Few-shot adaptation for morphology-independent cell instance segmentation
Abstract: Microscopy data collections are becoming larger and more frequent. Accurate and precise quantitative analysis tools like cell instance segmentation are necessary to benefit from them. This is challenging due to the variability in the data, which requires retraining the segmentation model to maintain high accuracy on new collections. This is needed especially for segmenting cells with elongated and non-convex morphology like bacteria. We propose to reduce the amount of annotation and computing power needed for retraining the model by introducing a few-shot domain adaptation approach that requires annotating only one to five cells of the new data to process and that quickly adapts the model to maintain high accuracy. Our results show a significant boost in accuracy after adaptation to very challenging bacteria datasets.
- H. Jeckel and K. Drescher, “Advances and opportunities in image analysis of bacterial cells and communities,” FEMS Microbiol. Rev., vol. 45, no. 4, Aug. 2021.
- “MicrobeJ, a tool for high throughput bacterial cell detection and quantitative analysis,” Nat Microbiol, vol. 1, no. 7, pp. 16077, June 2016.
- “Cellpose: a generalist algorithm for cellular segmentation,” Nat. Methods, vol. 18, no. 1, pp. 100–106, Jan. 2021.
- “Omnipose: a high-precision morphology-independent solution for bacterial cell segmentation,” Nat. Methods, pp. 1–11, Oct. 2022.
- H. Shimodaira, “Improving predictive inference under covariate shift by weighting the log-likelihood function,” J. Stat. Plan. Inference, vol. 90, no. 2, pp. 227–244, Oct. 2000.
- “Cell detection with star-convex polygons,” in MICCAI, 2018, pp. 265–273.
- “Whole-cell segmentation of tissue images with human-level performance using large-scale data annotation and deep learning,” Nat. Biotechnol., Nov. 2021.
- “Misic, a general deep learning-based method for the high-throughput cell segmentation of complex bacterial communities,” Elife, vol. 10, Sept. 2021.
- “Unified deep supervised domain adaptation and generalization,” in ICCV, Oct. 2017.
- H. Guan and M. Liu, “Domain adaptation for medical image analysis: A survey,” IEEE Trans. Biomed. Eng., vol. 69, no. 3, pp. 1173–1185, Mar. 2022.
- “Generative adversarial networks in medical image segmentation: A review,” Comput. Biol. Med., vol. 140, pp. 105063, Nov. 2021.
- “DALSA: Domain adaptation for supervised learning from sparsely annotated MR images,” IEEE Trans. Med. Imaging, vol. 35, no. 1, pp. 184–196, Jan. 2016.
- “Boundary-Weighted domain adaptive neural network for prostate MR image segmentation,” IEEE Trans. Med. Imaging, vol. 39, no. 3, pp. 753–763, Mar. 2020.
- “A domain-adaptive two-stream U-Net for electron microscopy image segmentation,” in ISBI, Apr. 2018, pp. 400–404.
- M. Javanmardi and T. Tasdizen, “Domain adaptation for biomedical image segmentation using adversarial training,” in ISBI, Apr. 2018, pp. 554–558.
- “Noise adaptation generative adversarial network for medical image analysis,” IEEE Trans. Med. Imaging, vol. 39, no. 4, pp. 1149–1159, Apr. 2020.
- “Minimizing labeling cost for nuclei instance segmentation and classification with cross-domain images and weak labels,” AAAI, vol. 35, no. 1, pp. 697–705, May 2021.
- “PDAM: A Panoptic-Level feature alignment framework for unsupervised domain adaptive instance segmentation in microscopy images,” IEEE Trans. Med. Imaging, vol. 40, no. 1, pp. 154–165, Jan. 2021.
- “CellTranspose: Few-shot Domain Adaptation for Cellular Instance Segmentation,” in IEEE/CVF WACV, Jan. 2023, pp. 455–466.
- “Diversity takes shape: Understanding the mechanistic and adaptive basis of bacterial morphology,” PLoS Biol., vol. 14, no. 10, pp. e1002565, Oct. 2016.
- Deep learning, vol. 1, MIT press Cambridge, 2016.
- “A simple framework for contrastive learning of visual representations,” in ICML, Hal Daumé Iii and Aarti Singh, Eds., 2020, vol. 119, pp. 1597–1607.
- “An open-source platform for analyzing and sharing worm-behavior data,” Nature methods, vol. 15, no. 9, pp. 645–646, 2018.
- “Annotated high-throughput microscopy image sets for validation.,” Nature methods, vol. 9, no. 7, pp. 637–637, 2012.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.