Panoptic segmentation of microscopic images of neuronal cell cultures

How to apply

Who to contact?	sinz@cs.uni-goettingen.de
Email subject	Start with "[ML Master]"
What to include?	All applications What you are studying (e.g. "Master in Applied Data Science") Statement of motivation (max 300 words) outlining your personal interest in our research areas. A short list of which relevant skills you have and which you would like to acquire. A list of courses you have taken and corresponding grades Known programming languages and experience Possible start date If you apply with your own project idea A concise (max 300 words) “research proposal” on a project you would be interested working on. This is not binding but helps to get the conversation started.

Sartorius and Göttingen University are looking for a student to take part in developing state-of-the-art deep learning-based methods for panoptic segmentation of microscopic images of neuronal cell cultures.

Example phase contrast images of neuronal cell cultures (left) with corresponding annotations overlain (right), where cell bodies are green, neurites are blue and clusters where individual cells can not be separated by eye are brown.

Background

Using light microscopy to study the behavior of cell cultures is widely used to understand the biological effect of new drug treatments. Thanks to automation, far more microscopic images can now be acquired than any human can possibly analyze manually. This means that computer vision-based analysis is crucial for pushing the field of cell biology forward, and due to the complexity of microscopic images deep learning-based approaches are essential. Sartorius has recently published LIVECell, a large-scale resource to enable deep learning-based instance segmentation of individual cells1. During the preparation of LIVECell, neuronal cell types proved particularly challenging due to their convex morphologies. To address this challenge, Sartorius has put together a specialized dataset of manually annotated images of neuronal cell cultures (see example in the Figure). This neuronal dataset comes with additional non-annotated images, allowing the use of semi-supervised approaches to image segmentation.

Project aims

The purpose of this project is to use the newly assembled dataset to train and compare deep learning-based models that segment microscopic images of neuronal cell cultures.

• Train a supervised baseline model for panoptic segmentation, meaning simultaneous segmentation of neuronal cell bodies and neurites, on annotated images and evaluate performance using the panoptic quality (PQ)-metric.
• Train at least one model using semi/self-supervised learning leveraging both annotated and non-annotated images and compare it to the supervised baseline model.

Point of contact at Sartorius

Rickard Sjögren, PhD. Senior Research Scientist, Sartorius Corporate Research. Rickard.Sjogren@Sartorius.com. Please CC sinz@cs.uni-goettingen.de and ecker@cs.uni-goettingen.de.

References:

1. Edlund, C., Jackson, T.R., Khalid, N. et al. LIVECell—A large-scale dataset for label-free live cell segmentation. Nat Methods (2021). https://doi.org/10.1038/s41592-021-01249-6

2. Kirillov, A., He, K., Girshick, R., Rother, C., & Dollár, P. (2019). Panoptic segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 9404-9413).