Konstantin Willeke

Graduate Student

I am fascinated by the similarities between artificial neural networks and biological neural networks, and I am particularly interested in how machine learning algorithms and the brain are solving the complex task of vision. To gain insight into these matters, I am using deep neural networks to model the early visual cortex of monkeys and mice, to see in which cases these models work, and in which cases they do not. Using network dissection techniques and in silico experiments, my aim is to discover functional principles of artificial neural networks that are instructive for neuroscientific experiments, and that could lead to insights into the fundamentals of our cognitive system and its implementation. I am also passionate about open science, sharing of data and methods, and the movement of using AI to empower society.

Lab members are shown in this color.

2024

Polina Turishcheva, Paul G. Fahey, Michaela Vystrčilová, Laura Hansel, Rachel E Froebe, Kayla Ponder, Yongrong Qiu, Konstantin Friedrich Willeke, Mohammad Bashiri, Ruslan Baikulov, Yu Zhu, Lei Ma, Shan Yu, Tiejun Huang, Bryan M. Li, Wolf De Wulf, Nina Kudryashova, Matthias H. Hennig, Nathalie Rochefort, Arno Onken, Eric Wang, Zhiwei Ding, Andreas S. Tolias, Fabian H. Sinz, Alexander S Ecker Retrospective for the Dynamic Sensorium Competition for predicting large-scale mouse primary visual cortex activity from videos NeurIPS 2024 conference paper · system identification · competition page OpenReview
Taesung Jung, Nanyu Zeng, Jason D. Fabbri, Guy Eichler, Zhe Li, Konstantin Willeke, Katie E. Wingel, Agrita Dubey, Rizwan Huq, Mohit Sharma, Yaoxing Hu, Girish Ramakrishnan, Kevin Tien, Paolo Mantovani, Abhinav Parihar, Heyu Yin, Denise Oswalt, Alexander Misdorp, Ilke Uguz, Tori Shinn, Gabrielle J. Rodriguez, Cate Nealley, Ian Gonzales, Michael Roukes, Jeffrey Knecht, Daniel Yoshor, Peter Canoll, Eleonora Spinazzi, Luca P. Carloni, Bijan Pesaran, Saumil Patel, Brett Youngerman, R. James Cotton, Andreas Tolias, Kenneth L. Shepard Stable, chronic in-vivo recordings from a fully wireless subdural-contained 65,536-electrode brain-computer interface device bioRxiv preprint · system identification · bioRxiv
Jiakun Fu, Suhas Shrinivasan, Luca Baroni, Zhuokun Ding, Paul G. Fahey, Paweł Pierzchlewicz, Kayla Ponder, Rachel Froebe, Lydia Ntanavara, Taliah Muhammad, Konstantin F Willeke, Eric Wang, Zhiwei Ding, Dat T. Tran, Stelios Papadopoulos, Saumil Patel, Jacob Reimer, Alexander S. Ecker, Xaq Pitkow, Jan Antolik, Fabian H. Sinz, Ralf M. Haefner, Andreas S. Tolias, Katrin Franke Pattern completion and disruption characterize contextual modulation in the visual cortex bioRxiv preprint · neuroscience · bioRxiv twitter
Jiakun Fu, Pawel A. Pierzchlewicz, Konstantin F. Willeke, Mohammad Bashiri, Taliah Muhammad, Maria Diamantaki, Emmanouil Froudarakis, Kelli Restivo, Kayla Ponder, George H. Denfield, Fabian H. Sinz, Andreas S. Tolias, Katrin Franke Heterogeneous orientation tuning in primary visual cortex of mice diverges from Gabor-like receptive fields in primates Cell Reports journal paper · inception loops neuroscience · cell press
Santiago A. Cadena, Konstantin F. Willeke, Kelli Restivo, George Denfield, Fabian H. Sinz, Matthias Bethge, Andreas S. Tolias, Alexander S. Ecker Diverse task-driven modeling of macaque V4 reveals functional specialization towards semantic tasks PLoS Computational Biology journal paper · normative models · bioRxiv PLoS CB

2023

Max F. Burg, Thomas Zenkel, Michaela Vystrčilová, Jonathan Oesterle, Larissa Höfling, Konstantin F. Willeke, Jan Lause, Sarah Müller, Paul G. Fahey, Zhiwei Ding, Kelli Restivo, Shashwat Sridhar, Tim Gollisch, Philipp Berens, Andreas S. Tolias, Thomas Euler, Matthias Bethge, Alexander S. Ecker Most discriminative stimuli for functional cell type identification arXiv preprint · system identification · arXiv
Pawel A. Pierzchlewicz, Konstantin F. Willeke, Arne F. Nix, Pavithra Elumalai, Kelli Restivo, Tori Shinn, Cate Nealley, Gabrielle Rodriguez, Saumil Patel, Katrin Franke, Andreas S. Tolias, Fabian H. Sinz Energy Guided Diffusion for Generating Neurally Exciting Images NeurIPS conference paper · system identification · bioRxiv github paper · project page
Konstantin F. Willeke, Paul G. Fahey, Mohammad Bashiri, Laura Hansel, Christoph Blessing, Konstantin-Klemens Lurz, Max F. Burg, Santiago A. Cadena, Zhiwei Ding, Kayla Ponder, Taliah Muhammad, Saumil S. Patel, Kaiwen Deng, Yuanfang Guan, Yiqin Zhu, Kaiwen Xiao, Xiao Han, Simone Azeglio, Ulisse Ferrari, Peter Neri, Olivier Marre, Adrian Hoffmann, Kirill Fedyanin, Kirill Vishniakov, Maxim Panov, Subash Prakash, Kishan Naik, Kantharaju Narayanappa, Alexander S. Ecker, Andreas S. Tolias, Fabian H. Sinz Retrospective on the SENSORIUM 2022 competition Proceedings of Machine Learning Research journal paper · system identification · competition page PMLR pdf
Polina Turishcheva, Paul G. Fahey, Laura Hansel, Rachel Froebe, Kayla Ponder, Michaela Vystrčilová, Konstantin F. Willeke, Mohammad Bashiri, Eric Wang, Zhiwei Ding, Andreas S. Tolias, Fabian H. Sinz, Alexander S. Ecker The Dynamic Sensorium competition for predicting large-scale mouse visual cortex activity from videos arXiv preprint · system identification · arXiv
Konstantin F. Willeke¹, Kelli Restivo¹, Katrin Franke, Arne F. Nix, Santiago A. Cadena, Tori Shinn, Cate Nealley, Gabby Rodriguez, Saumil Patel, Alexander S. Ecker, Fabian H. Sinz², Andreas S. Tolias² Deep learning-driven characterization of single cell tuning in primate visual area V4 unveils topological organization bioRxiv , equal contribution: ¹, ² preprint · system identification · bioRxiv

2022

Luca Baroni¹, Mohammad Bashiri¹, Konstantin Friedrich Willeke, Ján Antolík, Fabian Sinz Learning Invariance Manifolds of Visual Sensory Neurons Neurips 2022 Workshop NeurReps , equal contribution: ¹ workshop paper · system identification · PMLR pdf
Katrin Franke¹, Konstantin F. Willeke¹, Kayla Ponder, Mario Galdamez, Taliah Muhammad, Saumil Patel, Emmanouil Froudarakis, Jacob Reimer, Fabian H. Sinz, Andreas S. Tolias State-dependent pupil dilation rapidly shifts visual feature selectivity Nature , equal contribution: ¹ journal paper · inception loops neuroscience · nature twitter biorXiv data code
Konstantin F. Willeke, Paul G. Fahey, Mohammad Bashiri, Laura Pede, Max F. Burg, Christoph Blessing, Santiago A. Cadena, Zhiwei Ding, Konstantin-Klemens Lurz, Kayla Ponder, Taliah Muhammad, Saumil S. Patel, Alexander S. Ecker, Andreas S. Tolias, Fabian H. Sinz The Sensorium competition on predicting large-scale mouse primary visual cortex activity arXiv preprint · system identification · arXiv challenge data

2021

Shahd Safarani, Arne Nix, Konstantin Willeke, Santiago A. Cadena, Kelli Restivo, George Denfield, Andreas S. Tolias, Fabian H. Sinz Towards robust vision by multi-task learning on monkey visual cortex NeurIPS conference paper · inductive bias transfer · arXiv github
Shahd Safarani, Arne Nix, Konstantin Willeke, Santiago A. Cadena, Kelli Restivo, George Denfield, Andreas S. Tolias, Fabian H. Sinz Towards robust vision by multi-task learning on monkey visual cortex ICLR 2021 Workshop: How Can Findings About The Brain Improve AI Systems? workshop paper · inductive bias transfer · workshop youtube pdf
Konstantin-Klemens Lurz, Mohammad Bashiri, Konstantin Friedrich Willeke, Akshay Kumar Jagadish, Eric Wang, Edgar Y Walker, Santiago Cadena, Taliah Muhammad, Eric Cobos, Andreas Tolias, Alexander Ecker, Fabian Sinz Generalization in data-driven models of primary visual cortex ICLR (spotlight) conference paper · system identification · openreview bioRxiv twitter data code youtube