Learning to combine top-down context and feed-forward representations under ambiguity with apical and basal dendrites
Abstract: One of the hallmark features of neocortical anatomy is the presence of extensive top-down projections into primary sensory areas, with many impinging on the distal apical dendrites of pyramidal neurons. While it is known that they exert a modulatory effect, altering the gain of responses, their functional role remains an active area of research. It is hypothesized that these top-down projections carry contextual information that can help animals to resolve ambiguities in sensory data. One proposed mechanism of contextual integration is a non-linear integration of distinct input streams at apical and basal dendrites of pyramidal neurons. Computationally, however, it is yet to be demonstrated how such an architecture could leverage distinct compartments for flexible contextual integration and sensory processing when both sensory and context signals can be unreliable. Here, we implement an augmented deep neural network with distinct apical and basal compartments that integrates a) contextual information from top-down projections to apical compartments, and b) sensory representations driven by bottom-up projections to basal compartments, via a biophysically inspired rule. In addition, we develop a new multi-scenario contextual integration task using a generative image modeling approach. In addition to generalizing previous contextual integration tasks, it better captures the diversity of scenarios where neither contextual nor sensory information are fully reliable. To solve this task, this model successfully learns to select among integration strategies. We find that our model outperforms those without the "apical prior" when contextual information contradicts sensory input. Altogether, this suggests that the apical prior and biophysically inspired integration rule could be key components necessary for handling the ambiguities that animals encounter in the diverse contexts of the real world.
- “Cortical activity flips among quasi-stationary states.” Publisher: Proceedings of the National Academy of Sciences In Proceedings of the National Academy of Sciences 92.19, 1995, pp. 8616–8620 DOI: 10.1073/pnas.92.19.8616
- “Converging Neuronal Activity in Inferior Temporal Cortex during the Classification of Morphed Stimuli” In Cerebral Cortex 19.4, 2009, pp. 760–776 DOI: 10.1093/cercor/bhn125
- “Flamingo: a Visual Language Model for Few-Shot Learning” In Advances in Neural Information Processing Systems 35, 2022, pp. 23716–23736 URL: https://proceedings.neurips.cc/paper_files/paper/2022/hash/960a172bc7fbf0177ccccbb411a7d800-Abstract-Conference.html
- “On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation” Publisher: Public Library of Science In PLOS ONE 10.7, 2015, pp. e0130140 DOI: 10.1371/journal.pone.0130140
- “Canonical Microcircuits for Predictive Coding” In Neuron 76.4, 2012, pp. 695–711 DOI: 10.1016/j.neuron.2012.10.038
- Yoshua Bengio “Deriving Differential Target Propagation from Iterating Approximate Inverses” arXiv:2007.15139 [cs, stat] arXiv, 2020 DOI: 10.48550/arXiv.2007.15139
- “Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation” arXiv:1406.1078 [cs, stat] arXiv, 2014 URL: http://arxiv.org/abs/1406.1078
- “Brain-inspired predictive coding dynamics improve the robustness of deep neural networks”, 2020 URL: https://openreview.net/forum?id=q1o2mWaOssG
- “Learning to live with Dale’s principle: ANNs with separate excitatory and inhibitory units” Pages: 2020.11.02.364968 Section: New Results bioRxiv, 2021 DOI: 10.1101/2020.11.02.364968
- “Neural attractor dynamics in object recognition” In Experimental Brain Research 203.2, 2010, pp. 241–248 DOI: 10.1007/s00221-010-2243-1
- Carl Doersch “Tutorial on Variational Autoencoders” arXiv:1606.05908 [cs, stat] arXiv, 2021 DOI: 10.48550/arXiv.1606.05908
- Howard Eichenbaum “On the Integration of Space, Time, and Memory” In Neuron 95.5, 2017, pp. 1007–1018 DOI: 10.1016/j.neuron.2017.06.036
- Daniel J. Felleman and David C. Van Essen “Distributed Hierarchical Processing in the Primate Cerebral Cortex” In Cerebral Cortex 1.1, 1991, pp. 1–47 DOI: 10.1093/cercor/1.1.1-a
- “Cortico-cortical feedback engages active dendrites in visual cortex” Publisher: Nature Publishing Group In Nature, 2023, pp. 1–8 DOI: 10.1038/s41586-023-06007-6
- “A generative vision model that trains with high data efficiency and breaks text-based CAPTCHAs” Publisher: American Association for the Advancement of Science In Science 358.6368, 2017, pp. eaag2612 DOI: 10.1126/science.aag2612
- Charles D. Gilbert and Wu Li “Top-down influences on visual processing” Number: 5 Publisher: Nature Publishing Group In Nature Reviews Neuroscience 14.5, 2013, pp. 350–363 DOI: 10.1038/nrn3476
- Jordan Guerguiev, Timothy P. Lillicrap and Blake A. Richards “Towards deep learning with segregated dendrites” In eLife 6, 2017, pp. e22901 DOI: 10.7554/eLife.22901
- “Long-term priors influence visual perception through recruitment of long-range feedback” Number: 1 Publisher: Nature Publishing Group In Nature Communications 12.1, 2021, pp. 6288 DOI: 10.1038/s41467-021-26544-w
- “Hierarchical organization of cortical and thalamic connectivity” Number: 7781 Publisher: Nature Publishing Group In Nature 575.7781, 2019, pp. 195–202 DOI: 10.1038/s41586-019-1716-z
- Sarah Jarvis, Konstantin Nikolic and Simon R. Schultz “Neuronal gain modulability is determined by dendritic morphology: A computational optogenetic study” Publisher: Public Library of Science In PLOS Computational Biology 14.3, 2018, pp. e1006027 DOI: 10.1371/journal.pcbi.1006027
- Rebecca Jordan and Georg B. Keller “Opposing Influence of Top-down and Bottom-up Input on Excitatory Layer 2/3 Neurons in Mouse Primary Visual Cortex” In Neuron 108.6, 2020, pp. 1194–1206.e5 DOI: 10.1016/j.neuron.2020.09.024
- Kohitij Kar and James J. DiCarlo “Fast Recurrent Processing via Ventrolateral Prefrontal Cortex Is Needed by the Primate Ventral Stream for Robust Core Visual Object Recognition” In Neuron 109.1, 2021, pp. 164–176.e5 DOI: 10.1016/j.neuron.2020.09.035
- “Impaired mismatch negativity is associated with current functional status rather than genetic vulnerability to schizophrenia” In Psychiatry Research: Neuroimaging 222.1, 2014, pp. 100–106 DOI: 10.1016/j.pscychresns.2014.02.012
- Matthew Larkum “A cellular mechanism for cortical associations: an organizing principle for the cerebral cortex” Publisher: Elsevier In Trends in Neurosciences 36.3, 2013, pp. 141–151 DOI: 10.1016/j.tins.2012.11.006
- Matthew E. Larkum, J.Julius Zhu and Bert Sakmann “A new cellular mechanism for coupling inputs arriving at different cortical layers” Number: 6725 Publisher: Nature Publishing Group In Nature 398.6725, 1999, pp. 338–341 DOI: 10.1038/18686
- Matthew E. Larkum, Walter Senn and Hans-R. Lüscher “Top-down Dendritic Input Increases the Gain of Layer 5 Pyramidal Neurons” In Cerebral Cortex 14.10, 2004, pp. 1059–1070 DOI: 10.1093/cercor/bhh065
- “Dendritic Spikes in Apical Dendrites of Neocortical Layer 2/3 Pyramidal Neurons” Publisher: Society for Neuroscience Section: Articles In Journal of Neuroscience 27.34, 2007, pp. 8999–9008 DOI: 10.1523/JNEUROSCI.1717-07.2007
- “Difference Target Propagation” In Machine Learning and Knowledge Discovery in Databases, Lecture Notes in Computer Science Cham: Springer International Publishing, 2015, pp. 498–515 DOI: 10.1007/978-3-319-23528-8˙31
- Grace W. Lindsay “Attention in Psychology, Neuroscience, and Machine Learning” In Frontiers in Computational Neuroscience 14, 2020 URL: https://www.frontiersin.org/article/10.3389/fncom.2020.00029
- Lvd Maaten “Visualizing data using t-SNE” In Journal of Machine Learning Research 9.Nov, 2008, pp. 2579 URL: https://cir.nii.ac.jp/crid/1370567187575316229
- Stephen Maren, K.Luan Phan and Israel Liberzon “The contextual brain: implications for fear conditioning, extinction and psychopathology” Number: 6 Publisher: Nature Publishing Group In Nature Reviews Neuroscience 14.6, 2013, pp. 417–428 DOI: 10.1038/nrn3492
- “Anatomy of hierarchy: Feedforward and feedback pathways in macaque visual cortex” _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/cne.23458 In Journal of Comparative Neurology 522.1, 2014, pp. 225–259 DOI: 10.1002/cne.23458
- “A Theoretical Framework for Target Propagation” In Advances in Neural Information Processing Systems 33 Curran Associates, Inc., 2020, pp. 20024–20036 URL: https://proceedings.neurips.cc/paper/2020/hash/e7a425c6ece20cbc9056f98699b53c6f-Abstract.html
- “Learning to Combine Top-Down and Bottom-Up Signals in Recurrent Neural Networks with Attention over Modules” ISSN: 2640-3498 In Proceedings of the 37th International Conference on Machine Learning PMLR, 2020, pp. 6972–6986 URL: https://proceedings.mlr.press/v119/mittal20a.html
- D. Mumford “On the computational architecture of the neocortex” In Biological Cybernetics 66.3, 1992, pp. 241–251 DOI: 10.1007/BF00198477
- “Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts” In Advances in Neural Information Processing Systems 35, 2022, pp. 9564–9576 URL: https://proceedings.neurips.cc/paper_files/paper/2022/hash/3e67e84abf900bb2c7cbd5759bfce62d-Abstract-Conference.html
- J.J. Nassi, S.G. Lomber and R.T. Born “Corticocortical Feedback Contributes to Surround Suppression in V1 of the Alert Primate” In Journal of Neuroscience 33.19, 2013, pp. 8504–8517 DOI: 10.1523/JNEUROSCI.5124-12.2013
- Laura B Naumann, Joram Keijser and Henning Sprekeler “Invariant neural subspaces maintained by feedback modulation” Publisher: eLife Sciences Publications, Ltd In eLife 11, 2022, pp. e76096 DOI: 10.7554/eLife.76096
- “Learning Transferable Visual Models From Natural Language Supervision” arXiv:2103.00020 [cs] version: 1 arXiv, 2021 DOI: 10.48550/arXiv.2103.00020
- “Self-supervised learning of probabilistic prediction through synaptic plasticity in apical dendrites: A normative model” Pages: 2021.03.04.433822 Section: New Results bioRxiv, 2022 DOI: 10.1101/2021.03.04.433822
- Rajesh P.N. Rao and Dana H. Ballard “Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects” Number: 1 Publisher: Nature Publishing Group In Nature Neuroscience 2.1, 1999, pp. 79–87 DOI: 10.1038/4580
- “The importance of mixed selectivity in complex cognitive tasks” Number: 7451 Publisher: Nature Publishing Group In Nature 497.7451, 2013, pp. 585–590 DOI: 10.1038/nature12160
- “Neocortical Layer 1: An Elegant Solution to Top-Down and Bottom-Up Integration” _eprint: https://doi.org/10.1146/annurev-neuro-100520-012117 In Annual Review of Neuroscience 44.1, 2021, pp. 221–252 DOI: 10.1146/annurev-neuro-100520-012117
- “On the actions that one nerve cell can have on another: Distinguishing “drivers” from “modulators”” Publisher: Proceedings of the National Academy of Sciences In Proceedings of the National Academy of Sciences 95.12, 1998, pp. 7121–7126 DOI: 10.1073/pnas.95.12.7121
- Kihyuk Sohn, Honglak Lee and Xinchen Yan “Learning Structured Output Representation using Deep Conditional Generative Models” In Advances in Neural Information Processing Systems 28 Curran Associates, Inc., 2015 URL: https://proceedings.neurips.cc/paper/2015/hash/8d55a249e6baa5c06772297520da2051-Abstract.html
- Courtney J. Spoerer, Patrick McClure and Nikolaus Kriegeskorte “Recurrent Convolutional Neural Networks: A Better Model of Biological Object Recognition” In Frontiers in Psychology 8, 2017 URL: https://www.frontiersin.org/articles/10.3389/fpsyg.2017.01551
- Michael Spratling “Reconciling predictive coding and biased competition models of cortical function” In Frontiers in Computational Neuroscience 2, 2008 URL: https://www.frontiersin.org/articles/10.3389/neuro.10.004.2008
- Nelson Spruston “Pyramidal neurons: dendritic structure and synaptic integration” In Nature Reviews Neuroscience 9.3, 2008, pp. 206–221 DOI: 10.1038/nrn2286
- “Determinants of Voltage Attenuation in Neocortical Pyramidal Neuron Dendrites” Publisher: Society for Neuroscience Section: ARTICLE In Journal of Neuroscience 18.10, 1998, pp. 3501–3510 DOI: 10.1523/JNEUROSCI.18-10-03501.1998
- “Attention Is All You Need” arXiv:1706.03762 [cs] arXiv, 2023 URL: http://arxiv.org/abs/1706.03762
- “Feedback signals from cat’s area 21a enhance orientation selectivity of area 17 neurons” In Experimental Brain Research 182.4, 2007, pp. 479–490 DOI: 10.1007/s00221-007-1014-0
- “Supralinear Ca2+ Influx into Dendritic Tufts of Layer 2/3 Neocortical Pyramidal Neurons In Vitro and In Vivo” Publisher: Society for Neuroscience Section: Cellular/Molecular In Journal of Neuroscience 23.24, 2003, pp. 8558–8567 DOI: 10.1523/JNEUROSCI.23-24-08558.2003
- “Dendritic modulation enables multitask representation learning in hierarchical sensory processing pathways”, 2022 DOI: 10.1101/2022.11.25.517941
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.