Papers
Topics
Authors
Recent
Search
2000 character limit reached

Learning to combine top-down context and feed-forward representations under ambiguity with apical and basal dendrites

Published 9 Dec 2023 in q-bio.NC | (2312.05484v3)

Abstract: One of the hallmark features of neocortical anatomy is the presence of extensive top-down projections into primary sensory areas, with many impinging on the distal apical dendrites of pyramidal neurons. While it is known that they exert a modulatory effect, altering the gain of responses, their functional role remains an active area of research. It is hypothesized that these top-down projections carry contextual information that can help animals to resolve ambiguities in sensory data. One proposed mechanism of contextual integration is a non-linear integration of distinct input streams at apical and basal dendrites of pyramidal neurons. Computationally, however, it is yet to be demonstrated how such an architecture could leverage distinct compartments for flexible contextual integration and sensory processing when both sensory and context signals can be unreliable. Here, we implement an augmented deep neural network with distinct apical and basal compartments that integrates a) contextual information from top-down projections to apical compartments, and b) sensory representations driven by bottom-up projections to basal compartments, via a biophysically inspired rule. In addition, we develop a new multi-scenario contextual integration task using a generative image modeling approach. In addition to generalizing previous contextual integration tasks, it better captures the diversity of scenarios where neither contextual nor sensory information are fully reliable. To solve this task, this model successfully learns to select among integration strategies. We find that our model outperforms those without the "apical prior" when contextual information contradicts sensory input. Altogether, this suggests that the apical prior and biophysically inspired integration rule could be key components necessary for handling the ambiguities that animals encounter in the diverse contexts of the real world.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (53)
  1. “Cortical activity flips among quasi-stationary states.” Publisher: Proceedings of the National Academy of Sciences In Proceedings of the National Academy of Sciences 92.19, 1995, pp. 8616–8620 DOI: 10.1073/pnas.92.19.8616
  2. “Converging Neuronal Activity in Inferior Temporal Cortex during the Classification of Morphed Stimuli” In Cerebral Cortex 19.4, 2009, pp. 760–776 DOI: 10.1093/cercor/bhn125
  3. “Flamingo: a Visual Language Model for Few-Shot Learning” In Advances in Neural Information Processing Systems 35, 2022, pp. 23716–23736 URL: https://proceedings.neurips.cc/paper_files/paper/2022/hash/960a172bc7fbf0177ccccbb411a7d800-Abstract-Conference.html
  4. “On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation” Publisher: Public Library of Science In PLOS ONE 10.7, 2015, pp. e0130140 DOI: 10.1371/journal.pone.0130140
  5. “Canonical Microcircuits for Predictive Coding” In Neuron 76.4, 2012, pp. 695–711 DOI: 10.1016/j.neuron.2012.10.038
  6. Yoshua Bengio “Deriving Differential Target Propagation from Iterating Approximate Inverses” arXiv:2007.15139 [cs, stat] arXiv, 2020 DOI: 10.48550/arXiv.2007.15139
  7. “Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation” arXiv:1406.1078 [cs, stat] arXiv, 2014 URL: http://arxiv.org/abs/1406.1078
  8. “Brain-inspired predictive coding dynamics improve the robustness of deep neural networks”, 2020 URL: https://openreview.net/forum?id=q1o2mWaOssG
  9. “Learning to live with Dale’s principle: ANNs with separate excitatory and inhibitory units” Pages: 2020.11.02.364968 Section: New Results bioRxiv, 2021 DOI: 10.1101/2020.11.02.364968
  10. “Neural attractor dynamics in object recognition” In Experimental Brain Research 203.2, 2010, pp. 241–248 DOI: 10.1007/s00221-010-2243-1
  11. Carl Doersch “Tutorial on Variational Autoencoders” arXiv:1606.05908 [cs, stat] arXiv, 2021 DOI: 10.48550/arXiv.1606.05908
  12. Howard Eichenbaum “On the Integration of Space, Time, and Memory” In Neuron 95.5, 2017, pp. 1007–1018 DOI: 10.1016/j.neuron.2017.06.036
  13. Daniel J. Felleman and David C. Van Essen “Distributed Hierarchical Processing in the Primate Cerebral Cortex” In Cerebral Cortex 1.1, 1991, pp. 1–47 DOI: 10.1093/cercor/1.1.1-a
  14. “Cortico-cortical feedback engages active dendrites in visual cortex” Publisher: Nature Publishing Group In Nature, 2023, pp. 1–8 DOI: 10.1038/s41586-023-06007-6
  15. “A generative vision model that trains with high data efficiency and breaks text-based CAPTCHAs” Publisher: American Association for the Advancement of Science In Science 358.6368, 2017, pp. eaag2612 DOI: 10.1126/science.aag2612
  16. Charles D. Gilbert and Wu Li “Top-down influences on visual processing” Number: 5 Publisher: Nature Publishing Group In Nature Reviews Neuroscience 14.5, 2013, pp. 350–363 DOI: 10.1038/nrn3476
  17. Jordan Guerguiev, Timothy P. Lillicrap and Blake A. Richards “Towards deep learning with segregated dendrites” In eLife 6, 2017, pp. e22901 DOI: 10.7554/eLife.22901
  18. “Long-term priors influence visual perception through recruitment of long-range feedback” Number: 1 Publisher: Nature Publishing Group In Nature Communications 12.1, 2021, pp. 6288 DOI: 10.1038/s41467-021-26544-w
  19. “Hierarchical organization of cortical and thalamic connectivity” Number: 7781 Publisher: Nature Publishing Group In Nature 575.7781, 2019, pp. 195–202 DOI: 10.1038/s41586-019-1716-z
  20. Sarah Jarvis, Konstantin Nikolic and Simon R. Schultz “Neuronal gain modulability is determined by dendritic morphology: A computational optogenetic study” Publisher: Public Library of Science In PLOS Computational Biology 14.3, 2018, pp. e1006027 DOI: 10.1371/journal.pcbi.1006027
  21. Rebecca Jordan and Georg B. Keller “Opposing Influence of Top-down and Bottom-up Input on Excitatory Layer 2/3 Neurons in Mouse Primary Visual Cortex” In Neuron 108.6, 2020, pp. 1194–1206.e5 DOI: 10.1016/j.neuron.2020.09.024
  22. Kohitij Kar and James J. DiCarlo “Fast Recurrent Processing via Ventrolateral Prefrontal Cortex Is Needed by the Primate Ventral Stream for Robust Core Visual Object Recognition” In Neuron 109.1, 2021, pp. 164–176.e5 DOI: 10.1016/j.neuron.2020.09.035
  23. “Impaired mismatch negativity is associated with current functional status rather than genetic vulnerability to schizophrenia” In Psychiatry Research: Neuroimaging 222.1, 2014, pp. 100–106 DOI: 10.1016/j.pscychresns.2014.02.012
  24. Matthew Larkum “A cellular mechanism for cortical associations: an organizing principle for the cerebral cortex” Publisher: Elsevier In Trends in Neurosciences 36.3, 2013, pp. 141–151 DOI: 10.1016/j.tins.2012.11.006
  25. Matthew E. Larkum, J.Julius Zhu and Bert Sakmann “A new cellular mechanism for coupling inputs arriving at different cortical layers” Number: 6725 Publisher: Nature Publishing Group In Nature 398.6725, 1999, pp. 338–341 DOI: 10.1038/18686
  26. Matthew E. Larkum, Walter Senn and Hans-R. Lüscher “Top-down Dendritic Input Increases the Gain of Layer 5 Pyramidal Neurons” In Cerebral Cortex 14.10, 2004, pp. 1059–1070 DOI: 10.1093/cercor/bhh065
  27. “Dendritic Spikes in Apical Dendrites of Neocortical Layer 2/3 Pyramidal Neurons” Publisher: Society for Neuroscience Section: Articles In Journal of Neuroscience 27.34, 2007, pp. 8999–9008 DOI: 10.1523/JNEUROSCI.1717-07.2007
  28. “Difference Target Propagation” In Machine Learning and Knowledge Discovery in Databases, Lecture Notes in Computer Science Cham: Springer International Publishing, 2015, pp. 498–515 DOI: 10.1007/978-3-319-23528-8˙31
  29. Grace W. Lindsay “Attention in Psychology, Neuroscience, and Machine Learning” In Frontiers in Computational Neuroscience 14, 2020 URL: https://www.frontiersin.org/article/10.3389/fncom.2020.00029
  30. Lvd Maaten “Visualizing data using t-SNE” In Journal of Machine Learning Research 9.Nov, 2008, pp. 2579 URL: https://cir.nii.ac.jp/crid/1370567187575316229
  31. Stephen Maren, K.Luan Phan and Israel Liberzon “The contextual brain: implications for fear conditioning, extinction and psychopathology” Number: 6 Publisher: Nature Publishing Group In Nature Reviews Neuroscience 14.6, 2013, pp. 417–428 DOI: 10.1038/nrn3492
  32. “Anatomy of hierarchy: Feedforward and feedback pathways in macaque visual cortex” _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/cne.23458 In Journal of Comparative Neurology 522.1, 2014, pp. 225–259 DOI: 10.1002/cne.23458
  33. “A Theoretical Framework for Target Propagation” In Advances in Neural Information Processing Systems 33 Curran Associates, Inc., 2020, pp. 20024–20036 URL: https://proceedings.neurips.cc/paper/2020/hash/e7a425c6ece20cbc9056f98699b53c6f-Abstract.html
  34. “Learning to Combine Top-Down and Bottom-Up Signals in Recurrent Neural Networks with Attention over Modules” ISSN: 2640-3498 In Proceedings of the 37th International Conference on Machine Learning PMLR, 2020, pp. 6972–6986 URL: https://proceedings.mlr.press/v119/mittal20a.html
  35. D. Mumford “On the computational architecture of the neocortex” In Biological Cybernetics 66.3, 1992, pp. 241–251 DOI: 10.1007/BF00198477
  36. “Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts” In Advances in Neural Information Processing Systems 35, 2022, pp. 9564–9576 URL: https://proceedings.neurips.cc/paper_files/paper/2022/hash/3e67e84abf900bb2c7cbd5759bfce62d-Abstract-Conference.html
  37. J.J. Nassi, S.G. Lomber and R.T. Born “Corticocortical Feedback Contributes to Surround Suppression in V1 of the Alert Primate” In Journal of Neuroscience 33.19, 2013, pp. 8504–8517 DOI: 10.1523/JNEUROSCI.5124-12.2013
  38. Laura B Naumann, Joram Keijser and Henning Sprekeler “Invariant neural subspaces maintained by feedback modulation” Publisher: eLife Sciences Publications, Ltd In eLife 11, 2022, pp. e76096 DOI: 10.7554/eLife.76096
  39. “Learning Transferable Visual Models From Natural Language Supervision” arXiv:2103.00020 [cs] version: 1 arXiv, 2021 DOI: 10.48550/arXiv.2103.00020
  40. “Self-supervised learning of probabilistic prediction through synaptic plasticity in apical dendrites: A normative model” Pages: 2021.03.04.433822 Section: New Results bioRxiv, 2022 DOI: 10.1101/2021.03.04.433822
  41. Rajesh P.N. Rao and Dana H. Ballard “Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects” Number: 1 Publisher: Nature Publishing Group In Nature Neuroscience 2.1, 1999, pp. 79–87 DOI: 10.1038/4580
  42. “The importance of mixed selectivity in complex cognitive tasks” Number: 7451 Publisher: Nature Publishing Group In Nature 497.7451, 2013, pp. 585–590 DOI: 10.1038/nature12160
  43. “Neocortical Layer 1: An Elegant Solution to Top-Down and Bottom-Up Integration” _eprint: https://doi.org/10.1146/annurev-neuro-100520-012117 In Annual Review of Neuroscience 44.1, 2021, pp. 221–252 DOI: 10.1146/annurev-neuro-100520-012117
  44. “On the actions that one nerve cell can have on another: Distinguishing “drivers” from “modulators”” Publisher: Proceedings of the National Academy of Sciences In Proceedings of the National Academy of Sciences 95.12, 1998, pp. 7121–7126 DOI: 10.1073/pnas.95.12.7121
  45. Kihyuk Sohn, Honglak Lee and Xinchen Yan “Learning Structured Output Representation using Deep Conditional Generative Models” In Advances in Neural Information Processing Systems 28 Curran Associates, Inc., 2015 URL: https://proceedings.neurips.cc/paper/2015/hash/8d55a249e6baa5c06772297520da2051-Abstract.html
  46. Courtney J. Spoerer, Patrick McClure and Nikolaus Kriegeskorte “Recurrent Convolutional Neural Networks: A Better Model of Biological Object Recognition” In Frontiers in Psychology 8, 2017 URL: https://www.frontiersin.org/articles/10.3389/fpsyg.2017.01551
  47. Michael Spratling “Reconciling predictive coding and biased competition models of cortical function” In Frontiers in Computational Neuroscience 2, 2008 URL: https://www.frontiersin.org/articles/10.3389/neuro.10.004.2008
  48. Nelson Spruston “Pyramidal neurons: dendritic structure and synaptic integration” In Nature Reviews Neuroscience 9.3, 2008, pp. 206–221 DOI: 10.1038/nrn2286
  49. “Determinants of Voltage Attenuation in Neocortical Pyramidal Neuron Dendrites” Publisher: Society for Neuroscience Section: ARTICLE In Journal of Neuroscience 18.10, 1998, pp. 3501–3510 DOI: 10.1523/JNEUROSCI.18-10-03501.1998
  50. “Attention Is All You Need” arXiv:1706.03762 [cs] arXiv, 2023 URL: http://arxiv.org/abs/1706.03762
  51. “Feedback signals from cat’s area 21a enhance orientation selectivity of area 17 neurons” In Experimental Brain Research 182.4, 2007, pp. 479–490 DOI: 10.1007/s00221-007-1014-0
  52. “Supralinear Ca2+ Influx into Dendritic Tufts of Layer 2/3 Neocortical Pyramidal Neurons In Vitro and In Vivo” Publisher: Society for Neuroscience Section: Cellular/Molecular In Journal of Neuroscience 23.24, 2003, pp. 8558–8567 DOI: 10.1523/JNEUROSCI.23-24-08558.2003
  53. “Dendritic modulation enables multitask representation learning in hierarchical sensory processing pathways”, 2022 DOI: 10.1101/2022.11.25.517941
Citations (2)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 3 tweets with 4 likes about this paper.