Papers
Topics
Authors
Recent
Search
2000 character limit reached

Entanglement transition in deep neural quantum states

Published 19 Dec 2023 in quant-ph and cond-mat.dis-nn | (2312.11941v1)

Abstract: Despite the huge theoretical potential of neural quantum states, their use in describing generic, highly-correlated quantum many-body systems still often poses practical difficulties. Customized network architectures are under active investigation to address these issues. For a guided search of suited network architectures a deepened understanding of the link between neural network properties and attributes of the physical system one is trying to describe, is imperative. Drawing inspiration from the field of machine learning, in this work we show how information propagation in deep neural networks impacts the physical entanglement properties of deep neural quantum states. In fact, we link a previously identified information propagation phase transition of a neural network to a similar transition of entanglement in neural quantum states. With this bridge we can identify optimal neural quantum state hyperparameter regimes for representing area as well as volume law entangled states. The former are easily accessed by alternative methods, such as tensor network representations, at least in low physical dimensions, while the latter are challenging to describe generally due to their extensive quantum entanglement. This advance of our understanding of network configurations for accurate quantum state representation helps to develop effective representations to deal with volume-law quantum states, and we apply these findings to describe the ground state (area law state) vs. the excited state (volume law state) properties of the prototypical next-nearest neighbor spin-1/2 Heisenberg model.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (40)
  1. Solving the quantum many-body problem with artificial neural networks. Science 355, 602–606 (2017). URL https://doi.org/10.1126/science.aag2302.
  2. Quantum entanglement in neural network states. Phys. Rev. X 7, 021021 (2017). URL https://link.aps.org/doi/10.1103/PhysRevX.7.021021.
  3. Neural-network quantum states, string-bond states, and chiral topological states. Physical Review X 8 (2018). URL https://doi.org/10.1103/physrevx.8.011006.
  4. Chiral topological phases from artificial neural networks. Physical Review B 97 (2018). URL https://doi.org/10.1103/physrevb.97.195136.
  5. Two-dimensional frustrated j1-j2 model studied with neural network quantum states. Physical Review B 100 (2019). URL https://doi.org/10.1103/physrevb.100.125124.
  6. Investigating ultrafast quantum magnetism with machine learning. SciPost Phys. 7, 004 (2019). URL https://scipost.org/10.21468/SciPostPhys.7.1.004.
  7. Quantum many-body dynamics in two dimensions with artificial neural networks. Physical Review Letters 125 (2020). URL https://doi.org/10.1103/physrevlett.125.100503.
  8. Supermagnonic propagation in two-dimensional antiferromagnets. Physical Review Letters 127 (2021). URL https://doi.org/10.1103/physrevlett.127.097202.
  9. Astrakhantsev, N. et al. Broken-symmetry ground states of the heisenberg model on the pyrochlore lattice. Physical Review X 11 (2021). URL https://doi.org/10.1103/physrevx.11.041021.
  10. Learning the ground state of a non-stoquastic quantum Hamiltonian in a rugged neural network landscape. SciPost Phys. 10, 147 (2021). URL https://scipost.org/10.21468/SciPostPhys.10.6.147.
  11. High-accuracy variational monte carlo for frustrated magnets with deep neural networks (2022). URL https://arxiv.org/abs/2211.07749.
  12. Optimizing design choices for neural quantum states. Phys. Rev. B 107, 195115 (2023). URL https://link.aps.org/doi/10.1103/PhysRevB.107.195115.
  13. Neural tensor contractions and the expressive power of deep neural quantum states. Phys. Rev. B 106, 205136 (2022). URL https://link.aps.org/doi/10.1103/PhysRevB.106.205136.
  14. Neural-network quantum states for a two-leg bose-hubbard ladder under magnetic flux. Phys. Rev. A 106, 063320 (2022). URL https://link.aps.org/doi/10.1103/PhysRevA.106.063320.
  15. Learning a compass spin model with neural network quantum states. Journal of Physics: Condensed Matter 34, 125802 (2022). URL https://dx.doi.org/10.1088/1361-648X/ac43ff.
  16. Szoldra, T. Fidelity and overlap of neural quantum states: Error bounds on the monte carlo estimator (2023). eprint arXiv:2311.14820.
  17. A unifying view of fermionic neural network quantum states: From neural network backflow to hidden fermion determinant states (2023). eprint arXiv:2311.09450.
  18. Autoregressive neural Slater-Jastrow ansatz for variational Monte Carlo simulation. SciPost Phys. 14, 171 (2023). URL https://scipost.org/10.21468/SciPostPhys.14.6.171.
  19. Nomura, Y. Boltzmann machines and quantum many-body problems. Journal of Physics: Condensed Matter 36, 073001 (2023). URL https://dx.doi.org/10.1088/1361-648X/ad0916.
  20. Efficient representation of quantum many-body states with deep neural networks. Nature Communications 8 (2017). URL https://doi.org/10.1038/s41467-017-00705-2.
  21. Quantum entanglement in deep learning architectures. Phys. Rev. Lett. 122, 065301 (2019). URL https://link.aps.org/doi/10.1103/PhysRevLett.122.065301.
  22. Entanglement features of random neural network quantum states. Phys. Rev. B 106, 115138 (2022). URL https://link.aps.org/doi/10.1103/PhysRevB.106.115138.
  23. Constructing exact representations of quantum many-body systems with deep neural networks. Nature Communications 9 (2018). URL https://doi.org/10.1038/s41467-018-07520-3.
  24. On the expressive power of deep neural networks (2016). eprint arXiv:1606.05336.
  25. Neural networks and deep learning: a brief introduction. Intensive Care Medicine 45, 712–714 (2019). URL https://doi.org/10.1007/s00134-019-05537-w.
  26. Sarker, I. H. Deep learning: A comprehensive overview on techniques, taxonomy, applications and research directions. SN Computer Science 2 (2021). URL https://doi.org/10.1007/s42979-021-00815-1.
  27. Sparsity-depth tradeoff in infinitely wide deep neural networks (2023). eprint arXiv:2305.10550.
  28. Deep dynamic neural network to trade-off between accuracy and diversity in a news recommender system (2021). eprint arXiv:2103.08458.
  29. Scaling of neural-network quantum states for time evolution. physica status solidi (b) 259, 2100172 (2022). URL https://doi.org/10.1002/pssb.202100172.
  30. Passetti, G. et al. Can neural quantum states learn volume-law ground states? Phys. Rev. Lett. 131, 036502 (2023). URL https://link.aps.org/doi/10.1103/PhysRevLett.131.036502.
  31. Fidelity of interpretability methods and perturbation artifacts in neural networks (2022). eprint arXiv:2203.02928.
  32. Exponential expressivity in deep neural networks through transient chaos. In Lee, D., Sugiyama, M., Luxburg, U., Guyon, I. & Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 29 (Curran Associates, Inc., 2016). URL https://proceedings.neurips.cc/paper/2016/file/148510031349642de5ca0c544f31b2ef-Paper.pdf.
  33. Deep information propagation. ArXiv abs/1611.01232 (2017).
  34. Absorbing phase transitions in artificial deep neural networks (2023). eprint arXiv:2307.02284.
  35. Colloquium: Area laws for the entanglement entropy. Reviews of Modern Physics 82, 277–306 (2010). URL https://doi.org/10.1103/revmodphys.82.277.
  36. Volume-law entanglement entropy of typical pure quantum states. PRX Quantum 3, 030201 (2022). URL https://link.aps.org/doi/10.1103/PRXQuantum.3.030201.
  37. Self-normalizing neural networks (2017). URL https://arxiv.org/abs/1706.02515. eprint arXiv:1706.02515.
  38. Vicentini, F. et al. NetKet 3: Machine Learning Toolbox for Many-Body Quantum Systems. SciPost Phys. Codebases 7 (2022). URL https://scipost.org/10.21468/SciPostPhysCodeb.7.
  39. Carleo, G. et al. NetKet: A machine learning toolkit for many-body quantum systems. SoftwareX 10, 100311 (2019). URL https://doi.org/10.1016/j.softx.2019.100311.
  40. Bradbury, J. et al. JAX: composable transformations of Python+NumPy programs (2018). URL http://github.com/google/jax.
Citations (3)

Summary

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.