Papers
Topics
Authors
Recent
Search
2000 character limit reached

Gradient-free neural topology optimization: Towards effective fracture-resistant designs

Published 7 Mar 2024 in cs.LG, cs.NA, and math.NA | (2403.04937v2)

Abstract: Gradient-free optimizers allow for tackling problems regardless of the smoothness or differentiability of their objective function, but they require many more iterations to converge when compared to gradient-based algorithms. This has made them unviable for topology optimization due to the high computational cost per iteration and the high dimensionality of these problems. We propose a gradient-free neural topology optimization method using a pre-trained neural reparameterization strategy that addresses two key challenges in the literature. First, the method leads to at least one order of magnitude decrease in iteration count to reach minimum compliance when optimizing designs in latent space, as opposed to the conventional gradient-free approach without latent parameterization. This helps to bridge the large performance gap between gradient-free and gradient-based topology optimization for smooth and differentiable problems like compliance optimization, as demonstrated via extensive computational experiments in- and out-of-distribution with the training data. Second, we also show that the proposed method can optimize toughness of a structure undergoing brittle fracture more effectively than a traditional gradient-based optimizer, delivering an objective improvement in the order of 30% for all tested configurations. Although gradient-based topology optimization is more efficient for problems that are differentiable and well-behaved, such as compliance optimization, we believe that this work opens up a new path for problems where gradient-based algorithms have limitations.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (60)
  1. Topology optimization approaches: A comparative review. Structural and multidisciplinary optimization, 48(6):1031–1055, 2013.
  2. On the use of artificial neural networks in topology optimisation. Structural and Multidisciplinary Optimization, 65(10):294, 2022.
  3. Topology optimization of multi-scale structures: a review. Structural and Multidisciplinary Optimization, 63:1455–1480, 2021.
  4. Topology optimization of structures undergoing brittle fracture. Journal of Computational Physics, 458:111048, 2022.
  5. Topology optimization of particle-matrix composites for optimal fracture resistance taking into account interfacial damage. International Journal for Numerical Methods in Engineering, 115(5):604–626, 2018.
  6. Topology and shape optimization for elastoplastic structural response. Computer methods in applied mechanics and engineering, 190(15-17):2135–2155, 2001.
  7. Comparing results of 31 algorithms from the black-box optimization benchmarking bbob-2009. In Proceedings of the 12th annual conference companion on Genetic and evolutionary computation, pages 1689–1696, 2010.
  8. Ole Sigmund. On the usefulness of non-gradient approaches in topology optimization. Structural and Multidisciplinary Optimization, 43:589–596, 2011.
  9. Topology optimization for brittle fracture resistance. Computer Methods in Applied Mechanics and Engineering, 347:238–263, 2019.
  10. An indirect design representation for topology optimization using variational autoencoder and style transfer. In 2018 AIAA/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference, page 0804, 2018.
  11. Efficient topology optimization in matlab using 88 lines of code. Structural and Multidisciplinary Optimization, 43:1–16, 2011.
  12. Neural reparameterization improves structural optimization. arXiv preprint arXiv:1909.04240, 2019.
  13. Tonr: An exploration for a novel way combining neural network with topology optimization. Computer Methods in Applied Mechanics and Engineering, 386:114083, 2021.
  14. Adjoint formulations for topology, shape and discrete optimization. In 45th AIAA Aerospace Sciences Meeting and Exhibit, page 55, 2007.
  15. A unified approach for topology optimization with local stress constraints considering various failure criteria: von mises, drucker–prager, tresca, mohr–coulomb, bresler–pister and willam–warnke. Proceedings of the Royal Society A, 476(2238):20190861, 2020.
  16. Material nonlinear topology optimization considering the von mises criterion through an asymptotic approach: Max strain energy and max load factor formulations. International Journal for Numerical Methods in Engineering, 118(13):804–828, 2019.
  17. Performance evaluation of a two stage adaptive genetic algorithm (tsaga) in structural topology optimization. Applied Soft Computing, 8(4):1607–1624, 2008.
  18. A two phase approach based on skeleton convergence and geometric variables for topology optimization using genetic algorithm. Structural and Multidisciplinary Optimization, 43:381–404, 2011.
  19. Multi-modal topological optimization of structure using immune algorithm. Computer Methods in Applied Mechanics and Engineering, 193(36-38):4035–4055, 2004.
  20. Structural topology optimization using ant colony methodology. Engineering Structures, 30(9):2559–2565, 2008.
  21. Structural topology optimization using ant colony optimization algorithm. Applied Soft Computing, 9(4):1343–1353, 2009.
  22. A binary particle swarm optimization for continuum structural topology optimization. Applied Soft Computing, 11(2):2833–2844, 2011.
  23. Generating optimal configurations in structural design using simulated annealing. International journal for numerical methods in engineering, 40(6):1053–1069, 1997.
  24. A new structural optimization method based on the harmony search algorithm. Computers & structures, 82(9-10):781–798, 2004.
  25. Topology optimization of structures using modified binary differential evolution. Structural and Multidisciplinary Optimization, 42:939–953, 2010.
  26. Structured variationally auto-encoded optimization. In International conference on machine learning, pages 3267–3275. PMLR, 2018.
  27. Improving black-box optimization in vae latent space using decoder uncertainty. Advances in Neural Information Processing Systems, 34:802–814, 2021.
  28. Sample-efficient optimization in the latent space of deep generative models via weighted retraining. Advances in Neural Information Processing Systems, 33:11259–11272, 2020.
  29. Generative adversarial nets. Advances in neural information processing systems, 27, 2014.
  30. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114, 2013.
  31. Deep unsupervised learning using nonequilibrium thermodynamics. In International conference on machine learning, pages 2256–2265. PMLR, 2015.
  32. Diffusion models beat gans on image synthesis. Advances in neural information processing systems, 34:8780–8794, 2021.
  33. Optimization of physical quantities in the autoencoder latent space. Scientific Reports, 12(1):9003, 2022.
  34. Constrained bayesian optimization for automatic chemical design using variational autoencoders. Chemical science, 11(2):577–586, 2020.
  35. Fast topology optimization for pm motors using variational autoencoder and neural networks with dropout. IEEE Transactions on Magnetics, 2023.
  36. Robust topology optimization using variational autoencoders. arXiv preprint arXiv:2107.10661, 2021.
  37. Topology optimization via machine learning and deep learning: A review. Journal of Computational Design and Engineering, 10(4):1736–1766, 2023.
  38. A survey of machine learning techniques in structural and multidisciplinary optimization. Structural and Multidisciplinary Optimization, 65(9):266, 2022.
  39. Topologygan: Topology optimization using generative adversarial networks based on physical fields over the initial domain. Journal of Mechanical Design, 143(3):031715, 2021.
  40. Deep generative design: Integration of topology optimization and generative models. Journal of Mechanical Design, 141(11):111405, 2019.
  41. Diffusion models beat gans on topology optimization. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), Washington, DC, 2023.
  42. Tounn: Topology optimization using neural networks. Structural and Multidisciplinary Optimization, 63:1135–1149, 2021.
  43. Length scale control in topology optimization using fourier enhanced neural networks. arXiv preprint arXiv:2109.01861, 2021.
  44. Completely derandomized self-adaptation in evolution strategies. Evolutionary computation, 9(2):159–195, 2001.
  45. The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 586–595, 2018.
  46. Latent bernoulli autoencoder. In Hal Daumé III and Aarti Singh, editors, Proceedings of the 37th International Conference on Machine Learning, volume 119 of Proceedings of Machine Learning Research, pages 2964–2974. PMLR, 13–18 Jul 2020.
  47. Autoencoding beyond pixels using a learned similarity metric. In International conference on machine learning, pages 1558–1566. PMLR, 2016.
  48. Neural networks for topology optimization. Russian Journal of Numerical Analysis and Mathematical Modelling, 34(4):215–223, 2019.
  49. Krister Svanberg. The method of moving asymptotes—a new method for structural optimization. International journal for numerical methods in engineering, 24(2):359–373, 1987.
  50. Ole Sigmund. On benchmarking and good scientific practise in topology optimization. Structural and Multidisciplinary Optimization, 65(11):315, 2022.
  51. Robert Tjarko Lange. evosax: Jax-based evolution strategies. arXiv preprint arXiv:2212.04180, 2022.
  52. Nikolaus Hansen. Benchmarking a bi-population cma-es on the bbob-2009 function testbed. In Proceedings of the 11th annual conference companion on genetic and evolutionary computation conference: late breaking papers, pages 2389–2396, 2009.
  53. Optimal design of microwave absorber using novel variational autoencoder from a latent space search strategy. Materials & Design, 212:110266, 2021.
  54. Particle swarm optimization. In Proceedings of ICNN’95-international conference on neural networks, volume 4, pages 1942–1948. IEEE, 1995.
  55. Rainer Storn. Differrential evolution-a simple and efficient adaptive scheme for global optimization over continuous spaces. Technical report, International Computer Science Institute, 11, 1995.
  56. Discovering evolution strategies via meta-black-box optimization. In Proceedings of the Companion Conference on Genetic and Evolutionary Computation, pages 29–30, 2023.
  57. Deep neuroevolution: Genetic algorithms are a competitive alternative for training deep neural networks for reinforcement learning. arXiv preprint arXiv:1712.06567, 2017.
  58. An efficient 3d topology optimization code written in matlab. Structural and Multidisciplinary Optimization, 50:1175–1196, 2014.
  59. Deep image prior. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 9446–9454, 2018.
  60. On the spectral bias of neural networks. In International Conference on Machine Learning, pages 5301–5310. PMLR, 2019.

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Authors (2)

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 1 like about this paper.