2000 character limit reached
Long Range Constraints for Neural Texture Synthesis Using Sliced Wasserstein Loss
Published 21 Nov 2022 in cs.CV | (2211.11137v2)
Abstract: In the past decade, exemplar-based texture synthesis algorithms have seen strong gains in performance by matching statistics of deep convolutional neural networks. However, these algorithms require regularization terms or user-added spatial tags to capture long range constraints in images. Having access to a user-added spatial tag for all situations is not always feasible, and regularization terms can be difficult to tune. Thus, we propose a new set of statistics for texture synthesis based on Sliced Wasserstein Loss, create a multi-scale method to synthesize textures without a user-added spatial tag, study the ability of our proposed method to capture long range constraints, and compare our results to other optimization-based, single texture synthesis algorithms.
- Bela Julesz. “Visual pattern discrimination,” in IRE Transactions on Information Theory, vol. 8, no. 2, pp. 84–92, 196, 1962.
- D. J. Heeger and J. R. Bergen. “Pyramid-based texture analysis/synthesis,” in Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, ACM, 1995, pp. 229–238.
- Javier Portilla and Eero P Simoncelli. “A parametric texture model based on joint statistics of complex wavelet coefficients,” in International Journal of Computer Vision, vol. 40, no. 1, pp. 49–70, 2000.
- Pitie, Francois and Kokaram, Anil C and Dahyot, Rozenn “N-dimensional probability density function transfer and its application to color transfer,” in Tenth IEEE International Conference on Computer Vision (ICCV’05) Volume 1, 2005.
- “Very Deep Convolutional Networks for Large-Scale Image Recognition,” in International Conference on Learning Representations (ICLR), May 2015.
- “Image style transfer using convolutional neural networks,” in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015.
- “Texture synthesis using convolutional neural networks,” in Advances in Neural Information Processing Systems 28, 2015, pp. 262–270.
- “Texture synthesis through convolutional neural networks and spectrum constraints,” in International Conference on Pattern Recognition (ICPR), December 2016.
- Xavier Snelgrove. “High-resolution multi-scale neural texture synthesis,” in SIGGRAPH Asia 2017 Technical Briefs, SA ’17, New York, NY, USA, 2017. Association for Computing Machinery.
- “Deep correlations for texture synthesis,” in ACM Trans. Graph., 36(4), July 2017.
- “High resolution neural texture synthesis with long range constraints,” in Journal of Mathematical Imaging and Vision 64:478–492, 2022.
- “ Non-stationary texture synthesis by adversarial expansion,” in ACM Transactions on Graphics (ToG), vol. 37, ACM, 2018, pp.1-13, 2018.
- ‘Wasserstein loss for image synthesis and restoration,” in ACM Transactions on Graphics (ToG), vol. 24, ACM, 2005, pp. 795–802.
- “Variational Texture Synthesis with Sparsity and Spectrum Constraints,” in Journal of Mathematical Imaging and Vision, 52:124–144, 2015.
- ‘A Sliced Wasserstein Loss for Neural Texture Synthesis,” in In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2021.
- ‘Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesis,” in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), April 2019.
- ‘Transposer: Universal Texture Synthesis Using Feature Maps as Transposed Convolution Filter,” in arXiv:2007.07243 [cs.CV], July 2020.
- ‘Neural FFTs for Universal Texture Image Synthesis,” in Proceedings of the 34th International Conference on Neural Information Processing Systems (NIPS), April 2020.
- ‘The unreasonable effectiveness of deep features as a perceptual metric,” in Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2018.
- ‘Gans trained by a two time-scale update rule converge to a local nash equilibrium,” in Advances in neural information processing systems (NIPS), 2017.
- ‘Demystifying MMD GANs,” in International Conference on Learning Representations (ICLR), 2018.
- ‘On Aliased Resizing and Surprising Subtleties in GAN Evaluation,” in Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2022.
- ‘Effectively unbiased fid and inception score and where to find them,” in Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2020.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.