Papers
Topics
Authors
Recent
Search
2000 character limit reached

Scattering and Gathering for Spatially Varying Blurs

Published 10 Mar 2023 in eess.SP | (2303.05687v2)

Abstract: A spatially varying blur kernel $h(\mathbf{x},\mathbf{u})$ is specified by an input coordinate $\mathbf{u} \in \mathbb{R}2$ and an output coordinate $\mathbf{x} \in \mathbb{R}2$. For computational efficiency, we sometimes write $h(\mathbf{x},\mathbf{u})$ as a linear combination of spatially invariant basis functions. The associated pixelwise coefficients, however, can be indexed by either the input coordinate or the output coordinate. While appearing subtle, the two indexing schemes will lead to two different forms of convolutions known as scattering and gathering, respectively. We discuss the origin of the operations. We discuss conditions under which the two operations are identical. We show that scattering is more suitable for simulating how light propagates and gathering is more suitable for image filtering such as denoising.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (37)
  1. S. H. Chan, “Constructing a sparse convolution matrix for shift varying image restoration problems,” in 2010 IEEE International Conference on Image Processing, 2010, pp. 3601–3604.
  2. “Analyzing spatially-varying blur,” in 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2010, pp. 2512–2519.
  3. “Estimating spatially varying defocus blur from a single image,” IEEE Transactions on Image Processing, vol. 22, no. 12, pp. 4879–4891, 2013.
  4. “Probabilistic modeling and inference for sequential space-varying blur identification,” IEEE Transactions on Computational Imaging, vol. 7, pp. 531–546, 2021.
  5. M. M. Sondhi, “Image restoration: The removal of spatially invariant degradations,” Proceedings of the IEEE, vol. 60, no. 7, pp. 842–853, 1972.
  6. “Degradation aware approach to image restoration using knowledge distillation,” IEEE Journal of Selected Topics in Signal Processing, vol. 15, no. 2, pp. 162–173, 2021.
  7. D. O’Connor and L. Vandenberghe, “Total variation image deblurring with space-varying kernel,” Computational Optimization and Applications, vol. 67, no. 3, pp. 521–541, Jul 2017.
  8. B. Saleh and N. Subotic, “Time-variant filtering of signals in the mixed time frequency domain,” IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 33, no. 6, pp. 1479–1485, 1985.
  9. “Time-varying filter banks and wavelets,” IEEE Transactions on Signal Processing, vol. 42, no. 11, pp. 2983–2996, 1994.
  10. “Time-varying analysis-synthesis systems based on filter banks and post filtering,” IEEE Transactions on Signal Processing, vol. 43, no. 11, pp. 2512–2524, 1995.
  11. F. Wang and V. Balakrishnan, “Robust kalman filters for linear time-varying systems with stochastic parametric uncertainties,” IEEE Transactions on Signal Processing, vol. 50, no. 4, pp. 803–813, 2002.
  12. “A tutorial on particle filters for online nonlinear/non-gaussian bayesian tracking,” IEEE Transactions on Signal Processing, vol. 50, no. 2, pp. 174–188, 2002.
  13. G. Wang, “The most general time-varying filter bank and time-varying lapped transforms,” IEEE Transactions on Signal Processing, vol. 54, no. 10, pp. 3775–3789, 2006.
  14. Tod Lauer, “Deconvolution with a spatially variant psf,” in Astronomical data analysis II. SPIE, 2002, vol. 4847, pp. 167–173.
  15. “Anisoplanatic deconvolution of adaptive optics images,” J. Opt. Soc. Am. A, vol. 22, no. 3, pp. 504–513, Mar 2005.
  16. “Efficient filter flow for space-variant multiframe blind deconvolution,” in 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2010, pp. 607–614.
  17. “A parallel product-convolution approach for representing depth varying point spread functions in 3d widefield microscopy based on principal component analysis,” Opt. Express, vol. 18, no. 7, pp. 6461–6476, Mar 2010.
  18. “Efficient spatially adaptive convolution and correlation,” Tech. Rep. 2006.13188, arXiv preprint, Jun 2020.
  19. “Deep learning for fast spatially varying deconvolution,” Optica, vol. 9, no. 1, pp. 96–99, Jan 2022.
  20. “Product-convolution operators and mixed-norm spaces,” Transactions of the American Mathematical Society, vol. 263, no. 2, pp. 309–341, 1981.
  21. “The design and use of steerable filters,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 13, no. 9, pp. 891–906, 1991.
  22. “Restoring images degraded by spatially variant blur,” SIAM Journal on Scientific Computing, vol. 19, no. 4, pp. 1063–1082, 1998.
  23. “Accurate and efficient method for smoothly space-variant gaussian blurring,” IEEE Transactions on Image Processing, vol. 19, no. 5, pp. 1362–1370, 2010.
  24. Signals & Systems (2nd Ed.), Prentice-Hall, Inc., USA, 1996.
  25. “Accelerating atmospheric turbulence simulation via learned phase-to-space transform,” in Proc. IEEE/CVF International Conference on Computer Vision (ICCV), October 2021, pp. 14759–14768.
  26. “Approximation of integral operators using product-convolution expansions,” Journal of Mathematical Imaging and Vision, vol. 58, no. 3, pp. 333–348, Jul 2017.
  27. “Scalable matrix-free adaptive product-convolution approximation for locally translation-invariant operators,” SIAM Journal on Scientific Computing, vol. 41, no. 4, pp. A2296–A2328, 2019.
  28. J. W. Goodman, Introduction to Fourier Optics, Roberts and Company, Englewood, Colorado, 3 edition, 2005.
  29. “Computational imaging through atmospheric turbulence,” Foundations and Trends® in Computer Graphics and Vision, vol. 15, no. 4, pp. 253–508, 2023.
  30. N. Chimitt and S. H. Chan, “Simulating anisoplanatic turbulence by sampling intermodal and spatially correlated Zernike coefficients,” Optical Engineering, vol. 59, no. 8, pp. 1 – 26, 2020.
  31. “Real-time dense field phase-to-space simulation of imaging through atmospheric turbulence,” IEEE Transactions on Computational Imaging, vol. 8, pp. 1159–1169, 2022.
  32. “Bridging the gap between computational photography and visual recognition: 5⁢t⁢h5𝑡ℎ5th5 italic_t italic_h UG2+limit-fromUG2\text{UG2}+UG2 + prize challenge,” http://cvpr2022.ug2challenge.org/dataset22_t3.html, Track 3.
  33. “Neutralizing the impact of atmospheric turbulence on complex scene imaging via deep learning,” Nature Machine Intelligence, vol. 3, pp. 876–884, 2021.
  34. “Real-world video deblurring: A benchmark dataset and an efficient recurrent neural network,” International Journal of Computer Vision, pp. 1–18, 2022.
  35. “Imaging through the atmosphere using turbulence mitigation transformer,” Tech. Rep. 2207.06465, arXiv preprint, Jul 2022.
  36. “A convergent overlapping domain decomposition method for total variation minimization,” Numerische Mathematik, vol. 116, no. 4, pp. 645–685, Oct 2010.
  37. “Deblurring dynamic scenes via spatially varying recurrent neural networks,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 8, pp. 3974–3987, 2022.
Citations (6)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up

Tweets

Sign up for free to view the 2 tweets with 42 likes about this paper.

Sign Up for Free