Papers
Topics
Authors
Recent
Search
2000 character limit reached

Angle Sensitive Pixels for Lensless Imaging on Spherical Sensors

Published 28 Jun 2023 in cs.CV | (2306.15953v1)

Abstract: We propose OrbCam, a lensless architecture for imaging with spherical sensors. Prior work in lensless imager techniques have focused largely on using planar sensors; for such designs, it is important to use a modulation element, e.g. amplitude or phase masks, to construct a invertible imaging system. In contrast, we show that the diversity of pixel orientations on a curved surface is sufficient to improve the conditioning of the mapping between the scene and the sensor. Hence, when imaging on a spherical sensor, all pixels can have the same angular response function such that the lensless imager is comprised of pixels that are identical to each other and differ only in their orientations. We provide the computational tools for the design of the angular response of the pixels in a spherical sensor that leads to well-conditioned and noise-robust measurements. We validate our design in both simulation and a lab prototype. The implications of our design is that the lensless imaging can be enabled easily for curved and flexible surfaces thereby opening up a new set of application domains.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (23)
  1. Diffusercam: lensless single-exposure 3d imaging. Optica, 5(1):1–9, 2018.
  2. Flatcam: Thin, lensless cameras using coded aperture and computation. IEEE Transactions on Computational Imaging, 3(3):384–397, 2017.
  3. A. Beck and M. Teboulle. Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems. IEEE Transactions on Image Processing, 18(11):2419–2434, 2009.
  4. Phlatcam: Designed phase-mask based thin lensless camera. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020.
  5. Lensless Imaging: A computational renaissance. IEEE Signal Processing Magazine, 33(5):23–35, 2016.
  6. Lensless ultra-miniature imagers using odd-symmetry spiral phase gratings. In Imaging and Applied Optics, page CW4C.3, 2013.
  7. H. Groemer. Geometric applications of Fourier series and spherical harmonics, volume 61. Cambridge University Press, 1996.
  8. Highly curved image sensors: a practical approach for improved optical performance. Optics express, 25(12):13010–13023, 2017.
  9. A switchable light field camera architecture with angle sensitive pixels and dictionary-based sparse coding. In IEEE Intl. Conf. Computational Photography (ICCP), pages 1–10, 2014.
  10. Krill-eye: Superposition compound eye for wide-angle imaging via grin lenses. In IEEE International Conference on Computer Vision Workshops, 2009.
  11. A hemispherical electronic eye camera based on compressible silicon optoelectronics. Nature, 454(7205):748, 2008.
  12. A. Koppelhuber and O. Bimber. Thin-film camera using luminescent concentrators and an optical söller collimator. Opt. Express, 25(16):18526–18536, 2017.
  13. G. Krishnan and S. K. Nayar. Towards a true spherical camera. In Human Vision and Electronic Imaging XIV, volume 7240, page 724002. International Society for Optics and Photonics, 2009.
  14. Sparse image reconstruction on the sphere: implications of a new sampling theorem. IEEE Trans. Image Proc., 22(6):2275–2285, 2013.
  15. J. D. McEwen and Y. Wiaux. A novel sampling theorem on the sphere. IEEE Transactions on Signal Processing, 59(12):5876–5887, 2011.
  16. Flexible electronics: the next ubiquitous platform. Proceedings of the IEEE, 100(Special Centennial Issue):1486–1517, 2012.
  17. R. Ramamoorthi and P. Hanrahan. An efficient representation for irradiance environment maps. In ACM SIGGRAPH, pages 497–500, 2001.
  18. Stretchcam: Zooming using thin, elastic optics. arXiv preprint arXiv:1804.07052, 2018.
  19. Towards flexible sheet cameras: Deformable lens arrays with intrinsic optical adaptation. In IEEE International Conference on Computational Photography (ICCP), pages 1–11, 2016.
  20. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. In ACM SIGGRAPH, pages 527–536, 2002.
  21. Digital cameras with designs inspired by the arthropod eye. Nature, 497(7447):95, 2013.
  22. Thin observation module by bound optics (tombo): concept and experimental verification. Applied optics, 40(11):1806–1813, 2001.
  23. Angle sensitive pixels in cmos for lensless 3d imaging. In IEEE Custom Integrated Circuits Conference, pages 371–374. IEEE, 2009.
Citations (1)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.