Papers
Topics
Authors
Recent
Search
2000 character limit reached

Icy Moon Surface Simulation and Stereo Depth Estimation for Sampling Autonomy

Published 23 Jan 2024 in cs.CV, cs.GR, and cs.RO | (2401.12414v1)

Abstract: Sampling autonomy for icy moon lander missions requires understanding of topographic and photometric properties of the sampling terrain. Unavailability of high resolution visual datasets (either bird-eye view or point-of-view from a lander) is an obstacle for selection, verification or development of perception systems. We attempt to alleviate this problem by: 1) proposing Graphical Utility for Icy moon Surface Simulations (GUISS) framework, for versatile stereo dataset generation that spans the spectrum of bulk photometric properties, and 2) focusing on a stereo-based visual perception system and evaluating both traditional and deep learning-based algorithms for depth estimation from stereo matching. The surface reflectance properties of icy moon terrains (Enceladus and Europa) are inferred from multispectral datasets of previous missions. With procedural terrain generation and physically valid illumination sources, our framework can fit a wide range of hypotheses with respect to visual representations of icy moon terrains. This is followed by a study over the performance of stereo matching algorithms under different visual hypotheses. Finally, we emphasize the standing challenges to be addressed for simulating perception data assets for icy moons such as Enceladus and Europa. Our code can be found here: https://github.com/nasa-jpl/guiss.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (67)
  1. L. Roth, J. Saur, K. D. Retherford, D. F. Strobel, P. D. Feldman, M. A. McGrath, and F. Nimmo, “Transient water vapor at europa’s south pole,” science, vol. 343, no. 6167, pp. 171–174, 2014.
  2. C. J. Hansen, L. Esposito, A. Stewart, J. Colwell, A. Hendrix, W. Pryor, D. Shemansky, and R. West, “Enceladus’ water vapor plume,” Science, vol. 311, no. 5766, pp. 1422–1425, 2006.
  3. J. Dooley, “Mission concept for a europa lander,” in 2018 IEEE Aerospace Conference.   IEEE, 2018, pp. 1–10.
  4. K. Hand, A. Murray, J. Garvin, W. Brinckerhoff, B. Christner, K. Edgett, B. Ehlmann, C. German, A. Hayes, T. Hoehler et al., “Europa lander study 2016 report: Europa lander mission,” NASA Jet Propuls. Lab., La Cañada Flintridge, CA, USA, Tech. Rep. JPL D-97667, 2017.
  5. O. Grasset, M. Dougherty, A. Coustenis, E. Bunce, C. Erd, D. Titov, M. Blanc, A. Coates, P. Drossart, L. Fletcher et al., “Jupiter icy moons explorer (juice): An esa mission to orbit ganymede and to characterise the jupiter system,” Planetary and Space Science, vol. 78, pp. 1–21, 2013.
  6. T. Bayer, M. Bittner, B. Buffington, G. Dubos, E. Ferguson, I. Harris, M. Jackson, G. Lee, K. Lewis, J. Kastner et al., “Europa clipper mission: Preliminary design report,” in 2019 IEEE Aerospace Conference.   IEEE, 2019, pp. 1–24.
  7. T. Nordheim, K. Hand, and C. Paranicas, “Preservation of potential biosignatures in the shallow subsurface of europa,” Nature Astronomy, vol. 2, no. 8, pp. 673–679, 2018.
  8. F. Postberg, J. Schmidt, J. Hillier, S. Kempf, and R. Srama, “A salt-water reservoir as the source of a compositionally stratified plume on enceladus,” Nature, vol. 474, no. 7353, pp. 620–622, 2011.
  9. B. Buratti, J. Hillier, P. Dalba, M. Hicks, J. Mosher, A. Hendrix, L. Abramson, and N. Akhter, “Observations and modeling of the opposition surges of the icy moons of saturn based on cassini visual infrared mapping spectrometer data,” The Planetary Science Journal, vol. 3, no. 8, p. 200, 2022.
  10. I. A. Nesnas, L. M. Fesq, and R. A. Volpe, “Autonomy for space robots: Past, present, and future,” Current Robotics Reports, vol. 2, no. 3, pp. 251–263, 2021.
  11. H. Nayar, A. Goel, A. Boettcher, M. Hans, J. Sawoniewicz, A. Gaut, S. Higa, H. Ono, A. Jain, C. Lim et al., “Development of a lander autonomy testbed for ocean worlds missions,” in Earth and Space 2021, 2021, pp. 531–540.
  12. G. Adams, T. Green, A. Brinkman, B. Chamberlain-Simon, D. Neamati, L. Shiraishi, K. Kriechbaum, E. Roberts, D. Kim, C. Sercel et al., “Citadel: An icy worlds simulation testbed,” in Earth and Space 2021, 2020, pp. 428–443.
  13. M. Ono, G. Doran, E. Langert, K. Wagstaff, D. I. Kim, A. Gaut, T. Estlin, A. Jain, M. Cameron, D. Muliere et al., “Ariel: Autonomous excavation site selection for europa lander mission concept,” in 2020 IEEE Aerospace Conference.   IEEE, 2020, pp. 1–19.
  14. J. Bowkett, D. I. Kim, J. Nash, D. P. Moreno, M. Gildner, R. Thakker, K. Wehage, S.-K. Kim, A. Brinkman, B. Emanuel et al., “Demonstration of autonomous sampling techniques in an icy moon terrestrial analog,” in 2023 IEEE Aerospace Conference.   IEEE, 2023, pp. 1–15.
  15. D. Catanoso, A. Chakrabarty, J. Fugate, U. Naal, T. M. Welsh, and L. J. Edwards, “Oceanwaters lander robotic arm operation,” in 2021 IEEE Aerospace Conference (50100).   IEEE, 2021, pp. 1–11.
  16. M. Cameron, K. Hand, C. Phillips, J. Pitesky, M. Bramble, S. Brooks, M. Cable, K. Craft, E. Duffy, J. Hofgartner et al., “Science-driven preparations for landing on europa,” in 53rd Lunar and Planetary Science Conference, vol. 2678, 2022, p. 2470.
  17. A. Vorburger and P. Wurz, “Europa’s ice-related atmosphere: The sputter contribution,” Icarus, vol. 311, pp. 135–145, 2018.
  18. R. Pappalardo, S. Vance, F. Bagenal, B. Bills, D. Blaney, D. Blankenship, W. Brinckerhoff, J. Connerney, K. Hand, T. Hoehler et al., “Science potential from a europa lander,” Astrobiology, vol. 13, no. 8, pp. 740–773, 2013.
  19. G. B. Hansen and T. B. McCord, “Amorphous and crystalline ice on the galilean satellites: A balance between thermal and radiolytic processes,” Journal of Geophysical Research: Planets, vol. 109, no. E1, 2004.
  20. P. Helfenstein, N. Currier, B. Clark, J. Veverka, M. Bell, R. Sullivan, J. Klemaszewski, R. Greeley, R. Pappalardo, J. Head III et al., “Galileo observations of europa’s opposition effect,” Icarus, vol. 135, no. 1, pp. 41–63, 1998.
  21. D. Catanoso, T. Stucky, J. Case, and A. Rogg, “Analysis of sample acquisition dynamics using discrete element method,” in 2020 IEEE Aerospace Conference.   IEEE, 2020, pp. 1–11.
  22. L. J. Preston and L. R. Dartnell, “Planetary habitability: lessons learned from terrestrial analogues,” International Journal of Astrobiology, vol. 13, no. 1, pp. 81–98, 2014.
  23. C. C. Porco, P. Helfenstein, P. Thomas, A. Ingersoll, J. Wisdom, R. West, G. Neukum, T. Denk, R. Wagner, T. Roatsch et al., “Cassini observes the active south pole of enceladus,” science, vol. 311, no. 5766, pp. 1393–1401, 2006.
  24. S. F. Newman, B. Buratti, R. Brown, R. Jaumann, J. Bauer, and T. Momary, “Photometric and spectral analysis of the distribution of crystalline and amorphous ices on enceladus as seen by cassini,” Icarus, vol. 193, no. 2, pp. 397–406, 2008.
  25. F. Postberg, S. Kempf, J. Schmidt, N. Brilliantov, A. Beinsen, B. Abel, U. Buck, and R. Srama, “Sodium salts in e-ring ice grains from an ocean below the surface of enceladus,” Nature, vol. 459, no. 7250, pp. 1098–1101, 2009.
  26. S. Kempf, U. Beckmann, G. Moragas-Klostermeyer, F. Postberg, R. Srama, T. Economou, J. Schmidt, F. Spahn, and E. Grün, “The e ring in the vicinity of enceladus: I. spatial distribution and properties of the ring particles,” Icarus, vol. 193, no. 2, pp. 420–437, 2008.
  27. P. Helfenstein and C. C. Porco, “Enceladus’geysers: Relation to geological features,” The Astronomical Journal, vol. 150, no. 3, p. 96, 2015.
  28. E. N. Crow-Willard and R. T. Pappalardo, “Structural mapping of enceladus and implications for formation of tectonized regions,” Journal of Geophysical Research: Planets, vol. 120, no. 5, pp. 928–950, 2015.
  29. M. Hedman, P. Nicholson, M. Showalter, R. Brown, B. Buratti, and R. Clark, “Spectral observations of the enceladus plume with cassini-vims,” The Astrophysical Journal, vol. 693, no. 2, p. 1749, 2009.
  30. D. Dhingra, M. M. Hedman, R. N. Clark, and P. D. Nicholson, “Spatially resolved near infrared observations of enceladus’ tiger stripe eruptions from cassini vims,” Icarus, vol. 292, pp. 1–12, 2017.
  31. S. Kempf, U. Beckmann, and J. Schmidt, “How the enceladus dust plume feeds saturn’s e ring,” Icarus, vol. 206, no. 2, pp. 446–457, 2010.
  32. B. J. Buratti, “Enceladus: Implications of its unusual photometric properties,” Icarus, vol. 75, no. 1, pp. 113–126, 1988.
  33. R. H. Brown, R. N. Clark, B. J. Buratti, D. P. Cruikshank, J. W. Barnes, R. M. Mastrapa, J. Bauer, S. Newman, T. Momary, K. H. Baines et al., “Composition and physical properties of enceladus’ surface,” Science, vol. 311, no. 5766, pp. 1425–1428, 2006.
  34. R. T. Eapen, R. R. Bhaskara, and M. Majji, “Narpa: Navigation and rendering pipeline for astronautics,” arXiv preprint arXiv:2211.01566, 2022.
  35. R. Bhaskara, R. T. Eapen, and M. Majji, “Differentiable rendering for pose estimation in proximity operations,” in AIAA SCITECH 2023 Forum, 2023, p. 2317.
  36. S. Parkes, I. Martin, M. Dunstan, and D. Matthews, “Planet surface simulation with pangu,” in Space ops 2004 conference, 2004, p. 389.
  37. A. Jain, “Darts-multibody modeling, simulation and analysis software,” in Multibody Dynamics 2019: Proceedings of the 9th ECCOMAS Thematic Conference on Multibody Dynamics.   Springer, 2020, pp. 433–441.
  38. L. Bingham, J. Kincaid, B. Weno, N. Davis, E. Paddock, and C. Foreman, “Digital lunar exploration sites unreal simulation tool (dust),” in 2023 IEEE Aerospace Conference.   IEEE, 2023, pp. 1–12.
  39. O. Dubois-Matra, S. Parkes, and M. Dunstam, “Testing and validation of planetary vision-based navigation systems with pangu,” in 21st International Symposium on Space Flight Dynamics (ISSFD), 2009.
  40. R. Brochard, J. Lebreton, C. Robin, K. Kanani, G. Jonniaux, A. Masson, N. Despré, and A. Berjaoui, “Scientific image rendering for space scenes with the surrender software,” arXiv preprint arXiv:1810.01423, 2018.
  41. M. Pajusalu, I. Iakubivskyi, G. J. Schwarzkopf, O. Knuuttila, T. Väisänen, M. Bührer, M. F. Palos, H. Teras, G. Le Bonhomme, J. Praks et al., “Sispo: space imaging simulator for proximity operations,” PloS one, vol. 17, no. 3, p. e0263882, 2022.
  42. A. Jain, J. Guineau, C. Lim, W. Lincoln, M. Pomerantz, G. t. Sohl, and R. Steele, “Roams: Planetary surface rover simulation environment,” 2003.
  43. J. M. Cameron, A. Jain, P. D. Burkhart, E. S. Bailey, B. Balaram, E. Bonfiglio, M. Ivanov, J. Benito, E. Sklyanskiy, and W. Strauss, “Dsends: multi-mission flight dynamics simulator for nasa missions,” in AIAA SPACE 2016, 2016, p. 5421.
  44. C. Aiazzi, A. Jain, A. Gaut, A. Young, and A. Elmquist, “Iris: High-fidelity perception sensor modeling for closed-loop planetary simulations,” in AIAA SCITECH 2022 Forum, 2022, p. 1433.
  45. M. G. Müller, M. Durner, A. Gawel, W. Stürzl, R. Triebel, and R. Siegwart, “A photorealistic terrain simulation pipeline for unstructured outdoor environments,” in 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2021, pp. 9765–9772.
  46. M. Denninger, D. Winkelbauer, M. Sundermeyer, W. Boerdijk, M. Knauer, K. H. Strobl, M. Humt, and R. Triebel, “Blenderproc2: A procedural pipeline for photorealistic rendering,” Journal of Open Source Software, vol. 8, no. 82, p. 4901, 2023. [Online]. Available: https://doi.org/10.21105/joss.04901
  47. J. Cartucho, S. Tukra, Y. Li, D. S. Elson, and S. Giannarou, “Visionblender: a tool to efficiently generate computer vision datasets for robotic surgery,” Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, vol. 9, no. 4, pp. 331–338, 2021.
  48. L. Edwards, U. Wong, K. Dalal, C. Kulkarni, A. Rogg, A. Tardy, T. Stucky, O. Umurhan, D. Catanoso, and T. Welsh, “An autonomy software testbed simulation for ocean worlds missions,” in Earth and Space 2021, 2021, pp. 369–380.
  49. K. Perlin, “An image synthesizer,” ACM Siggraph Computer Graphics, vol. 19, no. 3, pp. 287–296, 1985.
  50. S. Worley, “A cellular texture basis function,” in Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, 1996, pp. 291–294.
  51. “Quadspinner gaea terrain modeling application,” https://quadspinner.com/, accessed: 2023-09-30.
  52. S. B. Goldberg, M. W. Maimone, and L. Matthies, “Stereo vision and rover navigation software for planetary exploration,” in Proceedings, IEEE aerospace conference, vol. 5.   IEEE, 2002, pp. 5–5.
  53. J. Bowkett, J. Nash, D. I. Kim, S.-K. Kim, R. Thakker, A. Brinkman, Y. Cheng, R. Willson, C. Lim, A. Gaut et al., “Functional autonomy challenges in sampling for an europa lander mission,” in 2021 IEEE Aerospace Conference (50100).   IEEE, 2021, pp. 1–8.
  54. D. Scharstein and R. Szeliski, “A taxonomy and evaluation of dense two-frame stereo correspondence algorithms,” International journal of computer vision, vol. 47, pp. 7–42, 2002.
  55. H. Laga, L. V. Jospin, F. Boussaid, and M. Bennamoun, “A survey on deep learning techniques for stereo-based depth estimation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 4, pp. 1738–1764, 2020.
  56. A. Geiger, P. Lenz, and R. Urtasun, “Are we ready for autonomous driving? the kitti vision benchmark suite,” in 2012 IEEE conference on computer vision and pattern recognition.   IEEE, 2012, pp. 3354–3361.
  57. M. Menze and A. Geiger, “Object scene flow for autonomous vehicles,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 3061–3070.
  58. N. Mayer, E. Ilg, P. Hausser, P. Fischer, D. Cremers, A. Dosovitskiy, and T. Brox, “A large dataset to train convolutional networks for disparity, optical flow, and scene flow estimation,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 4040–4048.
  59. T. Kanade, H. Kano, S. Kimura, A. Yoshida, and K. Oda, “Development of a video-rate stereo machine,” in Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots, vol. 3.   IEEE, 1995, pp. 95–100.
  60. F. Zhang, X. Qi, R. Yang, V. Prisacariu, B. Wah, and P. Torr, “Domain-invariant stereo matching networks,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part II 16.   Springer, 2020, pp. 420–439.
  61. G. Xu, X. Wang, X. Ding, and X. Yang, “Iterative geometry encoding volume for stereo matching,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 21 919–21 928.
  62. H. Aanæs, R. R. Jensen, G. Vogiatzis, E. Tola, and A. B. Dahl, “Large-scale data for multiple-view stereopsis,” International Journal of Computer Vision, vol. 120, pp. 153–168, 2016.
  63. “Quixel megascans,” https://quixel.com/megascans/home/, accessed: 2023-09-30.
  64. “Pix4d,” https://www.pix4d.com/product/pix4dmapper-photogrammetry-software/, accessed: 2023-09-30.
  65. D. Eigen, C. Puhrsch, and R. Fergus, “Depth map prediction from a single image using a multi-scale deep network,” Advances in neural information processing systems, vol. 27, 2014.
  66. Z. Li and N. Snavely, “Megadepth: Learning single-view depth prediction from internet photos,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 2041–2050.
  67. W. Chen, Z. Fu, D. Yang, and J. Deng, “Single-image depth perception in the wild,” Advances in neural information processing systems, vol. 29, 2016.
Citations (1)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up

GitHub

  1. GitHub - nasa-jpl/guiss (4 stars)  

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.

Sign Up for Free