2000 character limit reached
Reconstructing the normal and shape at specularities in endoscopy
Published 30 Nov 2023 in cs.CV | (2311.18299v1)
Abstract: Specularities are numerous in endoscopic images. They occur as many white small elliptic spots, which are generally ruled out as nuisance in image analysis and computer vision methods. Instead, we propose to use specularities as cues for 3D perception. Specifically, we propose a new method to reconstruct, at each specularity, the observed tissue's normal direction (i.e., its orientation) and shape (i.e., its curvature) from a single image. We show results on simulated and real interventional images.
- Computer vision: a modern approach, prentice hall professional technical reference, 2002.
- “Intra-operative monocular 3d reconstruction for image-guided navigation in active locomotion capsule endoscopy,” in 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob). IEEE, 2012, pp. 768–774.
- “Self-supervised monocular depth estimation for gastrointestinal endoscopy,” Computer Methods and Programs in Biomedicine, p. 107619, 2023.
- “Cyclesttn: A learning-based temporal model for specular augmentation in endoscopy,” in International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 2023, pp. 570–580.
- “Normal reconstruction from specularity in the endoscopic setting,” in 2023 IEEE 20th International Symposium on Biomedical Imaging (ISBI). IEEE, 2023, pp. 1–5.
- “Elliptical specularity detection in endoscopy with application to normal reconstruction,” International Journal of Computer Assisted Radiology and Surgery, pp. 1–6, 2023.
- “Endoslam dataset and an unsupervised monocular visual odometry and depth estimation approach for endoscopic videos,” Medical image analysis, vol. 71, pp. 102058, 2021.
- “Implicit domain adaptation with conditional generative adversarial networks for depth prediction in endoscopy,” International journal of computer assisted radiology and surgery, vol. 14, pp. 1167–1176, 2019.
- James F Blinn, “Models of light reflection for computer synthesized pictures,” in Proceedings of the 4th annual conference on Computer graphics and interactive techniques, 1977, pp. 192–198.
- Brent Burley and Walt Disney Animation Studios, “Physically-based shading at disney,” in Acm Siggraph. vol. 2012, 2012, vol. 2012, pp. 1–7.
- “Harmonic coordinates for character articulation,” ACM Transactions on Graphics (TOG), vol. 26, no. 3, pp. 71–es, 2007.
- Szymon Rusinkiewicz, “Estimating curvatures and their derivatives on triangle meshes,” in Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004. IEEE, 2004, pp. 486–493.
- “Using multiple images and contours for deformable 3d–2d registration of a preoperative ct in laparoscopic liver surgery,” International Journal of Computer Assisted Radiology and Surgery, vol. 17, no. 12, pp. 2211–2219, 2022.
- “Deformable registration of a preoperative 3d liver volume to a laparoscopy image using contour and shading cues,” in International conference on medical image computing and computer-assisted intervention. Springer, 2017, pp. 326–334.
- “Endomapper dataset of complete calibrated endoscopy procedures,” Scientific Data, vol. 10, no. 1, pp. 671, 2023.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.