2000 character limit reached
GauStudio: A Modular Framework for 3D Gaussian Splatting and Beyond
Published 28 Mar 2024 in cs.CV | (2403.19632v1)
Abstract: We present GauStudio, a novel modular framework for modeling 3D Gaussian Splatting (3DGS) to provide standardized, plug-and-play components for users to easily customize and implement a 3DGS pipeline. Supported by our framework, we propose a hybrid Gaussian representation with foreground and skyball background models. Experiments demonstrate this representation reduces artifacts in unbounded outdoor scenes and improves novel view synthesis. Finally, we propose Gaussian Splatting Surface Reconstruction (GauS), a novel render-then-fuse approach for high-fidelity mesh reconstruction from 3DGS inputs without fine-tuning. Overall, our GauStudio framework, hybrid representation, and GauS approach enhance 3DGS modeling and rendering capabilities, enabling higher-quality novel view synthesis and surface reconstruction.
- Large-scale data for multiple-view stereopsis. International Journal of Computer Vision, 2016.
- 360-gs: Layout-guided panoramic gaussian splatting for indoor roaming. Feb 2024.
- Mip-nerf 360: Unbounded anti-aliased neural radiance fields. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022.
- pixelsplat: 3d gaussian splats from image pairs for scalable generalizable 3d reconstruction. Dec 2023.
- Neusg: Neural implicit surface reconstruction with 3d gaussian splatting guidance. Dec 2023.
- Masked-attention mask transformer for universal image segmentation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
- Gaussianpro: 3d gaussian splatting with progressive propagation. Feb 2024.
- Dkm: Dense kernelized feature matching for geometry estimation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.
- Lightgaussian: Unbounded 3d gaussian compression with 15x reduction and 200+ fps. Nov 2023.
- Trips: Trilinear point splatting for real-time radiance field rendering. Jan 2024.
- Plenoxels: Radiance fields without neural networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022.
- Colmap-free 3d gaussian splatting. arXiv preprint arXiv:2312.07504, 2023.
- Relightable 3d gaussian: Real-time point cloud relighting with brdf decomposition and ray tracing. Nov 2023.
- Eagles: Efficient accelerated 3d gaussians with lightweight encodings. Dec 2023.
- Sugar: Surface-aligned gaussian splatting for efficient 3d mesh reconstruction and high-quality mesh rendering. Nov 2023.
- Multiple view geometry in computer vision. Cambridge university press, 2003.
- Deep blending for free-viewpoint image-based rendering. ACM Transactions on Graphics (ToG), 2018.
- Gaussianshader: 3d gaussian splatting with shading functions for reflective surfaces. Nov 2023.
- Cotracker: It is better to track together. arXiv preprint arXiv:2307.07635, 2023.
- Poisson surface reconstruction. In Proceedings of the fourth Eurographics symposium on Geometry processing, 2006.
- Screened poisson surface reconstruction. ACM Transactions on Graphics (ToG), 2013.
- Splatam: Splat, track & map 3d gaussians for dense rgb-d slam. arXiv preprint arXiv:2312.02126, 2023.
- 3d gaussian splatting for real-time radiance field rendering. ACM Transactions on Graphics, 2023.
- Tanks and temples: Benchmarking large-scale scene reconstruction. ACM Transactions on Graphics, 2017.
- Deblurring 3d gaussian splatting. Jan 2024.
- Compact 3d gaussian representation for radiance field. arXiv preprint arXiv:2311.13681, 2023.
- Spec-nerf: Multi-spectral neural radiance fields. arXiv preprint arXiv:2310.12987, 2023.
- Gs-ir: 3d gaussian splatting for inverse rendering. Nov 2023.
- Vastgaussian: Vast 3d gaussians for large scene reconstruction. Feb 2024.
- Capturing, reconstructing, and simulating: the urbanscene3d dataset. In ECCV, 2022.
- Scaffold-gs: Structured 3d gaussians for view-adaptive rendering. arXiv preprint arXiv:2312.00109, 2023.
- Nerf: Representing scenes as neural radiance fields for view synthesis. Communications of the ACM, 2021.
- Instant neural graphics primitives with a multiresolution hash encoding. ACM transactions on graphics (TOG), 2022.
- Compact3d: Compressing gaussian splat radiance field models with vector quantization. Nov 2023.
- Relightable gaussian codec avatars. Dec 2023.
- Point-slam: Dense neural point cloud-based slam. In Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
- From coarse to fine: Robust hierarchical localization at large scale. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019.
- Structure-from-motion revisited. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2016.
- Language embedded 3d gaussians for open-vocabulary scene understanding. Nov 2023.
- Gir: 3d gaussian inverse rendering for relightable scene factorization. Dec 2023.
- Loftr: Detector-free local feature matching with transformers. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021.
- Splatter image: Ultra-fast single-view 3d reconstruction. Dec 2023.
- Lgm: Large multi-view gaussian model for high-resolution 3d content creation. arXiv preprint arXiv:2402.05054, 2024.
- Mega-nerf: Scalable construction of large-scale nerfs for virtual fly-throughs. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2022.
- Vdbfusion: Flexible and efficient tsdf integration of range sensor data. Sensors, 2022.
- Games: Mesh-based adapting and modification of gaussian splatting. arXiv preprint arXiv:2402.01459, 2024.
- Neus: Learning neural implicit surfaces by volume rendering for multi-view reconstruction. arXiv preprint arXiv:2106.10689, 2021.
- Tracking everything everywhere all at once. arXiv preprint arXiv:2306.05422, 2023.
- Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, 2004.
- Voxurf: Voxel-based efficient and accurate neural surface reconstruction. arXiv preprint arXiv:2208.12697, 2022.
- Mars: An instance-aware, modular and realistic simulator for autonomous driving. In CAAI International Conference on Artificial Intelligence. Springer, 2023.
- Agg: Amortized generative 3d gaussians for single image to 3d. Jan 2024.
- Point-nerf: Point-based neural radiance fields. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022.
- Street gaussians for modeling dynamic urban scenes. Jan 2024.
- Depth anything: Unleashing the power of large-scale unlabeled data. arXiv preprint arXiv:2401.10891, 2024.
- Spec-gaussian: Anisotropic view-dependent appearance for 3d gaussian splatting. arXiv preprint arXiv:2402.15870, 2024.
- Bakedsdf: Meshing neural sdfs for real-time view synthesis. arXiv preprint arXiv:2302.14859, 2023.
- Mip-splatting: Alias-free 3d gaussian splatting. Nov 2023.
- Monosdf: Exploring monocular geometric cues for neural implicit surface reconstruction. Advances in neural information processing systems, 2022.
- The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2018.
- Drivinggaussian: Composite gaussian splatting for surrounding dynamic autonomous driving scenes. Dec 2023.
- Fsgs: Real-time few-shot view synthesis using gaussian splatting. Dec 2023.
- Triplane meets gaussian splatting: Fast and generalizable single-view 3d reconstruction with transformers. Dec 2023.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.