Tortho-Gaussian: Splatting True Digital Orthophoto Maps

Abstract: True Digital Orthophoto Maps (TDOMs) are essential products for digital twins and Geographic Information Systems (GIS). Traditionally, TDOM generation involves a complex set of traditional photogrammetric process, which may deteriorate due to various challenges, including inaccurate Digital Surface Model (DSM), degenerated occlusion detections, and visual artifacts in weak texture regions and reflective surfaces, etc. To address these challenges, we introduce TOrtho-Gaussian, a novel method inspired by 3D Gaussian Splatting (3DGS) that generates TDOMs through orthogonal splatting of optimized anisotropic Gaussian kernel. More specifically, we first simplify the orthophoto generation by orthographically splatting the Gaussian kernels onto 2D image planes, formulating a geometrically elegant solution that avoids the need for explicit DSM and occlusion detection. Second, to produce TDOM of large-scale area, a divide-and-conquer strategy is adopted to optimize memory usage and time efficiency of training and rendering for 3DGS. Lastly, we design a fully anisotropic Gaussian kernel that adapts to the varying characteristics of different regions, particularly improving the rendering quality of reflective surfaces and slender structures. Extensive experimental evaluations demonstrate that our method outperforms existing commercial software in several aspects, including the accuracy of building boundaries, the visual quality of low-texture regions and building facades. These results underscore the potential of our approach for large-scale urban scene reconstruction, offering a robust alternative for enhancing TDOM quality and scalability.

• The paper’s main contribution is introducing an orthogonal 3D Gaussian Splatting technique that generates accurate True Digital Orthophoto Maps without needing explicit DSMs.
• It employs a Fully Anisotropic Gaussian Kernel with spherical harmonics, enhancing rendering fidelity in challenging, low-texture and reflective areas.
• The method uses a divide-and-conquer strategy for large-scale scene processing, outperforming traditional photogrammetric software in both efficiency and precision.

An Expert Review of the Tortho-Gaussian Method for Generating True Digital Orthophoto Maps

The paper "Tortho-Gaussian: Splatting True Digital Orthophoto Maps" presents a novel method for generating True Digital Orthophoto Maps (TDOMs) leveraging the technique of 3D Gaussian Splatting (3DGS), termed as Tortho-Gaussian. This research contributes a meaningful advancement in the field of digital orthophoto map generation, aiming to overcome the limitations of traditional photogrammetric approaches and recent neural rendering methods.

Methodological Innovations

The core contribution of the paper lies in applying 3D Gaussian Splatting for TDOM generation. The authors introduced an orthogonal splatting technique that directly projects 3D Gaussian kernels onto a 2D image plane without the need for an explicit Digital Surface Model (DSM). This method elegantly bypasses complex occlusion detection processes typically required in traditional photogrammetric methodologies.

Additionally, the paper details the development of a Fully Anisotropic Gaussian Kernel (FAGK), enhancing rendering quality through transparency, scaling, and rotation adaptations specific to various scene characteristics. Such adaptations greatly improve render fidelity, particularly in weak-texture regions and along slender structures. This kernel leverages spherical harmonics to dynamically adjust Gaussian properties based on the viewing angle, contributing to superior anti-aliasing and reflectivity handling.

The Tortho-Gaussian framework also adopts a divide-and-conquer strategy for large-scale scene processing. The approach partitions the scene into smaller segments, optimizing for efficiency in memory and computational resources. This allows the method to handle large-scale scenes robustly, a significant bottleneck in existing methods.

Quantitative and Qualitative Evaluation

Experimental comparisons against state-of-the-art commercial software, including Metashape and Pix4DMapper, demonstrate Tortho-Gaussian's ability to produce more geometrically accurate TDOMs. Qualitative assessments showcase its efficacy in maintaining building edge precision and reducing typical visual artifacts seen in low-texture or highly reflective areas.

Quantitatively, the study benchmarks the Tortho-Gaussian results through relative error analysis with Metashape and Pix4DMapper, showing an average relative error of 0.15486% and 0.12591% respectively. The method exhibits comparable if not improved precision over conventional methods, further corroborated by overlay analyses with manual CAD mappings.

Implications and Future Directions

The theoretical implications of this work highlight a shift towards differentiable rendering techniques for spatial data applications, positing 3D Gaussian Splatting as a scalable alternative to existing photogrammetric paradigms. Practically, the TOrtho-Gaussian offers a streamlined workflow for extracting true orthophotos, eliminating the need for redundant processes such as DSM validation or intricate post-production mosaicking.

Potential future research could explore further optimizations for even larger, city-scale data sets, refining the partition strategy for more granulated control and efficiency. The integration of semantic data, possibly through advances in segmentation and depth estimation models, could also enhance TOrtho-Gaussian efficacy, contextualizing spatial reconstructions with richer, more useful data layers.

In summary, the Tortho-Gaussian framework represents a significant methodological advance in orthophoto map generation, positioning itself as a more adaptable, computationally efficient, and high-quality alternative to both traditional photogrammetric and emerging neural-based approaches. This work is poised to influence future developments in urban and spatial data modeling, particularly within Geographic Information Systems (GIS) and digital twin applications.