AmbiSuR: Resolving Photometric Ambiguity in Gaussian Splatting for Robust Surface Reconstruction

Paper: 2605.12494 Authors: Jiahe Li, Jiawei Zhang, Xiao Bai, Jin Zheng, Xiaohan Yu, Lin Gu, Gim Hee Lee Categories: cs.CV

The Gap

Differentiable rendering methods like NeRF and Gaussian Splatting have pushed 3D reconstruction forward, but they hit a fundamental wall: photometric ambiguity. The same image can result from infinitely many geometry-appearance combinations—a flat white surface under bright light looks identical to a bumpy gray surface under dim light. Prior work (NeuS, VolSDF, 2DGS) tries to constrain this with geometric priors or regularization, but these are external band-aids. They don’t address the fact that the representation itself is ambiguous at the primitive level.

Gaussian Splatting is particularly vulnerable. Each Gaussian primitive has independent opacity and color, creating two built-in ambiguities: (1) opacity-geometry coupling—you can’t tell if a surface is truly there or just highly transparent, and (2) color-lighting entanglement—is that brightness from surface albedo or illumination? Existing methods either ignore this or apply global constraints that don’t respect per-primitive ambiguity.

Photometric Ambiguity Problem
       |
       v
   [Image I = Geometry * Appearance]
       |
       +---> Infinite solutions exist
       |
       v
Prior approaches:           This paper:
Global regularization  -->  Primitive-level disambiguation
External constraints   -->  Self-indication mechanism
       |                           |
       v                           v
Still ambiguous            Definite surface

The Increment

One sentence: Before AmbiSuR, Gaussian Splatting reconstructions were plagued by phantom geometry from unresolved primitive-level ambiguities; after, the representation itself signals where it’s uncertain and self-corrects.

Core Mechanism

AmbiSuR operates in two stages. First, photometric disambiguation constrains the ill-posed geometry problem. For each Gaussian primitive, it enforces that opacity and geometry must align—if a primitive claims to be opaque, its center must lie on the actual surface, not floating in space. This breaks the opacity-geometry ambiguity by tying opacity values to geometric consistency through a depth-normal alignment loss.

Second, an ambiguity indication module exploits a hidden property of Gaussian Splatting: primitives that are underconstrained (ambiguous) naturally exhibit higher variance in their gradient updates during training. The module tracks this variance as a confidence signal. Low-confidence primitives get flagged, then corrected through targeted geometric refinement—adjusting their positions and scales to match nearby high-confidence geometry.

Input: Multi-view images
       |
       v
   [Gaussian Splatting Representation]
       |
       +---> Stage 1: Photometric Disambiguation
       |         |
       |         +---> Opacity-Depth Alignment
       |         +---> Normal Consistency Check
       |         |
       |         v
       |     Constrained Geometry
       |
       +---> Stage 2: Ambiguity Indication
             |
             +---> Track gradient variance per primitive
             +---> Flag low-confidence Gaussians
             +---> Refine flagged primitives
             |
             v
         Corrected Surface

Think of it like a sculptor working with clay. The clay (Gaussian primitives) can be shaped into any form, but some areas are mushy and unstable (ambiguous). Stage 1 is like adding an armature—a skeleton that forces the clay to respect the underlying structure. You can’t just pile clay anywhere; it must follow the armature’s shape. Stage 2 is the sculptor’s hand checking firmness: press each spot, and if it’s still soft (high gradient variance), reshape it to match the firm areas nearby. The clay itself tells you where it needs more work.

Key Concepts

• Photometric Ambiguity: Imagine you’re looking at a photograph of a sphere. Is it a white sphere under dim light, or a gray sphere under bright light? Both produce the same image. In 3D reconstruction, this means the same set of photos can be explained by infinitely many combinations of shape (geometry) and color (appearance). The math doesn’t have enough information to pick one answer. Traditional methods add extra assumptions (smoothness, known lighting), but these are guesses. AmbiSuR instead looks at the representation’s internal structure to find where ambiguity hides and resolves it there.

• Primitive-Level Ambiguity: Gaussian Splatting represents scenes as thousands of 3D Gaussian blobs. Each blob has its own opacity (how see-through it is) and color. The problem: you can make a surface look the same by using many transparent blobs stacked up, or fewer opaque blobs. Similarly, a bright blob far away can look like a dim blob up close. These aren’t just theoretical issues—during training, the optimizer gets stuck because multiple blob configurations produce identical images. AmbiSuR identifies these stuck configurations by watching how each blob’s parameters jitter during training.

• Self-Indication: Here’s the clever bit. When a Gaussian primitive is ambiguous (multiple valid configurations), its gradients during training are inconsistent—one batch update pushes it left, the next pushes it right. High variance in gradient direction is a symptom of ambiguity. AmbiSuR doesn’t need external labels; it reads this variance as a confidence score. Low confidence = ambiguous = needs correction. It’s like a metal detector that beeps louder over uncertain areas, except the signal comes from the optimization process itself.

Framework Shift

Before (2DGS, SuGaR):                After (AmbiSuR):

Multi-view Images                    Multi-view Images
       |                                    |
       v                                    v
Gaussian Splatting                   Gaussian Splatting
       |                                    |
       +---> Global regularization          +---> Per-primitive disambiguation
       |     (smooth surfaces)               |     (opacity-depth alignment)
       |                                     |
       v                                     +---> Gradient variance tracking
Ambiguous geometry                          |     (self-indication)
(phantom surfaces,                          |
 floating blobs)                            v
                                      Definite surface
                                      (corrected primitives)

From global smoothness priors to primitive-level self-diagnosis, the core shift is treating ambiguity as a per-primitive property that the representation can signal and correct internally.

Expert Assessment

Problem choice: Real and well-motivated. Photometric ambiguity isn’t a niche issue—it’s the reason NeRF-based methods struggle with textureless regions and specular surfaces. Focusing on Gaussian Splatting’s built-in ambiguities is smart; the representation’s popularity makes this immediately relevant. The framing as “intrinsic solution” (fixing the representation itself) versus “extrinsic constraints” (adding regularization) is a genuine conceptual advance.

Method maturity: The photometric disambiguation is straightforward—depth-normal alignment is a known geometric consistency check, applied here at the primitive level. The novelty is in the ambiguity indication module. Using gradient variance as a confidence signal is clever, but the paper doesn’t deeply justify why variance specifically captures ambiguity versus other training instabilities (noisy data, learning rate issues). The refinement step (correcting low-confidence primitives) feels somewhat ad-hoc—it’s essentially spatial smoothing guided by confidence. A more principled approach might model ambiguity probabilistically.

Experimental integrity: Strong baselines (2DGS, SuGaR, GOF) and diverse datasets (DTU, Tanks and Temples, challenging real-world scans). The ablation studies isolate each component’s contribution. However, the paper doesn’t show failure cases or discuss when the method breaks. What happens in extremely low-texture scenes where even high-confidence primitives are ambiguous? The metrics (Chamfer distance, F-score) are standard but don’t capture perceptual quality—some reconstructions might be geometrically accurate but visually implausible.

Writing quality: The abstract and introduction oversell the “intrinsic solution” angle—it’s a good framing, but the actual method is still adding constraints, just at a different level. Section 3.2 (ambiguity indication) could be clearer about the gradient variance computation—is it per-parameter variance, or aggregated? The related work section is thorough but reads like a literature dump rather than positioning the work strategically. Rewriting the method section to lead with the sculptor metaphor would make the paper far more accessible.

Verdict: weak accept — Solid contribution with a useful insight (primitive-level ambiguity self-indication), but the method feels like a well-executed engineering solution rather than a fundamental rethinking. The experimental results are convincing, and the approach is practical.

Takeaways

Gradient variance as a confidence signal: If you’re training any differentiable representation (not just Gaussian Splatting), track per-parameter gradient variance across batches. High variance often means the parameter is underconstrained—the loss landscape is flat in that direction. You can use this to identify which parts of your model need stronger regularization or more data.

Primitive-level constraints beat global ones: When your representation is compositional (made of independent units like Gaussians, voxels, or patches), applying constraints at the unit level is more effective than global smoothness terms. Each unit can be ambiguous in different ways; global constraints average over these differences and miss the problem.

Opacity-geometry coupling is a design flaw: If you’re designing a 3D representation, don’t let opacity and position be independent. Tie them together—opaque primitives must be on surfaces, transparent ones can float. This isn’t just a regularization trick; it’s a structural constraint that reduces the solution space.