Null-Space Pronunciation Editing

• The paper demonstrates that closed-form null-space updates can reduce mispronunciation rates from 86.4% to 2.8% while maintaining non-target attributes like prosody and speaker identity.
• Methodologies like SonoEdit use linear-algebraic constraints to confine edits to specific subspaces, ensuring targeted corrections without catastrophic forgetting.
• Representation-level editing employs orthogonal subspace projections to isolate pronunciation components, enabling precise modifications with minimal acoustic drift.

Null-Space Pronunciation Editing refers to a set of methodologies that enable precise, attribute-specific modifications of neural speech generation models—specifically, surgical correction of word-level pronunciation—in a manner that mathematically confines edits to the desired subspace of behavior while provably preserving all other aspects of acoustic output to first order. This is achieved via linear-algebraic constraints and representation disentanglement, most prominently in two frameworks: the model parameter update method exemplified by SonoEdit (Singh et al., 23 Jan 2026), and representation-level editing in interpretable neural speech representations (Morrison et al., 2024). Both approaches address a persistent challenge in text-to-speech (TTS) and neural vocoding: correcting rare or low-resource mispronunciations without incurring catastrophic forgetting or drift in other voice attributes such as prosody, timbre, or speaker identity.

1. Theoretical Foundation for Null-Space Editing

Null-Space Pronunciation Editing formalizes pronunciational correction as a constrained optimization problem in either model parameter space or feature representation space. For model-editing (SonoEdit), given a pretrained weight matrix $W$, the hidden representation ("key") $k_*$ at a mispronounced token, and the desired "value" $v_*$ that yields the correct acoustic token, the goal is to compute an update $\Delta W$ minimizing

$\|(W + \Delta W) k_* - v_*\|_2^2$

subject to the constraint $\Delta W K_0 = 0$, where $K_0$ is a matrix of preserved "keys" drawn from a held-out speech corpus. The constraint enforces that the update lies in the null space of "preservation Jacobian" $$J_\text{pres} = \frac{\partial (W K_0)}{\partial W}$$, guaranteeing to first order that non-target pronunciations remain unchanged (Singh et al., 23 Jan 2026).

In representation-level approaches, each frame-level latent vector $r_t \in \mathbb{R}^D$ of the neural vocoder is decomposed as

$$r_t = r_t^{\text{pron}} + r_t^{\text{pros}} + r_t^{\text{spk}} + r_t^{\text{spec}}$$

with pronunciation ($r_t^{\text{pron}}$), prosody ($r_t^{\text{pros}}$), speaker embedding ($r_t^{\text{spk}}$), and spectral-balance components ($r_t^{\text{spec}}$) inhabiting mutually orthogonal subspaces as defined by canonical block-orthonormal projection matrices $U_{\bullet}$ (Morrison et al., 2024). Edits are thus effected by projecting any change vector $\Delta$ onto the desired subspace (e.g., $$P_{\text{pron}} = U_{\text{pron}} U_{\text{pron}}^T$$ for pronunciation).

2. Localization and Isolation of Pronunciation Subspaces

For targeted parameter editing, the relevant layers responsible for grapheme-to-phoneme mapping are identified using Acoustic Causal Tracing. Noise is injected into the token encoding, and individual Transformer layer activations are selectively restored; the impact of each restoration on the correct coarse acoustic token $c^*$ is measured as

$$\text{Impact}(\ell) \approx \text{softmax}(z_{\text{restored}}^{(\ell)})[c^*] - \text{softmax}(z_{\text{corrupted}})[c^*]$$

Layers with highest impact, typically a contiguous block (e.g., layers 15–21), are deemed responsible for G2P, and all edits are confined to value-projection or feed-forward weights in those layers (Singh et al., 23 Jan 2026).

In contrast, interpretable neural speech editing enforces strict block-orthogonality among pronunciation, prosody, speaker, and spectral subspaces through joint architectural design and a data augmentation regime, ensuring that subspace projection edits (such as modifying only the SPPG region in latent space) do not affect non-target attributes (Morrison et al., 2024).

3. Closed-Form Update Procedures and Null-Space Projections

In model parameter editing, the unique minimum-norm solution for the constrained update is given by projecting the target gradient $g_{\text{target}} = (W k_* - v_*) k_*^T$ onto the null space of the preservation Jacobian:

$\Delta W = P_{\text{null}}\, g_{\text{target}}$

with

$P_{\text{null}} = I - K_0 (K_0^T K_0)^{-1} K_0^T.$

Alternatively, using the AlphaEdit estimator,

$$\Delta W = \frac{v_* - W k_*}{k_*^T P_{\text{null}} k_*} (P_{\text{null}} k_*)^T,$$

where $\Delta W K_0 \approx 0$ and $(W + \Delta W) k_* = v_*$ are satisfied exactly (Singh et al., 23 Jan 2026).

For feature-level representation editing, a null-space projection is applied to the feature delta:

$$\Delta^{\text{pron}} = P_{\text{pron}} \Delta = U_{\text{pron}} U_{\text{pron}}^T \Delta,$$

resulting in an edited feature

$r_t' = r_t + \Delta^{\text{pron}},$

with the property that $\Delta^{\text{pron}}$ is orthogonal to prosody, speaker, and spectral subspaces, leaving those attributes untouched (Morrison et al., 2024).

4. Architectural and Implementation Considerations

In SonoEdit, the null-space projector is constructed as follows: a matrix $K_0 \in \mathbb{R}^{d \times N}$ of preserved hidden states is assembled (typically $N \approx 10^4–50,000$), and SVD is performed on $\Sigma = K_0 K_0^T$. The projector is formed as $P = I - U_R U_R^T$, retaining the top $R$ directions capturing $>$99% of speech variance (typically $R \sim 300$ for $d \sim 4096$). Edits are made exclusively to G2P-critical layers (Singh et al., 23 Jan 2026).

For representation-level editing, the neural vocoder (HiFi-GAN backbone) is trained with:

• Replacement of multi-scale spectrogram discriminator with a complex, multi-band version,
• Conditioning on disentangled features and augmentation indices (spectral-balance $r_f$ and volume $r_l$),
• A total generator loss combining adversarial, feature-matching, multi-resolution spectral, and SPPG (pronunciation) reconstruction losses:

$$L_G = L_{\text{GAN}} + \lambda_{\text{FM}} L_{\text{FM}} + \lambda_{\text{spec}} L_{\text{spec}} + \lambda_{\text{PPG}} L_{\text{PPG}},$$

where $L_{\text{PPG}}$ is a Jensen–Shannon divergence over SPPG outputs. Data augmentation in spectral-balance and volume dimensions with explicit conditioning drives disentanglement in the learned representations (Morrison et al., 2024).

5. Empirical Evaluation and Correction-Preservation Trade-offs

Empirical results for SonoEdit demonstrate:

• Target-WER (hard proper nouns): reduced from 86.4% (baseline Orpheus-TTS) to 2.8% post-edit,
• Global-WER (held-out preservation set): near original (3.15% post-edit vs. 3.12% baseline), far outperforming full fine-tuning (18.45%) and LoRA approaches (5.12%),
• Speaker similarity (SIM): 0.99; MOS (UTMOS): 4.18,
• Negligible acoustic drift (mel-spectrogram L1: 1.00→0.31; WER drift +0.1%; $F_0$ RMSE +0.3 Hz),
• Specific correction: e.g., “Ghibli” mispronunciation corrected without introducing prosodic or timbral artifacts (Singh et al., 23 Jan 2026).

Feature-level editing achieves:

• Pronunciation error ($\Delta$PPG): reduced from 0.12 to 0.10,
• Prosody drift: $\Delta$cent (RMS pitch error) $<$1, $\Delta\phi$ (voicing error) $<$0.01, $\Delta$dBA (loudness) $<$0.05 dB,
• Subjective ABX test: raters preferred edited clips (pronunciation changed, speaker/prosody unchanged) 92% of the time ($p<1\times 10^{-6}$); speaker identity preserved at 96% accuracy (Morrison et al., 2024).

A plausible implication is that null-space edits produce minimally invasive and optimally attribute-specific changes compared to gradient-based or unconstrained adaptation.

6. Comparative Summary of Workflows and Use Cases

Approach	Core Mechanism	Preservation Guarantee
SonoEdit (Singh et al., 23 Jan 2026)	Closed-form weight update in G2P layers, null-space constraint in parameter space	First-order invariance on preserved hidden states (practically zero drift)
Fine-Grained Interpretable Editing (Morrison et al., 2024)	Orthogonal subspace projection in feature (latent) space	Attribute-isolated: e.g., pronunciation-only edits mathematically decoupled from prosody/speaker/spectral attributes

Both approaches can be instantiated as single-shot, closed-form procedures, requiring either a reference pronunciation exemplar (e.g., via phoneme injection for $v_*$ extraction) or sparse phonetic posteriorgram (SPPG) overrides in representation space.

These methods are directly relevant to TTS deployment in linguistically diverse environments, correction of brand or proper noun pronunciations, and production pipelines demanding attribute-safe neural speech editing. Empirical evidence across both frameworks supports the conclusion that null-space techniques can deliver targeted pronunciation correction while achieving provable or near-perfect preservation of non-target attributes, circumventing catastrophic forgetting endemic to generic finetuning and LoRA-based adaptation.