Papers
Topics
Authors
Recent
Search
2000 character limit reached

Zero of Finite Sum of Maximally Monotone Operators

Updated 17 December 2025
  • The paper introduces solving 0 in A₁(x)+…+Aₙ(x) on Hilbert spaces, laying a foundation for structured convex optimization and monotone inclusions.
  • It employs minimal-lifting resolvent splitting that uses recursive resolvent evaluations and fixed-point iterations to guarantee convergence.
  • The approach has practical applications in decentralized optimization, multi-block ADMM, imaging, and networked control, demonstrating scalable algorithm design.

A zero of a finite sum of maximally monotone operators concerns solutions to operator inclusions of the form 0A1(x)++An(x)0 \in A_1(x) + \cdots + A_n(x) on a real Hilbert space HH, where A1,,An:HHA_1,\ldots,A_n:H \rightrightarrows H are maximally monotone. This class of problems subsumes a wide spectrum of structured convex optimization and monotone inclusion models central to modern analysis and large-scale computational algorithms. The intricate structure of maximally monotone summands, the nontrivial difficulty of evaluating the resolvent of the sum, and the essential role of splitting algorithms in applications ranging from distributed optimization to imaging motivates a comprehensive study of this inclusion.

1. Problem Formulation and Foundational Concepts

Given a real Hilbert space (H,,)(H,\langle \cdot,\cdot\rangle) with induced norm \|\cdot\|, and n2n\geq 2 maximally monotone operators A1,,An:H2HA_1,\ldots,A_n:H\to 2^H, the central problem is to find xHx\in H such that

0i=1nAi(x).0 \in \sum_{i=1}^n A_i(x).

Rewriting, the zero set is zer(i=1nAi)\operatorname{zer}\left(\sum_{i=1}^n A_i\right), which is a closed convex set under standard monotonicity and maximality assumptions.

The resolvent of HH0 with stepsize HH1 is HH2, a single-valued, firmly nonexpansive operator whenever HH3 is maximally monotone. If HH4, HH5 denotes the unscaled resolvent.

The sum operator HH6 is again maximally monotone (by Rockafellar's theorem, under standard constraint qualifications), yet crucially, explicit computation of the resolvent HH7 is intractable save for limited cases, motivating so-called splitting schemes: decompositions utilizing only the resolvents (or proximal operators) of the individual HH8.

2. Minimal-Lifting Resolvent Splitting and Lower Bound Theory

Traditional operator-splitting methods, such as Douglas–Rachford, naturally address HH9; for A1,,An:HHA_1,\ldots,A_n:H \rightrightarrows H0, splitting each A1,,An:HHA_1,\ldots,A_n:H \rightrightarrows H1 only once per iteration without auxiliary "lifting" is impossible except in special cases. The minimal-lifting framework asserts:

  • Any frugal resolvent splitting for the sum of A1,,An:HHA_1,\ldots,A_n:H \rightrightarrows H2 maximally monotone operators—one which uses each A1,,An:HHA_1,\ldots,A_n:H \rightrightarrows H3 once per iteration—requires a Cartesian product space A1,,An:HHA_1,\ldots,A_n:H \rightrightarrows H4 with A1,,An:HHA_1,\ldots,A_n:H \rightrightarrows H5.
  • This lower bound is unimprovable: there exists, for all A1,,An:HHA_1,\ldots,A_n:H \rightrightarrows H6, explicit frugal splittings acting on A1,,An:HHA_1,\ldots,A_n:H \rightrightarrows H7 (and no fewer), with each iterate constructed recursively via a sequence of A1,,An:HHA_1,\ldots,A_n:H \rightrightarrows H8 resolvent evaluations and A1,,An:HHA_1,\ldots,A_n:H \rightrightarrows H9 auxiliary variables.

A canonical recursion for (H,,)(H,\langle \cdot,\cdot\rangle)0 employs (H,,)(H,\langle \cdot,\cdot\rangle)1 and auxiliary (H,,)(H,\langle \cdot,\cdot\rangle)2: (H,,)(H,\langle \cdot,\cdot\rangle)3 then update

(H,,)(H,\langle \cdot,\cdot\rangle)4

and output (H,,)(H,\langle \cdot,\cdot\rangle)5. This iteration is (H,,)(H,\langle \cdot,\cdot\rangle)6-averaged and converges weakly to a fixed point encoding a solution (H,,)(H,\langle \cdot,\cdot\rangle)7 to the original inclusion. When (H,,)(H,\langle \cdot,\cdot\rangle)8, this specialization reduces to the classical Douglas–Rachford splitting on (H,,)(H,\langle \cdot,\cdot\rangle)9 (Malitsky et al., 2021).

3. Fixed-Point Theory and Convergence Analysis

The minimal-lifting resolvent splitting operator \|\cdot\|0 defined above satisfies:

  • \|\cdot\|1 is \|\cdot\|2-averaged for \|\cdot\|3,
  • \|\cdot\|4 if and only if \|\cdot\|5,
  • Any \|\cdot\|6 maps to a common value \|\cdot\|7 with \|\cdot\|8.

The sequence \|\cdot\|9 converges weakly to n2n\geq 20, and the associated n2n\geq 21 all converge to the same n2n\geq 22. If n2n\geq 23 are uniformly monotone, strong convergence can be asserted in the limiting regime n2n\geq 24 as in the Peaceman–Rachford variant.

The dimension bound (lifting degree n2n\geq 25) is established by formalizing the dependency of each n2n\geq 26 on current and preceding n2n\geq 27 and n2n\geq 28, then arguing via a structural matrix form and a rank calculation that n2n\geq 29 degrees of freedom are essential for unrestricted maximally monotone inputs (Malitsky et al., 2021).

4. Operator Splitting in the Finite Sum Regime

Several extensions and alternative schemes exist for addressing finite sums of maximally monotone operators:

Product-Space Reformulation: Cast A1,,An:H2HA_1,\ldots,A_n:H\to 2^H0 as A1,,An:H2HA_1,\ldots,A_n:H\to 2^H1 on A1,,An:H2HA_1,\ldots,A_n:H\to 2^H2, where A1,,An:H2HA_1,\ldots,A_n:H\to 2^H3 (the diagonal). The normal cone A1,,An:H2HA_1,\ldots,A_n:H\to 2^H4 resolves consensus. Douglas–Rachford and related 2-operator splittings then apply in this higher-dimensional setting (Bot et al., 2012, Chen et al., 2022).

Primal-Dual and Forward-Backward(-Forward) Splitting: Extensions to problems with both maximally monotone and Lipschitzian (possibly single-valued) summands employ composite or hybrid forward-backward, reflected-backward, or forward-reflected-backward schemes, potentially using variable metrics. These approaches enable splitting algorithms to handle composite, sum-of-composite, or distributed settings with efficient per-iteration complexity and broad convergence guarantees (Bot et al., 2012, Vũ, 2012, Tam et al., 14 Dec 2025).

Adaptive and Relaxed Variants: In the presence of monotonicity constants (e.g., strong/weak monotonicity, Lipschitz continuity), adaptive Douglas–Rachford designs modulate reflection and averaging parameters to restore nonexpansivity (or contraction) and guarantee global or even linear convergence, particularly in two-operator settings but with partial extensions to sums (Dao et al., 2018).

5. Application Domains and Distributed/Decentralised Optimization

Frugal, minimal-lifting splittings have direct applications to:

  • Decentralized optimization over networked agents: Each operator A1,,An:H2HA_1,\ldots,A_n:H\to 2^H5 may correspond to an agent's local objective or constraint. Minimal-lifting schemes assign local variables (A1,,An:H2HA_1,\ldots,A_n:H\to 2^H6) to agents, require only communication among neighbors (e.g., on cycle graphs), and evaluate each A1,,An:H2HA_1,\ldots,A_n:H\to 2^H7 precisely once per iteration without a central coordinator. Convergence and low per-iteration complexity are provable, and network-step-size independence can be attained in specifically designed forward-backward-type algorithms (Malitsky et al., 2021, Tam et al., 14 Dec 2025).
  • Multi-block ADMM: For multi-block linearly constrained convex programs, the dual inclusion A1,,An:H2HA_1,\ldots,A_n:H\to 2^H8 with A1,,An:H2HA_1,\ldots,A_n:H\to 2^H9 maximally monotone admits resolution via n-operator splitting as above, yielding convergent multi-block extensions to ADMM. In the generic case xHx\in H0, this recovers the (convergent) two-block ADMM/Douglas–Rachford on the dual; for xHx\in H1, it provides new guarantees not enjoyed by the standard direct multi-block ADMM (Malitsky et al., 2021).
  • Composite monotone inclusion: Inclusions with linear composition and block structure are amenable to minimal-lifting resolvent splittings where each operator and each application of the linear map and its adjoint is invoked only once per iteration. This is particularly vital when xHx\in H2 has large norm or is expensive to apply (Briceño-Arias, 2021).
  • Structured convex minimization, monotone games, networked Nash equilibria: Product-space and minimal-lifting splitting techniques underlie efficient solvers for (possibly non-differentiable) convex programs in imaging, regression, location theory, and distributed control (Bot et al., 2012, Tam et al., 14 Dec 2025).

6. Duality Frameworks, Extended Solution Concepts, and Generalization

Attouch–Théra duality reveals deep connections between solutions of xHx\in H3 and xHx\in H4, with the dual operator xHx\in H5. Existence of primal and dual solutions, paramonotonicity, and the structure of extended solution sets (as in the graph of xHx\in H6) enable recovery of all primal solutions from a single dual element and vice versa (Bauschke et al., 2011). These dual interpretations carry over to the finite sum regime through appropriate product-space constructs.

Normal problem and generalized zeros: For potentially inconsistent inclusions (xHx\in H7), the normal problem framework introduces a systematic perturbation—using the infimal displacement vector of the associated Douglas–Rachford splitting operator—to define a "least-distance" generalized solution set that reduces to the original if solutions exist, but is always nonempty by construction (Bauschke et al., 2013). This unifies classical least squares, best approximation problems, and infeasibility regularization under a common normal equations paradigm.

7. Methodological Table: Minimal-Lifting Frugal Splittings and Operator Splitting Strategies

Splitting Method Operator Class Lifting Dimension Main Iteration
Minimal-lifting resolvent split xHx\in H8 maximally monotone xHx\in H9 Recursive 0i=1nAi(x).0 \in \sum_{i=1}^n A_i(x).0
Douglas–Rachford 0i=1nAi(x).0 \in \sum_{i=1}^n A_i(x).1 0i=1nAi(x).0 \in \sum_{i=1}^n A_i(x).2 0i=1nAi(x).0 \in \sum_{i=1}^n A_i(x).3
Primal-dual product-space 0i=1nAi(x).0 \in \sum_{i=1}^n A_i(x).4 maximally monotone 0i=1nAi(x).0 \in \sum_{i=1}^n A_i(x).5 Product-space splitting, consensus constraint
Decentralized FBS/FBF Sum plus Lipschitzian 0i=1nAi(x).0 \in \sum_{i=1}^n A_i(x).6 or 0i=1nAi(x).0 \in \sum_{i=1}^n A_i(x).7 (agents) Forward-backward (possibly extragradient)
Multi-block ADMM (dual) 0i=1nAi(x).0 \in \sum_{i=1}^n A_i(x).8 subdifferential 0i=1nAi(x).0 \in \sum_{i=1}^n A_i(x).9 or as above Dual splitting; primal-dual updates

The breadth of monotone inclusion splitting techniques for the zeros of finite sums of maximally monotone operators reflects the deep interplay between operator-theoretic structural properties, fixed-point and duality frameworks, and the design of scalable, distributed, and provably convergent algorithms in applied computation (Malitsky et al., 2021, Tam et al., 14 Dec 2025, Bot et al., 2012, Briceño-Arias, 2021, Vũ, 2012, Dao et al., 2018, Bauschke et al., 2013, Bauschke et al., 2011, Chen et al., 2022).

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Zero of a Finite Sum of Maximally Monotone Operators.