DOI: 10.68381/jca15035 ISSN: 0944-6532

Alternating Proximal Algorithms for Weakly Coupled Convex Minimization Problems. Applications to Dynamical Games and PDE's

Hedy Attouch, Jérôme Bolte, Patrick Redont, Antoine Soubeyran

We introduce and study alternating minimization algorithms of the following type

\begin{array}{c} (x_0,y_0)\in{\mathcal X}\times{\mathcal Y},\: \alpha,\mu,\nu>0\text{ given},\\ \rule{0pt}{12pt} (x_k,y_k)\rightarrow(x_{k+1},y_k)\rightarrow(x_{k+1},y_{k+1})\text{ as follows} \\ \rule{0pt}{12pt} \left\{\begin{array}{l} x_{k+1}=\text{argmin} \{f(\xi)+\frac{\mu}{2}Q(\xi,y_k)+ \frac{\alpha}{2}\parallel\xi-x_k\parallel^2:\ \xi\in{\mathcal X}\}\\ \rule{0pt}{12pt} y_{k+1}=\text{argmin} \{g(\eta)+\frac{\mu}{2}Q(x_{k+1},\eta)+\frac{\nu}{2} \parallel\eta- y_k\parallel^2:\ \eta\in{\mathcal Y}\} \end{array}\right. \end{array} ( x 0 , y 0 ) ∈ X × Y ,   α , μ , ν > 0  given , ( x k , y k ) → ( x k + 1 , y k ) → ( x k + 1 , y k + 1 )  as follows { x k + 1 = argmin { f ( ξ ) + μ 2 Q ( ξ , y k ) + α 2 ∥ ξ − x k ∥ 2 :   ξ ∈ X } y k + 1 = argmin { g ( η ) + μ 2 Q ( x k + 1 , η ) + ν 2 ∥ η − y k ∥ 2 :   η ∈ Y }
where
\mathcal X X
and
\mathcal Y Y
are real Hilbert spaces,
f:\mathcal X\to{{\mathbb R}}\cup\{+\infty\} f : X → R ∪ { + ∞ }
,
g:\mathcal Y\to{{\mathbb R}}\cup\{+\infty\} g : Y → R ∪ { + ∞ }
are closed convex proper functions,
Q:(x,y)\in{\mathcal X}\times{\mathcal Y}\to{{\mathbb R}}^+ Q : ( x , y ) ∈ X × Y → R +
is a nonnegative quadratic form (hence convex, but possibly nondefinite) which couples the variables
x x
and
y y
. A particular important situation is the “weak coupling”
Q(x,y)=\parallel Ax-By\parallel^2 Q ( x , y ) = ∥ A x − B y ∥ 2
where
A\in L(\mathcal X,\mathcal Z) A ∈ L ( X , Z )
,
B\in L(\mathcal Y,\mathcal Z) B ∈ L ( Y , Z )
are continuous linear operators acting respectively from
\mathcal X X
and
\mathcal Y Y
into a third Hilbert space
\mathcal Z Z
. The “cost-to-move” terms
\parallel\xi-x\parallel^{2} ∥ ξ − x ∥ 2
and
\parallel\eta-y\parallel^{2} ∥ η − y ∥ 2
induce dissipative effects which are similar to friction in mechanics, anchoring and inertia in decision sciences. As a result, for each initial data
(x_0,y_0) ( x 0 , y 0 )
, the proximal-like algorithm generates a sequence
(x_k,y_k) ( x k , y k )
which weakly converges to a minimum point of the convex function
L(x,y)=f(x)+g(y)+\frac{\mu}{2}Q(x,y) L ( x , y ) = f ( x ) + g ( y ) + μ 2 Q ( x , y )
. The cost-to-move terms, which vanish asymptotically, have a crucial role in the convergence of the algorithm. A direct alternating minimization of the function
L L
could fail to produce a convergent sequence in the weak coupling case. Applications are given in game theory, variational problems and PDE's. These results are then extended to an arbitrary number of decision variables and to monotone inclusions.