Distributed accelerated optimization algorithms:Insights from an ODE

• 作 者: CHEN RuiJuan YANG Tao CHAI TianYou
• 机 构: School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuh
• 出 处: 中国科学:技术科学（英文版）
• 发表日期: 2020年9期
• 关键词: distributed accelerated optimization algorithms exponential convergence ordinary

In this paper,we consider the distributed optimization problem,where the goal is to minimize the global objective function formed by a sum of agents' local smooth and strongly convex objective functions,over undirected connected graphs.Several distributed accelerated algorithms have been proposed for solving such a problem in the existing literature.In this paper,we provide insights for understanding these existing distributed algorithms from an ordinary differential equation (ODE) point of view.More specifically,we first derive an equivalent second-order ODE,which is the exact limit of these existing algorithms by taking the small step-size.Moreover,focusing on the quadratic objective functions,we show that the solution of the resulting ODE exponentially converges to the unique global optimal solution.The theoretical results are validated and illustrated by numerical simulations.