Analysis, Geometry and Probability Seminar: Fall 2026
September 9th: Rafiq Islam (ISU)
Title: Scalable Sampling Algorithms via Langevin Dynamics
Abstract: Langevin algorithms are popular Markov chain Monte Carlo (MCMC) methods for large-scale sampling
from distributions with probability density $\pi(x)\propto e^{-f(x)}$. In this talk, we present three Langevin
sampling algorithms under strong convexity and smoothness assumptions on $f$. We first study the decentralized
proximal stochastic gradient Langevin dynamics (DE-PSGLD) algorithm for sampling from a convex body
$\mathcal{K}\subset\mathbb{R}^d$ when the data is distributed among $N$ computational agents. Constraints are
handled through a shared proximal regularization based on the Moreau–Yosida envelope, allowing unconstrained
updates to approximate the constrained target distribution. Next, we study unconstrained sampling in a decentralized
setting, where agents perform Bayesian learning collaboratively without sharing individual data. Existing
decentralized SGLD algorithms introduce network-induced bias that persists even when using full batches. To address
this bias, we propose the generalized EXTRA stochastic gradient Langevin dynamics. Finally, we propose the $P$-th
order Langevin dynamics for any $P\geq 3$, with improved dependence on dimension and sampling accuracy. For all
three algorithms, we obtain convergence guarantees and iteration complexities in the 2-Wasserstein distance. We
also validate our algorithms through numerical experiments in Bayesian regression, classification, and deep learning.
September 16th: No speaker. Miller Family Endowed Mathematics Lecture Series.