Wuchen Li : Mean-Field Games for Scalable Computation and Diverse Applications
- Applied Math and Analysis ( 205 Views )Mean field games (MFGs) study strategic decision-making in large populations where individual players interact via specific mean-field quantities. They have recently gained enormous popularity as powerful research tools with vast applications. For example, the Nash equilibrium of MFGs forms a pair of PDEs, which connects and extends variational optimal transport problems. This talk will present recent progress in this direction, focusing on computational MFG and engineering applications in robotics path planning, pandemics control, and Bayesian/AI sampling algorithms. This is based on joint work with the MURI team led by Stanley Osher (UCLA).
Jacob Bedrossian : Positive Lyapunov exponents for 2d Galerkin-Navier-Stokes with stochastic forcing
- Applied Math and Analysis ( 388 Views )In this talk we discuss our recently introduced methods for obtaining strictly positive lower bounds on the top Lyapunov exponent of high-dimensional, stochastic differential equations such as the weakly-damped Lorenz-96 (L96) model or Galerkin truncations of the 2d Navier-Stokes equations (joint with Alex Blumenthal and Sam Punshon-Smith). This hallmark of chaos has long been observed in these models, however, no mathematical proof had previously been made for any type of deterministic or stochastic forcing. The method we proposed combines (A) a new identity connecting the Lyapunov exponents to a Fisher information of the stationary measure of the Markov process tracking tangent directions (the so-called "projective process"); and (B) an L1-based hypoelliptic regularity estimate to show that this (degenerate) Fisher information is an upper bound on some fractional regularity. For L96 and GNSE, we then further reduce the lower bound of the top Lyapunov exponent to proving that the projective process satisfies Hörmander's condition. I will also discuss the recent work of Sam Punshon-Smith and I on verifying this condition for the 2d Galerkin-Navier-Stokes equations in a rectangular, periodic box of any aspect ratio using some special structure of matrix Lie algebras and ideas from computational algebraic geometry.
Dejan Slepcev : Variational problems on graphs and their continuum limit
- Applied Math and Analysis ( 142 Views )I will discuss variational problems arising in machine learning and their limits as the number of data points goes to infinity. Consider point clouds obtained as random samples of an underlying "ground-truth" measure. Graph representing the point cloud is obtained by assigning weights to edges based on the distance between the points. Many machine learning tasks, such as clustering and classification, can be posed as minimizing functionals on such graphs. We consider functionals involving graph cuts and graph laplacians and their limits as the number of data points goes to infinity. In particular we establish for what graph constructions the minimizers of discrete problems converge to a minimizer of a functional defined in the continuum setting. The talk is primarily based on joint work with Nicolas Garcia Trillos, as well as on works with Xavier Bresson, Moritz Gerlach, Matthias Hein, Thomas Laurent, James von Brecht and Matt Thorpe.
Giang Tran : Sparsity-Inducing Methods for Nonlinear Differential Equations
- Applied Math and Analysis ( 134 Views )Sparsity plays a central role in recent developments of many fields such as signal and image processing, compressed sensing, statistics, and optimization. In practice, sparsity is promoted through the additional of an L1 norm (or related quantity) as a constraint or penalty in a variational model. Motivated by the success of sparsity-inducing methods in imaging and information sciences, there is a growing interest in exploiting sparsity in dynamical systems and partial differential equations. In this talk, we will investigate the connections between compressed sensing, sparse optimization, and numerical methods for nonlinear differential equations. In particular, we will discuss about sparse modeling as well as the advantage of sparse optimization in solving various differential equations arising from physical and data sciences.
Ju Sun : When Are Nonconvex Optimization Problems Not Scary?
- Applied Math and Analysis ( 143 Views )Many problems arising from scientific and engineering applications can be naturally formulated as optimization problems, most of which are nonconvex. For nonconvex problems, obtaining a local minimizer is computationally hard in theory, never mind the global minimizer. In practice, however, simple numerical methods often work surprisingly well in finding high-quality solutions for specific problems at hand.
In this talk, I will describe our recent effort in bridging the mysterious theory-practice gap for nonconvex optimization. I will highlight a family of nonconvex problems that can be solved to global optimality using simple numerical methods, independent of initialization. This family has the characteristic global structure that (1) all local minimizers are global, and (2) all saddle points have directional negative curvatures. Problems lying in this family cover various applications across machine learning, signal processing, scientific imaging, and more. I will focus on two examples we worked out: learning sparsifying bases for massive data and recovery of complex signals from phaseless measurements. In both examples, the benign global structure allows us to derive geometric insights and computational results that are inaccessible from previous methods. In contrast, alternative approaches to solving nonconvex problems often entail either expensive convex relaxation (e.g., solving large-scale semidefinite programs) or delicate problem-specific initializations.
Completing and enriching this framework is an active research endeavor that is being undertaken by several research communities. At the end of the talk, I will discuss open problems to be tackled to move forward.
Greg Forest : An overview of the Virtual Lung Project at UNC, and whats math got to do with it?
- Applied Math and Analysis ( 172 Views )An effort at UNC is involved in understanding key mechanisms in the lung related to defense against pathogens. In diseases ranging from Cystic Fibrosis to asthma, these mechanisms are highly compromised, requiring therapeutic strategies that one would like to be able to quantify or even predict in some way. The Virtual Lung Project has focused on one principal component of lung defense: "the mucus escalator" as it is called in physiology texts. My goal in this lecture, with apologies to Tina Turner, is to give a longwinded answer to "what's math got to do with it?", and at the same time to convey how this collaboration is influencing the applied mathematics experience at UNC.
Ingrid Daubechies : Surface Comparison With Mass Transportation
- Applied Math and Analysis ( 144 Views )In many applications, ranging from computer animation to biology, one wants to quantify how similar two surfaces are to each other. In the last few years, the Gromov-Haussdorff distance has been applied to this problem; this gives good results, but turns out to be very heavy computationally. This talk proposes a different approach, in which (disk-like) 2-dimensional surfaces (typically embedded in 3-dimensional Euclidean space) are first mapped conformally to the unit disk, and the corresponding conformal densities are then compared via optimal mass transportation,. This mass transportation problem differs from the standard case in that we require the solution to be invariant under global Moebius transformations. The metric we construct also defines meaningful intrinsic distances between pairs of "patches" in the two surfaces, which allows automatic alignment of the surfaces. Numerical experiments on "real-life" surfaces to demonstrate possible applications in natural sciences will be shown as well. This is joint work with Yaron Lipman.
Lek-Heng Lim : Fast(est) Algorithms for Structured Matrices via Tensor Decompositions
- Applied Math and Analysis ( 150 Views )It is well-known that the asymptotic complexity of matrix-matrix product and matrix inversion is given by the rank of a 3-tensor, recently shown to be at most O(n^2.3728639) by Le Gall. This approach is attractive as a rank decomposition of that 3-tensor gives an explicit algorithm that is guaranteed to be fastest possible and its tensor nuclear norm quantifies the optimal numerical stability. There is also an alternative approach due to Cohn and Umans that relies on embedding matrices into group algebras. We will see that the tensor decomposition and group algebra approaches, when combined, allow one to systematically discover fast(est) algorithms. We will determine the exact (as opposed to asymptotic) tensor ranks, and correspondingly the fastest algorithms, for products of Circulant, Toeplitz, Hankel, and other structured matrices. This is joint work with Ke Ye (Chicago).
Harbir Lamba : Efficient Numerical Schemes for Stochastic Differential Equations
- Applied Math and Analysis ( 186 Views )Mathematical models incorporating random forcing, and the resulting stochastic differential equations (SDEs), are becoming increasingly important. However general principles and techniques for their robust and efficient numerical approximation are a very long way behind the corresponding ODE theory. In both cases the idea of adaptivity, that is using varying timesteps to improve convergence, is a key element. In this talk I will describe an approach based upon (low-order) Milstein-type methods using multiple error-controls. The idea is to monitor various terms in the truncation error, both deterministic and stochastic, and then to construct an algorithm that is robust enough to work efficiently in the presence of deterministic/diffusion-dominated regimes and differing accuracy requirements. Such an approach also has other benefits, such as improved numerical stability properties. No knowledge of stochastic calculus will be assumed.
Joe Kileel : Inverse Problems, Imaging, and Tensor Decomposition
- Applied Math and Analysis ( 364 Views )Perspectives from computational algebra and numerical optimization are brought to bear on a scientific application and a data science application. In the first part of the talk, I will discuss cryo-electron microscopy (cryo-EM), an imaging technique to determine the 3-D shape of macromolecules from many noisy 2-D projections, recognized by the 2017 Chemistry Nobel Prize. Mathematically, cryo-EM presents a particularly rich inverse problem, with unknown orientations, extreme noise, big data and conformational heterogeneity. In particular, this motivates a general framework for statistical estimation under compact group actions, connecting information theory and group invariant theory. In the second part of the talk, I will discuss tensor rank decomposition, a higher-order variant of PCA broadly applicable in data science. A fast algorithm is introduced and analyzed, combining ideas of Sylvester and the power method.
Yat Tin Chow : An algorithm for overcoming the curse of dimensionality in Hamilton-Jacobi equations
- Applied Math and Analysis ( 133 Views )In this talk we discuss an algorithm to overcome the curse of dimensionality, in possibly non-convex/time/state-dependent Hamilton-Jacobi partial differential equations. They may arise from optimal control and differential game problems, and are generally difficult to solve numerically in high dimensions.
A major contribution of our works is to consider an optimization problem over a single vector of the same dimension as the dimension of the HJ PDE instead. To do so, we consider the new approach using Hopf-type formulas. The sub-problems are now independent and they can be implemented in an embarrassingly parallel fashion. That is ideal for perfect scaling in parallel computing.
The algorithm is proposed to overcome the curse of dimensionality when solving high dimensional HJ PDE. Our method is expected to have application in control theory, differential game problems, and elsewhere. This approach can be extended to the computational of a Hamilton-Jacobi equation in the Wasserstein space, and is expected to have applications in mean field control problems, optimal transport and mean field games.