Activity
【第四十九期】PDE MODELS FOR DEEP NEURAL NETWORKS: LEARNING THEORY, CALCULUS OF VARIATIONS AND OPTIMAL CONTROL
Date:2025-11-06

摘要:We propose a partial differential-integral equation (PDE) framework for deep neural networks (DNNs) and their associated learning problems by taking the continuum limits of both network width and depth. The proposed model captures the complex interactions among hidden nodes, overcoming limitations of traditional discrete and ordinary differential equation (ODE)-based models. Controllability and optimality conditions for the learning task with its associated PDE forward problem are established using variational calculus, the Pontryagin Maximum Principle, and the Hamilton-Jacobi-Bellman equation, framing the deep learning process as a PDE-constrained optimization problem. This approach facilitates the development of new network architectures and numerical methods that improve upon traditional layer-by-layer gradient descent techniques. The talk provides a mathematical foundation for connecting neural networks, PDE theory, variational analysis, and optimal control. By integrating these fields, we offer a robust framework that enhances deep learning models’ stability, efficiency, and interpretability.

 

Address:No. 6 Science Building, No. 800 Dongchuan Road, Minhang District, Shanghai 200240, China
COPYRIGHT ©2020 Wu Wen-Tsun Center of Mathematical Sciences, Shanghai Jiao Tong University All Rights Reserved 沪交ICP备20200313