KiLearn

KiLearn

Project name: KiLearn – Kinetic equations and Learning control
Project reference: PID2020-112617GB-C22
AEI: PID2020-112617GB-C22/AEI/10.13039/501100011033 KiLearn
Funding source: MINECO, Ministerio de Ciencia e Innovación
Duration: September 2021 – September 2024
Principal Investigators (PI): Miguel Escobedo (UPV/EHU), Enrique Zuazua (Deusto Foundation)

About the Project

KiLearn The project arises from the necessity to deepen the understanding of several fundamental questions in Machine Learning, quantum gases, and protein’s dynamics through a detailed study of the mathematical properties of some models that are currently used in those fields. These questions include the time evolution of a Bose-Einstein condensate, the fragmentation dynamics of proteins from experiments, or the impact of the architecture on the performances of a Neural Network.

The increasing interconnection between Machine Learning and kinetic theory motivates a research path that develops on the boundary between these two worlds and has the potential of leading to deep and breakthrough results in both areas. Starting from this hypothesis, the general objective of the research project KiLearn is to develop new Machine Learning-inspired mathematical tools for the analysis of Kinetic Equations and, at the same time, to extend the present knowledge in Machine Learning and Neural Networks taking advantage of the vast theoretical baggage that kinetic theory has to offer.

Project Members

• Miguel Escobedo – UPV/EHU, University of the Basque Country
Enrique Zuazua – Deusto Foundation
Umberto Biccari – Deusto Foundation
• Iker Pastor – University of Deusto
Martin Lazar, Dubrovnik University
Jon Asier Bárcena-Petisco, UPV/EHU
Nicola de Nitti, FAU
Carlos Esteve, UAM
Borjan Geshkovski, UAM
Domènec Ruiz-Balet, UAM
Yongcun Song, FAU

 

KiLearn Toolbox

Learning with Neural ODEs Toolbox
Author: Borjan Geshkovski
Language: Python
A toolbox for learning with neural ODEs.

The ADMM-PINNs Algorithmic Framework for Nonsmooth PDE-Constrained Optimization: A Deep Learning Approach
Author: Yongcun Song
Language: Python / MATLAB
A source code to study the combination of the alternating direction method of multipliers (ADMM) with physics-informed neural networks (PINNs) for a general class of nonsmooth partial differential equation (PDE)-constrained optimization problems, where additional regularization can be employed for constraints on the control or design variables.

PINNS Wave Equation
Author: Daniël Veldman
Language: Python & MATLAB
An implementation of Physics-Informed Neural Networks (PINNs) to solve various forward and inverse problems for the 1 dimensional wave equation.

pyControls Framework
Author: Daniël Veldman
Language: C++ & Python
The pyControls package provides a framework for simulations of gas networks with arbirary geometry and edge dynamics. This package provides a high-order solver for the isoeuler equations and a reader for the GasLib scenarios. Furthermore, the network is easily plotted either in 2D or 3D manner.

Model Predictive Control
Author: Daniël Veldman
Language: MATLAB
Model Predictive Control for course discretizations of the heat and wave equation.

A sheep herding game
Author: Daniël Veldman
Language: MATLAB
A sheep herding game in MATLAB for the Long Night of Sciences (Lange Nacht der Wissenschaften) Erlangen-Furth-Nürnberg 2022.

RBM-MPC
Author: Daniël Veldman
Language: MATLAB
This is the code we used for the numerical experiments with RBM-MPC, a combination of Model Predictive Control (MPC) and Random Batch Methods (RBMs).

HJ – Inverse design
Author: Daniël Veldman
Language: MATLAB
Our goal here is to study the inverse design problem associated to Hamilton Jacobi Equations (HJ)

The interplay of control and deep learning
Author: Borjan Geshkovski
Deep supervised learning by merging the latter with well-known subfields of mathematical control theory and numerical analysis.

Hamilton-Jacobi Equations: Inverse Design
Author: Carlos Esteve
Source code to study the inverse design problem associated to Hamilton Jacobi Equations (HJ).

Randomized time-splitting in linear-quadratic optimal control
Author: Daniël Veldman
Solving an optimal control problem for a large-scale dynamical system can be computationally demanding.

Control of Advection-Diffusion Equations on Networks and Singular Limits
Author: Jon Asier Bárcena-Petisco, Márcio Cavalcante, Giuseppe Maria Coclite, Nicola de Nitti and Enrique Zuazua
We define an upper bound and a lower bound on the time in which the information propagates across the network (i.e., the maximal and minimal travel time of the characteristics across the network).

Averaged dynamics and control for heat equations with random diffusion
Author: Jon Asier Bárcena Petisco, Enrique Zuazua
to illustrate the effect of averaging in the dynamics, let us study the dynamics of (1) when =^ and =0. As averaging and the Fourier transform commute, we work on the Fourier transform of the fundamental solution of the heat equation.

 

Publications

Interplay between depth and width for interpolation in neural ODEs

A. Alvarez-Lopez, A. Hadj Slimane, E. Zuazua. Interplay between depth and width for interpolation in neural ODEs (2024) M3AS Abstract ...

Exponential convergence to steady-states for trajectories of a damped dynamical system modelling adhesive strings

GM. Coclite, N. De Nitti, F. Maddalena, G. Orlando, E. Zuazua. Exponential convergence to steady-states for trajectories of a damped ...

FedADMM-InSa: An Inexact and Self-Adaptive ADMM for Federated Learning

E. Zuazua. FedADMM-InSa: An Inexact and Self-Adaptive ADMM for Federated Learning (2024) https://doi.org/10.48550/arXiv.2402.13989 Abstract. Federated learning (FL) is a promising ...

Fourier series and sidewise control of 1-d waves

E. Zuazua. Fourier series and sidewise control of 1-d waves (2024) Volume in honor of Yves Meyer, Documents Mathématiques of ...

Stability and Convergence of a Randomized Model Predictive Control Strategy

Daniël Veldman, Alexandra Borkowski, Enrique Zuazua. Stability and Convergence of a Randomized Model Predictive Control Strategy (2024) IEEE Trans. Automat. Abstract ...

Controllability properties from the exterior under positivity constraints for a 1-D fractional heat equation

Antil H, Biccari U, Ponce R, Warma M, Zamorano S. Controllability properties from the exterior under positivity constraints for a ...

Uniform Turnpike Property and Singular Limits

M Hernandez-Salinas, E. Zuazua. Uniform Turnpike Property and Singular Limits (2024) Springer Verlag, Vol. 190, No. 3, https://doi.org/10.1007/s10440-024-00640-7 Abstract. Motivados ...

Pointwise constraints for scalar conservation laws with positive wave velocity

N. De Nitti, D. Serre, E. Zuazua. Pointwise constraints for scalar conservation laws with positive wave velocity (2024) Abstract. We ...

Neural ODE Control for Classification, Approximation and Transport

Ruiz-Balet D., Zuazua E. Neural ODE Control for Classification, Approximation and Transport (2023), SIAM Review, Vol. 65, No. 3, pp ...

Eigenvalue bounds for the Gramian operator of the heat equation

M. Lazar, Zuazua E.. Eigenvalue bounds for the Gramian operator of the heat equation (2024) Automatica, Vol. 164, pp. 111-653, ...

Large time asymptotics for partially dissipative hyperbolic systems without Fourier analysis: application to the nonlinearly damped p-system

T. Crin-Barat, E. Zuazua. Large time asymptotics for partially dissipative hyperbolic systems without Fourier analysis: Application to the nonlinearly damped ...

Tracking controllability for the heat equation

J.A. Barcena-Petisco, E. Zuazua. Tracking controllability for the heat equation (2024) Abstract. We study the tracking or sidewise control- lability ...

Optimal control approach for moving bottom detection in one-dimensional shallow waters by surface measurements

J. Lecarós, J. Lopez-Rios, G.I. Montecinos, E. Zuazua. Optimal control approach for moving bottom detection in one-dimensional shallow waters by ...

Exact Controllability and Stabilization of the Wave Equation

E. Zuazua. Exact Controllability and Stabilization of the Wave Equation (2024) UNITEXT - Springer Abstract. These Notes originated from a ...

Control of neural transport for normalizing flows

D. Ruiz-Balet, E. Zuazua. Control of neural transport for normalizing flows (2023) J. Math. Pures Appl. https://doi.org/10.48550/arXiv.2307.07817 Abstract. Inspired by ...

A Two-Stage Numerical Approach for the Sparse Initial Source Identification of a Diffusion-Advection Equation

U. Biccari, Y. Song, X. Yuan, E. Zuazua. A Two-Stage Numerical Approach for the Sparse Initial Source Identification of a ...

Gaussian Beam ansatz for finite difference wave equations

Biccari U, Zuazua E. Gaussian Beam ansatz for finite difference wave equations (2023) Abstract. This work is concerned with the ...

Long-time convergence of a nonlocal Burgers’ equation towards the local N-wave

G.M. Coclite, De Nitti N., Zuazua E.. Long-time convergence of a nonlocal Burgers' equation towards the local N-wave (2023) CVGMT ...

Optimal design of sensors via geometric criteria

I. Ftouhi, Zuazua E.. Optimal design of sensors via geometric criteria (2023) J. Geom. Anal., Vol. 33, No. 253, https://doi.org/10.1007/s12220-023-01301-1 ...

On the Controllability of Entropy Solutions of Scalar Conservation Laws at a Junction via Lyapunov methods

N. Nitti, De Nitti N., Zuazua E.. On the Controllability of Entropy Solutions of Scalar Conservation Laws at a Junction ...

Multilevel control by duality

Umberto Biccari, Enrique Zuazua. Multilevel control by duality (2023) Systems & Control Letters, Vol. 175, 105-502, https://doi.org/10.1016/j.sysconle.2023.105502 Abstract. We discuss the ...

A quantitative analysis of Koopman operator methods for system identification and predictions

C. Zhang, E. Zuazua.  A quantitative analysis of Koopman operator methods for system identification and predictions (2023) Comptes Rendus. Mécanique, ...

Reachable set for Hamilton-Jacobi equations with non-smooth Hamiltonian and scalar conservation laws

Esteve C., Zuazua E.. Reachable set for Hamilton-Jacobi equations with non-smooth Hamiltonian and scalar conservation laws (2022) Nonlinear Analysis, Vol ...

Differentiability with respect to the initial condition for Hamilton-Jacobi equations

Esteve C., Zuazua E.. Differentiability with respect to the initial condition for Hamilton-Jacobi equations (2022) SIAM Journal on Mathematical Analysis, ...

Control and Machine Learning

Zuazua E. Control and Machine Learning (2022) News journal of the Society for Industrial and Applied Mathematics , Vol. 55, ...

Analysis and numerical solvability of backward-forward conservation laws

Thibault Liard, Enrique Zuazua. Analysis and numerical solvability of backward-forward conservation laws (2022) SIAM Journal on Mathematical Analysis Abstract. In ...

Multilevel selective harmonic modulation by duality

Biccari U, Zuazua E. Multilevel selective harmonic modulation by duality (2022) IFAC-PapersOnLine, Vol. 55, No. 16, pp. 56-61, https://doi.org/10.1016/j.ifacol.2022.08.081. Abstract ...

A framework for randomized time-splitting in linear-quadratic optimal control

Daniël Veldman, Enrique Zuazua. (2022)A framework for randomized time-splitting in linear-quadratic optimal control Numerische Mathematik. DOI: https://doi.org/10.1007/s00211-022-01290-3 Abstract. Inspired by the ...

Constrained control of gene-flow models

Mazari I., Ruiz-Balet D., Zuazua E. Constrained control of gene-flow models. (2021) Ann. Inst. Henri Poincare (C) Anal. Non Lineaire ⟨hal-02373668⟩ ...

Optimal actuator design via Brunovsky’s normal form

B. Geshkovski, E. Zuazua, Optimal actuator design via Brunovsky's normal form (2022) IEEE Automatic Control, Vol. 26, No. 12, DOI: ...

Slow decay and Turnpike for Infinite-horizon Hyperbolic LQ problems

Zhong-Jie Han, E. Zuazua, Slow decay and Turnpike for Infinite-horizon Hyperbolic LQ problems (2022) SIAM J. Control Optim. Vol. 60, ...

Control of certain parabolic models from biology and social sciences

Domènec Ruiz-Balet, , Enrique Zuazua. Control of certain parabolic models from biology and social sciences(2022) Math Control and Related Fields, ...

Relaxation approximation and asymptotic stability of stratified solutions to the IPM equation

R. Bianchini, Crin-Barat T., M. Paicu. Relaxation approximation and asymptotic stability of stratified solutions to the IPM equation (2022) Abstract ...

Spectral inequalities for elliptic pseudo-differential operators on closed manifolds

D. Cardona. Spectral inequalities for elliptic pseudo-differential operators on closed manifolds (2022) Abstract. Let (M,g) be a closed Riemannian manifold ...

Multilevel Selective Harmonic Modulation via Optimal Control

Umberto Biccari, Carlos Esteve-Yagüe, Deyviss Jesús Oroya-Villalta. Multilevel Selective Harmonic Modulation via Optimal Control. (2022) Applied Mathematics and Optimization Abstract. We ...

Existence and cost of boundary controls for a degenerate/singular parabolic equation

Umberto Biccari, Víctor Hernández-Santamaría, Judith Vancostenoble. Existence and cost of boundary controls for a degenerate/singular parabolic equation (2022). Mathematical Control ...

Internal control for a non-local Schrödinger equation involving the fractional Laplace operator

U. Biccari Internal control for a non-local Schrödinger equation involving the fractional Laplace operator (2022), Vol. 11, No. 1: 301-324 ...

Sidewise control of 1-d waves

Y. Sarac, E. Zuazua. Sidewise control of 1-d waves. J Optim Theory Appl. Vol. 193, pp. 931–949 (2022). https://doi.org/10.1007/s10957-021-01986-w Abstract ...

Greedy algorithm for parameter dependent operator Lyapunov equations

Martin Lazar, Jerome Weston. Greedy algorithm for parameter dependent operator Lyapunov equations (2021) Systems & Control Letters, Vol. 154, pp ...

Optimal distributed control of linear parabolic equations by spectral decomposition

Martin Lazar, Cesare Molinari. Optimal distributed control of linear parabolic equations by spectral decomposition (2021) Optimal Control Applications and Methods, ...

Null controllability of a nonlinear age, space and two-sex structured population dynamics model

Yacouba Simporé, Oumar Traoré. Null controllability of a nonlinear age, space and two-sex structured population dynamics model (2021) Mathematical Control ...

Rotor imbalance suppression by optimal control

M. Gnuffi, D. Pighin, N. Sakamoto Rotor imbalance suppression by optimal control Optimal Control Applications and Methods, Vol. 43, No ...

Flow decomposition for heat equations with memory

G. Wang, Y. Zhang, E. Zuazua. Flow decomposition for heat equations with memory (2022) J. Math. Pures Appl, Vol. 158, ...

Diffusive Relaxation Limit of the Multi-Dimensional Hyperbolic Jin-Xin System

Crin-Barat T., L. Shou. Diffusive Relaxation Limit of the Multi-Dimensional Hyperbolic Jin-Xin System (2022) Abstract. In this paper we study ...

Controllability and Positivity Constraints in Population Dynamics with age, size Structuring and Diffusion

Yacouba Simporé, Umberto Biccari. Controllability and Positivity Constraints in Population Dynamics with age, size Structuring and Diffusion (2022) Abstract. In ...

Null Controllability for a Degenerate Structured Population Model

Yacouba Simporé, Yassine El gantouh, Umberto Biccari. Null Controllability for a Degenerate Structured Population Model (2022) Abstract. In this paper, ...

Greedy search of optimal approximate solutions

M. Lazar, E. Zuazua. Greedy search of optimal approximate solutions (2022) Commun. Optim. Theory Abstract. In this paper we develop ...

Control of reaction-diffusion models in biology and social sciences

Domènec Ruiz-Balet, Enrique Zuazua. Control of reaction-diffusion models in biology and social sciences (2022) Math. Control Relat. Fields Abstract. These lecture ...

The turnpike property and the longtime behavior of the Hamilton-Jacobi-Bellman equation for finite-dimensional LQ control problems

C. Esteve, H. Kouhkouh, D. Pighin, E. Zuazua. The turnpike property and the long-time behavior of the Hamilton-Jacobi-Bellman equation for finite-dimensional ...

Turnpike in Optimal Control PDES, ResNets, and beyond

B. Geshkovski, E. Zuazua, Turnpike in Optimal Control PDES, ResNets and beyond (2022) Acta Numer., Vol. 31, pp. 135-263. doi:10.1017/S0962492922000046 ...

Local Stability and Convergence of Unconstrained Model Predictive Control

Daniël Veldman, Enrique Zuazua. Local Stability and Convergence of Unconstrained Model Predictive Control (2022) Abstract. The local stability and convergence for ...

Preface- Control and Analysis of Partial Differential Equations

Nicolae Cîndea, Günter Leugering, Jëróme Lohêac, Sorin Micu, Kirsten Morris, Takeo Takahashi and Enrique Zuazua. Preface- Control and Analysis of ...

On the decay of one-dimensional locally and partially dissipated and hyperbolic systems

Crin-Barat T., De Nitti N., Zuazua E.. On the decay of one-dimensional locally and partially dissipated and hyperbolic systems (2022) ...

Initial data identification for the one-dimensional Burgers equation

Thibault Liard, Enrique Zuazua. Initial data identification for the one-dimensional Burgers equation. (2022). IEEE T Automat. Contr., Vol. 67, No ...

Nonuniqueness of minimizers for semilinear optimal control problems

D. Pighin. Nonuniqueness of minimizers for semilinear optimal control problems (2022) J. Eur. Math. Soc, , published online first. https://doi.org/10.4171/jems/1232 ...

Numerical Control: Part A

Emmanuel Trélat, Enrique Zuazua. Numerical Control: Part A First Edition (2022), Elsevier Science & Technology. Handbook of Numerical Analysis XXIII, ...

Cost of null controllability for parabolic equations with vanishing diffusivity and a transport term

Bárcena-Petisco J.A., Cost of null controllability for parabolic equations with vanishing diffusivity and a transport term (2020). HAL Id: hal-02455632 ...

Reachable subspaces, control regions and heat equations with memory

G. Wang, Y. Zhang, E. Zuazua. Reachable subspaces, control regions and heat equations with memory. (2021) Abstract. We study the ...

Nonnegative control of finite-dimensional linear systems

Lohéac J., Trélat E., Zuazua E. Nonnegative control of finite-dimensional linear systems. Ann. I. H. Poincare-An., Vol. 38, No. 2, ...

Control and Deep Learning: Some connections

B. Geshkovski, E. Zuazua.  Control and Deep Learning: Some connections (2021) This note is an extended abstract for a talk ...

Large-time asymptotics in deep learning

Esteve C., Geshkovski B., Pighin D., Zuazua E. Large-time asymptotics in deep learning (2021). hal-02912516 Abstract. It is by now well-known ...

Local null controllability of a model system for strong interaction between internal solitary waves

Jon Asier Bárcena-Petisco, Sergio Guerrero and Ademir F. Pazoto.  Local null controllability of a model system for strong interaction between ...

Multiplicity of solutions for fractional q(.)-Laplacian equations

Abita Rahmoune, Umberto Biccari. Multiplicity of solutions for fractional q(.)-Laplacian equations. (2021) Abstract. In this paper, we deal with the following ...

The Finite-Time Turnpike Phenomenon for Optimal Control Problems: Stabilization by Non-smooth Tracking Terms

M. Gugat, M. Schuster, E. Zuazua. The Finite-Time Turnpike Phenomenon for Optimal Control Problems: Stabilization by Non-Smooth Tracking Terms, in ...

Controllability of one-dimensional viscous free boundary flows

B. Geshkovski, E. Zuazua. Controllability of one-dimensional viscous free boundary flows. Siam. J. Control. Optim (2021), Vol. 59, No. 3, ...

The turnpike property in semilinear control

D. Pighin The turnpike property in semilinear control ESAIM Control Optim. Calc. Var., Vol. 26 (2021), pp. 1-48 Abstract.An exponential ...

Control of Hyperbolic and Parabolic Equations on Networks and Singular limits

J.A. Bárcena-Petisco, M. Cavalcante, G.M. Coclite, N. de Nitti, Enrique Zuazua. Control of Hyperbolic and Parabolic Equations on Networks and Singular ...

Local null controllability of the penalized Boussinesq system with a reduced number of controls

J.A. Bárcena-Petisco, Kevin Le Balc'H. Local null controllability of the penalized Boussinesq system with a reduced number of controls (2021) Abstract ...

Blow-up results for a logarithmic pseudo-parabolic p(.)-Laplacian type equation

Abita Rahmoune, Umberto Biccari. Blow-up results for a logarithmic pseudo-parabolic p(.)-Laplacian equation. (2021) Abstract. In this paper, we consider an initial-boundary ...

Optimal control of linear non-local parabolic problems with an integral kernel

Umberto Biccari, Víctor Hernández-Santamaría, Loic Louison, Abdennebi Omrane. Optimal control of linear non-local parabolic problems with an integral kernel. (2021) Abstract ...

The turnpike property in nonlinear optimal control – A geometric approach

N. Sakamoto, E. Zuazua. The turnpike property in nonlinear optimal control - A geometric approach. (2021) Automatica., Vol. 134 (2021), ...

Optimal control for neural ODE in a long time horizon and applications to the classification and simultaneous controllability problems

Jon Asier Bárcena-Petisco. Optimal control for neural ODE in a long time horizon and applications to the classification (2021) Abstract ...

Classical system theory revisited for Turnpike in standard state space systems and impulse controllable descriptor systems

Heiland J., Zuazua E. Classical system theory revisited for Turnpike in standard state space systems and impulse controllable descriptor systems (2021) ...

Model predictive control with random batch methods for a guiding problem

Ko Dongnam, Zuazua Enrique. Model predictive control with random batch methods for a guiding problem (2021). Math. Models Methods Appl ...

Special issue in the honor of Enrique Zuazua’s 60th birthday

G. Buttazzo, E. Casas, L. de Teresa, R. Glowinski, G. Leugering, E. Trélat and X. Zhang (eds.). Special issue in the ...

Sparse approximation in learning via neural ODEs

Esteve C., Geshkovski B. Sparse approximation in learning via neural ODEs (2021) Abstract. We consider the continuous-time, neural ordinary differential equation ...

Averaged dynamics and control for heat equations with random diffusion

Bárcena J.A., Zuazua E.. Averaged dynamics and control for heat equations with random diffusion (2021) Syst. Control. Lett. Vol. 158 ...

Control and Numerical approximation of Fractional Diffusion Equations

Umberto Biccari, Mahamadi Warma, Enrique Zuazua. Control and Numerical approximation of Fractional Diffusion Equations (2022) Handb. Numer. Anal. Elsevier. ISSN:1570-8659, DOI: ...

The Vlasov-Fokker-Planck Equation with High Dimensional Parametric Forcing Term

Shi Jin, Yuhua Zhu, Enrique Zuazua. The Vlasov-Fokker-Planck Equation with High Dimensional Parametric Forcing Term Numer. Math. 150, 479–519 (2022) ...

Turnpike in Lipschitz-nonlinear optimal control

Esteve C., Geshkovski G., Pighin D., Zuazua E. . Turnpike in Lipschitz-nonlinear optimal control Nonlinearity. Vol 5. No. 34, pp ...

Linear projection-based CEST parameter estimation

F. Glang, Moritz Fabian, A. German, Katrin M Khakzar, A. Mennecke, A. Liebert, K. Herz, P. Liebig, B. Kasper, Manuel ...

Interpolation and approximation via Momentum ResNets and Neural ODEs

Domènec Ruiz-Balet, Elisa Affili , Enrique Zuazua. Interpolation and approximation via Momentum ResNets and Neural ODEs IEEE Control Syst. Lett ...