Publications

In Press
L. Amoudruz, A. Economides, and P. Koumoutsakos, “The Volume of Healthy Red Blood Cells is Optimal for Advective Oxygen Transport in Arterioles,” Biophysical Journal, In Press. Publisher's VersionAbstract
Red blood cells (RBCs) are vital for transporting oxygen from the lungs to the body’s tissues through the intricate
circulatory system. They achieve this by binding and releasing oxygen molecules to the abundant hemoglobin within their cytosol.
The volume of RBCs affects the amount of oxygen they can carry, yet whether this volume is optimal for transporting oxygen
through the circulatory system remains an open question. This study explores, through high-fidelity numerical simulations, the
impact of RBC volume on advectve oxygen transport efficiency through arterioles which form the area of greatest flow resistance
in the circulatory system. The results show that, strikingly, RBCs with volumes similar to those found in vivo are most efficient to
transport oxygen through arterioles. The flow resistance is related to the cell-free layer thickness, which is influenced by the
shape and the motion of the RBCs: at low volumes RBCs deform and fold while at high volumes RBCs collide and follow more
diffuse trajectories. In contrast, RBCs with a healthy volume maximize the cell-free layer thickness, resulting in a more efficient
advectve transport of oxygen.
Submitted
R. Mojgani, D. Waelchli, Y. Guan, P. Koumoutsakos, and P. Hassanzadeh, “Extreme Event Prediction with Multi-agent Reinforcement Learning-based Parametrization of Atmospheric and Oceanic Turbulence,” Submitted. Arxiv
S. Kaltenbach, P. - S. Koutsourelakis, and P. Koumoutsakos, “Interpretable reduced-order modeling with time-scale separation,” Submitted. Arxiv
E. Menier, S. Kaltenbach, M. Yagoubi, M. Schoenauer, and P. Koumoutsakos, “Interpretable Learning of Effective Dynamics for multiscale systems,” Submitted. Arxiv
M. Chatzimanolakis, P. Weber, and P. Koumoutsakos, “Drag Reduction in Flows Past 2D and 3D Circular Cylinders Through Deep Reinforcement Learning,” Submitted. Arxiv
K. Vogiatzoglou, C. Papadimitriou, K. Ampountolas, M. Chatzimanolakis, P. Koumoutsakos, and V. Bontozoglou, “An interpretable wildfire spreading model for real-time predictions,” Submitted. Arxiv
D. Waelchli, P. Weber, and P. Koumoutsakos, “Discovering Individual Rewards in Collective Behavior through Inverse Multi-Agent Reinforcement Learning,” Submitted. Arxiv
P. R. Vlachas and P. Koumoutsakos, “Learning from Predictions: Fusing Training and Autoregressive Inference for Long-Term Spatiotemporal Forecasts,” Submitted. Arxiv
2023
I. Kicic, P. Vlachas, G. Arampatzis, M. Chatzimanolakis, L. Guibas, and P. Koumoutsakos, “Adaptive learning of effective dynamics for online modeling of complex systems,” Computer Methods in Applied Mechanics and Engineering, vol. 415, pp. 116204, 2023. Publisher's VersionAbstract

Predictive simulations are essential for applications ranging from weather forecasting to material design. The veracity of these simulations hinges on their capacity to capture the effective system dynamics. Massively parallel simulations predict the systems dynamics by resolving all spatiotemporal scales, often at a cost that prevents experimentation. On the other hand, reduced order models are fast but often limited by the linearization of the system dynamics and the adopted heuristic closures. We propose a novel systematic framework that bridges large scale simulations and reduced order models to extract and forecast adaptively the effective dynamics (AdaLED) of multiscale systems. AdaLED employs an autoencoder to identify reduced-order representations of the system dynamics and an ensemble of probabilistic recurrent neural networks (RNNs) as the latent time-stepper. The framework alternates between the computational solver and the surrogate, accelerating learned dynamics while leaving yet-to-be-learned dynamics regimes to the original solver. AdaLED continuously adapts the surrogate to the new dynamics through online training. The transitions between the surrogate and the computational solver are determined by monitoring the prediction accuracy and uncertainty of the surrogate. The effectiveness of AdaLED is demonstrated on three different systems - a Van der Pol oscillator, a 2D reaction–diffusion equation, and a 2D Navier–Stokes flow past a cylinder for varying Reynolds numbers (400 up to 1200), showcasing its ability to learn effective dynamics online, detect unseen dynamics regimes, and provide net speed-ups. To the best of our knowledge, AdaLED is the first framework that couples a surrogate model with a computational solver to achieve online adaptive learning of effective dynamics. It constitutes a potent tool for applications requiring many computationally expensive simulations.

kicic2023a.pdf
E. Papadopoulou, G. W. Kim, P. Koumoutsakos, and G. Kim, “Molecular dynamics analysis of water flow through a multiply connected carbon nanotube channel,” Current Applied Physics, vol. 45, pp. 64-71, 2023. Publisher's VersionAbstract
The filling process of nanoconduits is an active research topic. In this study, we use molecular dynamics simulations to identify the filling process of water molecules in a multiply connected carbon nanotube (MCCNT). For water permeation, a local change in the channel cross-section affects the water filling of MCCNTs because it may lead to irregularities in the permeation profile. A decrease in hydrogen bonds at the junctions of the structure characterizes the permeability of MCCNTs. In contrast to pristine CNTs, the complex nanochannel exhibits a different imbibition profile due to the energy changes at the junction. Next, we examine the local water density and velocity patterns in MCCNT channels to understand how junction regions affect steady-state water transport. We find that there is congestion and irregularities in steady water flow density and velocity profiles. Through this study, we expect to develop effective channels with more complex geometries for water purification and drug delivery
papadopoulou2023.pdf
P. Karnakov, S. Litvinov, and P. Koumoutsakos, “Flow reconstruction by multiresolution optimization of a discrete loss with automatic differentiation,” The European Physical Journal E, vol. 46, no. 59, 2023. Publisher's VersionAbstract
We present a potent computational method for the solution of inverse problems in fluid mechanics. We consider inverse problems formulated in terms of a deterministic loss function that can accommodate data and regularization terms. We introduce a multigrid decomposition technique that accelerates the convergence of gradient-based methods for optimization problems with parameters on a grid. We incorpo- rate this multigrid technique to the Optimizing a DIscrete Loss (ODIL) framework. The multiresolution ODIL (mODIL) accelerates by an order of magnitude the original formalism and improves the avoidance of local minima. Moreover, mODIL accommodates the use of automatic differentiation for calculating the gradients of the loss function, thus facilitating the implementation of the framework. We demonstrate the capabilities of mODIL on a variety of inverse and flow reconstruction problems: solution reconstruction for the Burgers equation, inferring conductivity from temperature measurements, and inferring the body shape from wake velocity measurements in three dimensions. We also provide a comparative study with the related, popular Physics-Informed Neural Networks (PINNs) method. We demonstrate that mODIL has three to five orders of magnitude lower computational cost than PINNs in benchmark problems including simple PDEs and lid-driven cavity problems. Our results suggest that mODIL is a very potent, fast and consistent method for solving inverse problems in fluid mechanics.
Flow reconstruction by multiresolution optimization of a discrete loss with automatic differentiation
L. Amoudruz, A. Economides, G. Arampatzis, and P. Koumoutsakos, “The stress-free state of human erythrocytes: Data- driven inference of a transferable RBC model,” Biophysical Journal, 2023. Publisher's VersionAbstract

The stress-free state (SFS) of red blood cells (RBCs) is a fundamental reference configuration for the calibration of computational models, yet it remains unknown. Current experimental methods cannot measure the SFS of cells without affecting their mechanical properties, whereas computational postulates are the subject of controversial discussions. Here, we introduce data-driven estimates of the SFS shape and the visco-elastic properties of RBCs. We employ data from single- cell experiments that include measurements of the equilibrium shape of stretched cells and relaxation times of initially stretched RBCs. A hierarchical Bayesian model accounts for these experimental and data heterogeneities. We quantify, for the first time, the SFS of RBCs and use it to introduce a transferable RBC (t-RBC) model. The effectiveness of the proposed model is shown on predictions of unseen experimental conditions during the inference, including the critical stress of transitions between tum- bling and tank-treading cells in shear flow. Our findings demonstrate that the proposed t-RBC model provides predictions of blood flows with unprecedented accuracy and quantified uncertainties.

The stress-free state of human erythrocytes: Data- driven inference of a transferable RBC model
2022
M. Chatzimanolakis, P. Weber, and P. Koumoutsakos, “Vortex separation cascades in simulations of the planar flow past an impulsively started cylinder up to Re = 100 000,” Journal of Fluid Mechanics, vol. 953, 2022. Publisher's VersionAbstract
Direct numerical simulations of the flow past an impulsively started cylinder at high Reynolds numbers (25k–100k) reveal an intriguing portrait of unsteady separation. Vorticity generation and vortex shedding entails a cascade of separation events on the cylinder surface that are reminiscent of Kelvin–Helmholtz instabilities. Primary vortices roll up along the cylinder surface as a result of instabilities of the initially attached vortex sheets, followed by vortex eruptions, creation of secondary vorticity and formation of dipole structures that are subsequently ejected from the surface of the cylinder. We analyse the vortical structures and their relationship to the forces experienced by the cylinder. This striking cascade of vortex instabilities may serve as reference for reduced-order models of flow separation and as guide for flow control of separated flows at high Reynolds numbers.
Vortex separation cascades in simulations of the planar flow past an impulsively started cylinder up to Re = 100 000
S. Cantero-Chinchilla, et al., “Robust optimal sensor configuration using the value of information,” Structural Control and Health Monitoring, 2022. Publisher's VersionAbstract

Sensing is the cornerstone of any functional structural health monitoring technology, with sensor number and placement being a key aspect for reliable monitoring. We introduce for the first time a robust methodology for optimal sensor configuration based on the value of information that accounts for (1) uncertainties from updatable and nonupdatable parameters, (2) variability of the objective function with respect to nonupdatable parameters, and (3) the spatial correlation between sensors. The optimal sensor configuration is obtained by maximizing the expected value of information, which leads to a cost-benefit analysis that entails model parameter uncertainties. The proposed methodology is demonstrated on an application of structural health monitoring in plate-like structures using ultrasonic guided waves. We show that accounting for uncertainties is critical for an accurate diagnosis of damage. Furthermore, we provide critical assessment of the role of both the effect of modeling and measurement uncertainties and the optimization algorithm on the resulting sensor placement. The results on the health monitoring of an alu- minum plate indicate the effectiveness and efficiency of the proposed methodology in discovering optimal sensor configurations.

Robust optimal sensor configuration using the value of information
Y. Gal, P. Koumoutsakos, F. Lanusse, G. Louppe, and C. Papadimitriou, “Bayesian uncertainty quantification for machine-learned models in physics,” Nature Reviews Physics , 2022. Publisher's Version Bayesian uncertainty quantification for machine-learned models in physics.pdf
P. R. Vlachas, G. Arampatzis, C. Uhler, and P. Koumoutsakos, “Multiscale simulations of complex systems by learning their effective dynamics,” Nat Mach Intell, 2022. Publisher's VersionAbstract
Predictive simulations of complex systems are essential for applications ranging from weather forecasting to drug design. The veracity of these predictions hinges on their capacity to capture effective system dynamics. Massively parallel simulations predict the system dynamics by resolving all spatiotemporal scales, often at a cost that prevents experimentation, while their findings may not allow for generalization. On the other hand, reduced-order models are fast but limited by the frequently adopted linearization of the system dynamics and the utilization of heuristic closures. Here we present a novel systematic framework that bridges large-scale simulations and reduced-order models to learn the effective dynamics of diverse, complex systems. The framework forms algorithmic alloys between nonlinear machine learning algorithms and the equation-free approach for modelling complex systems. Learning the effective dynamics deploys autoencoders to formulate a mapping between fine- and coarse-grained representations and evolves the latent space dynamics using recurrent neural networks. The algorithm is validated on benchmark problems, and we find that it outperforms state-of-the-art reduced-order models in terms of predictability, and large-scale simulations in terms of cost. Learning the effective dynamics is applicable to systems ranging from chemistry to fluid mechanics and reduces the computational effort by up to two orders of magnitude while maintaining the prediction accuracy of the full system dynamics. We argue that learning the effective dynamics provides a potent novel modality for accurately predicting complex systems.
Multiscale simulations of complex systems by learning their effective dynamics
J. Lipkova, B. Menze, B. Wiestler, P. Koumoutsakos, and J. Lowengrub, “Modelling glioma progression, mass effect and intracranial pressure in patient anatomy,” J. R. Soc. Interface, vol. 19, no. 188, 2022. Publisher's VersionAbstract
Increased intracranial pressure is the source of most critical symptoms in patients with glioma, and often the main cause of death. Clinical interventions could benefit from non-invasive estimates of the pressure distribution in the patient's parenchyma provided by computational models. However, existing glioma models do not simulate the pressure distribution and they rely on a large number of model parameters, which complicates their calibration from available patient data. Here we present a novel model for glioma growth, pressure distribution and corresponding brain deformation. The distinct feature of our approach is that the pressure is directly derived from tumour dynamics and patient-specific anatomy, providing non-invasive insights into the patient's state. The model predictions allow estimation of critical conditions such as intracranial hypertension, brain midline shift or neurological and cognitive impairments. A diffuse-domain formalism is employed to allow for efficient numerical implementation of the model in the patient-specific brain anatomy. The model is tested on synthetic and clinical cases. To facilitate clinical deployment, a high-performance computing implementation of the model has been publicly released.
Modelling glioma progression, mass effect and intracranial pressure in patient anatomy
J. Bae and P. KOUMOUTSAKOS, “Scientific multi-agent reinforcement learning for wall-models of turbulent flows,” Nature Communications, vol. 13, 2022. Publisher's VersionAbstract

The predictive capabilities of turbulent flow simulations, critical for aerodynamic design and weather prediction, hinge on the choice of turbulence models. The abundance of data from experiments and simulations and the advent of machine learning have provided a boost to turbulence modeling efforts. However, simulations of turbulent flows remain hindered by the inability of heuristics and supervised learning to model the near-wall dynamics. We address this challenge by introducing scientific multi-agent reinforcement learning (SciMARL) for the discovery of wall models for large-eddy simulations (LES). In SciMARL, discretization points act also as cooperating agents that learn to supply the LES closure model. The agents self- learn using limited data and generalize to extreme Reynolds numbers and previously unseen geometries. The present simulations reduce by several orders of magnitude the computa- tional cost over fully-resolved simulations while reproducing key flow quantities. We believe that SciMARL creates unprecedented capabilities for the simulation of turbulent flows.

Scientific multi-agent reinforcement learning for wall-models of turbulent flows
P. R. Vlachas, J. Zavadlav, M. Praprotnik, and P. Koumoutsakos, “Accelerated Simulations of Molecular Systems through Learning of Effective Dynamics,” J. Chem. Theory Comput. vol. 18, no. 1, pp. 538-549, 2022. Publisher's VersionAbstract
Simulations are vital for understanding and predicting the evolution of complex molecular systems. However, despite advances in algorithms and special purpose hardware, accessing the time scales necessary to capture the structural evolution of biomolecules remains a daunting task. In this work, we present a novel framework to advance simulation time scales by up to 3 orders of magnitude by learning the effective dynamics (LED) of molecular systems. LED augments the equation-free methodology by employing a probabilistic mapping between coarse and fine scales using mixture density network (MDN) autoencoders and evolves the non-Markovian latent dynamics using long short-term memory MDNs. We demonstrate the effectiveness of LED in the Müller–Brown potential, the Trp cage protein, and the alanine dipeptide. LED identifies explainable reduced-order representations, i.e., collective variables, and can generate, at any instant, all-atom molecular trajectories consistent with the collective variables. We believe that the proposed framework provides a dramatic increase to simulation capabilities and opens new horizons for the effective modeling of complex molecular systems.
Accelerated Simulations of Molecular Systems through Learning of Effective Dynamics
2021
K. Daniilidis, et al., “Robotics in the AI era: a vision for a hellenic robotics initiative,” Found. Trends Mach. Learn. vol. 9, no. 3, pp. 201-265, 2021. Publisher's VersionAbstract

In January 2021, the Hellenic Institute of Advanced Study (HIAS) assembled a panel including world leading roboticists from the Hellenic diaspora, who volunteered their scientific expertise to provide a vision for Robotics in Greece. This monograph, entitled “Robotics in the Artificial Intelligence (AI) era,” will hopefully trigger a dialogue towards the development of a national robotics strategy. Our vision is that Robotics in the AI era will be an essential technology of the future for the safety and security of the Hellenic nation, its environment and its citizens, for modernizing its economy towards Industry 4.0, and for inspiring and educating the next generation workforce for the challenges of the 21st century. To contribute towards making this vision a reality, after reviewing global trends in robotics and assessing the Greek robotics ecosystem, we arrived at the following key findings and recommendations: Firstly, we think that Greece should develop a national Hellenic Robotics Initiative that serves as the nation’s long-term vision and strategy across the entire Greek robotics ecosystem. Also, certain societal drivers should be key in the areas of focus. Safety and security is an area of national importance necessitating a national initiative, while agrifood, maritime and logistics provide opportunities for internationally leading innovation.

We recommend the establishment of a mission-driven, government-funded, organization advancing unmanned vehicles in societal drivers of national importance, and Greece should leverage its unique geography and become a living testbed of robotics innovation turning the country into a development site for exportable technologies. In our opinion, universities should create Centers of Excellence in robotics and AI as well as consider innovation-leading research institutes such as the Italian Institute of Technology. We recommend investing in robotics education using Maker Spaces in order to prepare the workforce with 21st century skills to become Industry 4.0 innovators. Furthermore, we believe that the government should collect, measure, and analyze data on the robotics industry, robotics uses, labor shifts, and brain gain and promote awareness via a Hellenic Robotics Day. And finally, the government should regulate robot safety without stifling innovation, provide safe experimentation areas and mechanisms for certifying safety of locally developed robots. This monograph has many additional suggestions that enhance the above main recommendations. As authors, we advocate bringing the robotics ecosystem together in order to sharpen and expand these findings to an ambitious, long-term, and detailed national strategy and roadmap for robotics in the AI era.

Robotics in the AI era: a vision for a hellenic robotics initiative

Pages