Interpretable meta-learning for physical systems reduces computational costs and improves interpretability.
problem Challenges in learning from heterogeneous experimental data.
method Affine structure learning model for multi-environment generalization.
result Proves the model can identify physical parameters and demonstrates competitive performance.
Interpretable machine-learning models can be unstable under multicollinearity, leading to oscillatory weights that do not reflect meaningful contributions.
problem Interpretable machine-learning models can be unstable under multicollinearity.
method Theoretical analysis of eigenmodes of the feature correlation matrix.
result Small-eigenvalue modes associated with multicollinearity amplify fluctuations in the weights and generate oscillatory patterns that do not necessarily reflect meaningful contributions.
Bayesian framework discovers interpretable Lagrangian from data.
problem Discovering physical laws from limited data.
method Sparse Bayesian approach for learning interpretable Lagrangian.
result Automates Hamiltonian discovery from Lagrangian and provides ODE/PDE descriptions.
Physics models integrated into VAEs improve generative performance and extrapolation.
problem Improving generative models with interpretability and robustness.
method Physics-based latent space in VAEs with regularized learning to balance physics and neural network components.
result Generative performance and extrapolation improvements demonstrated on synthetic and real-world datasets.
Parsimonious neural networks discover interpretable physical laws from data.
problem Discovering interpretable physical laws from data using machine learning.
method Combining neural networks with evolutionary optimization to balance accuracy and parsimony.
result Developed models for classical mechanics and materials melting temperature prediction.
Generative model learns wireless channel distributions efficiently.
problem Learning precise wireless channel distributions for optimal communication.
method Physics-informed sparse Bayesian generative modeling (SBGM) with compressed data.
result Model learns channel parameters from compressed AP observations, is physically interpretable, and generalizes across different systems.
Machine learning improves planetary space physics by incorporating physical knowledge.
problem Improving performance and interpretability of machine learning models for planetary space physics.
method Building on a previous semi-supervised physics-based classification, the team used varying data and physical information to improve machine learning performance and interpretability.
result Incorporating physical knowledge improves machine learning performance and interpretability, essential for deriving scientific meaning.
A good feature representation is a determinant factor to achieve high performance for many machine learning algorithms in terms of classification. This is especially true for techniques that do not build complex internal representations of data (e.g. decision trees, in contrast to deep neural networks). To transform th…
Improves machine learning models by incorporating physical laws into feature maps.
problem Lack of model interpretability in classical machine learning approaches.
method Physics-informed feature maps constructed from physical laws and dimensional analysis.
result Enhanced model interpretability and potential discovery of new physical equations.
p3VAE combines physics and machine learning for robust data representations.
problem Improving machine learning models' robustness to environmental factors of variation.
method Physics-informed variational autoencoder integrating physical knowledge with neural networks.
result p3VAE outperforms competing models in extrapolation and interpretability. SG-PALM learns interpretable tensor models for high-dimensional data.
problem Learning interpretable tensor models for high-dimensional data.
method SG-PALM combines Sylvester generative model and fast proximal alternating linearized minimization.
result SG-PALM converges linearly to global optimum and scales to high dimensions.
TIME network simplifies complex physical processes with interpretable models.
problem Challenges in learning coupled dynamic processes from multiple observations.
method Fully convolutional architecture capturing invariant domain structure.
result Robust and transparent in capturing process kernels and anomalies.
Paper proposes PI-DAE for missing data imputation in buildings using physics constraints.
problem Missing data in building energy modeling.
method Physics-informed Denoising Autoencoders (PI-DAE) with multivariate and univariate configurations.
result Enhanced interpretability and robustness to missing data rates.
Understanding biological network dynamics is a fundamental issue in various scientific and engineering fields. Network theory is capable of revealing the relationship between elements and their propagation; however, for complex collective motions, the network properties often transiently and complexly change. A fundame…
HFNO enhances interpretability of turbulent flows through parallel wavenumber bin processing.
problem Opaque inner workings of Fourier Neural Operators (FNOs) hinder physical interpretability.
method Introduces HFNO, a novel FNO-based architecture that processes wavenumber bins in parallel, enhancing interpretability.
result HFNO decomposes turbulent flows across various scales, enabling increased interpretability and multiscale modeling.
FaIRGP model improves climate emulation with physical interpretability.
problem Lack of physical interpretability in data-driven emulators.
method Bayesian approach to a data-driven emulator of energy balance equations.
result Demonstrates skillful emulation of global and spatial surface temperatures.
Using deep neural networks for identifying physics objects at the Large Hadron Collider (LHC) has become a powerful alternative approach in recent years. After successful training of deep neural networks, examining the trained networks not only helps us understand the behaviour of neural networks, but also helps improv…
Proposes a physics-informed VAE for disentangling physics from confounding influences.
problem Challenges in inferring and predicting physical systems under partial knowledge.
method Physics-informed variational autoencoder with adversarial training.
result Model successfully disentangles known physics from confounding influences.
Semi-parametric framework for nonlinear system identification
problem Nonlinear system identification
method Orthogonal Gaussian process regression
result Interpretable models from incomplete physics
Gradient-based training and pruning for radial basis function networks in materials physics.
problem Interpretable and robust machine learning for materials physics problems.
method Gradient-based training and pruning of radial basis function networks with closed-form optimization criteria.
result Pruned models provide compact and interpretable versions of larger models, offering insights into atom-level migration processes.
A method smears likelihood to reveal physical energy scales in jet identification.
problem Interpretability of machine learning in particle physics.
method Smearing or averaging over events within a metric energy distance.
result Discrimination power increases as resolution decreases, showing sensitivity to all energy scales.
Physics-guided model improves deep learning for nonlinear systems.
problem Intractable inference of nonlinear dynamical systems from data.
method Physics-guided Deep Markov Model (PgDMM) using neural networks.
result Improved performance on nonlinear systems with structured latent space.
Unified taxonomy for ML uncertainty in physics, validated.
problem Uncertainty quantification in machine learning for physics.
method Unified taxonomy, principled validation tools.
result Illustrated validation tools with examples.
Experimental data is often affected by uncontrolled variables that make analysis and interpretation difficult. For spatiotemporal systems, this problem is further exacerbated by their intricate dynamics. Modern machine learning methods are particularly well-suited for analyzing and modeling complex datasets, but to be …
Model learns Lagrangian dynamics from images for better prediction and control.
problem Lack of interpretability and applicability to high-dimensional data like images.
method Unsupervised neural network model that learns Lagrangian dynamics from images using a coordinate-aware VAE.
result Model infers interpretable Lagrangian dynamics, enabling long-term prediction and synthesis of controllers.
Intelligent agents need a physical understanding of the world to predict the impact of their actions in the future. While learning-based models of the environment dynamics have contributed to significant improvements in sample efficiency compared to model-free reinforcement learning algorithms, they typically fail to g…
PIML enhances machine learning for subsurface energy systems.
problem Lack of interpretability and domain-specific knowledge in machine learning models.
method Integrates physics principles into data-driven models using deep learning.
result PIML improves model generalization and adherence to physical laws.
CAMEL enhances manifold embedding and learning with curvature metrics.
problem High-dimensional data classification, dimension reduction, and visualization.
method CAMEL uses a Riemannian manifold with curvature metrics for enhanced expressibility and interpretability.
result CAMEL outperforms state-of-the-art methods on high-dimensional datasets.
New insights into ML models' accuracy and generalization for scientific problems.
problem Quantifying accuracy and generalization of ML models in scientific applications.
method Rigorous numerical analysis and theoretical bounds for linear differential equations.
result Different ML models can have opposing generalization behaviors, contrary to intuition.
How to understand deep learning systems remains an open problem. In this paper we propose that the answer may lie in the geometrization of deep networks. Geometrization is a bridge to connect physics, geometry, deep network and quantum computation and this may result in a new scheme to reveal the rule of the physical w…
Generative model connects physical properties to latent vectors for solar magnetic patches.
problem Disconnection between generative latent vectors and scientifically relevant quantities.
method Integrating GAN, SVM, and SSL to generate and retrieve physically interpretable solar magnetic patches.
result GAN-SVM combination enables smooth changes in physical parameters with generated patches.
A generalized Clifford manifold is proposed in which there are coordinates not only for the basis vector generators, but for each element of the Clifford group, including the identity scalar. These new quantities are physically interpreted to represent internal structure of matter (e.g. classical or quantum spin). The …
Turbo-Sim generates models from physics principles, improving interpretability and flexibility.
problem Transforming particle properties from theory to observation in collider physics.
method Maximizes mutual information between input and output, setting loss term weights.
result Mathematically interpretable and flexible generative models.
Improves latent variable learning for complex data.
problem Expressive latent variables for model prediction on multi-component data.
method Dynamic Latent Separation method that distances data samples in the latent space.
result Enhances output diversity and provides interpretable representations.
In applications of machine learning to particle physics, a persistent challenge is how to go beyond discrimination to learn about the underlying physics. To this end, a powerful tool would be a framework for unsupervised learning, where the machine learns the intricate high-dimensional contours of the data upon which i…
STS clarifies chaos and stochastic dynamics, linking algebraic topology and physics.
problem Chaos and stochastic dynamics in arbitrary form SDEs.
method Supersymmetric theory of stochastic dynamics (STS) using generalized transfer operator (GTO) and topological field theories (TFT).
result Positive 'pressure' in GTOs corresponds to spontaneous breakdown of topological supersymmetry, explaining 1/f noise.
Develops experimental design for discovering missing physics in bioreactors.
problem Discovering missing physics in incomplete model structures of process systems.
method Combines universal differential equations and symbolic regression with sequential experimental design.
result Successfully recovered true model structure of a bioreactor using machine learning techniques.
Equivariant neural network simplifies particle physics models.
problem Complexity and interpretability in particle physics classification.
method Lorentz group equivariant neural network architecture.
result Simplified, interpretable models with fewer parameters.
Physics-informed machine learning models improve biomolecular system simulations.
problem Modeling unresolved interactions beyond classical force fields.
method Physics-informed neural networks and operator learning.
result Accurate, mechanistic, generalizable models for long-timescale kinetics.
Recent results and interpretations are presented for the thermal minority game, concentrating on deriving and justifying the fundamental stochastic differential equation for the microdynamics.
Understanding complex systems with their reduced model is one of the central roles in scientific activities. Although physics has greatly been developed with the physical insights of physicists, it is sometimes challenging to build a reduced model of such complex systems on the basis of insights alone. We propose a nov…
DPC uses physics and neural nets to solve SDEs.
problem Solving stochastic differential equations with missing physics.
method Physics-data fusion with conditional maximum mean discrepancy (CMMD) loss.
result DPC achieves highly accurate solutions on benchmark examples.
Spin-opstrings from QMC simulations enable ML of quantum phases.
problem Capturing and predicting quantum phase transitions using ML.
method Spin-opstrings derived from QMC simulations used as ML input.
result Spin-opstrings accurately predict quantum phase transitions.
Physics-informed model reduces RBC simulation costs.
problem Computational infeasibility of direct numerical simulations for turbulent systems.
method Combines CNN and recurrent architecture, penalized with PDEs, uses conformal prediction.
result Significant reduction in computational cost for long-term simulations.
Symmetry-regularized Neural ODEs improve model stability and interpretability.
problem Improving the stability and physical interpretability of Neural ODEs.
method Integrating Lie symmetries and conservation laws into the loss function.
result Symmetry-regularized Neural ODEs enhance model stability and interpretability.
This work combines machine learning with physical models to solve inverse problems efficiently.
problem Solving inverse problems in the presence of missing physics and recovering parameters.
method Variational autoencoding with a physically structured decoder network and stochastic local approximations.
result The method accelerates inference for Bayesian inverse problems and acts as a regularizer encoding prior physical information.
Study assesses data-driven and physics-based SGS models for transcritical combustion.
problem Challenges in simulating high-pressure combustion systems due to complex fluid behaviors.
method Comparison of physics-based and random forest machine learning models in turbulent transcritical non-premixed flames.
result Random forest models can effectively model subgrid stresses, providing insight into their formation.
Active learning improves SR by proposing experiments in data-limited settings.
problem Efficiently gathering data for symbolic regression with physical constraints.
method Query by committee using the Pareto frontier of equations, with physical constraints.
result Reduces data required for SR and achieves state-of-the-art results.