Single model learns physics from diverse data.
problem Lack of universal physics models for diverse applications.
method General Physics Transformer (GPhyT) trained on diverse physics data.
result Single model achieves superior performance across multiple physics domains.
Machine learning in context of physical systems merits a re-examination of the learning strategy. In addition to data, one can leverage a vast library of physical prior models (e.g. kinematics, fluid flow, etc) to perform more robust inference. The nascent sub-field of \emph{physics-based learning} (PBL) studies the bl…
PhysVarMix predicts diverse urban trajectories with physics constraints.
problem Predicting complex urban agent trajectories with multiple plausible scenarios.
method Physics-informed variational mixture model combining learning and physics constraints.
result Superior performance compared to existing methods on benchmark datasets.
METASET selects diverse unit cells for efficient data-driven metamaterial design.
problem Imbalanced datasets in unit cells can bias data-driven metamaterial design.
method METASET uses similarity metrics and DPPs to select diverse subsets of unit cells.
result Smaller, diverse subsets improve search process and structural performance.
Paper introduces a method to generate physically feasible dynamics with physical priors.
problem Challenges in generating physically feasible dynamics under physical priors.
method Seamlessly incorporates physical priors into diffusion-based generative models.
result Efficient generation of physically realistic dynamics across various physical phenomena.
New ML methods improve physical system understanding by quantifying uncertainty across diverse regimes.
problem Capturing multi-regime physical systems with standard ML techniques.
method Coverage-oriented uncertainty quantification (UQ) methods.
result Coverage-oriented UQ models deliver physically consistent uncertainty estimates.
L-GATr transforms high-energy physics data using geometric algebra and Lorentz symmetry.
problem Extracting scientific understanding from particle-physics experiments with high precision and efficiency.
method L-GATr, a geometric algebra Transformer, representing data in 4D space-time and being equivariant under Lorentz transformations.
result L-GATr achieves performance comparable to or better than domain-specific baselines on regression, classification, and generative tasks.
A novel model learns from limited data using physics constraints and GPVAE to generate realistic samples.
problem Limited data for effective generative AI training.
method Physics-informed Gaussian Process Variational Autoencoder (PIGPVAE) incorporating physical models and discrepancy terms.
result Achieves state-of-the-art performance on indoor temperature data.
New method identifies physical constants from video data alone.
problem Identifying physical constants from video data.
method Proves level-set slope-coverage condition ensures local affine mapping to true physical state, enabling exact parameter recovery.
result Underdamped systems identifiable from a single video clip, other regimes require three diverse trajectories.
High-dimensional diffusion models suffer from distorted samples due to CFG.
problem Distortions in high-dimensional guided diffusion models.
method Analytical tools from statistical physics, dynamic mean-field theory.
result Distortions arise in high-dimensional settings due to class separability issues.
We consider the problem of diversity enhancing clustering, i.e, developing clustering methods which produce clusters that favour diversity with respect to a set of protected attributes such as race, sex, age, etc. In the context of fair clustering, diversity plays a major role when fairness is understood as demographic…
FunDiff models physical functions using diffusion and autoencoders.
problem Adapting generative models to continuous physical functions.
method Combines latent diffusion with function autoencoder, enforcing physical priors.
result Achieves optimal convergence rates for physical function estimation.
PILNO uses neural operators to solve PDEs efficiently on point clouds.
problem Solving partial differential equations (PDEs) on point cloud data efficiently.
method Physics-informed low-rank neural operator framework combining low-rank kernel approximations and an encoder-decoder architecture.
result PILNO efficiently approximates solution operators of PDEs on point cloud data, satisfying PDE constraints and boundary conditions.
New benchmark for causal reasoning from human video descriptions.
problem Lack of diversity in event types and natural language descriptions, and differences from human judgments.
method Iterative event cloze task and data augmentation techniques.
result Improved data collection efficiency and diverse causal judgments.
DeepONets combine neural networks with physics constraints for PDEs and parameter estimation.
problem Estimating parameters in PDEs with uncertainty quantification.
method Physics-informed neural networks (PINNs) integrated with Deep Operator Networks (DeepONets) for Bayesian inference.
result Robust and accurate solutions with comprehensive uncertainty quantification.
aMCL uses annealing to improve hypothesis diversity in ambiguous tasks.
problem Limitations of Winner-takes-all in predicting plausible hypotheses.
method Combines simulated annealing with Multiple Choice Learning (MCL).
result Enhanced exploration of hypothesis space during training.
Develops Φ-DVAE for assimilating unstructured data into physical models.
problem Challenges in incorporating unstructured data into physical models.
method Physics-informed dynamical variational autoencoder (Φ-DVAE) combining latent state-space model and VAE. result Demonstrates data-efficient dynamics encoding with competitive performance and uncertainty quantification.
A new method combines SciML and UQ with physical constraints.
problem Uncertainty quantification in scientific machine learning tasks.
method Physics-constrained polynomial chaos expansion.
result Effective uncertainty quantification and SciML integration.
We propose a paradigm to deep-learn the ever-expanding databases which have emerged in mathematical physics and particle phenomenology, as diverse as the statistics of string vacua or combinatorial and algebraic geometry. As concrete examples, we establish multi-layer neural networks as both classifiers and predictors …
This paper analyzes machine learning workflows in climate modeling.
problem Challenges in integrating machine learning with climate modeling.
method Analysis of case studies focusing on design patterns and workflow structure.
result Synthesis of workflow design patterns across diverse projects in ML-enabled climate modeling.
This paper proposes a new method to connect language and physical actions in reinforcement learning.
problem Connecting linguistic representations to the physical world in embodied agents.
method Language-conditioned goal generators to decouple sensorimotor learning from language acquisition.
result Agents can demonstrate a diversity of behaviors for any given instruction.
The easy access to large data sets has allowed for leveraging methodology in network physics and complexity science to disentangle patterns and processes directly from the data, leading to key insights in the behavior of systems. Here we use to country specific food production data to study binary and weighted topologi…
Subsurface applications including geothermal, geological carbon sequestration, oil and gas, etc., typically involve maximizing either the extraction of energy or the storage of fluids. Characterizing the subsurface is extremely complex due to heterogeneity and anisotropy. Due to this complexity, there are uncertainties…
Improves latent variable learning for complex data.
problem Expressive latent variables for model prediction on multi-component data.
method Dynamic Latent Separation method that distances data samples in the latent space.
result Enhances output diversity and provides interpretable representations.
LOT framework speeds up event distance computation in collider physics.
problem Computational inefficiency in quantifying event distances.
method Linearized Optimal Transport (LOT) for efficient computation.
result LOT significantly reduces computational cost without sacrificing accuracy.
Implicit probabilistic models are a flexible class of models defined by a simulation process for data. They form the basis for theories which encompass our understanding of the physical world. Despite this fundamental nature, the use of implicit models remains limited due to challenges in specifying complex latent stru…
Repulsive ensembles improve uncertainty estimates in PINNs for differential equations.
problem Improving uncertainty estimates in PINNs for differential equations.
method Employing repulsive ensembles (RE-PINN) with a repulsive term in the loss function.
result Repulsive ensembles produce more accurate uncertainty estimates and higher sample diversity.
We introduce a statistical physics inspired supervised machine learning algorithm for classification and regression problems. The method is based on the invariances or stability of predicted results when known data is represented as expansions in terms of various stochastic functions. The algorithm predicts the classif…
Over the past three decades, black holes have played an important role in quantum gravity, mathematical physics, numerical relativity and gravitational wave phenomenology. However, conceptual settings and mathematical models used to discuss them have varied considerably from one area to another. Over the last five year…
Data-efficient PDE operator learning without expensive simulations.
problem Expensive numerical PDE solutions limit data efficiency in machine learning.
method Unsupervised pretraining and in-context learning.
result Highly data-efficient and more generalizable than conventional models.
One endeavour of modern physical chemistry is to use bottom-up approaches to design materials and drugs with desired properties. Here we introduce an atomistic structure learning algorithm (ASLA) that utilizes a convolutional neural network to build 2D compounds and layered structures atom by atom. The algorithm takes …
Recent experimental advances in neuroscience have opened new vistas into the immense complexity of neuronal networks. This proliferation of data challenges us on two parallel fronts. First, how can we form adequate theoretical frameworks for understanding how dynamical network processes cooperate across widely disparat…
Experimental measurements of physical systems often have a limited number of independent channels, causing essential dynamical variables to remain unobserved. However, many popular methods for unsupervised inference of latent dynamics from experimental data implicitly assume that the measurements have higher intrinsic …
The paper improves ODE solvers by integrating diverse information types.
problem Improving accuracy and physical meaningfulness of ODE solutions.
method Leveraging probabilistic solvers to include second-order information and physical conservation laws.
result Solutions become more accurate and physically meaningful with additional information.
GEMSS discovers multiple sparse solutions in high-dimensional data.
problem Identifying multiple sparse feature combinations in high-dimensional, underdetermined systems.
method GEMSS (Gaussian Ensemble for Multiple Sparse Solutions) uses a structured spike-and-slab prior, mixture of Gaussians, and Jaccard-based penalty to optimize a single objective function via stochastic gradient descent.
result GEMSS consistently outperforms five feature selection methods on 128 experiments and real-world datasets.
Turbo-Sim generates models from physics principles, improving interpretability and flexibility.
problem Transforming particle properties from theory to observation in collider physics.
method Maximizes mutual information between input and output, setting loss term weights.
result Mathematically interpretable and flexible generative models.
Bayesian Entropy Neural Networks enforce constraints on deep learning predictions.
problem Deep learning models lack well-defined constraints in their outputs.
method Bayesian Entropy Neural Networks (BENN) using Maximum Entropy principles and the method of multipliers.
result BENN improves model robustness and reliability across various applications.
Determinantal point processes (DPPs) are elegant probabilistic models of repulsion that arise in quantum physics and random matrix theory. In contrast to traditional structured models like Markov random fields, which become intractable and hard to approximate in the presence of negative correlations, DPPs offer efficie…
Determinantal point processes (DPPs), which arise in random matrix theory and quantum physics, are natural models for subset selection problems where diversity is preferred. Among many remarkable properties, DPPs offer tractable algorithms for exact inference, including computing marginal probabilities and sampling; ho…
CViT learns complex physical systems using vision transformer techniques.
problem Learning maps between infinite-dimensional function spaces in scientific machine learning.
method Combines vision transformer encoder, grid-based coordinate embedding, and cross-attention mechanism.
result Achieves state-of-the-art performance on multiple benchmarks, often surpassing larger models.
Deep learning is a broad set of techniques that uses multiple layers of representation to automatically learn relevant features directly from structured data. Recently, such techniques have yielded record-breaking results on a diverse set of difficult machine learning tasks in computer vision, speech recognition, and n…
Deep RL optimizes sensor placement in digital twins for dynamic data acquisition.
problem Limited applicability of traditional sensor placement techniques for online applications.
method Formulates sensor placement as a Markov decision process and uses deep reinforcement learning.
result Improves predictive accuracy and reliability of digital twins through adaptive sensor repositioning.
Framework preserves emergent physics in non-equilibrium systems from particle trajectories.
problem Linking short spatiotemporal scales to emergent bulk physics in multiscale systems.
method Metriplectic bracket formalism for structure-preserving coarse-graining.
result Preservation of thermodynamic laws and conservation in machine-learned dynamics.
EIDGM model estimates DE parameters from RCS data.
problem Estimating DE parameters from RCS data with heterogeneities.
method Physics-informed neural network emulator + Wasserstein GAN parameter generator.
result EIDGM accurately captures diverse parameter distributions.
Research on probabilistic models of networks now spans a wide variety of fields, including physics, sociology, biology, statistics, and machine learning. These efforts have produced a diverse ecology of models and methods. Despite this diversity, many of these models share a common underlying structure: pairwise intera…
Interpretable machine-learning models can be unstable under multicollinearity, leading to oscillatory weights that do not reflect meaningful contributions.
problem Interpretable machine-learning models can be unstable under multicollinearity.
method Theoretical analysis of eigenmodes of the feature correlation matrix.
result Small-eigenvalue modes associated with multicollinearity amplify fluctuations in the weights and generate oscillatory patterns that do not necessarily reflect meaningful contributions.
ALT transforms time series data for better classification.
problem Efficiently classifying time series data with varying temporal scales.
method ALT algorithm using variable-length shifted time windows.
result State-of-the-art performance with minimal computational overhead.
A lightweight framework improves convergence and stability of PINNs for complex PDEs.
problem Training instability and reduced accuracy in PINNs for complex PDEs.
method Adaptive curvature correction using secant information to optimize first-order optimizers.
result Consistent improvements in convergence speed, stability, and accuracy over standard optimizers.