Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

3517021,0531,404 · Jun 202019922001200920172026
48 results for Physics-inspired models

New approach relaxes inductive biases of physics-inspired NNs for better performance.

problem Challenges in applying physics-inspired NNs to real-world systems.
method Examined and relaxed inductive biases of Hamiltonian NNs, improving performance on non-conservative systems.
result Improved performance on practical, non-conservative systems by relaxing inductive biases.

Neural SVEs model complex systems with memory, outperforming traditional methods.

problem Modeling systems with memory effects and irregular behavior.
method Introducing neural stochastic Volterra equations as a physics-inspired architecture.
result Neural SVEs outperform neural SDEs and DeepONets in various applications.

Physics-inspired methods optimize SVD compression of LLMs.

problem Efficiently compressing large language models (LLMs) using SVD.
method FermiGrad for globally optimal rank selection and PivGa for lossless compression.
result Global optimization of SVD ranks and lossless compression of low-rank factors.

The issue of computing (co)homology generators of a cell complex is gaining a pivotal role in various branches of science. While this issue can be rigorously solved in polynomial time, it is still overly demanding for large scale problems. Drawing inspiration from low-frequency electrodynamics, this paper presents a ph…

2012-12-06abs ↗pdf ↗

SLT explains neural network success by closing theory-practice gap.

problem Failure of classical inference and learning theory in modern neural networks.
method Physics-inspired Singular Learning Theory (SLT) applied to neural networks.
result SLT recovers known and novel scaling laws for neural network phase transitions.

We show that dispersive propagation of light followed by phase detection has properties that can be exploited for extracting features from the waveforms. This discovery is spearheading development of a new class of physics-inspired algorithms for feature extraction from digital images with unique properties and superio…

2017-06-07abs ↗pdf ↗

Purely data driven approaches for machine learning present difficulties when data is scarce relative to the complexity of the model or when the model is forced to extrapolate. On the other hand, purely mechanistic approaches need to identify and specify all the interactions in the problem at hand (which may not be feas…

2011-07-13abs ↗pdf ↗

Proposes a framework for compositional generalization in language models.

problem Lack of compositional generalization in neural networks compared to humans.
method Introduces Generalized Grammar Rules (GGRs) for transduction tasks, formalizing symmetry-based constraints.
result Framework enables models to generalize compositionally, similar to human learning.

We introduce a machine learning approach for extracting fine-grained representations of protein evolution from molecular dynamics datasets. Metastable switching linear dynamical systems extend standard switching models with a physically-inspired stability constraint. This constraint enables the learning of nuanced repr…

2016-10-05abs ↗pdf ↗

Study shows perceptrons with random labels perform similarly to Gaussian data.

problem The assumption of Gaussian input data is often seen as a limitation in machine learning.
method Analyzed generalized linear classification (perceptron model) with random labels.
result Minimum training loss is independent of data covariance for high-dimensional input data.

Proposes a thermodynamic work minimization framework for guiding generative models.

problem Guiding generative models in sparse-data regimes with limited target samples or constraints.
method Regularization framework inspired by thermodynamic work, introducing Path Guidance and Observable Guidance.
result Improves sample efficiency and reduces bias in molecular simulations.

Derives RL framework for systems without velocity or acceleration measurements.

problem Learning control for systems with limited sensor data.
method Gaussian Process Regression with a novel derivative-free kernel.
result Improved estimation performance and data-efficiency compared to traditional methods.

Study finds physical priors don't significantly improve ML models for learning latent dynamics.

problem Learning latent dynamics from visual observations without access to the underlying state.
method Benchmarked 17 datasets with visual observations of physical systems using various physically inspired methods alongside baselines.
result Physical priors do not significantly improve standard techniques for learning latent dynamics.

SSDMs generate quantum states directly, outperforming classical methods.

problem Generating pure-state quantum representations efficiently.
method Score-based generative model on complex projective manifold.
result SSDMs match target pure-state ensembles by orders of magnitude.

Machine Learning (ML) is one of the most exciting and dynamic areas of modern research and application. The purpose of this review is to provide an introduction to the core concepts and tools of machine learning in a manner easily understood and intuitive to physicists. The review begins by covering fundamental concept…

2018-03-23abs ↗pdf ↗

A new machine learning method for spatial regression.

problem Spatial/temporal regression with scattered data and arbitrary dimensions.
method Modified Planar Rotator (MPRS) method, a non-parametric model with distance-dependent interactions.
result MPRS predictions are competitive with standard interpolation methods and superior in handling rough and non-Gaussian data.

New neural network predicts accurate protein complex structures.

problem Predicting accurate protein complex structures from atomic coordinates.
method Rotation-equivariant neural network combining point-based representation, equivariance, local convolutions, and hierarchical subsampling.
result Significant improvement in identifying accurate structural models.

The paper applies thermodynamics to financial markets to prove no-arbitrage constraints.

problem No arbitrage in financial markets under price impact.
method Stochastic thermodynamics applied to financial trading cycles.
result Proves any round-trip trading strategy yields non-positive expected profit.

New method uses geometric moments for accurate machine learning potentials.

problem Creating high-dimensional potential energy surfaces efficiently.
method Feed-forward neural networks with invariant local molecular descriptors based on geometric moments.
result Accuracy comparable to established models, high efficiency.

New MCMC method speeds up quantum physics simulations by a factor of 100.

problem Simulating quantum many-body systems with high computational complexity.
method FFT-accelerated MCMC with coupled particle and auxiliary variables.
result Achieves O(NlogN)O(N \log N) scaling, significantly faster than traditional O(N3)O(N^3) methods.

A hybrid algorithm combines optimization and enumeration for symbolic regression.

problem Finding any function from a set of operators without prior specification.
method Mixed-integer nonlinear optimization with explicit enumeration and constraints.
result The hybrid algorithm is competitive with state-of-the-art methods.

Previously, we proposed a physically inspired rule to organize the data points in a sparse yet effective structure, called the in-tree (IT) graph, which is able to capture a wide class of underlying cluster structures in the datasets, especially for the density-based datasets. Although there are some redundant edges or…

2015-06-19abs ↗pdf ↗

Bayesian optimization for function-valued responses, addressing worst case deviations.

problem Optimizing expensive functions with functional responses, focusing on worst case performance.
method Min-Max Functional Bayesian Optimization (MM-FBO) using Gaussian process surrogates and functional principal component analysis.
result MM-FBO consistently outperforms existing methods in synthetic and real-world applications.

DEO uses gradient information to escape saddle points in neural networks.

problem Training deep neural networks struggles with flat regions and saddle points.
method Dimer-Enhanced Optimization (DEO) uses gradient information to estimate curvature and escape saddle points.
result DEO improves training efficiency and performance compared to standard first-order methods.

Researchers infer gene activity in dividing cells, accounting for protein inheritance and division history.

problem Inferring protein production kinetics in dividing cells due to protein inheritance and division history.
method Adapted conditional normalizing flows to approximate intractable likelihoods from simulated data.
result Glc3 gene is mostly inactive under stress, with brief and transient expression.

MuML models predict molecular dipole moments using atomic partial charges and dipoles.

problem Predicting molecular dipole moments accurately and efficiently.
method Combining atomic partial charges and atomic dipoles within a physically inspired ML model.
result MuML models achieve excellent transferability and accuracy, approaching DFT results at a fraction of the computational cost.

Paper proposes PI-DAE for missing data imputation in buildings using physics constraints.

problem Missing data in building energy modeling.
method Physics-informed Denoising Autoencoders (PI-DAE) with multivariate and univariate configurations.
result Enhanced interpretability and robustness to missing data rates.

Topolow embeds dissimilarity data into Euclidean space robustly against non-metricity and sparsity.

problem Embedding dissimilarity data into Euclidean space when dissimilarities are non-metric or sparse.
method Topolow uses a physics-inspired, gradient-free optimization framework to maximize likelihood under a Laplace error model.
result Topolow outperforms standard MDS methods in reconstructing sparse and non-Euclidean data.

A framework to compare atomistic descriptors and their transformations.

problem Comparing and understanding different atomistic descriptors and their transformations.
method Introducing a framework to compare different sets of descriptors and their transformations by metrics and kernels.
result Diagnostic tools to determine equivalent information and distorted common information between feature spaces.

Previously, we proposed a physically-inspired method to construct data points into an effective in-tree (IT) structure, in which the underlying cluster structure in the dataset is well revealed. Although there are some edges in the IT structure requiring to be removed, such undesired edges are generally distinguishable…

2015-07-29abs ↗pdf ↗