In this paper we develop a new perspective on generalization of neural networks by proposing and investigating the concept of a neural network stiffness. We measure how stiff a network is by looking at how a small gradient step in the network's parameters on one example affects the loss on another example. Higher stiff…
Analyzes properties of stiffness tensors for elastic wave imaging.
problem Characterizing stiffness tensor fields for elastic wave imaging.
method Finsler-geometric methods applied to anisotropic stiffness tensor fields.
result Conditions for Finsler-geometric methods to be applicable.
Study on elastic curves with variable stiffness, derived from bending energy.
problem Modeling elastic wires with varying thickness.
method Derive Euler-Lagrange equations for curves with variable bending stiffness.
result Characterizations of elastic curves with variable stiffness.
This paper presents a new method for solving systems with polynomial stiffness.
problem Finding analytical solutions to nonlinear differential equations with polynomial stiffness is challenging.
method The paper introduces a geometric/algebraic method using generating series and shuffle product.
result The method provides a recursive schematic that can be automated and applied to systems with polynomial stiffness.
Researchers reconstruct stiffness tensors from limited data in anisotropic elasticity.
problem Reconstructing stiffness tensors from partial data around one polarization.
method Using algebraic geometry and slowness surfaces, the approach leverages the algebraic geometry of families of slowness surfaces.
result For tensors in a dense open subset, a small amount of data around one polarization uniquely determines the entire slowness surface and stiffness tensor.
Efficiently integrates stiff ODEs with vectorized methods.
problem Stiff systems and sparse training data in ODEs.
method Implicit, vectorized time integration with adjoint method.
result Achieves speed ups of greater than 100x on modern GPUs.
Physics-informed model predicts beam stiffness and monitors structural health.
problem Predicting and monitoring the stiffness of Euler-Bernoulli beams.
method Physics-informed Gaussian process model using the Euler-Bernoulli beam equation.
result Model accurately predicts bending stiffness and detects structural damage.
Developing stable and scalable probabilistic ODE solvers for stiff and high-dimensional problems.
problem Stiff and high-dimensional ODEs
method Matrix-free update step and iterative re-linearization
result Improved stability and scalability
AMORE uses neural operators to efficiently predict multiple thermochemical states in stiff chemical kinetics.
problem Efficiently integrating stiff chemical kinetics systems to reduce computational cost.
method Developed AMORE, a framework of adaptive multi-output operator network with two adaptive loss functions.
result Demonstrated improved accuracy and efficiency in predicting thermochemical states from initial conditions.
LiLaN uses linear latent networks to solve stiff ODEs efficiently.
problem Solving stiff ordinary differential equations (StODEs) requires expensive methods.
method LiLaN integrates latent dynamics analytically, avoiding explicit/implicit integration.
result LiLaN can approximate stiff nonlinear systems to any accuracy epsilon.
A novel method optimizes variable-stiffness structures for better strength and weight.
problem Optimizing variable-stiffness structures for higher strength and lighter weight.
method A novel multi-stage concurrent topology optimization scheme combining DMO, S-BPTO, and CFAO.
result The method ensures better fibre angle convergence and stable optimization.
In our previous article [Rad16], we investigated the asymptotic behaviour of orthogonal Bianchi class B perfect fluids close to the initial singularity and proved the Strong Cosmic Censorship conjecture in this setting. In several of the statements, the case of a stiff fluid had to be excluded. The present paper fills …
Structural damage due to excessive loading or environmental degradation typically occurs in localized areas in the absence of collapse. This prior information about the spatial sparseness of structural damage is exploited here by a hierarchical sparse Bayesian learning framework with the goal of reducing the source of …
Probabilistic solvers improve stability for stiff systems.
problem Performance penalties for small steps in stiff systems.
method Probabilistic exponential integrators that include fast linear dynamics in the prior.
result Proven L-stability and probabilistic error accounting.
Physics-informed GANs estimate elastic moduli from mechanical tests.
problem Estimating spatially-varying elastic moduli from measured deformations.
method Physics-informed Generative Adversarial Networks (PI-GANs) with PDE constraints.
result Generated stiffness samples match true distribution statistics.
Study gauge freedoms in elastic wave equations and Dirichlet-to-Neumann map.
problem Recover stiffness tensor and density from Dirichlet-to-Neumann map.
method Analyze invariance under coordinate transformations and gauge freedoms.
result Present gauge freedoms in the Dirichlet-to-Neumann map for Riemannian elastic wave equation.
The simplest field theory description of the multivariate statistics of forward rate variations over time and maturities, involves a quadratic action containing a gradient squared rigidity term. However, this choice leads to a spurious kink (infinite curvature) of the normalized correlation function for coinciding matu…
The focus in this paper is Bayesian system identification based on noisy incomplete modal data where we can impose spatially-sparse stiffness changes when updating a structural model. To this end, based on a similar hierarchical sparse Bayesian learning model from our previous work, we propose two Gibbs sampling algori…
Certain solutions of a sextic sigma-model Lagrangian reminiscent of Skyrme model correspond to perfect fluids with stiff matter equation of state. We analyse from a differential geometric perspective this correspondence extended to general barotropic fluids.
The Phi- relationship also known as Phi-factor appears in a number of lattice structures, mostly considering the lines within several separate circles or polygons. The paper considers a regular hexagonal tessellation as a lattice with the highest specific mechanical stiffness.
Efficiently infers latent SDEs with scalable memory and time costs.
problem Inference of latent SDEs with high time and memory complexity.
method Amortized reparametrization of expectations under linear SDEs, coupled with efficient gradient approximation.
result Achieves similar performance to adjoint sensitivities with fewer model evaluations.
The paper proves that certain spaces have injective balls of any radius.
problem The injectivity radius of certain geometric spaces is infinite.
method Analyzes higher rank simple and semisimple Lie groups with specific properties.
result The locally symmetric spaces have injective balls of any radius.
Fourier Neural Operators accurately predict dynamics of high-dimensional ionic models.
problem Approximating stiff, multiscale ionic models using neural networks.
method Fourier Neural Operators for learning dynamics of high-dimensional ionic models.
result Fourier Neural Operators can accurately predict dynamics of high-dimensional ionic models.
New methods solve complex financial equations.
problem Solving backward stochastic differential equations driven by continuous-time Markov chains.
method Multi-stage Euler-Maruyama methods and multilevel spatial discretization.
result Efficiently solved stiff Markov BSDEs.
Self-adaptive PINNs improve accuracy in stiff PDEs.
problem Accurate numerical solution of stiff PDEs using neural networks.
method Adaptive weights applied to each training point individually, using a soft attention mechanism.
result SA-PINNs outperform other PINN algorithms in L2 error with fewer training epochs.
In many contexts the modal properties of a structure change, either due to the impact of a changing environment, fatigue, or due to the presence of structural damage. For example during flight, an aircraft's modal properties are known to change with both altitude and velocity. It is thus important to quantify these cha…
In this paper, we develop a convolutional neural network model to predict the mechanical properties of a two-dimensional checkerboard composite quantitatively. The checkerboard composite possesses two phases, one phase is soft and ductile while the other is stiff and brittle. The ground-truth data used in the training …
A linkage is a finite graph with lengths assigned to each edge. A planar realization is a map to the plane which preserves edge lengths. It can be thought of as a mechanical device formed from stiff rods and rotating joints. We look at the configuration space of all planar realizations of a linkage (following work of K…
We propose Symplectic Recurrent Neural Networks (SRNNs) as learning algorithms that capture the dynamics of physical systems from observed trajectories. An SRNN models the Hamiltonian function of the system by a neural network and furthermore leverages symplectic integration, multiple-step training and initial state op…
Optimizes natural frequencies of cellular composites with various microstructures.
problem Designing cellular composites with diverse microstructures for maximizing natural frequencies.
method Data-driven topology optimization with a latent-variable Gaussian process model.
result Cellular designs with multiclass microstructures achieve higher natural frequencies.
LIQSS method improves accuracy and efficiency for power system simulations.
problem Accurately modeling and simulating long-duration mission profiles of Naval power systems.
method Linear Implicit Quantized State System (LIQSS) method for stiff, nonlinear, differential algebraic equations.
result LIQSS1 method yields results within 1% accuracy of continuous methods and increases efficiency logarithmically with quantization size.
Diffusion models simulate molecular dynamics with adjustable accuracy.
problem Simulating molecular dynamics with high accuracy and efficiency.
method Diffusion models as Euler-Maruyama integrators for Langevin dynamics, learning forces from static snapshots.
result Diffusion models generate molecular trajectories with temporal correlations similar to MD simulations.
We consider a disk-shaped thin elastic sheet bonded to a compliant sphere. (Our sheet can slip along the sphere; the bonding controls only its normal displacement.) If the bonding is stiff (but not too stiff), the geometry of the sphere makes the sheet wrinkle to avoid azimuthal compression. The total energy of this sy…
Paper analyzes Langevin dynamics for multimodal Gaussian mixtures, controlling errors across dimensions.
problem Challenges in obtaining stable diffusion-based samplers in high- and infinite-dimensional settings.
method Study of preconditioned Annealed Langevin Dynamics (ALD) for Gaussian mixtures, focusing on Euler-Maruyama (EM) and exponential-integrator schemes.
result Proves dimension-uniform KL bounds for the exponential-integrator scheme, allowing arbitrarily small divergence with dimension.
Develops a framework for distilling flow models from few steps.
problem Improving few-step sampling in diffusion models for better performance.
method Local approximation errors and dynamical amplification controlled through analytical tractability.
result Deep residual compositions efficiently approximate long-horizon transport with controlled global error.
Physics-informed deep learning approximates strain gradient plasticity solutions.
problem Stiffness and computational challenges in solving strain gradient plasticity models.
method Physics-informed deep learning (PIDL) with modified loss functions and optimization schemes.
result PIDL methods address stiffness and computational challenges in strain gradient plasticity.
Develops a new model to predict training dynamics of large language models.
problem Lack of mechanistic understanding of training dynamics in large language models.
method A first-principles reduced-order model of training dynamics, predicting group-size invariance and stability thresholds.
result Closed-form model predicts training dynamics with high accuracy and provides new diagnostics.
Additive nonparametric regression models provide an attractive tool for variable selection in high dimensions when the relationship between the response and predictors is complex. They offer greater flexibility compared to parametric non-linear regression models and better interpretability and scalability than the non-…
We propose a new cognitive framework for option price modelling, using quantum neural computation formalism. Briefly, when we apply a classical nonlinear neural-network learning to a linear quantum Schrödinger equation, as a result we get a nonlinear Schrödinger equation (NLS), performing as a quantum stochastic filter…
Study of Riemann solitons and η-hyperbolic Ricci solitons on Bochner-flat Lorentzian Kähler spacetime manifolds.
problem Analyzing soliton behaviors on Bochner-flat Lorentzian Kähler spacetime manifolds.
method Deriving explicit formulas for soliton parameters and analyzing their behaviors.
result Criteria for shrinking, steady, and expanding behaviors of solitons.
AdaPID optimizes diffusion-based samplers by dynamically adjusting schedules.
problem Optimizing the intermediate-time dynamics in diffusion-based samplers.
method Develops a time-varying stiffness schedule using Piece-Wise-Constant (PWC) parametrizations and a hierarchical refinement approach.
result QoS-driven PWC schedules consistently improve sampling fidelity and accuracy.
In the context of science, the well-known adage "a picture is worth a thousand words" might well be "a model is worth a thousand datasets." In this manuscript we introduce the SciML software ecosystem as a tool for mixing the information of physical laws and scientific models with data-driven machine learning approache…
Model explains yield curve dynamics using order flow shocks.
problem Understanding the yield curve's fluctuations and their relation to order flows.
method Relates exogenous shocks to order flow surprises, creating a microstructural model that incorporates price and order flow dynamics.
result The model explains yield curve dynamics with fewer parameters and generates liquidity-dependent correlations.
Study finds strict collection policies improve portfolio quality of microfinance banks.
problem Improving portfolio quality of microfinance banks through better credit collection policies.
method Multi-stage sampling, regression analysis, descriptive statistics.
result Collection policy has a higher effect on portfolio quality.
We address the problem of parameter estimation in models of systems biology from noisy observations. The models we consider are characterized by simultaneous deterministic nonlinear differential equations whose parameters are either taken from in vitro experiments, or are hand-tuned during the model development process…
DistillKac generates images quickly using damped wave equations.
problem Generating high-quality images efficiently.
method Uses damped wave equations and Kac dynamics for finite speed transport.
result Fast image generation with high quality and numerical stability.
We establish a connection between trend filtering and system identification which results in a family of new identification methods for linear, time-varying (LTV) dynamical models based on convex optimization. We demonstrate how the design of the cost function promotes a model with either a continuous change in dynamic…
New boundary treatment improves accuracy for complex PDEs.
problem Order reduction in high-order IMEX schemes for multidimensional PDEs.
method Novel boundary treatment algorithms for Cartesian meshes, treating implicit-explicit stages similarly to interior points.
result Recovery of designed order of convergence by numerical verification.