LLMs struggle with arithmetic tasks unless they use high numerical precision.
problem Improving arithmetical reasoning capabilities of LLMs.
method Theoretical analysis and empirical experiments on numerical precision.
result LLMs require high numerical precision to efficiently handle arithmetic tasks.
The study uncovers latent capabilities of language models via causal representation learning.
problem Rigorous causal evaluations of language model capabilities are challenging due to confounding effects and computational costs.
method Proposes a causal representation learning framework to identify latent capability factors as causally interrelated after controlling for a common confounder (base model).
result Identifies a three-node linear causal structure explaining performance variations across 1500 models and six benchmarks.
Mathematical study shows post-hoc explanations are better than attention weights alone.
problem Understanding the internal behavior of attention-based models.
method Mathematical analysis of a simple attention-based architecture.
result Post-hoc explanations provide more useful insights than attention weights alone.
A deep learning approach generates math word problems in multiple languages.
problem Template-based mechanisms for generating mathematical word problems lack customizability and creativity.
method Character Level Long Short Term Memory Network (LSTM) and POS tags are used to generate and resolve constraints in generated problems.
result The approach generates accurate math word problems in English and Sinhala with over 90% accuracy.
Benchmark for math reasoning models from human proofs.
problem Measuring and accelerating machine learning models in high-level mathematical reasoning.
method Built a non-synthetic dataset from theorem prover proofs, defined a task for model to fill in missing propositions, used hierarchical transformer to improve performance.
result Neural models can capture non-trivial mathematical reasoning, hierarchical transformer outperforms baseline.
Mathematical reasoning---a core ability within human intelligence---presents some unique challenges as a domain: we do not come to understand and solve mathematical problems primarily on the back of experience and evidence, but on the basis of inferring, learning, and exploiting laws, axioms, and symbol manipulation ru…
Mathematical framework for differential machine learning in finance.
problem Theoretical assumptions in financial models and their impact on machine learning algorithms.
method Rigorous mathematical framework for differential machine learning in finance.
result Theoretical grounding enhances the predictive capabilities of neural networks in financial applications.
Machine learning impacts computational math, offering new functions approximations.
problem Machine learning's black box nature hinders further progress in computational math.
method Analyzes machine learning's impact on computational math and vice versa.
result Integrating computational math with machine learning can enhance both fields.
Transformers with CoT don't enhance reasoning power across all tasks.
problem Does CoT enhance the reasoning power of transformers?
method Examined the memorization capabilities of fixed-precision transformers with and without CoT.
result Transformers with CoT cannot memorize all reasoning tasks, leading to a negative answer.
There is a need for affordable, widely deployable maternal-fetal ECG monitors to improve maternal and fetal health during pregnancy and delivery. Based on the diffusion-based channel selection, here we present the mathematical formalism and clinical validation of an algorithm capable of accurate separation of maternal …
AER dynamically adjusts entropy regularization for better LLM reinforcement learning.
problem Policy entropy collapse in RLVR training limits exploration and reasoning performance.
method Adaptive Entropy Regularization (AER) with difficulty-aware coefficient allocation, initial-anchored target entropy, and dynamic global coefficient adjustment.
result AER consistently outperforms baselines on mathematical reasoning benchmarks, improving both accuracy and exploration.
Paper introduces a new measure combining entropy and Gini index.
problem Quantifying complexity in socio- and econo-physics.
method Generalizes entropy using Gini index and Lorenz curve transformation.
result Supports quantifying complexity in socio- and econo-physics.
This paper deals with the explicit design of strategy formulations to make the best strategic choices from a conventional matrix form of representing strategic choices. The explicit strategy formulation is an analytical model which is targeted to provide a mathematical strategy framework to find the best moment for str…
GFN-SR uses deep learning to generate diverse mathematical expressions.
problem Symbolic regression to find best mathematical expressions.
method Traversing a DAG to generate expression trees sequentially with GFlowNet.
result GFN-SR outperforms other SR algorithms in noisy data.
Transformers learn topic structure through embedding and attention mechanisms.
problem Understanding how transformers capture semantic structure in text.
method Combination of mathematical analysis and experiments on Wikipedia and synthetic data.
result Embedding and attention layers encode topic structure in transformers.
We incorporate Tensor-Product Representations within the Transformer in order to better support the explicit representation of relation structure. Our Tensor-Product Transformer (TP-Transformer) sets a new state of the art on the recently-introduced Mathematics Dataset containing 56 categories of free-form math word-pr…
The paper analyzes financial market turbulence using mathematical physics.
problem Understanding price fluctuations caused by information asymmetry.
method Spectrum analysis to decompose pricing patterns.
result Identifies phase correlations in financial stock market turbulence.
A long-standing problem at the interface of artificial intelligence and applied mathematics is to devise an algorithm capable of achieving human level or even superhuman proficiency in transforming observed data into predictive mathematical models of the physical world. In the current era of abundance of data and advan…
Distance metric learning is a branch of machine learning that aims to learn distances from the data, which enhances the performance of similarity-based algorithms. This tutorial provides a theoretical background and foundations on this topic and a comprehensive experimental analysis of the most-known algorithms. We sta…
PDGM uses neural nets to solve complex financial equations.
problem Solving path-dependent partial differential equations (PPDEs)
method Generalized Deep Galerkin Method (PDGM) combining feed-forward and LSTM architectures
result PDGM successfully models solutions to various PPDEs, including financial derivatives.
ANNs overcome curse of dimensionality for heat equation uniform errors.
problem Approximating high-dimensional heat equations with neural networks.
method Developed techniques to estimate uniform L∞-error. result ANNs' parameters grow polynomially with dimension and precision.
TIR expands LLM capabilities by enabling problem-solving strategies.
problem Lack of a principled theory explaining why LLMs with tools are more capable.
method Formal proof and Advantage Shaping Policy Optimization (ASPO) algorithm.
result TIR model decisively outperforms pure-text models on challenging benchmarks.
Mathematical modeling with Ordinary Differential Equations (ODEs) has proven to be extremely successful in a variety of fields, including biology. However, these models are completely deterministic given a certain set of initial conditions. We convert mathematical ODE models of three benchmark biological systems to Dyn…
Paper introduces Prob-SSI for robust OMA in noisy data.
problem Challenges in estimating modal parameters from noisy data.
method Probabilistic formulation of SSI, robust Prob-SSI algorithm.
result Robust Prob-SSI outperforms conventional SSI in corrupted data.
Bayesian model predicts sequences better than LSTMs by identifying underlying rules.
problem Current RNNs struggle to generalize from limited training data and identify underlying rules in sequences.
method Bayesian model that learns underlying concepts from sequences and generalizes to new data.
result Bayesian model predicts sequences better than traditional LSTMs.
TNet combines DL with physics models to solve inverse problems efficiently.
problem Solving inverse problems with limited data and physics constraints.
method Model-constrained deep learning approach using TNet.
result TNet solutions are as accurate as traditional methods but faster.
We demonstrate the application of an algorithmic trading strategy based upon the recently developed dynamic mode decomposition (DMD) on portfolios of financial data. The method is capable of characterizing complex dynamical systems, in this case financial market dynamics, in an equation-free manner by decomposing the s…
The presence of symmetries in a Hamiltonian system usually implies the existence of conservation laws that are represented mathematically in terms of the dynamical preservation of the level sets of a momentum mapping. The symplectic or Marsden--Weinstein reduction procedure takes advantage of this and associates to the…
Uniform consistency proven for spatial distribution and depth estimators in any dimension.
problem Uniform consistency of spatial distribution and depth estimators in arbitrary dimensions.
method Proof of uniform L1-consistency using sample size n as the only dependency. result Consistency rate is independent of dimension d and sample size n. Kolmogorov-Arnold Networks promise scalable performance in high dimensions.
problem Curse of dimensionality in multilayer perceptrons.
method Kolmogorov-Arnold representation theorem and interpolation methods.
result Kolmogorov-Arnold Networks achieve true freedom from the curse of dimensionality.
Geometric arbitrage theory reformulates a generic asset model possibly allowing for arbitrage by packaging all asset and their forward dynamics into a stochastic principal fibre bundle, with a connection whose parallel transport encodes discounting and portfolio rebalancing, and whose curvature measures, in this geomet…
Enhances math problem-solving models with multi-turn preference learning.
problem Improving mathematical problem-solving capabilities of large language models.
method Introduces a multi-turn direct preference learning framework for tool-integrated mathematical reasoning tasks.
result Significant performance improvements in model accuracy on math datasets.
While there is currently a lot of enthusiasm about "big data", useful data is usually "small" and expensive to acquire. In this paper, we present a new paradigm of learning partial differential equations from {\em small} data. In particular, we introduce \emph{hidden physics models}, which are essentially data-efficien…
The mixed-fractional CEV model improves CDS pricing by accounting for default risk.
problem Improving the pricing of Credit Default Swaps (CDS) by accounting for default risk.
method Using a mixed-fractional Brownian motion to model the Constant Elasticity of Variance (CEV) model.
result The mixed-fractional CEV model yields more realistic CDS spreads and default probabilities.
We study the problem of predicting rare critical transition events for a class of slow-fast nonlinear dynamical systems. The state of the system of interest is described by a slow process, whereas a faster process drives its evolution and induces critical transitions. By taking advantage of recent advances in reservoir…
Bayesian Causal Forests model assesses part-time work's impact on student growth.
problem Estimating causal effects of part-time work on student growth in mathematics achievement.
method Longitudinal Bayesian Causal Forests model combining non-parametric and difference-in-differences methods.
result Negative impact of part-time work for most students, potential benefits for those with low school belonging, widening achievement gap identified.
The paper proposes a method to identify causal structure in complex dynamical systems.
problem Spurious correlations in data-driven models limit the performance of control systems.
method The method leverages controllability concepts to compute input trajectories and uses causal inference techniques.
result The method reliably identifies the true causal structure of control systems from real-world data.
DeepONets improve surrogate modeling for engineering systems.
problem Accurately modeling complex PDEs for engineering systems.
method DeepONets specialize in approximating mathematical operators for PDEs.
result DeepONets achieve high prediction accuracy and zero-shot capability.
Model for dynamic pricing across multiple RE groups to maximize revenue.
problem Maximizing revenue from multiple RE pricing groups.
method Mathematical model incorporating multiple pricing groups, revenue goals, and time value of money.
result Algorithm for constructing a pricing policy for multiple RE groups.
Auto-CEI improves LLM reasoning by balancing assertiveness and conservativeness.
problem Hallucinations and laziness in LLM reasoning tasks.
method Expert Iteration explores reasoning trajectories, guiding incorrect paths back on track and promoting appropriate 'I don't know' responses.
result Auto-CEI achieves superior alignment in logical reasoning, mathematics, and planning tasks.
Bayesian Gaussian Processes layer detects out-of-distribution data in medical imaging.
problem Detecting out-of-distribution data in medical imaging tasks.
method Parameter-efficient hierarchical convolutional Gaussian Processes in Wasserstein-2 space.
result Uncertainty estimates enable superior out-of-distribution detection compared to previous methods.
FML uses neural networks to model unknown systems accurately.
problem Modeling unknown dynamical systems with incomplete data.
method Flow map learning (FML) combined with deep neural networks.
result Accurate predictive models for partially observed systems.
Transformers learn functionals from distributions without losing information.
problem Lack of rigorous mathematical theory supporting Transformer performance.
method Proposed a Transformer learning framework, attention operator, and distribution regression.
result Transformers can compress distributions into function representations without loss of information.
Study particle dynamics in non-differentiable fractal spaces.
problem Understanding motion in non-smooth, probabilistic geometries.
method Use fiber bundle theory to characterize multivalued geodesic trajectories.
result Developed a hybrid theory combining surface and stochastic process theories.
Study proposes a new metric for comparing Gaussian mixtures in RKHS.
problem Comparing complex multimodal densities in RKHS.
method Wasserstein-type metric for kernel Gaussian mixtures.
result Enhanced capability to model multimodal densities.
In this paper, we study a multi-step interactive recommendation problem, where the item recommended at current step may affect the quality of future recommendations. To address the problem, we develop a novel and effective approach, named CFRL, which seamlessly integrates the ideas of both collaborative filtering (CF) …
Advanced mathematical relativity course for math and physics students.
problem Mathematical foundations of general relativity.
method Comprehensive lecture notes covering advanced topics.
result Comprehensive coverage of mathematical relativity for advanced students.
The paper surveys mathematical results on filtration enlargement with financial examples.
problem Mathematical finance applications of filtration enlargement theory.
method Exhaustive survey and interpretation of key results from literature.
result Provides a compendium of known mathematical results for mathematical finance researchers.