Mathematical general relativity reviewed.
problem Challenges in mathematical modeling of general relativity.
method Selected topics reviewed.
result Insights into mathematical models of general relativity.
Deep learning models are growing, posing new mathematical challenges.
problem Mathematical challenges in training, inference, generalization, and optimization of deep models.
method Formal mathematical analysis and communication with mathematicians, statisticians, and computer scientists.
result A set of new mathematical challenges in deep learning.
AI mirrors modern math's autonomous development, raising interpretive challenges.
problem AI's effectiveness in math mirrors historical autonomy of math.
method Analyzes historical evolution of modern mathematics and AI's role.
result AI's affinity with math's historical autonomy suggests interpretive limits.
AI aids in mathematics research and problem-solving.
problem Complex mathematical problems and discoveries.
method Explains AI principles and diverse applications in math.
result AI assists in discovering patterns, proving theorems, and challenging conjectures.
Review of mathematical representations for biomolecular data.
problem Complexity and high dimensionality of biomolecular datasets hinder ML applications.
method Developed low-dimensional and scalable mathematical representations using algebraic topology, differential geometry, and graph theory.
result Mathematical representations improve protein-ligand binding predictions and other biomolecular applications.
Examines challenges and proposes new approaches in machine learning theory.
problem Challenges in machine learning as a function approximation and optimization.
method Mathematical analysis of gradient descent, fixed network limitations, and RNNs.
result New insights and mathematical approaches to improve machine learning.
Mathematical reasoning---a core ability within human intelligence---presents some unique challenges as a domain: we do not come to understand and solve mathematical problems primarily on the back of experience and evidence, but on the basis of inferring, learning, and exploiting laws, axioms, and symbol manipulation ru…
New analysis shows transformer models can't learn effectively.
problem Transformer models learning in context can't achieve general predictive accuracy.
method Empirical evidence and mathematical analysis of transformer architecture limitations.
result Transformers cannot achieve general predictive accuracy due to architectural limitations.
Mathematical Reinforcement Learning faces a 'Two-Hump' problem due to sparse rewards and a scarcity of intermediate 'hard-but-solvable' instances.
problem Mathematical search problems in Reinforcement Learning
method Novel data generation techniques and algorithmic enhancements
result Substantial performance improvements over previous baselines
Mathematical models reveal key factors for engaging Gen Z at work.
problem Understanding and improving engagement of Generation Z employees.
method Correlation and cluster analyses on engagement surveys.
result Clear responsibilities and challenging work are essential for Gen Z employees.
A new mathematical framework simplifies securitization structuring.
problem Challenges in structuring asset-backed securities.
method PEAL Method: a 10-step mathematical framework.
result Enhances risk characterization and market transparency.
Benchmark for math reasoning models from human proofs.
problem Measuring and accelerating machine learning models in high-level mathematical reasoning.
method Built a non-synthetic dataset from theorem prover proofs, defined a task for model to fill in missing propositions, used hierarchical transformer to improve performance.
result Neural models can capture non-trivial mathematical reasoning, hierarchical transformer outperforms baseline.
Distance metric learning is a branch of machine learning that aims to learn distances from the data, which enhances the performance of similarity-based algorithms. This tutorial provides a theoretical background and foundations on this topic and a comprehensive experimental analysis of the most-known algorithms. We sta…
Special issue on understanding physical processes from unusual diffusion patterns.
problem Understanding physical processes from anomalous diffusion data.
method Not explicitly described in the abstract, but likely involves analysis of data from the Anomalous Diffusion Challenge.
result Not explicitly stated, but likely includes analysis of physical processes from anomalous diffusion data.
Explains the history and challenges of minimal surfaces.
problem Understanding the regularity of minimal surfaces.
method Historical overview and technical analysis.
result Outlines the evolution and current state of minimal surfaces.
This survey reviews Heterogeneous Representation Learning (HRL) for diverse data types.
problem Challenges in learning from heterogeneous data types.
method Unified learning framework for modeling various learning settings.
result Unified mathematical framework for multi-view, transfer, privileged, and multi-task learning.
LLMs struggle with arithmetic tasks unless they use high numerical precision.
problem Improving arithmetical reasoning capabilities of LLMs.
method Theoretical analysis and empirical experiments on numerical precision.
result LLMs require high numerical precision to efficiently handle arithmetic tasks.
The modern data analyst must cope with data encoded in various forms, vectors, matrices, strings, graphs, or more. Consequently, statistical and machine learning models tailored to different data encodings are important. We focus on data encoded as normalized vectors, so that their "direction" is more important than th…
Extends Bayesian theory to handle complex interdependencies in multidimensional event spaces.
problem Complex interdependencies between events and hypotheses sets in real-world systems.
method Developed a mathematical formalism for modeling complex relationships through rigorous derivation and validated using analytical proofs, simulations, and case studies.
result MDSE theory improves prediction accuracy by 15-20% compared to standard Bayesian methods in high interdimensionality datasets.
New type of maps studied with non-vanishing torsion.
problem Harmonic maps with non-trivial torsion.
method Introduced and analyzed new type of maps between manifolds with torsion connections.
result First mathematical analysis of harmonic maps with torsion.
This paper reviews recent advances in the field of optimization under uncertainty via a modern data lens, highlights key research challenges and promise of data-driven optimization that organically integrates machine learning and mathematical programming for decision-making under uncertainty, and identifies potential r…
Physical systems are modelled and investigated within simulation software in an increasing range of applications. In reality an investigation of the system is often performed by empirical test scenarios which are related to typical situations. Our aim is to derive a method which generates diverse test scenarios each re…
Calculation of an optimal tariff is a principal challenge for pricing actuaries. In this contribution we are concerned with the renewal insurance business discussing various mathematical aspects of calculation of an optimal renewal tariff. Our motivation comes from two important actuarial tasks, namely a) construction …
Deep learning finds mathematical equations from data.
problem Discovering underlying mathematical expressions from datasets.
method Uses a recurrent neural network to search for mathematical expressions and optimizes using a risk-seeking policy gradient.
result Outperforms existing methods in recovering exact symbolic expressions.
A very brief history of relative valuation in neoclassical finance since 1973 is presented, with attention to core currency issues for emerging economies. Price formation is considered in the context of hierarchical causality, with discussion focussed on identifying mathematical modelling challenges for robust and tran…
LLMs will inevitably hallucinate due to their mathematical structure.
problem The inherent limitations of Large Language Models (LLMs).
method Analysis of LLMs using computational theory and Godel's Incompleteness Theorem.
result Hallucinations in LLMs are an inevitable feature, not just errors.
Deep neural networks (DNNs) have emerged as key enablers of machine learning. Applying larger DNNs to more diverse applications is an important challenge. The computations performed during DNN training and inference are dominated by operations on the weight matrices describing the DNN. As DNNs incorporate more layers a…
Python module for RL trading in limit order books.
problem Training RL agents for algorithmic trading in limit order books.
method Model-based gym environments for reinforcement learning.
result Efficient RL training for trading problems.
GANs as priors improve uncertainty quantification in complex fields.
problem Bayesian inference challenges in high-dimensional, discrete fields.
method Use GANs to approximate prior distributions for Bayesian updates.
result Demonstrated efficacy on image classification, inpainting, denoising, and inverse problems.
Researchers created a continuous Markov martingale that mimics Brownian motion but lacks the strong Markov property.
problem Constructing a continuous Markov martingale with Brownian marginals that misses the strong Markov property.
method Developed a new approach to create a continuous Markov martingale that differs from Brownian motion in terms of the strong Markov property.
result A continuous Markov martingale with Brownian marginals that lacks the strong Markov property was successfully constructed.
Mathematical advances needed for Digital Twins, differing from traditional models.
problem Foundational mathematical advances required for Digital Twins.
method Multi-scale, multi-physics modeling and coupling, different reliability criteria and uncertainty assessments.
result AI/ML methods can perform well in biomedical problems but fail in simple engineering systems.
Introduces triangular transport for uncertain data.
problem Uncertainty in complex systems without known probabilistic representations.
method Characterizes and manipulates unknown probability distributions using triangular transport maps.
result Triangular transport guarantees desirable mathematical and computational properties.
Kolmogorov-Arnold Networks promise scalable performance in high dimensions.
problem Curse of dimensionality in multilayer perceptrons.
method Kolmogorov-Arnold representation theorem and interpolation methods.
result Kolmogorov-Arnold Networks achieve true freedom from the curse of dimensionality.
The challenge to fruitfully merge state-of-the-art techniques from mathematical finance and numerical analysis has inspired researchers to develop fast deterministic option pricing methods. As a result, highly efficient algorithms to compute option prices in Lévy models by solving partial integro differential equations…
Automatically designs normalization and activation layers together.
problem Designing normalization and activation layers separately.
method Unified tensor-to-tensor computation graph, low-level mathematical functions, rejection protocols, multi-objective evolution.
result Discovery of EvoNorms with novel structures.
Sparse DNNs face scalability issues; MIT/IEEE/Amazon challenge analyzes best solutions.
problem Scalability issues in Sparse Deep Neural Networks (DNNs).
method Mathematically defined DNN inference computation, community submissions from various fields.
result Sparse DNN execution time, TmDNN, is strongly dependent on the number of operations, Nmop. Experimental life sciences like biology or chemistry have seen in the recent decades an explosion of the data available from experiments. Laboratory instruments become more and more complex and report hundreds or thousands measurements for a single experiment and therefore the statistical methods face challenging tasks…
Adversarial deep hedging learns to hedge without specifying asset price models.
problem Lack of effective underlying asset models for deep hedging.
method Adversarial learning framework where a hedger and a generator compete to improve hedging performance.
result Adversarial deep hedging achieves competitive performance without explicit asset process modeling.
There has been a lot of recent interest in adopting machine learning methods for scientific and engineering applications. This has in large part been inspired by recent successes and advances in the domains of Natural Language Processing (NLP) and Image Classification (IC). However, scientific and engineering problems …
We incorporate Tensor-Product Representations within the Transformer in order to better support the explicit representation of relation structure. Our Tensor-Product Transformer (TP-Transformer) sets a new state of the art on the recently-introduced Mathematics Dataset containing 56 categories of free-form math word-pr…
This paper explores how deep learning models can fit data exactly and why this is important.
problem Understanding why deep learning models can fit data exactly and generalize well.
method Interpolation and over-parameterization as key themes to understand deep learning.
result Interpolation and over-parameterization are crucial for deep learning models to fit data exactly and generalize well.
This paper tackles the challenge presented by small-data to the task of Bayesian inference. A novel methodology, based on manifold learning and manifold sampling, is proposed for solving this computational statistics problem under the following assumptions: 1) neither the prior model nor the likelihood function are Gau…
Paper addresses RLHF alignment challenges with novel algorithms.
problem Challenges in RLHF alignment, especially in strategic exploration.
method Develops a reverse-KL regularized contextual bandit formulation and proposes efficient algorithms with theoretical guarantees.
result Proposed methods significantly outperform existing RLHF algorithms in real-world experiments.
The study uncovers latent capabilities of language models via causal representation learning.
problem Rigorous causal evaluations of language model capabilities are challenging due to confounding effects and computational costs.
method Proposes a causal representation learning framework to identify latent capability factors as causally interrelated after controlling for a common confounder (base model).
result Identifies a three-node linear causal structure explaining performance variations across 1500 models and six benchmarks.
The need for new methods to deal with big data is a common theme in most scientific fields, although its definition tends to vary with the context. Statistical ideas are an essential part of this, and as a partial response, a thematic program on statistical inference, learning, and models in big data was held in 2015 i…
Perceptrons have been known for a long time as a promising tool within the neural networks theory. The analytical treatment for a special class of perceptrons started in seminal work of Gardner \cite{Gar88}. Techniques initially employed to characterize perceptrons relied on a statistical mechanics approach. Many of su…
New C∗-algebra approach unifies machine learning strategies.
problem Lack of diverse and information-rich data models in machine learning.
method Integrates C∗-algebra into machine learning frameworks. result Unified learning strategies and new data models.
We consider a class of participation rights, i.e. obligations issued by a company to investors who are interested in performance-based compensation. Albeit having desirable economic properties equity-based debt obligations (EbDO) pose challenges in accounting and contract pricing. We formulate and solve the associated …