Neural nets learn and forget tasks sequentially, showing promising scalability.
problem Learning and forgetting of multiple visual tasks in a sequential setting.
method Simulated sequential learning of ten related visual tasks.
result Neural nets show forward facilitation and backward interference, which are key phenomena.
New method uses neural nets in Hilbert space for option pricing on flow forwards.
problem Pricing options on flow forwards with neural networks in Hilbert space.
method Optimization problem in Hilbert space solved by a novel feedforward neural network architecture.
result Excellent numerical efficiency and superior performance over classical methods.
A new dual test for forward-flatness simplifies computations.
problem Checking forward-flatness in discrete-time systems.
method A unique sequence of integrable codistributions.
result Computational efficiency and comparison with dynamic feedback linearization.
A quantum field theory generalization, Baaquie, of the Heath, Jarrow, and Morton (HJM) term structure model parsimoniously describes the evolution of imperfectly correlated forward rates. Field theory also offers powerful computational tools to compute path integrals which naturally arise from all forward rate models. …
DFM simplifies CNF training without interpolants.
problem Efficiently training CNFs with computationally expensive ODE solving.
method DFM optimizes dual vector fields for bijective transformations.
result DFM outperforms CNF trained with FM or ML objectives.
State representation learning aims at learning compact representations from raw observations in robotics and control applications. Approaches used for this objective are auto-encoders, learning forward models, inverse dynamics or learning using generic priors on the state characteristics. However, the diversity in appl…
Paper proves convergence of Markovian iteration for FBSDEs with fully coupled drift and Z process.
problem Proving convergence of Markovian iteration for FBSDEs with fully coupled drift and Z process.
method Differentiation-based approach to handle Z process, uniformly controlling Lipschitz continuity of decoupling fields.
result Proves convergence of Markovian iteration method for FBSDEs with fully coupled drift and Z process.
ACI identifies cause-effect relationships and causal influence ranges in dynamical systems.
problem Detecting and quantifying causal influence ranges in complex systems.
method Bayesian data assimilation and assimilative causal inference (ACI) to trace causes back from observed effects.
result Mathematically rigorous formulations of forward and backward causal influence ranges (CIRs) for nonlinear dynamical systems.
Paper creates benchmarks for neural hyperparameter search.
problem Difficulty in comparing HPO methods due to high computational costs.
method Developed benchmarks for a feed forward neural network on four regression datasets.
result Exhaustive comparison of HPO methods on the benchmarks.
New framework for portfolio management using binomial markets and game theory.
problem Investment behavior in competitive and incomplete markets.
method Introduces PRFPP framework, constructs and analyzes for both finite and mean field games.
result Relative performance concerns do not always lead to more risky asset investment.
Causal deep learning tackles causal inference using tensor factor analysis.
problem Addressing causal questions in data using neural networks.
method Tensor factor analysis and neural network architectures (causal capsules, tensor transformer, multilinear projection algorithm).
result Derives deep neural networks for causal inference with tensor factor analysis.
OLS is a special case of Transformer, revealing its linear nature.
problem Understanding the statistical essence of Transformer architecture.
method Algebraic proof and spectral decomposition of covariance matrix.
result Attention mechanism in Transformers is mathematically equivalent to OLS.
Understanding theoretical properties of deep and locally connected nonlinear network, such as deep convolutional neural network (DCNN), is still a hard problem despite its empirical success. In this paper, we propose a novel theoretical framework for such networks with ReLU nonlinearity. The framework explicitly formul…
New approaches improve adversarial robustness of DEQs.
problem Adversarial vulnerability of DEQs.
method Developed approaches to estimate intermediate gradients and integrate them into attacking pipelines.
result Demonstrated adversarial robustness of DEQs competitive with deep networks.
Study forecasts volatility and risk in electricity markets using matrix-HAR models.
problem Forecasting volatility and risk in electricity markets.
method Constructed a parsimonious matrix-HAR type model to estimate realized covariation and risk premia in electricity markets.
result Inclusion of longer time horizons and renewable generation information improves forecasts.
We reduce variance in Bures-Wasserstein variational inference.
problem High variance in Monte Carlo approximations of Bures-Wasserstein gradients.
method Control variates to reduce variance in the forward step.
result Proposed estimator reduces variance by orders of magnitude.
The intrinsic error tolerance of neural network (NN) makes approximate computing a promising technique to improve the energy efficiency of NN inference. Conventional approximate computing focuses on balancing the efficiency-accuracy trade-off for existing pre-trained networks, which can lead to suboptimal solutions. In…
Field theory explains optimal scaling in ResNets for signal propagation.
problem Understanding optimal scaling parameter for ResNet performance.
method Finite-size field theory for ResNets to study signal propagation and scaling.
result Analytical expressions for optimal scaling parameter, independent of other hyperparameters.
DeepGSB solves MFGs with non-differentiable preferences.
problem Solving MFGs with non-differentiable preferences and exact population convergence.
method Generalized Schrödinger Bridge via Forward-Backward SDEs and Temporal Difference learning.
result DeepGSB provides necessary and sufficient conditions for mean-field problems.
Gradient flossing stabilizes RNN training by controlling Lyapunov exponents.
problem Gradient instability in RNNs leading to exploding and vanishing gradients.
method Regularizing Lyapunov exponents through backpropagation using differentiable linear algebra.
result Gradient flossing improves RNN training success rate and convergence speed.
A DenseNet model classifies metastatic cancer in medical images.
problem Classifying metastatic cancer in medical images efficiently and accurately.
method Proposes a DenseNet-based model for metastatic cancer classification on medical images.
result The proposed model outperformed other classical methods like Resnet34, Vgg19.
Stochastic VB improves nonlinear model inference speed and accuracy.
problem Bayesian inference of nonlinear models from noisy data.
method Stochastic Variational Bayesian (VB) inference for nonlinear models.
result Stochastic VB achieves comparable parameter recovery to analytical solution but is faster.
ACI uses Bayesian data assimilation to trace causes from effects in complex systems.
problem Capturing instantaneous, time-evolving causal relationships in complex, high-dimensional systems.
method Assimilative causal inference (ACI) leverages Bayesian data assimilation to trace causes backward from observed effects.
result ACI provides online tracking of causal roles that may reverse intermittently and reveals how far effects propagate.
PETRA enables parallel training of deep models with reversible architectures.
problem Challenges in parallelizing deep model training.
method Introduces PETRA, a novel approach for parallelizing gradient computations in reversible architectures.
result Achieves competitive accuracies on CIFAR-10, ImageNet32, and ImageNet using ResNet models.
Generative model learns shape drift for quantifying domain uncertainty in hemodynamics.
problem Quantifying domain uncertainty in medical image segmentation for biomarker estimation.
method Conditional stochastic interpolant framework based on LDDMM registration.
result Generative model can create random perturbations of shapes for biomarker estimation.
Introduces bsuite for studying RL agent capabilities.
problem Investigate core capabilities of RL agents.
method Collects and automates evaluation of experiments.
result Facilitates reproducible research on RL.
Paper presents a deep learning framework for faster, more accurate nuclear reactor power prediction.
problem Inaccurate and inefficient modeling of nuclear reactor transients.
method Hybrid digital twin-focused multi-stage deep learning framework using feed-forward neural networks.
result Achieved remarkable accuracy (96% classification, 2.3% MAPE) with noise-enhanced simulated data.
The study explains how transformer components enable in-context learning.
problem Understanding how transformer components contribute to in-context learning.
method Analyzed a two-attention-layer transformer model trained on Markov chain data.
result Gradient flow converges to a limiting model with a copier, selector, and classifier mechanism.
Tensor Neural Networks improve regression accuracy and efficiency.
problem Nonparametric regression problems with complex, high-dimensional functions.
method Integrates statistical regression and numerical integration within a tensor neural network framework.
result Superior performance in approximation accuracy and generalization capacity compared to FFNs and RBNs.
Proposes a neural network for efficient deep hedging strategies.
problem Hard training of optimal hedging strategies due to action dependence.
method Introduces no-transaction band network, a neural architecture.
result Demonstrates faster and more precise hedging strategies.
New method for dynamic valuation in markets with random endowments.
problem Dynamic valuation in markets with random endowments.
method Developed new FBSDE systems and established optimality conditions.
result Established necessary and sufficient conditions for optimality.
This paper shows how forward rate interpolations are equivalent to discount factor interpolations in yield curve construction.
problem The challenge of choosing between different interpolation methods for yield curve construction.
method Demonstrates the equivalence between forward rate interpolations and discount factor interpolations.
result Some popular interpolation methods on forward rates are equivalent to classical interpolation methods on discount factors.
DYffusion improves diffusion models for spatiotemporal forecasting.
problem Challenges in generating stable and accurate forecasts for dynamic data.
method Leverages temporal dynamics in data, directly coupling it with diffusion steps.
result Improves computational efficiency and performs competitively on complex dynamics.
Paper explores volatility swaps in rough volatility models.
problem Understanding volatility swaps in rough volatility models.
method Examines the relationship between forward start volatility swaps and implied volatilities in rough volatility models.
result The leading term approximation error in the correlated case does not depend on the time to forward start date.
COREL learns latent representations that naturally cluster, outperforming CCE.
problem Training neural networks to learn useful latent representations.
method Attractive-Repulsive Loss Framework for Clustering-Oriented Representation Learning (COREL).
result COREL variants outperform CCE in various classification tasks.
Develops a new class of forward performance processes for investment pools.
problem Investment performance in market models with continuous semimartingale stock prices.
method Constructs a broad class of forward performance processes with power mixture initial conditions.
result Characterizes and derives properties of two-power mixture forward performance processes.
New FPI layers enable efficient backpropagation in deep networks.
problem Designing deep neural networks to handle complex constraints.
method Fixed-point iteration layers for forward and backward propagation.
result Backward FPI layer simplifies gradient calculation without explicit Jacobian.
Compact embedding for forward rate curves simplifies approximations.
problem Approximating complex forward rate curves efficiently.
method Proving compact embedding and showing finite approximations.
result Forward rate evolutions can be approximated by finite processes.
We prove here a general closed-form expansion formula for forward-start options and the forward implied volatility smile in a large class of models, including the Heston stochastic volatility and time-changed exponential Lévy models. This expansion applies to both small and large maturities and is based solely on the p…
We investigate the low-dimensional structure of deterministic transformations between random variables, i.e., transport maps between probability measures. In the context of statistics and machine learning, these transformations can be used to couple a tractable "reference" measure (e.g., a standard Gaussian) with a tar…
This paper studies robust forward investment and consumption preferences within a zero-volatility context. Different from previous works, we consider an incomplete financial market model due to general investment portfolio constraints. We provide a new PDE characterization and a novel semi-explicit saddle-point constru…
We describe a model for evolving commodity forward prices that incorporates three important dynamics which appear in many commodity markets: mean reversion in spot prices and the resulting Samuelson effect on volatility term structure, decorrelation of moves in different points on the forward curve, and implied volatil…
The paper develops stochastic models for mortality rates using infinite dimensional processes.
problem Uncertainty in demographic projections of future mortality rates.
method Forward mortality models driven by Wiener process and Poisson random measure.
result Consistency conditions for forward mortality improvements and mortality rates.
In a Markovian stochastic volatility model, we consider financial agents whose investment criteria are modelled by forward exponential performance processes. The problem of contingent claim indifference valuation is first addressed and a number of properties are proved and discussed. Special attention is given to the c…
Two new models for forward power prices capture clustering jumps.
problem Describing forward power prices with clustering jumps.
method Continuous branching processes with immigration and Hawkes processes with exponential kernel.
result Models adequately describe forward prices evolution in French power market.
The paper analyzes investment and consumption strategies under uncertain market conditions.
problem Investment and consumption under drift and volatility uncertainties.
method Randomization approach to construct robust preferences and strategies.
result Developed optimal and robust investment and consumption strategies remain valid in the physical market.
Advocates for Marr's levels of analysis to unify machine learning debates.
problem Challenges in aligning perspectives among machine learning researchers.
method Introduces Marr's levels of analysis from cognitive science and neuroscience.
result Marr's levels facilitate understanding and dissection of machine learning methods.
Proposes a model for long-term electricity contracts with explicit computation and easy calibration.
problem Non-storability and poor liquidity in long-term electricity markets.
method Multi-factor polynomial framework for explicit computation of forwards, risk premium, and correlation.
result Calibrated model provides a risk-minimizing hedge for various time horizons.