Bayesian optimisation for dynamically adjusting learning rates in machine learning models.
problem Dynamic adjustment of learning rates schedules in machine learning models.
method Probabilistic model based on latent Gaussian processes and auto-/regressive formulation.
result Flexibly adjusts learning rates schedules to abrupt changes of behaviours.
Develops a method to approximate convexity adjustments for interest rate products.
problem Finding accurate convexity adjustments for interest rate products.
method Uses Malliavin calculus to develop an approximation method.
result Excellent numerical accuracy of the formulas for various interest rate products.
The paper introduces mortgage-rate-adjusted home prices to help buyers and adjust housing indices.
problem Impact of mortgage rates on home prices and property purchase decisions.
method Derives mortgage-rate-adjusted 'effective price' and constructs a price-mortgage rate neutrality line.
result Mortgage rates significantly affect home prices over long periods but not during the pandemic.
Stochastic Gradient Descent (SGD) methods are prominent for training machine learning and deep learning models. The performance of these techniques depends on their hyperparameter tuning over time and varies for different models and problems. Manual adjustment of hyperparameters is very costly and time-consuming, and e…
Defines a new short rate model and convexity adjustment formulae.
problem Interest rate convexity in a Gaussian framework.
method Defines a short rate model driven by a Gaussian Volterra process and derives convexity adjustment formulae.
result Explicit formulae for convexity adjustment derived.
AdamZ optimiser improves neural network training efficiency.
problem Challenges in optimisation like overshooting and stagnation.
method Dynamic learning rate adjustment based on overshoot and stagnation factors.
result Consistently minimises loss function, improving model performance.
The paper proposes a principle for dynamically adjusting the granularity of reinforcement learning abstractions.
problem Lack of general principles for dynamically adjusting the granularity of reinforcement learning abstractions.
method The paper proposes a principle based on rate-distortion theory, formalized through a performance certificate decomposing value error into learning and abstraction error bounds.
result Soft state-action abstractions can achieve near-optimal performance under substantial lossy compression of state and action information.
LNUCB-TA improves MAB performance by dynamically adjusting exploration rates and recognizing spatiotemporal patterns.
problem Suboptimal performance in environments with rapidly changing reward structures and static exploration rates.
method Hybrid model combining linear and nonlinear estimation, with adaptive k-NN for temporal attention.
result Significantly outperforms state-of-the-art algorithms in cumulative and mean reward, convergence, and robustness.
The study uses pre-trained neural networks to adjust for confounding in non-tabular data.
problem Neglecting non-tabular data sources can lead to biased ATE estimates.
method Leverages latent features from pre-trained neural networks to adjust for confounding.
result Neural networks can achieve fast convergence rates for ATE estimation with latent features.
In this paper we discuss the issue of computation of the bilateral credit valuation adjustment (CVA) under rating triggers, and in presence of ratings-linked margin agreements. Specifically, we consider collateralized OTC contracts, that are subject to rating triggers, between two parties -- an investor and a counterpa…
SALR improves deep learning generalization by dynamically adjusting learning rates.
problem Improving generalization in deep learning models.
method Sharpness-aware learning rate scheduling based on local loss function sharpness.
result SALR drives solutions to flatter regions, improving generalization and convergence.
The performance of stochastic gradient descent (SGD) depends critically on how learning rates are tuned and decreased over time. We propose a method to automatically adjust multiple learning rates so as to minimize the expected error at any one time. The method relies on local gradient variations across samples. In our…
Stochastic Gradient TreeBoost is often found in many winning solutions in public data science challenges. Unfortunately, the best performance requires extensive parameter tuning and can be prone to overfitting. We propose PaloBoost, a Stochastic Gradient TreeBoost model that uses novel regularization techniques to guar…
AutoSGD automatically adjusts learning rates for SGD.
problem Inefficient manual learning rate selection for SGD.
method AutoSGD automatically adjusts learning rates based on iteration.
result Empirical results show strong performance across various optimization tasks.
The study highlights the importance of Wrong-Way Risk in FVA calculations during financial market turmoil.
problem The relevance of Wrong-Way Risk in Funding Valuation Adjustments (FVA) during financial market uncertainty.
method The study examines the impact of various modelling choices, including default times and stochastic/deterministic funding spreads, on FVA calculations.
result WWR effects are non-negligible in FVA modelling from a risk-management perspective.
Bayesian method improves clinical trial efficiency.
problem Increase treatment effect estimates in clinical trials.
method Combines prognostic covariate adjustment with a Bayesian framework.
result Substantial increase in statistical power with controlled type I error.
CARD detects treatment responders with machine learning and adjustment.
problem Identifying responders in non-random treatment settings.
method Conformal prediction, machine learning, propensity score adjustment.
result High power responder detection in various scenarios.
Rate-In dynamically adjusts dropout rates during inference to improve uncertainty estimation in neural networks.
problem Static dropout rates lead to suboptimal uncertainty estimates in neural networks.
method Rate-In dynamically adjusts dropout rates using information-theoretic principles.
result Rate-In improves calibration and sharpens uncertainty estimates compared to fixed or heuristic dropout rates.
The credit crisis and the ongoing European sovereign debt crisis have highlighted the native form of credit risk, namely the counterparty risk. The related Credit Valuation Adjustment, (CVA), Debt Valuation Adjustment (DVA), Liquidity Valuation Adjustment (LVA) and Replacement Cost (RC) issues, jointly referred to in t…
The paper models rating transitions and calibrates them to market data for XVA calculations.
problem Calibrating rating models to both historical and market data for accurate XVA calculations.
method Modeling rating transitions as a Markov chain, calibrating to historical and market data, proposing a novel calibration procedure.
result Improved XVA scheme through better calibration of rating models.
AutoGD automatically adjusts learning rates for gradient descent.
problem Optimizing learning rates for gradient descent methods.
method AutoGD automatically adjusts learning rates based on iteration.
result AutoGD can recover the optimal rate of GD for a broad class of functions.
With an increasing demand for training powers for deep learning algorithms and the rapid growth of computation resources in data centers, it is desirable to dynamically schedule different distributed deep learning tasks to maximize resource utilization and reduce cost. In this process, different tasks may receive varyi…
New methods reduce private federated learning communication automatically.
problem Reducing communication in private federated learning.
method Automatic compression rate adjustment based on training error, using secure aggregation and differential privacy.
result Provable instance-optimal for mean estimation, achieving favorable compression rates.
GALA adapts learning rates online by aligning gradients, improving deep learning model performance.
problem Fine-tuning learning rates for deep learning models requires extensive grid search.
method GALA dynamically adjusts learning rates by tracking gradient alignment and local curvature.
result GALA produces a flexible, adaptive learning rate schedule that increases when gradients align.
A model explains why 4% is a safe retirement withdrawal rate.
problem Determining a safe withdrawal rate for American retirees.
method Discrete-time model of stochastic returns on assets and their moments.
result The 4% rule emerges from adjusting high expected rates of return for various risks.
For those concerned with the long-term value of their accounts, it can be a challenge to plan in the present for inflation-adjusted economic growth over coming decades. Here, I argue that there exists an economic constant that carries through time, and that this can help us to anticipate the more distant future: global…
Learning models of artificial intelligence can nowadays perform very well on a large variety of tasks. However, in practice different task environments are best handled by different learning models, rather than a single, universal, approach. Most non-trivial models thus require the adjustment of several to many learnin…
Simpler, parameter-free AdaGrad and Adam variants with convergence guarantees.
problem Inefficiencies in ad-hoc learning rate tuning for optimization algorithms.
method Developed AdaGrad++ and Adam++ without predefined learning rates and proved their convergence.
result AdaGrad++ and Adam++ achieve comparable convergence rates to AdaGrad and Adam respectively.
The purpose of this paper is introducing rigorous methods and formulas for bilateral counterparty risk credit valuation adjustments (CVA's) on interest-rate portfolios. In doing so, we summarize the general arbitrage-free valuation framework for counterparty risk adjustments in presence of bilateral default risk, as de…
This paper provides intuition on the relationship of accrual and mark-to-market valuation for cash and forward interest rate trades. Discounted cashflow valuation is compared to spread-based valuation for forward trades, which explains the trader's view on valuation. This is followed by Taylor series approximation for …
New model corrects bias in crowdsourced ratings for diverse items.
problem Bias and noise in crowdsourced ratings for training data.
method Bayesian rating model with item-level effects for difficulty, discriminativeness, and guessability.
result New model avoids bias in training data, improving model goodness of fit.
A new method automatically and dynamically sets learning rates in deep learning.
problem Determining the appropriate learning rate in deep learning tasks is challenging and often subjective.
method Local Quadratic Approximation (LQA) to automatically and dynamically set learning rates.
result The proposed method leads to nearly optimal learning rates in a computationally efficient way.
CCVA adjusts for climate change impacts on financial valuation.
problem Climate change impacts on financial valuation are currently ignored.
method Flexible parameterization to capture climate impacts on hazard rates.
result Significant impacts on interest rate swaps even with slow climate change.
Stochastic Gradient Descent with a constant learning rate (constant SGD) simulates a Markov chain with a stationary distribution. With this perspective, we derive several new results. (1) We show that constant SGD can be used as an approximate Bayesian posterior inference algorithm. Specifically, we show how to adjust …
Unintended effects from scaling neural network outputs with adaptive learning rates.
problem Adaptive learning rate optimization's behavior is altered by output scaling, leading to misinterpretation.
method Presented a modified optimization algorithm to mitigate unintended effects.
result Adaptive learning rate's effectiveness is significantly impacted by output scaling, especially for small scaling factors.
Paper proposes a method to estimate variance reduction in DNN training using importance sampling.
problem Challenges in assessing variance reduction during DNN training using importance sampling.
method Proposes a method for estimating variance reduction using minibatches sampled under importance sampling.
result Demonstrates consistent reduction in variance, improved training efficiency, and enhanced model accuracy.
The paper uses machine learning and Lie groups to improve rating transitions and XVA calculations.
problem Improving rating transitions and XVA calculations using machine learning and Lie groups.
method Modeling rating transitions as SDEs on Lie groups, calibrating to historical and market data, applying Girsanov theorem, and using Deep Learning.
result Improves rating transitions and XVA calculations, making the model more robust.
Develops methods to measure and set function-space learning rates in neural networks.
problem Measuring and optimizing changes in neural network output functions.
method Efficient methods to measure and set function-space learning rates, requiring minimal computational overhead.
result Demonstrates FLeRM (Function-space Learning Rate Matching) for hyperparameter transfer across model scales.
VAV method optimizes learning rate for faster, stable SGD convergence.
problem Optimizing learning rate for efficient and stable machine learning models.
method Energy-based self-adaptive learning rate with auxiliary variable r. result VAV method achieves faster convergence and superior stability with larger learning rates.
We study the Hull-White model for the term structure of interest rates in the presence of volatility uncertainty. The uncertainty about the volatility is represented by a set of beliefs, which naturally leads to a sublinear expectation and a G-Brownian motion. The main question in this setting is how to find an arbitra…
In this article, we consider a Markov-modulated model with jumps for short rate dynamics. We obtain closed formulas for the term structure and forward rates using the properties of the jump-telegraph process and the expectation hypothesis. The results are compared with the numerical solution of the corresponding partia…
Develops a method to estimate average hazard under non-proportional hazards without relying on proportional hazards assumption.
problem Estimation of treatment effects when hazards are non-proportional, leading to unstable hazard ratios.
method Semiparametric, doubly robust framework for covariate-adjusted average hazard estimation.
result Valid sqrt{n} inference with small bias and near-nominal confidence-interval coverage across proportional and non-proportional hazards settings.
An uncollateralized swap hedged back-to-back by a CCP swap is used to introduce FVA. The open IR01 of FVA, however, is a sure sign of risk not being fully hedged, a theoretical no-arbitrage pricing concern, and a bait to lure market risk capital, a practical business concern. By dynamically trading the CCP swap, with t…
The paper explores how control variates can reduce variance in Monte Carlo simulations, especially for Sobolev functions.
problem Efficiency of control variates in reducing variance for Monte Carlo simulations.
method Study of a specific quadrature rule using nonparametric regression-adjusted control variates.
result A specific quadrature rule can improve the Monte Carlo rate and achieve the minimax optimal rate under sufficient smoothness assumptions.
We consider the class of affine LIBOR models with multiple curves, which is an analytically tractable class of discrete tenor models that easily accommodates positive or negative interest rates and positive spreads. By introducing an interpolating function, we extend the affine LIBOR models to a continuous tenor and de…
This paper generalizes the framework for arbitrage-free valuation of bilateral counterparty risk to the case where collateral is included, with possible re-hypotecation. We analyze how the payout of claims is modified when collateral margining is included in agreement with current ISDA documentation. We then specialize…
Elastic Cash adjusts money supply to stabilize interest rates.
problem Stabilizing interest rates in a decentralized system.
method Modifies supply to keep interest rate fixed by public market.
result Improves elasticity of US Dollar and new cryptocurrencies.
AdaLoss optimizes adaptive learning rates for efficient convergence in various models.
problem Efficiently optimizing adaptive learning rates for gradient descent methods.
method AdaLoss uses loss function information to dynamically adjust step sizes.
result AdaLoss achieves linear convergence in linear regression and robust global convergence in neural networks.