Estimates model performance from compute budget for distillation.
problem Risk mitigation in large-scale distillation.
method Distillation scaling law based on compute budget allocation.
result Maximizes student performance with compute-optimal allocation.
Due to concerns about human error in crowdsourcing, it is standard practice to collect labels for the same data point from multiple internet workers. We here show that the resulting budget can be used more effectively with a flexible worker assignment strategy that asks fewer workers to analyze easy-to-label data and m…
Chinchilla Approach 2 biases neural scaling law estimates, leading to unnecessary compute costs.
problem Systematic biases in Chinchilla Approach 2's parabolic fits of neural scaling laws.
method Analyzes three sources of error: IsoFLOP sampling grid width, uncentered sampling, and loss surface asymmetry.
result Chinchilla Approach 3 largely eliminates these biases, offering a more convenient or scalable alternative.
In this paper we propose and analyze a method based on the Riccati transformation for solving the evolutionary Hamilton-Jacobi-Bellman equation arising from the stochastic dynamic optimal allocation problem. We show how the fully nonlinear Hamilton-Jacobi-Bellman equation can be transformed into a quasi-linear paraboli…
Optimal fees for CFMMs prevent liquidity pools from competing to the bottom.
problem Maximizing liquidity provider returns in CFMMs with multiple pools.
method Theoretical and numerical analysis of Nash equilibria for optimal fees.
result Pure Nash equilibria of optimal fees exist for CFMMs using Uniswap's trade function.
Review of modern computational optimal transport methods for biomedical applications.
problem Efficient computation of optimal transport for big data.
method Regularization-based and projection-based computational methods.
result Advancements in computational optimal transport methods for biomedical research.
Algorithm finds near-optimal VaR portfolios using MILP, improving risk management.
problem Computing optimal VaR portfolios is hard due to non-convexity and combinatorial nature.
method Formulates VaR portfolio problem as MILP, uses alternate formulations for guarantees.
result Near-optimal VaR portfolios with near-optimality guarantees.
New framework finds more efficient linear layers over structured matrices.
problem Efficient alternatives for dense linear layers in neural networks.
method Unified framework searching over all linear operators, developing a taxonomy based on computational and algebraic properties.
result BTT-MoE provides substantial compute-efficiency gains over dense layers and standard MoE.
Efficiently computes optimal transport maps and Wasserstein barycenters using conditional normalizing flows.
problem Computing optimal transport maps and Wasserstein barycenters in high-dimensional spaces.
method Uses conditional normalizing flows to approximate distributions and solve the primal problem.
result Shows computational feasibility for hundreds of input distributions and yields accurate results.
SignSGD outperforms SGD in linear regression with optimal scaling laws under PLRF model.
problem Improving linear regression performance with signSGD under power-law random features.
method Analysis of signSGD risk under PLRF model, comparison with SGD, identification of unique effects.
result SignSGD can have a steeper compute-optimal slope than SGD in noisy regimes, especially with WSD schedule.
Model predicts neural network performance scaling laws across various factors.
problem Understanding the performance of neural networks across different training factors.
method Random feature model trained with gradient descent, analyzing compute-optimal scaling laws.
result Predicts asymmetric compute-optimal scaling rule and behavior of training and test loss gap.
Paper develops fast method for computing optimal transport.
problem Efficient computation of optimal transport distance between distributions.
method Entropy-regularized extragradient method for first-order optimization.
result Achieves state-of-the-art runtime guarantees and good numerical performance.
End-to-end portfolio optimization using quantum annealing for financial decision problems.
problem Optimizing financial portfolios with quantum computing constraints.
method Hybrid pipeline combining quantum and classical optimization.
result Quantum-assisted portfolio optimization can achieve competitive returns.
Study optimizes compute usage for LLM web agents, improving performance.
problem High compute costs and narrow focus on single-step tasks limit LLM web agents.
method Two-stage pipeline: SFT followed by on-policy RL, with hyperparameter optimization.
result Combining SFT and on-policy RL requires 55% less compute to match peak SFT performance.
Domain Translation is the problem of finding a meaningful correspondence between two domains. Since in a majority of settings paired supervision is not available, much work focuses on Unsupervised Domain Translation (UDT) where data samples from each domain are unpaired. Following the seminal work of CycleGAN for UDT, …
New phases identified in neural scaling laws with compute limits.
problem Understanding neural scaling laws under compute constraints.
method Solved neural scaling model with stochastic gradient descent, derived loss curves, analyzed model-parameter-count phases.
result Identified 4 phases (+3 subphases) in data-complexity/target-complexity phase-plane, derived exponents.
Model shows loss curve with two distinct exponents due to sparse activations.
problem Sparse activations impact neural network scaling laws.
method Introduced a model for neural scaling laws under sparse activations, derived asymptotic population loss, and analyzed gradient-descent dynamics.
result Loss curve exhibits double-descent peak near interpolation threshold with two distinct scaling exponents.
In this paper we apply evolutionary optimization techniques to compute optimal rule-based trading strategies based on financial sentiment data. The sentiment data was extracted from the social media service StockTwits to accommodate the level of bullishness or bearishness of the online trading community towards certain…
We propose a microstructural modeling framework for studying optimal market making policies in a FIFO (first in first out) limit order book (LOB). In this context, the limit orders, market orders, and cancel orders arrivals in the LOB are modeled as Cox point processes with intensities that only depend on the state of …
In this paper we consider the basic version of Reinforcement Learning (RL) that involves computing optimal data driven (adaptive) policies for Markovian decision process with unknown transition probabilities. We provide a brief survey of the state of the art of the area and we compare the performance of the classic UCB…
The paper optimizes DIA purchase policies using lifecycle models and asset allocation.
problem Determining the optimal allocation to Deferred Income Annuities (DIAs).
method Employed a lifecycle model with utility of consumption and bequest, formalized optimization process, analyzed results, and extended model to include asset allocation.
result Optimal DIA allocation varies based on refundability, asset allocation, and perceived longevity.
Study optimizes resource allocation in noisy systems for better control.
problem Limited attention in stochastic systems with multiplicative noise.
method Analytical and numerical methods for optimal attention allocation.
result Effective resource allocation enhances noise estimation and control decisions.
The paper proposes an asset allocation strategy using the Sortino ratio for better performance.
problem Traditional asset allocation methods like the Sharpe ratio do not penalize negative returns adequately.
method The Sortino ratio is used to maximize asset allocation, penalizing only negative return variances.
result The Sortino ratio-based strategy outperforms traditional methods like the Kelly criterion.
We propose a method to compute optimal control paths for autonomous vehicles deployed for the purpose of inferring a velocity field. In addition to being advected by the flow, the vehicles are able to effect a fixed relative speed with arbitrary control over direction. It is this direction that is used as the basis for…
This paper tackles post-trade allocation inefficiencies and presents a uniform return allocation method.
problem Return divergence among accounts after trade allocation.
method Systematic treatment of trade allocation risk, presenting a uniform return allocation method.
result Uniform allocation of returns irrespective of the number of accounts and trade sizes.
This paper examines allocation mechanisms in markets with transfer costs, showing how these costs affect economic efficiency.
problem Transfer costs in decentralized exchange markets reduce economic efficiency.
method An axiomatic study of allocation mechanisms in the presence of transfer costs, providing robust and conditional mean allocation mechanisms.
result Robust and conditional mean allocation mechanisms are identified, relating to risk sharing in agent pools.
Paper introduces a new method for allocating capital based on risk measures from ruin theory.
problem Allocating capital to manage risk measures derived from ruin theory.
method Introduces a novel allocation method for dynamic value-at-risk (VaR) measures.
result Demonstrates desirable properties and compares with existing methods.
The aims of this study are twofold. First, we consider an optimal risk allocation problem with non-convex preferences. By establishing an infimal representation for distortion risk measures, we give some necessary and sufficient conditions for the existence of optimal and asymptotic optimal allocations. We will show th…
Framework uses hindsight regret to audit marketing budget allocations.
problem Lack of principled way to assess strategic budget allocations.
method Hindsight regret framework based on constraint-faithful benchmark.
result Identifies practical trade-off between allocation flexibility and detectability.
New method allocates capital based on tail central moments for financial risk assessment.
problem Inability of CTE-based capital allocation to reflect tail behavior of losses.
method Developed TCM-based capital allocation for normal mean-variance mixture distributions.
result TCM-based method captures tail risk contributions not detected by CTE.
The paper explores capital allocation using Euler formula with VaR and ES, revealing non-monotonicity and providing estimation methods.
problem Non-monotonicity in VaR-based capital allocation and the need for consistent risk measures.
method Use of Euler formula, Value-at-Risk (VaR), Expected shortfall (ES), simulation, and Markov chain Monte Carlo.
result Capital allocation with VaR is not monotonous, and consistent risk measures are crucial.
Capital allocation principles are used in various contexts in which a risk capital or a cost of an aggregate position has to be allocated among its constituent parts. We study capital allocation principles in a performance measurement framework. We introduce the notation of suitability of allocations for performance me…
The financial crisis showed the importance of measuring, allocating and regulating systemic risk. Recently, the systemic risk measures that can be decomposed into an aggregation function and a scalar measure of risk, received a lot of attention. In this framework, capital allocations are added after aggregation and can…
The paper analyzes insurance pricing and capital allocation in imperfect markets.
problem Analyzing insurance pricing and capital allocation in imperfect markets.
method Non-additive distortion pricing functional and principle of equal priority of payments in default.
result Derives the natural allocation of premium and margin with properties that merit the name.
Optimal resource allocation in censored semi-bandits with unknown thresholds.
problem Sequential resource allocation with unknown thresholds and hidden parameters.
method Established equivalence to MP-MAB and Combinatorial Semi-Bandits, derived optimal algorithms.
result Validated performance of proposed algorithms on synthetic data.
New risk-sharing rules induced by capital allocation principles.
problem Risk sharing in corporate structures.
method Randomizing existing capital allocation principles.
result Derives new risk-sharing rules complementing existing literature.
We study the problem of allocating stocks to dark pools. We propose and analyze an optimal approach for allocations, if continuous-valued allocations are allowed. We also propose a modification for the case when only integer-valued allocations are possible. We extend the previous work on this problem to adversarial sce…
The European insurance sector will soon be faced with the application of Solvency 2 regulation norms. It will create a real change in risk management practices. The ORSA approach of the second pillar makes the capital allocation an important exercise for all insurers and specially for groups. Considering multi-branches…
In this paper we develop a novel methodology for estimation of risk capital allocation. The methodology is rooted in the theory of risk measures. We work within a general, but tractable class of law-invariant coherent risk measures, with a particular focus on expected shortfall. We introduce the concept of fair capital…
This work reviews and tests risk allocation strategies in finance, highlighting Shapley allocation's advantages.
problem Risk allocation in financial institutions with non-additive risk measures and layered structures.
method Systematic review of risk allocation strategies, testing in simplified and realistic settings, including Basel 2.5 and FRTB.
result Shapley allocation offers the best compromise between simplicity, mathematical properties, and computational cost.
Enhances topic models to better handle polysemous words.
problem Lack of polysemy handling in Gaussian latent Dirichlet allocation.
method Introduces a hierarchical structure to capture polysemy in Gaussian latent Dirichlet allocation.
result Significantly improves polysemy detection and provides more parsimonious topic representations.
Optimal resource allocation is a fundamental challenge for dense and heterogeneous wireless networks with massive wireless connections. Because of the non-convex nature of the optimization problem, it is computationally demanding to obtain the optimal resource allocation. Recently, deep reinforcement learning (DRL) has…
Study resource allocation strategies in sequential decisions with unknown rewards.
problem Sequential resource allocation with unknown rewards.
method Design combinatorial multi-armed bandit algorithms for discrete or continuous budgets.
result Prove algorithms achieve logarithmic cumulative regret under semi-bandit feedback.
Facing the FRTB, banks need to allocate their capital to each business units or risk positions to evaluate the capital efficiency of their strategies. This paper proposes two computationally efficient allocation methods which are weighted according to liquidity horizon. Both methods provide more stable and less negativ…
A Nash game theory approach allocates capital requirements among financial institutions.
problem Allocating systemic risk measures among financial institutions.
method Proposes a Nash allocation rule inspired by game theory.
result Provides sufficient conditions for the existence and uniqueness of Nash allocation rules.
The paper evaluates index-based allocation policies using data from randomized control trials.
problem Evaluating index-based allocation policies in resource-scarce scenarios.
method Using data from randomized control trials, the paper introduces an efficient estimator and methods for computing asymptotically correct confidence intervals.
result Valid statistical conclusions can be drawn for index-based allocation policies.
Develops a framework to analyze financial structures.
problem Difficulty in systematic analysis, comparison, and verification of financial structures.
method Formalizes financial structures as structured allocation systems with explicit allocation operators.
result Specifies inputs, structural requirements, and feasibility restrictions for financial structures.
Paper uses Simulated Bifurcation for quick asset allocation optimization.
problem Optimal asset allocation selection.
method Simulated Bifurcation algorithms applied to 441 S&P500 assets.
result Unrivaled timescale for optimal sub-allocation selection.