Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

4998146195 · Jun 202019922001200920172026
48 results for attention allocation

Study optimizes resource allocation in noisy systems for better control.

problem Limited attention in stochastic systems with multiplicative noise.
method Analytical and numerical methods for optimal attention allocation.
result Effective resource allocation enhances noise estimation and control decisions.

Paper proposes integrating wavelet transform, channel attention, and LSTM for better stock price prediction.

problem Inherently difficult stock price prediction due to low signal-to-noise ratio.
method Wavelet transform convolution, channel attention, and LSTM integration.
result Robust performance in post-pandemic market conditions.

Investigates optimal parameter allocation in Transformers for efficiency and expressivity.

problem Balancing expressivity and efficiency in Transformer model parameters.
method Mathematical analysis and theoretical characterization of attention heads and head dimensions.
result Later layers can operate more efficiently with reduced parameters due to saturation of softmax activations.

We study classification problems where features are corrupted by noise and where the magnitude of the noise in each feature is influenced by the resources allocated to its acquisition. This is the case, for example, when multiple sensors share a common resource (power, bandwidth, attention, etc.). We develop a method f…

2016-07-10abs ↗pdf ↗

The financial crisis showed the importance of measuring, allocating and regulating systemic risk. Recently, the systemic risk measures that can be decomposed into an aggregation function and a scalar measure of risk, received a lot of attention. In this framework, capital allocations are added after aggregation and can…

2016-07-12abs ↗pdf ↗

A Nash game theory approach allocates capital requirements among financial institutions.

problem Allocating systemic risk measures among financial institutions.
method Proposes a Nash allocation rule inspired by game theory.
result Provides sufficient conditions for the existence and uniqueness of Nash allocation rules.

Study on multi-head softmax attention dynamics for in-context learning.

problem Understanding and optimizing multi-head softmax attention models for multi-task linear regression.
method Gradient flow analysis and spectral mapping technique.
result Gradient flow converges to optimal multi-head softmax attention model, with task allocation emerging during training.

This work reviews and tests risk allocation strategies in finance, highlighting Shapley allocation's advantages.

problem Risk allocation in financial institutions with non-additive risk measures and layered structures.
method Systematic review of risk allocation strategies, testing in simplified and realistic settings, including Basel 2.5 and FRTB.
result Shapley allocation offers the best compromise between simplicity, mathematical properties, and computational cost.

FedCM measures contributions in real-time for federated learning.

problem Fairly allocating contributions in federated learning systems.
method FedCM calculates impact based on current and previous rounds with attention aggregation.
result FedCM is more sensitive to data quality and quantity in real-time.

IAL uses interactive learning to improve model performance with minimal human feedback.

problem Overfitting and high human interaction cost in training neural networks.
method IAL framework with NAP attention generator and reranking algorithm.
result IAL significantly outperforms baselines with less retraining and human interaction.

Self-attention models benefit equally from width and depth, but beyond a certain point, depth becomes less efficient.

problem Understanding the optimal balance between depth and width in self-attention models.
method Theoretical predictions and empirical ablations on networks of varying depths and widths.
result An optimal width of 30K is recommended for a 1-Trillion parameter network, marking a significant width for self-attention models.

FedACS uses attention to select clients with similar data for federated learning.

problem Non-IID data and data scarcity in federated learning.
method FedACS integrates an attention mechanism to prioritize clients with similar data distributions.
result FedACS improves federated learning performance by addressing non-IID data and data scarcity.

Study capacity constraints in continual learning with a simple model.

problem Understanding optimal resource allocation for agents with limited memory and compute resources.
method Analyzes a capacity-constrained linear-quadratic-Gaussian (LQG) sequential prediction problem and demonstrates optimal capacity allocation strategies.
result Derives a solution to the capacity-constrained LQG sequential prediction problem and shows how to optimally allocate capacity across sub-problems in the steady state.

Simulations of infectious disease spread have long been used to understand how epidemics evolve and how to effectively treat them. However, comparatively little attention has been paid to understanding the fairness implications of different treatment strategies -- that is, how might such strategies distribute the expec…

2019-11-01abs ↗pdf ↗

Efficient sparse attention reduces self-attention complexity and improves model performance.

problem Quadratic compute and memory requirements of self-attention for long sequences.
method Content-based sparse attention with dynamic routing module.
result Routing Transformer achieves state-of-the-art performance on various benchmarks.

This paper tackles resource allocation in the Lightning Network using DRL.

problem Complex combinatorial problem of node selection and resource allocation in the Lightning Network.
method Attention-based Deep Reinforcement Learning framework.
result Improved resource allocation leads to better performance and decentralization in the LN.

Investing in cryptocurrencies can improve portfolio risk-return profile, especially with diversification strategies.

problem Investing in cryptocurrencies and evaluating their potential for portfolio allocation strategies.
method Investigated different types of investors, various portfolio construction rules, and incorporated liquidity constraints.
result Cryptocurrencies can improve the risk-return profile of portfolios, especially with diversification strategies.

New theory shows how multi-head attention reduces variance and decorrelates outputs.

problem Understanding and optimizing multi-head attention in neural networks.
method Developed a statistical theory linking multi-head attention to ensemble Nadaraya-Watson estimators.
result MHA variance reduction depends on head decorrelation, not just head count.

It is well known that quantile regression model minimizes the portfolio extreme risk, whenever the attention is placed on the estimation of the response variable left quantiles. We show that, by considering the entire conditional distribution of the dependent variable, it is possible to optimize different risk and perf…

2015-07-01abs ↗pdf ↗

Study shows cognitive load impacts financial market efficiency, especially for less sophisticated investors.

problem Cognitive load's effect on financial market information processing.
method Developed a theoretical framework and tested it with exogenous disclosure complexity variation.
result Cognitive load significantly impairs price discovery, particularly for less sophisticated investors.

This study examines the execution phase of corporate share buy-backs, highlighting inefficiencies and costs.

problem Lack of research on share buy-back execution practices and associated costs.
method Comparative analysis of execution practices and fees charged to corporations and investors.
result Uncovered inefficiencies and frictional costs in share buy-back executions, advocating for transparency and fairness.

Estimates classification rules from partially classified data.

problem Estimating Bayes' rule for unclassified observations in partially classified data.
method Fitting a g-component mixture model by maximum likelihood (ML) via the EM algorithm.
result Asymptotic relative efficiency (ARE) of Bayes' rule estimated from partially classified samples.

The paper optimizes DIA purchase policies using lifecycle models and asset allocation.

problem Determining the optimal allocation to Deferred Income Annuities (DIAs).
method Employed a lifecycle model with utility of consumption and bequest, formalized optimization process, analyzed results, and extended model to include asset allocation.
result Optimal DIA allocation varies based on refundability, asset allocation, and perceived longevity.

The paper proposes an asset allocation strategy using the Sortino ratio for better performance.

problem Traditional asset allocation methods like the Sharpe ratio do not penalize negative returns adequately.
method The Sortino ratio is used to maximize asset allocation, penalizing only negative return variances.
result The Sortino ratio-based strategy outperforms traditional methods like the Kelly criterion.

Enhanced portfolio selection using sentiment data and LSTM.

problem Improving portfolio selection through sentiment analysis and price prediction.
method Semantic Attention Model for sentiment prediction, LSTM for price prediction, mean-variance strategy for portfolio optimization.
result Sentiment-aware portfolio strategies outperform non-sentiment aware models on average.

Framework allows systems to defer difficult decisions to unknown experts.

problem Ensuring safety and robustness in autonomous systems with unknown human experts.
method Meta-learning approach that adapts to new experts at test-time using optimization and model-based attention mechanisms.
result Framework can quickly adapt deferral policies to new experts without re-training.

This paper tackles post-trade allocation inefficiencies and presents a uniform return allocation method.

problem Return divergence among accounts after trade allocation.
method Systematic treatment of trade allocation risk, presenting a uniform return allocation method.
result Uniform allocation of returns irrespective of the number of accounts and trade sizes.

This paper examines allocation mechanisms in markets with transfer costs, showing how these costs affect economic efficiency.

problem Transfer costs in decentralized exchange markets reduce economic efficiency.
method An axiomatic study of allocation mechanisms in the presence of transfer costs, providing robust and conditional mean allocation mechanisms.
result Robust and conditional mean allocation mechanisms are identified, relating to risk sharing in agent pools.

The aims of this study are twofold. First, we consider an optimal risk allocation problem with non-convex preferences. By establishing an infimal representation for distortion risk measures, we give some necessary and sufficient conditions for the existence of optimal and asymptotic optimal allocations. We will show th…

2015-03-15abs ↗pdf ↗

New method allocates capital based on tail central moments for financial risk assessment.

problem Inability of CTE-based capital allocation to reflect tail behavior of losses.
method Developed TCM-based capital allocation for normal mean-variance mixture distributions.
result TCM-based method captures tail risk contributions not detected by CTE.

The paper explores capital allocation using Euler formula with VaR and ES, revealing non-monotonicity and providing estimation methods.

problem Non-monotonicity in VaR-based capital allocation and the need for consistent risk measures.
method Use of Euler formula, Value-at-Risk (VaR), Expected shortfall (ES), simulation, and Markov chain Monte Carlo.
result Capital allocation with VaR is not monotonous, and consistent risk measures are crucial.

Capital allocation principles are used in various contexts in which a risk capital or a cost of an aggregate position has to be allocated among its constituent parts. We study capital allocation principles in a performance measurement framework. We introduce the notation of suitability of allocations for performance me…

2013-01-23abs ↗pdf ↗

The paper analyzes insurance pricing and capital allocation in imperfect markets.

problem Analyzing insurance pricing and capital allocation in imperfect markets.
method Non-additive distortion pricing functional and principle of equal priority of payments in default.
result Derives the natural allocation of premium and margin with properties that merit the name.

We study the problem of allocating stocks to dark pools. We propose and analyze an optimal approach for allocations, if continuous-valued allocations are allowed. We also propose a modification for the case when only integer-valued allocations are possible. We extend the previous work on this problem to adversarial sce…

2010-03-11abs ↗pdf ↗

The European insurance sector will soon be faced with the application of Solvency 2 regulation norms. It will create a real change in risk management practices. The ORSA approach of the second pillar makes the capital allocation an important exercise for all insurers and specially for groups. Considering multi-branches…

2015-06-12abs ↗pdf ↗