Policy gradient methods with aggregated states can achieve better performance than approximate policy iteration.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
In this paper we discuss policy iteration methods for approximate solution of a finite-state discounted Markov decision problem, with a focus on feature-based aggregation methods and their connection with deep reinforcement learning schemes. We introduce features of the states of the original problem, and we formulate …
We introduce a new family of minmax rank aggregation problems under two distance measures, the Kendall τ and the Spearman footrule. As the problems are NP-hard, we proceed to describe a number of constant-approximation algorithms for solving them. We conclude with illustrative applications of the aggregation methods on…
Recently, it has been shown that many functions on sets can be represented by sum decompositions. These decompositons easily lend themselves to neural approximations, extending the applicability of neural nets to set-valued inputs---Deep Set learning. This work investigates a core component of Deep Set architecture: ag…
New method aggregates Gaussian experts by detecting conditional independence violations.
We provide an explicit aggregation in the neoclassical growth model with aggregate shocks and uninsurable employment risk. We show there are two restrictions on the unemployment shock for approximate aggregation to occur. First the probability of unemployment must be positive for each agent in each time period. That en…
We propose a clustering-based iterative algorithm to solve certain optimization problems in machine learning, where we start the algorithm by aggregating the original data, solving the problem on aggregated data, and then in subsequent steps gradually disaggregate the aggregated data. We apply the algorithm to common m…
Paper analyzes sparse aggregation in GLMs with Kullback-Leibler risk bounds.
We prove a lower bound for feature dimension in linear MDPs and propose a novel dynamics aggregation framework.
The ability to adequately model risks is crucial for insurance companies. The method of "Copula-based hierarchical risk aggregation" by Arbenz et al. offers a flexible way in doing so and has attracted much attention recently. We briefly introduce the aggregation tree model as well as the sampling algorithm proposed by…
Efficiently private clustering algorithms with tight approximation ratios.
New LCM aggregator improves GNN performance and efficiency.
Paper tackles learning win-win solutions in aggregation systems.
The paper introduces a tensor-based approach to improve neural models' aggregation of structural context.
MEVA aggregates model predictions to improve accuracy without needing model details.
We establish that an optimistic variant of Q-learning applied to a fixed-horizon episodic Markov decision process with an aggregated state representation incurs regret , where is the horizon, is the number of aggregate states, is the number of episodes, and is …
While a typical supervised learning framework assumes that the inputs and the outputs are measured at the same levels of granularity, many applications, including global mapping of disease, only have access to outputs at a much coarser level than that of the inputs. Aggregation of outputs makes generalization to new in…
State aggregation is a popular model reduction method rooted in optimal control. It reduces the complexity of engineering systems by mapping the system's states into a small number of meta-states. The choice of aggregation map often depends on the data analysts' knowledge and is largely ad hoc. In this paper, we propos…
Active learning method reduces labeling cost for regression models with aggregated data.
Estimation of the operational risk capital under the Loss Distribution Approach requires evaluation of aggregate (compound) loss distributions which is one of the classic problems in risk theory. Closed-form solutions are not available for the distributions typically used in operational risk. However with modern comput…
Study shows safely discarding features based on aggregate SHAP values is sound.
As a non-parametric Bayesian model which produces informative predictive distribution, Gaussian process (GP) has been widely used in various fields, like regression, classification and optimization. The cubic complexity of standard GP however leads to poor scalability, which poses challenges in the era of big data. Hen…
This paper compares rank aggregation methods for partial label ranking.
Optimal Transport Graph Neural Networks (OT-GNN) improves graph embeddings by using optimal transport.
Robust algorithm for distributed optimization resistant to Byzantine failures.
Basel II and Solvency 2 both use the Value-at-Risk (VaR) as the risk measure to compute the Capital Requirements. In practice, to calibrate the VaR, a normal approximation is often chosen for the unknown distribution of the yearly log returns of financial assets. This is usually justified by the use of the Central Limi…
This paper optimizes retraining models using their own predictions and noisy labels.
The problem of explaining deep learning models, and model predictions generally, has attracted intensive interest recently. Many successful approaches forgo global approximations in order to provide more faithful local interpretations of the model's behavior. LIME develops multiple interpretable models, each approximat…
A method to select important experts for Gaussian processes to balance computational efficiency and uncertainty quantification.
This paper optimizes MDP policies for efficient state aggregation.
Optimal risk sharing without convex preferences using aggregate convexity.
Stochastic simulation techniques employed for the analysis of portfolios of insurance/reinsurance risk, often referred to as `Aggregate Risk Analysis', can benefit from exploiting state-of-the-art high-performance computing platforms. In this paper, parallel methods to speed-up aggregate risk analysis for supporting re…
This paper develops a low-nonnegative-rank approximation method to identify the state aggregation structure of a finite-state Markov chain under an assumption that the state space can be mapped into a handful of meta-states. The number of meta-states is characterized by the nonnegative rank of the Markov transition mat…
For a GJR-GARCH specification with a generic innovation distribution we derive analytic expressions for the first four conditional moments of the forward and aggregated returns and variances. Moment for the most commonly used GARCH models are stated as special cases. We also the limits of these moments as the time hori…
This paper presents a way of solving Markov Decision Processes that combines state abstraction and temporal abstraction. Specifically, we combine state aggregation with the options framework and demonstrate that they work well together and indeed it is only after one combines the two that the full benefit of each is re…
Improved local explainer aggregation for interpretable machine learning models.
Paper studies Transformer learning theory for Euclidean and Riemannian domains.
Develops a method to efficiently compute Wasserstein barycenters with variational distributions.
One-round FL method improves robustness and reduces communication rounds.
Unified view of GNNs as graph signal denoising.
This work improves multi-modal generative models by using permutation-invariant neural networks.
New method ranks sectors and countries using local and aggregate I-O data.
Short-term load forecasting (STLF) is essential for the reliable and economic operation of power systems. Though many STLF methods were proposed over the past decades, most of them focused on loads at high aggregation levels only. Thus, low-aggregation load forecast still requires further research and development. Comp…
A key factor in developing high performing machine learning models is the availability of sufficiently large datasets. This work is motivated by applications arising in Software as a Service (SaaS) companies where there exist numerous similar yet disjoint datasets from multiple client companies. To overcome the challen…
Introduces a new price measure and a second-order economic theory for volatility forecasting.
The paper studies the convergence of SAA for systemic risk measures.
This work analyzes aggregation strategies for Bayesian deep learning models in federated learning.
Robust VB framework handles contamination using min-max median aggregation.