Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,878 papers · 148 categories

Trend · papers per month

295988117 · Jun 202019922001200920172026
48 results for hierarchical decision-making

We study how to effectively leverage expert feedback to learn sequential decision-making policies. We focus on problems with sparse rewards and long time horizons, which typically pose significant challenges in reinforcement learning. We propose an algorithmic framework, called hierarchical guidance, that leverages the…

2018-03-01abs ↗pdf ↗

Framework improves resilience in operations through joint long-term and short-term decision-making.

problem Resilient operations in global markets require adaptive decision rules.
method Developed a two-timescale hierarchical reinforcement learning framework.
result Framework increases mean profit by 9.2% under joint demand-supply shocks and 11.8% under prolonged shocks.

A framework uses POMDPs to assess hierarchical clustering quality.

problem No agreed methodology for evaluating hierarchical clustering without ground-truth labels.
method Modelled as a POMDP, assessing search support for hierarchical structures.
result Proposes a novel measure for assessing hierarchical clustering quality.

A principle for specialized decision-making divides complex problems into manageable parts.

problem Complex decision-making problems beyond individual capabilities.
method An on-line learning rule that learns a partitioning of the problem space for specialized linear policies.
result The approach solves problems that exceed individual decision-makers' capabilities.

Hierarchical reinforcement learning is a promising approach to tackle long-horizon decision-making problems with sparse rewards. Unfortunately, most methods still decouple the lower-level skill acquisition process and the training of a higher level that controls the skills in a new task. Leaving the skills fixed can le…

2019-06-13abs ↗pdf ↗

Decision making is a process that is extremely prone to different biases. In this paper we consider learning fair representations that aim at removing nuisance (sensitive) information from the decision process. For this purpose, we propose to use deep generative modeling and adapt a hierarchical Variational Auto-Encode…

2018-06-26abs ↗pdf ↗

Study compares local and global models for hierarchical forecasting accuracy.

problem Challenges in hierarchical time series forecasting, especially in accuracy and information utilisation.
method Developed and evaluated local and global forecasting models (GFMs) to exploit cross-series and cross-hierarchies information.
result Global Forecasting Models (GFMs) outperform local models in hierarchical forecasting accuracy and computational efficiency.

Paper proposes a new method for predicting DER adoption with hierarchical guarantees.

problem Accurately predicting DER adoption in electric grids with uncertainty and spatial disparity.
method Multivariate Hawkes process for modeling DER adoption dynamics and split conformal prediction algorithm for hierarchical validity.
result Empirical evaluation shows superior predictive accuracy and uncertainty calibration compared to existing methods.

Hybrid Bayesian-conformal framework improves uncertainty quantification in healthcare predictions.

problem Jointly satisfying distribution-free coverage guarantees and risk-adaptive precision in clinical decision-making.
method Integrates Bayesian hierarchical random forests with group-aware conformal calibration, using posterior uncertainties to weight conformity scores.
result Achieves target coverage (94.3% vs 95% target) with adaptive precision, 21% narrower intervals for low-uncertainty cases.

Develops a framework for decision-making abstractions under computational limitations.

problem Decision-making by agents with limited computational resources.
method Information-theoretic signal compression and optimization problem formulation.
result Generates a hierarchy of abstractions for a non-trivial environment.

Representation learning is a central challenge across a range of machine learning areas. In reinforcement learning, effective and functional representations have the potential to tremendously accelerate learning progress and solve more challenging problems. Most prior work on representation learning has focused on gene…

2018-11-19abs ↗pdf ↗

A method for fast, accurate cross-temporal forecasts using machine learning.

problem Inconsistent forecasts across different levels of platform data.
method Non-linear hierarchical forecast reconciliation using machine learning.
result Automated direct production of reconciled forecasts for high-frequency decision making.

A new hierarchical forecasting method using machine learning improves forecast accuracy.

problem Improving forecast accuracy in hierarchical forecasting systems.
method Non-linear combination of base forecasts, focusing on both accuracy and coherence.
result The proposed method outperforms existing approaches, especially for diverse series.

INVERT connects neural representations to human-understandable concepts.

problem Lack of understanding and statistical significance in existing explainability methods.
method Inverse Recognition (INVERT) approach that connects learned representations to human-understandable concepts.
result INVERT provides interpretable metrics and statistical significance for representation alignment.

New model for fair clustering ensures balanced representation of protected attributes.

problem Ensuring fair representation in clustering for protected attributes.
method Model-based formulation of fair clustering, balancing protected attributes across clusters.
result Demonstrates improved fairness in clustering through a new model.

Novel framework identifies pump-specific deterioration rates using Bayesian hierarchical hazard modeling and causal discovery.

problem Challenges in asset management due to heterogeneous deterioration rates in pump equipment.
method Bayesian hierarchical hazard modeling with causal discovery, GPU-accelerated No-U-Turn Sampling (NUTS), and DirectLiNGAM.
result Identified striking heterogeneity in deterioration rates, with negative effects 400 times larger than positive effects.

Two methods estimate effect size for online experiments, improving accuracy and efficiency.

problem Determining the correct effect size for online experiment duration.
method Two approaches: hierarchical models and utility theory.
result Proposed methods outperform baseline approaches in accuracy and efficiency.

Affinity propagation is an exemplar-based clustering algorithm that finds a set of data-points that best exemplify the data, and associates each datapoint with one exemplar. We extend affinity propagation in a principled way to solve the hierarchical clustering problem, which arises in a variety of domains including bi…

2012-02-14abs ↗pdf ↗

The paper offers a method to create prediction sets with uncertainty control.

problem Calibrating and communicating uncertainty in machine learning predictions.
method Distribution-free, risk-controlling prediction sets using a holdout set to calibrate set sizes.
result Explicit finite-sample guarantees for error control in various machine learning tasks.

To be successful in real-world tasks, Reinforcement Learning (RL) needs to exploit the compositional, relational, and hierarchical structure of the world, and learn to transfer it to the task at hand. Recent advances in representation learning for language make it possible to build models that acquire world knowledge f…

2019-06-10abs ↗pdf ↗

A novel method predicts shape development using Riemannian shape spaces.

problem Predicting future shape development from a single observation.
method Proposes a novel prediction method that encodes shapes in a Riemannian shape space and learns hierarchical statistical models.
result Outperforms deep learning-supported variants and state-of-the-art methods in predicting shape development.

Proposes efficient algorithm for system-level I&M decisions under uncertainty.

problem Optimal management strategies for deteriorating civil engineering systems.
method Factored partially observable Markov decision process with Bayesian networks and DDMAC reinforcement learning.
result DDMAC policies offer substantial benefits over heuristic approaches in system-level cost optimization.

A multi-agent system improves crypto portfolio management by processing diverse data types.

problem Managing cryptocurrency portfolios requires processing various data types under high volatility.
method A multi-agent system with three specialized agents for market dynamics, news sentiment, and signal fusion.
result The best configuration, Hierarchical (Skill), achieved a 133.52% cumulative return and 1.502 Sharpe ratio.

Survey of AI in finance covering models, strategies, and knowledge systems.

problem Challenges in applying AI to financial markets, especially in high-frequency trading.
method Systematic analysis of financial AI across predictive models, decision frameworks, and knowledge augmentation systems.
result Critical trade-offs and gaps between theoretical advances and practical implementation in financial AI.

A new method for solving complex sequential decision-making problems by decomposing them into multiple levels.

problem Sequential decision-making with natural multi-level structure.
method Multi-level meta-reinforcement learning with skill-based curriculum.
result Efficiently reduces stochasticity and policy search space, leading to fewer iterations and computations.

This study compares hierarchical and non-hierarchical models for open-domain multi-turn dialog generation.

problem Which kind of models (hierarchical or non-hierarchical) is better for open-domain multi-turn dialog generation?
method Systematically compared nearly all representative hierarchical and non-hierarchical models over the same experimental settings.
result Nearly all hierarchical models are worse than non-hierarchical models in open-domain multi-turn dialog generation, except for HRAN.

We survey agglomerative hierarchical clustering algorithms and discuss efficient implementations that are available in R and other software environments. We look at hierarchical self-organizing maps, and mixture models. We review grid-based clustering, focusing on hierarchical density-based approaches. Finally we descr…

2011-04-30abs ↗pdf ↗

Paper presents a new method for better financial market forecasting.

problem Traditional investment strategies fail to capture market nuances and risks.
method Combines deep learning, factor integration, and correlated stock analysis.
result Enhanced diversification and performance capture in financial markets.

Paper proposes a Renyi entropy-based method for tuning hierarchical topic models.

problem Tuning hierarchical topic models, especially determining the number of topics at each level, is challenging.
method The paper introduces a Renyi entropy-based metric for quality assessment and a practical tuning concept.
result The proposed method can estimate the number of topics for two hierarchical levels in hARTM model.

Neural NMF discovers hierarchical topics in multilayer data.

problem Detecting latent hierarchical structure in multilayer data.
method Recursive application of nonnegative matrix factorization (NMF) in layers with backpropagation optimization.
result Neural NMF outperforms other hierarchical NMF methods in synthetic and real-world datasets.

The paper develops a decision support system for hierarchical text classification of conference proceedings.

problem Classifying documents with a fixed hierarchical structure of topics.
method Developed a weighted hierarchical similarity function to calculate topic relevance, using entropy of words to estimate weights.
result The weighted hierarchical similarity function improves ranking accuracy compared to other methods.

Bayesian Hierarchical Invariant Prediction refines ICP for better scalability and prior integration.

problem Improving computational scalability and invariance testing for causal inference.
method Bayesian Hierarchical structure to test invariance under heterogeneous data.
result Demonstrated improved scalability and potential as an alternative to ICP.

Hierarchical causal models help understand cause and effect in nested data.

problem Learning cause and effect from nested hierarchical data.
method Extend structural causal models and causal graphical models with inner plates, develop graphical identification technique and estimation methods.
result Hierarchical data can enable causal identification even when non-hierarchical data cannot.

Posterior regularization enhances Bayesian hierarchical mixture clustering by improving node separation.

problem High nodal variance in BHMC trees, leading to weak separation between nodes at higher levels.
method Employing Posterior Regularization to impose max-margin constraints on nodes at every level.
result Improves cluster separation in BHMC models, enhancing overall model performance.