Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

113226338451 · Jun 202019922001200920172026
48 results for decision graphs

Graph neural Thompson Sampling improves online decision-making for graph data.

problem Online decision-making with graph-structured rewards.
method GNN-TS algorithm using GNN for mean reward estimation and graph neural tangent features for uncertainty.
result GNN-TS achieves a state-of-the-art regret bound of ildeO((ildedT)1/2) ilde{\mathcal{O}}(( ilde{d} T)^{1/2}).

Neural Architecture Search (NAS) enabled the discovery of state-of-the-art architectures in many domains. However, the success of NAS depends on the definition of the search space. Current search spaces are defined as a static sequence of decisions and a set of available actions for each decision. Each possible sequenc…

2018-12-27abs ↗pdf ↗

Graph Networks are used to make decisions in potentially complex scenarios but it is usually not obvious how or why they made them. In this work, we study the explainability of Graph Network decisions using two main classes of techniques, gradient-based and decomposition-based, on a toy dataset and a chemistry task. Ou…

2019-05-31abs ↗pdf ↗

EBNCs are a new model for Bayesian networks, derived from different networks.

problem Creating efficient models for Bayesian networks with discrete variables.
method Developed an EBNC model derived from different Bayesian networks, showing it's a special case of softmax polynomial regression.
result EBNCs can be used as a special case of softmax polynomial regression models.

Agents cooperate to make decisions in multi-armed bandits over a graph.

problem Optimizing decisions in multi-agent multi-armed bandits with shared information.
method Designs consensus-based distributed estimation and cooperative algorithms for group decision-making.
result Achieves group performance close to centralized fusion center.

Study how communication and feedback graphs affect learning outcomes.

problem Understanding the impact of feedback graphs on cooperative online learning.
method Analyzed network regret in terms of the independence number of the strong product of communication and feedback graphs.
result Proved bounds for network regret and demonstrated the non-improvable nature of positive results in pathological cases.

In this paper, we introduce a new online decision making paradigm that we call Thresholding Graph Bandits. The main goal is to efficiently identify a subset of arms in a multi-armed bandit problem whose means are above a specified threshold. While traditionally in such problems, the arms are assumed to be independent, …

2019-05-22abs ↗pdf ↗

Paper tackles active learning for GNNs, reducing annotation costs.

problem Efficiently label nodes on graphs to reduce GNN training costs.
method Formulates as a sequential decision process, trains GNN-based policy network with reinforcement learning.
result Trains a transferable active learning policy that generalizes across different domains.

A new method for multi-agent planning on graphs outperforms existing approaches.

problem Planning coordination among multiple interacting agents on a graph.
method Variational perturbation theory applied to inference in large networks.
result Our method outperforms state-of-the-art methods in non-local cost function scenarios.

We consider an adversarial online learning setting where a decision maker can choose an action in every stage of the game. In addition to observing the reward of the chosen action, the decision maker gets side observations on the reward he would have obtained had he chosen some of the other actions. The observation str…

2011-06-13abs ↗pdf ↗

We study multi-armed bandit problems with graph feedback, in which the decision maker is allowed to observe the neighboring actions of the chosen action, in a setting where the graph may vary over time and is never fully revealed to the decision maker. We show that when the feedback graphs are undirected, the original …

2018-05-23abs ↗pdf ↗

Graph Neural Networks improve demand forecasting by considering article relationships.

problem Forecasting independent article-level predictions without considering related articles.
method Integrating GNN encoder into DeepAR model and using article attribute similarity to build graphs.
result The proposed approach consistently outperforms non-graph benchmarks and produces useful article embeddings.

A new method for semi-supervised classification using graph walks and reinforcement learning.

problem Efficiently classifying nodes in attributed networks with limited labeled data.
method Proposes a reinforcement learning approach to find optimal paths in the graph for classification.
result The method outperforms existing approaches on multiple datasets.

This paper extends combinatorial semi-bandits to graph feedback, improving regret bounds.

problem Adversarial combinatorial semi-bandits with graph feedback.
method Introduced graph feedback in combinatorial semi-bandits, using convexified actions and online stochastic mirror descent.
result Optimal regret scales as ST+αSTS\sqrt{T}+\sqrt{αST}, interpolating between full and semi-bandit feedback.

This paper presents a novel method for structural data recognition using a large number of graph models. In general, prevalent methods for structural data recognition have two shortcomings: 1) Only a single model is used to capture structural variation. 2) Naive recognition methods are used, such as the nearest neighbo…

2017-03-08abs ↗pdf ↗

Study of reinforcement learning with additional feedback observations.

problem Episodic reinforcement learning in Markov decision processes with feedback observations.
method Formalization of feedback graph, model-based algorithms leveraging feedback, regret bound analysis.
result Regret bound depends only on the size of the maximum acyclic subgraph of the feedback graph.

A new framework explains GNN predictions by simulating graph structure and feature changes.

problem Lack of transparency in GNN predictions hinders understanding.
method TraP2 framework using a three-layer architecture: Translation, Perturbation, and Paraphrase layers.
result TraP2 achieves 10.2% higher explanation accuracy than state-of-the-art methods.

Graph-based state representation improves deep RL performance.

problem High sample-complexity and starting with a good input representation in deep RL.
method Exploiting the graph structure of MDPs for effective state representation learning.
result Graph-based node representation methods outperform matrix-based methods in grid-world navigation tasks.

Molecular "fingerprints" encoding structural information are the workhorse of cheminformatics and machine learning in drug discovery applications. However, fingerprint representations necessarily emphasize particular aspects of the molecular structure while ignoring others, rather than allowing the model to make data-d…

2016-03-02abs ↗pdf ↗

Graph Neural Networks (GNNs) have proven to be successful in many classification tasks, outperforming previous state-of-the-art methods in terms of accuracy. However, accuracy alone is not enough for high-stakes decision making. Decision makers want to know the likelihood that a specific GNN prediction is correct. For …

2019-05-07abs ↗pdf ↗

We study the explore-exploit tradeoff in distributed cooperative decision-making using the context of the multiarmed bandit (MAB) problem. For the distributed cooperative MAB problem, we design the cooperative UCB algorithm that comprises two interleaved distributed processes: (i) running consensus algorithms for estim…

2015-12-21abs ↗pdf ↗

The paper proposes multicalibration to improve matching in graphs with imperfect predictors.

problem Finding the best matching in graphs with imperfect predictors.
method Introduces multicalibration as a fairness notion to ensure unbiasedness on protected sets of contexts.
result Constructing a multicalibrated predictor that outperforms standard optimal rules in matching algorithms.

Paper formalizes a reinforcement learning model for complex information structures.

problem Complex interdependence in sequential decision-making problems.
method Formalizes a novel reinforcement learning model with explicit information structure representation.
result Upper bound on sample complexity of learning general sequential decision-making problems.

Though reinforcement learning has greatly benefited from the incorporation of neural networks, the inability to verify the correctness of such systems limits their use. Current work in explainable deep learning focuses on explaining only a single decision in terms of input features, making it unsuitable for explaining …

2019-05-28abs ↗pdf ↗

Proves error bounds for state representation in RL using graph spectral features.

problem Addressing the curse of dimensionality in RL with unknown transition graphs.
method Proves upper bounds on approximation error of linear value function approximation using learned spectral features of the state-graph.
result Error bounds scale with algebraic connectivity and eigenvector estimation error.

CI-GNN uses GNNs to diagnose psychiatric disorders by identifying causally relevant brain regions.

problem Leveraging GNNs for psychiatric diagnosis requires interpretable models to understand decision-making.
method CI-GNN integrates Granger causality into GNNs to identify causally relevant subgraphs.
result CI-GNN provides more reliable and concise explanations of psychiatric diagnoses.

IDS algorithm optimizes sequential decisions in various monitoring settings.

problem Optimizing sequential decisions in complex monitoring scenarios.
method Information-directed sampling (IDS) algorithm for linear partial monitoring.
result IDS achieves nearly worst-case rate optimality in finite-action games.

Graph classification improved using spectral features and wavelet filters.

problem Categorizing graphs based on their structure and node attributes.
method Derived spectral features from graph signal processing, designed two Gaussian process models: one simple and one sophisticated.
result Simple and sophisticated Gaussian process models yield competitive performance, including well-calibrated uncertainty estimates.

Improved graph embedding through refined linear transformation and community recovery.

problem Identifying meaningful latent communities in graph data.
method Refined graph encoder embedding via linear transformation, self-training, and latent community recovery.
result Improved vertex embedding and better decision boundaries for vertex classification.

We present an equivalent criterion for the global existence of Euler's multiplier for an integrable one-form taking into account the corresponding codim-1-foliation. In particular, the impact of inseparable leaves is considered. Here, we suppose that the foliation can be reduced to a graph; we also discuss obstructions…

2001-08-22abs ↗pdf ↗

Model forecasts global stock market volatility using dynamic graphs and all trading days.

problem Enhance forecasting accuracy and practical utility in global stock market volatility.
method Spatial-temporal graph neural network architecture to capture volatility spillover effect.
result Forecasting performance surpasses baseline models in all scenarios.

We study the robustness verification problem for tree-based models, including decision trees, random forests (RFs) and gradient boosted decision trees (GBDTs). Formal robustness verification of decision tree ensembles involves finding the exact minimal adversarial perturbation or a guaranteed lower bound of it. Existin…

2019-06-10abs ↗pdf ↗