arXiv research

New Thompson sampling algorithm for stochastic partial monitoring achieves logarithmic regret.

IDS algorithm optimizes sequential decisions in various monitoring settings.

New algorithms reduce regret in both stochastic and adversarial partial monitoring problems.

Partial monitoring is a rich framework for sequential decision making under uncertainty that generalizes many well known bandit models, including linear, combinatorial and dueling bandits. We introduce information directed sampling (IDS) for stochastic partial monitoring with a linear reward and observation structure. …

We present a new anytime algorithm that achieves near-optimal regret for any instance of finite stochastic partial monitoring. In particular, the new algorithm achieves the minimax regret, within logarithmic factors, for both "easy" and "hard" problems. For easy problems, it additionally achieves logarithmic individual…

Partial monitoring is a general model for sequential learning with limited feedback formalized as a game between two players. In this game, the learner chooses an action and at the same time the opponent chooses an outcome, then the learner suffers a loss and receives a feedback signal. The goal of the learner is to mi…

Improved ExO method achieves near-optimal bounds in both stochastic and adversarial settings.

This paper presents a new asymptotic expansion method for pricing continuously monitoring barrier options. In particular, we develops a semi-group expansion scheme for the Cauchy-Dirichlet problem in the second-order parabolic partial differential equations (PDEs) arising in barrier option pricing. As an application, w…

We prove a new minimax theorem connecting the worst-case Bayesian regret and minimax regret under partial monitoring with no assumptions on the space of signals or decisions of the adversary. We then generalise the information-theoretic tools of Russo and Van Roy (2016) for proving Bayesian regret bounds and combine th…

Most of the empirical studies on stochastic volatility dynamics favor the 3/2 specification over the square-root (CIR) process in the Heston model. In the context of option pricing, the 3/2 stochastic volatility model is reported to be able to capture the volatility skew evolution better than the Heston model. In this …

Partial monitoring is a generalization of the well-known multi-armed bandit framework where the loss is not directly observed by the learner. We complete the classification of finite adversarial partial monitoring to include all games, solving an open problem posed by Bartok et al. [2014]. Along the way we simplify and…

We provide a simple and efficient algorithm for adversarial $k$-action $d$-outcome non-degenerate locally observable partial monitoring game for which the $n$-round minimax regret is bounded by $6(d+1) k^{3/2} \sqrt{n \log(k)}$, matching the best known information-theoretic upper bound. The same algorithm also achieves…

Efficient integration of uncertain observations with decision-making optimization is key for prescribing informed intervention actions, able to preserve structural safety of deteriorating engineering systems. To this end, it is necessary that scheduling of inspection and monitoring strategies be objectively performed o…

Partial-monitoring games constitute a mathematical framework for sequential decision making problems with imperfect feedback: The learner repeatedly chooses an action, opponent responds with an outcome, and then the learner suffers a loss and receives a feedback signal, both of which are fixed functions of the action a…

Spreading processes are often modelled as a stochastic dynamics occurring on top of a given network with edge weights corresponding to the transmission probabilities. Knowledge of veracious transmission probabilities is essential for prediction, optimization, and control of diffusion dynamics. Unfortunately, in most ca…

In approachability with full monitoring there are two types of conditions that are known to be equivalent for convex sets: a primal and a dual condition. The primal one is of the form: a set C is approachable if and only all containing half-spaces are approachable in the one-shot game; while the dual one is of the form…

Calibrated strategies can be obtained by performing strategies that have no internal regret in some auxiliary game. Such strategies can be constructed explicitly with the use of Blackwell's approachability theorem, in an other auxiliary game. We establish the converse: a strategy that approaches a convex $B$-set can be…

New algorithm minimizes expert selection regret in partial bandit feedback.

We propose combinatorial cascading bandits, a class of partial monitoring problems where at each step a learning agent chooses a tuple of ground items subject to constraints and receives a reward if and only if the weights of all chosen items are one. The weights of the items are binary, stochastic, and drawn independe…

This research develops efficient surrogate models for predicting crack growth in metal structures.

The method and characteristics of several approaches to the pricing of discretely monitored arithmetic Asian options on stocks with discrete, absolute dividends are described. The contrast between method behaviors for options with an Asian tail and those with monitoring throughout their lifespan is emphasized. Rates of…

The robustness and integrity of IP networks require efficient tools for traffic monitoring and analysis, which scale well with traffic volume and network size. We address the problem of optimal large-scale flow monitoring of computer networks under resource constraints. We propose a stochastic optimization framework wh…

A convolutional sequence to sequence non-intrusive load monitoring model is proposed in this paper. Gated linear unit convolutional layers are used to extract information from the sequences of aggregate electricity consumption. Residual blocks are also introduced to refine the output of the neural network. The partiall…

The paper proposes a method to monitor deep learning predictions for retraining, reducing costs.

We formulate stochastic partial differential equations on Riemannian manifolds, moving surfaces, general evolving Riemannian manifolds (with appropriate assumptions) and Riemannian manifolds with random metrics, in the variational setting of the analysis to stochastic partial differential equations. Considering mainly …

Stochastic control problems in finance often involve complex controls at discrete times. As a result numerically solving such problems, for example using methods based on partial differential or integro-differential equations, inevitably give rise to low order accuracy, usually at most second order. In many cases one c…

Infrastructure monitoring is critical for safe operations and sustainability. Water distribution networks (WDNs) are large-scale networked critical systems with complex cascade dynamics which are difficult to predict. Ubiquitous monitoring is expensive and a key challenge is to infer the contaminant dynamics from parti…

A search engine usually outputs a list of $K$ web pages. The user examines this list, from the first web page to the last, and chooses the first attractive page. This model of user behavior is known as the cascade model. In this paper, we propose cascading bandits, a learning variant of the cascade model where the obje…

Optimizes state monitoring in Markovian systems with cost constraints.

Develops anytime-valid stopping rules for SGD based on observed trajectory.

Bayesian method estimates Kronecker graphical models from autoregressive processes.

In many security and healthcare systems, the detection and diagnosis systems use a sequence of sensors/tests. Each test outputs a prediction of the latent state and carries an inherent cost. However, the correctness of the predictions cannot be evaluated since the ground truth annotations may not be available. Our obje…

We describe general multilevel Monte Carlo methods that estimate the price of an Asian option monitored at $m$ fixed dates. Our approach yields unbiased estimators with standard deviation $O(ε)$ in $O(m + (1/ε)^{2})$ expected time for a variety of processes including the Black-Scholes model, Merton's jump-diffusion mod…

New deep probabilistic model handles missing data in time series forecasting.

Study on multi-agent decision making complexity, showing sample efficiency gaps.

Bayesian neural networks can be partially stochastic without losing predictive power.

In this paper, we take up the analysis of a principal/agent model with moral hazard introduced in [17], with optimal contracting between competitive investors and an impatient bank monitoring a pool of long-term loans subject to Markovian contagion. We provide here a comprehensive mathematical formulation of the model …

Expert-guided model improves seismic compliance monitoring.

Across numerous applications, forecasting relies on numerical solvers for partial differential equations (PDEs). Although the use of deep-learning techniques has been proposed, actual applications have been restricted by the fact the training data are obtained using traditional PDE solvers. Thereby, the uses of deep-le…

Clarifies when solutions to stochastic PDEs stay near given subsets.

This paper studies the question of filtering and maximizing terminal wealth from expected utility in a partially information stochastic volatility models. The special features is that the only information available to the investor is the one generated by the asset prices, and the unobservable processes will be modeled …

A new method uses active learning to monitor industrial processes more accurately.

We prove the statistical consistency of kernel Partial Least Squares Regression applied to a bounded regression learning problem on a reproducing kernel Hilbert space. Partial Least Squares stands out of well-known classical approaches as e.g. Ridge Regression or Principal Components Regression, as it is not defined as…

This work tackles maintenance planning with deep reinforcement learning under uncertainty.

Paper tackles active labeling for partial supervision.

Improves model accuracy for neural nets in stochastic dynamics with partial prior knowledge.

AI model enhances grid monitoring with synchro-waveform tech.

Neural networks solve SPDEs using Wiener chaos expansion.