This work proposes an online learning approach to tighten constraints in stochastic control problems.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
In this paper we present a new approach for tightening upper bounds on the partition function. Our upper bounds are based on fractional covering bounds on the entropy function, and result in a concave program to compute these bounds and a convex program to tighten them. To solve these programs effectively for general r…
Unified framework for hard affine SDP constraints in vRKHSs.
We propose a novel training algorithm for reinforcement learning which combines the strength of deep Q-learning with a constrained optimization approach to tighten optimality and encourage faster reward propagation. Our novel technique makes deep reinforcement learning more practical by drastically reducing the trainin…
Paper tightens optimization bounds using conformal prediction.
Improved neural network robustness certification through tighter convex relaxations.
Safety filter for unknown discrete-time systems with learned models and noise covariance.
New bounds tighten the generalization error of Gibbs algorithm.
Sparse principal component analysis (PCA) involves nonconvex optimization for which the global solution is hard to obtain. To address this issue, one popular approach is convex relaxation. However, such an approach may produce suboptimal estimators due to the relaxation effect. To optimally estimate sparse principal su…
Optimal experiments tighten causal effect bounds efficiently.
New framework tightens certified robustness gaps in machine learning models.
The rapid growth of deep learning applications in real life is accompanied by severe safety concerns. To mitigate this uneasy phenomenon, much research has been done providing reliable evaluations of the fragility level in different deep neural networks. Apart from devising adversarial attacks, quantifiers that certify…
In this note we establish estimates for the harmonic map heat flow from into a closed manifold, and use it to construct sweepouts with the following good property: each curve in the tightened sweepout, whose energy is close to the maximal energy of curves in the sweepout, is itself close to a closed geodesic.
Bounding the generalization error of learning algorithms has a long history, which yet falls short in explaining various generalization successes including those of deep learning. Two important difficulties are (i) exploiting the dependencies between the hypotheses, (ii) exploiting the dependence between the algorithm'…
Paper tightens statistical aggregation results using local complexity.
Variational inference has become one of the most widely used methods in latent variable modeling. In its basic form, variational inference employs a fully factorized variational distribution and minimizes its KL divergence to the posterior. As the minimization can only be carried out approximately, this approximation i…
Improved bounds on geodesic lengths in Riemannian surfaces.
We show that the variational representations for f-divergences currently used in the literature can be tightened. This has implications to a number of methods recently proposed based on this representation. As an example application we use our tighter representation to derive a general f-divergence estimator based on t…
New method tightens bounds on causation probabilities using independent datasets.
UCRL3 improves UCRL2's efficiency in reinforcement learning by reducing exploration.
New method improves neural network verification by considering multivariate input space of ReLU neurons.
We consider a discrete-time approximation of paths of an Ornstein--Uhlenbeck process as a mean for estimation of a price of European call option in the model of financial market with stochastic volatility. The Euler--Maruyama approximation scheme is implemented. We determine the estimates for the option price for prede…
The study tightens bounds on binomial probabilities and minimums using KL-divergence.
Optimizes decisions in time-varying distributions using online stochastic methods and Wasserstein distance.
We prove the first polynomial bound on the number of monotonic homotopy moves required to tighten a collection of closed curves on any compact orientable surface, where the number of crossings in the curve is not allowed to increase at any time during the process. The best known upper bound before was exponential, whic…
Adaptive uncertainty quantification improves black-box model predictions in generative AI.
We describe a new technique for computing lower-bounds on the minimum energy configuration of a planar Markov Random Field (MRF). Our method successively adds large numbers of constraints and enforces consistency over binary projections of the original problem state space. These constraints are represented in terms of …
Safe learning in uncertain systems with state measurements and optimization.
The superposition of temporal point processes has been studied for many years, although the usefulness of such models for practical applications has not be fully developed. We investigate superposed Hawkes process as an important class of such models, with properties studied in the framework of least squares estimation…
New method improves deep learning by sampling worst-performing data.
The paper tightens bounds on distances between Reeb graphs.
We introduce a new class of lower bounds on the log partition function of a Markov random field which makes use of a reversed Jensen's inequality. In particular, our method approximates the intractable distribution using a linear combination of spanning trees with negative weights. This technique is a lower-bound count…
New method speeds up solving L0-regularized least-squares problems.
Study tightens bounds for interpolating noisy data using minimum l1-norm.
We consider the learning of multi-agent Hawkes processes, a model containing multiple Hawkes processes with shared endogenous impact functions and different exogenous intensities. In the framework of stochastic maximum likelihood estimation, we explore the associated risk bound. Further, we consider the superposition o…
We study the problem of instance segmentation in biological images with crowded and compact cells. We formulate this task as an integer program where variables correspond to cells and constraints enforce that cells do not overlap. To solve this integer program, we propose a column generation formulation where the prici…
We propose a new complexity measure for Markov decision processes (MDPs), the maximum expected hitting cost (MEHC). This measure tightens the closely related notion of diameter [JOA10] by accounting for the reward structure. We show that this parameter replaces diameter in the upper bound on the optimal value span of a…
This paper tightens information-theoretic bounds on generalization errors.
Improved PAC-Bayesian bounds by considering example difficulty.
We give an algorithm to compute the stable lengths of pseudo-Anosovs on the curve graph, answering a question of Bowditch. We also give a procedure to compute all invariant tight geodesic axes of pseudo-Anosovs. Along the way we show that there are constants such that the minimal upper bound on `slices' of …
New algorithm learns and unlearns from streaming data efficiently.
We introduce a globally-convergent algorithm for optimizing the tree-reweighted (TRW) variational objective over the marginal polytope. The algorithm is based on the conditional gradient method (Frank-Wolfe) and moves pseudomarginals within the marginal polytope through repeated maximum a posteriori (MAP) calls. This m…
News on inflation and monetary policy impacts US household inflation expectations.
Strong theoretical guarantees of robustness can be given for ensembles of classifiers generated by input randomization. Specifically, an bounded adversary cannot alter the ensemble prediction generated by an additive isotropic Gaussian noise, where the radius for the adversary depends on both the variance of t…
The study tightens risk bounds for mixtures of experts using local differential privacy.
Paper tightens lower bounds on decentralized training complexity.
This paper presents a distributionally robust Q-Learning algorithm (DrQ) which leverages Wasserstein ambiguity sets to provide idealistic probabilistic out-of-sample safety guarantees during online learning. First, we follow past work by separating the constraint functions from the principal objective to create a hiera…
We refine toxicity bounds for dynamic liquidation incentives in CP-AMM systems.