Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

190379569758 · Jun 202019922001200920172026
48 results for randomised gradient estimators

Unified high-probability regret bounds for online convex optimisation with randomised gradient estimators.

problem Online convex optimisation with randomised gradient estimators for q\ell_q-Lipschitz losses.
method FTRL with randomised two-point finite-difference gradient estimators based on cone-measure sampling from r\ell_r-spheres.
result Unified high-probability regret bounds for all p,q,r[1,]p,q,r \in [1,\infty].

New framework for policy gradient methods in continuous time reinforcement learning.

problem Addressing policy gradient methods for continuous time reinforcement learning.
method Control randomisation technique to derive policy gradient representation for various Markovian control problems.
result Demonstrated application to optimal switching problems in the energy sector.

We design a randomised parallel version of Adaboost based on previous studies on parallel coordinate descent. The algorithm uses the fact that the logarithm of the exponential loss is a function with coordinate-wise Lipschitz continuous gradient, in order to define the step lengths. We provide the proof of convergence …

2013-10-07abs ↗pdf ↗

New method improves calibration of BayesCG for better uncertainty quantification.

problem Bayesian conjugate gradient method's poor calibration limits its utility.
method Randomized postiteration strategy to enhance posterior calibration.
result The method improves the distribution of posterior errors and enhances uncertainty quantification.

We introduce a general learning framework for private machine learning based on randomised response. Our assumption is that all actors are potentially adversarial and as such we trust only to release a single noisy version of an individual's datapoint. We discuss a general approach that forms a consistent way to estima…

2020-01-14abs ↗pdf ↗

New method uses randomised signatures for generating financial time series data.

problem Generating synthetic financial time series data accurately.
method Introduced a Wasserstein-type distance based on discrete-time randomised signatures.
result Demonstrated universal approximation for randomised signatures on continuous functions.

Randomised classifiers outperform deterministic ones in strategic classification.

problem Strategic modification of features by agents in classification tasks.
method Theoretical analysis of randomised classifiers in strategic classification.
result Randomised classifiers can achieve better accuracy than deterministic ones under certain conditions.

FP uses random projections to train networks without feedback, achieving comparable performance to backpropagation.

problem Training neural networks without feedback from downstream layers.
method Forward Projection (FP) method that uses randomised nonlinear projections and closed-form regression.
result FP achieves comparable generalisation to backpropagation methods with a single forward pass, offering significant speedup.

Numerous kinds of uncertainties may affect an economy, e.g. economic, political, and environmental ones. We model the aggregate impact by the uncertainties on an economy and its associated financial market by randomised mixtures of Lévy processes. We assume that market participants observe the randomised mixtures only …

2011-12-09abs ↗pdf ↗

Study uses actor-critic method for continuous-time mean-field control with entropy regularisation.

problem Continuous-time mean-field control in reinforcement learning.
method Actor-critic approach with entropy regularisation, value function alternation, and Wasserstein space parametrisation.
result Derives exact parametrisation of actor and critic functions in linear-quadratic mean-field framework.

We propose a randomised version of the Heston model-a widely used stochastic volatility model in mathematical finance-assuming that the starting point of the variance process is a random variable. In such a system, we study the small-and large-time behaviours of the implied volatility, and show that the proposed random…

2016-08-25abs ↗pdf ↗

Paper develops a privacy-preserving nonparametric regression method.

problem Nonparametric regression with local differential privacy constraints.
method Privatised discretisation and Laplace noise applied to feature vectors and responses.
result Strongly universally consistent estimator for regression and classification.

Randomized exploration in linear bandits achieves optimal regret bounds.

problem Optimizing exploration in high-dimensional linear bandit problems.
method Analysis of Thompson sampling without forced optimism.
result Randomized exploration algorithms achieve an O(dnlog(n))O(d\sqrt{n} \log(n)) regret bound in smooth, strongly convex action spaces.

Improved Bayesian optimisation method using randomised Gaussian process UCB.

problem Improving performance in Bayesian optimisation.
method Developed a modified Gaussian process upper confidence bound (GP-UCB) acquisition function.
result The method achieves better performance than GP-UCB in various problems.

Discrete time analogues of ergodic stochastic differential equations (SDEs) are one of the most popular and flexible tools for sampling high-dimensional probability measures. Non-asymptotic analysis in the L2L^2 Wasserstein distance of sampling algorithms based on Euler discretisations of SDEs has been recently develop…

2018-08-21abs ↗pdf ↗

Two modified tests improve the reliability of evaluating explanation methods.

problem Methodological concerns in evaluating explanation methods for saliency maps.
method Proposed modifications to the Model Parameter Randomisation Test (MPRT): Smooth MPRT and Efficient MPRT.
result Enhanced metric reliability, facilitating more trustworthy deployment of explanation methods.

EVILL uses randomised perturbations to improve exploration in bandit problems.

problem Improving exploration in structured stochastic bandit problems.
method Solves for the minimiser of a linearly perturbed regularised negative log-likelihood function.
result EVILL matches the performance of Thompson-sampling-style methods in theory and practice.

Estimates long-term effects from short-term experiments and observational data with unobserved confounders.

problem Estimating long-term causal effects from short-term experiments and long-term observational data with unobserved confounding.
method Combining regression residuals with short-term experimental outcomes to create an instrumental variable for estimating long-term causal effects.
result The estimator is unbiased and its variance is analytically studied.

In this paper we propose a Bayesian method for estimating architectural parameters of neural networks, namely layer size and network depth. We do this by learning concrete distributions over these parameters. Our results show that regular networks with a learnt structure can generalise better on small datasets, while f…

2019-01-14abs ↗pdf ↗

Improved control approach for correlated bandits with better performance.

problem General multi-armed bandit problem with correlated elements.
method Introducing entropy regularisation to obtain a smooth asymptotic approximation of the value function, leading to a semi-index approximation of the optimal decision process.
result Performance of Asymptotic Randomised Control (ARC) algorithm compares favorably with other approaches.

We introduce Bayesian least-squares policy iteration (BLSPI), an off-policy, model-free, policy iteration algorithm that uses the Bayesian least-squares temporal-difference (BLSTD) learning algorithm to evaluate policies. An online variant of BLSPI has been also proposed, called randomised BLSPI (RBLSPI), that improves…

2019-04-06abs ↗pdf ↗

We consider the problem of link prediction, based on partial observation of a large network, and on side information associated to its vertices. The generative model is formulated as a matrix logistic regression. The performance of the model is analysed in a high-dimensional regime under a structural assumption. The mi…

2018-03-19abs ↗pdf ↗

Popular approaches to differential privacy, such as the Laplace and exponential mechanisms, calibrate randomised smoothing through global sensitivity of the target non-private function. Bounding such sensitivity is often a prohibitively complex analytic calculation. As an alternative, we propose a straightforward sampl…

2017-06-08abs ↗pdf ↗

We develop a monitoring procedure to detect changes in a large approximate factor model. Letting rr be the number of common factors, we base our statistics on the fact that the (r+1)\left( r+1\right) -th eigenvalue of the sample covariance matrix is bounded under the null of no change, whereas it becomes spiked under cha…

2017-08-09abs ↗pdf ↗

This paper tackles batch Bayesian optimal experimental design by using Wasserstein gradient flows.

problem The challenge of optimising high-dimensional, strongly non-convex expected information gain in batch settings.
method Probabilistic lifting to the space of probability measures, entropic regularisation, Wasserstein gradient flow, and particle-based algorithms.
result The proposed approach can be used directly as a randomised batch-design policy or as a computational relaxation.

We propose and evaluate alternative ensemble schemes for a new instance based learning classifier, the Randomised Sphere Cover (RSC) classifier. RSC fuses instances into spheres, then bases classification on distance to spheres rather than distance to instances. The randomised nature of RSC makes it ideal for use in en…

2014-09-17abs ↗pdf ↗

Develops a kernel-based framework for dynamic trading strategies.

problem Optimizing portfolios with temporal dependencies in asset dynamics.
method Parameterizes trading strategies as functions in RKHS, enabling flexible, non-Markovian approaches.
result Significantly outperforms classical Markovian methods in synthetic and market-data examples.

Novel strategy for federated learning with privacy-preserving predictors and nonvacuous generalization bounds.

problem Privacy-preserving federated learning with nonvacuous generalization bounds.
method Randomized predictors, PAC-Bayesian generalization bound, synchronous and heterogeneous/homogenous cases.
result Achieves comparable predictive performance to batch approach while preserving privacy.

Study proves value of non-Markovian games with partial, asymmetric info.

problem Value of non-Markovian Dynkin games with partial and asymmetric information.
method Probabilistic and functional analytic approach based on Sion's min-max theorem.
result Existence of optimal strategies for both players in randomised stopping times.

Paper improves privacy bounds for shuffle model using novel numerical techniques.

problem Improving privacy guarantees in the shuffle model of differential privacy.
method Develops and evaluates numerical techniques for tighter (ε,δ)(\varepsilon,δ)-differential privacy bounds.
result Accurately evaluates privacy loss distribution for adaptive compositions of shufflers.

Machine learning experiments often mislead due to unmet assumptions.

problem Machine learning experiments with pooled data may not meet necessary assumptions for unbiased causal effect estimation.
method Analysis of assumptions required for unbiased causal effect estimation in machine learning experiments.
result Practical applications of A/B-tests with machine learning models may not yield unbiased estimates of causal effect.

An explorative data analysis system should be aware of what the user already knows and what the user wants to know of the data: otherwise the system cannot provide the user with the most informative and useful views of the data. We propose a principled way to do exploratory data analysis, where the user's background kn…

2018-05-20abs ↗pdf ↗

The paper proposes an estimator to make inference of heterogeneous treatment effects sorted by impact groups (GATES) for non-randomised experiments. The groups can be understood as a broader aggregation of the conditional average treatment effect (CATE) where the number of groups is set in advance. In economics, this a…

2019-11-07abs ↗pdf ↗

Theoretical limits show experimental data can falsify but not validate causal estimates from observational studies.

problem Fundamental limits on validating causal estimates using experimental data in observational studies.
method Impossible inference framework, Gaussian Process based approach.
result Experimental data can falsify but not validate causal estimates from observational studies.