Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

1223 · Jun 202019922001200920172026
48 results for need-to-know

The paper explores the incompatibility between fair privacy, need-to-know, and fairness in classifier outputs.

problem The interaction between fair privacy, need-to-know, and fairness in classifier outputs.
method Formulated and explored the interaction between fair privacy, need-to-know, and fairness in classifier outputs.
result Optimal classifiers are generally incompatible with fair privacy and need-to-know.

In this paper, we investigate the non-stationary combinatorial semi-bandit problem, both in the switching case and in the dynamic case. In the general case where (a) the reward function is non-linear, (b) arms may be probabilistically triggered, and (c) only approximate offline oracle exists \cite{wang2017improving}, o…

2020-02-10abs ↗pdf ↗

When geometric structures on surfaces are determined by the lengths of curves, it is natural to ask: which curves' lengths do we really need to know? It is a result of Duchin--Leininger--Rafi that any flat metric induced by a unit-norm quadratic differential is determined by its marked simple length spectrum. We genera…

2018-10-03abs ↗pdf ↗

Develops framework for understanding deep learning in time series data.

problem Understanding and explaining decisions made by deep learning models in time series data.
method Uses deep neural networks to capture and explain temporal dependencies in time series data.
result Framework successfully captures and explains temporal dependencies in various synthetic and real-world datasets.

Knots and links which are closed 3-braids are a very special class. Like 2-bridge knots and links, they are simple enough to admit a complete classification. At the same time they are rich enough to serve as a source of examples on which, with luck, a researcher may be able to test various conjectures. The goal of this…

2008-02-07abs ↗pdf ↗

These notes are an introduction to symplectic groupoids and the double structures associated with them. The treatment is intended to lie about midway between the original account of Coste, Dazord and Weinstein, which relied on effective use of the symplectic structures, and the account in my 2005 book, which showed, on…

2015-03-15abs ↗pdf ↗

Price without transaction makes no sense. Trading volume authenticates its corresponding price, so there exist mutual information and correlation between price and trading volume. We are curious about fractal features of this correlation and need to know how structures in different scales translate information. To expl…

2019-03-05abs ↗pdf ↗

The paper studies MAB problems with LDP to balance privacy and service quality.

problem Balancing privacy and service quality in multi-armed bandit systems.
method Investigates regret minimization for MAB with LDP guarantee, proving lower bounds and proposing matching upper bounds algorithms.
result Regret upper bounds match lower bounds up to constant factors for MAB algorithms with LDP guarantee.

A new learning method uses data to learn from large model sets.

problem Learning with large sets of candidate models where uniform convergence is hard.
method Data-dependent learning that incorporates empirical data less reliant on prior assumptions.
result Demonstrates improved generalization in various learning assumptions.

Algorithm converges to Nash equilibria in competitive games.

problem Finding Nash equilibria in decentralized, competitive Markov games.
method Decentralized Optimistic Gradient Descent/Ascent with a critic.
result Converges to the set of Nash equilibria under self-play.

An online reinforcement learning algorithm is anytime if it does not need to know in advance the horizon T of the experiment. A well-known technique to obtain an anytime algorithm from any non-anytime algorithm is the "Doubling Trick". In the context of adversarial or stochastic multi-armed bandits, the performance of …

2018-03-19abs ↗pdf ↗

We develop an automated variational inference method for Bayesian structured prediction problems with Gaussian process (GP) priors and linear-chain likelihoods. Our approach does not need to know the details of the structured likelihood model and can scale up to a large number of observations. Furthermore, we show that…

2016-09-14abs ↗pdf ↗

A standard way to obtain convergence guarantees in stochastic convex optimization is to run an online learning algorithm and then output the average of its iterates: the actual iterates of the online learning algorithm do not come with individual guarantees. We close this gap by introducing a black-box modification to …

2019-03-03abs ↗pdf ↗

Simplifies large action space bandits by selecting representative actions.

problem Efficiently managing large action spaces with correlated outcomes.
method Random sampling and solving of bandit instances to identify representative actions.
result The algorithm selects a smaller set of representative actions that perform nearly as well as the full action space.

Tricks adversarial attacks to target specific classes, improving classifier accuracy.

problem Recent adversarial defense approaches have failed to protect classifiers from untargeted attacks.
method Target Training defense tricks untargeted attacks into targeted attacks on designated classes, then derives the real class.
result 86.2% accuracy for CW-L2 (confidence=0) in CIFAR10, outperforming unsecured classifiers.

Follow-the-Leader (FTL) is an intuitive sequential prediction strategy that guarantees constant regret in the stochastic setting, but has terrible performance for worst-case data. Other hedging strategies have better worst-case guarantees but may perform much worse than FTL if the data are not maximally adversarial. We…

2013-01-03abs ↗pdf ↗

Novel algorithm for decentralized optimization in time-varying networks with delays.

problem Decentralized optimization in networks with communication delays.
method DT-GO algorithm, applicable to general directed graphs, converges to same complexity as centralized SGD.
result Algorithm DT-GO achieves convergence rates for convex and non-convex objectives, similar to centralized SGD.

Proposes a new method for estimating counterfactual treatment effects.

problem Uncertainty in identifying causal mechanisms from observational data.
method Introduces a parameterized family of causal mechanisms that generalize Gumbel-max, trained to minimize counterfactual effect variance.
result Trained mechanisms yield lower variance estimates of counterfactual treatment effects.

Auto-encoders have emerged as a successful framework for unsupervised learning. However, conventional auto-encoders are incapable of utilizing explicit relations in structured data. To take advantage of relations in graph-structured data, several graph auto-encoders have recently been proposed, but they neglect to reco…

2019-05-26abs ↗pdf ↗

Paper presents an efficient algorithm for estimating Lipschitz functions from noisy data.

problem Estimating unknown Lipschitz functions from noisy observations.
method Extends max-affine methods to Lipschitz setting using nonlinear feature expansion and adaptive partitioning.
result Achieves minimax convergence rate with respect to intrinsic dimension, up to logarithmic factors.

The paper uses deep neural networks to estimate and infer ATE without needing to know the dimension of the data.

problem Estimating and inferring the average treatment effect (ATE) in complex data settings.
method The paper uses deep neural networks to estimate the mean regression function and then calculates the ATE. It establishes consistency and asymptotic normality of the estimators.
result The deep neural network estimates of ATE are consistent and asymptotically normal, providing dimension-free rates.

Adaptive gradient methods converge faster with over-parameterization and line-search.

problem Training over-parameterized models using adaptive gradient methods.
method Simplified setting of smooth, convex losses with over-parameterized models, proving convergence rates and demonstrating improvements with line-search techniques.
result Adaptive gradient methods, particularly AMSGrad, converge faster with line-search techniques.

In order for machine learning to be deployed and trusted in many applications, it is crucial to be able to reliably explain why the machine learning algorithm makes certain predictions. For example, if an algorithm classifies a given pathology image to be a malignant tumor, then the doctor may need to know which parts …

2017-10-29abs ↗pdf ↗

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs to the population distribution of the training/evaluation data to prevent unpre…

2018-09-13abs ↗pdf ↗

Study multi-task learning with low-rank representation in stochastic linear bandits.

problem Transfer learning across multiple linear bandit tasks with shared low-dimensional representation.
method Proposes a greedy policy with trace norm regularization to implicitly learn a low-rank representation without knowing the rank.
result Upper bound on multi-task regret of NdT(T+d)r\sqrt{NdT(T+d)r}, showing benefit over independent task solving.

Paper solves the chicken-and-egg problem in unsupervised learning of signal models.

problem Learning signal models from incomplete data when the model is unknown.
method Necessary and sufficient sensing conditions for learning signal models from multiple measurement operators or group invariance.
result Agrees with the fundamental limitations of learning from incomplete data.

The paper classifies orbits of semisimple elements in real semisimple Lie algebras.

problem Classifying orbits of semisimple elements in real semisimple Lie algebras.
method Case by case analysis of complex numbers and Galois cohomology for real numbers.
result Characterization of orbits with real representatives.

New learning rules from information bottleneck improve deep learning without precise labels.

problem Training deep neural networks with backpropagation is biologically implausible.
method Kernelized information bottleneck principle with 3-factor Hebbian structure.
result The new learning rules perform nearly as well as backpropagation on image classification tasks.

Optimal pricing strategy for unknown valuation models with noisy feedback.

problem Minimizing regret in dynamic pricing with unknown valuation functions and noisy feedback.
method Proposes a minimax-optimal algorithm using discretization and data partitioning to handle unknown noise distribution and Lipschitz continuity of valuation functions.
result Achieves minimax-optimal regret bound matching the theoretical lower bound up to logarithmic factors.

This paper tackles causal representation learning with linear and general transformations.

problem Identify and recover latent causal variables and graphs under unknown transformations.
method Score-based algorithms that use gradients of log-density functions for identifiability and achievability.
result Two stochastic hard interventions per node are sufficient for identifiability of general transformations.

Meta-learning for bandit tasks using shared representations.

problem Learning new bandit tasks efficiently using shared low-dimensional representations.
method Proposes a greedy policy to learn new bandit tasks leveraging a partially learned low-dimensional representation.
result Upper bound on regret of proposed policy, showing efficiency of learning new tasks.