Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

6.3%12.5%18.8%25.0% · Oct 199319922001200920172026
48 results for approximation factor

This paper studies optimal approximation factors in misspecified off-policy RL, identifying key factors under various settings.

problem Understanding optimal approximation factors in misspecified off-policy value function estimation.
method Examined various settings including weighted L2L_2-norm, LL_\infty norm, state aliasing, and state coverage.
result Established optimal asymptotic approximation factors for different norms and identified two instance-dependent factors for L2(μ)L_2(μ) norm.

A new method for optimizing deep neural networks using TKFAC.

problem Optimizing deep neural networks with second-order methods.
method Proposes Trace-restricted Kronecker-factored Approximate Curvature (TKFAC) for Fisher information matrix approximation.
result TKFAC improves performance on deep network architectures compared to state-of-the-art algorithms.

In this paper, we present a general, multistage framework for graphical model approximation using a cascade of models such as trees. In particular, we look at the problem of covariance matrix approximation for Gaussian distributions as linear transformations of tree models. This is a new way to decompose the covariance…

2018-08-10abs ↗pdf ↗

Factor graphs are important models for succinctly representing probability distributions in machine learning, coding theory, and statistical physics. Several computational problems, such as computing marginals and partition functions, arise naturally when working with factor graphs. Belief propagation is a widely deplo…

2017-08-08abs ↗pdf ↗

This work tackles sparse coding in DLRA for interpretable multiway data.

problem Sparse coding in DLRA for interpretable multiway data.
method Proposes a new sparse-coding subproblem (MSC) and several algorithms to solve it.
result DLRA extends low-rank approximations, reducing variance and enhancing interpretability.

New RBF networks can approximate any continuous function.

problem Approximating any continuous function on a compact subset.
method Replacing smoothing factors with shifts in RBF networks and proving approximation under certain conditions.
result RBF networks can approximate any continuous function on any compact subset.

Factor graphs have recently gained increasing attention as a unified framework for representing and constructing algorithms for signal processing, estimation, and control. One capability that does not seem to be well explored within the factor graph tool kit is the ability to handle deterministic nonlinear transformati…

2019-03-21abs ↗pdf ↗

Efficiently learns Single-Index Models with constant factor approximation.

problem Learning Single-Index Models under L22L_2^2 loss with unknown link functions.
method An efficient algorithm using alignment sharpness for optimization.
result Achieves constant factor approximation to optimal loss for various distributions and link functions.

The paper provides tight bounds for improving multi-armed bandits problem.

problem Improving multi-armed bandits problem with concave reward functions.
method Upper and lower bounds for randomized online algorithms, providing an O(klogk)O(\sqrt{k} \log k) approximation.
result Achieved nearly-tight approximation guarantees for the improving multi-armed bandits problem.

Authors improve accuracy analysis for portfolio optimization with multiple timescale factors.

problem Asymptotic accuracy of portfolio optimization approximations for general utility functions and two timescale factors.
method Construct sub- and super-solutions to fully nonlinear problem.
result Rigorous justification of accuracy for portfolio optimization with general utility functions and two timescale factors.

We consider interactive learning and covering problems, in a setting where actions may incur different costs, depending on the response to the action. We propose a natural greedy algorithm for response-dependent costs. We bound the approximation factor of this greedy algorithm in active learning settings as well as in …

2016-02-23abs ↗pdf ↗

New algorithm selects best distribution privately in nearly-linear time.

problem Estimating the best distribution from samples under differential privacy constraints.
method Differentially private algorithm with nearly-linear time complexity and optimal approximation factor.
result Achieves optimal approximation factor of 3 with modest sample complexity increase.

New algorithms improve approximation of matrix norms, with applications in statistics and machine learning.

problem Improving approximation of matrix norms for 2ightarrowq2 ightarrow q in polynomial time.
method Polynomial-time multiplicative approximation algorithms for 2ightarrowq2 ightarrow q norm, leveraging sum-of-squares certificates.
result Achieved polynomially improved approximation factors, notably d1/8d^{1/8} for q=4q=4.

We build a simple diagnostic criterion for approximate factor structure in large cross-sectional equity datasets. Given a model for asset returns with observable factors, the criterion checks whether the error terms are weakly cross-sectionally correlated or share at least one unobservable common factor. It only requir…

2016-12-15abs ↗pdf ↗

Matrix completion and approximation are popular tools to capture a user's preferences for recommendation and to approximate missing data. Instead of using low-rank factorization we take a drastically different approach, based on the simple insight that an additive model of co-clusterings allows one to approximate matri…

2014-12-31abs ↗pdf ↗

We simplify SSL by approximating redundant structural components with low-rank factorization.

problem Improving self-supervised learning performance with limited labeled data.
method Low-rank approximation of structural redundancy, introducing ε_s to measure approximation quality.
result The proposed method enhances SSL performance, as shown by theoretical and experimental validations.

Second-order optimization methods such as natural gradient descent have the potential to speed up training of neural networks by correcting for the curvature of the loss function. Unfortunately, the exact natural gradient is impractical to compute for large models, and most approximations either require an expensive it…

2016-02-03abs ↗pdf ↗

The paper analyzes how factorized Gaussian approximations underestimate uncertainty in variational inference.

problem Underestimation of uncertainty in variational inference using factorized Gaussian approximations.
method Examined the trade-off between shrinkage and delinking in approximating a Gaussian with a diagonal covariance matrix.
result Entropy of the factorized Gaussian approximation underestimates both componentwise variance and entropy of the original Gaussian.

The problem of portfolio allocation in the context of stocks evolving in random environments, that is with volatility and returns depending on random factors, has attracted a lot of attention. The problem of maximizing a power utility at a terminal time with only one random factor can be linearized thanks to a classica…

2019-08-20abs ↗pdf ↗

Amortized inference allows latent-variable models trained via variational learning to scale to large datasets. The quality of approximate inference is determined by two factors: a) the capacity of the variational distribution to match the true posterior and b) the ability of the recognition network to produce good vari…

2018-01-10abs ↗pdf ↗

New model reduces matrix factorization bias, yielding truly low-rank solutions.

problem Gradient descent's implicit bias in matrix factorization.
method Introducing a new factorization model with constrained factors and diagonal components.
result The new model consistently exhibits a strong implicit bias, yielding truly low-rank solutions.

Policy gradient methods with aggregated states can achieve better performance than approximate policy iteration.

problem Approximation errors in policy and value function approximations.
method State-aggregated representations and policy gradient methods.
result Policy gradient methods can achieve a per-period regret bounded by ε, while approximate policy iteration and value iteration have a higher regret.

We introduce a novel class of credit risk models in which the drift of the survival process of a firm is a linear function of the factors. The prices of defaultable bonds and credit default swaps (CDS) are linear-rational in the factors. The price of a CDS option can be uniformly approximated by polynomials in the fact…

2016-05-24abs ↗pdf ↗

We consider the problem of identifying current coupons for Agency backed To-be-Announced (TBA) Mortgage Backed Securities. In a doubly stochastic factor based model which allows for prepayment intensities to depend upon current and origination mortgage rates, as well as underlying investment factors, we identify the cu…

2015-10-07abs ↗pdf ↗

QLA improves Bayesian uncertainty estimation for DNNs without increasing computational cost.

problem Overconfident out-of-distribution predictions from DNNs.
method Proposes Quadratic Laplace Approximation (QLA) to improve Bayesian uncertainty quantification.
result QLA yields modest yet consistent uncertainty estimation improvements over Linearized Laplace Approximation (LLA) on five regression datasets.

We develop a monitoring procedure to detect changes in a large approximate factor model. Letting rr be the number of common factors, we base our statistics on the fact that the (r+1)\left( r+1\right) -th eigenvalue of the sample covariance matrix is bounded under the null of no change, whereas it becomes spiked under cha…

2017-08-09abs ↗pdf ↗

The Hull-White one factor model is used to price interest rate options. The parameters of the model are often calibrated to simple liquid instruments, in particular European swaptions. It is therefore very important to have very efficient pricing formula for simple instruments. Such a formula is proposed here for Europ…

2009-01-13abs ↗pdf ↗

We develop a Bayesian Poisson matrix factorization model for forming recommendations from sparse user behavior data. These data are large user/item matrices where each user has provided feedback on only a small subset of items, either explicitly (e.g., through star ratings) or implicitly (e.g., through views or purchas…

2013-11-07abs ↗pdf ↗

We study the sample-based k-median clustering objective under a sequential setting without substitutions. In this setting, an i.i.d. sequence of examples is observed. An example can be selected as a center only immediately after it is observed, and it cannot be substituted later. The goal is to select a set of centers …

2019-05-30abs ↗pdf ↗

Algorithm compresses large matrices by approximating them as low rank and low precision factors.

problem Efficiently storing and processing large matrices with billions of elements.
method Randomized sketching and quantization of matrix columns to achieve low rank and low precision factorization.
result Achieves compression ratios as low as one bit per matrix coordinate while maintaining or improving performance.