Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

8.3%16.7%25.0%33.3% · Jan 199319922001200920172026
48 results for optimization-based estimators

Paper proposes a matrix optimization model for reliable Euclidean embedding from noisy data.

problem Challenges in Euclidean embedding from noisy observations containing outliers.
method Matrix optimization based embedding model to detect and remove outliers.
result The model provides high accuracy estimators and successfully identifies outliers.

The main challenge for adaptive regulation of linear-quadratic systems is the trade-off between identification and control. An adaptive policy needs to address both the estimation of unknown dynamics parameters (exploration), as well as the regulation of the underlying system (exploitation). To this end, optimism-based…

2017-11-20abs ↗pdf ↗

Paper proposes a novel optimization method for disaggregating smart meter data.

problem Energy disaggregation, inferring appliance-specific energy consumption from aggregate meter data.
method Two-stage optimization approach: first phase uses mixed integer programming, second phase binary quadratic optimization with penalty terms and appliance constraints.
result Proposed method successfully reconstructs appliance signatures, overcoming previous optimization-based methods' limitations.

A novel optimization-based Gaussian mixture reduction method using composite transportation divergence.

problem Exponential increase in Gaussian mixture order leads to intractable inference.
method Optimization-based Gaussian mixture reduction (GMR) using composite transportation divergence (CTD).
result Unified framework for selecting optimal cost function in various applications.

We develop methods to approximate derivatives for causal inference problems using data.

problem Estimating causal effects from data when distributions are not known.
method Constructive algorithm approximating Gateaux derivatives via finite differencing.
result Derives conditions for finite-difference approximations to preserve statistical benefits.

New methods tackle complex inverse problems with scalable optimization-based MCMC.

problem Estimating high-dimensional model parameters and hyperparameters in nonlinear hierarchical statistical inverse problems.
method Optimization-based Markov chain Monte Carlo (MCMC) methods using RTO and pseudo-marginal MCMC.
result Efficient sampling tools for hierarchical Bayesian inversion with robust performance to model parameter dimensions.

Optimization-based pruning eliminates backpropagation for large language models.

problem Suboptimal pruning performance due to heuristic metrics.
method Optimization of Bernoulli distribution to learn pruning masks without backpropagation.
result Efficient pruning of large language models with improved performance.

We propose a new framework for designing estimators for off-policy evaluation in contextual bandits. Our approach is based on the asymptotically optimal doubly robust estimator, but we shrink the importance weights to minimize a bound on the mean squared error, which results in a better bias-variance tradeoff in finite…

2019-07-22abs ↗pdf ↗

We study an optimization-based approach to con- struct a mean-reverting portfolio of assets. Our objectives are threefold: (1) design a portfolio that is well-represented by an Ornstein-Uhlenbeck process with parameters estimated by maximum likelihood, (2) select portfolios with desirable characteristics of high mean r…

2018-03-17abs ↗pdf ↗

We propose a method called ideal regression for approximating an arbitrary system of polynomial equations by a system of a particular type. Using techniques from approximate computational algebraic geometry, we show how we can solve ideal regression directly without resorting to numerical optimization. Ideal regression…

2011-10-20abs ↗pdf ↗

A new framework reduces RL sample complexity for complex MDPs.

problem Handling large state and action spaces in reinforcement learning.
method Unified model-based and model-free RL framework with ABC class, novel estimation function, and functional eluder dimension.
result OPERA algorithm achieves sample-efficient regret bounds for various MDP models.

Expectile regression is a nice tool for investigating conditional distributions beyond the conditional mean. It is well-known that expectiles can be described with the help of the asymmetric least square loss function, and this link makes it possible to estimate expectiles in a non-parametric framework by a support vec…

2015-07-14abs ↗pdf ↗

Bayesian uncertainty quantification is flawed, according to new research.

problem Flawed interpretation of Bayesian uncertainty quantification.
method Discussion of Bayesian updating and optimization-based perspective, proposing measures of quality.
result Bayesian uncertainty quantification is not coherent with optimization-based perspective.

In this paper, we propose three approaches for the estimation of the Tucker decomposition of multi-way arrays (tensors) from partial observations. All approaches are formulated as convex minimization problems. Therefore, the minimum is guaranteed to be unique. The proposed approaches can automatically estimate the numb…

2010-10-05abs ↗pdf ↗

This work introduces a new loss function to improve the efficiency of optimization-based PDE solvers.

problem Optimization-based PDE solvers converge slowly and are inefficient compared to classical iterative solvers.
method Proposes a novel Stabilized Gradient Residual (SGR) loss function to modulate the condition number.
result The SGR loss achieves orders-of-magnitude faster convergence than the MSE loss in both ODIL and PINNs frameworks.

Study on selecting between base algorithms in stochastic bandit problems.

problem Model selection in stochastic environments with contextual information.
method Developed a meta-algorithm-base algorithm abstraction with a smoothing transformation for optimal O(T)O(\sqrt{T}) guarantees.
result Optimal O(T)O(\sqrt{T}) model selection guarantees for stochastic contextual bandit problems.

The paper studies scaling laws for associative memory mechanisms.

problem Understanding and optimizing learning and memorization processes.
method High-dimensional matrices of outer products of embeddings, relating to transformer models. Derived scaling laws with sample and parameter sizes. Extensive numerical experiments.
result Precise scaling laws and statistical efficiency of estimators.

We consider a distributed learning setup where a sparse signal is estimated over a network. Our main interest is to save communication resource for information exchange over the network and reduce processing time. Each node of the network uses a convex optimization based algorithm that provides a locally optimum soluti…

2018-03-31abs ↗pdf ↗

CICME estimates common and domain-specific causal mechanisms from multi-sensor data.

problem Inferring causal mechanisms from heterogeneous multi-sensor data across multiple domains.
method Three-step approach using Causal Transfer Learning (CTL).
result CICME reliably detects domain-invariant causal mechanisms and guides individual domain causal mechanism estimation.

We consider off-policy evaluation and optimization with continuous action spaces. We focus on observational data where the data collection policy is unknown and needs to be estimated. We take a semi-parametric approach where the value function takes a known parametric form in the treatment, but we are agnostic on how i…

2019-05-24abs ↗pdf ↗

OPAA estimates probability densities using functional analysis.

problem Estimating probability density functions efficiently and accurately.
method OPAA uses a parallelizable algorithm based on functional analysis to estimate probability distributions.
result OPAA provides an efficient method to estimate probability density functions and normalizing weights.

Inference models are a key component in scaling variational inference to deep latent variable models, most notably as encoder networks in variational auto-encoders (VAEs). By replacing conventional optimization-based inference with a learned model, inference is amortized over data examples and therefore more computatio…

2018-07-24abs ↗pdf ↗

Paper tackles heavy-tailed data without finite variance, proposing robust risk minimization.

problem Empirical risk minimization under heavy-tailed data with finite pp-th moment.
method Minimizes risk values robustly estimated via Catoni's method, using generalized generic chaining.
result Shows better performance of optimizer based on empirical risks via Catoni-style estimation.

We propose a geometric algorithm for topic learning and inference that is built on the convex geometry of topics arising from the Latent Dirichlet Allocation (LDA) model and its nonparametric extensions. To this end we study the optimization of a geometric loss function, which is a surrogate to the LDA's likelihood. Ou…

2016-10-27abs ↗pdf ↗

This paper describes a new method of bond portfolio optimization based on stochastic string models of correlation structure in bond returns. The paper shows how to approximate correlation function of bond returns, compute the optimal portfolio allocation using Wiener-Hopf factorization, and check whether a collection o…

2002-08-17abs ↗pdf ↗

Generative approach speeds hyperparameter tuning for machine learning models.

problem Computational infeasibility of cross-validation and difficulty of fully Bayesian hyper-parameter learning.
method Combines optimization-based approximations and amortization techniques.
result Rapid evaluation of hyper-parameters over grids or ranges, supporting predictive tuning and uncertainty quantification.

The recently proposed SPARse Factor Analysis (SPARFA) framework for personalized learning performs factor analysis on ordinal or binary-valued (e.g., correct/incorrect) graded learner responses to questions. The underlying factors are termed "concepts" (or knowledge components) and are used for learning analytics (LA),…

2014-12-18abs ↗pdf ↗

The paper develops fair machine learning models using causal path-specific effects.

problem Fairness in machine learning models under causal constraints.
method Lagrange multiplier approach for infinite-dimensional functional estimation, closed-form solutions for constrained optimization.
result Theoretical and flexible semiparametric estimation strategies for fair predictions.

Proposes a new method for better explaining neural network decisions.

problem Challenges in explaining neural network decisions due to base-point choice.
method Introduces tangentially aligned integrated gradients to maximize explanation tangential alignment.
result Optimal base-point maximizes explanation tangential alignment, leading to more accurate interpretations.

We propose a family of relaxations of the optimal transport problem which regularize the problem by introducing an additional minimization step over a small region around one of the underlying transporting measures. The type of regularization that we obtain is related to smoothing techniques studied in the optimization…

2019-06-07abs ↗pdf ↗