We consider a proximal operator given by a quadratic function subject to bound constraints and give an optimization algorithm using the alternating direction method of multipliers (ADMM). The algorithm is particularly efficient to solve a collection of proximal operators that share the same quadratic form, or if the qu…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “quadratic algorithm”
Constrained second-order convex optimization algorithms are the method of choice when a high accuracy solution to a problem is needed, due to their local quadratic convergence. These algorithms require the solution of a constrained quadratic subproblem at every iteration. We present the \emph{Second-Order Conditional G…
Improved SVRG for quadratic functions achieves better performance and running times.
problem Minimizing quadratic functions with a specific type of Hessian matrix.
method Variant of SVRG algorithm for quadratic functions with improved analysis.
result Improved performance and running times for quadratic functions compared to state-of-the-art methods.
Quadratic-time algorithm computes stretch factors and foliations for pseudo-Anosov mapping classes.
problem Computing stretch factors and foliations for pseudo-Anosov mapping classes efficiently.
method Quadratic-time algorithm using input word and length as complexity measure.
result First algorithm to compute stretch factors and foliations in sub-exponential time.
Python package for projecting onto quadratic hypersurfaces.
problem Projections onto non-cylindrical central quadratic hypersurfaces.
method User-friendly Python package with documentation.
result Efficiently projects points onto quadratic hypersurfaces.
Gaussian belief propagation (GaBP) is an iterative algorithm for computing the mean of a multivariate Gaussian distribution, or equivalently, the minimum of a multivariate positive definite quadratic function. Sufficient conditions, such as walk-summability, that guarantee the convergence and correctness of GaBP are kn…
Streaming Approach to Quadratic Covariation Estimation Using Financial Ultra-High-Frequency Dataq-fin.CP
A streaming algorithm estimates quadratic covariation from financial data efficiently.
problem Estimating quadratic covariation from ultra-high-frequency financial data with limited memory.
method Formulated multi-scale, realized kernel, pre-averaging, and modulated realized covariance estimators with fixed bandwidth.
result Fixed bandwidth estimators require higher bandwidth for positive semidefiniteness.
Paper proposes a QUBO formulation that reduces binary variables in Bayesian network learning.
problem Reducing the number of binary variables in QUBO formulations for Bayesian network learning.
method Proposes a new QUBO formulation that minimizes binary variables.
result Significantly reduces the number of binary variables required for Bayesian network structure learning.
Study Markov chain gradient descent in Hilbert spaces for quadratic loss.
problem Approximating optimal solutions for quadratic loss functions.
method Developed a Markov chain-based stochastic gradient algorithm in Hilbert spaces.
result Established probabilistic upper bounds on convergence.
Optimizes quadratic bandits with tight Hessian-dependent sample complexity bounds.
problem Understanding optimal sample complexity for quadratic functions.
method Introduces energy allocation and optimal energy spectrum to prove tight lower bounds. Solves for Hessian-independent optimal algorithm.
result Proves optimal Hessian-dependent sample complexities and existence of a universally optimal algorithm.
Faster algorithms for structured SVMs reduce computation time.
problem Efficiently solving quadratic programming problems with specific structures.
method Designing nearly-linear time algorithms for quadratic programs with low-rank factorizations and few linear constraints.
result First nearly-linear time algorithms for solving quadratic programs with specific structures.
OMGD algorithm optimizes online convex optimization with switching costs and delayed gradients.
problem Optimizing online convex optimization with switching costs and delayed gradients.
method Proposed an online multiple gradient descent (OMGD) algorithm for quadratic and linear switching costs.
result OMGD achieves optimal dynamic regret in the limited information setting.
Compress++ speeds up distribution compression to near-linear time.
problem Accurately summarize a probability distribution using a small number of points efficiently.
method Introduces Compress++, a meta-procedure to speed up any thinning algorithm.
result Achieves points with integration error in time and space.
A fast, robust AMP algorithm for quadratic optimization problems.
problem Implementing robust approximate-message passing algorithms for quadratic optimization problems.
method Spectral pre-processing and mild modification of AMP algorithm iterates.
result Output solution close to AMP algorithm output for perturbed inputs.
Quantum algorithm speeds up Lasso regression by quadratically faster per iteration.
problem Efficiently solving high-dimensional linear regression with L1-penalty.
method Pathwise LARS algorithm adapted for quantum computing, using minimum-finding subroutines.
result Quadratic speedup in computation time for both number of features and observations.
Accelerated gradient method's stability deteriorates exponentially with steps.
problem Algorithmic stability of Nesterov's accelerated gradient method.
method Analysis of two notions of algorithmic stability for Nesterov's accelerated gradient method.
result Stability of Nesterov's accelerated method deteriorates exponentially with the number of gradient steps.
Logarithmic regret achieved in continuous-time linear-quadratic reinforcement learning.
problem Optimizing control actions in unknown continuous-time systems over a finite time horizon.
method Least-squares algorithm based on continuous-time observations and controls, with perturbation analysis and parameter estimation error analysis.
result Logarithmic regret bound of order .
The runtime for Kernel Partial Least Squares (KPLS) to compute the fit is quadratic in the number of examples. However, the necessity of obtaining sensitivity measures as degrees of freedom for model selection or confidence intervals for more detailed analysis requires cubic runtime, and thus constitutes a computationa…
The paper proposes a method to select clusters, models, and algorithms based on quadratic discriminant scores.
problem Selecting the number of clusters, models, and algorithms in cluster analysis.
method Develops quadratic scores for cluster quality, uses bootstrap resampling, and compares partitions.
result The proposed method achieves better overall performance compared to other state-of-the-art methods.
In this thesis, we consider semi-algebraic sets over a real closed field defined by quadratic polynomials. Semi-algebraic sets of are defined as the smallest family of sets in that contains the algebraic sets as well as the sets defined by polynomial inequalities, and which is also closed under the bool…
We consider adaptive control of the Linear Quadratic Regulator (LQR), where an unknown linear system is controlled subject to quadratic costs. Leveraging recent developments in the estimation of linear systems and in robust controller synthesis, we present the first provably polynomial time algorithm that provides high…
Proposes sparse QSVM for better generalization and interpretability.
problem Overfitting and difficulty in interpreting full quadratic classifiers.
method Enforces -norm constraint to promote sparsity and develops a penalty decomposition algorithm.
result The proposed model enhances generalization and produces sparse solutions.
New algorithms improve blind source separation for linear-quadratic mixtures.
problem Blind source separation of linear-quadratic mixtures under separability assumptions.
method Proposed two algorithms: SNPALQ and BF. SNPALQ generalizes SNPA for LQ model, BF post-processes SNPALQ.
result Proven robustness and computational tractability of SNPALQ in separating sources even with noise.
We present the first computationally-efficient algorithm with regret for learning in Linear Quadratic Control systems with unknown dynamics. By that, we resolve an open question of Abbasi-Yadkori and Szepesvári (2011) and Dean, Mania, Matni, Recht, and Tu (2018).
Optimal algorithm for LQR control with improved regret bound.
problem Nonstochastic control with quadratic losses (LQR control).
method Online algorithm with optimal dynamic regret of .
result Improves the best known rate of for general convex losses.
New algorithm learns LQR with regret using Langevin dynamics and excitation.
problem Learning LQR with a regret bound.
method Thompson sampling with Langevin dynamics and excitation mechanism.
result Achieved regret bound for LQR learning.
Novel approximation hierarchy for sparse quadratic programs.
problem Sparse Quadratic Programs with Cardinality Constraints.
method Exploits rank-dominating eigenvectors for min-max optimization over binary variables.
result Efficient screening of nonzero elements with scalable optimization algorithms.
Motivated by electricity consumption metering, we extend existing nonnegative matrix factorization (NMF) algorithms to use linear measurements as observations, instead of matrix entries. The objective is to estimate multiple time series at a fine temporal scale from temporal aggregates measured on each individual serie…
Quantum computing offers a quadratic speedup for estimating non-linear functionals.
problem Estimating non-linear functionals of probability distributions.
method Proposes a quantum-inside-quantum Monte Carlo algorithm for a broad class of non-linear estimation problems.
result Achieves a quadratic speedup for non-linear estimation problems, including nested conditional expectations and stochastic optimization.
A new algorithm solves constrained optimization problems with stochastic gradients.
problem Nonlinear equality constrained optimization with rank-deficient Jacobians.
method Step decomposition strategy combining normal and tangential steps.
result Convergence guarantees in rank-deficient Jacobian cases.
We propose a novel end-to-end non-minimax algorithm for training optimal transport mappings for the quadratic cost (Wasserstein-2 distance). The algorithm uses input convex neural networks and a cycle-consistency regularization to approximate Wasserstein-2 distance. In contrast to popular entropic and quadratic regular…
New model-free algorithm achieves similar LQR regret guarantees.
problem Model-free control of linear dynamical systems under quadratic costs.
method Online policy gradient scheme with policy space cost analysis.
result Achieves regret scaling with √T, matching model-based methods.
New algorithm reduces runtime for robust sparse mean estimation.
problem Efficiently estimating mean from corrupted data with sparse constraints.
method Subquadratic time algorithm using poly(k, log d, 1/ε) samples.
result First subquadratic time algorithm for robust sparse mean estimation.
Q-SHAP efficiently calculates feature contributions in boosting trees.
problem Global evaluation of feature contributions in tree models.
method Q-SHAP, an efficient algorithm that reduces Shapley values calculation to polynomial time.
result Q-SHAP improves computational efficiency and enhances accuracy of feature-specific estimates.
A Unified Analysis of First-Order Methods for Smooth Games via Integral Quadratic Constraintsmath.OC
Unified analysis of first-order methods for smooth games using IQCs.
problem Certify convergence rates of first-order methods for smooth and strongly-monotone games.
method Adapted integral quadratic constraints (IQCs) to study first-order methods and derive tight upper bounds of convergence rates.
result First global convergence rate for the negative momentum method with iteration complexity.
We consider support recovery in the quadratic logistic regression setting - where the target depends on both p linear terms and up to quadratic terms . Quadratic terms enable prediction/modeling of higher-order effects between features and the target, but when incorporated naively may involve solvi…
We propose a DC proximal Newton algorithm for solving nonconvex regularized sparse learning problems in high dimensions. Our proposed algorithm integrates the proximal Newton algorithm with multi-stage convex relaxation based on the difference of convex (DC) programming, and enjoys both strong computational and statist…
This paper is concerned with the determination of credit risk premia of defaultable contingent claims by means of indifference valuation principles. Assuming exponential utility preferences we derive representations of indifference premia of credit risk in terms of solutions of Backward Stochastic Differential Equation…
Efficiently solves exploration-exploitation in LQR using Lagrangian relaxation.
problem Exploration-exploitation dilemma in linear quadratic regulator (LQR) setting.
method Relax optimistic optimization into a constrained extended LQR problem, then solve using Riccati equations.
result Computes -optimistic controller efficiently with Riccati equations.
We study the problem of controlling linear time-invariant systems with known noisy dynamics and adversarially chosen quadratic losses. We present the first efficient online learning algorithms in this setting that guarantee regret under mild assumptions, where is the time horizon. Our algorithms rely …
We give the first algorithm for Matrix Completion whose running time and sample complexity is polynomial in the rank of the unknown target matrix, linear in the dimension of the matrix, and logarithmic in the condition number of the matrix. To the best of our knowledge, all previous algorithms either incurred a quadrat…
Quadratic regression involves modeling the response as a (generalized) linear function of not only the features but also of quadratic terms . The inclusion of such higher-order "interaction terms" in regression often provides an easy way to increase accuracy in already-high-dimensional problem…
This paper introduces a method to incorporate risk sensitivity in RL using quadratic variation penalties.
problem Risk-sensitive reinforcement learning under entropy regularization.
method Equivalent martingale property and quadratic variation penalty for value process.
result The proposed method improves finite-sample performance in linear-quadratic control problems.
Study on PG learning for LQ MFC problems with common noise, proving convergence and sample complexity.
problem Optimal policy learning in LQ MFC problems with common noise and entropy regularization.
method Comprehensive error analysis of PG algorithms in both model-based and model-free settings.
result Global linear convergence and sample complexity of PG algorithms in model-free setting.
We show that all groups in a very large class of Coxeter groups are locally quasiconvex and have uniform membership problem solvable in quadratic time. If a group in the class satisfies a further hypothesis it is subgroup separable and relevant homomorphisms are also calculable in quadratic time. The algorithm also dec…
We show that the gradient descent algorithm provides an implicit regularization effect in the learning of over-parameterized matrix factorization models and one-hidden-layer neural networks with quadratic activations. Concretely, we show that given random linear measurements of a rank positive s…
Efficient Learning of Quadratic Variance Function Directed Acyclic Graphs via Topological Layersstat.ML
Paper learns DAGs with quadratic variance functions efficiently.
problem Learning DAGs with quadratic variance functions.
method Introduces topological layers to reconstruct DAGs hierarchically.
result Efficient algorithm reduces computational cost.
New algorithm reconstructs sparse networks in subquadratic time.
problem Reconstructing sparse networks from limited data.
method Stochastic second neighbor search to bypass quadratic complexity.
result Subquadratic time complexity, up to .