Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

2885778651,153 · Jun 202019922001200920172026
48 results for non-smooth tensor data

New method tackles non-smooth tensor data for better recovery.

problem Non-smooth changes in tensor data degrade traditional t-SVD methods.
method Learnable tensor nuclear norm, Alternating Proximal Multiplier Method (APMM), multi-objective tensor recovery framework.
result The proposed method effectively recovers tensor data with non-smooth changes.

A new algorithm improves both computational efficiency and statistical optimality for robust low-rank matrix and tensor estimation.

problem Challenges in low-rank matrix estimation under heavy-tailed noise, both computationally and statistically.
method Riemannian sub-gradient (RsGrad) algorithm, which is computationally efficient and statistically optimal.
result RsGrad achieves linear convergence and statistical optimality for robust loss functions under Gaussian and heavy-tailed noise.

We present a windowed technique to learn parsimonious time-varying autoregressive models from multivariate timeseries. This unsupervised method uncovers interpretable spatiotemporal structure in data via non-smooth and non-convex optimization. In each time window, we assume the data follow a linear model parameterized …

2019-05-21abs ↗pdf ↗

Study proves solenoidal injectivity for tensor fields on curved manifolds with low regularity.

problem Injectivity for tensor fields on negatively curved manifolds with low regularity metrics.
method Pestov energy estimates for transport equation on non-smooth unit sphere bundle, keeping track of regularity, and using functions with more vertical than horizontal regularity.
result Proves solenoidal injectivity for tensor fields on simple Riemannian manifolds with C1,1C^{1,1} metrics and non-positive sectional curvature.

We propose inertial versions of block coordinate descent methods for solving non-convex non-smooth composite optimization problems. Our methods possess three main advantages compared to current state-of-the-art accelerated first-order methods: (1) they allow using two different extrapolation points to evaluate the grad…

2019-03-05abs ↗pdf ↗

Smoothness analysis of adversarial training reveals LL_\infty constraints cause more non-smoothness.

problem Non-smoothness of adversarial training loss function.
method Analyzed the smoothness of adversarial training loss function using optimal attacks for model parameters.
result The LL_\infty constraint causes more non-smoothness than L2L_2 constraint.

On a Riemannian manifold with a positive lower bound on the Ricci tensor, the distance of isoperimetric sets from geodesic balls is quantitatively controlled in terms of the gap between the isoperimetric profile of the manifold and that of a round sphere of suitable radius. The deficit between the diameters of the mani…

2017-07-13abs ↗pdf ↗

MARINA-P improves non-smooth federated optimization with adaptive stepsizes.

problem Non-smooth federated optimization in machine learning applications.
method Extends EF21-P and MARINA-P to non-smooth convex setting, proving optimal convergence rate and communication complexity bounds.
result MARINA-P achieves O(1/T)O(1/\sqrt{T}) convergence rate and communication complexity matching classical subgradient methods.

New methods improve convergence in non-convex non-smooth learning problems.

problem Sparse learning from high-dimensional data with non-convex, non-smooth regularizers.
method Stochastic proximal gradient methods with arbitrary sampling.
result Independent sampling improves performance over uniform sampling.

We introduce non-smooth symplectic forms on manifolds and describe corresponding Poisson structures on the algebra of Colombeau generalized functions. This is achieved by establishing an extension of the classical map of smooth functions to Hamiltonian vector fields to the setting of non-smooth geometry. For mildly sin…

2014-03-02abs ↗pdf ↗

The paper explores various stationarity concepts in non-smooth optimization.

problem Understanding stationarity in non-smooth optimization problems.
method Introduction and discussion of different stationarity concepts for non-convex non-smooth functions.
result Clarification of the relationship among different stationarity concepts and their relevance in iterative methods.

New bounds explain deterministic non-smooth deep nets without large Lipschitz constants.

problem Challenges in explaining generalization of deterministic non-smooth deep nets.
method De-randomized PAC-Bayes margin bounds for deterministic non-convex and non-smooth predictors.
result New bounds avoid large Lipschitz constants, providing generalization guarantees.

In the framework of Lorentzian warped products, we study the Friedmann-Robertson-Walker cosmological model to investigate non-smooth curvatures associated with multiple discontinuities involved in the evolution of the universe. In particular we analyze non-smooth features of the spatially flat Friedmann-Robertson-Walke…

2003-08-16abs ↗pdf ↗

This work speeds up hyperparameter selection for non-smooth convex models using implicit differentiation.

problem Optimizing hyperparameters of non-smooth convex models.
method Implicit differentiation of proximal gradient and coordinate descent methods.
result Implicit differentiation can speed up hyperparameter optimization, especially for non-smooth problems.

FedProx algorithm improved for non-smooth and heterogeneous data.

problem Theoretical understanding of FedProx for non-convex federated optimization.
method Local dissimilarity invariant convergence theory through algorithmic stability.
result Convergence guarantees for non-smooth FL problems and minibatch size.

Positive mass theorem for non-smooth metrics on flat manifolds with corners.

problem Proving a positive mass theorem for non-smooth metrics on asymptotically flat manifolds with non-compact boundary.
method Proves a positive mass theorem for metrics that are only continuous across a compact hypersurface.
result Obtains a positive mass theorem on manifolds with non-compact corners.

Efficient algorithms for large Maxent models improve wildfire probability predictions.

problem Training large-scale, non-smooth Maxent models efficiently for big data.
method First-order optimization algorithms using Kullback-Leibler divergence.
result Our algorithms outperform state-of-the-art methods by one order of magnitude.

The Positive Mass Theorem implies that any smooth, complete, asymptotically flat 3-manifold with non-negative scalar curvature which has zero total mass is isometric to (R^3, delta_{ij}). In this paper, we quantify this statement using spinors and prove that if a complete, asymptotically flat manifold with non-negative…

1999-06-08abs ↗pdf ↗

Paper improves learning efficiency by focusing on effective dimensionality.

problem Dimensionality bottleneck in modern learning tasks.
method Developed tools to reduce dimensional costs using effective dimensionality.
result Uniform concentration bounds involving effective dimensionality, improving over existing results.

Advances smooth over-parameterization for solving non-smooth optimization problems.

problem Non-smooth optimization with structural constraints in imaging and machine learning.
method Smooth over-parameterization of non-smooth problems, using gradient descent and mirror descent.
result Gradient descent on the reformulated smooth problem converges efficiently without parameter tuning.

Consistency models accelerate generation with theoretical guarantees.

problem Empirical success of consistency models without theoretical justification.
method Theoretical analysis of consistency models mapping inputs to arbitrary points.
result Achieve KL divergence of order O(ε2) O(\varepsilon^2) with $ O\left(\log\left(\frac{d}{\varepsilon} ight) ight) $ iterations.

Smooth bundles with rough data maintain Hodge kernel isomorphism.

problem Maintaining Hodge kernel isomorphism for smooth bundles with non-smooth geometric data.
method Analyzing nilpotent differential operators and Hodge-Dirac-type operators under perturbations of geometric data.
result Kernels of Hodge-Dirac operators remain isomorphic under uniform perturbations of geometric data.

New SPS variant improves non-smooth optimization without small gradients.

problem Improving non-smooth optimization without small gradients.
method Safeguarded Stochastic Polyak Step Size (SPSsafe_{safe}) for non-smooth optimization.
result Rigorous convergence guarantees for non-smooth convex optimization without strong assumptions.

Adaptive NN method improves matrix completion for non-smooth data.

problem Matrix completion with non-smooth non-linear functions under high missingness.
method Two-sided nearest neighbors with \Holder function class non-linearity.
result NN error rate matches oracle's for latent factors, non-trivial for wide range of missingness.

New bounds for online portfolio selection without smoothness assumptions.

problem Online portfolio selection with non-Lipschitz, non-smooth losses.
method Data-dependent bounds using novel smoothness characterizations and FTRL with self-concordant regularizers.
result Achieves logarithmic regrets when data is 'easy' and sublinear worst-case regrets.

Stochastic approximation proves asymptotic normality for non-smooth problems.

problem Solving non-smooth stochastic approximation problems.
method Stochastic approximation algorithms for solving smooth equations, extended to non-smooth problems.
result Asymptotic normality and optimality in non-smooth stochastic approximation is proven.

We provide improved convergence rates for various \emph{non-smooth} optimization problems via higher-order accelerated methods. In the case of \ell_\infty regression, we achieves an O(ε4/5)O(ε^{-4/5}) iteration complexity, breaking the O(ε1)O(ε^{-1}) barrier so far present for previous methods. We arrive at a similar rate fo…

2019-06-04abs ↗pdf ↗

Safe-EF improves federated learning for non-smooth, constrained optimization.

problem Federated learning's communication bottlenecks with high-dimensional model updates.
method Error feedback (EF) for non-smooth convex optimization with safety constraints.
result Safe-EF matches lower complexity bounds and ensures safety constraints.

We theoretically discuss why deep neural networks (DNNs) performs better than other models in some cases by investigating statistical properties of DNNs for non-smooth functions. While DNNs have empirically shown higher performance than other standard methods, understanding its mechanism is still a challenging problem.…

2018-02-13abs ↗pdf ↗

Improved model for non-smooth signals with complex spectra.

problem Current models struggle with non-smooth signals and complex spectral structures.
method CGPCM and RGPCM models with causality and Bayesian nonparametric interpretations, improved variational inference.
result Proposed models show better performance on synthetic and real-world data.

Modified perturbation method removes non-smoothness in solving Black-Scholes equations.

problem Non-smoothness in solving Black-Scholes equations.
method Variable transformations and homotopy perturbation method.
result Excellent agreement with exact solutions for Black-Scholes and multi-asset options.

Expanding FCCO to non-smooth weakly-convex problems, improving deep learning performance.

problem Addressing the limitations of current FCCO methods by tackling non-smooth weakly-convex problems.
method Developed a single-loop algorithm for non-smooth weakly-convex FCCO and extended it to tri-level problems.
result Established the complexity for finding ε-stationary points in the Moreau envelop of the objective function.