Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

60120180240 · May 202619922001200920172026
48 results for threshold dimension

Polynomial neural networks explore thresholds for maximum expressiveness.

problem Understanding the limits of polynomial neural networks' expressiveness.
method Introducing activation degree threshold to measure network expressiveness and proving its existence and upper bounds.
result Polynomial neural networks with equi-width architectures achieve the maximum expressiveness.

This study optimizes multi-modal learning thresholds and algorithms in high dimensions.

problem Optimizing multi-modal learning performance in high-dimensional data.
method Analytical quantification and derivation of AMP algorithm with state evolution analysis.
result Bayes-optimal performance and recovery thresholds derived for multi-modal data.

We consider the problem of clustering a set of high-dimensional data points into sets of low-dimensional linear subspaces. The number of subspaces, their dimensions, and their orientations are unknown. We propose a simple and low-complexity clustering algorithm based on thresholding the correlations between the data po…

2013-03-15abs ↗pdf ↗

Improved Sparse Polyak for high-dimensional M-estimation with sparser solutions.

problem High-dimensional M-estimation problems with potential loss of sparsity and accuracy.
method Variant of Sparse Polyak with optimal thresholding operators.
result Retains desirable scaling properties while achieving sparser and more accurate solutions.

The study explores the compressive power of Boolean threshold autoencoders, finding that seven layers are necessary but three are not.

problem Understanding the compressive limits of Boolean threshold autoencoders.
method Investigation into the minimum number of layers and nodes required for autoencoders to accurately transform binary vectors.
result There exists a seven-layer autoencoder with a logarithmic middle layer size for any set of distinct vectors, but not a three-layer one.

The paper characterizes spin initial data sets saturating the BPS bound in asymptotically AdS spacetimes.

problem Characterizing spin initial data sets saturating the BPS bound in asymptotically AdS spacetimes.
method The paper introduces a theorem for replacing imaginary Killing spinors with strictly timelike or null ones and uses spinors to construct a codimension-2 slicing.
result The paper establishes a sharp dimension threshold for saturating the BPS bound in gravitational waves and rotating black holes in higher dimensions.

Fewer degrees of freedom can train deep networks, showing a sharp phase transition.

problem Training deep networks with fewer degrees of freedom than parameters.
method Examined success probability of hitting training loss sub-level sets within random subspaces.
result Threshold training dimension increases as desired final loss decreases.

Proves finitely generated associated graded rings for valuations on log Fano pairs.

problem Stability thresholds of log Fano pairs.
method Proves finite generation of associated graded rings for valuations.
result Log Fano pairs are uniformly K-stable if their stability threshold is less than a certain value.

New method corrects Laplace/BIC errors in singular models, revealing effective dimension.

problem Laplace/BIC errors in singular models due to incorrect effective dimension assumption.
method RLCT (real log canonical threshold) to correct effective dimension in linear models.
result Correct evidence slope and effective dimension estimation in linear settings.

A fast method estimates Gaussian mixture components without iterative fitting.

problem Estimating the number of components in high-dimensional Gaussian mixtures.
method Center data, compute singular values, and count above a threshold.
result The estimator consistently recovers the true number of components under mild separation condition.

Let MM be a compact, unit volume, Riemannian manifold with boundary. In this paper we study the homology of a random Čech-complex generated by a homogeneous Poisson process in MM. Our main results are two asymptotic threshold formulas, an upper threshold above which the Čech complex recovers the kk-th homology of $M…

2019-06-18abs ↗pdf ↗

Characterizes optimal reconstruction error in high-dimensional Gaussian mixtures.

problem Optimizing reconstruction error in high-dimensional sparse Gaussian mixtures.
method Exact asymptotic characterization using state evolution of AMP algorithm.
result Identification of statistical-to-computational gap between AMP and information-theoretic threshold.

Monotone neural networks can approximate and interpolate functions efficiently.

problem Understanding the efficiency and expressiveness of monotone neural networks.
method Solving the monotone interpolation problem using depth-4 networks and comparing size bounds with arbitrary networks.
result Monotone neural networks can approximate and interpolate functions efficiently, but may require exponential size in high dimensions.

The paper extends risk measures to two-step approximations and studies log-concave distributions.

problem Extending classical risk measures to two-step approximations.
method Optimization problem for determining optimal regime thresholds and values for log-concave distributions.
result Conditions for the uniqueness of regime changing in log-concave distributions.

Recently, a novel family of biologically plausible online algorithms for reducing the dimensionality of streaming data has been derived from the similarity matching principle. In these algorithms, the number of output dimensions can be determined adaptively by thresholding the singular values of the input data matrix. …

2016-12-11abs ↗pdf ↗

We show that every approximately differentially private learning algorithm (possibly improper) for a class HH with Littlestone dimension~dd requires Ω(log(d))Ω\bigl(\log^*(d)\bigr) examples. As a corollary it follows that the class of thresholds over N\mathbb{N} can not be learned in a private manner; this resolves open qu…

2018-06-04abs ↗pdf ↗

We consider the problem of clustering noisy high-dimensional data points into a union of low-dimensional subspaces and a set of outliers. The number of subspaces, their dimensions, and their orientations are unknown. A probabilistic performance analysis of the thresholding-based subspace clustering (TSC) algorithm intr…

2013-05-15abs ↗pdf ↗

We study graph matching with correlated Gaussian features and find thresholds for exact recovery.

problem Graph matching with correlated Gaussian features.
method Information-theoretic thresholds and conditions for exact and almost exact recovery.
result Contextual information introduces a richer structure, with thresholds for exact and almost exact recovery no longer coinciding.

In this paper we show that the computational complexity of the Iterative Thresholding and K-residual-Means (ITKrM) algorithm for dictionary learning can be significantly reduced by using dimensionality-reduction techniques based on the Johnson-Lindenstrauss lemma. The dimensionality reduction is efficiently carried out…

2018-05-02abs ↗pdf ↗

We improve deep threshold networks' memorization capacity exponentially.

problem Memorizing datasets with randomized labels using deep neural networks.
method Using Gaussian random weights in the first layer and binary or integer weights in subsequent layers, we prove a new dependence on minimum distance.
result We show that O~(1δ+n)\widetilde{\mathcal{O}}(\frac{1}{\delta} + \sqrt{n}) neurons and O~(dδ+n)\widetilde{\mathcal{O}}(\frac{d}{\delta} + n) weights are sufficient.

Study extends learnability equivalence to multi-class and regression, overcoming binary classification limits.

problem Equivalence of online and private learnability in multi-class and regression settings.
method Introduced a novel Littlestone dimension variant and threshold functions for multi-class classification.
result Online learnability implies private learnability in multi-class classification but not in regression.

Sharp threshold found for metric uniqueness in Riemannian Calderón-type problems.

problem Determining metrics uniquely from Dirichlet-to-Neumann maps in Riemannian Schrödinger problems.
method Adaptation of Lassas-Uhlmann reconstruction theorem and novel Gevrey space techniques.
result Analytic metrics uniquely determine the metric up to boundary-preserving diffeomorphisms, but non-analytic metrics are not uniquely determined.

High-dimensional sparse modeling via regularization provides a powerful tool for analyzing large-scale data sets and obtaining meaningful, interpretable models. The use of nonconvex penalty functions shows advantage in selecting important features in high dimensions, but the global optimality of such methods still dema…

2016-05-11abs ↗pdf ↗

Sparse GCA finds linear relationships in multiple datasets, using gradient descent.

problem Finding linear relationships across multiple datasets with sparse loading vectors.
method Formulated as generalized eigenvalue problems, used a thresholded gradient descent algorithm.
result Proposed algorithm yields tight estimation error bounds and demonstrates effectiveness on synthetic datasets.

Optimal algorithm for high-dimensional stochastic linear bandits with sparse parameters.

problem High-dimensional stochastic linear bandits with sparse parameters.
method Three-stage arm selection algorithm using thresholded Lasso for estimation.
result Achieves exact minimax optimality in cumulative regret.

Deep Gaussian processes can have non-degenerate and non-Gaussian limits.

problem Understanding the behavior of deep Gaussian processes as depth grows.
method Studying the limit of compositional Gaussian processes where each layer is a Gaussian process.
result Identified a sharp bandwidth threshold above which the limit is degenerate, and proved that for bandwidths below this threshold, the limit is a non-degenerate and non-Gaussian distribution.

New algorithm robustly estimates sparse models in high dimensions with corrupted data.

problem Estimating latent variable models with arbitrarily corrupted samples in high dimensional space.
method Trimmed (Gradient) Expectation Maximization with trimming gradients and hard thresholding steps.
result The algorithm converges to near optimal statistical rate geometrically under certain conditions.

The problem of clustering noisy and incompletely observed high-dimensional data points into a union of low-dimensional subspaces and a set of outliers is considered. The number of subspaces, their dimensions, and their orientations are assumed unknown. We propose a simple low-complexity subspace clustering algorithm, w…

2013-07-18abs ↗pdf ↗

This paper explains a mechanism called phase collapse that improves image classification accuracy.

problem Understanding the role of non-linearities and convolutional filters in image classification.
method Demonstrates phase collapse as a mechanism that eliminates spatial variability and linearly separates classes.
result Phase collapse improves classification accuracy, while thresholding operators degrade performance.

Study on hemisphere threshold for Escobar functional on Riemannian manifolds, revealing mass and boundary invariant behaviors.

problem Analyzing the hemisphere threshold for the Escobar functional on compact Riemannian manifolds.
method Near-threshold landscape organization by boundary invariants, exact evaluation of weighted profile moments, Lyapunov-Schmidt correction, and blow-up analysis.
result At threshold, blow-ups concentrate at umbilic points with vanishing mass and gradient, leading to compactness and hemispherical rigidity.

Study of Langevin dynamics for tensor PCA recovery in high dimensions.

problem Recovering hidden signal vectors (spikes) from noisy Gaussian tensor observations.
method Langevin dynamics approach for nonconvex optimization.
result Sample complexity matches the single-spike case but degrades for all spikes.