Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

17345067 · Jun 202019922001200920172026
48 results for complexity-theoretic hardness

Topological quantum computers use hyperbolic knots for computations.

problem The difficulty of calculating quantum invariants of knots.
method Using hyperbolic knots to compute topological quantum computer invariants.
result The hyperbolic geometry of knots is unlikely to be useful for topological quantum computation.

We prove that the evolution of weight vectors in online gradient descent can encode arbitrary polynomial-space computations, even in very simple learning settings. Our results imply that, under weak complexity-theoretic assumptions, it is impossible to reason efficiently about the fine-grained behavior of online gradie…

2018-07-03abs ↗pdf ↗

Efficient tests achieve best error rates in high-dimensional hypothesis testing.

problem Achieving optimal error rates in computationally efficient hypothesis testing.
method Linear spectral statistics and low-degree likelihood ratio analysis.
result An efficient test achieves the best possible error rates among all computationally efficient tests.

In the context of sparse principal component detection, we bring evidence towards the existence of a statistical price to pay for computational efficiency. We measure the performance of a test by the smallest signal strength that it can detect and we propose a computationally efficient method based on semidefinite prog…

2013-04-03abs ↗pdf ↗

Fix a finite group GG. We analyze the computational complexity of the problem of counting homomorphisms π1(X)Gπ_1(X) \to G, where XX is a topological space treated as computational input. We are especially interested in requiring GG to be a fixed, finite, nonabelian, simple group. We then consider two cases: when the in…

2018-05-23abs ↗pdf ↗

Proving that next-token prediction makes language models generate coherent long documents.

problem Understanding why language models generate coherent documents despite focusing on next-token prediction.
method Proving the power of next-token prediction in learning longer-range structure using Recurrent Neural Networks (RNN).
result Optimizing next-token prediction in RNNs yields a model that closely approximates the training distribution, even for long-range coherence.

Study shows memory needs grow with task sequence length in continual learning.

problem Challenges in retaining aptitude for multiple learning tasks sequentially.
method Complexity-theoretic study using communication complexity and multiplicative weights update.
result Memory needs grow linearly with task sequence length, suggesting intractability.

Hard instances, which require a long time for a specific algorithm to solve, help (1) analyze the algorithm for accelerating it and (2) build a good benchmark for evaluating the performance of algorithms. There exist several efforts for automatic generation of hard instances. For example, evolutionary algorithms have b…

2019-02-26abs ↗pdf ↗

Tackles the computational hardness of HPC detection, conjecturing equivalence to PC detection.

problem Computational hardness of hypergraphic planted clique detection.
method No specific method mentioned; focuses on conjecturing equivalence.
result Equivalence of computational hardness between HPC and PC detection.

Theoretical analysis shows pretext-based self-supervised learning can be boosted by downstream data under certain conditions.

problem Theoretical analysis of pretext-based self-supervised learning and downstream data refinement.
method Theoretical analysis and experiments on synthetic and real-world datasets.
result Theoretical lower bounds and experiments show that downstream data refinement can boost or hurt performance depending on conditions.

Study categorizes knots and links as rigid or shaky based on Reidemeister moves.

problem Classifying knots and links as rigid or shaky based on adaptability to Reidemeister moves.
method Categorization of hard diagrams as rigid or shaky, investigation of rigid and shaky hard diagrams for specific knots and links.
result Every link has a rigid hard diagram, and there is an upper limit for the number of crossings in such diagrams.

We describe a method for generating minimal hard prime surface-link diagrams. We extend the known examples of minimal hard prime classical unknot and unlink diagrams up to three components and generate figures of all minimal hard prime surface-unknot and surface-unlink diagrams with prime base surface components up to …

2017-06-28abs ↗pdf ↗

Paper connects free-energy and low-degree hardness in high-dimensional statistics.

problem High-dimensional statistical inference problems are computationally hard.
method Defines a free-energy criterion and connects it to low-degree hardness.
result Establishes connection between free-energy and low-degree hardness for Gaussian models.

This paper proves a generalization bound for complex-valued neural networks scaling with spectral complexity.

problem Ensuring the performance of complex-valued neural networks on unseen data.
method Theoretical derivation using Maurey Sparsification Lemma and Dudley Entropy Integral, empirical validation on various datasets.
result The spectral complexity of weight matrices is a significant factor in the generalization ability of complex-valued neural networks.

The Hard Lefschetz Theorem extends to certain Kähler Lie Algebroids with ellipticity.

problem Extending the Hard Lefschetz Theorem to Kähler Lie Algebroids.
method Analyzing a specific class of Kähler Lie Algebroids with ellipticity requirements.
result A class of Kähler Lie Algebroids satisfy the Hard Lefschetz Theorem with ellipticity.

HardCoRe-NAS finds fitting neural networks adhering to hard resource constraints.

problem Finding fitting neural networks that adhere to hard resource constraints.
method Accurate formulation of resource requirement and scalable search method.
result HardCoRe-NAS generates state-of-the-art architectures strictly satisfying hard resource constraints.

New unsupervised method selects hard negative samples for contrastive learning.

problem How to select good negative examples for contrastive learning without using true similarity information.
method Developed a new family of unsupervised sampling methods for hard negative selection.
result Improves downstream performance across multiple modalities.

DC3 uses deep learning to solve hard-constrained optimization problems efficiently.

problem Hard constraints in optimization problems make classical solvers slow and infeasible.
method DC3 employs a differentiable procedure to enforce feasibility and unrolls corrections for inequality constraints.
result DC3 achieves near-optimal solutions while maintaining feasibility in both synthetic and real-world tasks.

Trading system uses NP-hard optimization to select stocks for high Sharpe ratio trading.

problem Finding profitable, uncorrelated stocks for high Sharpe ratio trading.
method NP-hard combinatorial optimization using Ising machine and simulated bifurcation algorithm.
result Trading strategy with FPGA-based system achieves 164 μs response latency.

Meta-learning strategy improves few-shot classification performance.

problem Few-shot classification with deep neural networks struggles when labeled samples are limited.
method Proposes an easy-to-hard expert meta-training strategy to arrange training tasks based on task hardness.
result Meta-learners achieve better results with the proposed expert training strategy.

The paper proves a generalized Lefschetz duality for a specific type of manifold.

problem Proving the hard Lefschetz duality for a new class of manifolds.
method Generalizing Kähler identities to prove the duality for locally conformally almost Kähler manifolds.
result The hard Lefschetz duality is established for locally conformally almost Kähler manifolds.

Study shows challenges in reinforcement learning math problems, proposing enhancements and a hardness measure.

problem Challenges in reinforcement learning finding rare high-reward instances.
method Combining combinatorial group theory, algorithmic enhancements, and topological hardness measure.
result Resolved mathematical questions and proposed enhancements for reinforcement learning.

Although deep convolutional neural networks achieve state-of-the-art performance across nearly all image classification tasks, their decisions are difficult to interpret. One approach that offers some level of interpretability by design is \textit{hard attention}, which uses only relevant portions of the image. However…

2019-08-20abs ↗pdf ↗

New framework formalizes RLHF trilemma: improving safety, fairness, and robustness is computationally infeasible.

problem Aligning large language models with diverse human values while maintaining computational feasibility and robustness.
method Complexity-theoretic analysis integrating statistical learning theory and robust optimization.
result Achieving both representativeness (epsilon <= 0.01) and robustness (delta <= 0.001) for global-scale populations requires super-polynomial operations.

Paper investigates hardness of learning neural networks under manifold hypothesis.

problem Hardness of learning neural networks under the manifold hypothesis.
method Extending proofs of hardness in the SQ and cryptographic settings to the geometric setting.
result Learning is hard under input manifolds of bounded curvature but learnable with additional assumptions on manifold volume.

New algorithms learn robust policies from shifted distributions.

problem Learning robust policies in environments with distributional shifts.
method Two novel model-free algorithms: distributionally robust Q-learning and variance-reduced distributionally robust Q-learning.
result Achieves minimax sample complexity upper bound of ildeO(SA(1γ)4ε2) ilde O(|\mathbf{S}||\mathbf{A}|(1-γ)^{-4}ε^{-2}).