Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

51101152202 · Jun 202019922001200920172026
48 results for predefined dimension

The paper develops a method to dynamically adjust VAE latent space dimensions during training.

problem Under- or overprovisioning of latent space dimensions in VAEs.
method GECO optimizer with L0L_0-ARM gradient estimator to dynamically adjust latent space dimensions.
result The latent space can be pruned effectively without violating reconstruction error constraints.

DNArch learns CNN architectures by backpropagation.

problem Discovering optimal CNN architectures.
method Differentiable Neural Architectures (DNArch) learns CNN architectures by backpropagation, controlling kernel sizes, channels, downsampling positions, and depth.
result DNArch finds performant CNN architectures across various tasks.

Gaussian Mixture Models (GMM) have found many applications in density estimation and data clustering. However, the model does not adapt well to curved and strongly nonlinear data. Recently there appeared an improvement called AcaGMM (Active curve axis Gaussian Mixture Model), which fits Gaussians along curves using an …

2015-02-06abs ↗pdf ↗

FedNAS automates federated learning by searching for better architectures.

problem Non-I.I.D. data makes predefined model architectures suboptimal.
method Federated Neural Architecture Search (FedNAS) for collaborative architecture optimization.
result FedNAS searches for better architectures that outperform predefined models.

This work improves metric learning models by incorporating class hierarchies.

problem Class hierarchies are often ignored in classification-based metric learning models.
method Trained softmax classifier and metric learning models with predefined class hierarchies.
result ProxyDR model performs better in hierarchical inference and hierarchy-informed performance.

Data augmentation (DA) is fundamental against overfitting in large convolutional neural networks, especially with a limited training dataset. In images, DA is usually based on heuristic transformations, like geometric or color transformations. Instead of using predefined transformations, our work learns data augmentati…

2019-09-21abs ↗pdf ↗

Inducing sparseness while training neural networks has been shown to yield models with a lower memory footprint but similar effectiveness to dense models. However, sparseness is typically induced starting from a dense model, and thus this advantage does not hold during training. We propose techniques to enforce sparsen…

2018-08-27abs ↗pdf ↗

Traditional event detection classifies a word or a phrase in a given sentence for a set of predefined event types. The limitation of such predefined set is that it prevents the adaptation of the event detection models to new event types. We study a novel formulation of event detection that describes types via several k…

2019-10-24abs ↗pdf ↗

We propose the Relational Tucker3 (RT) decomposition for multi-relational link prediction in knowledge graphs. We show that many existing knowledge graph embedding models are special cases of the RT decomposition with certain predefined sparsity patterns in its components. In contrast to these prior models, RT decouple…

2019-02-03abs ↗pdf ↗

QB-Vine extends Quasi-Bayesian methods to high dimensions using vine copulas.

problem Efficiently predicting high-dimensional distributions without sampling.
method Recursive Quasi-Bayesian construction for marginals and vine copulas for dependence modeling.
result QB-Vine is a fully non-parametric density estimator with analytical form and convergence rate independent of dimension.

New algorithm tackles regression on manifold data using diffusion and semi-supervised learning.

problem Regression on high-dimensional manifold data with complex structures.
method Diffusion-based spectral algorithm using graph Laplacian and heat kernel.
result Algorithm achieves convergence rate dependent on intrinsic manifold dimension, avoiding curse of dimensionality.

Dealing with previously unseen slots is a challenging problem in a real-world multi-domain dialogue state tracking task. Other approaches rely on predefined mappings to generate candidate slot keys, as well as their associated values. This, however, may fail when the key, the value, or both, are not seen during trainin…

2019-08-26abs ↗pdf ↗

CD-RCA method identifies causal relationships in prediction errors without predefined graphs.

problem Challenges in diagnosing prediction errors due to lack of transparency in black-box models.
method Causal-Discovery-based Root-Cause Analysis (CD-RCA) method that estimates causal relationships without predefined causal graphs.
result CD-RCA outperforms heuristic attribution methods in identifying variable contributions to prediction errors.

Concept-driven OPE reduces variance in off-policy decision evaluation.

problem High variance in off-policy decision evaluation due to limited sample sizes.
method Integrating human-explainable concepts into OPE to reduce variance.
result Concept-based OPE estimators remain unbiased and reduce variance when concepts are known and predefined.

cMCA uses contrastive learning to identify latent subgroups in political party data.

problem Identifying latent subgroups within political party data.
method Contrastive learning applied to multiple correspondence analysis (MCA).
result cMCA identifies latent subgroups not seen by traditional methods.

The paper analyzes the sample complexities for policy evaluation with linear function approximation.

problem Policy evaluation with linear function approximation in discounted infinite horizon Markov decision processes.
method Investigates sample complexities for two policy evaluation algorithms: TD and TDC.
result Establishes high-probability sample complexity bounds for policy evaluation algorithms.

Discovering causal structure among a set of variables is a fundamental problem in many empirical sciences. Traditional score-based casual discovery methods rely on various local heuristics to search for a Directed Acyclic Graph (DAG) according to a predefined score function. While these methods, e.g., greedy equivalenc…

2019-06-11abs ↗pdf ↗

BC-LLM uses LLMs to find concepts without predefined sets, improving interpretability and performance.

problem Finding a balance between interpretability and accuracy in concept extraction models.
method Bayesian approach with LLMs as both concept extractor and prior.
result BC-LLM outperforms interpretable and black-box models across various datasets.

This paper investigates to what extent one can improve reinforcement learning algorithms. Our study is split in three parts. First, our analysis shows that the classical asymptotic convergence rate O(1/N)O(1/\sqrt{N}) is pessimistic and can be replaced by O((log(N)/N)β)O((\log(N)/N)^β) with 12β1\frac{1}{2}\leq β\leq 1 and NN the number…

2019-11-06abs ↗pdf ↗

This paper analyzes discrete diffusion models, deriving convergence bounds for their generated samples.

problem Theoretical guarantees for discrete-state diffusion models remain under-explored.
method Continuous Time Markov Chain (CTMC) framework and discrete-time sampling algorithm.
result Convergence bounds for KL divergence and TV distance are derived, showing linear dependence on dimension.

New framework SEU solves lifelong learning's catastrophic forgetting issue.

problem Catastrophic forgetting in lifelong learning.
method Introduces Neural Architecture Search into lifelong learning to dynamically adapt model structures for different tasks.
result Achieves higher accuracy with significantly smaller model size (25-33% of state-of-the-art methods).

A new method for learning manifolds efficiently using canonical basis functions.

problem Learning manifolds in high-dimensional data with efficient and distinct latent dimensions.
method Proposes a novel optimization objective to enforce a transformation matrix with a few prominent and non-degenerate basis functions.
result Demonstrates that minimizing the off-diagonal manifold metric elements 1\ell_1-norm results in a more efficient latent space representation.

Paper proposes a novel auto-encoder for latent density estimation.

problem Challenges of learning generative probabilistic models due to curse of dimensionality.
method Joint dimensionality reduction and non-parametric density estimation framework using a novel estimator.
result Proposed model achieves promising results on various datasets.

Paper proposes an efficient RL algorithm for discounted MDPs using feature mapping.

problem Efficient reinforcement learning for large state and action spaces.
method Uses feature mapping to represent states and actions in a low-dimensional space, proposing a novel algorithm with polynomial regret bound.
result Achieves a O(dT/(1γ)2)O(d\sqrt{T}/(1-γ)^2) regret bound, near-optimal up to a (1γ)0.5(1-γ)^{-0.5} factor.

Method learns statistics of return distributions via neural networks and maximum mean discrepancy.

problem Learning probability distributions in reinforcement learning.
method Maximum mean discrepancy (MMD) for learning unrestricted statistics of return distributions.
result Method outperforms standard distributional RL baselines on Atari games.

Efficient implicit differentiation for Lasso hyperparameter optimization.

problem Difficult hyperparameter optimization for Lasso-type models.
method Implicit differentiation algorithm tailored for Lasso-type problems, avoiding matrix inversion and solving linear systems.
result Outperforms standard methods in optimizing error on held-out data or Stein Unbiased Risk Estimator (SURE).

This paper improves Gaussian process predictions by integrating prior knowledge.

problem Gaussian processes lack predictive power when prior information is ignored.
method Derive mean and covariance functions from previous data using weighted sums of basis functions.
result Integrating prior knowledge significantly increases look-ahead time and accuracy.

Markov networks are widely used in many Machine Learning applications including natural language processing, computer vision, and bioinformatics . Learning Markov networks have many complications ranging from intractable computations involved to the possibility of learning a model with a huge number of parameters. In t…

2018-12-03abs ↗pdf ↗

Keyphrase boundary classification (KBC) is the task of detecting keyphrases in scientific articles and labelling them with respect to predefined types. Although important in practice, this task is so far underexplored, partly due to the lack of labelled data. To overcome this, we explore several auxiliary tasks, includ…

2017-04-03abs ↗pdf ↗

Adaptive importance sampling for stochastic optimization is a promising approach that offers improved convergence through variance reduction. In this work, we propose a new framework for variance reduction that enables the use of mixtures over predefined sampling distributions, which can naturally encode prior knowledg…

2019-03-29abs ↗pdf ↗

One of the most challenging problems in kernel online learning is to bound the model size and to promote the model sparsity. Sparse models not only improve computation and memory usage, but also enhance the generalization capacity, a principle that concurs with the law of parsimony. However, inappropriate sparsity mode…

2016-04-22abs ↗pdf ↗

Proposes FIPO-BC for efficient online calibration of complex models.

problem Efficiently calibrating computationally expensive models with large datasets.
method Fixed inducing points online Bayesian calibration (FIPO-BC) algorithm.
result FIPO-BC is at least ten times faster than standard methods and enables online updates.