Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

1.2%2.4%3.6%4.8% · Nov 199519922001200920172026
48 results for richness

New metric measures dynamical richness without relying on accuracy.

problem Lack of a reliable metric for measuring dynamical richness.
method Developed a computationally efficient, performance-independent metric based on low-rank bias.
result Metric recovers neural collapse as a special case and captures known transitions without accuracy.

Consider a Riemannian metric on two-torus. We prove that the question of existence of polynomial first integrals leads naturally to a remarkable system of quasi-linear equations which turns out to be a Rich system of conservation laws. This reduces the question of integrability to the question of existence of smooth (q…

2009-07-29abs ↗pdf ↗

RICH models scenes as hierarchical tree to learn and generate complex compositions.

problem Learning compositional structures between parts and objects in natural scenes.
method RICH uses a latent scene graph to organize entities into a tree structure and employs a top-down inference approach.
result RICH learns and generates complex scene hierarchies from unlabeled data.

Study binary choice with asymmetric loss, offering simple solutions.

problem Binary choice with asymmetric loss in data-rich environments.
method Loss-based reweighting of logistic regression or machine learning techniques.
result Valid decisions on binary outcomes with general loss functions.

This paper proposes new get-rich-quick schemes that involve trading in a financial security with a non-degenerate price path. For simplicity the interest rate is assumed zero. If the price path is assumed continuous, the trader can become infinitely rich immediately after it becomes non-constant (if it ever does). If i…

2016-04-03abs ↗pdf ↗

The study examines the balancedness of random partition models and finds the rich-get-richer characteristic is a result of model assumptions.

problem The balancedness of random partition models is largely neglected in the literature.
method Formulated a framework to define and study the balancedness of exchangeable random partition models, analyzed using product-form exchangeability and projectivity assumptions.
result The 'rich-get-richer' characteristic is an inevitable consequence of the model assumptions.

A recent line of work studies overparametrized neural networks in the "kernel regime," i.e. when the network behaves during training as a kernelized linear predictor, and thus training with gradient descent has the effect of finding the minimum RKHS norm solution. This stands in contrast to other studies which demonstr…

2019-06-13abs ↗pdf ↗

Exact solutions reveal how unbalanced initializations promote rapid feature learning in neural networks.

problem Understanding how neural networks efficiently extract features from data.
method Deriving exact solutions to a minimal model of neural networks transitioning between lazy and rich learning regimes.
result Unbalanced layer-specific initialization variances and learning rates determine the degree of feature learning.

We study the computational tractability of PAC reinforcement learning with rich observations. We present new provably sample-efficient algorithms for environments with deterministic hidden state dynamics and stochastic rich observations. These methods operate in an oracle model of computation -- accessing policy and va…

2018-03-01abs ↗pdf ↗

Study on rich regime training in deep learning, finding active parameters in bottom layers.

problem Understanding the practical success of deep learning models.
method Empirical study on rich regime training with benchmark datasets, re-initialization analysis, and probabilistic Layer-Wise Sparse SGD.
result Probabilistic Layer-Wise Sparse SGD matches vanilla SGD's generalization performance with improved efficiency.

A dynamic agent model is introduced with an annual random wealth multiplicative process followed by taxes paid according to a linear wealth-dependent tax rate. If poor agents pay higher tax rates than rich agents, eventually all wealth becomes concentrated in the hands of a single agent. By contrast, if poor agents are…

2017-11-15abs ↗pdf ↗

Physics-informed GCRL tackles sparse feedback learning with hybrid dynamics.

problem Sparse feedback learning with high-dimensional, hybrid, or contact-dependent dynamics.
method Introduces physics-informed inductive biases into goal-conditioned value learning.
result Contact-rich manipulation tasks degrade existing Pi-GCRL methods.

In many situations, we need to build and deploy separate models in related environments with different data qualities. For example, an environment with strong observation equipments (e.g., intensive care units) often provides high-quality multi-modal data, which are acquired from multiple sensory devices and have rich-…

2018-09-06abs ↗pdf ↗

Motivated by the widespread adoption of large-scale A/B testing in industry, we propose a new experimentation framework for the setting where potential experiments are abundant (i.e., many hypotheses are available to test), and observations are costly; we refer to this as the experiment-rich regime. Such scenarios requ…

2018-05-30abs ↗pdf ↗

Develops a deep learning architecture for rich-item recommendations.

problem Rich data structures with multiple entity types and side-information.
method General formulation, multiple graph-CNN based architecture (AL-GCN), ranking metric pAp@k.
result 5-6% points more accurate than production models in real-world applications.

Variational inference methods often focus on the problem of efficient model optimization, with little emphasis on the choice of the approximating posterior. In this paper, we review and implement the various methods that enable us to develop a rich family of approximating posteriors. We show that one particular method …

2017-07-09abs ↗pdf ↗

Deep Discrete Encoders (DDEs) tackle interpretable generative models for rich data with discrete latent layers.

problem Overparametrized, non-identifiable, and uninterpretable deep generative models in high-stakes applications.
method Directed graphical model with multiple binary latent layers, transparent identifiability conditions, scalable estimation pipeline.
result Transparent identifiability conditions and scalable estimation pipeline for interpretable DDEs.

Grokking occurs when neural networks transition from lazy to rich training dynamics, fitting initial features before generalizing.

problem Understanding why neural networks exhibit early train loss decrease without corresponding test loss improvement.
method Analyzing vanilla gradient descent on polynomial regression with a two-layer neural network, identifying sufficient statistics for test loss.
result Grokking arises when a network first attempts to fit a kernel regression solution with initial features, followed by late-time feature learning.

HOMER learns latent states to explore rich environments efficiently.

problem Exploration in rich observation environments with unknown latent states.
method Interleaves representation learning and strategic exploration to identify kinematic states.
result Provably efficient exploration with polynomial sample complexity in latent states and time horizon.

Kearns et al. [2018] recently proposed a notion of rich subgroup fairness intended to bridge the gap between statistical and individual notions of fairness. Rich subgroup fairness picks a statistical fairness constraint (say, equalizing false positive rates across protected groups), but then asks that this constraint h…

2018-08-24abs ↗pdf ↗

Generative Neuro-Symbolic model learns from raw data with rich conceptual representations.

problem Learning rich, general-purpose conceptual representations from raw perceptual inputs.
method Generative Neuro-Symbolic (GNS) model combining symbolic and neural network approaches.
result Model learns from raw data and generalizes to 4 unique tasks.

Quantum models can approximate any function if data encoding allows for a rich enough frequency spectrum.

problem Theoretical properties of quantum machine learning models, particularly their expressive power.
method Investigated how data encoding affects the expressive power of parametrized quantum circuits.
result Quantum models can access increasingly rich frequency spectra by repeating data encoding gates, potentially making them universal function approximators.

New BE dimension measure reveals rich RL problems with sample-efficient algorithms.

problem Finding sample-efficient algorithms for complex RL problems.
method Introducing Bellman Eluder (BE) dimension and designing GOLF and OLIVE algorithms.
result GOLF and OLIVE algorithms learn near-optimal policies for low BE dimension problems with polynomial samples.

Neural Machine Translation (MT) has reached state-of-the-art results. However, one of the main challenges that neural MT still faces is dealing with very large vocabularies and morphologically rich languages. In this paper, we propose a neural MT system using character-based embeddings in combination with convolutional…

2016-03-02abs ↗pdf ↗

We study the exploration problem in episodic MDPs with rich observations generated from a small number of latent states. Under certain identifiability assumptions, we demonstrate how to estimate a mapping from the observations to latent states inductively through a sequence of regression and clustering steps -- where p…

2019-01-25abs ↗pdf ↗

By representing words with probability densities rather than point vectors, probabilistic word embeddings can capture rich and interpretable semantic information and uncertainty. The uncertainty information can be particularly meaningful in capturing entailment relationships -- whereby general words such as "entity" co…

2018-04-26abs ↗pdf ↗

We provide an exact solution to the ideal-gas-like models studied in econophysics to understand the microscopic origin of Pareto-law. In these class of models the key ingredient necessary for having a self-organized scale-free steady-state distribution is the trading or collision rule where agents or particles save a d…

2006-03-17abs ↗pdf ↗

This paper shows how deep neural networks can learn rich, independent features that significantly deviate from initialization.

problem Understanding how deep neural networks achieve meaningful feature learning and global convergence.
method Investigation of infinitely wide, LL-layer neural networks using the tensor program framework under Maximal Update parametrization.
result SGD enables these networks to learn linearly independent features that substantially deviate from their initial values, capturing relevant data information.

The computational costs of inference and planning have confined Bayesian model-based reinforcement learning to one of two dismal fates: powerful Bayes-adaptive planning but only for simplistic models, or powerful, Bayesian non-parametric models but using simple, myopic planning strategies such as Thompson sampling. We …

2014-02-09abs ↗pdf ↗

New method tackles rugged optimization landscapes in contact-rich scenarios.

problem Optimization challenges in dynamic environments with deformable objects.
method Combines Bayesian optimization with semi-local 'leaps' for global search.
result Outperforms gradient-based and gradient-free baselines in simulation and real robot experiments.