Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

2695378061,074 · Jun 202019922001200920172026
48 results for Generative Ability

Paper proposes a new confidence dimension to measure DNN generalization.

problem Measuring the generalization ability of deep neural networks is challenging.
method Introduces confidence dimension (CD) based on Hoeffding's inequality and VC-dimension.
result CD provides a feasible framework to calculate the upper bound of generalization.

This paper evaluates how well neural models can solve complex tasks by breaking them into simpler ones.

problem Measuring neural models' ability to solve complex tasks by breaking them into simpler subtasks.
method Characterized axes of compositional generalization, introduced a benchmark suite of tasks, and improved Transformer models' attention mechanisms.
result Modified Transformer models generally perform better than natural baselines in solving complex tasks, but challenges remain.

Humans have an impressive ability to reason about new concepts and experiences from just a single example. In particular, humans have an ability for one-shot generalization: an ability to encounter a new concept, understand its structure, and then be able to generate compelling alternative variations of the concept. We…

2016-03-16abs ↗pdf ↗

Energy-based models can generate complex images by combining simpler concepts.

problem Generating natural images that satisfy complex logical combinations of concepts.
method Energy-based models combine probability distributions of simpler concepts to generate compositions.
result Energy-based models can generate images that satisfy conjunctions, disjunctions, and negations of concepts.

We introduce an irreversible discrete multiplicative process that undergoes Bose-Einstein condensation as a generic model of competition. New players with different abilities successively join the game and compete for limited resources. A player's future gain is proportional to its ability and its current gain. The the…

2003-03-16abs ↗pdf ↗

GeneraLight improves traffic signal control models' generalization ability.

problem Overfitting and lack of generalization ability in RL TSC models.
method GeneraLight uses a meta-RL framework with a traffic flow generator based on GANs.
result GeneraLight significantly boosts generalization performance across different traffic flows.

Study finds stock selection ability of Chinese mutual funds is better than asset allocation ability.

problem Evaluating the performance of actively managed mutual funds in China.
method Developed performance measures for asset allocation and selection using holding-based models and compared them with Fama-French and Treynor-Mazuy models.
result Stock selection ability from holding-based models is positively correlated with Fama-French model, while industry allocation is positively correlated with Treynor-Mazuy model.

Mathematical reasoning---a core ability within human intelligence---presents some unique challenges as a domain: we do not come to understand and solve mathematical problems primarily on the back of experience and evidence, but on the basis of inferring, learning, and exploiting laws, axioms, and symbol manipulation ru…

2019-04-02abs ↗pdf ↗

The paper tackles adaptive questioning to classify candidate ability.

problem Designing an optimal sequence of adaptive questions to classify candidate ability.
method Develops lower bounds and geometrical insights for sequential questioning strategies, and arrives at algorithms that match these bounds.
result Asymptotically, any candidate needs to be asked questions at most at two levels, facilitating endogenous exploration.

Efficiently learns disentangled representations using conditional probability differences.

problem Learning disentangled representations with causal mechanisms.
method Approximates difference of conditional probabilities with model's generalization ability.
result 1.9--11.0imes imes more sample efficient and 9.4--32.4 times quicker than previous method.

Enhanced kernel ridgeless regression improves performance with LAB RBF kernels.

problem Lack of flexibility in kernel ridgeless regression.
method Locally-Adaptive-Bandwidths (LAB) RBF kernels and kernel learning techniques.
result Functions learned from LAB RBF kernels belong to an integral space of RKHSs, demonstrating robust generalization.

The study examines deep convolutional neural networks and their learning ability.

problem Understanding the learning ability of deep convolutional neural networks (DCNNs).
method Examines DCNNs under both underparameterized and overparameterized settings, using a novel network deepening scheme.
result Establishes the first learning rates of underparameterized DCNNs and shows how adding layers can create interpolating DCNNs with good learning rates.

Image captioning models are usually evaluated on their ability to describe a held-out set of images, not on their ability to generalize to unseen concepts. We study the problem of compositional generalization, which measures how well a model composes unseen combinations of concepts when describing images. State-of-the-…

2019-09-10abs ↗pdf ↗

New measure quantifies contrastive self-supervised learning's generalization ability.

problem Limited theoretical understanding of contrastive self-supervised learning's generalization.
method Defined (σ,δ)(σ,δ)-measure to mathematically quantify data augmentation and provide an upper bound for downstream classification error.
result Generalization ability is related to alignment of positive samples, divergence of class centers, and concentration of augmented data.

FastAdaBelief improves convergence rate of AdaBelief by exploiting strong convexity.

problem Improving convergence rate of AdaBelief without sacrificing generalization ability.
method Designing FastAdaBelief that adjusts step size considering strong convexity.
result Proves O(logT)O(\log T) regret bound for FastAdaBelief.

Deep generative models (DGMs) are effective on learning multilayered representations of complex data and performing inference of input data by exploring the generative ability. However, it is relatively insufficient to empower the discriminative ability of DGMs on making accurate predictions. This paper presents max-ma…

2016-11-22abs ↗pdf ↗

EVGAE improves VGAE's latent representation learning by mitigating over-pruning.

problem Over-pruning in VGAE limits latent variable capacity and diversity.
method EVGAE uses epitomic approach with multiple sparse VGAE models (epitomes) to increase active latent units and improve generative ability.
result EVGAE outperforms VGAE in generative ability and link prediction on citation networks.

Bayesian neural networks' performance varies with prior choice, affecting their ability to identify unknowns.

problem The impact of prior choice on Bayesian neural networks' ability to identify unknowns.
method Evaluation of different prior distributions on classification tasks using BNNs and NNs with Monte Carlo dropout.
result Prior choice significantly impacts BNNs' ability to identify unknowns, affecting true and false positive rates.

Paper confirms winning tickets have sharp minima, useful for generalization.

problem Explaining why over-parameterized models generalize well despite having sharp minima.
method PAC-Bayesian theory applied to analyze winning tickets and their generalization behavior.
result PAC-Bayesian theory confirms winning tickets have relatively sharp minima, a disadvantage for generalization.

LaRT models LLMs' response accuracy and CoT length to evaluate reasoning ability and speed.

problem Valid evaluation of Large Language Models (LLMs) via response accuracy and chain-of-thought length.
method Introduces Latency-Response Theory (LaRT) to jointly model response accuracy and CoT length using latent ability and latent speed.
result LaRT yields higher estimation accuracy and shorter confidence intervals for latent traits compared to IRT.

Neural Logic Reasoning integrates deep learning and symbolic logic for better prediction tasks.

problem Lack of cognitive reasoning in deep neural networks limits their ability to solve complex prediction tasks.
method Proposes Logic-Integrated Neural Network (LINN) that learns logical operations and conducts propositional logical reasoning.
result LINN significantly outperforms state-of-the-art recommendation models in Top-K recommendation.

Access to medical data is highly restricted due to its sensitive nature, preventing communities from using this data for research or clinical training. Common methods of de-identification implemented to enable the sharing of data are sometimes inadequate to protect the individuals contained in the data. For our researc…

2019-09-19abs ↗pdf ↗

This paper presents a basic property of region dividing of ReLU (rectified linear unit) deep learning when new layers are successively added, by which two new perspectives of interpreting deep learning are given. The first is related to decision trees and forests; we construct a deep learning structure equivalent to a …

2019-06-16abs ↗pdf ↗

Meta-learning bounds derived using PAC-Bayes theory for improved generalization.

problem Uncertainty in generalization performance for meta-learning with new tasks.
method PAC-Bayes relative entropy bounds and empirical risk minimization (ERM) method.
result Competitive generalization performance and rapid convergence with data-dependent prior.

We present a novel recurrent neural network (RNN) based model that combines the remembering ability of unitary RNNs with the ability of gated RNNs to effectively forget redundant/irrelevant information in its memory. We achieve this by extending unitary RNNs with a gating mechanism. Our model is able to outperform LSTM…

2017-06-08abs ↗pdf ↗

A longstanding problem for Deep Neural Networks (DNNs) is understanding their puzzling ability to generalize well. We approach this problem through the unconventional angle of \textit{cognitive abstraction mechanisms}, drawing inspiration from recent neuroscience work, allowing us to define the Cognitive Neural Activat…

2019-05-27abs ↗pdf ↗

Study extends wealth tax neutrality framework to heterogeneous investors.

problem Analyzing wealth tax neutrality in populations with varying return-generating ability.
method Extended Fokker-Planck framework to heterogeneous investors, deriving extended Fokker-Planck equation.
result Proportional wealth tax no longer neutral due to varying return-generating ability, leading to different real incidence and wealth distribution changes.

Recently the GAN generated face images are more and more realistic with high-quality, even hard for human eyes to detect. On the other hand, the forensics community keeps on developing methods to detect these generated fake images and try to guarantee the credibility of visual contents. Although researchers have develo…

2019-02-27abs ↗pdf ↗