Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

10.7%21.3%32.0%42.6% · Jun 202019922001200920172026
48 results for variable-sized data

Paper introduces new bounds linking data compressibility to generalization error.

problem Establishing data-dependent generalization bounds.
method Variable-size compressibility framework linking generalization error to compression rate of input data.
result New bounds depend on empirical data measure, subsuming existing PAC-Bayes and intrinsic dimension bounds.

New hypergraph neural network learns variable-sized hyperedges.

problem Learning representations for non-uniform hypergraphs with variable cardinalities.
method Developed a hypergraph neural network exploiting incidence structure.
result Significant improvement in accuracy on real-world hypergraph datasets.

Two Bayesian optimization methods tackle dynamic design spaces with mixed variables.

problem Optimizing complex systems with varying numbers and types of variables and constraints.
method Two Bayesian optimization approaches: budget allocation and kernel function.
result Both methods converge faster and more consistently than standard approaches.

Expectation maximization (EM) has recently been shown to be an efficient algorithm for learning finite-state controllers (FSCs) in large decentralized POMDPs (Dec-POMDPs). However, current methods use fixed-size FSCs and often converge to maxima that are far from optimal. This paper considers a variable-size FSC to rep…

2015-05-01abs ↗pdf ↗

We introduce a new neural architecture to learn the conditional probability of an output sequence with elements that are discrete tokens corresponding to positions in an input sequence. Such problems cannot be trivially addressed by existent approaches such as sequence-to-sequence and Neural Turing Machines, because th…

2015-06-09abs ↗pdf ↗

Improved taxi demand-supply forecasts using graph-based LSTM.

problem Accurate taxi demand-supply forecasting with complex spatial and temporal patterns.
method Investigated impact of spatial partitioning techniques (Voronoi vs. Geohash) on LSTM network performance.
result GraphLSTM offers competitive performance against ConvLSTM, at lower complexity, across real-world data sets.

Study compares RL and SL for TSP, finds RL better for variable graph sizes.

problem Training deep neural networks for the Travelling Salesman Problem.
method Controlled experiments with supervised and reinforcement learning models on fixed and variable sized graphs.
result Reinforcement learning leads to better generalization to variable graph sizes.

Persistent homology (PH) is a rigorous mathematical theory that provides a robust descriptor of data in the form of persistence diagrams (PDs) which are 2D multisets of points. Their variable size makes them, however, difficult to combine with typical machine learning workflows. In this paper we introduce persistence c…

2018-02-13abs ↗pdf ↗

Text segmentation plays an important role in various Natural Language Processing (NLP) tasks like summarization, context understanding, document indexing and document noise removal. Previous methods for this task require manual feature engineering, huge memory requirements and large execution times. To the best of our …

2018-08-29abs ↗pdf ↗

We present a memory augmented neural network for natural language understanding: Neural Semantic Encoders. NSE is equipped with a novel memory update rule and has a variable sized encoding memory that evolves over time and maintains the understanding of input sequences through read}, compose and write operations. NSE c…

2016-07-14abs ↗pdf ↗

Regularization for matrix factorization (MF) and approximation problems has been carried out in many different ways. Due to its popularity in deep learning, dropout has been applied also for this class of problems. Despite its solid empirical performance, the theoretical properties of dropout as a regularizer remain qu…

2017-10-13abs ↗pdf ↗

AdaptiveNet tackles disease progression prediction in rheumatoid arthritis using deep neural networks.

problem Predicting disease progression in rheumatoid arthritis using clinical data.
method AdaptiveNet, a novel recurrent neural network architecture, that handles multiple lists of different events and missing data.
result AdaptiveNet outperforms classical baselines in disease progression prediction.

A new distance for mixed-variable, hierarchical datasets with meta variables.

problem Heterogeneous datasets limit generalizability and performance in machine learning and optimization.
method Developed a modeling framework for mixed-variable and hierarchical domains with meta variables, and a novel distance function.
result The novel distance function allows comparison of heterogeneous datasets, improving model performance.

FREDE efficiently embeds graphs using linear space and guarantees quality.

problem Efficiently embedding graphs with quality guarantees and linear space complexity.
method FREDE combines matrix sketching with a nonlinear transform of PageRank similarities to achieve linear space and quality guarantees.
result FREDE provides column-covariance approximation guarantees that are nearly as good as SVD, even with limited node similarities.

Learning representation for graph classification turns a variable-size graph into a fixed-size vector (or matrix). Such a representation works nicely with algebraic manipulations. Here we introduce a simple method to augment an attributed graph with a virtual node that is bidirectionally connected to all existing nodes…

2017-08-14abs ↗pdf ↗

New method estimates graphons from multiple networks with high accuracy and low complexity.

problem Estimating graphon function from multiple networks with different node sets and sizes.
method Histogram-based estimator that aligns nodes across all networks.
result High accuracy and low computational complexity achieved.

Reinforcement Patching optimizes dynamic sequence patching for efficient time series forecasting.

problem Efficiently learning data-adaptive representations for long-horizon sequence data, especially continuous sequences.
method Reinforcement Patching (ReinPatch) uses reinforcement learning to optimize dynamic patching policies and sequence backbones.
result ReinPatch achieves compelling performance in time-series forecasting compared to state-of-the-art methods.

The relationship between the size and the variance of firm growth rates is known to follow an approximate power-law behavior σ(S)Sβ(S)σ(S) \sim S^{-β(S)} where SS is the firm size and β(S)0.2β(S)\approx 0.2 is an exponent weakly dependent on SS. Here we show how a model of proportional growth which treats firms as classes compos…

2009-04-08abs ↗pdf ↗

Graph Laplacian spectrum serves as a robust feature representation.

problem Difficulties in analyzing and comparing graphs due to their structure.
method Proposes using the graph Laplacian spectrum (GLS) as a feature representation.
result Graph Laplacian spectrum (GLS) preserves structural information and is consistent under deformation and invariance under isomorphism.

Hyper-SAGNN learns patterns in hypergraphs for complex interactions.

problem Learning patterns in hypergraphs with variable-sized heterogeneous hyperedges.
method Self-attention based graph neural network for homogeneous and heterogeneous hypergraphs.
result Significantly outperforms state-of-the-art methods on various tasks.

We propose in this paper a differentiable learning loss between time series, building upon the celebrated dynamic time warping (DTW) discrepancy. Unlike the Euclidean distance, DTW can compare time series of variable size and is robust to shifts or dilatations across the time dimension. To compute DTW, one typically so…

2017-03-05abs ↗pdf ↗

Sequences have become first class citizens in supervised learning thanks to the resurgence of recurrent neural networks. Many complex tasks that require mapping from or to a sequence of observations can now be formulated with the sequence-to-sequence (seq2seq) framework which employs the chain rule to efficiently repre…

2015-11-19abs ↗pdf ↗

Deep Sets improve reinforcement learning for autonomous driving with variable inputs.

problem Optimal decision making in autonomous driving with varying number of objects.
method Employed Deep Sets for high-level decision making in reinforcement learning.
result Deep Sets outperform other approaches in performance and generalization.

Online distributional prediction with latent cluster geometry

problem Predicting the full data-generating distribution in non-stationary streams
method Representing candidate laws as latent cluster geometry and using Gibbs quasi-posterior
result Achieving sublinear cumulative Wasserstein regret under bounded support and stable latent geometry

RS-Del provides robustness for sequence classifiers against edit distance attacks.

problem Certifying robustness of discrete sequence classifiers against edit distance attacks.
method Randomized deletion (RS-Del) for discrete sequence classifiers, focusing on edit distance-bounded adversaries.
result Achieved a certified accuracy of 91% at an edit distance radius of 128 bytes on malware detection.

Big data sets must be carefully partitioned into statistically similar data subsets that can be used as representative samples for big data analysis tasks. In this paper, we propose the random sample partition (RSP) data model to represent a big data set as a set of non-overlapping data subsets, called RSP data blocks,…

2017-12-12abs ↗pdf ↗

Prevents sensitive data generation in diffusion models using labeled and unlabeled data.

problem Generating sensitive data in diffusion models using unlabeled data.
method Positive-Unlabeled Diffusion Models, approximating ELBO with labeled and unlabeled data.
result Prevents the generation of sensitive data without compromising image quality.

Study reveals Data Shapley's inconsistent performance in data selection tasks.

problem Inconsistency of Data Shapley's performance in data selection across different settings.
method Hypothesis testing framework and identification of utility functions.
result Data Shapley's performance is no better than random selection without specific constraints.

PRRO generates synthetic tabular data that improves SL performance and class distribution.

problem Low SL utility of synthetic data due to class imbalance and overlooked data relationships.
method Data pruning and column reordering to optimize SL utility.
result Synthetic data generated with PRRO enhances predictive performance and class distribution.

Defines data science as a natural ecosystem with challenges and missions.

problem Challenges and missions in data science due to 5D complexities and data life cycle phases.
method Systemic and data-centric view of data science as a fusion of data universe and its challenges, formalizing a general-purpose architecture.
result Essential data science as a natural ecosystem integrating specific disciplines and high-impact applications.

This paper introduces C-DSL to improve data mining outcomes by considering context.

problem Data collection ambiguities, data imbalance, hidden biases, lack of domain info, and data incompleteness.
method Developed Context-Driven Data Science Lifecycle (C-DSL) to address data quality issues.
result Tangible improvements to data mining outcomes were achieved through C-DSL.

Proposes using probabilistic models for privacy-preserving synthetic data.

problem Designing high-quality synthetic data for privacy preservation.
method Formulate the problem through probabilistic modelling, choosing a model for the data.
result Statistical discoveries can be reliably reproduced from synthetic data.