Faced with massive data, is it possible to trade off (statistical) risk, and (computational) space and time? This challenge lies at the heart of large-scale machine learning. Using k-means clustering as a prototypical unsupervised learning problem, we show how we can strategically summarize the data (control space) in …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,291 papers · 148 categories
Trend · papers per month
48 results for “time-data tradeoffs”
The paper analyzes parameter estimation from nonlinear observations.
problem Recovering a structured but unknown parameter from nonlinear observations.
method Develops a framework for characterizing time-data tradeoffs for various parameter estimation algorithms.
result Projected gradient descent schemes converge at a linear rate with near minimal number of samples.
How should statistical procedures be designed so as to be scalable computationally to the massive datasets that are increasingly the norm? When coupled with the requirement that an answer to an inferential question be delivered within a certain time budget, this question has significant repercussions for the field of s…
New data structure identifies close match from multiple distributions.
problem Identify the closest distribution to a given sample.
method Developed a sublinear-time data structure for identifying the closest distribution.
result First data structure that identifies the closest distribution in sublinear time.
In this paper we consider the use of the space vs. time Kronecker product decomposition in the estimation of covariance matrices for spatio-temporal data. This decomposition imposes lower dimensional structure on the estimated covariance matrix, thus reducing the number of samples required for estimation. To allow a sm…
Study shows stability of travel time data reconstruction from closed subsets.
problem Reconstruction of length spaces from travel time data on a closed subset.
method Lipschitz stability proof for certain types of length spaces.
result Reconstruction of length spaces is Lipschitz stable from travel time data on a closed subset.
Recover simple irreversible Finsler geometry from travel time data
problem Stable recovery of a simple irreversible Finsler geometry
method Use a Gromov-Hausdorff distance adapted to irreversible metric spaces
result Unique and Lipschitz-stable recovery
Probabilistic forecasting for geosteering in fluvial successions using a generative adversarial networkphysics.geo-ph
Generative adversarial network improves geosteering in fluvial reservoirs.
problem Improving geosteering in complex reservoirs with high uncertainties.
method Generative adversarial deep neural network (GAN) trained to model fluvial successions.
result Reduces uncertainty and correctly predicts geological features up to 500 meters ahead of drill-bit.
Research explores unsupervised methods for detecting vessel behavior changes in real-time data streams.
problem Detecting shifts in vessel behavior for maritime traffic monitoring.
method Investigates unsupervised and semi-supervised change detection methods.
result Identifies shifts in vessel behavior for unusual events detection.
Researchers recover Riemannian manifolds and lower order terms from travel time data.
problem Recovering Riemannian manifolds and lower order terms from travel time data.
method Adaptation of the Boundary Control method to recover lower order terms.
result Complete Riemannian manifolds and lower order terms can be uniquely recovered from a local source to solution map.
New clustering algorithm uses persistent homology for space-time data.
problem Clustering space-time data without labeled examples.
method Persistent homology for topological data analysis, analyzing data at multiple resolutions.
result The algorithm distinguishes true features from noise based on persistence.
New proofs confirm travel time data determine simple metrics on a disc.
problem Determining a simple Riemannian metric from travel time data.
method Proofs based on Myers-Steenrod theorem, Lipschitz-type stability estimate.
result Travel time data determine a simple Riemannian metric on a disc up to natural gauge.
Algorithm generates private continuous-time data for sensitive domains.
problem Private generation of continuous-time data for sensitive domains.
method Mean-field Langevin dynamics and noisy particle gradient descent.
result Strong privacy guarantees for one-time data contributions.
Classifies and clusters event time data using non-homogeneous Poisson process models.
problem Classifying and clustering event time data from multiple observations.
method Modeling rate functions using spline basis expansion, estimating coefficients using maximum likelihood, and assigning observations to groups based on likelihood.
result The classification and clustering approaches perform well on both synthetic and real-world data.
The study evaluates how well local explanations align with model predictions.
problem Capturing the faithfulness of local explanations to model predictions.
method Introducing consistency and sufficiency as properties, and developing quantitative measures and estimators.
result Quantitative measures of consistency and sufficiency depend on test-time data distribution.
FinSphere improves stock analysis quality with AI and expert-curated data.
problem Lack of objective evaluation metrics and depth in stock analysis by FinLLMs.
method Developed AnalyScore, curated Stocksis dataset, and FinSphere AI agent.
result FinSphere outperforms general and domain-specific LLMs in generating high-quality stock analysis reports.
Deep learning improves neutrino-nucleus interaction vertex reconstruction.
problem Vertex reconstruction of neutrino-nucleus interaction events.
method Combining energy and timing data for classification and regression tasks using deep learning.
result The model achieves 4.00% higher classification accuracy and 0.9919 higher regression accuracy than previous methods.
Paper reconstructs compact Riemannian manifolds from travel time data.
problem Reconstructing compact Riemannian manifolds from partial travel time data.
method Embedding in function space, studying distance function regularity.
result Reconstruction of compact Riemannian manifolds from travel time data.
The bias-variance tradeoff doesn't always apply in neural networks, contradicting textbook claims.
problem The bias-variance tradeoff is not universally applicable in neural networks, contradicting textbook teachings.
method Extensive experiments and analysis on neural networks, revisiting Geman et al. (1992) experiments.
result Neural networks do not exhibit a bias-variance tradeoff when increasing network width, contradicting textbook claims.
KCUSUM detects abrupt changes in real-time data streams efficiently.
problem Detecting abrupt changes in high-volume scientific data streams.
method Kernel-based Cumulative Sum (KCUSUM) algorithm using Maximum Mean Discrepancy (MMD).
result KCUSUM outperforms traditional CUSUM in online change point detection.
Develops an efficient method for real-time data analysis and visualization.
problem Challenges of analyzing high-dimensional data.
method Incremental non-linear manifold approximation using GMRA framework.
result Accurately represents non-linear manifolds with small initial samples.
New algorithm detects and adapts to changes in real-time data streams.
problem Adapting to fast-changing data in real-time systems.
method Concept drift detection followed by prototype-based adaptation.
result Stable and quick adjustments during model adaptation.
Short Term Prediction of Parking Area states Using Real Time Data and Machine Learning Techniquescs.LG
Model predicts parking area states up to 60 mins ahead.
problem Predicting parking area states for urban traffic management.
method Neural Network-based model using real-time and historic data.
result Model outperforms naive models by over 150% at 60 mins prediction.
Paper develops fast, flexible Hawkes process inference for space-time data.
problem Capturing self-exciting, clustering spatio-temporal data.
method Finite support kernels, discretization, precomputations, gradient-based solver.
result Statistically accurate and fast inference for space-time Hawkes processes.
ALPE improves mid-price forecasting in HFT with real-time data.
problem Real-time mid-price forecasting in high-frequency trading.
method Adaptive Learning Policy Engine (ALPE) using RL and adaptive epsilon decay.
result ALPE outperforms other models in mid-price forecasting.
Analysis and Optimization of Seismic Monitoring Networks with Bayesian Optimal Experiment Designstat.AP
Optimizes seismic monitoring networks using Bayesian OED.
problem Improve seismic event identification and location.
method Bayesian optimal experimental design (OED) to configure sensor networks.
result Optimized sensor network improves seismic event identification and location.
Data stream clustering tackles real-time data processing challenges.
problem Real-time processing of data streams with less prior information.
method Review of data stream clustering algorithms and their characteristics.
result Comparison and analysis of data stream clustering algorithms.
An exactly solvable model for emergence and scaling laws in the multitask sparse parity problemcs.LG
Solves a model for sudden problem-solving ability in deep learning.
problem Emergence of new problem-solving abilities in deep learning models.
method Solves a simple multi-linear model in a skill-basis, finding analytic expressions for emergence and scaling laws.
result Simple model captures sigmoidal emergence of multiple new skills in neural networks.
A new tradeoff between regularization and sharpness improves model performance in overparameterized settings.
problem Improving model performance in overparameterized settings with minimum-norm interpolators.
method Proposes a regularization-sharpness tradeoff for overparameterized linear regression with an ℓ^p penalty.
result Empirical validation shows the tradeoff terms can distinguish performant linear interpolators.
Characterization of the Distortion-Perception Tradeoff for Finite Channels with Arbitrary Metricscs.IT
Study the tradeoff between signal distortion and human perception over finite channels.
problem Characterize the distortion-perception tradeoff for finite channels with arbitrary metrics.
method Solve linear programming problems to compute the distortion-perception function and optimal reconstructions.
result DP function is piecewise linear in the perception index.
The paper optimizes portfolio selection with a new regret-based method.
problem Dynamic portfolio optimization with unknown tradeoff parameters.
method Regret-based selection criterion for sparse portfolios.
result Optimal sparse portfolios constructed with unknown tradeoff parameter.
The paper studies adversarial training for linear regression models.
problem Understanding the tradeoffs between robust and standard accuracy in adversarial training.
method Characterizes the fundamental tradeoff and specific adversarial training approach for linear regression with Gaussian features.
result Precise characterization of the standard and robust accuracy tradeoff in high-dimensional settings.
We perform the first study of the tradeoff space of access methods and replication to support statistical analytics using first-order methods executed in the main memory of a Non-Uniform Memory Access (NUMA) machine. Statistical analytics systems differ from conventional SQL-analytics in the amount and types of memory …
Paper explores tradeoffs in classification using tensor subspaces.
problem Supervised classification with sample, computation, and storage complexities.
method Use of tensor subspaces, particularly hierarchical Kronecker structured subspaces.
result Hierarchical Kronecker structured subspaces improve classification tradeoffs.
Paper explores tradeoff between standard and robust accuracy for latent models.
problem Tradeoff between standard accuracy and robust accuracy in adversarial training.
method Revisits adversarial training for latent models, considering Gaussian mixture and generalized linear models.
result Low-dimensional manifold structure mitigates the tradeoff between standard and robust accuracy.
MD-GAN with multi-particle input: the machine learning of long-time molecular behavior from short-time MD dataphysics.chem-ph
MD-GAN learns long-time molecular behavior from short-time data with multi-particle input.
problem Accurately predicting long-time molecular dynamics from short-time data.
method Machine learning method (MD-GAN) that incorporates dynamics of multiple particles of molecules.
result Predicting diffusion with one-third of the training data length using multi-particle input.
Proposes a new adversarial model to avoid accuracy vs. adversarial accuracy tradeoff.
problem Inherent tradeoff between accuracy and adversarial accuracy in existing adversarial robustness definitions.
method Introduces Voronoi-epsilon adversary that balances perturbation constraints.
result Voronoi-epsilon adversary avoids accuracy vs. adversarial accuracy tradeoff even with large .
Researchers study fairness-accuracy tradeoffs in predictive models for multiple groups.
problem Understanding the tradeoff between fairness and accuracy in models serving multiple demographic groups.
method Characterizing the fairness-accuracy (FA) Pareto frontier, approximating it from limited data, and bounding the worst-case gap.
result Derivation of worst-case-optimal estimators and uniform finite-sample bounds for the entire FA frontier.
Deep neural networks predict traffic congestion from real-time data.
problem Predicting non-recurring traffic congestion caused by events.
method Deep neural networks trained on real-time traffic data and events.
result 98.73% accuracy in identifying football game-induced congestion.
Modern neural networks show no bias-variance tradeoff with increased parameters.
problem The traditional bias-variance tradeoff does not hold in over-parameterized neural networks.
method Empirical measurements and theoretical analysis of bias and variance in modern neural networks.
result Bias and variance can decrease as the number of parameters grows in over-parameterized neural networks.
The paper explores robustness in linear regression models under adversarial attacks.
problem The impact of test-time adversarial attacks on linear regression models.
method Quantitative estimates and phase transitions analysis.
result Precise characterization of tradeoffs between adversarial robustness and accuracy.
Adversarial training can degrade standard accuracy even when optimal for robust accuracy.
problem Tradeoff between standard and robust accuracy in adversarial training.
method Analyzes adversarial training's impact on standard accuracy, even when optimal for robust accuracy.
result Even with optimal predictors, adversarial training can still degrade standard accuracy.
The paper analyzes the bias-variance tradeoff for Bregman divergences.
problem Understanding the bias-variance tradeoff for Bregman divergences.
method Analyzes the bias-variance tradeoff through operations in dual space.
result Derives several results including a generalized law of total variance and ensembling operations.
Optimizes privacy-preserving data release with adversarial neural networks.
problem Minimizing distortion while concealing sensitive information in data release.
method Adversarial neural networks for randomized mechanisms and variational approximation of mutual information privacy.
result Achieves near-optimal tradeoffs between data distortion and privacy in experiments.
CDC-FM improves generative model quality-generalization tradeoff by regularizing with geometry-aware noise.
problem Tradeoff between high sample quality and memorization in deep generative models.
method Introduces Carré du champ flow matching (CDC-FM) that replaces homogeneous noise with anisotropic Gaussian noise capturing latent data manifold geometry.
result CDC-FM consistently offers better quality-generalization tradeoff across diverse datasets and architectures.
This paper explores tradeoffs between standard and adversarial risks in distributionally adversarial training.
problem Understanding the impact of adversarial training on standard risk and adversarial risk.
method Study of distributionally adversarial training with different learning settings and models.
result Derives Pareto-optimal tradeoff curves between standard and adversarial risks.
New study shows tradeoffs between compression quality, distortion, and perception.
problem Optimizing compression for low distortion often sacrifices perceptual quality.
method Adopted Blau & Michaeli's perceptual quality definition and studied the rate-distortion-perception tradeoff.
result Restricting perceptual quality to high generally requires a trade-off between rate and distortion.
The paper enhances preference learning by incorporating response time data.
problem Lack of temporal information in user decision-making for reward model learning.
method Integrates response time alongside binary choice data using the EZ model and Neyman-orthogonal loss functions.
result Response time-augmented approach reduces error rates from exponential to polynomial scaling, improving sample efficiency.