Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

59119178237 · Jun 202019922001200920172026
48 results for statistical hurdles

A composite loss framework is proposed for low-rank modeling of data consisting of interesting and common values, such as excess zeros or missing values. The methodology is motivated by the generalized low-rank framework and the hurdle method which is commonly used to analyze zero-inflated counts. The model is demonstr…

2017-09-06abs ↗pdf ↗

New bounds on learning from multiple distributions for VC classes.

problem Understanding the sample complexity of learning from multiple data distributions.
method Analyzing the gap between known upper and lower bounds for PAC-learnable classes.
result Recent progress on sample complexity for VC dimension d classes on k distributions.

Latent-state environments with long horizons, such as those faced by recommender systems, pose significant challenges for reinforcement learning (RL). In this work, we identify and analyze several key hurdles for RL in such environments, including belief state error and small action advantage. We develop a general prin…

2019-05-29abs ↗pdf ↗

StatFEM uses low-rank approximations to scale Bayesian statFEM for high-dimensional problems.

problem Model misspecification and scalability in high-dimensional physical systems.
method Low-rank approximation of covariance matrix, Bayesian filtering, sparse data reconstruction.
result Reconstructs sparsely observed data-generating processes with minimal loss of information.

Unobserved confounding is a major hurdle for causal inference from observational data. Confounders---the variables that affect both the causes and the outcome---induce spurious non-causal correlations between the two. Wang & Blei (2018) lower this hurdle with "the blessings of multiple causes," where the correlation st…

2019-05-30abs ↗pdf ↗

The paper forecasts corporate distress using a novel MIDAS logistic regression method.

problem Forecasting corporate distress with right-censored data, high-dimensional predictors, and mixed-frequency data.
method The paper introduces a novel high-dimensional censored MIDAS logistic regression method that handles censoring through inverse probability weighting and employs a sparse-group penalty for mixed-frequency predictors.
result The method achieves accurate estimation and superior performance in predicting financial distress of Chinese-listed firms.

Efficient offline reinforcement learning with neural networks using differentiable function approximation.

problem Statistical efficiency of offline reinforcement learning with function approximators.
method Pessimistic fitted Q-learning (PFQL) and differentiable function approximation.
result Provably efficient offline reinforcement learning with differentiable function approximation.

This paper analyzes HTL using stability theory for binary classification.

problem Analyzing HTL's theoretical behavior in binary classification tasks.
method Stability analysis of regularized empirical risk minimizers.
result Derives generalization bounds for training error, excess risk, and cross-validation.

Deep learning methods have shown extraordinary potential for analyzing very diverse biomedical data, but their dissemination beyond developers is hindered by important computational hurdles. We introduce ImJoy (https://imjoy.io/), a flexible and open-source browser-based platform designed to facilitate widespread reuse…

2019-05-30abs ↗pdf ↗

Alternative app data improves credit scoring for underserved borrowers.

problem Improving credit scoring for low-wealth and young individuals.
method Use of alternative data from app-based marketplaces, validated with TreeSHAP method.
result Alternative data sources predict financial behavior better than traditional bureau data.

Statistical approach uses ODEs for modeling individual health trajectories.

problem Challenges in applying ODEs to longitudinal cohort data, especially noise and parameter sensitivity.
method Combines ODEs with neural networks to model individual health trajectories using each observation as initial value.
result Demonstrates improved modeling of individual health trajectories compared to global regression.

Method analyzes large-scale network data to detect communication pattern shifts.

problem Analyzing large-scale time-series network data is challenging.
method Temporal encoder embedding method using ground-truth or estimated vertex labels.
result Detects communication pattern shifts across all levels of network structure.

Recent work has uncovered the interesting (and somewhat surprising) finding that training models to be invariant to adversarial perturbations requires substantially larger datasets than those required for standard classification. This result is a key hurdle in the deployment of robust machine learning models in many re…

2019-05-31abs ↗pdf ↗

A significant hurdle for analyzing large sample data is the lack of effective statistical computing and inference methods. An emerging powerful approach for analyzing large sample data is subsampling, by which one takes a random subsample from the original full sample and uses it as a surrogate for subsequent computati…

2015-09-17abs ↗pdf ↗

Cloud computing is gaining significant attention, however, security is the biggest hurdle in its wide acceptance. Users of cloud services are under constant fear of data loss, security threats and availability issues. Recently, learning-based methods for security applications are gaining popularity in the literature wi…

2018-10-23abs ↗pdf ↗

Machine learning has the potential to assist many communities in using the large datasets that are becoming more and more available. Unfortunately, much of that potential is not being realized because it would require sharing data in a way that compromises privacy. In order to overcome this hurdle, several methods have…

2018-06-29abs ↗pdf ↗

Deep model tackles zero-inflated multi-species abundance estimation.

problem Predicting species distribution across landscapes with inflated zero counts.
method Proposes a novel deep learning model combining multivariate probit and log-normal distributions.
result Model outperforms existing methods on bird and fish population datasets.

We introduce a novel theoretical framework for Return On Investment (ROI) maximization in repeated decision-making. Our setting is motivated by the use case of companies that regularly receive proposals for technological innovations and want to quickly decide whether they are worth implementing. We design an algorithm …

2019-05-28abs ↗pdf ↗

If you want to tell people the truth, make them laugh, otherwise they'll kill you. (source unclear) Machine learning and deep learning are the technologies of the day for developing intelligent automatic systems. However, a key hurdle for progress in the field is the literature itself: we often encounter papers that re…

2019-01-07abs ↗pdf ↗

New RL algorithm handles delayed feedback with posterior sampling.

problem Challenges of delayed feedback in reinforcement learning with linear function approximation.
method Posterior sampling with delayed feedback for value-based RL.
result Achieves optimal regret guarantee with improved computational efficiency.

New framework bridges climate science and ML for easier climate model emulation.

problem High computational costs and mistrust of ML methods in climate models.
method Integrating climate science and machine learning perspectives to design easy-to-adopt emulators.
result Demonstrated reliability of emulators designed to address specific tasks.

FastMuyGPs speeds up GP predictions for large datasets.

problem High cost of Gaussian process predictions for large data.
method Combines cross-validation, batching, nearest neighbors sparsification, and precomputation.
result Superior accuracy and competitive runtime compared to other methods.

Physics-inspired methods optimize SVD compression of LLMs.

problem Efficiently compressing large language models (LLMs) using SVD.
method FermiGrad for globally optimal rank selection and PivGa for lossless compression.
result Global optimization of SVD ranks and lossless compression of low-rank factors.

Vulnerability to adversarial attacks is one of the principal hurdles to the adoption of deep learning in safety-critical applications. Despite significant efforts, both practical and theoretical, the problem remains open. In this paper, we analyse the geometry of adversarial attacks in the large-data, overparametrized …

2020-02-11abs ↗pdf ↗

Catastrophic forgetting occurs when a neural network loses the information learned in a previous task after training on subsequent tasks. This problem remains a hurdle for artificial intelligence systems with sequential learning capabilities. In this paper, we propose a task-based hard attention mechanism that preserve…

2018-01-04abs ↗pdf ↗

Policy learning can be used to extract individualized treatment regimes from observational data in healthcare, civics, e-commerce, and beyond. One big hurdle to policy learning is a commonplace lack of overlap in the data for different actions, which can lead to unwieldy policy evaluation and poorly performing learned …

2019-06-20abs ↗pdf ↗

Non-exhaustive learning (NEL) is an emerging machine-learning paradigm designed to confront the challenge of non-stationary environments characterized by anon-exhaustive training sets lacking full information about the available classes.Unlike traditional supervised learning that relies on fixed models, NEL utilizes se…

2019-08-26abs ↗pdf ↗

Study extends learnability equivalence to multi-class and regression, overcoming binary classification limits.

problem Equivalence of online and private learnability in multi-class and regression settings.
method Introduced a novel Littlestone dimension variant and threshold functions for multi-class classification.
result Online learnability implies private learnability in multi-class classification but not in regression.

A major hurdle to clinical translation of brain-machine interfaces (BMIs) is that current decoders, which are trained from a small quantity of recent data, become ineffective when neural recording conditions subsequently change. We tested whether a decoder could be made more robust to future neural variability by train…

2016-10-19abs ↗pdf ↗

Dynamic neural network toolkits such as PyTorch, DyNet, and Chainer offer more flexibility for implementing models that cope with data of varying dimensions and structure, relative to toolkits that operate on statically declared computations (e.g., TensorFlow, CNTK, and Theano). However, existing toolkits - both static…

2017-05-22abs ↗pdf ↗

This work simplifies Bayesian inference for neural networks by identifying influential parameter directions.

problem High computational complexity in Bayesian inference for neural networks due to high-dimensional parameter space.
method Constructing an active subspace of influential parameter directions to reduce dimensionality.
result Effective and scalable Bayesian inference achieved via reduced active subspace.

One out of four children in India are leaving grade eight without basic reading skills. Measuring the reading levels in a vast country like India poses significant hurdles. Recent advances in machine learning opens up the possibility of automating this task. However, the datasets of children's speech are not only rare …

2019-11-27abs ↗pdf ↗

We study a robust optimal stopping problem with respect to a set $\cP$ of mutually singular probabilities. This can be interpreted as a zero-sum controller-stopper game in which the stopper is trying to maximize its pay-off while an adverse player wants to minimize this payoff by choosing an evaluation criteria from $\…

2013-01-01abs ↗pdf ↗

A new XVA strategy rooted in balance sheet perspective improves equity process for bank shareholders.

problem Counterparty risk valuation adjustments (XVAs) in financial derivatives.
method Develops a cost-of-capital XVA strategy in a balance sheet perspective, solving explicitly in static setup and dynamically in trade context.
result Ensures a submartingale equity process corresponding to a target hurdle rate on capital at risk.

Since its inception, Floer homology has been an important tool in low-dimensional topology. Floer theoretic invariants of 33-manifolds tend to be either gauge theoretic or symplecto-geometric in nature, and there is a general philosophy that each gauge theoretic Floer homology should have a corresponding symplectic Fl…

2016-11-29abs ↗pdf ↗

Power-law portfolios improve diversification by scaling weights sub-linearly.

problem Optimization methods struggle with unstable pair correlations and non-Gaussian risk measures.
method Construct portfolios with penalty proportional to arbitrary order moment of returns, leading to sub-linear weight scaling.
result Infinite order power-law portfolios are perfectly diversified, improving diversification over Kelly portfolios.