Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

107213320426 · Jun 202019922001200920172026
48 results for methodological challenges

This paper reviews transfer learning for financial data predictions, highlighting its potential.

problem Accurate stock price prediction in financial time series is challenging due to noise and non-linear relationships.
method Transfer Learning applied to financial market predictions.
result Transfer Learning can improve financial prediction capability.

Study examines challenges and applications of machine learning in finance.

problem Challenges in applying machine learning to financial research due to market idiosyncrasies and methodological differences.
method Discussion of adjustments needed to conventional machine learning methodology to account for financial market peculiarities.
result Machine learning can be unified with financial research as a robust complement to econometric methods.

This paper critiques flawed MVTS anomaly detection evaluation methods and proposes a simple baseline.

problem Flawed evaluation methods in MVTS anomaly detection research.
method Robust evaluation protocols, including PCA-based baseline.
result Simple PCA-based baseline outperforms many DL approaches.

Many complex systems can be represented as networks, and the problem of network comparison is becoming increasingly relevant. There are many techniques for network comparison, from simply comparing network summary statistics to sophisticated but computationally costly alignment-based approaches. Yet it remains challeng…

2017-04-02abs ↗pdf ↗

Introduces CCR for constructing confidence regions from conformal predictions.

problem Challenges in constructing confidence regions for model parameters.
method Combines conformal prediction intervals for model outputs to establish confidence regions for parameters under minimal assumptions.
result Valid coverage guarantees for finite sample regime, applicable to various model types.

Paper proposes a novel method to assess treatment effect estimators using cross-validation.

problem Lack of ground truth to objectively assess treatment effect estimators in RCTs.
method Cross-validation-like methodology combining noisy difference-of-means estimate and aggregation across RCTs.
result Aggressive downweighting or truncation of large values reduces variance and improves treatment effect estimation.

Study categorizes time series anomaly detection metrics based on evaluation challenges.

problem Challenges in evaluating time series anomaly detection due to diverse application objectives and metric assumptions.
method Problem-oriented framework categorizing metrics into six dimensions based on evaluation challenges.
result Quantifies each metric's discriminative ability and reveals limitations of widely used metrics.

Fast accumulation of large amounts of complex data has created a need for more sophisticated statistical methodologies to discover interesting patterns and better extract information from these data. The large scale of the data often results in challenging high-dimensional estimation problems where only a minority of t…

2014-04-24abs ↗pdf ↗

This paper considers the mean variance portfolio management problem. We examine portfolios which contain both primary and derivative securities. The challenge in this context is due to portfolio's nonlinearities. The delta-gamma approximation is employed to overcome it. Thus, the optimization problem is reduced to a we…

2011-02-24abs ↗pdf ↗

Survey examines distillation methods for large language models.

problem Efficiently compress large language models while preserving their capabilities.
method Knowledge Distillation and Dataset Distillation techniques.
result Integrating KD and DD can produce more effective and scalable compression strategies.

Paper integrates ML with physics models for engineering and environmental challenges.

problem Complex science and engineering problems require new methodologies combining physics-based models and ML.
method Structured overview of integrating physics-based models with ML techniques.
result Taxonomy of existing techniques and potential research gaps identified.

Develops a new Bayesian inference method for discrete data.

problem Computational challenges in discrete state spaces, especially intractable likelihoods.
method Uses a discrete Fisher divergence to update beliefs about model parameters, circumventing the intractable normalising constant.
result Establishes statistical properties of the generalised posterior and proposes a calibration approach.

We use the theory of normal variance-mean mixtures to derive a data augmentation scheme for models that include gamma functions. Our methodology applies to many situations in statistics and machine learning, including Multinomial-Dirichlet distributions, Negative binomial regression, Poisson-Gamma hierarchical models, …

2019-05-29abs ↗pdf ↗

Unified Bayesian framework for PTA data analysis tackles hierarchical model issues.

problem Hierarchical Bayesian modeling challenges in PTA data analysis.
method Reparameterization strategy using Normalizing Flows (NFs) and i-nessai nested sampler.
result Improved statistical robustness and computational efficiency in PTA analysis.

Automated digital twin discovery from biological data improves drug discovery and personalized medicine.

problem Developing reliable digital twins from noisy, incomplete biological data.
method Symbolic and sparse regression, Bayesian frameworks, deep learning, and large language models.
result Sparse regression generally outperforms symbolic regression, especially with Bayesian frameworks.

Bayesian method improves sparse CCA for multi-view data.

problem Integrative statistical analysis of multi-view high-dimensional data.
method Bayesian infinite factor model with graphical horseshoe prior or diagonal structure to encourage sparsity.
result The proposed Bayesian ScSCCA approach achieves robust estimation of sparse CCA.

Sherpa.ai framework combines federated learning and differential privacy for edge AI services.

problem Protecting data privacy in edge AI services.
method Holistic federated learning and differential privacy approach with methodological guidelines.
result Demonstrated through classification and regression use cases.

Review of methods enabling causal predictions under hypothetical interventions.

problem Need for predicting outcomes under hypothetical interventions in decision making.
method Systematic review of methods using causal inference for prediction models.
result Identified 13 methods for causal inference from observational data.

Deep Learning (DL) methods have emerged as one of the most powerful tools for functional approximation and prediction. While the representation properties of DL have been well studied, uncertainty quantification remains challenging and largely unexplored. Data augmentation techniques are a natural approach to provide u…

2019-03-22abs ↗pdf ↗

The Affective Behavior Analysis in-the-wild (ABAW) 2020 Competition is the first Competition aiming at automatic analysis of the three main behavior tasks of valence-arousal estimation, basic expression recognition and action unit detection. It is split into three Challenges, each one addressing a respective behavior t…

2020-01-30abs ↗pdf ↗

New method infers causal relationships from nonstationary time series data.

problem Challenges in inferring causal relationships from nonstationary time series data.
method Proposes a new class of restricted SCM with time-varying filters and stationary noise, leveraging asymmetry from nonstationarity.
result Demonstrates effectiveness of the proposed methodology on various synthetic and real datasets.

New simulation technique speeds up Lévy-driven OU process pricing.

problem Inefficient Monte Carlo simulations of Lévy-driven OU processes.
method Numerical inversion of characteristic function combined with FFT for fast and accurate simulations.
result The proposed technique is at least one order of magnitude faster than existing methods.

Systematic review of multimodal data challenges and solutions.

problem Challenges in integrating diverse data types for improved diagnostics and personalized care.
method Synthesizing findings from 69 studies on technical obstacles and recent methodological advances.
result Promising solutions like transfer learning, generative models, attention mechanisms, and neural architecture search.

Differential Privacy (DP) provides strong guarantees on the risk of compromising a user's data in statistical learning applications, though these strong protections make learning challenging and may be too stringent for some use cases. To address this, we propose element level differential privacy, which extends differ…

2019-12-05abs ↗pdf ↗