This paper reviews transfer learning for financial data predictions, highlighting its potential.
problem Accurate stock price prediction in financial time series is challenging due to noise and non-linear relationships.
method Transfer Learning applied to financial market predictions.
result Transfer Learning can improve financial prediction capability.
A new method for handling imbalanced big data using ensembles and smart data.
problem Imbalanced data distribution in big data scenarios.
method Smart Data driven Decision Trees Ensemble (SD_DeTE) methodology.
result SD_DeTE outperforms Random Forest in handling imbalanced binary classification problems in big data.
Study examines challenges and applications of machine learning in finance.
problem Challenges in applying machine learning to financial research due to market idiosyncrasies and methodological differences.
method Discussion of adjustments needed to conventional machine learning methodology to account for financial market peculiarities.
result Machine learning can be unified with financial research as a robust complement to econometric methods.
A new boosting method reduces overfitting and negative transfer in transfer learning.
problem Overfitting and negative transfer in transfer learning.
method Importance sampling in boosting and random-forest based ensemble methodology.
result Performs better than competitive transfer learning methodologies 63% of the time.
Activation functions influence behavior and performance of DNNs. Nonlinear activation functions, like Rectified Linear Units (ReLU), Exponential Linear Units (ELU) and Scaled Exponential Linear Units (SELU), outperform the linear counterparts. However, selecting an appropriate activation function is a challenging probl…
Rubin LSST DESC uses AI/ML for dark energy research.
problem Challenges in uncertainty quantification and model robustness for AI/ML in DESC.
method Bayesian inference, physics-informed methods, validation frameworks, active learning.
result AI/ML methods are essential but require rigorous evaluation and governance.
Modern electronic health records (EHRs) provide data to answer clinically meaningful questions. The growing data in EHRs makes healthcare ripe for the use of machine learning. However, learning in a clinical setting presents unique challenges that complicate the use of common machine learning methodologies. For example…
This paper critiques flawed MVTS anomaly detection evaluation methods and proposes a simple baseline.
problem Flawed evaluation methods in MVTS anomaly detection research.
method Robust evaluation protocols, including PCA-based baseline.
result Simple PCA-based baseline outperforms many DL approaches.
Ranking recommendation algorithms across datasets using Bradley-Terry model
problem Comparing recommendation algorithms across different datasets
method Introduce a novel data-driven ranking methodology based on Bradley-Terry model
result The obtained ranking depends on key dataset statistics
Many complex systems can be represented as networks, and the problem of network comparison is becoming increasingly relevant. There are many techniques for network comparison, from simply comparing network summary statistics to sophisticated but computationally costly alignment-based approaches. Yet it remains challeng…
Introduces CCR for constructing confidence regions from conformal predictions.
problem Challenges in constructing confidence regions for model parameters.
method Combines conformal prediction intervals for model outputs to establish confidence regions for parameters under minimal assumptions.
result Valid coverage guarantees for finite sample regime, applicable to various model types.
Since the advent of the horseshoe priors for regularization, global-local shrinkage methods have proved to be a fertile ground for the development of Bayesian methodology in machine learning, specifically for high-dimensional regression and classification problems. They have achieved remarkable success in computation, …
Incremental learning from non-stationary data poses special challenges to the field of machine learning. Although new algorithms have been developed for this, assessment of results and comparison of behaviors are still open problems, mainly because evaluation metrics, adapted from more traditional tasks, can be ineffec…
Causal discovery improves fMRI analysis, but faces challenges.
problem Challenges in applying causal discovery to fMRI data.
method Identifying and addressing nine challenges in fMRI causal discovery.
result Current methods for fMRI causal discovery need improvement.
Paper proposes a novel method to assess treatment effect estimators using cross-validation.
problem Lack of ground truth to objectively assess treatment effect estimators in RCTs.
method Cross-validation-like methodology combining noisy difference-of-means estimate and aggregation across RCTs.
result Aggressive downweighting or truncation of large values reduces variance and improves treatment effect estimation.
Study categorizes time series anomaly detection metrics based on evaluation challenges.
problem Challenges in evaluating time series anomaly detection due to diverse application objectives and metric assumptions.
method Problem-oriented framework categorizing metrics into six dimensions based on evaluation challenges.
result Quantifies each metric's discriminative ability and reveals limitations of widely used metrics.
Fast accumulation of large amounts of complex data has created a need for more sophisticated statistical methodologies to discover interesting patterns and better extract information from these data. The large scale of the data often results in challenging high-dimensional estimation problems where only a minority of t…
This paper considers the mean variance portfolio management problem. We examine portfolios which contain both primary and derivative securities. The challenge in this context is due to portfolio's nonlinearities. The delta-gamma approximation is employed to overcome it. Thus, the optimization problem is reduced to a we…
Survey examines distillation methods for large language models.
problem Efficiently compress large language models while preserving their capabilities.
method Knowledge Distillation and Dataset Distillation techniques.
result Integrating KD and DD can produce more effective and scalable compression strategies.
Paper integrates ML with physics models for engineering and environmental challenges.
problem Complex science and engineering problems require new methodologies combining physics-based models and ML.
method Structured overview of integrating physics-based models with ML techniques.
result Taxonomy of existing techniques and potential research gaps identified.
Develops a new Bayesian inference method for discrete data.
problem Computational challenges in discrete state spaces, especially intractable likelihoods.
method Uses a discrete Fisher divergence to update beliefs about model parameters, circumventing the intractable normalising constant.
result Establishes statistical properties of the generalised posterior and proposes a calibration approach.
Proposes I-prior extension for additive interaction models.
problem Challenges in estimating and selecting models with interactions.
method Extends I-prior methodology to multiple covariates, introducing a parsimonious model specification.
result Improves estimation and model selection for additive interaction models.
This study optimizes currency arbitrage using quantum computing methods.
problem Optimizing profitable trading routes in currency markets.
method Quantum Annealing, QAOA, and Constraint Mapping.
result Quantum computing techniques enhance the identification of optimal arbitrage paths.
We use the theory of normal variance-mean mixtures to derive a data augmentation scheme for models that include gamma functions. Our methodology applies to many situations in statistics and machine learning, including Multinomial-Dirichlet distributions, Negative binomial regression, Poisson-Gamma hierarchical models, …
Unified Bayesian framework for PTA data analysis tackles hierarchical model issues.
problem Hierarchical Bayesian modeling challenges in PTA data analysis.
method Reparameterization strategy using Normalizing Flows (NFs) and i-nessai nested sampler.
result Improved statistical robustness and computational efficiency in PTA analysis.
We describe our methods that achieved the 3rd and 4th places in tasks 1 and 2, respectively, at ISIC challenge 2019. The goal of this challenge is to provide the diagnostic for skin cancer using images and meta-data. There are nine classes in the dataset, nonetheless, one of them is an outlier and is not present on it.…
Automated digital twin discovery from biological data improves drug discovery and personalized medicine.
problem Developing reliable digital twins from noisy, incomplete biological data.
method Symbolic and sparse regression, Bayesian frameworks, deep learning, and large language models.
result Sparse regression generally outperforms symbolic regression, especially with Bayesian frameworks.
Bayesian method improves sparse CCA for multi-view data.
problem Integrative statistical analysis of multi-view high-dimensional data.
method Bayesian infinite factor model with graphical horseshoe prior or diagonal structure to encourage sparsity.
result The proposed Bayesian ScSCCA approach achieves robust estimation of sparse CCA.
Sherpa.ai framework combines federated learning and differential privacy for edge AI services.
problem Protecting data privacy in edge AI services.
method Holistic federated learning and differential privacy approach with methodological guidelines.
result Demonstrated through classification and regression use cases.
Review of methods enabling causal predictions under hypothetical interventions.
problem Need for predicting outcomes under hypothetical interventions in decision making.
method Systematic review of methods using causal inference for prediction models.
result Identified 13 methods for causal inference from observational data.
Editorial discusses nine challenges in modern algorithmic trading.
problem Challenges in modern algorithmic trading and controls.
method Discussion of challenges without proposing solutions.
result No specific new results or findings.
This paper presents a methodology for creating streaming, distributed inference algorithms for Bayesian nonparametric (BNP) models. In the proposed framework, processing nodes receive a sequence of data minibatches, compute a variational posterior for each, and make asynchronous streaming updates to a central model. In…
Deep Learning (DL) methods have emerged as one of the most powerful tools for functional approximation and prediction. While the representation properties of DL have been well studied, uncertainty quantification remains challenging and largely unexplored. Data augmentation techniques are a natural approach to provide u…
The analysis of mixed data has been raising challenges in statistics and machine learning. One of two most prominent challenges is to develop new statistical techniques and methodologies to effectively handle mixed data by making the data less heterogeneous with minimum loss of information. The other challenge is that …
The notion of uncertainty is of major importance in machine learning and constitutes a key element of machine learning methodology. In line with the statistical tradition, uncertainty has long been perceived as almost synonymous with standard probability and probabilistic predictions. Yet, due to the steadily increasin…
The paper explores using machine learning for yield curve calibration in multiple markets.
problem Calibration challenges in multiple yield curve markets.
method Gaussian process regression and Adam optimizer.
result Good results for single curve markets, but many challenges for multi curve markets.
NASirt automates CNN architecture design for spectral data.
problem Designing optimal neural architectures for complex data.
method Neural Architecture Search (NAS) with Item Response Theory (IRT) for instance-level complexity.
result NASirt achieves high accuracy (97.40%) on spectral datasets.
Develops Bayesian inference methods for gamma models.
problem Challenges in inference for models with gamma functions.
method Data augmentation scheme using Exponential Reciprocal Gamma distributions.
result Scalable EM and MCMC algorithms developed.
New method infers causal relationships from nonstationary time series data.
problem Challenges in inferring causal relationships from nonstationary time series data.
method Proposes a new class of restricted SCM with time-varying filters and stationary noise, leveraging asymmetry from nonstationarity.
result Demonstrates effectiveness of the proposed methodology on various synthetic and real datasets.
Bayesian method estimates coverage from sketching imperfect data.
problem Estimating coverage probabilities from compressed data.
method Bayesian nonparametric approach using Dirichlet process prior.
result Estimators accurately recover distinct counts and frequencies.
New simulation technique speeds up Lévy-driven OU process pricing.
problem Inefficient Monte Carlo simulations of Lévy-driven OU processes.
method Numerical inversion of characteristic function combined with FFT for fast and accurate simulations.
result The proposed technique is at least one order of magnitude faster than existing methods.
The development of molecular signatures for the prediction of time-to-event outcomes is a methodologically challenging task in bioinformatics and biostatistics. Although there are numerous approaches for the derivation of marker combinations and their evaluation, the underlying methodology often suffers from the proble…
City Logistics is characterized by multiple stakeholders that often have different views of such a complex system. From a public policy perspective, identifying stakeholders, issues and trends is a daunting challenge, only partially addressed by traditional observation systems. Nowadays, social media is one of the bigg…
The aim of this paper is to propose a new methodology that allows forecasting, through Vasicek and CIR models, of future expected interest rates (for each maturity) based on rolling windows from observed financial market data. The novelty, apart from the use of those models not for pricing but for forecasting the expec…
Systematic review of multimodal data challenges and solutions.
problem Challenges in integrating diverse data types for improved diagnostics and personalized care.
method Synthesizing findings from 69 studies on technical obstacles and recent methodological advances.
result Promising solutions like transfer learning, generative models, attention mechanisms, and neural architecture search.
Paper improves basket option pricing for log-normal models.
problem Challenges in pricing basket options with negative weights.
method Moment matching and solving a unary cubic equation.
result Highly accurate closed form solution for basket options.
New decision support systems use prediction sets to help experts update their predictions, improving performance.
problem Challenges in explaining and updating predictions from decision support systems.
method Developed a methodology leveraging nested structure of prediction sets and counterfactual monotonicity to improve performance.
result Limiting experts' agency leads to better performance in decision support systems based on prediction sets.
Machine learning improves official statistics but needs rigorous validation.
problem Lack of methodological robustness in machine learning for official statistics.
method Total Machine Learning Error (TMLE) framework to validate ML models.
result TMLE addresses representativeness and measurement errors in ML models.