Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

81162242323 · Jun 202019922001200920172026
48 results for flexible regression

Flexible empirical Bayes for large-scale multiple linear regression.

problem Large-scale multiple linear regression with flexible priors and efficient computation.
method Adaptive shrinkage priors combined with variational approximations for hyperparameter estimation.
result The posterior mean from the empirical Bayes method solves a penalized regression problem.

Combines MCTM and NF for flexible multivariate density regression with interpretable marginals.

problem Difficult interpretation of flexible NF models and limitations of MCTM in flexibility.
method Hybrid approach combining MCTM for interpretable marginals and NF for complex joint distributions.
result Demonstrates versatility and improved performance compared to MCTM and other NF models.

Neural Local Wasserstein Regression models distribution-on-distribution regression with flexible, localized transport maps.

problem Estimating distribution-on-distribution regression with global optimal transport maps or linearization limitations.
method Proposes Neural Local Wasserstein Regression, a flexible nonparametric framework using locally defined transport maps in Wasserstein space.
result Demonstrates effective capture of nonlinear and high-dimensional distributional relationships.

flexBART improves BART for categorical predictors by creating flexible tree partitions.

problem Limitation of BART in handling categorical predictors with one-hot encoding.
method flexBART re-implements BART with regression trees that can assign multiple levels to both branches of a decision tree node, and proposes a new decision rule prior for spatial data.
result flexBART often yields improved predictive performance and scales better to larger datasets than existing BART implementations.

Flexible Bayesian approach for generalized linear models, especially for sparse logistic regression.

problem Sparse logistic regression challenges in machine learning.
method Empirical Bayes approach with mean-field variational inference, tuning-free and scalable.
result Superior predictive performance in sparse logistic regression compared to existing methods.

Unified approach for interpretable regression with flexible modeling.

problem Combining predictive adaptivity with interpretability in heterogeneous data.
method Combining random Fourier features, spectral feature map, principal component analysis, Gaussian mixture model, and cluster-specific generalized additive models.
result Consistently improves upon classical and black-box models across benchmark datasets.

Bayesian approach for estimating heterogeneous treatment effects in RDD designs.

problem Heterogeneity in treatment effects in RDD designs can lead to misleading conclusions.
method Direct Bayesian Additive Regression Trees (BART) for modeling heterogeneous treatment effects.
result Flexibly captures complicated structures of heterogeneous treatment effects as a function of covariates.

VSPS creates flexible prediction regions for multi-target regression with guaranteed coverage.

problem Uncertainty quantification in multi-target regression with complex distributions.
method Conditional normalizing flows with conformal calibration to identify dense regions.
result VSPS produces smaller, more informative prediction regions with robust coverage guarantees.

The study compares different models for predicting factor premiums and finds neural networks perform better but have unstable weights.

problem Predicting and timing the CMA factor premium using machine learning models.
method Compared regression models (OLS, Ridge, Random Forest, Neural Network) and tested factor timing strategies.
result Neural networks outperform linear models in explaining factor premium variance, but weights are unstable.

To construct flexible nonlinear predictive distributions, the paper introduces a family of softplus function based regression models that convolve, stack, or combine both operations by convolving countably infinite stacked gamma distributions, whose scales depend on the covariates. Generalizing logistic regression that…

2016-08-23abs ↗pdf ↗

New method for efficient maximum likelihood estimation of pp-generalized probit regression.

problem Efficient estimation of pp-generalized probit regression models.
method Combining sketching techniques with importance subsampling to obtain a coreset.
result Maximum likelihood estimator can be approximated efficiently up to a factor of (1+ε)(1+\varepsilon) on large data.

Study highlights how model choice affects uncertainty estimation in neural network regression.

problem Uncertainty estimation under model misspecification in neural network regression.
method Analyzed the impact of model choice on uncertainty estimation in neural network regression, focusing on aleatoric and epistemic uncertainties.
result Model misspecification leads to unreliable uncertainty estimates, highlighting the importance of choosing appropriate models.

Regression is widely used by practioners across many disciplines. We reformulate the underlying optimisation problem as a second-order conic program providing the flexibility often needed in applications. Using examples from portfolio management and quantitative trading we solve regression problems with and without con…

2013-10-12abs ↗pdf ↗

RegFlow models future states with flexible probability distributions.

problem Predicting future states under complex, non-deterministic scenarios.
method Hypernetwork architecture and continuous normalizing flow model.
result RegFlow achieves state-of-the-art results on benchmark datasets.

SRF improves kernel approximation and GP regression performance.

problem Efficient kernel approximation and Bayesian kernel learning in large-scale regression problems.
method Stein variational gradient descent to generate high-quality random features and approximate spectral measure posteriors.
result SRF outperforms traditional approaches in kernel approximation and GP regression.

We introduce a new principle for model selection in regression and classification. Many regression models are controlled by some smoothness or flexibility or complexity parameter c, e.g. the number of neighbors to be averaged over in k nearest neighbor (kNN) regression or the polynomial degree in regression with polyno…

2007-02-27abs ↗pdf ↗

Improves regression efficiency by separating material and immaterial parts of responses.

problem Improving estimation efficiency in nonlinear multivariate regressions.
method Kernel envelope (KENV) estimator for nonparametric response envelopes in reproducing kernel Hilbert space.
result KENV achieves lower in-sample prediction risk than kernel ridge regression in non-trivial immaterial components.

Finite mixtures of regression models offer a flexible framework for investigating heterogeneity in data with functional dependencies. These models can be conveniently used for unsupervised learning on data with clear regression relationships. We extend such models by imposing an eigen-decomposition on the multivariate …

2013-12-02abs ↗pdf ↗

Over the last decades, the challenges in applied regression and in predictive modeling have been changing considerably: (1) More flexible model specifications are needed as big(ger) data become available, facilitated by more powerful computing infrastructure. (2) Full probabilistic modeling rather than predicting just …

2019-09-25abs ↗pdf ↗

Bayesian model improves classification performance with flexible uncertainty modeling.

problem Improving classification performance with flexible uncertainty modeling.
method Combines Gaussian process and Dirichlet process priors for latent function and link function, respectively.
result Outperforms standard logistic regression on simulated data.

Develops new algorithms for QRF to handle mixed-frequency and longitudinal data.

problem Handling mixed-frequency and longitudinal data in quantile regression.
method Mixed-Frequency Quantile Regression Forest (MIDAS-QRF) and Finite Mixture Quantile Regression Forest (FM-QRF).
result Valid and flexible models for complex empirical settings in financial risk management and climate-change impact evaluation.

We propose a flexible nonparametric regression method for ultrahigh-dimensional data. As a first step, we propose a fast screening method based on the favored smoothing bandwidth of the marginal local constant regression. Then, an iterative procedure is developed to recover both the important covariates and the regress…

2017-11-28abs ↗pdf ↗

Combines BART and Gaussian process for spatial covariate prediction with uncertainty.

problem Improving spatial prediction models with nonlinear and interaction covariates.
method Bayesian Additive Regression Trees (BART) combined with Gaussian process for spatial dependence.
result Effective in reducing computational burden through INLA and MCMC.

Normalized compound random measures are flexible nonparametric priors for related distributions. We consider building general nonparametric regression models using normalized compound random measure mixture models. Posterior inference is made using a novel pseudo-marginal Metropolis-Hastings sampler for normalized comp…

2016-08-02abs ↗pdf ↗

Although there is a rich literature on methods for allowing the variance in a univariate regression model to vary with predictors, time and other factors, relatively little has been done in the multivariate case. Our focus is on developing a class of nonparametric covariance regression models, which allow an unknown p …

2011-01-11abs ↗pdf ↗

This article proposes Multinomial Probit Bayesian Additive Regression Trees (MPBART) as a multinomial probit extension of BART - Bayesian Additive Regression Trees (Chipman et al (2010)). MPBART is flexible to allow inclusion of predictors that describe the observed units as well as the available choice alternatives. T…

2013-09-30abs ↗pdf ↗

DRN improves actuarial distributional forecasting with interpretable neural networks.

problem Challenges in modeling loss distributional properties with classic methods.
method Combines GLMs with a modified DDR method to flexibly refine baseline distribution.
result DRN improves predictive performance while maintaining interpretability.

SplitWise enhances stepwise regression by adaptively encoding numeric predictors into binary features.

problem Capturing nonlinear relationships in regression models without sacrificing interpretability.
method Adaptive encoding of numeric predictors into binary features using shallow decision trees, assessed by AIC or BIC.
result Consistently produces more parsimonious and generalizable models than traditional techniques.

New algorithm for nonparametric IV regression using stochastic gradients.

problem Identifying causal effects in the presence of unobservable confounders.
method Functional stochastic gradient descent for NPIV regression.
result Superior stability and competitive performance compared to existing methods.

We introduce a new regression framework, Gaussian process regression networks (GPRN), which combines the structural properties of Bayesian neural networks with the non-parametric flexibility of Gaussian processes. This model accommodates input dependent signal and noise correlations between multiple response variables,…

2011-10-19abs ↗pdf ↗

It is shown that the the popular least squares method of option pricing converges even under very general assumptions. This substantially increases the freedom of creating different implementations of the method, with varying levels of computational complexity and flexible approach to regression. It is also argued that…

2014-04-07abs ↗pdf ↗

WDL models density curves using Wasserstein distance and flexible mixture models.

problem Modeling entire distribution and non-negativity constraints.
method Wasserstein distance, Semi-parametric Conditional Gaussian Mixture Models (SCGMM), Majorization-Minimization optimization.
result WDL better characterizes nonlinear dependence of conditional densities.

Riesz regression connects to density ratio estimation for causal inference.

problem Estimating average treatment effects in causal inference.
method Riesz regression as a signed density ratio and least-squares importance fitting.
result Riesz regression and DRE are equivalent, allowing transfer of DRE results.

Flexible estimation of heterogeneous treatment effects lies at the heart of many statistical challenges, such as personalized medicine and optimal resource allocation. In this paper, we develop a general class of two-step algorithms for heterogeneous treatment effect estimation in observational studies. We first estima…

2017-12-13abs ↗pdf ↗

Deep Transformed Gaussian Processes extend TGPs with variational inference for scalable multi-layer modeling.

problem Flexible modeling of complex data distributions.
method DTGPs are a multi-layer model of TGPs using variational inference for scalability.
result DTGPs achieve good scalability and performance in multiple regression datasets.