Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

58116173231 · Jun 202019922001200920172026
48 results for stacked regressions

Stacked regressions improve predictive accuracy by combining estimators.

problem Improve predictive accuracy in regression models.
method Analogous to least-squares, learn combination weights by minimizing regularized empirical risk with nonnegativity constraint.
result The stacked estimator has strictly smaller population risk than the best single estimator, especially when signal-to-noise ratio is small.

Heart rate estimation from electrocardiogram signals is very important for the early detection of cardiovascular diseases. However, due to large individual differences and varying electrocardiogram signal quality, there does not exist a single reliable estimation algorithm that works well on all subjects. Every algorit…

2019-03-26abs ↗pdf ↗

To construct flexible nonlinear predictive distributions, the paper introduces a family of softplus function based regression models that convolve, stack, or combine both operations by convolving countably infinite stacked gamma distributions, whose scales depend on the covariates. Generalizing logistic regression that…

2016-08-23abs ↗pdf ↗

Classification outperforms regression in portfolio construction, yielding higher Sharpe ratios.

problem Determining which machine learning approach (classification vs. regression) is more effective for portfolio construction.
method Used stacking ensemble of gradient boosted tree, random forest, and neural network models.
result Classification yields higher Sharpe ratios and economically significant alphas compared to regression.

The motivation of this work is to improve the performance of standard stacking approaches or ensembles, which are composed of simple, heterogeneous base models, through the integration of the generation and selection stages for regression problems. We propose two extensions to the standard stacking approach. In the fir…

2014-03-28abs ↗pdf ↗

A method to improve gradient boosting models using stacking.

problem Improving the performance of gradient boosting models.
method Proposes a stacking algorithm to learn a meta-model for ensembles of gradient boosting models.
result The proposed approach can be extended to differentiable combination models like neural networks.

Stacking improves inference for multimodal Bayesian posterior distributions.

problem Difficulty of MCMC in moving between modes and underestimation of posterior uncertainty.
method Parallel runs of MCMC, variational, or mode-based inference, combined using Bayesian stacking.
result Stacking efficiently samples from multimodal posterior distributions and represents uncertainty better than variational inference.

The paper proposes a demand prediction model for e-commerce sites using machine learning and stacking.

problem Accurately predicting demand for products sold by multiple sellers at different prices.
method Applied different regression algorithms and stacked generalization for demand prediction.
result Stacked generalization produced almost as good results as individual machine learning methods.

Combination of distributional regression algorithms improves uncertainty estimation of satellite precipitation products.

problem Uncertainty estimation in satellite precipitation products.
method Ensemble learning methods combining conditional zero-adjusted probability distributions estimated with GAMLSS, spline-based GAMLSS, and distributional regression forests.
result Stacking of methods outperformed individual methods in most quantile levels using the quantile loss function.

Improved prediction of soil parameters using Multi-target Stacked Generalisation on EDXRF spectra.

problem Challenges in predicting multiple soil parameters accurately from EDXRF spectra.
method Multi-target Stacked Generalisation (MTSG) method combining multiple regression models.
result MTSG significantly improved prediction accuracy for multiple soil parameters, reducing average error from 0.67 to 0.64.

The paper explores MMPR to select diverse models for scientific insight.

problem Model selection often fails to bring multiple underlying patterns to light.
method Multi-model penalized regression (MMPR) to acknowledge model uncertainty.
result Different penalty settings can promote either shrinkage or sparsity of coefficients in separate models.

The paper evaluates company investment value using machine learning models.

problem Evaluating the investment value of companies based on machine learning.
method Data mining, feature selection, cross-validation, stacking model, Bayesian Ridge Regression.
result The RMSE of the final model is 3.047, indicating improved stability and generalization.

Paper tackles multi-source domain adaptation for regression.

problem Predicting HDL cholesterol levels using gut microbiome data.
method Two-step procedure: 1) Extend a flexible single-source DA algorithm for classification to regression. 2) Augment with ensemble learning for multi-source DA.
result Consistent improvement in HDL cholesterol level prediction performance over existing methods.

One of the current challenges in machine learning is how to deal with data coming at increasing rates in data streams. New predictive learning strategies are needed to cope with the high throughput data and concept drift. One of the data stream mining tasks where new learning strategies are needed is multi-target regre…

2019-03-29abs ↗pdf ↗

Study develops ensemble machine learning framework for predicting groundwater heavy metal pollution.

problem Statistical complexity and spatial heterogeneity of heavy metal contamination in groundwater.
method Nested cross-validated ensemble machine learning with response transformations (raw, log, Gaussian copula).
result Copula-based models with DBSCAN clustering diagnostics provide the most reliable and interpretable assessments of groundwater contamination.

Stacking is a general approach for combining multiple models toward greater predictive accuracy. It has found various application across different domains, ensuing from its meta-learning nature. Our understanding, nevertheless, on how and why stacking works remains intuitive and lacking in theoretical insight. In this …

2019-01-26abs ↗pdf ↗

We review the basic definition of a stack and apply it to the topological and smooth settings. We then address two subtleties of the theory: the correct definition of a ``stack over a stack'' and the distinction between small stacks (which are algebraic objects) and large stacks (which are generalized spaces).

2003-06-10abs ↗pdf ↗

This paper demonstrates how to apply machine learning algorithms to distinguish good stocks from the bad stocks. To this end, we construct 244 technical and fundamental features to characterize each stock, and label stocks according to their ranking with respect to the return-to-volatility ratio. Algorithms ranging fro…

2018-06-05abs ↗pdf ↗

In this article, we derive many properties of étale stacks in various contexts, and prove that étale stacks may be characterized categorically as those stacks that arise as prolongations of stacks on a site of spaces and local homeomorphisms. Moreover, we show that the bicategory of étale differentiable stacks and loca…

2012-12-11abs ↗pdf ↗

This research predicts Bitcoin prices using wavelet and deep stacking approach.

problem Predicting price fluctuations of Bitcoin due to its price volatility.
method Wavelet for noise removal, deep learning models (neural networks and transformers), feature selection.
result The model achieved high accuracy in predicting Bitcoin prices at different time intervals.

Ensembles are popular methods for solving practical supervised learning problems. They reduce the risk of having underperforming models in production-grade software. Although critical, methods for learning heterogeneous regression ensembles have not been proposed at large scale, whereas in classical ML literature, stac…

2018-04-17abs ↗pdf ↗

New neural stack and Turing Machine architectures prove stability and computational power.

problem Designing stable neural network architectures for Turing Machine simulation.
method Introducing neural stack and Turing Machine architectures, proving stability and computational equivalence.
result Differentiable nnTM with bounded neurons can simulate Turing Machine in real-time and is equivalent to UTM.

Warfarin dosing remains challenging due to narrow therapeutic index and highly individual variability. Incorrect warfarin dosing is associated with devastating adverse events. Remarkable efforts have been made to develop the machine learning based warfarin dosing algorithms incorporating clinical factors and genetic va…

2018-09-10abs ↗pdf ↗

Bayesian stacking improves model performance with varying model weights.

problem Improving model predictions with heterogeneous input performance.
method Bayesian hierarchical stacking with varying model weights inferred via Bayesian inference.
result Hierarchical stacking yields better predictions than linear averaging.

We generalize the notion of a small sheaf of sets over a topological space or manifold to define the notion of a small stack of groupoids over an étale topological or differentiable stack. We then provide a construction analogous to the étalé space construction in this context, establishing an equivalence of 2-categori…

2010-11-28abs ↗pdf ↗

This work characterizes global quotient stacks---smooth stacks associated to a finite group acting a manifold---among smooth quotient stacks [M/G][M/G], where MM is a smooth manifold equipped with a smooth proper action by a Lie group GG. The characterization is described in terms of the action of the connected componen…

2013-02-02abs ↗pdf ↗

Constructs moduli stacks for quiver connections and extends non-Abelian Hodge theory.

problem Extending non-Abelian Hodge theory to moduli stacks of quiver connections.
method Formalizes and constructs moduli stacks of bundles with λ-connections over prestacks.
result Shows moduli stacks are algebraic and locally of finite presentation when base is smooth and projective.

A new machine learning framework called machine collaboration improves prediction accuracy.

problem Improving prediction accuracy in machine learning.
method Machine Collaboration (MaC) framework, which uses a circular and interactive learning approach.
result Machine Collaboration framework significantly outperforms other state-of-the-art methods in most cases.

Study connections on Lie groupoids and stacks using Atiyah sequences.

problem No specific problem stated; general connections on Lie groupoids and stacks.
method Construct connections using Atiyah sequences associated with transversal tangential distributions.
result Detailed study and construction of connections on Lie groupoids and stacks.

In this paper, we consider diffeological spaces as stacks over the site of smooth manifolds, as well as the "underlying" diffeological space of any stack. More precisely, we consider diffeological spaces as so-called concrete sheaves and show that the Grothendieck construction sending these sheaves to stacks has a left…

2014-06-05abs ↗pdf ↗

Constructs moduli stacks of quiver bundles and applies to Higgs bundles.

problem Classifying morphisms of vector bundles over a fixed base.
method General method for constructing moduli stacks of diagrams of vector bundles indexed by a simplicial set.
result Recovery of Nakajima quiver varieties and alternate construction of moduli stacks of Higgs bundles.