The paper analyzes how stacking improves model stability.
problem Lack of theoretical insight into how stacking works.
method Stability analysis of learning algorithms, focusing on hypothesis stability.
result The hypothesis stability of stacking is a product of base models and combiner.
Study uses stacked generalization to improve fraud detection algorithms.
problem Improving performance of algorithms in imbalanced fraud data sets.
method Two-step process combining machine learning methods and cross-validation.
result Improved performance metrics on resampled fraud data sets.
Active stacking improves heart rate estimation accuracy with minimal labeled data.
problem Inconsistent heart rate estimation across subjects due to signal quality and individual differences.
method Active learning and stacking ensemble regression to aggregate base estimators.
result Active stacking significantly outperforms other methods with minimal labeled data.
StackGenVis simplifies ensemble learning by visualizing model selection and performance.
problem Complexity in choosing and combining models for stacking ensemble learning.
method Visual analytics system that dynamically adapts performance metrics, manages data instances, selects algorithms, and measures predictive performance.
result Reduces complexity of stacking by removing overpromising and underperforming models.
LESS combines local predictors for subsets to learn from heterogeneous input-output pairs.
problem Learning from heterogeneous input-output pairs in populations with varied behavior.
method LESS algorithm: generates subsets, trains local predictors, combines them.
result LESS is highly competitive compared to state-of-the-art methods.
Stacked Monte Carlo improves option pricing efficiency.
problem Evaluating option prices in various models.
method A stacking technique that approximates Monte Carlo draws using a specified function.
result Shows efficiency in European and Asian Call options in both constant and stochastic volatility models.
Study evaluates different meta-learners for multi-view stacking.
problem Choosing the best meta-learner for multi-view stacking.
method Seven different meta-learners were evaluated in simulations and real data.
result Nonnegative lasso, nonnegative adaptive lasso, and nonnegative elastic net are suitable meta-learners.
Stacked models improve link prediction across diverse networks.
problem Predicting missing links in complex networks.
method Systematically evaluated 203 link predictor algorithms, combining them into stacked models.
result Stacked models achieve optimal or nearly optimal link prediction accuracy.
Paper proves stacking ensembling is effective and proposes a new family of stacked generalizations.
problem Lack of theoretical guarantees for stacking ensembling methods.
method Proves novel theoretical result and proposes a new family of stacked generalizations.
result Proves stacking ensembling is effective and proposes a new family of stacked generalizations.
pystacked combines machine learning models for improved predictions.
problem Improving machine learning model performance through stacking.
method Stacked generalization using Python's scikit-learn with various base learners.
result Enhanced predictive models through combining multiple machine learning algorithms.
A method to improve gradient boosting models using stacking.
problem Improving the performance of gradient boosting models.
method Proposes a stacking algorithm to learn a meta-model for ensembles of gradient boosting models.
result The proposed approach can be extended to differentiable combination models like neural networks.
Warfarin dosing remains challenging due to narrow therapeutic index and highly individual variability. Incorrect warfarin dosing is associated with devastating adverse events. Remarkable efforts have been made to develop the machine learning based warfarin dosing algorithms incorporating clinical factors and genetic va…
We review the basic definition of a stack and apply it to the topological and smooth settings. We then address two subtleties of the theory: the correct definition of a ``stack over a stack'' and the distinction between small stacks (which are algebraic objects) and large stacks (which are generalized spaces).
In this article, we derive many properties of étale stacks in various contexts, and prove that étale stacks may be characterized categorically as those stacks that arise as prolongations of stacks on a site of spaces and local homeomorphisms. Moreover, we show that the bicategory of étale differentiable stacks and loca…
Constructs cohomology decompositions for symmetric stacks.
problem Cohomology of symmetric stacks.
method Constructs decompositions of cohomology, Borel--Moore homology, and vanishing cycle cohomology.
result Defines BPS cohomology and proves its equivalence to intersection cohomology for smooth stacks.
New insights into choosing between two data integration methods based on SVD.
problem Choosing between two data integration methods (Stack-SVD and SVD-Stack) for shared latent structure across multiple datasets.
method Derive exact expressions for the asymptotic performance and phase transitions of Stack-SVD and SVD-Stack, and develop optimal weighting schemes.
result Optimally weighted Stack-SVD outperforms optimally weighted SVD-Stack in the asymptotic regime.
New neural stack and Turing Machine architectures prove stability and computational power.
problem Designing stable neural network architectures for Turing Machine simulation.
method Introducing neural stack and Turing Machine architectures, proving stability and computational equivalence.
result Differentiable nnTM with bounded neurons can simulate Turing Machine in real-time and is equivalent to UTM.
Stacking improves inference for multimodal Bayesian posterior distributions.
problem Difficulty of MCMC in moving between modes and underestimation of posterior uncertainty.
method Parallel runs of MCMC, variational, or mode-based inference, combined using Bayesian stacking.
result Stacking efficiently samples from multimodal posterior distributions and represents uncertainty better than variational inference.
Bayesian stacking improves model performance with varying model weights.
problem Improving model predictions with heterogeneous input performance.
method Bayesian hierarchical stacking with varying model weights inferred via Bayesian inference.
result Hierarchical stacking yields better predictions than linear averaging.
The paper proposes a demand prediction model for e-commerce sites using machine learning and stacking.
problem Accurately predicting demand for products sold by multiple sellers at different prices.
method Applied different regression algorithms and stacked generalization for demand prediction.
result Stacked generalization produced almost as good results as individual machine learning methods.
Paper combines machine learning and model averaging for robust parameter estimation.
problem Estimating structural parameters with partially unknown functional forms.
method Pairing double/debiased machine learning with stacking for model averaging.
result DDML with stacking is more robust to unknown functional forms than single learners.
This paper demonstrates how to apply machine learning algorithms to distinguish good stocks from the bad stocks. To this end, we construct 244 technical and fundamental features to characterize each stock, and label stocks according to their ranking with respect to the return-to-volatility ratio. Algorithms ranging fro…
Develops theory of differential graded schemes for derived stacks.
problem Creating a theory for derived stacks using dg schemes.
method Formulates dg schemes as homotopy sites, equates to stacks on dg algebras.
result Infinity category of stacks represented by dg schemes is derived schemes.
pRSL combines probabilistic rules to improve multi-label classification.
problem Modeling the structure between multi-label classes for better performance.
method Uses probabilistic propositional logic rules and belief propagation to combine predictions from multiple classifiers.
result pRSL achieves state-of-the-art performance on various benchmark datasets.
We generalize the notion of a small sheaf of sets over a topological space or manifold to define the notion of a small stack of groupoids over an étale topological or differentiable stack. We then provide a construction analogous to the étalé space construction in this context, establishing an equivalence of 2-categori…
NN-Stacking improves predictive power of regression models by adjusting stacking coefficients with features.
problem Low predictive power of linear stacking methods.
method NN-Stacking uses neural networks to estimate adaptive stacking coefficients.
result NN-Stacking leads to better predictive power, especially in large datasets.
Optimizes ensemble weights and hyperparameters for better machine learning model predictions.
problem Improving ensemble model performance through optimal weights and hyperparameters tuning.
method Designing a nested optimization algorithm that tunes hyperparameters and finds optimal ensemble weights, using Bayesian search and a heuristic for diverse base learners.
result The algorithm (GEM-ITH) produces better ensemble model performance across various datasets.
Study predicts heart failure patient survival using stacked ensemble ML.
problem Predicting survival of heart failure patients.
method Collect and analyze patient data, apply SMOTE, use K-Means, Fuzzy C-Means clustering, Random Forest, XGBoost, Decision Tree, and propose a stacked ensemble model.
result Supervised ML algorithms outperform unsupervised models, achieving high accuracy and F1 score.
Memory bandwidth bottleneck is a major challenges in processing machine learning (ML) algorithms. In-memory acceleration has potential to address this problem; however, it needs to address two challenges. First, in-memory accelerator should be general enough to support a large set of different ML algorithms. Second, it…
This work characterizes global quotient stacks---smooth stacks associated to a finite group acting a manifold---among smooth quotient stacks [M/G], where M is a smooth manifold equipped with a smooth proper action by a Lie group G. The characterization is described in terms of the action of the connected componen…
The BPS decomposition theorem splits cohomology of symmetric stacks into invariant parts.
problem Decomposing the cohomology of smooth symmetric stacks into invariant parts.
method Using cohomological Hall induction and intersection cohomology of moduli spaces.
result Establishes the BPS decomposition theorem for various symplectic stacks.
Researchers propose improved multivariate prediction models for HIV drug resistance.
problem Predicting drug resistances of HIV from mutation information.
method Revised stacking algorithms to borrow information among multiple prediction tasks.
result Proposed methods outperform other multivariate prediction methods.
Stacked conformal prediction simplifies model validation.
problem Validating stacked predictive models efficiently.
method Meta-learner at the top of a stacked ensemble for approximate marginal validity.
result The method achieves approximate marginal validity without a separate calibration sample.
Constructs moduli stacks for quiver connections and extends non-Abelian Hodge theory.
problem Extending non-Abelian Hodge theory to moduli stacks of quiver connections.
method Formalizes and constructs moduli stacks of bundles with λ-connections over prestacks.
result Shows moduli stacks are algebraic and locally of finite presentation when base is smooth and projective.
Constructs equivariant cohomology models for differentiable stacks.
problem Developing cohomology theory for stacks with group actions.
method Extends classical results for smooth manifolds to differentiable stacks.
result Derives spectral sequences generalizing Bott's spectral sequence.
Study optimizes shared singular subspace estimation from noisy matrices.
problem Estimating shared singular subspaces across multiple noisy matrices.
method Low-rank matrix denoising framework with Stack-SVD and novel estimators.
result Stack-SVD achieves minimax rate-optimality for identical shared subspaces, and novel estimators for partial sharing.
This paper explores the relationship between gerbes over stacks and Lie groupoid extensions.
problem Exploring the relationship between gerbes over stacks and Lie groupoid extensions.
method Defines a gerbe over a stack and explores its relationship with Lie groupoid extensions.
result Establishes the relationship between gerbes over stacks and Morita equivalence classes of Lie groupoid extensions.
In this paper, we consider diffeological spaces as stacks over the site of smooth manifolds, as well as the "underlying" diffeological space of any stack. More precisely, we consider diffeological spaces as so-called concrete sheaves and show that the Grothendieck construction sending these sheaves to stacks has a left…
Study connections on Lie groupoids and stacks using Atiyah sequences.
problem No specific problem stated; general connections on Lie groupoids and stacks.
method Construct connections using Atiyah sequences associated with transversal tangential distributions.
result Detailed study and construction of connections on Lie groupoids and stacks.
Improved prediction of soil parameters using Multi-target Stacked Generalisation on EDXRF spectra.
problem Challenges in predicting multiple soil parameters accurately from EDXRF spectra.
method Multi-target Stacked Generalisation (MTSG) method combining multiple regression models.
result MTSG significantly improved prediction accuracy for multiple soil parameters, reducing average error from 0.67 to 0.64.
Constructs moduli stacks of quiver bundles and applies to Higgs bundles.
problem Classifying morphisms of vector bundles over a fixed base.
method General method for constructing moduli stacks of diagrams of vector bundles indexed by a simplicial set.
result Recovery of Nakajima quiver varieties and alternate construction of moduli stacks of Higgs bundles.
Tree-SMU enables strong compositional generalization in neural networks.
problem Zero-shot generalization to novel compositions of concepts.
method Tree Stack Memory Units (Tree-SMU) with Stack Memory Units (SMU).
result Tree-SMU achieves strong empirical results on mathematical reasoning benchmarks.
New potentials found for sheaves on Calabi-Yau 4-folds.
problem Understanding sheaves on Calabi-Yau 4-folds.
method Derived Quot-stacks and Lagrangian distributions.
result Globally defined −1-shifted potentials on sheaves. This thesis is divided into four chapters. The first chapter discusses the relationship between stacks on a site and groupoids internal to the site. It includes a rigorous proof of the folklore result that there is an equivalence between the bicategory of internal groupoids and the bicategory of geometric stacks. The s…
Stacked LSTM networks improve traffic volume forecasting.
problem Accurate traffic volume prediction for better planning.
method Applying stacked Long Short-Term Memory (LSTM) networks for time series forecasting.
result Stacked LSTM networks enhance the accuracy of traffic volume predictions.
Studies geometric structures on Lie groupoids and differentiable stacks.
problem None explicitly stated in the abstract.
method Various geometric structures and connections on Lie groupoids and differentiable stacks.
result Introduces new concepts like topological groupoid extensions and gerbes over topological stacks.
We implemented several multilabel classification algorithms in the machine learning package mlr. The implemented methods are binary relevance, classifier chains, nested stacking, dependent binary relevance and stacking, which can be used with any base learner that is accessible in mlr. Moreover, there is access to the …
Stacking improves deep neural network training efficiency.
problem Improving the efficiency of training deep neural networks.
method Proposes stacking as a form of accelerated gradient descent.
result Proves stacking provides accelerated training for certain deep linear residual networks.