Stacking is a general approach for combining multiple models toward greater predictive accuracy. It has found various application across different domains, ensuing from its meta-learning nature. Our understanding, nevertheless, on how and why stacking works remains intuitive and lacking in theoretical insight. In this …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “stacked generalization”
We review the basic definition of a stack and apply it to the topological and smooth settings. We then address two subtleties of the theory: the correct definition of a ``stack over a stack'' and the distinction between small stacks (which are algebraic objects) and large stacks (which are generalized spaces).
Constructs cohomology decompositions for symmetric stacks.
problem Cohomology of symmetric stacks.
method Constructs decompositions of cohomology, Borel--Moore homology, and vanishing cycle cohomology.
result Defines BPS cohomology and proves its equivalence to intersection cohomology for smooth stacks.
We study compositional generalization, viz., the problem of zero-shot generalization to novel compositions of concepts in a domain. Standard neural networks fail to a large extent on compositional learning. We propose Tree Stack Memory Units (Tree-SMU) to enable strong compositional generalization. Tree-SMU is a recurs…
In this article, we derive many properties of étale stacks in various contexts, and prove that étale stacks may be characterized categorically as those stacks that arise as prolongations of stacks on a site of spaces and local homeomorphisms. Moreover, we show that the bicategory of étale differentiable stacks and loca…
Bayesian stacking improves model performance with varying model weights.
problem Improving model predictions with heterogeneous input performance.
method Bayesian hierarchical stacking with varying model weights inferred via Bayesian inference.
result Hierarchical stacking yields better predictions than linear averaging.
Paper proves stacking ensembling is effective and proposes a new family of stacked generalizations.
problem Lack of theoretical guarantees for stacking ensembling methods.
method Proves novel theoretical result and proposes a new family of stacked generalizations.
result Proves stacking ensembling is effective and proposes a new family of stacked generalizations.
Study connections on Lie groupoids and stacks using Atiyah sequences.
problem No specific problem stated; general connections on Lie groupoids and stacks.
method Construct connections using Atiyah sequences associated with transversal tangential distributions.
result Detailed study and construction of connections on Lie groupoids and stacks.
NeSS combines neural and symbolic approaches for better compositional generalization.
problem Lack of compositional generalization in deep learning models.
method NeSS uses a neural network to generate traces, executed by a symbolic stack machine with sequence manipulation.
result Achieves 100% generalization performance across multiple domains.
We develop a universal framework to study smooth higher orbifolds on the one hand and higher Deligne-Mumford stacks (as well as their derived and spectral variants) on the other, and use this framework to obtain a completely categorical description of which stacks arise as the functor of points of such objects. We choo…
We generalize the notion of a small sheaf of sets over a topological space or manifold to define the notion of a small stack of groupoids over an étale topological or differentiable stack. We then provide a construction analogous to the étalé space construction in this context, establishing an equivalence of 2-categori…
We propose a novel stacked generalization (stacking) method as a dynamic ensemble technique using a pool of heterogeneous classifiers for node label classification on networks. The proposed method assigns component models a set of functional coefficients, which can vary smoothly with certain topological features of a n…
A theory of dg schemes is developed so that it becomes a homotopy site, and the corresponding infinity category of stacks is equivalent to the infinity category of stacks, as constructed by Toen and Vezzosi, on the site of dg algebras whose cohomologies have finitely many generators in each degree. Stacks represented b…
The BPS decomposition theorem splits cohomology of symmetric stacks into invariant parts.
problem Decomposing the cohomology of smooth symmetric stacks into invariant parts.
method Using cohomological Hall induction and intersection cohomology of moduli spaces.
result Establishes the BPS decomposition theorem for various symplectic stacks.
Constructs moduli stacks of quiver bundles and applies to Higgs bundles.
problem Classifying morphisms of vector bundles over a fixed base.
method General method for constructing moduli stacks of diagrams of vector bundles indexed by a simplicial set.
result Recovery of Nakajima quiver varieties and alternate construction of moduli stacks of Higgs bundles.
In this paper we relate the study of actions of discrete groups over connected manifolds to that of their orbit spaces seen as differentiable stacks. We show that the orbit stack of a discrete dynamical system on a simply connected manifold encodes the dynamics up to conjugation and inversion. We also prove a generaliz…
Stacking methods improve the prediction performance of regression models. A simple way to stack base regressions estimators is by combining them linearly, as done by \citet{breiman1996stacked}. Even though this approach is useful from an interpretative perspective, it often does not lead to high predictive power. We pr…
pystacked combines machine learning models for improved predictions.
problem Improving machine learning model performance through stacking.
method Stacked generalization using Python's scikit-learn with various base learners.
result Enhanced predictive models through combining multiple machine learning algorithms.
We introduce the notion of cofoliation on a stack. A cofoliation is a change of the differentiable structure which amounts to giving a full representable smooth epimorphism. Cofoliations are uniquely determined by their associated Lie algebroids. Cofoliations on stacks arise from flat connections on groupoids. Connecti…
Study uses stacked generalization to improve fraud detection algorithms.
problem Improving performance of algorithms in imbalanced fraud data sets.
method Two-step process combining machine learning methods and cross-validation.
result Improved performance metrics on resampled fraud data sets.
Study of quantum decorated character stacks and their quantizations.
problem Quantization of decorated character stacks and their compatibility with cutting and gluing.
method Using stratified factorization homology, extend Fock and Goncharov's construction to include stacky points.
result Construction of categorical charts and flips on quantum decorated character stacks.
This paper introduces the notions of vector field and flow on a general differentiable stack. Our main theorem states that the flow of a vector field on a compact proper differentiable stack exists and is unique up to a uniquely determined 2-cell. This extends the usual result on the existence and uniqueness of flows o…
New neural stack and Turing Machine architectures prove stability and computational power.
problem Designing stable neural network architectures for Turing Machine simulation.
method Introducing neural stack and Turing Machine architectures, proving stability and computational equivalence.
result Differentiable nnTM with bounded neurons can simulate Turing Machine in real-time and is equivalent to UTM.
A new mathematical approach to general covariance using stacks and Lie algebras.
problem Understanding general covariance in curved spacetime field theories.
method Using stacks and groupoids to study the quotient of metrics modulo diffeomorphism, and analyzing the tangent complex and Lie algebra actions.
result Recovering a novel expression for the stress-energy tensor in scalar field theories.
Describes the Teichmüller stack and its variants, answering questions about orbifold points and local models.
problem Understanding the structure and properties of Teichmüller stacks and their variants.
method Analyzes the Teichmüller stack and its variants using the compactness of cycle spaces in the Kähler setting.
result Detailed answers to questions about orbifold points and local models in Teichmüller stacks and variants.
StackGenVis simplifies ensemble learning by visualizing model selection and performance.
problem Complexity in choosing and combining models for stacking ensemble learning.
method Visual analytics system that dynamically adapts performance metrics, manages data instances, selects algorithms, and measures predictive performance.
result Reduces complexity of stacking by removing overpromising and underperforming models.
In this paper we study the topological T-dual of spaces with a non-free circle action mainly using the stack theory method of Bunke and co-workers \cite{Bunke1}. We first compare three formalisms for obtaining the Topological T-dual of a semi-free -space in a simple example. Then, we calculate the T-dual of genera…
In this paper, we propose a novel generative model named Stacked Generative Adversarial Networks (SGAN), which is trained to invert the hierarchical representations of a bottom-up discriminative network. Our model consists of a top-down stack of GANs, each learned to generate lower-level representations conditioned on …
The paper studies higher geometric structures and connections on manifolds, constructing moduli stacks and proving equivalence criteria.
problem Classifying and understanding higher geometric structures and connections on manifolds.
method Constructing smooth higher symmetry groups, moduli stacks, and higher gauge actions; proving equivalence criteria.
result Construction and classification of moduli stacks of higher geometric data and connections.
Paper combines machine learning and model averaging for robust parameter estimation.
problem Estimating structural parameters with partially unknown functional forms.
method Pairing double/debiased machine learning with stacking for model averaging.
result DDML with stacking is more robust to unknown functional forms than single learners.
We extend Massey products from cohomology to differential cohomology via stacks, organizing and generalizing existing constructions in Deligne cohomology. We study the properties and show how they are related to more classical Massey products in de Rham, singular, and Deligne cohomology. The setting and the algebraic m…
SStaGCN improves GCN by stacking and aggregation for better node feature extraction.
problem Mitigating over-smoothing in GCN for heterogeneous graph data.
method SStaGCN combines stacking and aggregation to improve GCN performance.
result SStaGCN effectively mitigates over-smoothing and enhances node feature extraction.
The paper proposes a demand prediction model for e-commerce sites using machine learning and stacking.
problem Accurately predicting demand for products sold by multiple sellers at different prices.
method Applied different regression algorithms and stacked generalization for demand prediction.
result Stacked generalization produced almost as good results as individual machine learning methods.
Kuranishi and Teichmüllermath.CV
The goal of this short article is to describe the local structure of the Teichmüller stack of [8] in the neighborhood of a Kähler point. In particular we show that at a generic Kähler point X, Catanese Kur=Teich question, when interpretated at the level of stacks, has an affirmative answer. The situation may be much mo…
This work characterizes global quotient stacks---smooth stacks associated to a finite group acting a manifold---among smooth quotient stacks , where is a smooth manifold equipped with a smooth proper action by a Lie group . The characterization is described in terms of the action of the connected componen…
This paper proves cohomology invariants for differentiable stacks.
problem Understanding cohomology of differentiable stacks.
method Simplicial approach to representations up to homotopy.
result Cohomology with coefficients in a representation up to homotopy is a Morita invariant of the underlying stack.
Stacked conformal predictionstat.ML
Stacked conformal prediction simplifies model validation.
problem Validating stacked predictive models efficiently.
method Meta-learner at the top of a stacked ensemble for approximate marginal validity.
result The method achieves approximate marginal validity without a separate calibration sample.
Constructs moduli stacks for quiver connections and extends non-Abelian Hodge theory.
problem Extending non-Abelian Hodge theory to moduli stacks of quiver connections.
method Formalizes and constructs moduli stacks of bundles with λ-connections over prestacks.
result Shows moduli stacks are algebraic and locally of finite presentation when base is smooth and projective.
We generalize geometric prequantization of symplectic manifolds to differentiable stacks. Our approach is atlas-independent and provides a bijection between isomorphism classes of principal circle bundles (with or without connections) and second cohomology groups of certain chain complexes.
In this paper, we consider diffeological spaces as stacks over the site of smooth manifolds, as well as the "underlying" diffeological space of any stack. More precisely, we consider diffeological spaces as so-called concrete sheaves and show that the Grothendieck construction sending these sheaves to stacks has a left…
New potentials found for sheaves on Calabi-Yau 4-folds.
problem Understanding sheaves on Calabi-Yau 4-folds.
method Derived Quot-stacks and Lagrangian distributions.
result Globally defined -shifted potentials on sheaves.
MetaStackVis aids in choosing better metamodels for stacking ensembles.
problem Difficulty in selecting optimal metamodels for stacking ensembles.
method Interactive visualization tool to explore and compare different metamodels.
result Alternative metamodels significantly improve stacking ensemble performance.
Stacks in Poisson Geometrymath.DG
This thesis is divided into four chapters. The first chapter discusses the relationship between stacks on a site and groupoids internal to the site. It includes a rigorous proof of the folklore result that there is an equivalence between the bicategory of internal groupoids and the bicategory of geometric stacks. The s…
Stacked LSTM networks improve traffic volume forecasting.
problem Accurate traffic volume prediction for better planning.
method Applying stacked Long Short-Term Memory (LSTM) networks for time series forecasting.
result Stacked LSTM networks enhance the accuracy of traffic volume predictions.
Stacked regressions improve predictive accuracy by combining estimators.
problem Improve predictive accuracy in regression models.
method Analogous to least-squares, learn combination weights by minimizing regularized empirical risk with nonnegativity constraint.
result The stacked estimator has strictly smaller population risk than the best single estimator, especially when signal-to-noise ratio is small.
We develop a theory of parametrized geometric cobordism by introducing smooth Thom stacks. This requires identifying and constructing a smooth representative of the Thom functor acting on vector bundles equipped with extra geometric data, leading to a geometric refinement of the the Pontrjagin-Thom construction in stac…
Studies geometric structures on Lie groupoids and differentiable stacks.
problem None explicitly stated in the abstract.
method Various geometric structures and connections on Lie groupoids and differentiable stacks.
result Introduces new concepts like topological groupoid extensions and gerbes over topological stacks.
Maps vector fields between stacks and orbit spaces.
problem Understanding vector fields on stacks and orbit spaces.
method Morita stratifications and geometric vector fields correspondence.
result Derives stacky version of Gauss lemma and extends Palais' theorem.