Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

201402603804 · Jun 202019922001200920172026
48 results for neural stack

New neural stack and Turing Machine architectures prove stability and computational power.

problem Designing stable neural network architectures for Turing Machine simulation.
method Introducing neural stack and Turing Machine architectures, proving stability and computational equivalence.
result Differentiable nnTM with bounded neurons can simulate Turing Machine in real-time and is equivalent to UTM.

NeSS combines neural and symbolic approaches for better compositional generalization.

problem Lack of compositional generalization in deep learning models.
method NeSS uses a neural network to generate traces, executed by a symbolic stack machine with sequence manipulation.
result Achieves 100% generalization performance across multiple domains.

We study compositional generalization, viz., the problem of zero-shot generalization to novel compositions of concepts in a domain. Standard neural networks fail to a large extent on compositional learning. We propose Tree Stack Memory Units (Tree-SMU) to enable strong compositional generalization. Tree-SMU is a recurs…

2019-11-05abs ↗pdf ↗

The deep network model, with the majority built on neural networks, has been proved to be a powerful framework to represent complex data for high performance machine learning. In recent years, more and more studies turn to nonneural network approaches to build diverse deep structures, and the Deep Stacking Network (DSN…

2019-02-15abs ↗pdf ↗

A method to improve gradient boosting models using stacking.

problem Improving the performance of gradient boosting models.
method Proposes a stacking algorithm to learn a meta-model for ensembles of gradient boosting models.
result The proposed approach can be extended to differentiable combination models like neural networks.

Tropical cyclone wind-intensity prediction is a challenging task considering drastic changes climate patterns over the last few decades. In order to develop robust prediction models, one needs to consider different characteristics of cyclones in terms of spatial and temporal characteristics. Transfer learning incorpora…

2017-08-22abs ↗pdf ↗

Predicting the direction of assets have been an active area of study and a difficult task. Machine learning models have been used to build robust models to model the above task. Ensemble methods is one of them showing results better than a single supervised method. In this paper, we have used generative and discriminat…

2019-02-21abs ↗pdf ↗

In healthcare, making the best possible predictions with complex models (e.g., neural networks, ensembles/stacks of different models) can impact patient welfare. In order to make these complex models explainable, we present DeepSHAP for mixed model types, a framework for layer wise propagation of Shapley values that bu…

2019-11-27abs ↗pdf ↗

Model predicts S&P500 volatility more accurately than existing models.

problem Improving accuracy of volatility and market risk forecasts.
method Stacked model using Gradient Descent Boosting, Random Forest, SVM, and Artificial Neural Network.
result The model outperforms other models in forecasting S&P500 volatility.

In this paper, a taxonomy for memory networks is proposed based on their memory organization. The taxonomy includes all the popular memory networks: vanilla recurrent neural network (RNN), long short term memory (LSTM ), neural stack and neural Turing machine and their variants. The taxonomy puts all these networks und…

2018-05-01abs ↗pdf ↗

Paper proposes a new reserving model using machine learning techniques.

problem Managing uncertainties in premium sufficiency and reserves for future claims.
method Stacked model combining Gradient Boosting, Random Forest, Artificial Neural Networks, and log-normal approach.
result The proposed model improves traditional reserving techniques, leading to more accurate reserving risk assessment.

Stacking improves inference for multimodal Bayesian posterior distributions.

problem Difficulty of MCMC in moving between modes and underestimation of posterior uncertainty.
method Parallel runs of MCMC, variational, or mode-based inference, combined using Bayesian stacking.
result Stacking efficiently samples from multimodal posterior distributions and represents uncertainty better than variational inference.

In this work, we propose a novel recurrent neural network (RNN) architecture. The proposed RNN, gated-feedback RNN (GF-RNN), extends the existing approach of stacking multiple recurrent layers by allowing and controlling signals flowing from upper recurrent layers to lower layers using a global gating unit for each pai…

2015-02-09abs ↗pdf ↗

Stacking is a general approach for combining multiple models toward greater predictive accuracy. It has found various application across different domains, ensuing from its meta-learning nature. Our understanding, nevertheless, on how and why stacking works remains intuitive and lacking in theoretical insight. In this …

2019-01-26abs ↗pdf ↗

We review the basic definition of a stack and apply it to the topological and smooth settings. We then address two subtleties of the theory: the correct definition of a ``stack over a stack'' and the distinction between small stacks (which are algebraic objects) and large stacks (which are generalized spaces).

2003-06-10abs ↗pdf ↗

In this article, we derive many properties of étale stacks in various contexts, and prove that étale stacks may be characterized categorically as those stacks that arise as prolongations of stacks on a site of spaces and local homeomorphisms. Moreover, we show that the bicategory of étale differentiable stacks and loca…

2012-12-11abs ↗pdf ↗

This research predicts Bitcoin prices using wavelet and deep stacking approach.

problem Predicting price fluctuations of Bitcoin due to its price volatility.
method Wavelet for noise removal, deep learning models (neural networks and transformers), feature selection.
result The model achieved high accuracy in predicting Bitcoin prices at different time intervals.

Bayesian stacking improves model performance with varying model weights.

problem Improving model predictions with heterogeneous input performance.
method Bayesian hierarchical stacking with varying model weights inferred via Bayesian inference.
result Hierarchical stacking yields better predictions than linear averaging.

Study improves fraud detection in e-commerce with a stacked model combining CNNs, GNNs, and confidence gating.

problem Detecting credit card fraud in online transactions.
method Stacking approach with attention and confidence-driven layers, using DOWA and IOWA operators.
result The method achieves high accuracy and robust generalization in CCF detection.

We generalize the notion of a small sheaf of sets over a topological space or manifold to define the notion of a small stack of groupoids over an étale topological or differentiable stack. We then provide a construction analogous to the étalé space construction in this context, establishing an equivalence of 2-categori…

2010-11-28abs ↗pdf ↗

This work characterizes global quotient stacks---smooth stacks associated to a finite group acting a manifold---among smooth quotient stacks [M/G][M/G], where MM is a smooth manifold equipped with a smooth proper action by a Lie group GG. The characterization is described in terms of the action of the connected componen…

2013-02-02abs ↗pdf ↗

Autoregressive models are among the best performing neural density estimators. We describe an approach for increasing the flexibility of an autoregressive model, based on modelling the random numbers that the model uses internally when generating data. By constructing a stack of autoregressive models, each modelling th…

2017-05-19abs ↗pdf ↗

Constructs moduli stacks for quiver connections and extends non-Abelian Hodge theory.

problem Extending non-Abelian Hodge theory to moduli stacks of quiver connections.
method Formalizes and constructs moduli stacks of bundles with λ-connections over prestacks.
result Shows moduli stacks are algebraic and locally of finite presentation when base is smooth and projective.

Study connections on Lie groupoids and stacks using Atiyah sequences.

problem No specific problem stated; general connections on Lie groupoids and stacks.
method Construct connections using Atiyah sequences associated with transversal tangential distributions.
result Detailed study and construction of connections on Lie groupoids and stacks.

In this paper, we consider diffeological spaces as stacks over the site of smooth manifolds, as well as the "underlying" diffeological space of any stack. More precisely, we consider diffeological spaces as so-called concrete sheaves and show that the Grothendieck construction sending these sheaves to stacks has a left…

2014-06-05abs ↗pdf ↗

Constructs moduli stacks of quiver bundles and applies to Higgs bundles.

problem Classifying morphisms of vector bundles over a fixed base.
method General method for constructing moduli stacks of diagrams of vector bundles indexed by a simplicial set.
result Recovery of Nakajima quiver varieties and alternate construction of moduli stacks of Higgs bundles.

Code search and comprehension have become more difficult in recent years due to the rapid expansion of available source code. Current tools lack a way to label arbitrary code at scale while maintaining up-to-date representations of new programming languages, libraries, and functionalities. Comprehensive labeling of sou…

2019-06-03abs ↗pdf ↗

Neural network predicts weather probabilities with added uncertainty.

problem Inferring uncertainty from weather predictions.
method Data-driven neural network trained on WeatherBench dataset, combining outputs from subsets of variables.
result More accurate than some numerical models, provides probabilistic information.

Currently there are two predominant ways to train deep neural networks. The first one uses restricted Boltzmann machine (RBM) and the second one autoencoders. RBMs are stacked in layers to form deep belief network (DBN); the final representation layer is attached to the target to complete the deep neural network. Autoe…

2016-12-22abs ↗pdf ↗

This thesis is divided into four chapters. The first chapter discusses the relationship between stacks on a site and groupoids internal to the site. It includes a rigorous proof of the folklore result that there is an equivalence between the bicategory of internal groupoids and the bicategory of geometric stacks. The s…

2018-06-05abs ↗pdf ↗

LATTE tackles heterogeneous network embedding challenges with layer-stacked attention.

problem Aggregating higher-order indirect relations in heterogeneous networks.
method Layer-stacked ATTention Embedding (LATTE) that decomposes meta relations at each layer.
result LATTE achieves state-of-the-art performance on benchmark datasets.