Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

20406080 · Jun 202019922001200920172026
48 results for multi-layer ensemble

Paper proposes an online learning method with multi-level adaptivity for diverse loss functions.

problem Online learning with unknown types and curvatures of functions.
method Multi-layer online ensemble approach with gradient variations.
result Achieves improved regret bounds for different types of loss functions.

This paper explores estimating chaotic dynamics and parameters using local ensemble Kalman filters.

problem Estimating chaotic dynamics and parameters from observations.
method Local ensemble Kalman filters with covariance and local domain localisation.
result Rigorously updating global parameters using a local domain ensemble Kalman filter.

LIFE framework improves model accuracy and interpretability.

problem Achieving high prediction accuracy and interpretability in neural networks.
method Three-step process: subset definition, feature creation, and linear model combination.
result LIFE consistently outperforms other models in prediction accuracy and interpretability.

Nowadays, deep neural networks (DNNs) have become the main instrument for machine learning tasks within a wide range of domains, including vision, NLP, and speech. Meanwhile, in an important case of heterogenous tabular data, the advantage of DNNs over shallow counterparts remains questionable. In particular, there is …

2019-09-13abs ↗pdf ↗

A deep neural network (DNN) based power control method is proposed, which aims at solving the non-convex optimization problem of maximizing the sum rate of a multi-user interference channel. Towards this end, we first present PCNet, which is a multi-layer fully connected neural network that is specifically designed for…

2018-07-26abs ↗pdf ↗

Hybrid model combines LSTM and ETS for mid-term electric load forecasting.

problem Mid-term electric load forecasting accuracy.
method Combines LSTM, ETS, and ensemble learning; uses dilated LSTM for long-term relationships.
result High performance and competitiveness compared to classical and machine learning models.

End-to-end pipeline for data-driven decision making in mixed-integer optimization.

problem Data-driven decision making in mixed-integer optimization with uncertainty.
method Exploiting mixed-integer optimization-representability of machine learning methods, characterizing decision trust regions, and ensembling multiple models.
result Framework generates high-quality prescriptions and controls model robustness.

TWIST algorithm detects communities in multi-layer networks with tensor decomposition.

problem Community detection in multi-layer networks with multiple node-modality relationships.
method Tensor-based TWIST algorithm for global/local node and layer memberships.
result Accurate community detection with small misclassification error as network size increases.

This work tackles asymmetric community estimation in multi-layer directed networks.

problem Estimating different numbers of sender and receiver communities in multi-layer directed networks.
method Proposes a goodness-of-fit test based on the largest singular value of an aggregated normalized residual matrix.
result Develops sequential and ratio-based testing procedures to consistently determine true sender and receiver community numbers.

Proposes a balanced multi-component and multi-layer neural network for efficient function approximation.

problem Accurately and efficiently approximating complex functions with high degrees of freedom and computational cost.
method Inspired by a multi-component approach, MMNN combines single-layer networks with a multi-layer decomposition strategy.
result Significant reduction in training parameters, more efficient training process, and improved accuracy compared to FCNNs or MLPs.

New AMP algorithms improve multi-layer signal reconstruction.

problem Reconstructing signals and hidden variables from multi-layer networks with rotationally invariant weights.
method Developed multi-layer rotationally invariant generalized AMP (ML-RI-GAMP) algorithms and state evolution recursion.
result ML-RI-GAMP outperforms existing methods in terms of lower complexity and similar performance.

New model for multi-layer categorical data improves latent class analysis.

problem Traditional latent class analysis for single-layer categorical data is insufficient for multi-layer data.
method Developed a multi-layer latent class model (multi-layer LCM) and three spectral methods for estimation.
result The debiased sum of Gram matrices method performs best in estimating latent classes.

Combining different models is a widely used paradigm in machine learning applications. While the most common approach is to form an ensemble of models and average their individual predictions, this approach is often rendered infeasible by given resource constraints in terms of memory and computation, which grow linearl…

2019-10-12abs ↗pdf ↗

Learned data models based on sparsity are widely used in signal processing and imaging applications. A variety of methods for learning synthesis dictionaries, sparsifying transforms, etc., have been proposed in recent years, often imposing useful structures or properties on the models. In this work, we focus on sparsif…

2018-10-19abs ↗pdf ↗

Paper optimizes clustering for multi-layer networks and discrete mixtures.

problem Optimizing clustering in multi-layer networks and discrete mixtures.
method Two-stage method: tensor-based initialization and likelihood-based refinement.
result Achieves minimax optimal error rate for multi-layer networks and discrete mixtures.

FMMNN combines sine activations with multi-component, multi-layer structure for high-frequency function approximation.

problem Effective representation and learning of high-frequency features in neural networks.
method Introduces FMMNN with sine-type activations and multi-component, multi-layer structure.
result FMMNN achieves strong accuracy and favorable convergence on oscillatory function-approximation benchmarks.

Multi-layer optical film has been found to afford important applications in optical communication, optical absorbers, optical filters, etc. Different algorithms of multi-layer optical film design has been developed, as simplex method, colony algorithm, genetic algorithm. These algorithms rapidly promote the design and …

2018-12-07abs ↗pdf ↗

This work defines a new function space for multi-layer neural networks.

problem Characterizing the function space of multi-layer neural networks.
method Defining a neural Hilbert ladder (NHL) as an infinite union of reproducing kernel Hilbert spaces (RKHSs).
result Established theoretical properties of the new function space, including generalization guarantees and dynamics of random fields.

We consider the problem of reconstructing a signal from multi-layered (possibly) non-linear measurements. Using non-rigorous but standard methods from statistical physics we present the Multi-Layer Approximate Message Passing (ML-AMP) algorithm for computing marginal probabilities of the corresponding estimation proble…

2017-01-24abs ↗pdf ↗

Inferencing with network data necessitates the mapping of its nodes into a vector space, where the relationships are preserved. However, with multi-layered networks, where multiple types of relationships exist for the same set of nodes, it is crucial to exploit the information shared between layers, in addition to the …

2018-09-20abs ↗pdf ↗

GCNs improve multi-layer network classification by expanding the distance between means.

problem Improving multi-layer network classification with graphical information.
method Theoretical and empirical study of graph convolutions in multi-layer networks.
result Graph convolutions expand the classification regime by a factor of 1/Emdeg41/\sqrt[4]{\mathbb{E}{ m deg}}.

Paper proposes a method to predict disk failures using multi-layer domain adaptive learning.

problem Traditional machine learning models struggle to predict disk failures due to limited data.
method Multi-layer domain adaptive learning with source and target domains.
result The proposed method improves failure prediction accuracy on disk data with few failure samples.

Deep generative priors offer powerful models for complex-structured data, such as images, audio, and text. Using these priors in inverse problems typically requires estimating the input and/or hidden signals in a multi-layer deep neural network from observation of its output. While these approaches have been successful…

2019-11-08abs ↗pdf ↗

A generative model is developed for deep (multi-layered) convolutional dictionary learning. A novel probabilistic pooling operation is integrated into the deep model, yielding efficient bottom-up (pretraining) and top-down (refinement) probabilistic learning. Experimental results demonstrate powerful capabilities of th…

2015-04-15abs ↗pdf ↗

Multi-layered representation is believed to be the key ingredient of deep neural networks especially in cognitive tasks like computer vision. While non-differentiable models such as gradient boosting decision trees (GBDTs) are the dominant methods for modeling discrete or tabular data, they are hard to incorporate with…

2018-05-31abs ↗pdf ↗

We consider the problem of inferring the input and hidden variables of a stochastic multi-layer neural network from an observation of the output. The hidden variables in each layer are represented as matrices. This problem applies to signal recovery via deep generative prior models, multi-task and mixed regression and …

2020-01-26abs ↗pdf ↗

New Banach spaces for ReLU networks enable better function approximation and gradient dynamics analysis.

problem Function approximation and gradient dynamics in multi-layer ReLU networks.
method Developed Banach spaces for ReLU networks, defined new function representations, and analyzed gradient flow dynamics.
result Gradient flow dynamics of the new representation is the continuous analog of gradient descent for ReLU networks.

SRR detects early signs of financial crises using multi-layer graphs.

problem Predicting systemic financial transitions from evolving market interactions.
method Systemic Risk Radar (SRR) models financial markets as multi-layer graphs.
result Graph-derived features provide useful early-warning signals compared to feature-based models.

How can local-search methods such as stochastic gradient descent (SGD) avoid bad local minima in training multi-layer neural networks? Why can they fit random labels even given non-convex and non-smooth architectures? Most existing theory only covers networks with one hidden layer, so can we go deeper? In this paper, w…

2018-10-29abs ↗pdf ↗

Lookahead pruning extends single-layer optimization to multi-layer, outperforming magnitude-based pruning.

problem Pruning neural networks to reduce computational cost and memory usage.
method Developed a multi-layer optimization approach extending the single-layer optimization of magnitude-based pruning.
result Consistently outperforms magnitude-based pruning on various networks, especially in high sparsity.

Improved recommendation systems using multi-layer embeddings reduce model size while maintaining accuracy.

problem Improving model accuracy in recommendation systems while minimizing model size.
method Introducing a multi-layer embedding training (MLET) architecture that trains embeddings via a sequence of linear layers.
result Substantial advantages in model accuracy and memory footprint are achieved with reduced embedding dimensions.

Deep generative priors are a powerful tool for reconstruction problems with complex data such as images and text. Inverse problems using such models require solving an inference problem of estimating the input and hidden units of the multi-layer network from its output. Maximum a priori (MAP) estimation is a widely-use…

2019-03-01abs ↗pdf ↗

Structure inference is an important task for network data processing and analysis in data science. In recent years, quite a few approaches have been developed to learn the graph structure underlying a set of observations captured in a data space. Although real-world data is often acquired in settings where relationship…

2019-10-22abs ↗pdf ↗