Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

55109164218 · Jun 202019922001200920172026
48 results for matrix ensembles

Study on Gaussian ensemble of matrix products with mixed moments computed.

problem Understanding the statistical properties of matrix products of Gaussian matrices.
method Analysis of a multi-Wishart ensemble and enumeration of non-crossing pairings.
result Mixed moments of the product matrix are computed and found to be weighted by Fuss-Catalan numbers at large NN.

HD algorithm simulates dynamics on random matrix ensembles without generating full matrices.

problem Simulating dynamics on dense random matrix ensembles with high space and time complexity.
method Householder reflectors for adaptive and recursive construction, deferring decisions.
result Significant reductions in runtime and memory footprint for practical TnT \ll n.

Random matrix ensembles yield uniform distributions on manifolds.

problem Understanding distributions of vectors in random matrix ensembles.
method Analyzing eigenvalues, singular values, and Autonne-Takagi vectors of various random matrix ensembles.
result Uniform distributions on specific manifolds for different types of random matrix ensembles.

Method detects neural network equivalence via matrix ensembles and spectral analysis.

problem Detecting equivalence among different deep learning architectures.
method Generating Mixed Matrix Ensembles (MMEs) and matching to conjugate circular ensembles.
result Empirical evidence shows vanishing differences in spectral densities with long tail decay rates.

Extends spectral number variance convergence to random matrix ensembles for twisted Laplacians.

problem Spectral number variance convergence for twisted Laplacians and Dirac operators.
method Extends Rudnick's approach to Gaussian ensembles for twisted Laplacians and Dirac operators.
result Convergence to Gaussian ensembles for twisted Laplacians and Dirac operators.

Paper proposes a new method to improve clustering ensemble performance.

problem Improving clustering ensemble performance by refining co-association matrix.
method Low-rank tensor approximation to derive coherent-link matrix and refine co-association matrix.
result The proposed method achieves breakthrough in clustering performance compared to state-of-the-art methods.

In this paper we examine the effect of applying ensemble learning to the performance of collaborative filtering methods. We present several systematic approaches for generating an ensemble of collaborative filtering models based on a single collaborative filtering algorithm (single-model or homogeneous ensemble). We pr…

2012-11-13abs ↗pdf ↗

We generalize the recently discovered relationship between JT gravity and double-scaled random matrix theory to the case that the boundary theory may have time-reversal symmetry and may have fermions with or without supersymmetry. The matching between variants of JT gravity and matrix ensembles depends on the assumed s…

2019-07-07abs ↗pdf ↗

We use a cluster ensemble to determine the number of clusters, k, in a group of data. A consensus similarity matrix is formed from the ensemble using multiple algorithms and several values for k. A random walk is induced on the graph defined by the consensus matrix and the eigenvalues of the associated transition proba…

2014-08-05abs ↗pdf ↗

Paper solves a key problem in learning from high-dimensional covariance matrices.

problem Computing normalizing factors for Riemannian Gaussian distributions on high-dimensional covariance matrices.
method Equivalence with random matrix theory and log-normal matrix ensembles to approximate normalizing factors.
result Efficient approximation of normalizing factors with decreasing error as dimension increases.

BatchEnsemble reduces ensemble costs by 3X in training and testing.

problem High costs for training and testing ensembles of neural networks.
method Defines each weight matrix as a Hadamard product of a shared matrix and a rank-one matrix per member.
result Achieves 3X speedup and 3X memory reduction in test time for ensembles of size 4.

The paper analyzes an ensemble of randomly projected linear discriminants for high-dimensional data.

problem Classification issues in small samples of high-dimensional data.
method Asymptotic analysis using random matrix theory.
result The ensemble offers a performance advantage under certain conditions.

A central problem of random matrix theory is to understand the eigenvalues of spiked random matrix models, introduced by Johnstone, in which a prominent eigenvector (or "spike") is planted into a random matrix. These distributions form natural statistical models for principal component analysis (PCA) problems throughou…

2018-07-02abs ↗pdf ↗

The study investigates kernel-target alignment in tree ensemble kernels.

problem The degree of kernel-target alignment affects the performance of tree ensemble kernels in kernel learning.
method Eigenanalysis of the kernel matrix and sensitivity analysis via landmark learning.
result Good performance of tree ensemble kernels is associated with strong kernel-target alignment.

We estimate generic statistical properties of a structural credit risk model by considering an ensemble of correlation matrices. This ensemble is set up by Random Matrix Theory. We demonstrate analytically that the presence of correlations severely limits the effect of diversification in a credit portfolio if the corre…

2011-02-18abs ↗pdf ↗

We improve prediction risk estimation for large datasets using sketching and ridge regression.

problem Estimating prediction risks for large datasets efficiently and accurately.
method Random matrix theory, generalized cross validation, sketched ridge regression ensembles, and ensemble trick.
result Consistent risk estimation and prediction intervals for large-scale datasets.

In this article, the logic rule ensembles approach to supervised learning is applied to the unsupervised or semi-supervised clustering. Logic rules which were obtained by combining simple conjunctive rules are used to partition the input space and an ensemble of these rules is used to define a similarity matrix. Simila…

2012-07-17abs ↗pdf ↗

Solves weakly supervised regression using low-rank approximations and manifold regularization.

problem Weakly supervised regression with known, unknown, and uncertain labels.
method Combines manifold regularization and low-rank matrix decomposition for optimization.
result Improves solution quality and stability for large datasets.

In a broad range of classification and decision making problems, one is given the advice or predictions of several classifiers, of unknown reliability, over multiple questions or queries. This scenario is different from the standard supervised setting, where each classifier accuracy can be assessed using available labe…

2013-03-13abs ↗pdf ↗

Study shows energy levels on hyperbolic surfaces follow GOE fluctuations.

problem Understanding energy level fluctuations on hyperbolic surfaces.
method Analysis of Laplace eigenvalues on hyperbolic surfaces, using GOE random matrix theory.
result Energy variance on typical hyperbolic surfaces closely matches GOE fluctuations.

Topic models can provide us with an insight into the underlying latent structure of a large corpus of documents. A range of methods have been proposed in the literature, including probabilistic topic models and techniques based on matrix factorization. However, in both cases, standard implementations rely on stochastic…

2017-02-23abs ↗pdf ↗

The paper explores how multiway data from PDEs can be accurately tracked using EnKF with specific covariance and precision estimators.

problem Tracking sparse and multiway structures in dynamical processes governed by PDEs.
method Examined several multiway covariance and precision matrix estimators in the context of physics-driven forecasting and EnKF.
result Multiway data from Poisson and convection-diffusion PDEs can be accurately tracked using EnKF with appropriate estimators.

This paper focuses on scalability and robustness of spectral clustering for extremely large-scale datasets with limited resources. Two novel algorithms are proposed, namely, ultra-scalable spectral clustering (U-SPEC) and ultra-scalable ensemble clustering (U-SENC). In U-SPEC, a hybrid representative selection strategy…

2019-03-04abs ↗pdf ↗

We provide a method to prepare covariance matrices for quantum datasets.

problem No concrete protocol for preparing covariance matrices for quantum datasets.
method Amplitude encoding of data, exploiting global phase symmetry to center the dataset.
result Covariance matrix can be prepared for arbitrary quantum datasets or centered classical datasets.

Tree ensembles like RF and GBT can be seen as kernels, improving regression and classification performance.

problem Improving kernel methods for tree ensemble based models.
method Investigation of RF and GBT kernels in simulation and real data.
result RF and GBT kernels are competitive to their respective ensembles in higher dimensions, particularly with noisy features.

The paper develops a new algorithm for RBMs using dynamical mean-field theory.

problem Learning in Restricted Boltzmann Machines (RBMs) with complex dependencies.
method Dynamical mean-field theory applied to RBMs with rectangular coupling matrices drawn from a bi-rotation invariant ensemble.
result The algorithm converges globally under a stability criterion, with rates matching numerical simulations.

Ensemble methods that average over a collection of independent predictors that are each limited to a subsampling of both the examples and features of the training data command a significant presence in machine learning, such as the ever-popular random forest, yet the nature of the subsampling effect, particularly of th…

2019-10-10abs ↗pdf ↗

The rising interest in pattern recognition and data analytics has spurred the development of innovative machine learning algorithms and tools. However, as each algorithm has its strengths and limitations, one is motivated to judiciously fuse multiple algorithms in order to find the "best" performing one, for a given da…

2017-12-08abs ↗pdf ↗

Corrects GCV for inconsistent risk estimation in finite ensembles of penalized estimators.

problem Inconsistent risk estimation of GCV for finite ensembles of penalized estimators.
method Identifies a correction involving an additional scalar correction based on degrees of freedom adjusted training errors from each ensemble component.
result CGCV maintains computational advantages of GCV and is model-free uniformly consistent for ridge regression.

New methods improve tree ensemble models by compressing them while maintaining accuracy.

problem Theoretical understanding and practical compression of tree ensembles like random forests and gradient boosting machines.
method Spectral perspective on tree ensembles, deriving minimax rates and developing compression schemes.
result Leading eigenfunctions/singular vectors capture dominant predictive directions, leading to smaller, competitive models.

Subspace clustering is the unsupervised grouping of points lying near a union of low-dimensional linear subspaces. Algorithms based directly on geometric properties of such data tend to either provide poor empirical performance, lack theoretical guarantees, or depend heavily on their initialization. We present a novel …

2017-09-14abs ↗pdf ↗