Study evaluates thresholds for removing noise from DNN weights using random matrix theory.
problem Removing noise from deep neural network weights for better approximation.
method Model weights as signal + noise, use random matrix theory to estimate thresholds, evaluate using cosine similarity.
result Proposed threshold estimation method improves approximation quality.
RPCholesky approximates kernel matrices with few evaluations.
problem Approximating kernel matrices efficiently.
method Randomly pivoted partial Cholesky factorization.
result RPCholesky provides nearly optimal low-rank approximations.
This work interprets diffusion score matching using normalizing flows for better model training and evaluations.
problem Limitations of diffusion score matching when dealing with certain types of distributions.
method The approach involves interpreting the diffusion matrix using normalizing flows to provide better interpretation and usage of diffusion score matching.
result Diffusion score matching is equivalent to the original score matching evaluated in the transformed space defined by the normalizing flow.
When response variables are nominal and populations are cross-classified with respect to multiple polytomies, questions often arise about the degree of association of the responses with explanatory variables. When populations are known, we introduce a nominal association vector and matrix to evaluate the dependence of …
We study the problem of computing the matrix exponential of a block triangular matrix in a peculiar way: Block column by block column, from left to right. The need for such an evaluation scheme arises naturally in the context of option pricing in polynomial diffusion models. In this setting a discretization process pro…
EAST aligns neural network classifiers with user-defined evaluation metrics.
problem Mismatch between neural network training and evaluation metrics leads to suboptimal performance.
method EAST uses dynamic thresholding, soft-set confusion matrix, and annealing to align neural network predictions with target evaluation metrics.
result EAST improves alignment between training objectives and evaluation metrics, outperforming existing methods.
Proposes GIR for better alpha evaluation under model misspecification.
problem Alpha-based performance evaluation fails to capture correlated residuals.
method Derives GIR as alphas scaled by residual covariance matrix inverse square root.
result GIR robust to various model misspecifications and produces stable returns.
The contribution of reducible connections to the U(N) Chern-Simons invariant of a Seifert manifold M can be expressed in some cases in terms of matrix integrals. We show that the U(N) evaluation of the LMO invariant of any rational homology sphere admits a matrix model representation which agrees with the Chern-Simon…
We propose a route for the evaluation of risk based on a transformation of the covariance matrix. The approach uses a `potential' or `objective' function. This allows us to rescale data from different assets (or sources) such that each data set then has similar statistical properties in terms of their probability distr…
Unified approach optimizes neural network training for various metrics.
problem Training and evaluation of neural network binary classifiers often use different metrics.
method Combines differentiable approximation and probabilistic soft sets.
result Effective in optimizing for metrics like F1-Score across various domains.
Study evaluates posterior covariance matrix W for frequentist evaluation of Bayesian estimators.
problem Evaluating variability of posterior estimates in Bayesian models.
method Use of Bayesian Infinitesimal Jackknife approximation and W-kernel.
result Principal space of W is central to frequentist evaluation of Bayesian models.
In this paper, we review the problem of matrix completion and expose its intimate relations with algebraic geometry, combinatorics and graph theory. We present the first necessary and sufficient combinatorial conditions for matrices of arbitrary rank to be identifiable from a set of matrix entries, yielding theoretical…
Estimates multi-attribute choice preferences using private signals and matrix factorization.
problem Modeling multi-attribute choice preferences under weak assumptions.
method Generative choice model with latent factor matrices and private signals; multi-stage matrix factorization.
result Validated estimation performance of novel algorithm through simulations.
New method for hyperparameter tuning in sparse matrix factorization.
problem Hyperparameter tuning in sparse matrix factorization.
method Numerical method based on evaluating the zero point of normalization factor in sparse matrix prior.
result Our method outperforms existing algorithms in ground-truth sparse matrix reconstruction.
IRT metrics improve model evaluation by assessing latent characteristics.
problem Limitations of classic metrics like precision and F1.
method Introducing psychometric metrics like Item Response Theory (IRT).
result IRT complements classical metrics, offering new insights.
CPS methods improve sample efficiency in robotics.
problem Improving sample efficiency in reinforcement learning for robotics.
method Empirical evaluation of C-CMA-ES with active covariance matrix adaptation and comparison-based surrogate model.
result Improvements in sample efficiency with C-CMA-ES extensions.
New method estimates large matrices' spectra from small sub-matrices.
problem Estimating large matrices' spectra when full matrix-vector products are not available.
method Free decompression based on free probability theory.
result Estimates eigenspectrum of impalpable matrices from small sub-matrices.
Paper introduces a new model to assess machine learning strategies in high-frequency trading.
problem Evaluating the economic impact of supervised machine learning in high-frequency trading.
method Developed a 'trade information matrix' to attribute profit and loss to correct and incorrect predictions under execution constraints.
result Demonstrated an estimation approach for measuring the sensitivity of P&L to prediction error in a market making strategy.
New R package for NMF evaluated on real-world data.
problem Limited comprehensive evaluations of NMF packages under real-world conditions.
method Systematic performance comparison of three NMF packages using real-world data.
result New package outperforms existing ones in computational efficiency and reconstruction accuracy.
We simplify matrix computations for block matrices, especially useful for covariance and correlation matrices.
problem Complex computations for block matrices, especially for covariance and correlation matrices.
method Obtained a canonical representation for block matrices, facilitating computation of various matrix operations.
result Simplified computation of matrix operations for block matrices, particularly useful for covariance and correlation matrices.
A new method reduces log determinant evaluation cost from cubic to quadratic.
problem Efficiently evaluating log determinants in machine learning.
method Variational Bayesian approximation with complexity O(n^2).
result State-of-the-art performance on synthetic and real-world datasets.
Novel method diagnoses large language models' reasoning abilities.
problem Fine-grained evaluation of large language models' reasoning abilities.
method Adapting cognitive diagnosis models to LLMs, estimating mastery profiles and Q-matrix, incorporating textual information.
result Accurate parameter recovery and insights into LLMs' capabilities.
The paper proposes methods for predicting missing values in mixed data matrices.
problem Matrix completion for mixed data types (continuous, binary, ordinal).
method Generalized latent factor models for low-rank matrix estimation with entrywise consistency.
result Tight probabilistic error bounds for the proposed estimators.
LVQ models robustness evaluated against adversarial attacks.
problem Robustness of LVQ models against adversarial attacks.
method Evaluation of three LVQ models: Generalized LVQ, Generalized Matrix LVQ, and Generalized Tangent LVQ.
result Generalized LVQ and Generalized Tangent LVQ are robust, while Generalized Matrix LVQ is not.
Bayesian non-linear matrix completion tackles large, sparse data.
problem Predict missing elements in large, sparsely observed matrices.
method Bayesian Gaussian process latent variable models with data-parallel distributed computation.
result Scalable Bayesian non-linear matrix completion outperforms linear methods.
Dynamic risk assessment method for WUI fires improves upon static frameworks.
problem Static risk assessment methods fail to capture dynamic changes in WUI fire risks.
method Dynamic evaluation matrix, grey incidence analysis, optimization model.
result The proposed method effectively captures dynamic risk evolution patterns.
Develops rough set classifiers using confusion matrices.
problem Evaluating classifier quality in machine learning.
method Combines rough set theory with confusion matrices.
result Defines indices and classifiers based on rough confusion matrices.
EDAs with matrix transpose improve Bayesian structure learning performance.
problem Improving Bayesian structure learning performance.
method Introducing a matrix transpose mutation operator for EDAs in Bayesian structure learning.
result EDAs with transpose mutation give markedly better performance than conventional EDAs.
In this paper we examine the effect of applying ensemble learning to the performance of collaborative filtering methods. We present several systematic approaches for generating an ensemble of collaborative filtering models based on a single collaborative filtering algorithm (single-model or homogeneous ensemble). We pr…
Federated multi-view matrix factorization learns from multiple data sources without centralizing user data.
problem Cold-start federated recommendations and multi-view data structure.
method Federated learning framework extended to multi-view matrix factorization.
result Federated multi-view matrix factorization outperforms simpler methods in cold-start federated recommendations.
We derive a numerical algorithm for evaluating the Riemannian logarithm on the Stiefel manifold with respect to the canonical metric. In contrast to the existing optimization-based approach, we work from a purely matrix-algebraic perspective. Moreover, we prove that the algorithm converges locally and exhibits a linear…
Graph neural networks speed up nonnegative matrix factorization.
problem Efficiently factorize nonnegative matrices for various applications.
method Developed a graph neural network that combines bipartite self-attention with ADMM updates.
result Significant acceleration achieved in nonnegative matrix factorization.
New NMF algorithm uses Toeplitz matrix for facial recognition.
problem Facial recognition performance improvement.
method Proposes TNMF algorithm with Toeplitz penalty for NMF.
result TNMF outperforms ZNMF and other constrained NMF algorithms.
Randomized HALS for efficient NMF on big data.
problem Challenges in computing nonnegative matrix factorization for big data.
method Randomized hierarchical alternating least squares (HALS) algorithm.
result Efficient nonnegative decomposition for big data applications.
Boosts neural network performance by improving weight separability.
problem Improving the separability of weight vectors in neural networks.
method Proposes a new evaluation metric and feed-backward reconstruction loss to encourage weight separability.
result Improves visual recognition performance across various tasks.
A new method for non-negative matrix factorization using generalized dual divergence.
problem Non-negative matrix factorization for various noise structures.
method Theoretical framework based on generalized dual Kullback-Leibler divergence, with algorithms developed and proven convergence using Expectation-Maximization.
result Generalizes existing methods and provides an alternative for non-negative matrix factorizations.
This project compares MCMC and VI for Bayesian PMF on MovieLens.
problem Intractable posterior distribution in PMF.
method Employed MCMC and VI for Bayesian inference on MovieLens.
result VI converges faster, MCMC provides more accurate estimates.
This work establishes always-valid risk bounds for online matrix completion.
problem Challenges in establishing always-valid concentration inequalities for online matrix completion.
method Combines non-asymptotic martingale concentration and regularized low-rank matrix regression.
result Establishes always-valid risk bound process for online matrix completion.
We provide a proof of backpropagation algorithm in matrix notation.
problem The lack of a full induction proof of backpropagation algorithm in matrix notation.
method We provide a full induction proof of the BP algorithm in matrix notation, situating it in the framework of matrix differential calculus.
result We prove the validity of the backpropagation algorithm in inductive form.
NGRC shows numerical instabilities with short lags and high-degree polynomials.
problem Numerical instabilities in NGRC feature matrix.
method Combining numerical linear algebra and dynamical systems theory, we study feature matrix conditioning. We evaluate different numerical algorithms for solving the regularized least-squares problem.
result SVD-based training achieves accurate forecasts without regularization, preferable for short lags and high-degree polynomials.
Improved cutting plane method for convex optimization and games.
problem Efficiently finding points in convex sets or proving they do not contain balls.
method Optimal cutting plane algorithm using leverage scores and advanced data structures.
result Significant improvement in time complexity for convex optimization and games.
This paper presents an algorithm to construct a weighted adjacency matrix of a plane bipartite graph obtained from a pretzel knot diagram. The determinant of this matrix after evaluation is shown to be the Jones polynomial of the pretzel knot by way of perfect matchings (or dimers) of this graph. The weights are Tutte'…
Dropout controls model capacity in deep learning and matrix completion.
problem Controlling model capacity in deep learning and matrix completion problems.
method Investigates dropout's effect on model capacity and Rademacher complexity.
result Dropout induces a regularizer that controls model capacity in expectation.
COSMO learns DAG structure without acyclicity constraints.
problem Learning DAG structure from data efficiently and without constraints.
method Differentiable approximation of smooth orientation matrix.
result COSMO converges to acyclic solutions without evaluating acyclicity.
Two new methods estimate quantum density matrices using machine learning.
problem Estimating the quantum density matrix for complex systems.
method Quantum Maximum Likelihood and Quantum Variational Inference with quantum flows.
result Improved estimation of quantum density matrices for mixed states.
Variational inference improves neural network matrix factorization for stochastic blockmodels.
problem Improving predictive performance of neural network matrix factorization for stochastic blockmodels.
method Construct Bayesian neural networks and fit with variational inference.
result Variational inference can achieve equivalent performance to neural networks on Movielens data.
Effective Gram matrix predicts deep network generalization.
problem Understanding and predicting deep network generalization.
method Derived a differential equation governing generalization gap, analyzed with effective Gram matrix.
result Effective Gram matrix accurately predicts test loss during training.
Paper develops a new test for high-dimensional matrix-valued data.
problem Hypothesis testing for mean of matrix-valued data in high-dimensional settings.
method Proposes a new test statistic for high-dimensional matrix rank testing.
result Develops a novel approach for sparse singular value decomposition (SVD) estimation.