Two-block ADMM outperformed multi-block ADMM in multi-task learning experiments.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
CAVI converges globally or locally exponentially for two-block models.
We explain an elementary topological construction of the Springer representation on the homology of (topological) Springer fibers of types C and D in the case of nilpotent endomorphisms with two Jordan blocks. The Weyl group and component group actions admit a diagrammatic description in terms of cup diagrams which app…
In this paper we consider a general matrix factorization model which covers a large class of existing models with many applications in areas such as machine learning and imaging sciences. To solve this possibly nonconvex, nonsmooth and non-Lipschitz problem, we develop a non-monotone alternating updating method based o…
The study examines MCMC methods for arbitrary objectives and finds likelihood sharpness impacts performance and regularization.
We consider the community detection problem in sparse random hypergraphs. Angelini et al. (2015) conjectured the existence of a sharp threshold on model parameters for community detection in sparse hypergraphs generated by a hypergraph stochastic block model. We solve the positive part of the conjecture for the case of…
In this paper, we propose a general framework to accelerate significantly the algorithms for nonnegative matrix factorization (NMF). This framework is inspired from the extrapolation scheme used to accelerate gradient methods in convex optimization and from the method of parallel tangents. However, the use of extrapola…
New method speeds up solving machine learning problems by splitting variables randomly.
The study examines algebraic structures of specific tensor forms in four-dimensional spacetimes.
Construction of (colored) knot polynomials for double-fat graphs is further generalized to the case when "fingers" and "propagators" are substituting R-matrices in arbitrary closed braids with m-strands. Original version of arXiv:1504.00371 corresponds to the case m=2, and our generalizations sheds additional light on …
New geometric construction of spectral sequences from Khovanov homology.
By using variational calculus and exterior derivative formalism, we proposed in two previous joint papers with S. Siparov a new geometric approach for electromagnetism in pseudo-Finsler spaces. In the present paper, we provide more details, especially regarding generalized currents, the domain of integration and gauge …
The support vector machine (SVM) was originally designed for binary classifications. A lot of effort has been put to generalize the binary SVM to multiclass SVM (MSVM) which are more complex problems. Initially, MSVMs were solved by considering their dual formulations which are quadratic programs and can be solved by s…
New method combines curiosity and hindsight for stacking blocks.
Co-Clustering, the problem of simultaneously identifying clusters across multiple aspects of a data set, is a natural generalization of clustering to higher-order structured data. Recent convex formulations of bi-clustering and tensor co-clustering, which shrink estimated centroids together using a convex fusion penalt…
DAG models with hidden variables present many difficulties that are not present when all nodes are observed. In particular, fully observed DAG models are identified and correspond to well-defined sets ofdistributions, whereas this is not true if nodes are unobserved. Inthis paper we characterize exactly the set of dist…
Unified sampling approach for Bayesian imaging problems.
Improved VGG networks enhance image classification accuracy.
The topological properties of interbank networks have been discussed widely in the literature mainly because of their relevance for systemic risk. Here we propose to use the Stochastic Block Model to investigate and perform a model selection among several possible two block organizations of the network: these include b…
The alternating gradient descent (AGD) is a simple but popular algorithm which has been applied to problems in optimization, machine learning, data ming, and signal processing, etc. The algorithm updates two blocks of variables in an alternating manner, in which a gradient step is taken on one block, while keeping the …
AANets balance stability and plasticity in CIL.
As autonomous vehicles (AVs) need to interact with other road users, it is of importance to comprehensively understand the dynamic traffic environment, especially the future possible trajectories of surrounding vehicles. This paper presents an algorithm for long-horizon trajectory prediction of surrounding vehicles usi…
MTCNet uses MTL to estimate crowd density and count.
Research in several fields now requires the analysis of data sets in which multiple high-dimensional types of data are available for a common set of objects. In particular, The Cancer Genome Atlas (TCGA) includes data from several diverse genomic technologies on the same cancerous tumor samples. In this paper we introd…
The performance of spectral clustering can be considerably improved via regularization, as demonstrated empirically in Amini et. al (2012). Here, we provide an attempt at quantifying this improvement through theoretical analysis. Under the stochastic block model (SBM), and its extensions, previous results on spectral c…
A common approach to analyze a covariate-sample count matrix, an element of which represents how many times a covariate appears in a sample, is to factorize it under the Poisson likelihood. We show its limitation in capturing the tendency for a covariate present in a sample to both repeat itself and excite related ones…
Many modern data mining applications are concerned with the analysis of datasets in which the observations are described by paired high-dimensional vectorial representations or "views". Some typical examples can be found in web mining and genomics applications. In this article we present an algorithm for data clusterin…
Develops a new model to better predict corporate bond yields.
A deep learning model corrects precipitation bias without expert knowledge.
Proposes a new neural network architecture combining MLP and basis functions.
Random matrix theory explains transient signal detectability in early-stopped gradient flow.
Model clusters networks and their communities simultaneously.
Two new FedMF algorithms improve data clustering in federated learning.
The paper proposes AIS for Bayesian inversion of multioutput signals with covariance estimation.
Study extends neural network approximation to time-varying PDEs using Fourier-Lebesgue spaces.
Profile graphical models represent multivariate dependence under varying risk factors.
Alternative approach to generative modeling using convex conjugates and optimal transport.
New gradient coding schemes reduce decoding error in both random and adversarial straggler settings.
Many problems in machine learning and other fields can be (re)for-mulated as linearly constrained separable convex programs. In most of the cases, there are multiple blocks of variables. However, the traditional alternating direction method (ADM) and its linearized version (LADM, obtained by linearizing the quadratic p…
Motivated by big data applications, first-order methods have been extremely popular in recent years. However, naive gradient methods generally converge slowly. Hence, much efforts have been made to accelerate various first-order methods. This paper proposes two accelerated methods towards solving structured linearly co…
New method recovers sparse signals from nonlinear observations with robust error bounds.
We analyze mixing times of three DA algorithms for regression models.