The paper evaluates samplers on multi-modal targets, focusing on mode separation and recovery.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Measures mode separation in high-dimensional densities via a reversible diffusion process.
MFVI mode collapse explained; RoVI proposed to mitigate.
Gradient-guided nested sampling improves posterior inference efficiency.
Study on mode stability of gravitational instantons of type D.
The paper proposes a method to identify power system oscillation modes using blind source separation.
The Dynamic Mode Decomposition (DMD) extracted dynamic modes are the non-orthogonal eigenvectors of the matrix that best approximates the one-step temporal evolution of the multivariate samples. In the context of dynamical system analysis, the extracted dynamic modes are a generalization of global stability modes. We a…
SRMD uses random features for efficient time-frequency analysis.
Simple mode exploration methods do not improve performance in neural networks.
Hybrid model for multimodal distributions using diffusion and classification.
New framework assesses graph-learning datasets for better evaluation.
Modeling variability in tensor decomposition methods is one of the challenges of source separation. One possible solution to account for variations from one data set to another, jointly analysed, is to resort to the PARAFAC2 model. However, so far imposing constraints on the mode with variability has not been possible.…
DDSME outperforms SME in estimating multimodal distributions.
This work presents a novel approach to train invertible linear layers by adding rank-one perturbations.
Sampling from posterior distributions using Markov chain Monte Carlo (MCMC) methods can require an exhaustive number of iterations, particularly when the posterior is multi-modal as the MCMC sampler can become trapped in a local mode for a large number of iterations. In this paper, we introduce the pseudo-extended MCMC…
In this work we propose a method for reducing the dimensionality of tensor objects in a binary classification framework. The proposed Common Mode Patterns method takes into consideration the labels' information, and ensures that tensor objects that belong to different classes do not share common features after the redu…
The use of imitation learning to learn a single policy for a complex task that has multiple modes or hierarchical structure can be challenging. In fact, previous work has shown that when the modes are known, learning separate policies for each mode or sub-task can greatly improve the performance of imitation learning. …
Stacking improves inference for multimodal Bayesian posterior distributions.
A new method improves Bayesian inference for multimodal posteriors.
Mode decomposition is a prototypical pattern recognition problem that can be addressed from the (a priori distinct) perspectives of numerical approximation, statistical inference and deep learning. Could its analysis through these combined perspectives be used as a Rosetta stone for deciphering mechanisms at play in de…
New method makes neural networks transparent, revealing learning modes.
We provide the proof that the space of time series data is a Kolmogorov space with -separation axiom using the loop space of time series data. In our approach we define a cyclic coordinate of intrinsic time scale of time series data after empirical mode decomposition. A spinor field of time series data comes fro…
Root Cause Analysis for Anomalies is challenging because of the trade-off between the accuracy and its explanatory friendliness, required for industrial applications. In this paper we propose a framework for simple and friendly RCA within the Bayesian regime under certain restrictions (that Hessian at the mode is diago…
PDNS tackles multimodal sampling challenges using proximal point method.
The paper analyzes the joint dynamics of prices and order flow in electronic order books.
We present a simple, modular graph-based convolutional neural network that takes structural information from protein-ligand complexes as input to generate models for activity and binding mode prediction. Complex structures are generated by a standard docking procedure and fed into a dual-graph architecture that include…
In this work we show that randomized (block) coordinate descent methods can be accelerated by parallelization when applied to the problem of minimizing the sum of a partially separable smooth convex function and a simple separable convex function. The theoretical speedup, as compared to the serial method, and referring…
New method renormalizes neural network Gaussian processes to identify learnable vs. unlearnable modes.
In addition to finding meaningful clusters, centroid-based clustering algorithms such as K-means or mean-shift should ideally find centroids that are valid patterns in the input space, representative of data in their cluster. This is challenging with data having a nonconvex or manifold structure, as with images or text…
AutoLL uses neural networks to automatically reorder graph nodes for linear layouts.
We define and discuss the first sparse coding algorithm based on closed-form EM updates and continuous latent variables. The underlying generative model consists of a standard `spike-and-slab' prior and a Gaussian noise model. Closed-form solutions for E- and M-step equations are derived by generalizing probabilistic P…
We quantify forgetting in post-training models, distinguishing mass and drift.
Improved KSD test for better detection of differences in distributions.
The increasing use of multiple sensors, which produce a large amount of multi-dimensional data, requires efficient representation and classification methods. In this paper, we present a new method for multi-dimensional data classification that relies on two premises: 1) multi-dimensional data are usually represented by…
New approach treats coordination as an architectural layer to improve LLM-based multi-agent systems.
In spectral clustering and spectral image segmentation, the data is partioned starting from a given matrix of pairwise similarities S. the matrix S is constructed by hand, or learned on a separate training set. In this paper we show how to achieve spectral clustering in unsupervised mode. Our algorithm starts with a se…
New decision-theoretic characterization separates belief and decision posteriors.
A generalization of the Euler-Plateau problem to account for the energy contribution due to twisting of the bounding loop is proposed. Euler-Lagrange equations are derived in a parameterized setting and a bifurcation analysis is performed. A pair of dimensionless parameters govern bifurcations from a flat, circular gro…
Canonical transformation plays a fundamental role in simplifying and solving classical Hamiltonian systems. We construct flexible and powerful canonical transformations as generative models using symplectic neural networks. The model transforms physical variables towards a latent representation with an independent harm…
One of the core tasks in multi-view learning is to capture relations among views. For sequential data, the relations not only span across views, but also extend throughout the view length to form long-term intra-view and inter-view interactions. In this paper, we present a new memory augmented neural network model that…
Periodic surfaces have a limited number of bending modes, equal to their membrane modes.
Sparse-mode DMD disambiguates local and global modes in spatiotemporal data.
Motivated by advantages of current-mode design, this brief contribution explores the implementation of weight matrices in neuromemristive systems via current-mode memristor crossbar circuits. After deriving theoretical results for the range and distribution of weights in the current-mode design, it is shown that any we…
The two most extended density-based approaches to clustering are surely mixture model clustering and modal clustering. In the mixture model approach, the density is represented as a mixture and clusters are associated to the different mixture components. In modal clustering, clusters are understood as regions of high d…
Improves conditions for mode connectivity in deep neural networks.
Many applications in different domains produce large amount of time series data. Making accurate forecasting is critical for many decision makers. Various time series forecasting methods exist which use linear and nonlinear models separately or combination of both. Studies show that combining of linear and nonlinear mo…
The paper analyzes the score field of diffusion models using Burgers dynamics.
For dynamical systems that can be modelled as asymptotically stable linear systems forced by Gaussian noise, this paper develops methods to infer or estimate their modes from observations in real time. The modes can be real or complex. For a real mode, we wish to infer its damping rate and mode shape. For a complex mod…