arXiv research

This study provides an explicit expansion of KL divergence's gradient flow in Fisher-Rao geometry.

Unified approach to verify NN properties using ReLU's unique polytope structure.

Paper proposes a method to improve MCMC sampling for energy-based models.

We study smooth {\sf traversing} vector fields $v$ on compact manifolds $X$ with boundary. A traversing $v$ admits a Lyapunov function $f: X \to \Bbb R$ such that $df(v) > 0$. We show that the trajectory spaces $\mathcal T(v)$ of {\sf traversally generic} $v$-flows are {\sf Whitney stratified spaces}, and thus admit tr…

LoRA-Curve connects independent LoRA optima through continuous low-loss valleys, improving Bayesian model averaging.

VAEBM combines VAEs and EBMs for efficient image generation.

Euler's theorem extended to complex structures.

A novel multi-resolution Gaussian process model for efficient time traversal.

Many tasks in computer vision can be cast as a "label changing" problem, where the goal is to make a semantic change to the appearance of an image or some subject in an image in order to alter the class membership. Although successful task-specific methods have been developed for some label changing applications, to da…

We combine Gromov's amenable localization technique with the Poincaré duality to study the traversally generic vector flows on smooth compact manifolds $X$ with boundary. Such flows generate well-understood stratifications of $X$ by the trajectories that are tangent to the boundary in a particular canonical fashion. Sp…

Any traversally generic vector flow on a compact manifold $X$ with boundary leaves some residual structure on its boundary $\d X$. A part of this structure is the flow-generated causality map $C_v$, which takes a region of $\d X$ to the complementary region. By the Holography Theorem from \cite{K4}, the map $C_v$ allow…

Counterfactual regret minimization (CFR) is the most popular algorithm on solving two-player zero-sum extensive games with imperfect information and achieves state-of-the-art performance in practice. However, the performance of CFR is not fully understood, since empirical results on the regret are much better than the …

Predicts node sequences in graphs using multi-order network models.

Let $X$ be a compact smooth manifold with boundary. In this article, we study the spaces $\mathcal V^\dagger(X)$ and $\mathcal V^\ddagger(X)$ of so called boundary generic and traversally generic vector fields on $X$ and the place they occupy in the space $\mathcal V(X)$ of all fields (see Theorems \ref{th3.4} and Theo…

Attention-based encoder decoder network uses a left-to-right beam search algorithm in the inference step. The current beam search expands hypotheses and traverses the expanded hypotheses at the next time step. This traversal is implemented using a for-loop program in general, and it leads to speed down of the recogniti…

A colored graph is a directed graph in which nodes or edges have been assigned colors that are not necessarily unique. Observability problems in such graphs consider whether an agent observing the colors of edges or nodes traversed on a path in the graph can determine which node they are at currently or which nodes wer…

Method generates counterfactual explanations for graph classifiers.

SURF steers scalarization weights to uniformly traverse the Pareto front.

In low-dimensional topology, many important decision algorithms are based on normal surface enumeration, which is a form of vertex enumeration over a high-dimensional and highly degenerate polytope. Because this enumeration is subject to extra combinatorial constraints, the only practical algorithms to date have been v…

Let $C_{k_1}^{k_2}$ denote the set of all closed curves of class $C^r$ on the sphere $S^2$ whose geodesic curvatures are restricted to lie in $(k_1,k_2)$, furnished with the $C^r$ topology (for some $r >= 2$ and possibly infinite $k_1 < k_2$). In 1970, J. Little proved that the space $C_0^{+\infty}$ of closed curves ha…

This paper is the third in a series that researches the Morse Theory, gradient flows, concavity and complexity on smooth compact manifolds with boundary. Employing the local analytic models from \cite{K2}, for \emph{traversally generic flows} on $(n+1)$-manifolds $X$, we embark on a detailed and somewhat tedious study …

We investigate the difficulties of training sparse neural networks and make new observations about optimization dynamics and the energy landscape within the sparse regime. Recent work of \citep{Gale2019, Liu2018} has shown that sparse ResNet-50 architectures trained on ImageNet-2012 dataset converge to solutions that a…

A new method uses string method to explore diffusion models.

Periodic surfaces have a limited number of bending modes, equal to their membrane modes.

This paper proposes a novel type of random forests called a denoising random forests that are robust against noises contained in test samples. Such noise-corrupted samples cause serious damage to the estimation performances of random forests, since unexpected child nodes are often selected and the leaf nodes that the i…

Sparse-mode DMD disambiguates local and global modes in spatiotemporal data.

Motivated by advantages of current-mode design, this brief contribution explores the implementation of weight matrices in neuromemristive systems via current-mode memristor crossbar circuits. After deriving theoretical results for the range and distribution of weights in the current-mode design, it is shown that any we…

Proposes a new method for completing swap cycles in decentralized exchanges.

For dynamical systems that can be modelled as asymptotically stable linear systems forced by Gaussian noise, this paper develops methods to infer or estimate their modes from observations in real time. The modes can be real or complex. For a real mode, we wish to infer its damping rate and mode shape. For a complex mod…

Characterizes neutral deformation modes of minimal surfaces.

In many real-world scenarios, an autonomous agent often encounters various tasks within a single complex environment. We propose to build a graph abstraction over the environment structure to accelerate the learning of these tasks. Here, nodes are important points of interest (pivotal states) and edges represent feasib…

Mathematical analysis shows annealing prevents mode collapse in Gaussian mixtures.

Parsimonious Dynamic Mode Decomposition selects sparse modes robustly.

As has been observed by Morse \cite{Mo}, any generic vector field $v$ on a compact smooth manifold $X$ with boundary gives rise to a stratification of the boundary $\d X$ by compact submanifolds $\{\d_j^\pm X(v)\}_{1 \leq j \leq \dim(X)}$, where $\textup{codim}(\d_j^\pm X(v))= j$. Our main observation is that this stra…

In this paper, we present our general results about traversing flows on manifolds with boundary in the context of the flows on surfaces with boundary. We take advantage of the relative simplicity of $2D$-worlds to explain and popularize our approach to the Morse theory on smooth manifolds with boundary, in which the bo…

Geodesics connect model modes in neural network loss landscapes.

A new, efficient $k$-modes algorithm improves clustering of categorical data.

Multimodal clustering is an unsupervised technique for mining interesting patterns in $n$-adic binary relations or $n$-mode networks. Among different types of such generalized patterns one can find biclusters and formal concepts (maximal bicliques) for 2-mode case, triclusters and triconcepts for 3-mode case, closed $n…

Music Inpainting is the task of filling in missing or lost information in a piece of music. We investigate this task from an interactive music creation perspective. To this end, a novel deep learning-based approach for musical score inpainting is proposed. The designed model takes both past and future musical context i…

This paper describes a mechanism by which a traversally generic flow $v$ on a smooth connected manifold $X$ with boundary produces a compact $CW$-complex $\mathcal T(v)$, which is homotopy equivalent to $X$ and such that $X$ embeds in $\mathcal T(v)\times \mathbf R$. The $CW$-complex $\mathcal T(v)$ captures some resid…

EDLP samples flat modes in discrete spaces using entropy.

Proposes a Gaussian process for Koopman mode decomposition.

The study explores vector flows on manifolds, focusing on polynomial constraints and equivalence relations.

Deep learning helps remove secondary $B$-mode polarization to detect primordial gravitational waves.

A new method for continual learning in GANs learns new modes with limited data.

Empirical study shows GANs overfit and drop modes when training is deterministic.

The paper finds shape modes for vortices in a specific sigma model.

Dynamic Mode Decomposition (DMD) yields a linear, approximate model of a system's dynamics that is built from data. We seek to reduce the order of this model by identifying a reduced set of modes that best fit the output. We adopt a model selection algorithm from statistics and machine learning known as Least Angle Reg…