A new clustering method learns shared hidden space and fuzzy partition between multi-view data.
problem Effective exploitation of relationship between different views in multi-view data.
method Hidden space sharing multi-view fuzzy clustering (HSS-MVFC) method based on fuzzy c-means.
result The proposed method outperforms many related clustering methods in experiments.
Paper addresses hidden faces in configuration space integrals for embeddings.
problem Understanding hidden faces in configuration space integrals for long embeddings.
method Modified configuration space integrals incorporating acyclic bar complex of a dg algebra.
result Cochain map from new graph complex to de Rham complex of embeddings modulo immersions.
Supervised learning frequently boils down to determining hidden and bright parameters in a parameterized hypothesis space based on finite input-output samples. The hidden parameters determine the attributions of hidden predictors or the nonlinear mechanism of an estimator, while the bright parameters characterize how h…
Generative adversarial models are powerful tools to model structure in complex distributions for a variety of tasks. Current techniques for learning generative models require an access to samples which have high quality, and advanced generative models are applied to generate samples from noisy training data through amb…
Study spectral settings of generalized Laplacians on homogeneous spaces.
problem Understanding the spectral properties of generalized Laplacians on compact homogeneous spaces.
method Investigates the generic spectral configuration of operators on G-invariant metrics on M=G/K. result The spectral setting depends on G-isometries and hidden symmetries. The hidden M-algebra is integrated into a super-Lie group, allowing for compactification of extra dimensions.
problem Integrating the hidden M-algebra into a super-Lie group to model super-exceptional spacetimes.
method Left-invariant extension of the decomposed M-theory 3-form, providing a computer-checked re-derivation and streamlined conception of super-Lie groups.
result Lattice subgroups of the hidden M-group allow toroidal compactification of hidden dimensions, akin to topological T-duality.
Proposes MV-Co-VH for multi-view clustering using visible and hidden views.
problem Lack of efficient algorithms for fully utilizing multi-view data.
method Projects multiple views to a common hidden space using NMF, then applies collaborative learning.
result Competitive clustering performance on UCI and real-world datasets.
New algorithm processes Riemannian data more efficiently.
problem High memory usage and slow speed in previous Riemannian HMMs.
method Online algorithm based on Baum-Welch adapted for Riemannian manifolds.
result Significant improvements in speed and efficiency.
New findings on hidden symmetries in ReLU networks.
problem Understanding the redundancy and symmetries in ReLU network parameter space.
method Analyzing parameter settings and function classes for various network architectures.
result For certain network architectures, there are no hidden symmetries.
Two-hidden-layer networks can approximate any continuous function.
problem Proving the universal approximation property of two-hidden-layer feedforward neural networks.
method Constructive approach based on simplicial maps and triangulations.
result Concrete architecture and weights can be obtained for approximating continuous functions.
Reinforcement learning (RL) in Markov decision processes (MDPs) with large state spaces is a challenging problem. The performance of standard RL algorithms degrades drastically with the dimensionality of state space. However, in practice, these large MDPs typically incorporate a latent or hidden low-dimensional structu…
Paper tackles hidden game problem in AI alignment and language games.
problem Hidden game problem in AI alignment and language games.
method Developed a composition of regret minimization techniques to discover and exploit hidden structures.
result Achieved optimal external and swap regret bounds for rapid convergence to correlated equilibria.
Paper analyzes coexisting hidden and self-excited attractors in an economic system.
problem Existence of coexisting hidden and self-excited attractors in economic systems.
method Integer and fractional order analysis of an economic system.
result Integer-order system exhibits multiple combinations of coexisting hidden and self-excited attractors.
The moduli space of the Calabi-Yau three-folds, which play a role as superstring ground states, exhibits the same {\em special geometry} that is known from nonlinear sigma models in N=2 supergravity theories. We discuss the symmetry structure of special real, complex and quaternionic spaces. Maps between these spaces…
Neural networks learn more efficiently with hidden factorial structures.
problem Challenges in high-dimensional statistical learning.
method Controlled experimental framework to test neural networks' ability to exploit hidden factorial structures.
result Neural networks can leverage hidden factorial structures to learn discrete distributions more efficiently.
Paper presents a fast method for estimating hidden states in Bayesian models.
problem Estimating hidden states in Bayesian state space models efficiently.
method Amortized simulation-based inference with pretraining.
result The method achieves sufficient accuracy and fast inference times.
This work speeds up fHMM analysis by tensor algebra.
problem Scalability issues in analyzing factorial hidden Markov models.
method Tensorized algorithms and scalable filtering methods.
result Significant improvement in computational performance.
Deep networks have achieved impressive results across a variety of important tasks. However a known weakness is a failure to perform well when evaluated on data which differ from the training distribution, even if these differences are very small, as is the case with adversarial examples. We propose Fortified Networks,…
QATS efficiently decodes HMMs with polylogarithmic complexity.
problem Efficiently decoding hidden Markov models from noisy observations.
method Divide-and-conquer procedure with polylogarithmic sequence complexity and cubic state space complexity.
result QATS outperforms Viterbi and PMAP in speed and accuracy.
Hidden symmetry of a G'-space X is defined by an extension of the G'-action on X to that of a group G containing G' as a subgroup. In this setting, we study the relationship between the three objects: (A) global analysis on X by using representations of G (hidden symmetry); (B) global analysis on X by using representat…
New algorithm for aggregate inference in HMMs with continuous observations.
problem Inference in large populations with indistinguishable individuals and continuous measurements.
method Continuous observation collective forward-backward algorithm extending existing discrete case algorithm.
result Efficacy demonstrated through numerical experiments.
A new metric space model for point process excitations uncovers hidden interactions.
problem Estimating pairwise interactions in multivariate Hawkes processes is often infeasible.
method Developed a Hidden Hawkes Geometry (HHG) model to embed event types in a metric space.
result Learning the embedding reveals salient interactions in various applications.
Generalizes bits back coding for time-series models with latent Markov structures.
problem Efficiently compressing time-series data with latent Markov structures.
method Extends bits back coding to time-series models with latent Markov structures, including HMMs and LGSSMs.
result Effective for small scale models, promising for larger scale settings like video compression.
Study evaluates initialization strategies for infinite hidden Markov models.
problem Limited attention to initialization in infinite hidden Markov models.
method Systematically evaluated distance-based clustering, model-based, and uniform initializations.
result Distance-based clustering initializations consistently outperform other methods.
The generic identification problem is to decide whether a stochastic process (Xt) is a hidden Markov process and if yes to infer its parameters for all but a subset of parametrizations that form a lower-dimensional subvariety in parameter space. Partial answers so far available depend on extra assumptions on the pro…
New algorithm learns HMM parameters on Riemannian manifolds.
problem Learning hidden Markov models on non-Euclidean spaces.
method Geometric method of moments algorithm for Riemannian manifolds.
result Significantly improved speed and accuracy compared to existing methods.
Extends HMM to topological spaces for modeling complex data.
problem Modeling complex, continuous data in infinite-dimensional spaces.
method Use of Onsager-Machlup functional and Cameron-Martin space.
result Demonstrates versatility in identifying sleep states and snowfall patterns.
New estimators for causal effects in DAGs with hidden variables, addressing computational and statistical challenges.
problem Estimating causal effects in DAGs with hidden variables beyond traditional criteria.
method Introduces novel one-step corrected plug-in and targeted minimum loss-based estimators for causal effects in DAGs with hidden variables.
result Root-n consistent causal effect estimates with desirable statistical properties.
We briefly review the hierarchy for the hyper-Kähler equations and define a notion of symmetry for solutions of this hierarchy. A four-dimensional hyper-Kähler metric admits a hidden symmetry if it embeds into a hierarchy with a symmetry. It is shown that a hyper-Kähler metric admits a hidden symmetry if it admits a ce…
Study generalizes Yang-Mills equations for special complex surfaces.
problem Deriving equations for self-dual Yang-Mills fields on complex surfaces.
method Generalization of flat space Yang's and Newman's equations to conformally Kahler Riemannian 4-manifolds.
result Continuous group of hidden symmetries found only for conformally half-flat geometry.
The paper tackles estimation of hidden state LTI systems of unknown order.
problem Estimation of Markov parameters and minimal realization of unknown order LTI systems.
method Hankel penalized least square estimator, Ho-Kalman algorithm, and a combined algorithm.
result Statistical guarantees for estimation error, rank recovery, and sample complexity.
This paper introduces a new approach to finding knots and links with hidden symmetries using "hidden extensions", a class of hidden symmetries defined here. We exhibit a family of tangle complements in the ball whose boundaries have symmetries with hidden extensions, then we further extend these to hidden symmetries of…
Linear Dynamical System (LDS) is an elegant mathematical framework for modeling and learning multivariate time series. However, in general, it is difficult to set the dimension of its hidden state space. A small number of hidden states may not be able to model the complexities of a time series, while a large number of …
Machine learning promises methods that generalize well from finite labeled data. However, the brittleness of existing neural net approaches is revealed by notable failures, such as the existence of adversarial examples that are misclassified despite being nearly identical to a training example, or the inability of recu…
New model for bandit problem with linear rewards and side information.
problem Hidden Markovian bandit problem with linear rewards and side information.
method Presented a model and algorithm with regret analysis for the problem.
result Logarithmic regret achieved even in high-dimensional problems with structural side information.
Polynomial delay algorithm tests causal models with hidden variables.
problem Testing causal models with hidden variables in polynomial delay.
method c-component local Markov property (C-LMP) and polynomial delay algorithm.
result First algorithm for poly-delay testing of CIs in causal graphs with hidden variables.
In this paper we introduce the deep kernelized autoencoder, a neural network model that allows an explicit approximation of (i) the mapping from an input space to an arbitrary, user-specified kernel space and (ii) the back-projection from such a kernel space to input space. The proposed method is based on traditional a…
The study analyzes local minima in ReLU networks and finds low probability of bad local minima.
problem Understanding the existence and probability of local minima in ReLU networks.
method Theoretical analysis combined with linear programming and experiments on MNIST and CIFAR-10 datasets.
result No bad differentiable local minima found almost everywhere in weight space.
Paper studies shallow ReLU networks' approximation rates for Hölder functions.
problem Understanding shallow ReLU networks' efficiency in approximating Hölder functions.
method Analyzes rates of uniform approximation by ReLU shallow neural networks with m hidden neurons. result Shows ReLU shallow neural networks can uniformly approximate Hölder functions with rates close to optimal.
Efficiently infers coupled hidden Markov models with noisy discrete observations.
problem Intractable inference for coupled continuous-time Markov chains with discrete observations.
method Latent Interacting Particle Systems, look-ahead functions, twisted Sequential Monte Carlo sampling.
result Demonstrated effectiveness on latent SIRS model and wildfire spread dynamics.
New method infers hidden states in continuous-time phenomena better than traditional models.
problem Traditional HSMM's are limited to discrete time grids and cannot handle irregularly spaced data.
method Formulated integro-differential forward and backward equations for CTSMC's, introduced scalable Viterbi-type algorithm.
result Efficiently solved equations for posterior marginals and path estimates.
We train multi-task autoencoders on linguistic tasks and analyze the learned hidden sentence representations. The representations change significantly when translation and part-of-speech decoders are added. The more decoders a model employs, the better it clusters sentences according to their syntactic similarity, as t…
We introduce a new formulation of the Hidden Parameter Markov Decision Process (HiP-MDP), a framework for modeling families of related tasks using low-dimensional latent embeddings. Our new framework correctly models the joint uncertainty in the latent parameters and the state space. We also replace the original Gaussi…
DISTANA improves weather prediction by inferring hidden factors from temperature data.
problem Inferring hidden factors in spatiotemporal processes without supervision.
method Enhanced DISTANA architecture for spatiotemporal data, active tuning for latent state inference.
result DISTANA achieves more accurate predictions than other methods, inferring hidden factors from temperature data.
RBM models reveal how hidden unit tail behavior affects pattern reconstruction.
problem Understanding how the tail behavior of hidden units in RBMs influences pattern reconstruction.
method Identified an effective energy function for RBMs and studied its local minima.
result The ability to reconstruct patterns depends on the tail behavior of the hidden unit prior distribution.
Researchers analyze how RNNs solve intent detection tasks using dynamical systems theory.
problem Understanding the internal mechanisms of RNNs in intent detection.
method Investigating RNN architectures through a dynamical systems perspective.
result Identified fixed point topology and limited number of attractors in RNN dynamics.
Due to physiological variation, patients diagnosed with the same condition may exhibit divergent, but related, responses to the same treatments. Hidden Parameter Markov Decision Processes (HiP-MDPs) tackle this transfer-learning problem by embedding these tasks into a low-dimensional space. However, the original formul…
Expands Hidden Markov Model to include Markov chain observations.
problem Handling Markov chain observations in Hidden Markov Models.
method Developed Expectation-Maximization algorithm and Viterbi algorithm analogs.
result Estimates transition probabilities for hidden states and observations.