The paper proposes a model to learn disentangled representations using mutual information.
problem Learning disentangled representations from shared and exclusive attributes.
method Mutual information maximization for shared attributes and minimization for disentanglement.
result The proposed model outperforms state-of-the-art models in representation disentanglement.
Improves unsupervised feature learning with an exclusivity concept.
problem Overfitting in AE-based unsupervised feature learning.
method Integrates exclusivity concept to enhance AE's latent feature representation.
result Significant improvement in performance compared to other methods.
We explore xor function using copula representations and error surface projections.
problem The exclusive or (xor) function and its approximation problems.
method Probabilistic logic, associative copula functions, and comparison of error surfaces with different activation functions.
result Copula representations extend xor from Boolean to real values.
AVAE improves semi-supervised learning by generating exclusive latent codes.
problem Inadequate exclusive latent codes in traditional VAE for robust classification.
method AVAE++ generates exclusive latent codes using a combination of VAE and GAN.
result AVAE outperforms state-of-the-art models in semisupervised classification.
This research shows how to learn shared representations from unpaired data.
problem Learning shared representations from unpaired data.
method Spectral embeddings of random walk matrices from each unimodal representation.
result Shared representations can be learned almost exclusively from unpaired data.
ZNet learns instrumental representations from covariates for causal inference.
problem Lack of valid instruments in observational studies.
method Representation learning approach that constructs instrumental representations from observed covariates.
result ZNet enables IV-based estimation without explicit instruments.
Next step is reported in the program of Racah matrices extraction from the differential expansion of HOMFLY polynomials for twist knots: from the double-column rectangular representations R=[rr] to a triple-column and triple-hook R=[333]. The main new phenomenon is the deviation of the particular coefficient $f_{[332]}…
Continuing the quest for exclusive Racah matrices, which are needed for evaluation of colored arborescent-knot polynomials in Chern-Simons theory, we suggest to extract them from a new kind of a double-evolution -- that of the antiparallel double-braids, which is a simple two-parametric family of two-bridge knots, gene…
Research quantifies financial exclusion risks in UK, focusing on cash infrastructure and socio-economic factors.
problem Localised financial exclusion in the UK as cash infrastructure declines.
method Developed a composite indicator using various input variables.
result Financial exclusion is more prevalent in deprived communities and affluent areas.
Study of SO(3)-irreducible geometry in complex 5D and ternary Pauli exclusion principle.
problem Exploring SO(3)-irreducible geometry in complex 5D.
method Defined a ternary skew-symmetric tensor, split the 10D space into irreducible SO(3) subspaces, found invariants and defined geometric structures.
result Defined a SO(3)-irreducible geometric structure on a 5D complex Hermitian manifold.
Racah matrices and higher j-symbols are used in description of braiding properties of conformal blocks and in construction of knot polynomials. However, in complicated cases the logic is actually inverted: they are much better deduced from these applications than from the basic representation theory. Following the re…
Many practical applications such as gene expression analysis, multi-task learning, image recognition, signal processing, and medical data analysis pursue a sparse solution for the feature selection purpose and particularly favor the nonzeros \emph{evenly} distributed in different groups. The exclusive sparsity norm has…
Introduces joint exclusivity (JE), a new form of negative dependence.
problem Negative dependence structures in probability distributions.
method Defines JE by exclusion of the interior of the non-negative orthant, establishes necessary and sufficient conditions for existence, proposes a canonical construction.
result Sharp necessary and sufficient condition for existence of JE random vectors with prescribed marginals.
We consider the symmetric exclusion process on suitable random grids that approximate a compact Riemannian manifold. We prove that a class of random walks on these random grids converge to Brownian motion on the manifold. We then consider the empirical density field of the symmetric exclusion process and prove that it …
We review two strands of conceptual approaches to the formal representation of a decision maker's non-knowledge at the initial stage of a static one-person, one-shot decision problem in economic theory. One focuses on representations of non-knowledge in terms of probability measures over sets of mutually exclusive and …
Extends conformal prediction to contrastive learning for better coverage of positive samples.
problem Lack of principled guarantees on coverage in contrastive learning.
method Introduces minimum-volume covering sets with learnable constraints.
result Improves inclusion-exclusion trade-offs in positive and negative samples.
Study reveals hidden structure behind Racah matrices for twisted knots.
problem Understanding non-associativity in representation products of twisted knots.
method Analysis of quantum R-matrices and their eigenvalues to decompose Racah matrices.
result Discovery of pentad structure (Tˉ,Sˉ,S,E,B) associated with universal R-matrix. Exclusive Group Lasso improves feature selection in correlated biological data.
problem Correlated features hinder Lasso performance in biological classification problems.
method Proposes and solves the exclusive group Lasso, combining stability selection and random group allocation.
result Exclusive Group Lasso outperforms Lasso in comprehensive selection of informative features.
Exclusive Lasso improves survival prediction in cancer datasets.
problem Enhanced survival prediction in cancer datasets with high-dimensional genomic and clinical data.
method Proposes Exclusive Lasso regularization for feature selection in Cox regression models for grouped variables.
result Demonstrates improved survival prediction performance using Exclusive Lasso compared to standard Cox regression.
By mapping the most advanced elements of the contemporary social interactions, the world scientific collaboration network develops an extremely involved and heterogeneous organization. Selected characteristics of this heterogeneity are studied here and identified by focusing on the scientific collaboration community of…
Factorization of the differential expansion coefficients for HOMFLY-PT polynomials of double braids, discovered in arXiv:1606.06015 in the case of rectangular representations R, is extended to the first non-rectangular representations R=[2,1] and R=[3,1]. This increases chances that such factorization will take p…
New formula simplifies evolution of twist knots and calculates Racah matrices for rectangular representations.
problem Simplifying evolution of twist knots and calculating Racah matrices for rectangular representations.
method Developed a universal formula for triangular evolution matrix B applicable to rectangular representations R=[rs]. Used skew characters and Macdonald polynomials. result Explicit knowledge of twist-family evolution leads to a nearly explicit answer for Racah matrix Sˉ in arbitrary rectangular representation R. DCAE learns compact latent representations for one-class novelty detection.
problem Learning compact latent representations for one-class novelty detection.
method DCAE learns compact and collapse-free latent representations through internal discriminative layers of GANs, reconstructing in-class data finely and exclusively.
result DCAE achieves state-of-the-art performance on novelty and adversarial example detection.
N-VAE separates class-specific and shared factors in data.
problem Multimodal distribution of generative factors due to class distinction.
method N-VAE model with class-conditioned and shared latent spaces.
result Model effectively disentangles class-dependent and shared factors.
Factorization of DE coefficients is violated in antiparallel triple pretzels, but described elegantly.
problem Understanding the origins of factorization in double braids and its extension to antiparallel triple pretzels.
method Defect-preserving deformation from trefoil to antiparallel triple pretzels, analysis of DE coefficients.
result Factorization of DE coefficients is violated but described by an elegant formula for symmetric representations.
SAMI learns disentangled representations from data.
problem Learning disentangled representations from data.
method Combines diffusion models and VAEs to learn disentangled representations.
result SAMI learns disentangled representations that are interpretable and useful.
New method selects variables in groups with few nonzeros, improving support recovery.
problem Structured variable selection with sparse patterns across groups.
method Composite norm and proximal algorithm for exclusive group sparsity.
result Asymptotic consistency in signed support recovery under conventional assumptions.
New model for fair clustering ensures balanced representation of protected attributes.
problem Ensuring fair representation in clustering for protected attributes.
method Model-based formulation of fair clustering, balancing protected attributes across clusters.
result Demonstrates improved fairness in clustering through a new model.
ETM identifies field-specific keywords in text classification.
problem Unsupervised text classification with field-specific keywords.
method Weighted Lasso penalty and pairwise Kullback-Leibler divergence penalty for topic separation.
result ETM improves topic coherence by 22% and 10% compared to LDA.
An exclusion particle model is considered as a highly simplified model of a limit order market. Its price behavior reproduces the well known crossover from over-diffusion (Hurst exponent H>1/2) to diffusion (H=1/2) when the time horizon is increased, provided that orders are allowed to be canceled. For early times a ma…
Negative screening is one method to avoid interactions with inappropriate entities. For example, financial institutions keep investment exclusion lists of inappropriate firms that have environmental, social, and government (ESG) problems. They create their investment exclusion lists by gathering information from variou…
Spaces of polynomials are shown to be Euclidean balls.
problem Understanding the geometry of Lorentzian and real stable polynomials.
method Refined connection between symmetric exclusion process and polynomial geometry.
result Spaces of Lorentzian and real stable polynomials are homeomorphic to closed Euclidean balls.
EIGAN learns private representations without centralized data, outperforming state-of-the-art.
problem Private representation learning with multiple ally and adversary attributes.
method Exclusion-Inclusion Generative Adversarial Network (EIGAN) and Distributed EIGAN (D-EIGAN).
result EIGAN and D-EIGAN outperform state-of-the-art methods in accuracy and scalability.
New study analyzes security of neural network data reconstruction attacks.
problem Data reconstruction attacks pose a threat to private training data.
method Analyzes security boundary of data reconstruction attacks via neuron exclusivity state.
result Characterizes insecure/secure boundary of data reconstruction attacks.
An ongoing challenge in the analysis of document collections is how to summarize content in terms of a set of inferred themes that can be interpreted substantively in terms of topics. The current practice of parametrizing the themes in terms of most frequent words limits interpretability by ignoring the differential us…
We construct a general procedure to extract the exclusive Racah matrices S and \bar S from the inclusive 3-strand mixing matrices by the evolution method and apply it to the first simple representations R =[1], [2], [3] and [2,2]. The matrices S and \bar S relate respectively the maps (R\otimes R)\otimes \bar R\longrig…
This paper introduces a method to select and weight pretext tasks for better self-supervised speech representation learning.
problem Combining pretext tasks for better performance in self-supervised speech representation learning.
method Estimating calibrated weights for partial losses corresponding to pretext tasks during self-supervised training.
result Groups of selected and weighted pretext tasks perform better than classic baselines in automatic speech recognition and speaker/emotion recognition.
Alternatives to recurrent neural networks, in particular, architectures based on attention or convolutions, have been gaining momentum for processing input sequences. In spite of their relevance, the computational properties of these alternatives have not yet been fully explored. We study the computational power of two…
Paper tackles unfair advantages in DARTS, presenting Fair DARTS to improve neural architecture search.
problem Performance collapse in DARTS due to unfair advantages in skip connections.
method Relax exclusive competition to collaborative, let architectural weights be independent, and use zero-one loss for discretization.
result New state-of-the-art results on CIFAR-10 and ImageNet, demonstrating the effectiveness of Fair DARTS.
New method identifies latent variables with sparse perturbations.
problem Identifying latent variables with minimal supervision.
method Weakly supervised representation learning with sparse perturbations.
result Identification of latent variables up to specified blocks.
Self-supervised learning improves ECG classification performance.
problem Label scarcity in clinical 12-lead ECG data.
method Adapted self-supervised methods to ECG domain, focusing on contrastive representations and latent forecasting.
result Contrastive predictive coding adaptation yields linear evaluation performance only 0.5% below supervised performance.
Analyzes how inclusion/exclusion from STOXX Europe 600 Index affects company prices.
problem Understanding price dynamics of companies in STOXX Europe 600 Index.
method Used logit models and neural networks to analyze data.
result Identified independent variables affecting price changes.
Study risk-constrained Kelly optimization for mutually exclusive outcomes, proving support invariance and developing a structured algorithm.
problem Risk-constrained Kelly optimization for mutually exclusive outcomes with explicit state prices.
method Analyzes the finite mutually exclusive outcome version of risk-constrained Kelly optimization with explicit state prices, proving support invariance and developing a structured algorithm.
result Support is invariant across CRRA parameter and drawdown-surrogate parameter in the overround regime.
We describe the inclusive Racah matrices for the first non-(anti)symmetric rectangular representation R=[2,2] for quantum groups U_q(sl_N). Most of them have sizes 2, 3, and 4 and are fully described by the eigenvalue hypothesis. Of two 6x6 matrices, one is also described in this way, but the other one corresponds to t…
In this paper we consider the problem of semi-supervised learning with deep Convolutional Neural Networks (ConvNets). Semi-supervised learning is motivated on the observation that unlabeled data is cheap and can be used to improve the accuracy of classifiers. In this paper we propose an unsupervised regularization term…
Meta-learning improved by using information theory to prioritize data-driven adaptation.
problem Challenges in meta-learning due to the need for mutually-exclusive tasks.
method Designing a meta-regularization objective using information theory.
result Successfully uses data from non-mutually-exclusive tasks to efficiently adapt to novel tasks.
Softmax confidence misrepresents uncertainty in neural networks.
problem Neural networks fail to increase uncertainty on out-of-distribution data.
method Investigates two implicit biases in softmax confidence.
result Softmax confidence correlates with epistemic uncertainty due to decision boundary structure and deep network filtering.
The availability of large microarray data has led to a growing interest in biclustering methods in the past decade. Several algorithms have been proposed to identify subsets of genes and conditions according to different similarity measures and under varying constraints. In this paper we focus on the exclusive row bicl…