Paper addresses the disparity between sampled and mean representations in disentangled learning.
problem Disparity between sampled and mean representations in disentangled learning.
method Proposes a method to eliminate the disparity by proving and utilizing the relationship between total correlation of sampled and mean representations for multivariate normal distributions.
result Demonstrates that a factorized mean representation can have lower total correlation than the sampled representation.
Unsupervised learning of disentangled representations involves uncovering of different factors of variations that contribute to the data generation process. Total correlation penalization has been a key component in recent methods towards disentanglement. However, Kullback-Leibler (KL) divergence-based total correlatio…
Advances in unsupervised learning enable reconstruction and generation of samples from complex distributions, but this success is marred by the inscrutability of the representations learned. We propose an information-theoretic approach to characterizing disentanglement and dependence in representation learning using mu…
GCAE uses density estimation to achieve reliable disentanglement in latent space.
problem Disentangled learning representations suffer from reliability issues.
method GCAE uses Gaussian Channel Autoencoder with Dual Total Correlation (DTC) to avoid the curse of dimensionality.
result GCAE achieves highly competitive and reliable disentanglement scores.
We investigate the two components of the total daily return (close-to-close), the overnight return (close-to-open) and the daytime return (open-to-close), as well as the corresponding volatilities of the 2215 NYSE stocks from 1988 to 2007. The tail distribution of the volatility, the long-term memory in the sequence, a…
ReDi improves few-step generation for discrete data models.
problem Slow sampling speeds in discrete flow-based models.
method Rectified Discrete Flow (ReDi) reduces factorization error by rectifying coupling.
result Empirically, ReDi reduces Conditional Total Correlation and enables few-step generation.
If the probability of default parameters (PDs) fed as input into a credit portfolio model are estimated as through-the-cycle (TTC) PDs stressed market conditions have little impact on the results of the capital calculations conducted with the model. At first glance, this is totally different if the PDs are estimated as…
We decompose the evidence lower bound to show the existence of a term measuring the total correlation between latent variables. We use this to motivate our β-TCVAE (Total Correlation Variational Autoencoder), a refinement of the state-of-the-art β-VAE objective for learning disentangled representations, requiring n…
Optimizing rewards under budget constraints with correlated costs and rewards.
problem Maximizing total expected reward under a budget constraint on total cost with correlated and potentially heavy-tailed cost-reward pairs.
method Proposes algorithms exploiting correlation between cost and reward via linear minimum mean-square error estimation to achieve tight regret bounds.
result Achieves O(logB) regret for a budget B>0 under certain moment conditions. Proposes TCWAE to learn disentangled representations using the Wasserstein Autoencoder.
problem Balancing reconstruction fidelity and disentanglement in learning representations.
method TCWAE (Total Correlation Wasserstein Autoencoder) using different KL estimators.
result Competitive results on data sets with known generative factors, and improved reconstructions on unknown factors.
The study examines correlations of logarithms of integers at different scalings.
problem Analyzing pair correlations of logarithms of integers at various scalings.
method Examined correlations of logarithms of positive integers at different scalings, proving the existence of pair correlation functions.
result Level repulsion at linear scaling, total loss of mass at superlinear scalings, and Poissonian behavior at sublinear scalings.
In this paper, we study a continuous time structural asset value model for two correlated firms using a two-dimensional Brownian motion. We consider the situation of incomplete information, where the information set available to the market participants includes the default time of each firm and the periodic asset value…
A new method captures higher-order interactions in data clusters.
problem Accurately characterizing complex higher-order variable interactions.
method Local Correlation Explanation (CorEx) method: clustering and total correlation.
result Captures higher-order interactions at a local scale.
This work improves texture segmentation by automatically tuning hyperparameters for Total-Variation.
problem The challenge is to automatically select hyperparameters for Total-Variation texture segmentation.
method The approach involves extending Stein's unbiased gradient estimator to handle correlated Gaussian noise, leading to an automatic tuning method.
result The method provides an automatic way to select hyperparameters for Total-Variation texture segmentation.
Paper relaxes differential privacy for correlated features, improving privacy-utility trade-off.
problem Standard differential privacy ignores feature correlation, leading to suboptimal privacy-utility balance.
method Introduces CorrDP framework that accounts for feature correlation, using total variation distance for quantification.
result CorrDP algorithms outperform standard DP in synthetic and real-world datasets with insensitive features.
Learning by children and animals occurs effortlessly and largely without obvious supervision. Successes in automating supervised learning have not translated to the more ambiguous realm of unsupervised learning where goals and labels are not provided. Barlow (1961) suggested that the signal that brains leverage for uns…
Sparse models for high-dimensional linear regression and machine learning have received substantial attention over the past two decades. Model selection, or determining which features or covariates are the best explanatory variables, is critical to the interpretability of a learned model. Much of the current literature…
Improved best-arm identification in correlated multi-armed bandits.
problem Best-arm identification in multi-armed bandits with correlated rewards.
method Proposed C-LUCB algorithm that exploits upper bounds on conditional rewards.
result Significant reduction in sample complexity for best-arm identification.
New measures quantify dependence between variables without distribution estimation.
problem Measuring dependence between variables in arbitrary dimensions.
method Proposed matrix-based normalized total correlation and dual total correlation measures.
result Measures are differentiable and statistically more powerful than existing methods.
This paper addresses the problem of multi-agent inverse reinforcement learning (MIRL) in a two-player general-sum stochastic game framework. Five variants of MIRL are considered: uCS-MIRL, advE-MIRL, cooE-MIRL, uCE-MIRL, and uNE-MIRL, each distinguished by its solution concept. Problem uCS-MIRL is a cooperative game in…
Paper models Pavlov's classical conditioning using stochastic processes and Langevin equations.
problem Lack of modeling for Pavlov's classical conditioning.
method Modeling neural and synaptic dynamics via Langevin equations.
result Pavlov's mechanism spontaneously leads to synaptic weights similar to Hebb's.
New condition ensures submanifolds are skew in small areas.
problem Ensuring submanifolds are skew in Euclidean space.
method Introduces a third-order differential condition.
result Constructs improved totally skew embeddings for Rn. We study the relationship between catastrophic forgetting and properties of task sequences. In particular, given a sequence of tasks, we would like to understand which properties of this sequence influence the error rates of continual learning algorithms trained on the sequence. To this end, we propose a new procedure …
Research examines correlations of complex logarithms of lattice points, showing level repulsion and Poissonian behavior.
problem Analyzing correlations of complex logarithms of lattice points.
method Proving existence of pair correlation functions and examining behavior at various scalings.
result Level repulsion observed at linear scaling, Poissonian behavior at sublinear scalings.
Dynamic Vine Copulas detect and quantify time-varying higher-order interactions in multivariate systems.
problem Time-varying dependence in multivariate systems, including tail behavior, asymmetry, and conditional structure.
method Dynamic Vine Copulas (DVC) framework for estimating and diagnosing non-Gaussian dependence, using fixed-root-order C-vines and smooth parameter trajectories.
result DVC detects and quantifies time-varying higher-order interactions, distinguishing between pairwise and conditional dependence.
Method learns diverse models to resist spurious correlations.
problem Models learn spurious correlations in i.i.d. training data.
method Multiple models with minimized conditional total correlation.
result Framework significantly outperforms baseline on distribution shift.
New method improves false-/true-positive-rate estimation in fraud detection with noisy labels.
problem Estimating FPR/TPR in fraud detection with class-conditional label noise.
method Directly cleaning model's validation data to de-correlate cleaning error with model scores.
result Improves accuracy of FPR/TPR estimates, especially in asymmetric label noise scenarios.
A new diffusion model uses efficient conditional estimators for discrete data.
problem Efficient estimation of conditional probabilities for discrete data.
method Discrete denoising diffusion framework with sample-efficient NeurISE conditional estimation.
result The method outperforms existing approaches in various metrics on binary and scientific data.
New estimator for joint entropy outperforms existing methods in various distributions.
problem Estimating joint entropy in high-dimensional spaces.
method Partitioned sample spacing (PSS) for nonparametric estimation.
result PSS consistently outperforms k-NN and normalizing flow methods.
Researchers study learning polytree graphs from linear SEMs with exact recovery conditions.
problem Learning polytree graphs from linear SEMs with exact recovery conditions.
method Study Gaussian polytree models, derive sufficient and necessary conditions for sample sizes, and establish estimation error bounds.
result Sharp characterization of difficulty with matching sufficient and necessary conditions.
cCorrGAN approximates conditional correlation matrices using GANs.
problem Learning empirical conditional distributions in the elliptope of correlation matrices.
method Conditional Generative Adversarial Networks (GANs) applied to correlation matrices.
result Validated through Monte Carlo simulations in finance.
Data mining techniques on the biological analysis are spreading for most of the areas including the health care and medical information. We have applied the data mining techniques, such as KNN, SVM, MLP or decision trees over a unique dataset, which is collected from 16,380 analysis results for a year. Furthermore we h…
We present a model of an economy inspired by individual based model approaches in evolutionary ecology. We demonstrate that evolutionary dynamics in a space of companies interconnected through a correlated interaction matrix produces time dependencies of the total size of the economy total number of companies, companie…
The paper proposes a method to stabilize predictions by identifying causal variables using a seed variable.
problem Stable prediction across unknown test data with potential spurious correlations.
method Conditional independence test based algorithm using a seed variable to separate causal from non-causal variables.
result The algorithm precisely separates causal and non-causal variables for stable prediction across test data.
The study shows how trade uncertainty affects stock-bond correlations over time.
problem Impact of trade policy uncertainty on stock-bond correlations.
method Daily data analysis using GARCH-based models (CCC, STCC, DCC) with TPU and political dummy variables.
result Time-varying correlation models better capture the dynamics of stock-bond correlations than constant models.
Although the Lasso has been extensively studied, the relationship between its prediction performance and the correlations of the covariates is not fully understood. In this paper, we give new insights into this relationship in the context of multiple linear regression. We show, in particular, that the incorporation of …
A new sparse benchmark metabench identifies key abilities from large benchmarks.
problem Redundancy and compression in existing benchmarks.
method Data from 5000+ LLMs to identify most informative items, distilling a sparse benchmark.
result Sparse benchmark metabench captures underlying abilities with high accuracy.
In many scientific tasks we are interested in discovering whether there exist any correlations in our data. This raises many questions, such as how to reliably and interpretably measure correlation between a multivariate set of attributes, how to do so without having to make assumptions on distribution of the data or t…
We investigate the trading behavior of a large set of single investors trading the highly liquid Nokia stock over the period 2003-2008 with the aim of determining the relative role of endogenous and exogenous factors that may affect their behavior. As endogenous factors we consider returns and volatility, whereas the e…
The study examines spacelike foliations on Lorentz manifolds under specific conditions.
problem Investigating geometric properties of spacelike foliations on Lorentz manifolds.
method Analyzing conditions for stability, total geodesy, and total umbilicity of foliation leaves.
result Conditions for the stability, total geodesy, and total umbilicity of spacelike foliation leaves are established.
Two algorithms learn Gaussian graphical models from Glauber dynamics trajectories.
problem Learning Gaussian graphical models from dependent data.
method Two complementary approaches: local edge-testing and burn-in/thinning reduction.
result Both approaches provide finite-sample recovery guarantees and empirical comparisons.
This letter explores the behavior of conditional correlations among main cryptocurrencies, stock and bond indices, and gold, using a generalized DCC class model. From a portfolio management point of view, asset correlation is a key metric in order to construct efficient portfolios. We find that: (i) correlations among …
Using first principles from inference, we design a set of functionals for the purposes of \textit{ranking} joint probability distributions with respect to their correlations. Starting with a general functional, we impose its desired behaviour through the \textit{Principle of Constant Correlations} (PCC), which constrai…
Detailed study of the financial empirical correlation matrix of the 30 companies comprised by DAX within the period of the last 11 years, using the time-window of 30 trading days, is presented. This allows to clearly identify a nontrivial time-dependence of the resulting correlations. In addition, as a rule, the draw d…
Buying or selling assets leads to transaction costs for the investor. On one hand, it is well know to all market practionaires that the transaction costs are positive on average and present therefore systematic loss. On the other hand, for every trade, there is a buy side and a sell side, the total amount of asset and …
Study null energy condition impacts on special hypersurfaces in static spacetimes.
problem Effects of null energy condition on totally umbilic hypersurfaces.
method Characterization of embedded surfaces and photon surfaces using Alexandrov Theorem and other methods.
result Full characterization of embedded surfaces with constant spacetime mean curvature.
Many predictive tasks, such as diagnosing a patient based on their medical chart, are ultimately defined by the decisions of human experts. Unfortunately, encoding experts' knowledge is often time consuming and expensive. We propose a simple way to use fuzzy and informal knowledge from experts to guide discovery of int…
SaR-SVM-STV improves hyperspectral image classification with shape-adaptive reconstruction and denoising.
problem Classifying hyperspectral images with limited labeled data.
method Shape-adaptive Reconstruction (SaR) for pixel preprocessing, SVM for probability estimation, and Smoothed Total Variation (STV) for denoising.
result SaR-SVM-STV outperforms SVM-STV with fewer labeled data.