arXiv research

This work optimizes induced correlation in joint graph embeddings.

Proposes a new model to better handle correlation risk in credit risk calculations.

First passage models, where corporate assets undergo correlated random walks and a company defaults if its assets fall below a threshold provide an attractive framework for modeling the default process. Typical one year default correlations are small, i.e., of order a few percent, but nonetheless including correlations…

Better signal detection in undersampled data using joint and cross covariances.

Mutually interacting components form complex systems and the outputs of these components are usually long-range cross-correlated. Using wavelet leaders, we propose a method of characterizing the joint multifractal nature of these long-range cross correlations, a method we call joint multifractal analysis based on wavel…

New method detects and analyzes correlation in multiple network data.

An important application of Lebesgue integral quadrature arXiv:1807.06007 is developed. Given two random processes, $f(x)$ and $g(x)$, two generalized eigenvalue problems can be formulated and solved. In addition to obtaining two Lebesgue quadratures (for $f$ and $g$) from two eigenproblems, the projections of $f$- and…

Complex systems are composed of mutually interacting components and the output values of these components are usually long-range cross-correlated. We propose a method to characterize the joint multifractal nature of such long-range cross correlations based on wavelet analysis, termed multifractal cross wavelet analysis…

The paper explores the relationship between joint mixability and negative dependence structures.

Develops a method for stress testing correlations of financial portfolios.

The paper proposes a method to construct well-calibrated prediction sets for correlated target variables.

Many complex systems generate multifractal time series which are long-range cross-correlated. Numerous methods have been proposed to characterize the multifractal nature of these long-range cross correlations. However, several important issues about these methods are not well understood and most methods consider only o…

Variational Auto-Encoders (VAEs) have been widely applied for learning compact, low-dimensional latent representations of high-dimensional data. When the correlation structure among data points is available, previous work proposed Correlated Variational Auto-Encoders (CVAEs), which employ a structured mixture model as …

Optimizes high-dimensional portfolios using joint shrinkage.

Enhances multimodal generation with Normalizing Flows and correlation analysis.

Study finds multifractal cross-correlations between agricultural markets and external uncertainties.

Previous work has shown that popular trending events are important external factors which pose significant influence on user search behavior and also provided a way to computationally model this influence. However, their problem formulation was based on the strong assumption that each event poses its influence independ…

Develops a new framework for joint portfolio risk forecasting.

The problem of determining the joint probability distributions for correlated random variables with pre-specified marginals is considered. When the joint distribution satisfying all the required conditions is not unique, the "most unbiased" choice corresponds to the distribution of maximum entropy. The calculation of t…

Estimating the difficulty level of math word problems is an important task for many educational applications. Identification of relevant and irrelevant sentences in math word problems is an important step for calculating the difficulty levels of such problems. This paper addresses a novel application of text categoriza…

Improves joint distribution learning for high-dimensional datasets with complex correlations.

Causal discovery predicts unobserved joint statistics from observed data.

Enhances sensitivity analysis for correlated inputs.

New estimator for joint entropy outperforms existing methods in various distributions.

Proposes a multi-view VAE for imputing missing data from correlated sources.

The paper explores local-correlation models for pricing complex financial contracts.

Calibrates historical and implied correlations in energy markets.

Paper uses non-Euclidean analysis to classify brain structure variations.

The paper maps time-series onto networks to reveal hidden joint information.

Multi-Entity Dependence Learning (MEDL) explores conditional correlations among multiple entities. The availability of rich contextual information requires a nimble learning scheme that tightly integrates with deep neural networks and has the ability to capture correlation structures among exponentially many outcomes. …

Method estimates sparse inverse covariance and partial correlation matrices efficiently.

Two methods are proposed to filter correlations in DCC-GARCH residuals for foreign exchange rates.

Study reveals efficient recovery of multi-modal signals via Bayesian methods and sequential learning.

Manifold matching works to identify embeddings of multiple disparate data spaces into the same low-dimensional space, where joint inference can be pursued. It is an enabling methodology for fusion and inference from multiple and massive disparate data sources. In this paper we focus on a method called Canonical Correla…

We analyze a method to produce pairs of non independent Poisson processes $M(t),N(t)$ from positively correlated, self-decomposable, exponential renewals. In particular the present paper provides the family of copulas pairing the renewals, along with the closed form for the joint distribution $p_{m,n}(s,t)$ of the pair…

For joint inference over multiple variables, a variety of structured prediction techniques have been developed to model correlations among variables and thereby improve predictions. However, many classical approaches suffer from one of two primary drawbacks: they either lack the ability to model high-order correlations…

Using a large set of daily US and Japanese stock returns, we test in detail the relevance of Student models, and of more general elliptical models, for describing the joint distribution of returns. We find that while Student copulas provide a good approximation for strongly correlated pairs of stocks, systematic discre…

A privacy-constrained information extraction problem is considered where for a pair of correlated discrete random variables $(X,Y)$ governed by a given joint distribution, an agent observes $Y$ and wants to convey to a potentially public user as much information about $Y$ as possible without compromising the amount of …

In this paper, we introduce the problem of jointly learning feed-forward neural networks across a set of relevant but diverse datasets. Compared to learning a separate network from each dataset in isolation, joint learning enables us to extract correlated information across multiple datasets to significantly improve th…

A novel extrapolation method is proposed for longitudinal forecasting. A hierarchical Gaussian process model is used to combine nonlinear population change and individual memory of the past to make prediction. The prediction error is minimized through the hierarchical design. The method is further extended to joint mod…

Multivariate probability density functions of returns are constructed in order to model the empirical behavior of returns in a financial time series. They describe the well-established deviations from the Gaussian random walk, such as an approximate scaling and heavy tails of the return distributions, long-ranged volat…

This paper generalizes Moody's correlated binomial default distribution for homogeneous (exchangeable) credit portfolio, which is introduced by Witt, to the case of inhomogeneous portfolios. As inhomogeneous portfolios, we consider two cases. In the first case, we treat a portfolio whose assets have uniform default cor…

ProbETA models travel time correlations between trips for better navigation.

Understanding and developing a correlation measure that can detect general dependencies is not only imperative to statistics and machine learning, but also crucial to general scientific discovery in the big data age. In this paper, we establish a new framework that generalizes distance correlation --- a correlation mea…

This paper proposes a method to select relevant features for multi-label learning.

Study analyzes stock market correlations using multivariate distributions.

A deep neural network detects sleep events in polysomnograms with high accuracy.

Machine learning improves joint default assessment by capturing non-linear dependencies.