The paper explains DNNs by quantifying interactions among input variables.
problem Understanding and explaining the complex behavior of deep neural networks.
method The paper defines and quantifies the significance of interactions among multiple input variables using the Shapley value.
result The proposed method effectively explains the behavior of DNNs by assigning attribution values to input variables.
In this paper, we consider the multivariate Bernoulli distribution as a model to estimate the structure of graphs with binary nodes. This distribution is discussed in the framework of the exponential family, and its statistical properties regarding independence of the nodes are demonstrated. Importantly the model can e…
New framework for detecting complex interactions in multivariate data.
problem Insufficient pairwise measures fail to capture multivariate data complexities.
method Lattice theory and operator functions to derive higher-order information-theoretic measures.
result Streitberg Information fully characterizes all interactions among d variables. New algorithm extracts shared latent space for cortico-muscular interactions.
problem Challenges of high dimensionality and limited sample sizes in multivariate cortico-muscular analysis.
method Structured and sparse partial least squares coherence (ssPLSC) algorithm.
result ssPLSC achieves competitive or better performance in scenarios with limited sample sizes and high noise levels.
Function trees simplify complex ML models for better understanding.
problem Understanding and interpreting machine learning model predictions.
method Representing a multivariate function as a tree of simpler functions.
result Function trees reveal the global internal structure of functions.
Proposes a new method to better understand complex system interactions.
problem Current methods like Granger causality and transfer entropy fail to capture higher-order interactions.
method Introduces a generalized approach to capture multivariate causal interactions.
result The method can distinguish causal roles in synergetic interactions.
Time series forecasting is often fundamental to scientific and engineering problems and enables decision making. With ever increasing data set sizes, a trivial solution to scale up predictions is to assume independence between interacting time series. However, modeling statistical dependencies can improve accuracy and …
New method detects biomarker-treatment interactions in clinical trials.
problem Detecting interactions between high-dimensional biomarkers and treatments in randomized trials.
method Two-stage penalized regression screening using ridge regression for multivariate screening.
result Ridge regression screening provides greater power than traditional methods in correlated data.
New method recovers causal networks from short time-series data.
problem Inferring causal relationships from short time-series data in complex systems.
method Large-scale Nonlinear Granger Causality (lsNGC) approach.
result Captures meaningful interactions from limited observational data.
A new metric space model for point process excitations uncovers hidden interactions.
problem Estimating pairwise interactions in multivariate Hawkes processes is often infeasible.
method Developed a Hidden Hawkes Geometry (HHG) model to embed event types in a metric space.
result Learning the embedding reveals salient interactions in various applications.
The matrix-based Renyi's α-order entropy functional was recently introduced using the normalized eigenspectrum of a Hermitian matrix of the projected data in a reproducing kernel Hilbert space (RKHS). However, the current theory in the matrix-based Renyi's α-order entropy functional only defines the entropy of a single…
New model for multivariate discrete event data with flexible interactions.
problem Modeling multivariate discrete event data with categorical interactions.
method Developed a new modeling approach with convex constraints, two estimation procedures (LS and ML).
result Proposed model can capture arbitrary shapes of historical event influence.
DCIts interprets complex time series data with interpretable coefficients.
problem Interpreting nonlinear multivariate time series data.
method Deep convolutional architecture with a Focuser and Modeler components.
result DCIts provides interpretable coefficients and interaction patterns.
We describe and extract time-ordered multibody interactions from complex systems.
problem Complex systems with temporal and multibody dependencies.
method Decompose multivariate Markov chains into time-ordered multibody interactions. Algorithm to extract interactions from data. Measure complexity of interaction ensembles.
result Robust and efficient algorithm to infer time-ordered multibody interactions from data.
Software helps teach latent variable methods in multivariate data analytics.
problem Challenges in understanding multivariate data analytics for students.
method Interactive software for comparing latent variable methods.
result Builds intuition on choosing methods and interpreting coefficients.
TimeCNN improves forecasting by refining cross-variable interactions over time.
problem Multivariate time series forecasting struggles with dynamic and multifaceted cross-variable correlations.
method TimeCNN uses timepoint-independent convolution kernels to capture evolving relationships among variables.
result TimeCNN outperforms state-of-the-art models in real-world datasets with significant computational and speed advantages.
BEGIN network models binary data without parametric assumptions.
problem Conditional independence in non-parametric families of binary data.
method BEGIN network models binary data using sparse linear representations and block factorizations.
result BEGIN network captures conditional independence for arbitrary binary and multinomial variables.
Improves MARS for nonparametric multivariate regression with dimension reduction.
problem High number of basis functions in MARS for high-order interactions.
method Linear combinations of covariates for dimension reduction, facilitating gradient calculation and eigen-analysis for estimation.
result Asymptotic theory and numerical studies show improved performance over MARS.
We consider the problem of unveiling the implicit network structure of node interactions (such as user interactions in a social network), based only on high-frequency timestamps. Our inference is based on the minimization of the least-squares loss associated with a multivariate Hawkes model, penalized by ℓ1 and t…
Proposes online learning for Hawkes processes with network structure and event interaction.
problem Modeling complex interactions and latent structures in network events.
method Online learning approach for mixture of multivariate Hawkes processes.
result Efficacy demonstrated on synthetic and real-world data.
Bayesian DDR models complex multivariate distributions.
problem Modeling relationships between multivariate distributions with differing dimensions.
method Generalized Bayesian framework using sliced Wasserstein distance and MALA for inference.
result Posterior consistency and robust fits demonstrated in simulations and real data.
Proposes a new model for complex multivariate event data.
problem Modeling complex multivariate event data with spatio-temporal dynamics.
method Integrates spatial information into latent state evolution through learned temporal and spatial decay dynamics.
result Successfully recovers sensible temporal and spatial intensity structure in multivariate spatio-temporal point patterns.
In this paper, we solve the arms exponential exploding issue in multivariate Multi-Armed Bandit (Multivariate-MAB) problem when the arm dimension hierarchy is considered. We propose a framework called path planning (TS-PP) which utilizes decision graph/trees to model arm reward success rate with m-way dimension interac…
Learning influence pathways of a network of dynamically related processes from observations is of considerable importance in many disciplines. In this article, influence networks of agents which interact dynamically via linear dependencies are considered. An algorithm for the reconstruction of the topology of interacti…
Kernel-based tests detect dependencies in multivariate time series, including stationary and non-stationary data.
problem Detecting dependencies in multivariate time series data, especially non-stationary data.
method Kernel-based statistical tests of joint independence, extending dHSIC to handle both stationary and non-stationary processes.
result Robustly uncovers significant higher-order dependencies in synthetic and real-world data.
New measures and tests for high-order interactions in complex data.
problem Challenges in capturing high-order interactions in multivariate data.
method Hierarchy of d-order interaction measures and kernel-based tests. result Established statistical significance of high-order interactions.
Multivariate time series prediction has applications in a wide variety of domains and is considered to be a very challenging task, especially when the variables have correlations and exhibit complex temporal patterns, such as seasonality and trend. Many existing methods suffer from strong statistical assumptions, numer…
Algorithm detects lead-lag relationships in multivariate time series.
problem Understanding temporal dependencies between time series.
method Cluster-driven methodology based on dynamic time warping.
result Robust detection of lead-lag relationships in lagged multi-factor models.
New ensemble models classify mouse movement trajectories to assess survey question difficulty.
problem Assessing survey question difficulty based on respondents' interaction data.
method Ensemble models combining semi-metric-based weak learners to classify multivariate functional data.
result Improved survey data quality through better identification of respondent difficulty.
New tests detect high-order interactions without permutations.
problem Scalability issues in kernel-based tests for high-order interactions.
method Permutation-free high-order tests using V-statistics and cross-centring.
result Tests yield standard normal distribution under null hypothesis.
SMART combines decision trees and MARS for better regression modeling.
problem High variance in decision trees for continuous relationships, poor performance in MARS for discontinuities.
method SMART uses a decision tree to identify subsets with distinct continuous relationships, then applies MARS to fit these relationships independently.
result SMART improves regression performance over state-of-the-art methods in capturing discontinuities and continuous relationships.
Technology and collaboration enable dramatic increases in the size of psychological and psychiatric data collections, but finding structure in these large data sets with many collected variables is challenging. Decision tree ensembles like random forests (Strobl, Malley, and Tutz, 2009) are a useful tool for finding st…
Optimization is commonly employed to determine the content of web pages, such as to maximize conversions on landing pages or click-through rates on search engine result pages. Often the layout of these pages can be decoupled into several separate decisions. For example, the composition of a landing page may involve dec…
Angular measurements are often modeled as circular random variables, where there are natural circular analogues of moments, including correlation. Because a product of circles is a torus, a d-dimensional vector of circular random variables lies on a d-dimensional torus. For such vectors we present here a class of graph…
New models for analyzing microbiome data with interactions.
problem Analyzing compositional data with interactions.
method Exponential family models with generalized score matching.
result Effective estimation methods for compositional data with interactions.
Dynamic Vine Copulas detect and quantify time-varying higher-order interactions in multivariate systems.
problem Time-varying dependence in multivariate systems, including tail behavior, asymmetry, and conditional structure.
method Dynamic Vine Copulas (DVC) framework for estimating and diagnosing non-Gaussian dependence, using fixed-root-order C-vines and smooth parameter trajectories.
result DVC detects and quantifies time-varying higher-order interactions, distinguishing between pairwise and conditional dependence.
A new method captures higher-order interactions in data clusters.
problem Accurately characterizing complex higher-order variable interactions.
method Local Correlation Explanation (CorEx) method: clustering and total correlation.
result Captures higher-order interactions at a local scale.
Understanding the diffusion in social network is an important task. However, this task is challenging since (1) the network structure is usually hidden with only observations of events like "post" or "repost" associated with each node, and (2) the interactions between nodes encompass multiple distinct patterns which in…
This work develops a learning theory for inferring interaction kernels in complex agent systems.
problem Modeling complex interactions in systems of particles or agents.
method Nonparametric regression and approximation theory.
result Strong consistency and optimal convergence rates for estimators of interaction kernels.
We show that multivariate Hawkes processes coupled with the nonparametric estimation procedure first proposed in Bacry and Muzy (2015) can be successfully used to study complex interactions between the time of arrival of orders and their size, observed in a limit order book market. We apply this methodology to high-fre…
Extends QHawkes to MQHawkes for analyzing financial co-jumps.
problem Capturing endogenous co-jumps in financial markets.
method Develops MQHawkes process with quadratic kernels, investigates stationarity, and derives Yule-Walker equations.
result Volatility distribution exhibits power-law behavior with computable exponents.
DUET enhances multivariate time series forecasting by clustering time and channels.
problem Heterogeneous temporal patterns and complex channel correlations in multivariate time series.
method DUET uses dual clustering on temporal and channel dimensions to handle these challenges.
result DUET achieves state-of-the-art performance on 25 real-world datasets.
New method uses information theory to uncover causal relationships in complex systems.
problem Discovering causal relationships in multivariate systems, especially in Bayesian networks and hypergraphs.
method Partial Information Decomposition (PID) to explicitly model higher-order interactions.
result PID components reveal direct causal neighbors and collider relationships in Bayesian networks and multi-tail hyperedges in causal hypergraphs.
Study uses DNM theory to detect early warning signals of market instability.
problem Detecting early warning signals of financial market instability.
method Applying Dynamical Network Marker (DNM) theory to trading data from the Tokyo Stock Exchange.
result Early warning signals of large price movements can be detected on a daily time scale.
IETNet identifies important channels for MVTS classification.
problem Multivariate time series classification with blackbox deep networks.
method End-to-end network combining temporal feature extraction, variable selection, and interaction.
result IETNet improves model accuracy and reduces overfitting by identifying and removing non-predictive variables.
Enformer and GEnformer use Transformers with stochastic learning to forecast multivariate and spatiotemporal data with uncertainty.
problem Uncertainty quantification in multivariate time series and spatiotemporal forecasting.
method Synthesizing Transformer's expressive power with stochastic learning to model conditional distributions directly.
result Enformer and GEnformer yield calibrated probabilistic forecasts and outperform state-of-the-art baselines.
Spacetimeformer learns spatiotemporal relationships from data alone.
problem Forecasting multivariate time series with distinct spatial relationships.
method Transformers with dynamic graph connections learning interactions between space, time, and value.
result Competitive results on various time series prediction benchmarks.
Natural and social multivariate systems are commonly studied through sets of simultaneous and time-spaced measurements of the observables that drive their dynamics, i.e., through sets of time series. Typically, this is done via hypothesis testing: the statistical properties of the empirical time series are tested again…