The paper defines and analyzes IC using high-dimensional directional statistics.
problem Defining and analyzing the Information Coefficient (IC) in high-dimensional settings.
method High-dimensional directional statistics, closed-form expressions, optimization, simulation, empirical analysis.
result Explicit results of the projected normal distribution and IC's nature.
Embeds directed graphs into statistical manifolds for better geodesic preservation.
problem Preserving global geodesic information in directed graphs.
method Global minimization of pairwise relative entropy and graph geodesics.
result Our embedding outperforms existing models in various evaluation metrics.
The paper studies kernel smoothing and mean shift for directional data, deriving convergence rates and mode estimation.
problem Statistical and computational problems of kernel smoothing for directional data.
method Generalization of mean shift to directional data, derivation of convergence rates, and investigation of mode estimation.
result Statistical convergence rates of directional KDE and its derivatives, ascending property of directional mean shift, and mode estimation.
DKMD is a fast signed statistic for comparing univariate distributions.
problem Comparing univariate distributions, especially preserving directionality.
method DKMD integrates kernel mean embeddings against an odd weighting function.
result DKMD preserves directionality and is robust to outliers.
Paper develops online statistical inference methods for stochastic optimization using Kiefer-Wolfowitz algorithms.
problem Online statistical inference of model parameters in stochastic optimization problems.
method Kiefer-Wolfowitz algorithm with random search directions, asymptotic distribution analysis.
result Developed valid confidence intervals for online statistical inference.
The paper reviews statistical models for high-dimensional normalized vectors.
problem Handling directional data in machine learning.
method Review of mathematical models for normalized vectors on hypersphere and real projective plane.
result Common models and technical aspects are discussed.
Paper introduces EnDKF for more accurate pose tracking.
problem Accurate pose tracking with directional uncertainty.
method EnDKF integrates unit-quaternion attitude representation for better directional uncertainty capture.
result Significant reduction in error compared to traditional methods.
Interneurons improve learning in neural networks by accelerating convergence.
problem Rapid adaptation to changing input statistics in neural networks.
method Two mathematically tractable recurrent linear neural networks were compared: one with direct recurrent connections and the other with interneurons that mediate recurrent communication.
result The network with interneurons converges more quickly than the network with direct recurrent connections, scaling logarithmically with initialization spectrum.
Improved ridge regression with Frequent Directions for large-scale tasks.
problem Improving performance of ridge regression for large-scale data.
method Combines Frequent Directions with iterative optimization schemes.
result Achieves high accuracy in estimating bias and variance for sketched ridge regression.
This work tackles asymmetric community estimation in multi-layer directed networks.
problem Estimating different numbers of sender and receiver communities in multi-layer directed networks.
method Proposes a goodness-of-fit test based on the largest singular value of an aggregated normalized residual matrix.
result Develops sequential and ratio-based testing procedures to consistently determine true sender and receiver community numbers.
New method for testing directed graphs using surrogate data.
problem No established method for statistical testing on directed graphs.
method Define directed graph wide-sense stationary signals, generate surrogates preserving covariance, construct null distributions.
result Feasibility and superiority of new approach over existing methods.
Workshop on shape analysis discusses new research directions.
problem No specific problem stated; focus on new directions in shape analysis.
method Discussion and collaboration among researchers.
result Promising new directions in shape analysis were discussed.
Direct Density Ratio Optimization aligns LLMs with human preferences without assuming specific models.
problem Statistical inconsistency in aligning LLMs with human preferences.
method Direct Density Ratio Optimization (DDRO) estimates density ratio directly.
result DDRO is statistically consistent, converging to true human preferences as data grows.
We provide a correction to the expression for scoring Gaussian directed acyclic graphical models derived in Geiger and Heckerman [Ann. Statist. 30 (2002) 1414-1440] and discuss how to evaluate the score efficiently.
A new method for few-shot learning using directional statistics.
problem Few-shot classification with limited training data.
method Generates class representatives using a mixture of von Mises-Fisher distributions to capture inter-class correlation.
result Outperforms other methods in miniImageNet and tieredImageNet datasets.
Improves SGD convergence by online linear regression of gradients in multiple directions.
problem SGD's rough approximations of gradients lead to suboptimal plateaus and saddle points.
method Online linear regression of noisy gradients using PCA to estimate second-order behavior, and gradient descent outside the subspace.
result Improves convergence by avoiding suboptimal plateaus and saddles, leading to better final values.
Develop a variational framework for statistical inference on cyclic interactions.
problem Estimating and comparing large-scale recurrent organization in directed interactions.
method Represent directed interactions as edge flows on a simplicial complex and evolve under an energy-minimizing dynamical system.
result Separate transient interaction components from persistent harmonic flows, yielding a low-dimensional cycle space.
New method controls FDR for sparse GLMs, identifying positive and negative relationships.
problem Sparse GLMs with high-dimensional data and varying sample size.
method Debiased-Lasso estimator and CLIME method for precision matrix estimation.
result Asymptotically controls directional FDR and FDV for sparse GLMs.
The paper finds non-Gaussian directions in high-dimensional data using Wasserstein distance.
problem Locating interesting non-Gaussian features in high-dimensional data.
method Projection pursuit using 2-Wasserstein distance to maximize the difference from Gaussian.
result Statistical guarantees for accurately approximating an unknown low-dimensional non-Gaussian subspace.
Bayesian nonparametric model for priors on directed graphs.
problem Constructing priors for exchangeable directed graphs.
method Infinite relational digraphon model (di-IRM) for constructing priors.
result Demonstrated inference on synthetic data.
In this paper, we consider the problem of minimizing the sum of two convex functions subject to linear linking constraints. The classical alternating direction type methods usually assume that the two convex functions have relatively easy proximal mappings. However, many problems arising from statistics, image processi…
This paper reviews off-policy evaluation methods in reinforcement learning.
problem Efficiency and accuracy of off-policy evaluation methods in reinforcement learning.
method Discussion of existing OPE methods, their statistical properties, and related research directions.
result Efficiency bounds and state-of-the-art OPE methods in reinforcement learning.
We propose a graphical model for representing networks of stochastic processes, the minimal generative model graph. It is based on reduced factorizations of the joint distribution over time. We show that under appropriate conditions, it is unique and consistent with another type of graphical model, the directed informa…
Proposes φ-table for statistical SHAP explanations in regression models.
problem Lack of clear directional summaries, uncertainty, and fidelity in SHAP feature importance.
method SHAP importance selection, fitting a standardized linear surrogate, reporting coefficients, uncertainty, fidelity, and stability.
result Extends SHAP into a statistical global explanation with direction, uncertainty, fidelity, and stability.
Surveying nonparametric inference with shape constraints, past and future.
problem Statistical inference under shape constraints.
method Historical overview and future directions.
result Outlook on future research directions.
Distributions over permutations arise in applications ranging from multi-object tracking to ranking of instances. The difficulty of dealing with these distributions is caused by the size of their domain, which is factorial in the number of considered entities (n!). It makes the direct definition of a multinomial dist…
REGAIN learns optimal auxiliary directions for forecast reconciliation.
problem Forecast reconciliation from fixed systems; identifying useful auxiliary directions.
method REGAIN learns normalized auxiliary directions, forecasts induced series, and selects directions by loss reduction.
result Gain-selected auxiliary directions improve forecast quality, especially for residual uncertainty.
In this paper, we explore and detail our experiments in a high-dimensionality, multi-class image classification problem often found in the automatic recognition of Sign Languages. Here, our efforts are directed towards comparing the characteristics, advantages and drawbacks of creating and training Support Vector Machi…
Develops a statistical theory linking deep learning and proximal splitting.
problem Improving statistical models for deep learning.
method Proximal splitting method for optimising deep learning objectives.
result Establishes a link between traditional and deep learning models.
This paper reviews statistical and machine learning methods for anti-money laundering.
problem Lack of scientific literature on statistical and machine learning methods for anti-money laundering.
method Client risk profiling and suspicious behavior flagging.
result Client risk profiling involves diagnostics, while suspicious behavior flagging involves non-disclosed features and hand-crafted risk indices.
Sum-of-Squares lower bound shows NGCA requires more samples than known algorithms.
problem Finding a non-Gaussian direction in a high-dimensional dataset.
method Sum-of-Squares (SoS) framework to prove lower bounds.
result First super-constant degree SoS lower bound for NGCA.
"Mixed Data" comprising a large number of heterogeneous variables (e.g. count, binary, continuous, skewed continuous, among other data types) are prevalent in varied areas such as genomics and proteomics, imaging genetics, national security, social networking, and Internet advertising. There have been limited efforts a…
Unified framework for various probability distribution distances.
problem Handling diverse probability distribution distances in statistics.
method General framework covering density-based and distribution-function-based divergences.
result Unified approach to classical and modern statistical procedures.
Fisher width is a geometric measure of complexity on statistical manifolds.
problem Complexity measures on statistical manifolds
method Introducing Fisher width as a Fisher-geometric analogue of Gaussian width
result Fisher width retains key structural features of Gaussian width while capturing anisotropic geometric effects
Spectral clustering for directed graphs using likelihood estimation.
problem Clustering directed graphs with edge directions.
method Maximum likelihood estimation on stochastic block models.
result Significant performance gains over existing methods.
Paper tackles efficient policy gradient estimation from off-policy data.
problem Estimating policy gradients from off-policy data is challenging and inefficient.
method Derives asymptotic lower bounds, proposes a meta-algorithm with 3-way robustness, and establishes convergence guarantees.
result Meta-algorithm achieves the lower bound on mean-squared error without parametric assumptions.
Improved DOA estimation with distributed sensors across multiple frequencies.
problem Sensor gain uncertainties and directional perturbations in multi-frequency scenarios.
method Distributed optimization with local coherence models and iterative exchange of information.
result Advantages in statistical and computational efficiency through parallel iterative technique.
SGD benefits from a directional bias in kernel regression models.
problem Improving generalization in kernel regression models.
method Generalized directional bias property of SGD in kernel regression.
result SGD converges along the eigenvector of the largest eigenvalue of the Gram matrix.
Develops statistical methods for rates of change on Riemannian manifolds.
problem Statistical inference for rates of change in spatial processes over non-Euclidean domains.
method Formalizes smoothness and constructs differential processes for Riemannian manifolds, derives conditions for kernel existence, and develops predictive inference.
result Validates theoretical findings through simulation experiments for derivatives over polyhedral meshes.
Proposes a new measure to evaluate stability of statistical parameters under distributional shifts.
problem Difficulty in transferring knowledge across data sets due to distributional changes.
method Introduces a measure of instability quantifying sensitivity of statistical parameters to Kullback-Leibler divergence and directional shifts.
result The proposed measure can elucidate the type of shifts a parameter is sensitive to and improve estimation accuracy under shifted distributions.
We extend nonparametric models to handle extrapolation, providing bounds for inference.
problem Challenges in nonparametric statistical inference when evaluating outside the conditioning variable's support.
method Introduced a class of extrapolation assumptions and a consistent estimation procedure to handle extrapolation.
result Validated extrapolation-aware conclusions through various applications and real-world data.
Survey of challenges and future directions in applying RL to real-world settings.
problem Challenges in deploying RL in practical settings due to limited interaction and changing environments.
method Analysis of RL system design, implementation, and continual improvement.
result Need for theory and methodology to bridge research and application gap.
Motivation: Algorithms that discover variables which are causally related to a target may inform the design of experiments. With observational gene expression data, many methods discover causal variables by measuring each variable's degree of statistical dependence with the target using dependence measures (DMs). Howev…
Paper proposes methods to learn DAGs from partial orderings.
problem Learning DAGs from partial orderings is challenging.
method General estimation framework and efficient algorithms for low- and high-dimensional problems.
result Efficient estimation of DAGs from partial orderings is possible.
We analyze a family of methods for statistical causal inference from sample under the so-called Additive Noise Model. While most work on the subject has concentrated on establishing the soundness of the Additive Noise Model, the statistical consistency of the resulting inference methods has received little attention. W…
Kurdistan Region is a tourist hub. This research analyzes other Non-Oil Sectors that have huge attractions of Foreign Direct Investments into the Kurdistan Region from 2005 to 2013. Comparative analysis was carried out between Iraq and the Region, and among influential Sectors of the Economy. T-test and ANOVA are stati…
Model for directed synthesis of audio textures using multi-scale RNNs.
problem Challenges in modeling complex audio textures with traditional methods.
method Combining multi-scale RNNs with a conditioning strategy for user-directed synthesis.
result Demonstrated improved performance on various audio texture datasets.
Graphical models are popular statistical tools which are used to represent dependent or causal complex systems. Statistically equivalent causal or directed graphical models are said to belong to a Markov equivalent class. It is of great interest to describe and understand the space of such classes. However, with curren…