Covariance in physics and CNNs share similarities, with simple assumptions uniquely determining convolution forms.
problem Understanding the similarities between physics and CNNs using covariance.
method Examined similarities and differences, and demonstrated that simple assumptions lead to unique convolution forms.
result Simple assumptions of covariance, locality, linearity, and weight sharing uniquely determine convolution forms.
A new method selects covariates for causal effect estimation without strong assumptions.
problem Estimating causal effects without global causal structure learning and strong assumptions.
method Local covariate selection method that avoids pretreatment and causal sufficiency assumptions.
result The method achieves accurate causal effect estimation with improved computational efficiency.
We calculate eigenvector overlaps between intersecting time periods of covariance matrices.
problem Analyzing overlapping time periods in covariance matrices.
method Girko linearisation and extended local laws.
result Computed eigenvector overlaps for intersecting time intervals.
Local learning method selects covariates for causal effect estimation in the presence of latent variables.
problem Estimating causal effects from nonexperimental data with latent variables.
method Local learning approach that identifies valid adjustment sets for causal relationships.
result Ensures soundness and completeness of causal effect estimation under standard assumptions.
This paper explores estimating chaotic dynamics and parameters using local ensemble Kalman filters.
problem Estimating chaotic dynamics and parameters from observations.
method Local ensemble Kalman filters with covariance and local domain localisation.
result Rigorously updating global parameters using a local domain ensemble Kalman filter.
Compact bilinear pooling approximates covariance features for faster training.
problem Efficiently approximating covariance features for faster training.
method Compact bilinear pooling extended to polynomial approximations of covariance features.
result The proposed method achieves comparable accuracy with fewer dimensions.
We explain the meaning of local symmetries in physics.
problem Understanding the meaning of local symmetries in physics.
method We argue that general covariance and gauge principles are principles of epistemic access to physical laws, leading to ontological insights.
result Relationality is a core notion in gauge field theory, encoded by local symmetries.
The paper proves local laws for non-separable sample covariance matrices.
problem Analyzing non-separable sample covariance matrices with dependent or nonlinearly transformed data.
method Tensor network framework for analyzing fluctuation averaging in the presence of higher-order cumulant structure.
result Optimal averaged local law and full anisotropic local law for non-separable sample covariance matrices.
Method solves Gaussian graphical models on ladder graphs efficiently.
problem Solving Gaussian graphical models on ladder graphs efficiently.
method Proposes a method that depends on the position of zeros in local covariance matrices.
result Efficiently solves Gaussian graphical models on ladder graphs under certain conditions.
GLSKF improves tensor completion by capturing both global and local variations.
problem Tensor completion with missing entries, especially in data with spatial or temporal side information.
method Integrates smoothness-constrained low-rank factorization with a locally correlated residual process.
result GLSKF achieves superior performance and scalability on real-world datasets.
Recent work suggests that some auto-encoder variants do a good job of capturing the local manifold structure of the unknown data generating density. This paper contributes to the mathematical understanding of this phenomenon and helps define better justified sampling algorithms for deep learning based on auto-encoder v…
Develops model-free methods for event history analysis and efficient covariate adjustment.
problem Estimating treatment effects while accounting for confounding and understanding event history.
method Model-free prediction techniques, Local Covariance Measure (LCM), Debiased Outcome-adapted Propensity Estimator (DOPE), Aalen Covariance Measure (ACM).
result Demonstrates the effectiveness and robustness of the proposed methods in various settings.
Gradients help find global optima in complex functions.
problem Finding global optima in functions with many local minima.
method A principle for generating search directions from non-local quadratic approximants based on gradients.
result The proposed algorithm and CMA-ES perform better than random reinitialized BFGS.
Interactive privacy mechanisms improve spectral density estimation under local differential privacy.
problem Estimating spectral density of Gaussian time series with local differential privacy constraints.
method Two-stage process: Laplace mechanism followed by privatized sample analysis.
result Interactive mechanisms achieve faster rates for spectral density estimation.
Paper analyzes ensemble Kalman updates for effective dimension and localization.
problem Why small ensemble sizes work well in inverse problems and data assimilation.
method Non-asymptotic analysis of ensemble Kalman updates, focusing on effective dimension and localization.
result Rigorously explains why a small ensemble size is sufficient when prior covariance has moderate effective dimension.
This study improves estimation of locally stationary functional time series using NW method.
problem Accurately capturing time-dependence in locally stationary functional time series with time-varying covariates.
method Nadaraya-Watson (NW) estimation procedure for the conditional distribution of LSFTS.
result Established convergence rates of NW estimator for LSFTS with respect to Wasserstein distance.
We construct a covariant functor from a category of Abelian principal bundles over globally hyperbolic spacetimes to a category of *-algebras that describes quantized principal connections. We work within an appropriate differential geometric setting by using the bundle of connections and we study the full gauge group,…
The paper studies empirical processes from nearest neighbors in regression.
problem Estimating conditional cumulative distribution functions and local linear regression.
method Uniform central limit theorem and non-asymptotic bound under local bracketing entropy and uniform entropy numbers.
result Gaussian limit of empirical process with simple covariance.
We define a random-matrix ensemble given by the infinite-time covariance matrices of Ornstein-Uhlenbeck processes at different temperatures coupled by a Gaussian symmetric matrix. The spectral properties of this ensemble are shown to be in qualitative agreement with some stylized facts of financial markets. Through the…
CSL selects best model from library based on covariates.
problem Selecting the best model from a library based on covariates.
method Uses meta learning and cross-validation to find a local minimum.
result Converges at a rate faster than Op(n−1/4) and offers extensive empirical evidence. We develop a more efficient NGD method for structured parameters.
problem Computational challenges in NGD for structured parameter spaces.
method Local-parameter coordinates to simplify Fisher-matrix computations.
result New structured second-order algorithms and learning methods.
Develops a test for conditional local independence of counting processes.
problem Testing the hypothesis of conditional local independence among continuous time stochastic processes.
method Introduces a new functional parameter, the Local Covariance Measure (LCM), and proposes a test called (X)-LCT using nonparametric estimators and sample splitting or cross-fitting.
result The (X)-LCT test can be controlled uniformly with modest rates, and it works well without restrictive parametric assumptions.
Machine learning and geostatistics are powerful mathematical frameworks for modeling spatial data. Both approaches, however, suffer from poor scaling of the required computational resources for large data applications. We present the Stochastic Local Interaction (SLI) model, which employs a local representation to impr…
We review recent probabilistic results on covariant Schrödinger operators on vector bundles over (possibly locally infinite) weighted graphs, and explain applications like semiclassical limits. We also clarify the relationship between these results and their formal analogues on smooth (possibly noncompact) Riemannian m…
Novel method for high-dimensional BO using CMA to define local regions.
problem Challenges in applying BO to high-dimensional optimization problems.
method CMA strategy to learn search distribution and define local regions.
result Our method outperforms existing techniques on various benchmarks.
The accurate prediction of time-changing covariances is an important problem in the modeling of multivariate financial data. However, some of the most popular models suffer from a) overfitting problems and multiple local optima, b) failure to capture shifts in market conditions and c) large computational costs. To addr…
Study nonparametric covariance function estimation for noisy data.
problem Estimating covariance function from discrete noisy data in high dimensions.
method Adaptive learning-based estimators, including deep learning.
result Established oracle inequality and convergence rates for deep learning estimators.
New method for private linear regression under privacy constraints, achieving optimal rates.
problem Statistical complexity of private linear regression under unknown, ill-conditioned covariates.
method Information-Weighted Regression method
result Optimal convergence rates for both central and local privacy models.
Method predicts spatio-temporal patterns varying by region.
problem Predicting spatio-temporal processes with varying temporal patterns across regions.
method Localized spatio-temporal covariance model and sequential covariance fitting.
result Accurately predicts missing data in spatial regions over time.
A-BLINK speeds up Gaussian process covariance estimation.
problem Slow covariance matrix inversion in Gaussian processes.
method Two pre-trained neural networks learn Kriging weights and spatial variance.
result Significant computational speedups and posterior inference.
New method uses machine learning to improve statistical inference.
problem Performing inference on conditional functionals with scarce labeled data.
method Combines localization with prediction-based variance reduction.
result Valid and sharp confidence intervals for conditional functionals.
Geodesic curves improve flexibility in covariance estimation.
problem Inflexible covariance families limit spatiotemporal modeling.
method Use geodesic curves to build more flexible covariance families.
result Natural projection minimizes geodesic distance to sample covariance.
Develops locally private methods for nonparametric contextual bandits.
problem Privacy concerns in sequential decision-making on sensitive data.
method Uniform-confidence-bound-type estimator and jump-start scheme.
result Minimax optimality of proposed methods supported by lower bounds.
New method improves ensemble diversity and generalization.
problem Ensemble diversity does not guarantee practical generalization.
method Introduced a new diversity metric and training method for extrapolating differently on local data patches.
result Improves generalization and diversity in practical settings, especially under data limits and covariate shift.
New decompositions misattribute differences between populations, even when outcomes are identical.
problem Misattribution of differences between populations using common functional decompositions.
method Extending the Kitagawa-Oaxaca-Blinder decomposition to nonlinear functional decompositions.
result Functional ANOVA and Accumulated Local Effects can misattribute differences even when outcomes are identical in two populations.
We formulate the variational problem for AdS gravity with Dirichlet boundary conditions and demonstrate that the covariant counterterms are necessary to make the variational problem well-posed. The holographic charges associated with asymptotic symmetries are then rederived via Noether's theorem and `covariant phase sp…
Semi-supervised method boosts two-sample testing with covariate data.
problem Two-sample testing with covariate information.
method Semi-supervised kernel test with asymptotic normality.
result Higher asymptotic power compared to existing methods.
Designing a covariance function that represents the underlying correlation is a crucial step in modeling complex natural systems, such as climate models. Geospatial datasets at a global scale usually suffer from non-stationarity and non-uniformly smooth spatial boundaries. A Gaussian process regression using a non-stat…
In modeling multivariate time series, it is important to allow time-varying smoothness in the mean and covariance process. In particular, there may be certain time intervals exhibiting rapid changes and others in which changes are slow. If such time-varying smoothness is not accounted for, one can obtain misleading inf…
Defines a bundle map for currents on manifolds using higher covariant derivatives.
problem Defining a bundle map for currents on manifolds.
method Using higher covariant derivatives on a manifold equipped with a torsion-free connection.
result The bundle of generalized Weyl algebras and its properties.
Paper optimizes federated PCA for covariance estimation under privacy constraints.
problem Privacy-preserving covariance estimation in federated learning.
method Federated PCA, matrix version of van Trees' inequality, three-layer spectral decomposition.
result Optimal rates of convergence for central server's estimation, robust to inconsistent local estimators.
Introduces intrinsic Riemannian cross-covariance for manifold-valued random objects.
problem Covariance estimation for random objects on Riemannian manifolds.
method Defines covariance and correlation via parallel transport.
result Proposed covariance is independent of coordinate choices.
DGCP uses deep neural networks to optimize hyperparameters for Gaussian processes.
problem Optimizing hyperparameters for Gaussian processes in non-uniform input spaces.
method DGCP uses a deep neural network to learn hyperparameters of non-stationary covariance functions.
result DGCP improves Gaussian process predictions in locally adapted or sparse input spaces.
Paper proposes DP-Thresholding for estimating sparse high-dimensional covariance matrices with differential privacy.
problem Estimating sparse high-dimensional covariance matrices under differential privacy constraints.
method DP-Thresholding method for achieving non-trivial error bounds.
result DP-Thresholding achieves significant error bounds compared to existing methods.
A new method improves few-shot learning by combining ProtoNet with LFD.
problem Few-shot learning struggles with high variance support sets.
method Combines ProtoNet with Local Fisher Discriminant Analysis.
result Superior classification accuracy on miniImageNet and tieredImageNet.
We study differential cohomology on categories of globally hyperbolic Lorentzian manifolds. The Lorentzian metric allows us to define a natural transformation whose kernel generalizes Maxwell's equations and fits into a restriction of the fundamental exact sequences of differential cohomology. We consider smooth Pontry…
Localized debiased machine learning simplifies estimating quantile treatment effects.
problem Estimating quantile treatment effects in causal inference with many covariates and flexible relationships.
method Localized debiased machine learning (LDML) avoids learning the full nuisance function by estimating only at a single initial guess.
result LDML enables practically-feasible and theoretically-grounded efficient estimation of quantile treatment effects.
It is well known that the curvature tensor of a pseudo-Riemannian manifold can be decomposed with respect to the pseudo-orthogonal group into the sum of the Weyl conformal curvature tensor, the traceless part of the Ricci tensor and of the scalar curvature. A similar decomposition with respect to the pseudo-unitary gro…