Bayes-consistent disagreement discrepancy loss improves model robustness.
problem Distribution shift in real-world neural network deployment.
method Introducing a novel disagreement loss that is Bayes consistent.
result Proves existing surrogates for disagreement discrepancy are not Bayes consistent.
New method estimates model discrepancy without sampling for unnormalized models.
problem Evaluating and training unnormalized density models efficiently.
method Estimate Stein discrepancy using neural network parameterized vector function.
result Method outperforms existing goodness-of-fit tests and training methods.
The paper explores multidimensional critic output in GANs, improving convergence and diversity.
problem Underexplored in GANs literature, multidimensional critic output.
method Generalized Wasserstein GAN framework, SRVT block, maximal p-centrality discrepancy.
result High-dimensional critic output improves GAN performance in convergence and diversity.
LNGCA extends ICA to non-Gaussian signals and noise, improving estimation and testing.
problem Modeling multivariate data with non-Gaussian components and Gaussian noise.
method Linear latent factor model, simultaneous estimation of non-Gaussian and Gaussian components, discrepancy maximization, resampling-based test.
result Improved estimation and testing of non-Gaussian components over competing methods.
Expands Bayesian experiment design framework to account for model discrepancies.
problem Model misspecification in Bayesian optimal experiment design.
method Introduces Expected General Information Gain and Expected Discriminatory Information criteria.
result Demonstrates improved robustness and detection capabilities in experiment design.
MMD test detects adversarial attacks by addressing kernel limitations and non-independence issues.
problem MMD test's failure to detect adversarial attacks.
method Replaced Gaussian kernel with deep kernel, maximized test power, and used wild bootstrap for non-independence.
result MMD test is aware of adversarial attacks.
New method detects changes online with bounds on delay.
problem Detecting changes in data streams efficiently.
method Maximizes discrepancy between pre-change and post-change distributions.
result Non-asymptotic bounds on average running length and detection delay.
PolyGraph Discrepancy improves graph generative model evaluation.
problem Inability of existing metrics to provide an absolute performance measure and comparability across different graph descriptors.
method Approximates Jensen-Shannon distance using binary classifiers trained to distinguish between real and generated graphs.
result PGD provides a more robust and insightful evaluation compared to MMD metrics.
We give some non-existence results for Kähler-Einstein metrics with conical singularities along a divisor on Fano manifolds. In particular we show that the maximal possible cone angle is in general smaller than the invariant R(M). We study this discrepancy from the point of view of log K-stability.
New method detects changes by maximizing cross-entropy, outperforming existing techniques.
problem Detecting abrupt changes in data streams without labeled examples.
method Maximizes cross-entropy between segments to find change points, using dynamic programming.
result Outperforms three state-of-the-art approaches on challenging datasets.
A new test detects differences between two distributions without flow.
problem Detecting differences between two distributions without flow.
method Zero-flow discrepancy (ZFD) and zero-flow two-sample test (ZF2ST).
result ZF2ST can detect strong differences in structured distributions.
Paper develops metrics for random dynamical systems using vector-valued RKHSs.
problem Creating metrics for random nonlinear dynamical systems.
method Develops metrics on random dynamical systems using Perron-Frobenius operators in vector-valued reproducing kernel Hilbert spaces (vvRKHSs). Uses operator-valued kernels and time-wise independence criteria.
result Extends existing metrics for deterministic systems and introduces kernel maximal mean discrepancy for random processes.
We analyze the mapping class group of extendible automorphisms of the exterior boundary W of a compression body of dimension 3 or 4, which extend over the compression body (Q,V), where V is the interior boundary. Those that extend as automorphisms of (Q,V) rel V are called discrepant automorphisms, forming the mapping …
This paper refines MMD for domain adaptation by balancing intra-class and inter-class distances.
problem Balancing intra-class and inter-class distances for better feature discriminability in domain adaptation.
method The paper theoretically proves two facts about MMD and proposes a novel discriminative MMD method to balance intra-class and inter-class distances.
result The proposed method improves feature discriminability and outperforms state-of-the-art methods.
Optimizes kernel discrepancies by selecting subsets efficiently.
problem Improving kernel discrepancies for QMC methods.
method Introduces a novel subset selection algorithm for kernel discrepancies.
result Efficiently generates low-discrepancy samples from various distributions.
MMD-B-Fair learns fair representations by minimizing MMD test power.
problem Learning fair representations of data while preserving target attributes.
method Kernel two-sample testing and block testing schemes.
result Minimizing MMD test power allows hiding sensitive attribute information.
This paper introduces localized discrepancy theories for unsupervised domain adaptation.
problem Improving generalization bounds for unsupervised domain adaptation.
method Localized discrepancies defined on the hypothesis space after localization, leading to smaller and asymmetric values.
result Improved generalization bounds and sample complexity reduction.
New discrepancy function compares discrete probability measures considering space geometry.
problem Comparing discrete probability measures in a geometrically meaningful way.
method Proposes the Fourier Discrepancy Function, proving convexity, differentiability, and providing gradient formula.
result Proves the Fourier Discrepancy is convex, twice differentiable, and provides an explicit gradient formula.
We propose a method to optimize the representation and distinguishability of samples from two probability distributions, by maximizing the estimated power of a statistical test based on the maximum mean discrepancy (MMD). This optimized MMD is applied to the setting of unsupervised learning by generative adversarial ne…
The investigations of financial markets from a complex network perspective have unveiled many phenomenological properties, in which the majority of these studies map the financial markets into one complex network. In this work, we investigate 30 world stock market indices through their visibility graphs by adopting the…
A new method for unsupervised domain adaptation using Gaussian processes.
problem Reducing target domain error by aligning input and output distributions.
method Max-margin Gaussian process approach to achieve hypothesis consistency.
result Our method effectively minimizes maximum discrepancy and maximizes margins.
A new method uses GAN principles to balance treatment groups in causal inference.
problem Biased observational data in treatment outcomes estimation.
method Bi-level optimization with a discriminator and a weights generator.
result The method effectively estimates causal effects with theoretical bounds on estimation error.
The article introduces practical estimators for kernel discrepancies.
problem Estimating kernel discrepancies accurately and efficiently.
method Presented various estimators for MMD, HSIC, and KSD, including V-statistics, U-statistics, and incomplete U-statistics. Stressed the importance of kernel bandwidth and introduced adaptive estimators.
result Adaptive estimators combining multiple estimators with various kernels address the problem of kernel selection.
Ad-SVGD optimizes kernel parameters for SVGD, improving inference performance.
problem Efficiently approximating posterior distributions in Bayesian inference.
method Adaptive kernel selection for SVGD dynamics.
result Ad-SVGD outperforms standard heuristics in various tasks.
We consider Bayesian optimization of an expensive-to-evaluate black-box objective function, where we also have access to cheaper approximations of the objective. In general, such approximations arise in applications such as reinforcement learning, engineering, and the natural sciences, and are subject to an inherent, u…
Proposes PHD to measure domain discrepancy for complex models.
problem Insufficient domain discrepancy measures for complex models.
method Introduces PHD, a novel discrepancy measure for complex models.
result PHD is computationally efficient and applicable to multi-class classification.
Paper defines class discrepancy for machine learning problems and provides coresets.
problem Addressing discrepancies in machine learning models.
method Defines class discrepancy, provides techniques for bounding discrepancy, and develops coresets and streaming sketches.
result Establishes coresets of size O(sqrt{d}/epsilon) for various machine learning problems.
New method improves neural spike train models by minimizing divergence directly, leading to better performance.
problem Poor performance and divergence issues in spike train models using maximum likelihood estimation.
method Directly minimize maximum mean discrepancy using spike train kernels and stochastic optimization.
result The proposed method generates well-behaved models with better control over feature trade-offs.
Feature noise causes loss discrepancies across groups even with equal data.
problem Loss discrepancies observed in learning procedures across different groups.
method Characterized the effect of feature noise on loss discrepancy in linear regression.
result Feature noise leads to loss discrepancy even when groups have equal data.
New KCC-SDs improve distribution comparison in high dimensions.
problem Challenges in high-dimensional Stein discrepancies.
method Kernelized complete conditional Stein discrepancies (KCC-SDs).
result KCC-SDs outperform baselines in distinguishing distributions.
MPMC generates low-discrepancy points using graph neural networks.
problem Generating efficient low-discrepancy point sets.
method Leveraging Graph Neural Networks to model geometric properties.
result Achieves state-of-the-art performance in generating low-discrepancy points.
Sliced kernelized Stein discrepancy improves goodness-of-fit tests and model learning in high dimensions.
problem The curse-of-dimensionality in kernelized Stein discrepancy (KSD).
method Sliced Stein discrepancy and its scalable variants using optimal one-dimensional projections.
result Significantly outperforms KSD and baselines in goodness-of-fit tests and improves model learning.
Study shows the corrected Akaike criterion is inadmissible for estimating Kullback-Leibler discrepancy.
problem Inadmissibility of the corrected Akaike information criterion for estimating Kullback-Leibler discrepancy.
method Loss estimation framework to demonstrate inadmissibility and provide improved estimators.
result Improved estimators of Kullback-Leibler discrepancy are provided and perform well in reduced-rank situations.
Framework synthesizes geological images minimizing patch distribution discrepancy.
problem Synthesizing realistic geological images from a single exemplar.
method Uses kernel discrepancies and generative neural networks for efficient synthesis.
result Synthesized images match visual patterns and spatial statistics of the exemplar.
Study discrete analog of zeta-determinant maximization on triangulated surfaces.
problem Maximizing zeta-determinant for discrete Laplacian on triangulated surfaces.
method Analogous to Osgood, Phillips, and Sarnak's theorem, study stationary points of determinants for discrete cotan-Laplacian.
result Discrete metrics of constant discrete Gaussian curvature are stationary points of the determinant, suggesting minima.
A new method compares image classifiers using adaptive sampling of natural images.
problem Evaluation of image classifiers on small, fixed test sets may not generalize to real-world images.
method Adaptive sampling from a large corpus of unlabeled images to maximize classifier discrepancies measured by WordNet hierarchy.
result Human labeling of model-dependent image sets reveals relative classifier performance.
Semi-parametric framework for nonlinear system identification
problem Nonlinear system identification
method Orthogonal Gaussian process regression
result Interpretable models from incomplete physics
A new discrepancy method improves efficiency and accuracy in unsupervised domain adaptation.
problem Measuring the difference between source and target domains without labeled target data.
method Source-guided discrepancy (S-disc) that uses source domain labels for efficient computation and tighter generalization bounds.
result S-disc provides a tighter generalization error bound than existing discrepancies.
TMDA aligns subdomain data distribution discrepancies across domains using manifold representations.
problem Transfer learning challenges due to domain divergence.
method TMDA uses low-dimensional manifolds to represent subdomains and aligns local data distribution discrepancies across domains using M3D.
result TMDA is a promising method for various transfer learning tasks.
New partition designs reduce star discrepancy in high-dimensional sampling.
problem Improving the expected star discrepancy in high-dimensional sampling.
method Developed non-equal volume partitions to achieve lower expected star discrepancy.
result Explicit upper bounds for expected star discrepancy under non-equal volume partitions.
We introduce Network Maximal Correlation (NMC) as a multivariate measure of nonlinear association among random variables. NMC is defined via an optimization that infers transformations of variables by maximizing aggregate inner products between transformed variables. For finite discrete and jointly Gaussian random vari…
New framework improves experimental design using integral probability metrics.
problem Challenges in Bayesian Optimal Experimental Design (BOED) with KL divergence.
method Integrates integral probability metrics (IPMs) for stability and flexibility.
result IPM-based designs yield more robust and accurate credible sets.
This work proves the optimal estimation rates for popular kernel discrepancies.
problem Estimating the disagreement of distributions using kernel discrepancies.
method Proving minimax lower bounds for MMD, HSIC, and KSD.
result The minimax lower bound for estimation of MMD, HSIC, and KSD is \( n^{-1/2} \) on general topological spaces.
Proposes a method to select variables for kernel two-sample tests.
problem Determining whether two samples have the same distribution using informative variables.
method A framework based on kernel maximum mean discrepancy (MMD) for selecting a subset of variables.
result The sample size requirements for the three kernels depend on the number of selected variables, not the data dimension.
The paper explores conditions for interval exchange transformations to yield low-discrepancy sequences.
problem Conditions for interval exchange transformations to produce low-discrepancy sequences.
method Analyzes interval exchange transformations and applies ergodic theory.
result Constructs infinitely many interval exchange transformations with low-discrepancy orbits for n≥4. The paper highlights the importance of model discrepancy in cardiac simulations.
problem Uncertainty in model structure and equations affects predictions.
method The authors use Gaussian processes and autoregressive-moving-average models to account for model discrepancy.
result Different methods to account for model discrepancy have advantages and shortcomings.
A new metric DJP-MMD improves domain adaptation by balancing transferability and discriminability.
problem Improving domain adaptation performance by balancing transferability and discriminability.
method Discriminative Joint Probability Maximum Mean Discrepancy (DJP-MMD) replaces the traditional joint MMD.
result DJP-MMD outperforms traditional MMDs in image classification tasks.
A new method for density estimation using mixture discrepancy and moments.
problem Generalizing histogram statistics to higher dimensions.
method Density estimation via mixture discrepancy and moments (DSP-mix and MSP).
result DSP-mix and MSP are computationally tractable and maintain accuracy with increased speed.