Unified view of generative models using GFlowNet framework.
problem Diverse deep generative models with varied training and inference methods.
method Integrates GFlowNet framework to unify training and inference.
result Unified training and inference algorithms for generative models.
Unified analysis of SGD variants for nonconvex federated optimization.
problem Performance of stochastic gradient methods in nonconvex optimization.
method Proposed a unified assumption for modeling stochastic gradient second moment, leading to a single convergence analysis for various methods.
result Unified convergence analysis for a wide range of SGD variants and distributed methods.
Unified approach unites GANs and diffusion models using particle methods.
problem Combining GANs and diffusion models for generative tasks.
method Proposes a unified framework where generator training is seen as a generalization of particle models.
result Demonstrates that GANs and diffusion models can be integrated within a unified framework.
Unified physics-informed learning method improves generalization performance.
problem Lack of theoretical analysis for hybrid settings with incomplete physical constraints.
method Unified residual form unifying collocation and variational methods, establishing generalization performance governed by affine variety dimension.
result Generalization performance is determined by affine variety dimension, not just the number of parameters.
Unified model explains AT's generative ability.
problem Understanding the generative ability of AT.
method Contrastive Energy-based Models (CEM).
result Improved sample quality in supervised and unsupervised learning.
Paper proposes a unified time series forecasting model with adaptive transfer.
problem General forecasting models for diverse time series data.
method Unified representations through Decomposed Frequency Learning and adaptive domain-specific features via Time Series Register.
result State-of-the-art forecasting performance on seven real-world benchmarks.
Unified Skew-Gaussian process framework for various regression and classification tasks.
problem Handling multiple types of regression and classification problems.
method Generalization of Skew-Gaussian processes to handle various types of data and likelihoods.
result Closed-form posterior distributions for multiple tasks.
Unified framework for N-tuples learning improves weakly supervised tasks.
problem Reducing annotation burden in supervised learning.
method Empirical risk minimization framework integrating pointwise unlabeled data.
result Framework improves generalization across various N-tuples learning tasks.
Unified detector calibration and simulation using MLE from generative models.
problem Combining detector calibration and simulation using traditional methods.
method Maximum likelihood estimation from conditional generative models.
result Prior-independent and non-Gaussian resolutions possible.
Unified theory explains how data augmentation improves deep learning models.
problem Understanding why data augmentation improves model generalization.
method Unified theoretical framework explaining two key effects: partial semantic feature removal and feature mixing.
result Data augmentation enhances generalization through partial semantic feature removal and feature mixing.
Unified diffusion framework enhances generative models flexibility.
problem Improving generative models' design freedom and efficiency.
method Unified framework incorporating choice of representation, prior distribution, and noise scheduling.
result Enhanced flexibility leading to more efficient training and data generation.
Unified study of harmonic maps between pseudo-Riemannian surfaces.
problem Classifying harmonic maps between pseudo-Riemannian surfaces.
method Unified formalism and Bäcklund transformation.
result Unified solutions to harmonic map equations and corresponding maps.
In 2006 Habiro initiated a construction of generating functions for Witten-Reshetikhin-Turaev (WRT) invariants known as unified WRT invariants. In a series of papers together with Irmgard Buehler and Christian Blanchet we extended his construction to a larger class of 3-manifolds. The unified invariants provide a stron…
Unified framework for non-compressed networks from compression bounds.
problem Generalization of large deep neural networks with huge model size.
method Unified framework converting compression based bounds to non-compressed networks.
result Unified data-dependent generalization error bound with tighter evaluation.
Unified framework for SDMs and GANs with improved sampling and quality.
problem Limitations of SDMs and GANs in achieving fast sampling and high sample quality.
method Introducing a novel SDE named DiffFlow to describe the learning dynamics of SDMs and GANs, and proving the asymptotic optimality and maximal likelihood training scheme.
result Unified framework allows smooth transition between SDMs and GANs with flexible trade-off between sample quality and speed.
Unified model learns from proteins and ligands for drug design.
problem Disjoint data sources and modeling assumptions limit joint use of structure- and ligand-based drug design.
method Contrastive Geometric Learning for Unified Computational Drug Design (ConGLUDe)
result Unified model achieves competitive zero-shot virtual screening performance and state-of-the-art ligand-conditioned pocket selection.
The lack of mathematical tractability of Deep Neural Networks (DNNs) has hindered progress towards having a unified convergence analysis of training algorithms, in the general setting. We propose a unified optimization framework for training different types of DNNs, and establish its convergence for arbitrary loss, act…
Timer-XL predicts multidimensional time series using a unified Transformer approach.
problem Unified time series forecasting across various tasks and contexts.
method Decoder-only Transformers with a universal TimeAttention mechanism and deft position embedding.
result State-of-the-art performance across multiple forecasting benchmarks.
Unified view of KL-divergence and IPMs via DRE, with new DRM metrics.
problem Unified understanding of KL-divergence and IPMs.
method Unified representation via maximum likelihood density-ratio estimation (DRE).
result Unified form of IPMs and novel DRM metrics.
Unified framework for DRO using OT with constraints.
problem Handling ambiguity in likelihood ratios and outcomes.
method Unified framework leveraging optimal transport with conditional moment constraints.
result Unified approach enables adversarial perturbation of likelihood ratios and outcomes.
Unified model integrates Bachelier and Black-Scholes-Merton for asset pricing.
problem Study of asset pricing in a natural world with negative prices or riskless rates.
method Unified framework combining Bachelier and Black-Scholes-Merton models.
result Unified model shows different option pricing depending on riskless instruments used.
Unified analysis improves SAM for non-convex optimization.
problem Improving generalization in machine learning models.
method Sharpness-aware minimization (SAM) and Unified SAM.
result Unified SAM provides convergence guarantees under relaxed assumptions.
Unified bounds for neural networks incorporating physical laws.
problem Limitations in existing generalization analyses for PINNs and VPINNs.
method Unified framework using Taylor expansion and Koopman-based analysis.
result High-rank networks can generalize well even with differential operators.
Unified study of nine multi-output conformal methods with generalized scores.
problem Challenges in extending conformal prediction to multi-output problems.
method Nine conformal methods with generalized multi-output conformity scores.
result Generalized scores ensure asymptotic conditional coverage and exact finite-sample marginal coverage.
Unified parametric assumption improves convergence guarantees for nonconvex optimization.
problem Weak convergence guarantees for nonconvex optimization.
method Introducing a novel unified parametric assumption.
result Unified convergence theorem for gradient-based methods.
Unified model for interactive estimation with improved learnability measure.
problem Improving learnability in interactive estimation models.
method Introducing a combinatorial measure (dissimilarity dimension) and a general algorithm with polynomial bounds.
result Unified model subsumes statistical-query learning and structured bandits.
Unified framework for continuous-state discrete flow matching models.
problem Discrete generative modeling with continuous probabilities.
method Introducing α-Flow, a family of CS-DFM models based on information geometry. result Optimal flow matching loss for α-flow minimizes generalized kinetic energy. In this paper, we present a unified analysis of matrix completion under general low-dimensional structural constraints induced by {\em any} norm regularization. We consider two estimators for the general problem of structured matrix completion, and provide unified upper bounds on the sample complexity and the estimatio…
Unified framework for high-dimensional bandit problems with low-dimensional structures.
problem Stochastic high-dimensional bandit problems with low-dimensional structures.
method Proposed a simple unified algorithm and a general analysis framework for the regret upper bound.
result Unified algorithm achieves comparable regret bounds in various high-dimensional bandit problems.
Unified algorithm tackles various RL goals like reward-free and preference-based learning.
problem Unified approach to multiple RL learning goals.
method Decision-Estimation Coefficient (DEC) framework.
result Unified algorithm handles various learning goals with a single framework.
Unified PAC-Bayesian framework for deep learning generalization.
problem Limitations of existing PAC-Bayesian norm-based bounds for deep neural networks.
method Unified framework using anisotropic Gaussian posteriors and sensitivity matrix.
result Comparable or tighter generalization bounds compared to state-of-the-art approaches.
Unified analysis of kernel-based methods under covariate shift.
problem Covariate shift in learning problems.
method Unified analysis of nonparametric methods in RKHS.
result Sharp convergence rates for general loss functions.
Unified theory of orbifolds and cohomology.
problem Formulating a general theory of orbifolds unifying differential and equivariant cohomology.
method Abstract axiomatization in higher topos theory and concrete models for various orbifolds.
result Fully faithful embedding of orbifolds into a cohesive infinity-topos with proper equivariant cohomology.
Unified analysis of conjugate gradients and accelerated methods using duality gap.
problem Minimizing convex quadratic functions efficiently.
method Approximate Duality Gap Technique to unify conjugate gradients and accelerated methods.
result Unified and self-contained proof of conjugate gradients without relying on Chebyshev polynomials.
Ricci flow deforms the Riemannian metric proportionally to the curvature, such that the curvature evolves according to a heat diffusion process and eventually becomes constant everywhere. Ricci flow has demonstrated its great potential by solving various problems in many fields, which can be hardly handled by alternati…
Distillation (Hinton et al., 2015) and privileged information (Vapnik & Izmailov, 2015) are two techniques that enable machines to learn from other machines. This paper unifies these two techniques into generalized distillation, a framework to learn from multiple machines and data representations. We provide theoretica…
Unified framework improves diffusion model rewards without full trajectories.
problem Limited theoretical understanding of guided diffusion samplers.
method Developed a unified algorithmic and theoretical framework for diffusion guidance and reward-guided diffusion.
result Framework shows CFG decreases expected reciprocal of classifier probability.
Unified framework for active learning problems using information theory.
problem Combining level set estimation and Bayesian optimization.
method Information-theoretic criterion and acquisition function.
result Unified framework achieves state-of-the-art performance.
We present a probabilistic viewpoint to multiple kernel learning unifying well-known regularised risk approaches and recent advances in approximate Bayesian inference relaxations. The framework proposes a general objective function suitable for regression, robust regression and classification that is lower bound of the…
Unified physics field theories through a general conservation law.
problem Unified physics field theories.
method Introduced general field as a formal sum of differential forms, defined conservation law using action principle.
result Physics field theories become instances of the general conservation law.
Unified framework for human motion generation on Riemannian manifolds.
problem Learning valid human motion in Euclidean spaces.
method Riemannian Motion Generation (RMG) on product manifolds, Riemannian flow matching.
result Achieves state-of-the-art FID (0.043) on HumanML3D and surpasses strong baselines on MotionMillion.
Unified framework for unsupervised concept extraction simplifies guarantees.
problem Establishing guarantees for unsupervised concept extraction.
method Unified theoretical framework, meta-theorem for identifiability.
result Simplifies the task of proving guarantees for concept extraction.
Unified algorithm for any p-norm experimental design problems.
problem Experimental design problems for various p-norm objectives. method Randomized local search approach for all p. result First approximation algorithm for general p-norm objective. Unified method to calculate Gromov norm for Kähler classes of bounded symmetric domains.
problem Calculating the Gromov norm of Kähler classes for all bounded symmetric domains.
method Combination of ideas from Domin-Toledo and Toledo, aided by the Polydisc Theorem.
result Unified and simplified calculation of Gromov norm for all bounded symmetric domains.
Unified approach to denoising Markov models for efficient sampling.
problem Designing efficient sampling algorithms for complex distributions.
method Mathematical foundation using measure transport and nonequilibrium statistical mechanics.
result Unified variational objective and backward generator construction.
Unified framework for T-duality in both trivial and non-trivial topologies.
problem Unified description of T-duality for metrics and B-fields in non-trivial topology.
method Developed a new unifying framework for T-duality.
result Unified description of T-duality for metrics and B-fields in non-trivial topology.
Unified framework for various learning problems via Multiple-Instance Learning.
problem Various learning problems including multi-class, complementarily labeled, multi-label, and multi-task learning.
method Reduction of various learning problems to Multiple-Instance Learning (MIL) with theoretical guarantees.
result Unified and simplified framework for designing and analyzing algorithms for various learning problems.
Unified learning bound for covariate and concept shifts.
problem Generalization under distribution shift in machine learning.
method Support-agnostic definitions of covariate and concept shifts using entropic optimal transport, leading to a unified error bound applicable to various loss functions and label spaces.
result Development of estimators for shifts with concentration guarantees and the DataShifts algorithm for quantifying and estimating the error bound.