New study on No-U-Turn Sampler for accelerated mixing in Hamiltonian Monte Carlo.
problem Achieving accelerated convergence in Hamiltonian Monte Carlo.
method Combining concentration of measure and coupling analysis for mixing.
result Rigorous mixing guarantees for the No-U-Turn Sampler in certain Gaussian distributions.
NUTS mixing time scales as d^(1/4) for Gaussian distributions.
problem Improving the efficiency of the No-U-Turn Sampler (NUTS) for Gaussian distributions.
method Coupling argument leveraging geometric structure of Gaussian concentration, uniformity analysis of NUTS transitions.
result The mixing time of NUTS scales as d^(1/4) for Gaussian distributions, up to logarithmic factors.
uHMC achieves fast mixing in high dimensions with gradient evaluations.
problem Quantifying mixing time of uHMC in high dimensions.
method Construction of successful couplings for uHMC.
result uHMC mixes in total variation with logarithmic dependence on dimension.
Nonparametric Bayesian approaches to clustering, information retrieval, language modeling and object recognition have recently shown great promise as a new paradigm for unsupervised data analysis. Most contributions have focused on the Dirichlet process mixture models or extensions thereof for which efficient Gibbs sam…
A new method generates mixed-type features in tabular data with improved realism and accuracy.
problem Generating mixed-type features combining discrete and continuous data is challenging.
method A cascaded approach: first generates low-resolution categorical and coarse numerical features, then uses these in a high-resolution flow matching model.
result The model significantly improves detection scores, generating more realistic samples and capturing distributional details.
New solutions found for elliptic systems with mixed couplings.
problem Existence of fully nontrivial solutions to elliptic systems with mixed couplings.
method Study of fully nontrivial solutions to the system with mixed couplings in a bounded or unbounded domain.
result New existence and multiplicity results of fully nontrivial solutions.
Developed MF-PINNs to solve coupled Stokes-Darcy equations more accurately.
problem Solving coupled Stokes-Darcy equations with varying physical constants.
method Combining VP and SV forms with adjusted weights in MF-PINNs.
result Improved accuracy of streamline and pressure fields in numerical experiments.
We introduce a novel kernel that models input-dependent couplings across multiple latent processes. The pairwise joint kernel measures covariance along inputs and across different latent signals in a mutually-dependent fashion. A latent correlation Gaussian process (LCGP) model combines these non-stationary latent comp…
New MCMC method tackles label-switching problem for clustering.
problem Label-switching problem impedes MCMC efficiency in discrete clustering.
method Formulated optimal transport couplings for partition space.
result Our method efficiently overcomes label-switching problem.
Study local topological constraints on Berry curvature in spin-orbit coupled Bose-Einstein condensates.
problem Understanding local topological obstructions to flattening Berry curvature in spin-orbit-coupled Bose-Einstein condensates.
method Adapting Pigazzini-Toda lower bound to Kaluza-Klein setting, analyzing harmonic part of torsion 3-form, and using exact pointwise curvature analysis.
result Obstruction kernel vanishes, preventing complete gauging-away of Berry phases even at zero net topological charge.
The study examines mixing times of data-augmentation Gibbs samplers for high-dimensional probit regression.
problem Investigating convergence properties of data-augmentation samplers for Bayesian probit regression.
method Using recent results on Gibbs samplers for log-concave targets, the study provides non-asymptotic bounds on mixing times.
result Explicit non-asymptotic bounds on mixing times depend on design matrix and prior precision, holding uniformly over responses.
Temporal Difference Learning analysis under non-i.i.d. data and nonlinear approximation.
problem Finite-sample behavior of TD(0) under non-i.i.d. data and nonlinear approximation.
method High-probability, finite-sample analysis of vanilla TD(0) on polynomially mixing Markov data, assuming Holder continuity and bounded generalized gradients.
result Bounds on the convergence rate of TD(0) with high probability, matching known i.i.d. rates and holding even with nonstationary initialization.
New method learns DAG structure in clustered data, accounting for local variations.
problem Learning DAG structure in clustered data with varying effects.
method Extends mixed models to structure learning, using a differentiable graph coupling mechanism.
result Asymptotically recovers true structure, detecting dependencies missed by other methods.
Analysis of reactive-diffusion simulations requires a large number of independent model runs. For each high-fidelity simulation, inputs are varied and the predicted mixing behavior is represented by changes in species concentration. It is then required to discern how the model inputs impact the mixing process. This tas…
This work analyzes machine learning for Lagrangian Relaxation in MILP.
problem Improving efficiency in solving large-scale MILP problems.
method Data-driven Algorithm Design approach to learn Lagrangian multipliers.
result Stochastic Gradient Ascent achieves the minimax optimal rate for learning multipliers.
New method recovers causal DAGs from general environments without strict assumptions.
problem Recovering causal DAGs from real-world data with varying distributions.
method Formalizes desiderata for causal representation learning in general environments, leveraging sufficient change conditions up to third-order derivatives.
result Fully recovers latent DAG and identifies latent variables up to minor indeterminacies under nonparametric mixing.
New method for Bayesian inference on large datasets.
problem Scalable sampling for Bayesian generalized linear mixed models on large datasets.
method Mirror Langevin dynamics with data subsampling, post-processing for variance estimation.
result Asymptotic, order-wise correct estimation of posterior variance.
CausalMix generates synthetic data with causal controls for mixed-type tables.
problem Synthetic data for causal inference with mixed-type and multimodal tabular data.
method CausalMix combines Gaussian latent priors with data-type-specific decoders for control over overlap, confounding, and treatment effect heterogeneity.
result CausalMix achieves state-of-the-art distributional metrics and stable causal control.
A fundamental result in differential privacy states that the privacy guarantees of a mechanism are preserved by any post-processing of its output. In this paper we investigate under what conditions stochastic post-processing can amplify the privacy of a mechanism. By interpreting post-processing as the application of a…
Unified framework for SGMoE resolves estimation and selection issues.
problem Non-identifiability, coupled differential relations, and tight coupling in softmax-Gated models.
method Unified statistical framework with Voronoi-type loss functions and dendrograms of mixing measures.
result Consistent selection of the number of experts without model sweeps, optimal parameter rates under overfitting.
A new algorithm for restless bandits handles long-range dependencies.
problem Generalization of linear bandits with time-dependent parameters.
method LinMix-UCB algorithm with Berbee's coupling lemma.
result Sub-linear regret of $\mathcal{O}\left(\sqrt{d n\mathrm{polylog}(n) }
ight)$.
Paper analyzes Hit-and-Run's convergence rates and applies similar methods to randomized Kaczmarz.
problem Quantifying advantages of Hit-and-Run's coordinate-free property.
method Sharp estimates via coupling methods and mixing time bounds.
result Ballistic and superdiffusive convergence rates in certain settings.
We present a new notion of probabilistic duality for random variables involving mixture distributions. Using this notion, we show how to implement a highly-parallelizable Gibbs sampler for weakly coupled discrete pairwise graphical models with strictly positive factors that requires almost no preprocessing and is easy …
This study compares direct and indirect methods for estimating own funds in life insurance, finding indirect methods more effective under realistic asset-liability coupling.
problem Computing own funds for life insurers using direct and indirect methods in a risk-neutral pricing framework.
method Introduced a novel family of mixed estimators including both direct and indirect methods, integrated into a control variate framework for variance reduction.
result The indirect method is more effective under realistic asset-liability coupling, but neither method is universally superior.
A method for collecting human supervision that combines rules and instance labels.
problem Lack of labeled data and inefficient human supervision.
method Rule-exemplar method with training algorithm for joint denoising and model training.
result Our algorithm is more accurate than existing methods and effectively denoises rules.
Paper achieves ε−2 sample complexity for actor-critic methods with minimal assumptions.
problem Achieving ε−2 sample complexity for actor-critic methods under minimal assumptions. method Single-loop, single-timescale implementation; coupled Lyapunov drift framework.
result First ildeO(ε−2) sample complexity guarantee for finding an ε-optimal policy. SNI framework for mixed-type data imputation interprets and explains missing values.
problem Missing data in mixed-type databases skew analysis results.
method SNI couples statistical priors with neural attention to impute and explain missing values.
result SNI provides interpretable feature dependency diagnostics and soft regularization of attention.
This paper introduces a robust mixing model to describe hyperspectral data resulting from the mixture of several pure spectral signatures. This new model not only generalizes the commonly used linear mixing model, but also allows for possible nonlinear effects to be easily handled, relying on mild assumptions regarding…
Novel approach constructs differential causal networks from EEG data.
problem Difficulty in modeling interactions of thousands of neurons in group comparisons.
method Hierarchical differential dynamic causal nets based on Chen-Fliess expansions.
result Evidence of network functional disruptions in epileptic brains.
Paper proposes a mean-field gradient descent for zero-sum games, proving convergence to Nash equilibrium.
problem Finding mixed Nash equilibria in zero-sum games with multiple players.
method Mean-field gradient descent dynamics with time-averaging, incorporating exponentially discounted gradients.
result Exponential convergence rate to mixed Nash equilibrium with respect to total variation metric.
DSPM models control noise volatility, improving financial data analysis.
problem Financial returns exhibit volatility clustering, challenging traditional models.
method DSPM uses a tempered-stable subordinator to control noise volatility, preserving kurtosis and autocorrelation.
result DSPM models accurately capture volatility clustering and noise mechanisms.
This work improves convergence guarantees for unadjusted HMC in KL and Rényi divergences.
problem Understanding convergence properties of unadjusted HMC in divergences like KL and Rényi.
method One-shot couplings to establish regularization and lift convergence bounds.
result Quantitative control of relative density mismatch and warm-start requirements.
Study introduces a probabilistic framework for air-sea fluxes using neural networks.
problem Accurately quantifying air-sea fluxes for understanding interactions and improving weather/climate models.
method Gaussian distributions conditioned on input variables, artificial neural networks, eddy-covariance data, minimizing negative log-likelihood loss.
result Trained neural networks provide alternative mean flux estimates and quantify uncertainty.
On any given compact (n+1)-manifold M with non-empty boundary, it is proved that the moduli space of Einstein metrics on M is a smooth, infinite dimensional Banach manifold under a mild condition on the fundamental group. Thus, the Einstein moduli space is unobstructed. The Dirichlet and Neumann boundary maps to data o…
Hamiltonian Monte Carlo (HMC) exploits Hamiltonian dynamics to construct efficient proposals for Markov chain Monte Carlo (MCMC). In this paper, we present a generalization of HMC which exploits \textit{non-canonical} Hamiltonian dynamics. We refer to this algorithm as magnetic HMC, since in 3 dimensions a subset of th…
Proposes M-CHMM for robust modeling of multivariate healthcare time series.
problem Challenges in analyzing multivariate healthcare time series data.
method Mixture of coupled hidden Markov models (M-CHMM) with two sampling algorithms.
result Improves data fit, handles missing and noisy measurements, and enhances prediction accuracy.
HiSS sampling overcomes local mode traps in rugged discrete spaces.
problem Sampling multimodal discrete distributions with gradient-based methods.
method Integrates Metropolis-within-Gibbs framework with logistic convolution.
result HiSS outperforms alternatives on various tasks, including Ising models and binary neural networks.
Study free energy in spherical spin glasses, proving universality dichotomy.
problem Analyzing free energy in spherical spin glass models with different tail exponents.
method Introduced a tail-adapted normalization and used universality dichotomy.
result Sharp universality dichotomy for free energy across different tail exponents.
Multitask Gaussian process regression reduces data generation costs for molecular property prediction.
problem Data bottleneck in training surrogate models for molecular properties.
method Multitask Gaussian process regression over heterogeneous data sources (CC and DFT).
result Predicts at CC-level accuracy with over an order of magnitude reduction in data generation cost.
The paper introduces a new method to improve model generalization by routing model copies through permutations.
problem Improving model generalization in machine learning.
method The method replicates a model \(M\) times and rewire the contexts in which local learning messages are computed using permutations.
result The method improves generalization by structured message sharing rather than coupling parameters.
Bayesian optimization speeds up bioprocess development across scales.
problem Costly and complex bioprocess development across scales and biocatalyst selection.
method Multi-fidelity batch Bayesian optimization framework integrating Gaussian Processes and mixed-variable optimization.
result Reduction in experimental costs and increased yield in bioprocess optimization.
Bias correction improves language model training performance.
problem Stochastic update bias in preconditioned optimizers.
method Cross-fitted preconditioning and variance-corrected inversion.
result Reduces held-out pretraining loss by 0.15 nats.
A new combinatorial approach groups regression coefficients for improved accuracy.
problem Grouping regression coefficients to reveal shared values within groups.
method Introduces L0-Fusion, a combinatorial grouping approach using mixed integer optimization. result L0-Fusion achieves grouping consistency under weak grouping sensitivity conditions. Unified framework for stability and generalization of Push-Sum in decentralized learning over directed graphs.
problem Understanding stability and generalization of Push-Sum in decentralized learning over directed networks.
method Developed a unified uniform-stability framework for SGP algorithm, incorporating imbalance-aware consistency bounds.
result Established finite-iteration stability and optimization guarantees for convex and non-convex objectives.
Study optimal transport for stationary processes, estimating joinings and costs.
problem Optimal transport for stationary stochastic processes.
method Introduced estimators for optimal joinings and costs, established consistency and error rates.
result Consistent estimators of optimal joinings and costs under mild and stronger mixing assumptions.
This paper considers the problem of networks reconstruction from heterogeneous data using a Gaussian Graphical Mixture Model (GGMM). It is well known that parameter estimation in this context is challenging due to large numbers of variables coupled with the degeneracy of the likelihood. We propose as a solution a penal…
Comment classification on cookery channels using BERT and traditional models.
problem Volume of multilingual comments, variable lengths, slang, symbols, and abbreviations make comment classification challenging.
method Evaluated traditional machine learning models (Naive Bayes, KNN, SVM, Random Forest, Decision Trees) and BERT-based models (BERT, DISTILBERT, XLM) for multilingual comment classification.
result XLM was the top-performing BERT model with an accuracy of 67.31, while Random Forest with Term Frequency Vectorizer was the best traditional model with 63.59 accuracy.
Motivated by the study of coupled Kähler-Einstein metrics by Hultgren and Witt Nyström and coupled Kähler-Ricci solitons by Hultgren, we study in this paper coupled Sasaki-Einstein metrics and coupled Sasaki-Ricci solitons. We first show an isomorphism between the Lie algebra of all transverse holomorphic vector fields…