Compositional diffusion models simulate coupled PDEs efficiently.
problem Efficiently simulating long-horizon coupled PDE systems.
method Diffusion models trained on decoupled data are composed at inference time.
result Compositional diffusion models recover coupled trajectories with low error.
U-Net trained to recover acoustic interference striations from distorted data.
problem Recovering acoustic interference striations from distorted signals.
method Training a U-Net using a random mode-coupling matrix model to generate training data.
result U-Net successfully recovers AISs under various conditions.
This paper shows how to approximate any log-concave distribution using well-conditioned affine coupling flows.
problem Understanding the representational power of affine coupling flows for log-concave distributions.
method Leveraging connections between affine coupling architectures, Langevin dynamics, and Hénon maps to prove log-concave approximation.
result Any log-concave distribution can be approximated using well-conditioned affine-coupling flows.
Sharp pseudospectral bounds prevent transient amplification in coupled gradient descent.
problem Transient amplification in coupled gradient descent systems.
method Developed a sharp pseudospectral theory for block-triangular Jacobians, proving Kreiss constant bounds and matching minimax lower bounds.
result Obtained a finite-horizon iteration-complexity bound of O(K(J)2log(1/δ)) for stochastic coupled descent. Large Sinkhorn couplings improve flow models in data generation tasks.
problem Training flow models with optimal transport couplings.
method Using large batches of source and target points, and applying entropic regularization with a low ε. result Flow models perform better with large Sinkhorn couplings and low regularization.
MUSIC learns coupled systems with sparse data and incomplete physics.
problem Learning coupled systems with incomplete physical constraints and missing data.
method Sparsity induced multitask neural network framework integrating partial physical constraints with data-driven learning.
result MUSIC accurately learns solutions to complex coupled systems under data-scarce and noisy conditions.
Incorporates matrix exponential into generative flows for improved performance.
problem Improving generative flow models for better density estimation.
method Integrates matrix exponential into generative flows, proposing new layers and modifying network architecture.
result The proposed model achieves great performance on density estimation.
PINNs struggle with increasingly complex ODEs, especially when parameters control their complexity.
problem Evaluating physics-informed neural networks on complex coupled ODEs.
method Tuned benchmarks of partial differential equations and harmonic oscillators; varying network architecture and training method.
result PINNs fail to solve complex ODEs, revealing issues like insufficient capacity, poor conditioning, and high local curvature.
New method uses coupled SDEs to edit images with high fidelity and consistency.
problem Challenges in editing image content with text-to-image models.
method Using coupled stochastic differential equations to guide generative model sampling.
result Achieves high prompt fidelity and near-pixel-level consistency.
DiffObs predicts global precipitation with realistic wave modes and low frequency variations.
problem Predicting global precipitation evolution using satellite observations.
method Autoregressive generative diffusion model trained on satellite data.
result Model generates realistic wave modes and low frequency variations, validating its potential for climate prediction.
New gradient estimators for discrete variables improve model training.
problem Training models with discrete latent variables is challenging due to high gradient variance.
method Introduced novel gradient estimators based on importance sampling and statistical couplings, extending to categorical variables.
result Proposed gradient estimators outperform previous methods in systematic experiments.
End-to-end training of DBMs with improved gradient estimation.
problem Biased gradient estimation in DBMs, especially with high-dimensional states.
method Unbiased contrastive divergence using MH coupling and local mode initialization.
result End-to-end training of DBMs without greedy pretraining, achieving FID score of 10.33 for MNIST.
Node2Grids uncouples GCN training for large graphs, saving memory and computation.
problem GCNs' coupled training framework limits flexibility and scalability for large-scale graphs.
method Node2Grids maps coupled graph data into independent grid-like data for efficient processing.
result Node2Grids achieves comparable results to GCNs while saving memory and computation.
REMAL: Residual Equilibrium Manifold Active Learning for Surrogate-Based Multidisciplinary Design Analysis
problem Multidisciplinary design analysis of coupled engineering systems requires solving equilibrium states where all disciplinary coupling variables are consistent.
method Residual manifold surrogate modeling framework for coupled systems.
result REMAL learns a surrogate model of the joint residual manifold via multitask Gaussian process models.
This study compares different types of normalizing flows for generating complex distributions.
problem Comparing different types of normalizing flows for generating complex distributions.
method Real-valued non-Volume preserving (RealNVP), masked autoregressive flow (MAF), coupling rational quadratic spline (C-RQS), and autoregressive rational quadratic spline (A-RQS) were compared using statistical tests.
result A-RQS algorithm outperforms others in terms of accuracy and training speed.
Study on feature learning dynamics in infinite-depth neural networks, focusing on ResNets.
problem Understanding how features evolve during training in deep neural networks, especially in the large-depth limit.
method Conditional Gaussian representations and SDE system with decoupled backward weights.
result Depth-induced suppression of forward-backward coupling in infinite-depth networks, leading to a decoupled forward-backward SDE system.
Graph-Coupled Oscillator Networks (GraphCON) tackles graph-based learning problems.
problem The oversmoothing problem in Graph Neural Networks (GNNs).
method GraphCON is a novel framework based on discretizations of ODEs modeling oscillators coupled via graph adjacency.
result GraphCON mitigates the oversmoothing problem and exploding/vanishing gradients issues.
Improved neural network training by coupled initialization reduces neuron count.
problem Training neural networks efficiently with fewer neurons.
method Coupled initialization of weights into pairs of identical Gaussian vectors.
result Significantly reduced number of neurons required for network convergence.
This paper shows how learning the phase-amplitude coupling improves bio-signal classification.
problem Discarding phase component in bio-signal feature extraction leads to poor generalization.
method Introducing a novel self-supervised learning task called Phase-Swap to detect phase-amplitude coupling.
result Neural networks trained on Phase-Swap task generalize better across subjects and recording sessions.
We investigate in this paper the architecture of deep convolutional networks. Building on existing state of the art models, we propose a reconfiguration of the model parameters into several parallel branches at the global network level, with each branch being a standalone CNN. We show that this arrangement is an effici…
NSBI approach detects Higgs trilinear coupling with high luminosity upgrade constraints.
problem Determining the Higgs trilinear self-coupling via off-shell Higgs production.
method Hybrid neural simulation-based inference (NSBI) incorporating SMEFT and quantum interference effects.
result NSBI achieves sensitivity close to theoretical optimum for Higgs trilinear self-coupling.
New algorithm solves minimax games with linear constraints.
problem Nonconvex minimax games with coupled linear constraints.
method Primal-dual alternating proximal gradient (PDAPG) algorithm.
result Achieves ε-stationary solution within O(ε^(-2)) iterations for strongly concave settings.
Multi-simulator training has contributed to the recent success of Deep Reinforcement Learning by stabilizing learning and allowing for higher training throughputs. We propose Gossip-based Actor-Learner Architectures (GALA) where several actor-learners (such as A2C agents) are organized in a peer-to-peer communication t…
This paper introduces a novel recurrent model for music composition that is tailored to the structure of polyphonic music. We propose an efficient new conditional probabilistic factorization of musical scores, viewing a score as a collection of concurrent, coupled sequences: i.e. voices. To model the conditional distri…
A method for collecting human supervision that combines rules and instance labels.
problem Lack of labeled data and inefficient human supervision.
method Rule-exemplar method with training algorithm for joint denoising and model training.
result Our algorithm is more accurate than existing methods and effectively denoises rules.
Hierarchical pretraining with slow-fast ODEs
problem Causal self-attention vs. slow-fast ODEs
method Instantiating fast-slow ODE formalism as a concrete neural network
result Equilibrium manifold x=φ(y) is exactly the master-equation (ME) stationary distribution Reasoning models generate differently based on problem difficulty, not just length.
problem Understanding how reasoning models handle different problem difficulties.
method Examined hidden-state trajectories across competitive programming, mathematics, and Boolean satisfiability.
result Corrected trajectory geometry shows difficulty-dependent differences in reasoning models, with stronger effects in the code domain.
Developed MF-PINNs to solve coupled Stokes-Darcy equations more accurately.
problem Solving coupled Stokes-Darcy equations with varying physical constants.
method Combining VP and SV forms with adjusted weights in MF-PINNs.
result Improved accuracy of streamline and pressure fields in numerical experiments.
New asymmetric kernel methods improve feature learning.
problem Improving feature learning with asymmetric kernels.
method Coupled covariance eigenproblem and Nyström method.
result Empirical evaluations show benefits of KSVD.
Motivated by the study of coupled Kähler-Einstein metrics by Hultgren and Witt Nyström and coupled Kähler-Ricci solitons by Hultgren, we study in this paper coupled Sasaki-Einstein metrics and coupled Sasaki-Ricci solitons. We first show an isomorphism between the Lie algebra of all transverse holomorphic vector fields…
Defines coupled embeddability for maps on products of spaces, generating examples and nonexamples.
problem Understanding when maps on products of spaces can be embedded.
method Uses known results for nonsingular biskew and bilinear maps, studies genericity properties, extends Whitney embedding theorems, and relates to Z/2-coindex of embedding spaces. result Generates strong obstructions to coupled embeddability in terms of combinatorics of triangulations.
Many real-world data sets, especially in biology, are produced by complex nonlinear dynamical systems. In this paper, we focus on brain calcium imaging (CaI) of different organisms (zebrafish and rat), aiming to build a model of joint activation dynamics in large neuronal populations, including the whole brain of zebra…
Multitask Gaussian process regression reduces data generation costs for molecular property prediction.
problem Data bottleneck in training surrogate models for molecular properties.
method Multitask Gaussian process regression over heterogeneous data sources (CC and DFT).
result Predicts at CC-level accuracy with over an order of magnitude reduction in data generation cost.
I propose a variational approach to maximum pseudolikelihood inference of the Ising model. The variational algorithm is more computationally efficient, and does a better job predicting out-of-sample correlations than L2 regularized maximum pseudolikelihood inference as well as mean field and isolated spin pair appro…
Solves modified conjecture for Fano manifolds using Ding stability.
problem Finding Kähler-Einstein metrics on Fano manifolds.
method Interprets Ding semistability and solves modified conjecture.
result Solves modified conjecture for coupled Kähler-Einstein metrics on Fano manifolds.
UNTIE learns representations of coupled categorical data.
problem Challenges in learning from unlabeled categorical data with complex couplings.
method UNTIE approach for unsupervised representation learning of heterogeneous couplings.
result UNTIE significantly improves categorical data representations on 25 diverse datasets.
Paper discusses conditions for deforming coupled Kähler-Einstein metrics.
problem Conditions for deforming coupled Kähler-Einstein metrics.
method Analyzes deformation of coupled Kähler-Einstein metrics on Fano manifolds.
result Necessary and sufficient condition for deformation of coupled Kähler-Einstein metrics.
We examine several aspects of explicability of a classification system built from neural networks. The first aspect is the pairwise explicability, which is the ability to provide the most accurate prediction when the range of possibilities is narrowed to just two. Next we consider explicability in development, which me…
ReDi improves few-step generation for discrete data models.
problem Slow sampling speeds in discrete flow-based models.
method Rectified Discrete Flow (ReDi) reduces factorization error by rectifying coupling.
result Empirically, ReDi reduces Conditional Total Correlation and enables few-step generation.
Develops non-Markovian couplings for sub-Riemannian Brownian motions.
problem Constructing couplings for sub-Riemannian Brownian motions starting from points on the same vertical fiber.
method Uses global isometries to construct maximal couplings, satisfying a reflection principle.
result Estimates coupling time and applies to inequalities for the heat semigroup.
We address representational challenges in normalizing flows, particularly depth and conditioning issues.
problem Challenges in training normalizing flows, including vanishing/exploding gradients and poor conditioning.
method Analyzes representational aspects of depth and conditioning in normalizing flows, proving theoretical bounds and investigating phenomena.
result Proves that shallow affine coupling networks are universal approximators in Wasserstein distance if ill-conditioning is allowed.
Support vector regression (SVR) is one of the most popular machine learning algorithms aiming to generate the optimal regression curve through maximizing the minimal margin of selected training samples, i.e., support vectors. Recent researchers reveal that maximizing the margin distribution of whole training dataset ra…
Enhances deep networks robustness with data mollification and label smoothing.
problem Improving deep neural networks' robustness against corruptions.
method Coupling data mollification (image noising and blurring) with label smoothing.
result Improved robustness and uncertainty quantification on corrupted image benchmarks.
QDSB accelerates Schrödinger bridge learning with quantized approximations.
problem Learning generative models from unpaired samples.
method Quantized diffusion Schrödinger bridges (QDSB) using anchor-quantized distributions and cell-wise sampling.
result QDSB achieves sample quality similar to existing methods but with significantly less computational time.
Greedy training of recursive partitioning estimators faces a computational barrier when the true function doesn't satisfy a specific property.
problem Computational inefficiency of greedy training for recursive partitioning estimators.
method Analysis of greedy training for sparse regression functions over binary features.
result Greedy training requires exponential samples when the true function doesn't satisfy a specific property (MSP), but only logarithmic samples when it does.
Numerical observations on martingale couplings are confirmed under certain conditions.
problem Understanding the validity of numerical observations on maximizers and minimizers of martingale couplings.
method Investigation of sufficient conditions and counterexamples for the property to hold.
result The non-decreasing property of martingale couplings is preserved for maximizers under specific conditions.
Deep-learning method solves BSVIEs and coupled systems.
problem High-dimensional, time-inconsistent stochastic control problems.
method Trains a neural network to approximate solution fields directly.
result Non-asymptotic error bound and scalable performance.
The paper studies the question of whether the classical mirror and synchronous couplings of two Brownian motions minimise and maximise, respectively, the coupling time of the corresponding geometric Brownian motions. We establish a characterisation of the optimality of the two couplings over any finite time horizon and…