Framework improves gradient estimation for faster training convergence.
problem Efficiently estimating noisy gradients in stochastic optimization.
method Dynamic adaptive importance sampling combining multiple distributions.
result Adaptively weighted multiple importance sampling yields superior gradient estimates.
MT-SGD samples from multiple target distributions using gradient descent.
problem Sampling from multiple unnormalized target distributions.
method Proposes MT-SGD, a flow of intermediate distributions to sample from multiple target distributions.
result Asymptotic analysis shows MT-SGD reduces to multiple-gradient descent for multi-objective optimization.
We study diffeologies on locally convex spaces and their application to smooth multiplication of distributions.
problem Constructing smooth multiplication of distributions on locally convex spaces.
method Using diffeological colimits and wavefront-set criterion.
result Proving smooth multiplication of microlocally multipliable distributions.
A new method uses RF's out-of-bag errors for multiple imputation.
problem Missing data in biomedical studies and lack of prediction uncertainty.
method Constructs conditional distributions from the empirical distribution of out-of-bag prediction errors.
result Valid multiple imputation results achieved without parametric assumptions.
The clustering algorithms that view each object data as a single sample drawn from a certain distribution, Gaussian distribution, for example, has been a hot topic for decades. Many clustering algorithms: such as k-means and spectral clustering are proposed based on the single sample assumption. However, in real life, …
Study on diffeologies on locally convex spaces and smooth multiplication of distributions.
problem Geometric characterization and smoothness of distribution multiplication.
method Investigation of canonical and c∞-diffeologies on locally convex spaces, proving geometric characterizations, and comparing diffeologies. result Established a framework for nonlinear distribution theory beyond manifolds, realizing microlocally multipliable distributions as a diffeological colimit.
A new method for aligning multiple distributions efficiently.
problem Aligning multiple distributions in a shared latent space.
method Iterative alignment of variational approximations of distribution divergences using invertible alignment maps.
result Our method achieves competitive distribution alignment at low computational cost.
Paper proposes a new method to aggregate multiple sources with different label distributions.
problem Aggregating from multiple target-shifted sources with different label distributions.
method Unified framework to select relevant sources for domain adaptation with limited label, unsupervised, and label partial unsupervised scenarios.
result Empirical results significantly outperform baselines.
Develops a framework to quantify uncertainties in multiple ML models.
problem Uncertainty in ML model predictions and model inputs.
method Develops a theoretical framework to decouple and transform uncertainties.
result Generates joint distribution of ML predictions considering uncertainties.
Log-Normal Multiplicative Dynamics improves low-precision training of neural networks.
problem Training large neural networks with low precision is unstable.
method Derive a Bayesian learning rule with log-normal posterior distributions and multiplicative updates.
result LMD achieves stable and accurate training for Vision Transformer and GPT-2.
Improves NF for complex data distributions with multiple modes.
problem Difficulty in handling data distributions with multiple isolated modes.
method Proposes a new framework using variational latent representation to improve NF.
result Significantly more powerful for generating data distributions with multiple modes.
We propose a GAN design which models multiple distributions effectively and discovers their commonalities and particularities. Each data distribution is modeled with a mixture of K generator distributions. As the generators are partially shared between the modeling of different true data distributions, shared ones ca…
Proposes a framework for OOD detection combining multiple statistics.
problem Detecting out-of-distribution (OOD) samples reliably during inference.
method Multiple hypothesis testing with conformal p-values.
result Uniformly outperforms threshold-based tests across different datasets and neural networks.
JAMPI improves matrix multiplication in Spark, boosting performance by up to 24%.
problem Efficiently performing matrix multiplication in Spark.
method Combining asynchronous network IO, auto-vectorization, and barrier execution mode.
result Up to 24% performance increase in distributed matrix multiplication.
MWGraD solves multi-objective distributional optimization using particle-based gradient descent.
problem Simultaneously minimize multiple objective functionals over probability distributions.
method Iterative particle-based algorithm MWGraD, estimating and aggregating Wasserstein gradients.
result Demonstrates effectiveness on synthetic and real-world datasets.
Method constructs uniformly valid prediction sets across multiple distributions.
problem Uniformly valid prediction sets across multiple distributions.
method Max-p aggregation scheme and optimization programs.
result Optimal and efficient prediction sets for multiple distributions.
Unified framework for estimating density ratios across multiple distributions.
problem Binary density ratio estimation for multiple distributions.
method Unified framework based on Bregman divergence minimization.
result Generalization of binary DRE methods to multiple distributions.
Proposes using Wasserstein barycenters for robust optimization with multiple data sources.
problem Distributionally robust optimization with multiple heterogeneous data sources.
method Construct nominal distribution through Wasserstein barycenter of multiple data samples, reformulates as a finite convex program.
result Proposed scheme outperforms other estimators in sparse inverse covariance matrix estimation.
Extends Gaussian Process regression for handling multiple prior distributions.
problem Handling multiple prior distributions in Bayesian Machine Learning models.
method Mixtures of Gaussian Processes with analytical and Sparse Variational approaches.
result Effective in accounting for prior misspecification in functional regression problems.
The paper proves integral formulas for manifolds with multiple orthogonal distributions.
problem Understanding geometric properties of manifolds with multiple orthogonal distributions.
method Develops integral formulas for Riemannian manifolds with k>2 orthogonal complementary distributions. result Generalizes known formulas for k=2 and applies to manifold splitting and immersions. In this paper, we pay our attention to geometric parameters and their applications in economics and finance. We discuss the multiplicative models in which a geometric mean and a geometric standard deviation are more natural than arithmetic ones. We give two examples from Warsaw Stock Exchange in 1995--2009 and from a b…
Matrix multiplication is a fundamental building block for large scale computations arising in various applications, including machine learning. There has been significant recent interest in using coding to speed up distributed matrix multiplication, that are robust to stragglers (i.e., machines that may perform slower …
Exact results on power-law distributions in systems with resets.
problem Understanding power-law distributions in systems with resets.
method Exact mathematical analysis of multiplicative processes with resets.
result Power-law distributions are built up over time and their moments behave quantitatively determined by parameters.
This paper presents a novel theoretical study of the general problem of multiple source adaptation using the notion of Renyi divergence. Our results build on our previous work [12], but significantly broaden the scope of that work in several directions. We extend previous multiple source loss guarantees based on distri…
Paper settles sample complexity for learning from multiple distributions.
problem Learning from multiple data distributions with a hypothesis class of bounded VC dimension.
method Introduced an algorithm with sample complexity of O((d+k)ε^-2)·(k/ε)^o(1).
result Algorithm matches lower bound up to sub-polynomial factor.
Multiplicative noise models are often used instead of additive noise models in cases in which the noise variance depends on the state. Furthermore, when Poisson distributions with relatively small counts are approximated with normal distributions, multiplicative noise approximations are straightforward to implement. Th…
A dynamical model of capital exchange is introduced in which a specified amount of capital is exchanged between two individuals when they meet. The resulting time dependent wealth distributions are determined for a variety of exchange rules. For ``greedy'' exchange, an interaction between a rich and a poor individual r…
New sampling-based approach for filtering problems using multiplicative Gaussian functions.
problem Approximate inference in filtering problems.
method Approximates distribution with a weighted sum of continuous functions using sampling for multiplications.
result Preliminary experiments show potential of the new method compared to particle filters.
Method improves model performance on segments with local distribution shifts.
problem Improving model generalization across multiple data segments with local distribution differences.
method Two-stage multiply robust estimation method for tabular data analysis.
result Significantly improves prediction accuracy and robustness on regression and classification tasks.
Study reduces NAS search cost by generating multiple complex architectures in one shot.
problem Finding multiple neural architectures with varying complexities efficiently.
method Uses importance sampling to generate and update multiple distributions of architectures.
result Reduces search cost by finding multiple architectures with different complexities in a single search.
We show that the moments of the distribution of historic stock returns are in excellent agreement with the Heston model and not with the multiplicative model, which predicts power-law tails of volatility and stock returns. We also show that the mean realized variance of returns is a linear function of the number of day…
New bounds on learning from multiple distributions for VC classes.
problem Understanding the sample complexity of learning from multiple data distributions.
method Analyzing the gap between known upper and lower bounds for PAC-learnable classes.
result Recent progress on sample complexity for VC dimension d classes on k distributions.
Method learns conditional distributions using neural entropic optimal transport.
problem Challenges in learning multiple conditional distributions.
method Neural entropic optimal transport method with two networks and regularization.
result Effective learning of conditional distributions with limited samples.
The paper identifies generators of linear SDEs with noise types.
problem Identifying the generator of linear SDEs from their solution distribution.
method Deriving sufficient and necessary conditions for additive noise, and sufficient conditions for multiplicative noise.
result Generic conditions for identifying the generator of linear SDEs with both types of noise.
GANF uses normalizing flows to detect anomalies in multiple time series.
problem Detecting anomalies in multiple time series with interdependencies.
method Bayesian network integration with normalizing flows for unsupervised anomaly detection.
result GANF effectively detects anomalies and identifies distribution drift in time series data.
A new generative adversarial network is developed for joint distribution matching. Distinct from most existing approaches, that only learn conditional distributions, the proposed model aims to learn a joint distribution of multiple random variables (domains). This is achieved by learning to sample from conditional dist…
Given samples from a distribution, how many new elements should we expect to find if we continue sampling this distribution? This is an important and actively studied problem, with many applications ranging from unseen species estimation to genomics. We generalize this extrapolation and related unseen estimation proble…
To construct flexible nonlinear predictive distributions, the paper introduces a family of softplus function based regression models that convolve, stack, or combine both operations by convolving countably infinite stacked gamma distributions, whose scales depend on the covariates. Generalizing logistic regression that…
Method estimates multiple related Gaussian distributions using Laplacian regularization.
problem Jointly estimate multiple related zero-mean Gaussian distributions.
method Laplacian regularized stratified model fitting with hyper-parameters to encourage covariance closeness.
result The method performs well, especially in low data regimes, as demonstrated in finance, radar, and weather.
Unified framework for simulation-based inference learns a single model for multiple tasks.
problem Simulation-based inference for multiple tasks with limited model retraining.
method Unified flow-matching generative model with query-aware masking distribution.
result Competitive performance on various inference tasks and real-world problems.
In distributed learning, the goal is to perform a learning task over data distributed across multiple nodes with minimal (expensive) communication. Prior work (Daume III et al., 2012) proposes a general model that bounds the communication required for learning classifiers while allowing for $\eps$ training error on lin…
The paper introduces a method for forecasting corporate sales growth using multiple reference variables.
problem Forecasting corporate sales growth with multiple reference variables.
method Reference class selection using rank-based algorithms and principal components analysis for data dimension reduction.
result Dimension reduced variables with past sales growth rates and operating margins perform well in forecasting.
This paper tackles causal representation learning from multiple distributions without hard interventions.
problem Recovering latent causal variables and their relations from multiple distributions.
method Develops general solutions for causal representation learning without hard interventions, under sparsity constraints and suitable change conditions.
result Recovering the moralized graph of the underlying directed acyclic graph and latent variables related to the underlying causal model.
A new method combines scores of individual observations to efficiently approximate posterior distributions.
problem Handling posterior distributions conditioned on multiple observations with neural methods.
method Conditional score modeling to combine learned scores from individual observations.
result Sample-efficient method that can aggregate multiple observations at inference time.
In this work, we study the problem of learning a single model for multiple domains. Unlike the conventional machine learning scenario where each domain can have the corresponding model, multiple domains (i.e., applications/users) may share the same machine learning model due to maintenance loads in cloud computing serv…
We introduce a class of dependence structures, that we call the Multiple Risk Factor (MRF) dependence structures. On the one hand, the new constructions extend the popular CreditRisk+ approach, and as such they formally describe default risk portfolios exposed to an arbitrary number of fatal risk factors with condition…
We show that an economic system populated by multiple agents generates an equilibrium distribution in the form of multiple scaling laws of conditional PDFs, which are sufficient for characterizing the probability distribution. The existence of the double scaling law is demonstrated empirically for the sales and the lab…
A new test for volatility in clustered time series data, robust to distributional assumptions.
problem Volatility issues in clustered multiple time series data, especially in stock market indicators.
method Bootstrap method for multiple time series, accounting for contagion effect.
result The test is correctly sized and powerful, especially for stationary mean and contained volatility in fewer clusters.