Dropout improves regularization in flexible models for rare features.
problem Understanding theoretical properties of dropout in generalized linear models.
method Theoretical analysis and application to adaptive smoothing with B-splines.
result Dropout prefers rare features in mean and dispersion parameters.
Exponential dispersion model is a useful framework in machine learning and statistics. Primarily, thanks to the additive structure of the model, it can be achieved without difficulty to estimate parameters including mean. However, tight conditions on cumulant function, such as analyticity, strict convexity, and steepne…
A framework connects VAEs to GLMs for better model initialization and performance.
problem Understanding and optimizing loss function critical points in VAEs.
method Introducing a theoretical framework based on GLM and EDFs.
result Maximum likelihood initialization improves VAE performance.
New calibration bands for various distributions improve testing for auto-calibration.
problem Testing for auto-calibration in finite samples is challenging.
method Construct calibration bands for the exponential dispersion family using finite sample properties.
result Calibration bands allow for various tests for calibration and auto-calibration.
We describe the underlying probabilistic interpretation of alpha and beta divergences. We first show that beta divergences are inherently tied to Tweedie distributions, a particular type of exponential family, known as exponential dispersion models. Starting from the variance function of a Tweedie model, we outline how…
Study global solutions for Boussinesq systems on curved manifolds.
problem Global existence and uniqueness of solutions to Boussinesq systems on non-compact Riemannian manifolds with gravitational fields.
method Used dispersive and smoothing estimates of a vectorial matrix semigroup to establish global existence and uniqueness of mild solutions for linear systems. Then, applied fixed point arguments to semilinear systems. Proved exponential stability using Gronwall's inequality.
result Established global existence, uniqueness, and exponential stability of mild solutions to the Boussinesq systems on non-compact Riemannian manifolds with gravitational fields.
This paper generalizes beta divergence beyond its classical form associated with power variance functions of Tweedie models. Generalized form is represented by a compact definite integral as a function of variance function of the exponential dispersion model. This compact integral form simplifies derivations of many pr…
Deep generative models are commonly used for generating images and text. Interpretability of these models is one important pursuit, other than the generation quality. Variational auto-encoder (VAE) with Gaussian distribution as prior has been successfully applied in text generation, but it is hard to interpret the mean…
Study proves well-posedness and scattering for wave equations on hyperbolic spaces with singular data.
problem Proving well-posedness and scattering for wave equations on hyperbolic spaces with singular initial data.
method Using weak-Lp spaces and dispersive estimates on Lorentz spaces, the study establishes global well-posedness and exponential asymptotic stability. result Developed a scattering theory and constructed wave operators in a singular framework.
Modified EAT method improves Poisson gradient estimation.
problem Challenging differentiation through Poisson-distributed latent variables.
method Exponential Arrival Time (EAT) simulation with modifications and Gumbel-SoftMax relaxation.
result Modified EAT method provides unbiased first moment and reduced second-moment bias.
New method denoises images without clean reference using Tweedie distributions.
problem Image denoising without clean reference images.
method Combining Tweedie distributions, Noise2Score, and saddle point approximation.
result General closed-form denoising formula for various noise distributions.
Novel GLMMNet model tackles high-cardinality categorical features in actuarial applications.
problem Inadequate encoding methods for high-cardinality categorical features in actuarial data.
method Generalised Linear Mixed Model Neural Network (GLMMNet) integrating a generalised linear mixed model in a deep learning framework.
result GLMMNet often outperforms or performs comparably with entity embedded neural networks, providing transparency.
MallowsPO enhances LLM fine-tuning with a dispersion index of human preferences.
problem Lack of diversity in human preferences in DPO.
method Developed a dispersion index based on Mallows' theory to characterize preference diversity.
result Demonstrated improved performance in various tasks using the dispersion index.
Bayesian model tackles spatial count data issues with flexible non-parametric techniques.
problem Challenges in traditional parametric models for spatial count data with unbalanced distributions and complex dependencies.
method Bayesian semi-parametric spatial dispersed count model combining non-parametric techniques and adapted count models.
result Demonstrates superior performance in managing dispersion and capturing intricate spatial patterns.
sgdGMF efficiently estimates generalized matrix factorization models for single-cell RNA sequencing data.
problem Challenges in dimensionality reduction for large single-cell RNA sequencing datasets.
method Scalable adaptive stochastic gradient descent algorithm for generalized matrix factorization models.
result sgdGMF outperforms existing methods in scalability and accuracy for large datasets.
Skewness dispersion predicts future stock market returns, especially in months with monetary policy announcements.
problem Predicting future stock market returns using skewness dispersion.
method Cross-sectional analysis of firm-level realized skewness and stock market returns.
result Skewness dispersion is a significant predictor of future stock market returns, robust to various estimation methods.
Study on stock market volatility and return dispersion during COVID-19.
problem Impact of COVID-19 on stock market volatility and return dispersion.
method Used Google index to proxy epidemic impact, modeled volatility, and analyzed influencing factors of log-return.
result Volatility significantly affected by epidemic and cross-sectional return dispersion, with positive coefficients.
New dispersion indices based on inaccuracy and divergence introduced for information measures.
problem Measuring variability in uncertainty measures.
method Introducing new dispersion indices based on Kerridge inaccuracy and Kullback-Leibler divergence.
result Properties, bounds, and examples of new dispersion indices presented.
New framework controls statistical dispersion for high-stakes applications.
problem Understanding and controlling the dispersion of loss distributions in high-stakes applications.
method Simple yet flexible framework for distribution-free control of statistical dispersion measures.
result Proposed methods control statistical dispersion measures with societal implications.
Urban dispersal events are processes where an unusually large number of people leave the same area in a short period. Early prediction of dispersal events is important in mitigating congestion and safety risks and making better dispatching decisions for taxi and ride-sharing fleets. Existing work mostly focuses on pred…
Probabilistic modeling is cyclical: we specify a model, infer its posterior, and evaluate its performance. Evaluation drives the cycle, as we revise our model based on how it performs. This requires a metric. Traditionally, predictive accuracy prevails. Yet, predictive accuracy does not tell the whole story. We propose…
We generalize Mallows model to learn distance metrics from data.
problem Learning optimal distance metrics from noisy ranking data.
method Propose Lα distances and develop FPTAS for sampling and MLE. result Strong consistency of estimators for various α and β. New heat dispersion laws established for smooth compact manifolds.
problem Understanding heat dispersion in smooth compact manifolds.
method Established new heat dispersion laws through Theorem 1.1 and explored them further with Propositions 3.1 and 3.2.
result New heat dispersion laws for smooth compact manifolds.
Geometric focusing affects dispersive estimates for Schrödinger and wave equations.
problem Long-time decay rate in dispersive estimates for Schrödinger and wave equations on non-trapping asymptotically conic manifolds and exact metric cones.
method Classifying the long-time decay rate in dispersive estimates for the Schrödinger and wave equations on non-trapping asymptotically conic manifolds and exact metric cones in terms of the intensity of geometric focusing.
result Each multiplicity of conjugate points within distance π on Y = ∂X0 leads to a |t|1/2-loss in the long-time decay order and a half-order shift in the regularity index in the dispersive estimate for the Schrödinger equation.
Reduced-order model improves LES for atmospheric pollutant dispersion.
problem Accurate near-field pollutant concentration tracking in urban areas.
method Combining POD and GPR for non-intrusive reduced-order modeling.
result Component-by-component optimization captures spatial scales in high-order modes.
Orthogonal random features approximate a Bessel kernel, offering sharper bounds than random Fourier features.
problem Approximating Gaussian kernel efficiently for large datasets.
method Use of Haar orthogonal matrices to construct orthogonal random features and analyze their bias and variance.
result Orthogonal random features approximate a Bessel kernel, not the Gaussian kernel, with sharper bounds.
In the recent years, banks have sold structured products such as worst-of options, Everest and Himalayas, resulting in a short correlation exposure. They have hence become interested in offsetting part of this exposure, namely buying back correlation. Two ways have been proposed for such a strategy : either pure correl…
The study examines Hawkes processes and their long-term behavior.
problem Understanding the long-term behavior of Hawkes processes.
method Proving functional limit theorems under various conditions on the dispersion of child events.
result Functional limit theorems hold for Hawkes processes with different levels of child event dispersion.
The purpose of this paper is to study the generalized Fong--Vasicek two-factor interest rate model with stochastic volatility. In this model the dispersion of the stochastic short rate (square of volatility) is assumed to be stochastic as well and it follows a non-negative process with volatility proportional to the sq…
Proposes a new portfolio optimization method considering reward, dispersion, and asymmetry.
problem Capturing fat-tails and asymmetry in asset return distributions.
method Market model with tempered stable distribution; extended mean-variance optimization.
result Closed-form solutions for VaR and CVaR; efficient frontier extended to three dimensions.
We explore a decomposition in which returns on a large class of portfolios relative to the market depend on a smooth non-negative drift and changes in the asset price distribution. This decomposition is obtained using general continuous semimartingale price representations, and is thus consistent with virtually any ass…
The standard deviation and Gini mean difference order based on tail behavior.
problem Ordering between standard deviation and Gini mean difference for real-valued risks.
method Analysis of the mean excess function of the pairwise difference ∣X−X′∣. result Dominance regimes of SD and GMD are determined by tail behavior of the distribution.
Improved peak detection in ChIP-seq data reduces over-dispersion.
problem Over-dispersion in ChIP-seq data reduces peak detection accuracy.
method Supervised segmentation models with alternative noise assumptions.
result Improved peak detection accuracy compared to natural assumptions.
We discuss a short-time existence theorem of solutions to the initial value problem for a third order dispersive flow for closed curves into a compact almost Hermitian manifold. Our equations geometrically generalize a physical model describing the motion of vortex filament. The classical energy method cannot work for …
Bayesian Quadrature improves ensembling for neural networks with dispersed likelihood peaks.
problem Ensembling neural networks struggles with dispersed, narrow peaks in likelihood surfaces.
method Uses Bayesian Quadrature to construct weighted ensembles of architectures.
result Empirically outperforms state-of-the-art baselines in test likelihood, accuracy, and expected calibration error.
We consider time-domain digital backpropagation with chromatic dispersion filters jointly optimized and quantized using machine-learning techniques. Compared to the baseline implementations, we show improved BER performance and >40% power dissipation reductions in 28-nm CMOS.
Study on billiard trajectories with fixed bounces.
problem Counting periodic trajectories with specific bounces.
method Analyzes two-dimensional dispersive billiard systems.
result Asymptotic growth of primitive periodic trajectories.
Machine learning techniques have recently received significant attention as promising approaches to deal with the optical channel impairments, and in particular, the nonlinear effects. In this work, a machine learning-based classification technique, known as the Parzen window (PW) classifier, is applied to mitigate the…
Paper transforms a complex equation into simpler forms for analysis.
problem Analyzing a fourth-order dispersive flow equation on Kähler manifolds.
method Developed the generalized Hasimoto transformation to simplify the equation.
result Explicit expressions derived for three examples of compact Kähler manifolds.
Accurate forward modeling is important for solving inverse problems. An inaccurate wave-equation simulation, as a forward operator, will offset the results obtained via inversion. In this work, we consider the case where we deal with incomplete physics. One proxy of incomplete physics is an inaccurate discretization of…
Study dispersive estimates for Schrödinger and wave equations on a cone with specific metric.
problem Pointwise decay estimates for Schrödinger and wave equations on a product cone.
method Modified Hadamard parametrix on Y with ε>π to prove dispersive estimates. result Threshold of conjugate radius ε>π for pointwise dispersive estimates. We introduce negative binomial matrix factorization (NBMF), a matrix factorization technique specially designed for analyzing over-dispersed count data. It can be viewed as an extension of Poisson matrix factorization (PF) perturbed by a multiplicative term which models exposure. This term brings a degree of freedom fo…
The uncertainty or the variability of the data may be treated by considering, rather than a single value for each data, the interval of values in which it may fall. This paper studies the derivation of basic description statistics for interval-valued datasets. We propose a geometrical approach in the determination of s…
New method calculates DMN log-likelihood faster.
problem Precise and fast computation of DMN log-likelihood.
method Derived a closed form expression using gamma function properties.
result Closed form calculation is faster with same accuracy.
Paper proposes a new method for feature importance in model selection.
problem Feature importance in model selection.
method New tree-model explanation approach using Coefficient of Variation of feature weight.
result Novel feature explanation performs better than cross-validation in model selection.
Language models allocate information storage, not collapsing into uniform representations.
problem Incomplete neural collapse in language model representations.
method Analyzing variance and information sharing across 14 models, proving an information floor.
result Within-class variance is allocated information storage, not collapsed into uniform representations.
We present a machine-learning approach to classifying the phases of surface wave dispersion curves. Standard FTAN analysis of surfaces observed on an array of receivers is converted to an image, of which, each pixel is classified as fundamental mode, first overtone, or noise. We use a convolutional neural network (U-ne…
We study productivity dispersions across workers, firms and industrial sectors. Empirical study of the Japanese data shows that they all obey the Pareto law, and also that the Pareto index decreases with the level of aggregation. In order to explain these two stylized facts, we propose a theoretical framework built upo…