In this paper, we consider the multivariate Bernoulli distribution as a model to estimate the structure of graphs with binary nodes. This distribution is discussed in the framework of the exponential family, and its statistical properties regarding independence of the nodes are demonstrated. Importantly the model can e…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “Bernoulli variables”
Proposes a non-parametric method for deep discrete latent variable models.
problem Learning sparse discrete latent representations in deep models.
method Iterative algorithm with Beta-Bernoulli process prior and local data scaling.
result Improves sparsity and scalability of deep discrete latent variable models.
Rule-based classifiers quantify uncertainty using Bernoulli random variables.
problem Quantifying the uncertainty of precision estimates for rule-based text classifiers.
method Treat partitions of sub-strings as Bernoulli random variables, compare means using statistical tests, and combine classifiers using Dempster-Shafer theory.
result The approach can be used to combine binary classifiers into a multi-label classifier.
The paper proves ML estimators are strongly consistent for identifying edge weights in BAR models.
problem Identifying edge weights in Bernoulli Autoregressive (BAR) models.
method Maximum Likelihood (ML) estimation for two variants of BAR models.
result ML estimators are strongly consistent for edge weight identification.
A new distribution fixes a common error in VAEs, improving image quality.
problem Using a Bernoulli likelihood for pixel data in VAEs.
method Introducing the continuous Bernoulli distribution.
result The continuous Bernoulli improves image quality across various metrics and datasets.
Adaptive learning method identifies and corrects corrupted data.
problem Robust learning from corrupted training sets.
method Identifies corrupted and non-corrupted samples with latent Bernoulli variables, formulates as likelihood maximization with marginalized latent variables, solved via variational inference and Expectation-Maximization.
result Improves over state-of-the-art by automatically inferring corruption level with minimal overhead.
We consider Bernoulli random variables, which are independent conditional on a common random factor determining their probability distribution. We show that certain expected functionals of the proportion of variables in a given state converge at rate as . Based on these results, we …
Improved regret bounds for DP-KLUCB and DP-IMED in Bernoulli bandits.
problem Minimizing regret in stochastic bandits under ε-global Differential Privacy.
method Developed DP versions of KLUCB and IMED, proving tighter lower bounds and matching upper bounds.
result DP-KLUCB and DP-IMED achieve asymptotically optimal regret under ε-global DP.
Proposes a new method for feature selection in non-linear functions.
problem Feature selection for non-linear functions in high-dimensional data.
method Continuous relaxation of Bernoulli distributions to learn feature selection indicators via gradient descent.
result Demonstrates the effectiveness of the approach on synthetic and real-life applications.
Paper compares largest claim amounts from two interdependent portfolios.
problem Comparing claim amounts from two sets of interdependent portfolios.
method Stochastic comparisons using dependent non-negative random variables and Bernoulli variables.
result Stochastic order results for largest claim amounts.
Generalized Kronecker formula for Bernoulli numbers and self-intersections of curves on a surfacemath.NT
We present a new explicit formula for the -th Bernoulli number , which involves two integer parameters and with . If we set and , then the formula reduces to the celebrated Kronecker formula for . We give two proofs of our formula. One is analytic and uses a certain fun…
Infectious Default Model with Recovery and Continuous Limitphysics.data-an
We introduce an infectious default and recovery model for N obligors. Obligors are assumed to be exchangeable and their states are described by N Bernoulli random variables S_{i} (i=1,...,N). They are expressed by multiplying independent Bernoulli variables X_{i},Y_{ij},Y'_{ij}, and default and recovery infections are …
New ZIPLN model accounts for zero-inflation in multivariate count data.
problem Zero-inflation in multivariate count data.
method Introduced Zero-Inflated PLN (ZIPLN) model with variational inference.
result ZIPLN significantly improves log-likelihood and reduces dispersion.
Ordering the smallest claim amounts from two sets of interdependent heterogeneous portfoliosq-fin.RM
Paper compares smallest claim amounts from two interdependent portfolios.
problem Comparing smallest claim amounts from two sets of interdependent portfolios.
method Dependent non-negative random variables with survival copula, Bernoulli random variables, likelihood ratio order.
result Bounds for survival function of the smallest claim amount in a portfolio.
Probabilistic learning for binary classification with categorical variables.
problem Binary classification with categorical covariates.
method Probabilistic analysis and two algorithms for learning boolean functions.
result Effective learning of boolean functions from binary data.
Paper proposes a new estimator for generic discrete distributions.
problem Estimating gradients for stochastic nodes in deep generative models.
method Generalized Gumbel-Softmax estimator using truncation, Gumbel-Softmax trick, and linear transformation.
result Efficacy and practical value demonstrated in synthetic examples and topic models.
In this paper, we are concerned with obtaining distribution-free concentration inequalities for mixture of independent Bernoulli variables that incorporate a notion of variance. Missing mass is the total probability mass associated to the outcomes that have not been seen in a given sample which is an important quantity…
New algorithm minimizes regret in stochastic linear bandits with perturbed history.
problem Minimizing cumulative regret in stochastic linear bandits.
method Perturbed-history exploration in a linear bandit (LinPHE) algorithm.
result Achieves a gap-free bound on cumulative regret.
A new method selects features for clustering without labels.
problem Identifying meaningful features in large datasets.
method Differentiable unsupervised feature selection using a gated Laplacian.
result The method improves clustering performance in noisy data.
The structure of a Bayesian network encodes most of the information about the probability distribution of the data, which is uniquely identified given some general distributional assumptions. Therefore it's important to study the variability of its network structure, which can be used to compare the performance of diff…
Characterizes symmetric Bernoulli distributions with minimal convex sums.
problem Understanding minimal dependence among Bernoulli random vectors.
method Geometric and algebraic representations of multivariate symmetric Bernoulli distributions.
result Characterizes extremal negative dependence and builds minimal dependence copulas.
We study covariance matrix estimation for the case of partially observed random vectors, where different samples contain different subsets of vector coordinates. Each observation is the product of the variable of interest with a Bernoulli random variable. We analyze an unbiased covariance estimator under this mod…
Upper bound on expected supremum of Bernoulli process.
problem Bounding the supremum of Bernoulli processes.
method Using properties of the index set and function class, extending earlier results on Gaussian processes.
result An upper bound on the expected supremum of a Bernoulli process.
Study of online learning with noisy feedback in adversarial settings.
problem Adversarial online learning with noisy feedback.
method Models of adversarial online learning with binary losses xored by noise, considering both constant and variable noise rates.
result Tight regret bounds for learning with noise in adversarial online learning.
The paper compares one-hot encoding to Naïve Bayes for categorical variables.
problem Incorrect one-hot encoding affects Naïve Bayes performance.
method Mathematical and experimental analysis of PoB vs. categorical Naïve Bayes.
result Posterior probabilities are usually greater in the PoB case, but agree on the maximum a posteriori class label.
A note on extending Chernoff bound for unit interval random variables.
problem Extending the Chernoff bound to random variables in the unit interval.
method Proof of extension of the Chernoff bound.
result A proof provided for the extension of the Chernoff bound.
Simple algorithm approximates rare event frequencies.
problem Approximating the frequency of rare events.
method Iterative update of categorical click-distribution, resulting in a random walk on an n-dimensional simplex.
result The random walk corresponds to a biased Bernoulli convolution under certain conditions.
The aim of this article is to generalize in several variables some formulae for Eisenstein series in one variable. For example the formula for the values of zeta functions at even integers in functions of Bernoulli numbers. A. Szenes proved …
Finite index solutions to Bernoulli problem are always axially symmetric.
problem Entire solutions to the Bernoulli free boundary problem with finite Morse index in 3D.
method Proof of axial symmetry for finite index solutions.
result Finite index solutions to the Bernoulli problem in 3D are axially symmetric.
The structure of a Bayesian network includes a great deal of information about the probability distribution of the data, which is uniquely identified given some general distributional assumptions. Therefore it's important to study its variability, which can be used to compare the performance of different learning algor…
Algorithm learns smooth probability functions from Bernoulli tests with guarantees.
problem Learning smooth probability functions from Bernoulli tests with contextual features.
method Scalable algorithm with rigorous L2-norm convergence guarantees for posterior update rule.
result Empirical convergence rates match theoretical guarantees, superior to state-of-the-art.
Proves a principle for one-phase Bernoulli problem minimizers.
problem One-phase Bernoulli problem minimizers.
method Strong maximum principle, Alt-Caffarelli functional, Hardt-Simon-type foliation.
result Constructs a foliation for global minimizers.
Stochastic gradient descent based algorithms are typically used as the general optimization tools for most deep learning models. A Restricted Boltzmann Machine (RBM) is a probabilistic generative model that can be stacked to construct deep architectures. For RBM with Bernoulli inputs, non-Euclidean algorithm such as st…
Bayesian autoencoders improve OOD detection by addressing Bernoulli likelihood issues.
problem Out-of-distribution (OOD) detection fails with Bernoulli likelihood for certain datasets.
method Proposes Bayesian autoencoders and alternative likelihood models to fix the issue.
result Bayesian autoencoders and alternative likelihood models improve OOD detection accuracy.
This paper proposed a new regression model called -regularized outlier isolation and regression (LOIRE) and a fast algorithm based on block coordinate descent to solve this model. Besides, assuming outliers are gross errors following a Bernoulli process, this paper also presented a Bernoulli estimate model which, …
Hybrid continuous-discrete models naturally represent many real-world applications in robotics, finance, and environmental engineering. Inference with large-scale models is challenging because relational structures deteriorate rapidly during inference with observations. The main contribution of this paper is an efficie…
Uncertainty about Uncertainty: Optimal Adaptive Algorithms for Estimating Mixtures of Unknown Coinscs.LG
Optimal adaptive algorithm estimates coin mixture fractions with tight sample complexity bounds.
problem Estimating the fraction of positive coins in a mixture with unknown biases.
method Fully-adaptive algorithm with tight sample complexity bounds of Θ(ρ/ε²Δ² log(1/δ)).
result Upper and lower bounds of Θ(ρ/ε²Δ² log(1/δ)) samples for 1-δ probability of success.
We solve Euler equations on graph manifolds, classifying steady flows with Morse-Bott Bernoulli functions.
problem Classifying steady Euler flows with Morse-Bott Bernoulli functions.
method Constructing non-vanishing steady solutions using integrable systems and topology.
result Steady Euler flows with Morse-Bott Bernoulli functions exist only on graph three-manifolds.
The paper cleans label noise in supervised classification using Bernoulli sampling.
problem Label noise degrades supervised classifier performance.
method Proposes a label noise cleaning method based on Bernoulli random sampling.
result The method separates clean and noisy observations without prior label information.
This paper tackles open problem of tight bounds for KBs with Bernoulli rewards.
problem Open problem of tight bounds for Kernelized Bandits with Bernoulli rewards.
method Focus on Bernoulli model, not subgaussian noise, and optimize function in RKHS.
result Open problem remains unsolved in this context.
Dasgupta and Shulman showed that a two-round variant of the EM algorithm can learn mixture of Gaussian distributions with near optimal precision with high probability if the Gaussian distributions are well separated and if the dimension is sufficiently high. In this paper, we generalize their theory to learning mixture…
We show how to analyze and interpret the correlation structures, the conditional expectation values and correlation coefficients of exchangeable Bernoulli random variables. We study implied default distributions for the iTraxx-CJ tranches and some popular probabilistic models, including the Gaussian copula model, Beta …
Spectral method speeds fitting of binary time series models.
problem Modeling binary time series data with latent linear dynamical systems.
method Spectral learning of probit-Bernoulli latent linear dynamical systems.
result Spectral method provides robust, fixed-cost estimator.
A new method for efficient nonlinear process monitoring using random Bernoulli features.
problem High computational demands and real-time responsiveness in online monitoring systems.
method Random Bernoulli principal component analysis to capture nonlinear patterns efficiently.
result The proposed methods offer excellent scalability and reduced computational complexity.
Paper justifies ST estimator using pWGF and proposes an improved variant.
problem Theoretical justification for ST estimator for discrete variables.
method Interpreted ST as pWGF simulation and proposed an improved estimator.
result Established theoretical foundation for ST estimator and improved variant.
A new gradient estimator reduces variance near boundaries for binary latent variables.
problem Explosive gradient variance near boundaries in binary latent variable models.
method Introduces a new gradient estimator (bitflip-1) and an aggregated estimator (UGC) that uses either bitflip-1 or DisARM for each coordinate.
result UGC has uniformly lower variance than DisARM and achieves optimal optimization objectives.
Policy gradient algorithm with variable learning rates achieves near-optimal performance in multi-arm bandit problems.
problem Optimizing a policy gradient algorithm for multi-arm bandit problems with variable learning rates.
method Applied Foster-Lyapunov techniques to analyze a Markov chain formed by the state of the algorithm.
result The policy gradient algorithm converges to the optimal arm with logarithmic or poly-logarithmic regret.
A new method uses Mean Field Games to optimize mixture models of Bernoulli and categorical distributions.
problem Optimizing parameters of finite mixture models of Bernoulli and categorical distributions.
method Mean Field Games theory applied to multi-population systems.
result The Mean Field Games approach provides a method to compute mixture model parameters.