We define and discuss the first sparse coding algorithm based on closed-form EM updates and continuous latent variables. The underlying generative model consists of a standard `spike-and-slab' prior and a Gaussian noise model. Closed-form solutions for E- and M-step equations are derived by generalizing probabilistic P…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “closed-form algorithm”
Paper improves MFC algorithm for clustering linear subspaces.
problem Challenges in subspace clustering, especially with close cluster spans.
method Integrates MFC and iPursuit algorithms, focusing on innovation components.
result MFC/iPursuit algorithms robust to cluster intersections and span closeness.
We derive and approximate the conjugate prior of Dirichlet and beta distributions.
problem Intractability of conjugate prior for Dirichlet and beta distributions.
method Derive conjugate prior, define closed-form approximation, and provide algorithm.
result Closed-form approximation enables fully tractable Bayesian treatment.
Paper provides closed-form time derivatives for rigid body systems.
problem Need for time derivatives of equations of motion in robotics.
method Lie group formulation for rigid body systems to derive closed-form derivatives up to second-order.
result Closed-form equations provide direct insight into system dynamics.
RPE detects anomalies robustly in time-series data.
problem Detecting anomalies in time-series data efficiently and robustly.
method Window-based, robust projection step, closed-form algorithm.
result RPE can identify anomalies in time-stamp level and outperforms existing methods.
This contribution summarizes the results on the asymptotic performance of several variants of the FastICA algorithm. A number of new closed-form expressions are presented.
COSMIC identifies LTV systems from large data sets efficiently.
problem Identification of discrete-time linear time-variant systems from large-scale data.
method Formulates as regularized least squares problem, develops closed-form algorithm with linear complexity.
result Achieves optimal results even with large data volumes, significantly faster than general solvers.
A large proportion of market making models derive from the seminal model of Avellaneda and Stoikov. The numerical approximation of the value function and the optimal quotes in these models remains a challenge when the number of assets is large. In this article, we propose closed-form approximations for the value functi…
New Frank-Wolfe algorithm speeds up SVM-type multi-category learning.
problem Improving pattern recognition performance in multi-category SVM learning.
method Developed a new optimization algorithm based on Frank-Wolfe framework for MC-SVM variants.
result Closed-form solutions for direction finding and line search in the Frank-Wolfe framework for MC-SVM.
The paper introduces closed-form expressions for interpreting Tsetlin Machines.
problem Interpreting complex Tsetlin Machines with a large number of clauses.
method Developed closed-form expressions for local and global interpretability of Tsetlin Machines.
result The expressions enable real-time feature importance assessment and data clustering.
Alternative closed-form formula for spread call option prices under log-normal models.
problem Valuation of spread call options under log-normal models.
method Developed an alternative closed-form formula for spread call option prices.
result Our formula performs better for certain range of model parameters than existing closed-form formula.
A new method for speaker recognition on hyperspheres improves on PLDA's limitations.
problem Improving speaker recognition on hyperspheres with PLDA's limitations.
method Probabilistic Spherical Discriminant Analysis (PSDA) using Von Mises-Fisher distributions.
result PSDA scores are closed-form and can handle various trials, improving over PLDA.
Naz and Chaudhry [3] established multiple closed-form solutions for the basic Lucas-Uzawa model. According to Boucekkine and Ruiz-Tamarit [1] and Chilarescu [2] unique closed-form solutions exist for the basic Lucas-Uzawa model. We equate expressions for variables h(t) and u(t). We provide here condition for the unique…
We find a closed-form determinant for a specific sparse covariance matrix model.
problem Finding the determinant of a specific class of sparse positive definite matrices.
method Using Fourier transform of local factors, Normal Factor Graph Duality Theorem, and Matrix Determinant Lemma.
result We derive a closed-form expression for the determinant.
Estimation of the operational risk capital under the Loss Distribution Approach requires evaluation of aggregate (compound) loss distributions which is one of the classic problems in risk theory. Closed-form solutions are not available for the distributions typically used in operational risk. However with modern comput…
Neural network discovers exact solutions to QP with linear constraints.
problem Discovering exact solutions to Quadratic Programs (QP) with linear constraints using neural networks.
method Proposes a neural network modeling approach that analytically derives model parameters from problem coefficients, ensuring closed-form solutions without training.
result The closed-form NN model produces exact solutions for every critical region of the QP solution function, outperforming DNNs and commercial solvers in terms of optimality and feasibility.
FALL improves local model training with anchor regularization.
problem Efficient local model training in regression tasks.
method Regularization with precomputed anchor models, closed-form solution.
result FALL outperforms network Lasso in accuracy with significantly less training time.
A generalized Gaussian process model (GGPM) is a unifying framework that encompasses many existing Gaussian process (GP) models, such as GP regression, classification, and counting. In the GGPM framework, the observation likelihood of the GP model is itself parameterized using the exponential family distribution (EFD).…
New algorithm for estimating MLR parameters with non-Gaussian noise.
problem Estimating MLR parameters with non-Gaussian noise.
method Combining ADMM with EM algorithm idea.
result Our method outperforms EM algorithm in non-Gaussian noise case.
Closed-form pricing method for multi-asset options.
problem Pricing multi-asset contingent claims in an incomplete market.
method Proving extremal martingale measures and constructing algorithms for bounds and hedging.
result Closed-form formulas for no-arbitrage price intervals and hedging strategies.
A new retraction on Stiefel manifold with a closed-form inverse.
problem Efficiency in Riemannian computing applications.
method Introduces a new retraction on the compact Stiefel manifold with a closed-form inverse.
result The retraction is second-order accurate and features a closed-form inverse.
This work studies Gaussian geometry under entropy-regularized 2-Wasserstein distance.
problem Understanding Gaussian distributions in uncertainty quantification and diffusivity.
method Entropy-regularized 2-Wasserstein distance, closed-form solutions, fixed-point characterization.
result Closed-form expressions for the 2-Sinkhorn divergence and fixed-point barycenter.
Unified framework for Schrödinger Bridge solutions between arbitrary densities.
problem Generalizing generative models to arbitrary distributions.
method Unified closed-form framework for SB dynamics.
result Direct inference of SB dynamics from samples.
Linear models like EASE and SLIM are competitive in recommendation, and this work explores their theoretical relationship.
problem Understanding the relationship between linear models and matrix factorization in recommendation systems.
method Derivation and analysis of closed-form solutions for regression and matrix factorization approaches.
result Linear models and matrix factorization approaches are related but diverge in scaling singular values.
Unified framework for pricing various debt securities.
problem Pricing of different types of debt securities under general short-rate processes.
method Unifying framework using continuous-time Markov chain approximations and bi-dimensional diffusion processes.
result Closed-form matrix expressions and efficient algorithms for pricing various debt securities.
A new robust PCA method uses Innovation Search and Leverage Scores.
problem Outlier detection and robust PCA in data clustering.
method Innovation Search and Leverage Scores.
result The method provides theoretical guarantees and outperforms existing algorithms.
Information-theoretic measures such as the entropy, cross-entropy and the Kullback-Leibler divergence between two mixture models is a core primitive in many signal processing tasks. Since the Kullback-Leibler divergence of mixtures provably does not admit a closed-form formula, it is in practice either estimated using …
This paper provides a dictionary of closed-form kernel mean embeddings.
problem Challenges in deriving closed-form kernel mean embeddings.
method Comprehensive dictionary and practical tools for deriving new embeddings.
result Provides a Python library with minimal implementations of embeddings.
EM optimizes tensor density estimation by relaxing -divergence to KL-divergence.
problem Analytical challenges in traditional -divergence optimization for tensor-based density estimation.
method EM algorithm: relaxes optimization to KL-divergence, then applies tensor many-body approximation.
result Flexible modeling of various low-rank structures and their mixtures.
Layer-wise networks have a closed-form solution and a stopping criterion.
problem Training networks one layer at a time without backpropagation.
method Proved the Kernel Mean Embedding as the closed-form solution and developed a stopping criterion.
result Layer-wise networks converge to a highly desirable kernel for classification.
Noise-free sampling method using Wasserstein proximal for faster convergence.
problem Sampling from distributions governed by potential functions.
method Deterministic score-based MCMC with regularized Wasserstein proximal.
result Improved mixing time bounds for Gaussian distributions compared to ULA and MALA.
New retraction on symplectic Stiefel manifold with closed-form inverse.
problem Efficient mapping of manifold data to Euclidean domain.
method Introduces a new retraction map with a closed-form inverse.
result The new retraction has a closed-form inverse, unlike previous methods.
This work extends alpha-beta divergences to complex data and finds closed-form solutions.
problem Approximating complex random vectors.
method Extending alpha-beta divergences to complex data and optimizing the alpha-beta mean distortion.
result Closed-form expression for the centroid of complex random vectors.
Layer-wise networks have a closed-form solution and a stopping criterion.
problem Training networks one layer at a time without backpropagation.
method Proved the closed-form solution using the kernel Mean Embedding and Neural Indicator Kernel.
result Layer-wise networks have a closed-form solution and a stopping criterion.
We consider the inference of the structure of an undirected graphical model in an exact Bayesian framework. More specifically we aim at achieving the inference with close-form posteriors, avoiding any sampling step. This task would be intractable without any restriction on the considered graphs, so we limit our explora…
New initialization methods speed up Sinkhorn algorithm for OT problems.
problem Improving runtime of the Sinkhorn algorithm for optimal transport problems.
method Data-dependent initializers for Sinkhorn algorithm, based on closed-form solutions for specific settings.
result Data-dependent initializers result in dramatic speed-ups without affecting differentiability.
Survey on closed-form Fisher-Rao distance expressions.
problem Finding closed-form expressions for Fisher-Rao distance.
method Collect and present examples of closed-form expressions for Fisher-Rao distance of discrete and continuous distributions.
result Presentation of closed-form expressions for Fisher-Rao distance of various distributions.
In this note we consider setups in which variational objectives for Bayesian neural networks can be computed in closed form. In particular we focus on single-layer networks in which the activation function is piecewise polynomial (e.g. ReLU). In this case we show that for a Normal likelihood and structured Normal varia…
New method generates novel samples from closed-form diffusion models.
problem Closed-form SGMs memorize training data and cannot generate novel samples.
method Explicitly smooth closed-form score, use nearest-neighbor estimator.
result Efficient method generates novel samples without training.
Bayesian neural networks learn weights with closed-form updates.
problem Efficiently learning Bayesian neural networks with closed-form updates.
method Closed-form Bayesian inference for online learning of Gaussian-weighted BNNs.
result Closed-form expressions for sequential/online training of BNNs.
Improved portfolio optimization using VaR and CVaR with NMVM models.
problem Optimizing portfolios with VaR and CVaR under NMVM distributions.
method Transformed mean-CVaR-skewness problems into quadratic optimization with closed-form solutions for NMVM models.
result Approximate closed-form expressions for VaR and CVaR of NMVM portfolios.
Study on utility maximization with Tsallis entropy in reinforcement learning.
problem Exploring utility maximization with Tsallis entropy in reinforcement learning.
method Introducing Tsallis entropy regularizer to induce exploration, investigating specific examples, characterizing well-posedness, designing reinforcement learning algorithm.
result Characterized well-posedness and provided semi-closed-form solutions for specific examples, found distinct optimal strategies.
VBphenoR uses variational Bayes for EHR-based patient phenotyping.
problem Phenotyping patients from EHR data for targeted treatments.
method Variational Bayes Gaussian Mixture Model (GMM) and logistic regression.
result Closed-form inference for efficient patient phenotype determination.
In this paper, we propose a convergent parallel best-response algorithm with the exact line search for the nondifferentiable nonconvex sparsity-regularized rank minimization problem. On the one hand, it exhibits a faster convergence than subgradient algorithms and block coordinate descent algorithms. On the other hand,…
Robust state-space radio interferometric imaging using Stochastic Approximation Expectation Maximization
problem Improving state-space radio interferometric imaging in the presence of heavy-tailed noise
method Stochastic Approximation Expectation Maximization
result Significant improvement in reconstruction fidelity and robustness to radio-frequency interference
In this work, I generalize Merton's approach of pricing risky debt to the case where the interest rate risk is modeled by the CIR term structure. Closed form result for pricing the debt is given for the case where the firm value has non-zero correlation with the interest rate. This extends previous closed form pricing …
Optimizes neural networks' last layer with closed-form solutions.
problem Optimizing neural networks' last layer with stochastic gradient descent.
method Adapting closed-form last layer optimization for stochastic gradient descent, alternating between backbone and last layer updates.
result The method converges to optimal solutions and outperforms standard SGD and Adam in regression tasks.
This work provides closed-form solutions and minimum achievable errors for a large class of low-rank approximation problems in Hilbert spaces. The proposed theorem generalizes to the case of bounded linear operators the previous results obtained in the finite dimensional case for the Frobenius norm. The theorem provide…