Cascading flows improve variational inference in structured programs.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
The paper shows how certain complex projective varieties can be broken down into simpler types.
Program or process is an integral part of almost every IT/OT system. Can we trust the identity/ID (e.g., executable name) of the program? To avoid detection, malware may disguise itself using the ID of a legitimate program, and a system tool (e.g., PowerShell) used by the attackers may have the fake ID of another commo…
Reconstructing polytopes with fixed facet directions from support function evaluations.
The SO(3)-monopole program, initiated by Pidstrigatch and Tyurin [arXiv:dg-ga/9507004], yields a relationship between the Donaldson and Seiberg-Witten invariants through a cobordism between the moduli spaces defining these invariants. The main technical difficulty in this program lies in describing the links of singula…
Sparse non-Gaussian component analysis (SNGCA) is an unsupervised method of extracting a linear structure from a high dimensional data based on estimating a low-dimensional non-Gaussian data component. In this paper we discuss a new approach to direct estimation of the projector on the target space based on semidefinit…
We show that in any triangulated 3-manifold, every index n topologically minimal surface can be transformed to a surface which has local indices (as computed in each tetrahedron) that sum to at most n. This generalizes classical theorems of Kneser and Haken, and more recent theorems of Rubinstein and Stocking, and is t…
We study a distributionally robust mean square error estimation problem over a nonconvex Wasserstein ambiguity set containing only normal distributions. We show that the optimal estimator and the least favorable distribution form a Nash equilibrium. Despite the non-convex nature of the ambiguity set, we prove that the …
Two main obstacles preventing the widespread adoption of variational Bayesian neural networks are the high parameter overhead that makes them infeasible on large networks, and the difficulty of implementation, which can be thought of as "programming overhead." MC dropout [Gal and Ghahramani, 2016] is popular because it…
Stochastic approximation proves asymptotic normality for non-smooth problems.
DMVI uses diffusion models for efficient probabilistic inference in PPLs.
The crosscap number of a knot is an invariant describing the non-orientable surface of smallest genus that the knot bounds. Unlike knot genus (its orientable counterpart), crosscap numbers are difficult to compute and no general algorithm is known. We present three methods for computing crosscap number that offer varyi…
Tensor programs prove neural network limits for any architecture.
Nonnegative matrix factorization (NMF) has been shown recently to be tractable under the separability assumption, under which all the columns of the input data matrix belong to the convex cone generated by only a few of these columns. Bittorf, Recht, Ré and Tropp (`Factoring nonnegative matrices with linear programs', …
Improves authorship attribution accuracy and robustness against adversarial attacks.
As a contribution to interpretable machine learning research, we develop a novel optimization framework for learning accurate and sparse two-level Boolean rules. We consider rules in both conjunctive normal form (AND-of-ORs) and disjunctive normal form (OR-of-ANDs). A principled objective function is proposed to trade …
New method solves constrained stochastic optimization problems efficiently.
We propose a finite dimensional variational principle on triangulated 3-manifolds so that its critical points are related to solutions to Thurston's gluing equation and Haken's normal surface equation. The action functional is the volume. This is a generalization of an earlier program by Casson and Rivin for compact 3-…
The paper improves the empirical bootstrap method for non-normal estimators.
Flow analysis leads to metric completion in Kähler geometry.
A new classifier uses linear programming to classify sets based on their covariance.
Student performance modelling (SPM) is a critical step to assessing and improving students performances in their learning discourse. However, most existing SPM are based on statistical approaches, which on one hand are based on probability, depicting that results are based on estimation; and on the other hand, actual i…
Proposes a new algorithm for solving optimization problems with stochastic objectives and equality constraints.
The paper tackles long-term treatment effects with persistent confounders using sequential short-term outcomes.
Although consistency is a minimum requirement of any estimator, little is known about consistency of the mean partition approach in consensus clustering. This contribution studies the asymptotic behavior of mean partitions. We show that under normal assumptions, the mean partition approach is consistent and asymptotic …
New model estimates signals from noisy data using robust optimization.
In this paper we parametrize the Teichmüller spaces of constructible Koebe groups, that is Kleinian group that arise as covering of orbifolds determined by certain normal subgroups of their fundamental groups. We also study the covering spaces of the Teichmüller spaces of those Koebe groups. Finally we prove an iso…
Develops an online method for solving constrained optimization problems with debiasing techniques.
Under a Bayesian framework, we formulate the fully sequential sampling and selection decision in statistical ranking and selection as a stochastic control problem, and derive the associated Bellman equation. Using value function approximation, we derive an approximately optimal allocation policy. We show that this poli…
We give a brief summary of some of our work and our joint work with Stephan Tillmann on solving Thurston's equation and Haken equation on triangulated 3-manifolds in this paper. Several conjectures on the existence of solutions to Thurston's equation and Haken equation are made. Resolutions of these conjecture will lea…
Data structure for Heegaard splittings reduces complexity.
SED integrates synthesis, execution, and debugging for neural program synthesis.
Study rare-event simulation for neural networks and random forests.
Study on random linear programs and their connection to mean widths of random polyhedrons.
Stochastic programs simplify complex models with noise and nondeterminism.
Improves probabilistic programming by analyzing program structure.
We propose design guidelines for a probabilistic programming facility suitable for deployment as a part of a production software system. As a reference implementation, we introduce Infergo, a probabilistic programming facility for Go, a modern programming language of choice for server-side software development. We argu…
Paper tackles 1-bit compressed sensing, presenting efficient algorithm for sparse signal estimation.
A neural program synthesis method with iterative fix operations.
Graph-based approach repairs programs from diagnostic feedback.
A key feature of inductive logic programming (ILP) is its ability to learn first-order programs, which are intrinsically more expressive than propositional programs. In this paper, we introduce techniques to learn higher-order programs. Specifically, we extend meta-interpretive learning (MIL) to support learning higher…
New method reduces infinite variance in probabilistic programs with rejection sampling.
Synthesizes static analysis for probabilistic programs.
We present a new algorithm for approximate inference in probabilistic programs, based on a stochastic gradient for variational programs. This method is efficient without restrictions on the probabilistic program; it is particularly practical for distributions which are not analytically tractable, including highly struc…
Program synthesis is the task of automatically generating a program consistent with a specification. Recent years have seen proposal of a number of neural approaches for program synthesis, many of which adopt a sequence generation paradigm similar to neural machine translation, in which sequence-to-sequence models are …
We consider the task of mapping pseudocode to long programs that are functionally correct. Given test cases as a mechanism to validate programs, we search over the space of possible translations of the pseudocode to find a program that passes the validation. However, without proper credit assignment to localize the sou…
Exact simulation of correlated binary outcomes using PMF constraints and linear programming.
This book is a graduate-level introduction to probabilistic programming. It not only provides a thorough background for anyone wishing to use a probabilistic programming system, but also introduces the techniques needed to design and build these systems. It is aimed at people who have an undergraduate-level understandi…