Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,786 papers · 148 categories

Trend · papers per month

12.5%25.0%37.5%50.0% · May 199319922001200920172026
48 results for program normalization

Cascading flows improve variational inference in structured programs.

problem Challenges in variational inference for complex probabilistic programs.
method Integrates normalizing flows and ASVI to create cascading flows, which embed the forward-pass of probabilistic programs.
result Cascading flows outperform normalizing flows and ASVI in structured inference problems.

The paper shows how certain complex projective varieties can be broken down into simpler types.

problem Understanding the structure of complex projective varieties with pseudo-effective tangent sheaves.
method Developed a theory of pseudo-effective sheaves and applied the minimal model program.
result Projective klt varieties with pseudo-effective tangent sheaves can be decomposed into Fano varieties and Q-abelian varieties.

Reconstructing polytopes with fixed facet directions from support function evaluations.

problem Reconstructing polytopes with known facet directions from limited data.
method Least-squares estimate via convex quadratic program, combinatorial characterization for uniqueness, algorithm convergence.
result The least-squares estimate for a fixed simplicial normal fan is a convex quadratic program, and the solution is unique under certain conditions.

The SO(3)-monopole program, initiated by Pidstrigatch and Tyurin [arXiv:dg-ga/9507004], yields a relationship between the Donaldson and Seiberg-Witten invariants through a cobordism between the moduli spaces defining these invariants. The main technical difficulty in this program lies in describing the links of singula…

2012-11-02abs ↗pdf ↗

Sparse non-Gaussian component analysis (SNGCA) is an unsupervised method of extracting a linear structure from a high dimensional data based on estimating a low-dimensional non-Gaussian data component. In this paper we discuss a new approach to direct estimation of the projector on the target space based on semidefinit…

2011-06-01abs ↗pdf ↗

We show that in any triangulated 3-manifold, every index n topologically minimal surface can be transformed to a surface which has local indices (as computed in each tetrahedron) that sum to at most n. This generalizes classical theorems of Kneser and Haken, and more recent theorems of Rubinstein and Stocking, and is t…

2012-10-16abs ↗pdf ↗

We study a distributionally robust mean square error estimation problem over a nonconvex Wasserstein ambiguity set containing only normal distributions. We show that the optimal estimator and the least favorable distribution form a Nash equilibrium. Despite the non-convex nature of the ambiguity set, we prove that the …

2018-09-24abs ↗pdf ↗

Stochastic approximation proves asymptotic normality for non-smooth problems.

problem Solving non-smooth stochastic approximation problems.
method Stochastic approximation algorithms for solving smooth equations, extended to non-smooth problems.
result Asymptotic normality and optimality in non-smooth stochastic approximation is proven.

DMVI uses diffusion models for efficient probabilistic inference in PPLs.

problem Efficient probabilistic inference in complex probabilistic programming languages.
method DMVI employs diffusion models as variational approximations to the posterior distribution, optimizing a bound on the marginal likelihood.
result DMVI produces more accurate posterior inferences than existing methods in PPLs with similar computational cost and less manual tuning.

Tensor programs prove neural network limits for any architecture.

problem Understanding the limits of neural networks of any architecture.
method Prove convergence of neural network's Tangent Kernel (NTK) to a deterministic limit as network widths increase.
result Identify conditions for correct NTK limit calculation based on gradient independence assumption.

Improves authorship attribution accuracy and robustness against adversarial attacks.

problem Vulnerability of authorship attribution approaches to adversarial attacks.
method Formulated a relational adversary threat model and presented a novel learning framework, normalize-and-predict (N&P).
result Improves accuracy on adversarial inputs by up to 70% and robust accuracy by 45%.

As a contribution to interpretable machine learning research, we develop a novel optimization framework for learning accurate and sparse two-level Boolean rules. We consider rules in both conjunctive normal form (AND-of-ORs) and disjunctive normal form (OR-of-ANDs). A principled objective function is proposed to trade …

2016-06-18abs ↗pdf ↗

New method solves constrained stochastic optimization problems efficiently.

problem Online statistical inference of constrained stochastic nonlinear optimization problems.
method Stochastic Sequential Quadratic Programming (StoSQP) with iterative sketching solver.
result The rescaled primal-dual sequence converges to a mean-zero Gaussian distribution.

The paper improves the empirical bootstrap method for non-normal estimators.

problem Theoretical properties of empirical bootstrap for non-asymptotically normal estimators.
method Establishing limiting distribution, deriving consistency conditions, proposing alternative methods.
result The empirical bootstrap method can be asymptotically consistent under stability conditions.

Proposes a new algorithm for solving optimization problems with stochastic objectives and equality constraints.

problem Optimization problems with stochastic objectives and deterministic equality constraints.
method Trust-region stochastic sequential quadratic programming (TR-StoSQP) with adaptive relaxation techniques.
result Established a global almost sure convergence guarantee for TR-StoSQP.

The paper tackles long-term treatment effects with persistent confounders using sequential short-term outcomes.

problem Estimating long-term treatment effects with persistent unmeasured confounders.
method Exploiting the sequential structure of short-term outcomes, the paper develops three novel identification strategies and corresponding estimators.
result The proposed methods outperform existing approaches in handling persistent confounders.

Although consistency is a minimum requirement of any estimator, little is known about consistency of the mean partition approach in consensus clustering. This contribution studies the asymptotic behavior of mean partitions. We show that under normal assumptions, the mean partition approach is consistent and asymptotic …

2015-12-18abs ↗pdf ↗

New model estimates signals from noisy data using robust optimization.

problem Estimating signals from noisy observations with uncertainty.
method Wasserstein distributionally robust optimization for minimax MSE estimation.
result Nash equilibrium found for optimal estimator and prior.

In this paper we parametrize the Teichmüller spaces of constructible Koebe groups, that is Kleinian group that arise as covering of 22-orbifolds determined by certain normal subgroups of their fundamental groups. We also study the covering spaces of the Teichmüller spaces of those Koebe groups. Finally we prove an iso…

1995-02-17abs ↗pdf ↗

Develops an online method for solving constrained optimization problems with debiasing techniques.

problem Online inference of solutions to constrained optimization problems with equality and inequality constraints.
method Stochastic Sequential Quadratic Programming (SSQP) with momentum debiasing.
result Achieves global almost-sure convergence and local asymptotic normality with optimal primal-dual limiting covariance.

Under a Bayesian framework, we formulate the fully sequential sampling and selection decision in statistical ranking and selection as a stochastic control problem, and derive the associated Bellman equation. Using value function approximation, we derive an approximately optimal allocation policy. We show that this poli…

2017-10-07abs ↗pdf ↗

Study rare-event simulation for neural networks and random forests.

problem Safety evaluation and robustness quantification of machine learning models.
method Importance sampling scheme integrating large deviations and sequential mixed integer programming.
result Efficiency guarantees and numerical demonstrations for various neural network architectures.

Study on random linear programs and their connection to mean widths of random polyhedrons.

problem Characterizing the objectives of random linear programs and their relation to mean widths of random polyhedrons.
method Utilizing random duality theory, the exact characterizations of linear objectives are obtained in a large dimensional context.
result The exact characterizations of the program's objectives are obtained, connecting the objectives to the mean widths of random polyhedrons.

We propose design guidelines for a probabilistic programming facility suitable for deployment as a part of a production software system. As a reference implementation, we introduce Infergo, a probabilistic programming facility for Go, a modern programming language of choice for server-side software development. We argu…

2019-06-20abs ↗pdf ↗

Graph-based approach repairs programs from diagnostic feedback.

problem Learning to repair programs from limited labeled data and compiler error messages.
method Introduces program-feedback graph and graph neural network for reasoning, and self-supervised learning with unlabeled programs.
result DrRepair significantly outperforms prior work, achieving high repair rates.

A key feature of inductive logic programming (ILP) is its ability to learn first-order programs, which are intrinsically more expressive than propositional programs. In this paper, we introduce techniques to learn higher-order programs. Specifically, we extend meta-interpretive learning (MIL) to support learning higher…

2019-07-25abs ↗pdf ↗

New method reduces infinite variance in probabilistic programs with rejection sampling.

problem Infinite variance in naive importance sampling for programs with rejection sampling.
method Developed a new amortized importance sampling estimator with finite variance proof.
result Empirically demonstrated efficiency and correctness compared to existing alternatives.

We present a new algorithm for approximate inference in probabilistic programs, based on a stochastic gradient for variational programs. This method is efficient without restrictions on the probabilistic program; it is particularly practical for distributions which are not analytically tractable, including highly struc…

2013-01-07abs ↗pdf ↗

We consider the task of mapping pseudocode to long programs that are functionally correct. Given test cases as a mechanism to validate programs, we search over the space of possible translations of the pseudocode to find a program that passes the validation. However, without proper credit assignment to localize the sou…

2019-06-12abs ↗pdf ↗

Exact simulation of correlated binary outcomes using PMF constraints and linear programming.

problem Simulating dependent Bernoulli outcomes with specific means and correlations.
method Formulate the problem over the joint Bernoulli PMF, impose constraints, and solve as a linear program. Use convex-hull characterization and truncated-moment completion scheme for feasibility and simulation.
result Exact simulation framework for correlated binary outcomes, providing a convex-hull characterization and truncated-moment completion scheme.

This book is a graduate-level introduction to probabilistic programming. It not only provides a thorough background for anyone wishing to use a probabilistic programming system, but also introduces the techniques needed to design and build these systems. It is aimed at people who have an undergraduate-level understandi…

2018-09-27abs ↗pdf ↗