Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

14294357 · Jun 202019922001200920172026
48 results for interval-bound propagation

IBP-R improves verified adversarial robustness with simple, effective interval bound propagation.

problem Improving verifiability of adversarially trained networks.
method Coupling adversarial attacks with interval bound propagation for minimized verification gap.
result State-of-the-art verified robustness-accuracy trade-offs for small perturbations on CIFAR-10.

Proves the existence of accurate, certifiably robust neural networks.

problem Training neural networks to be robust against adversarial attacks.
method Proves the existence of networks that approximate continuous functions and ensure robustness through interval-bound propagation.
result Proves the existence of accurate, interval-certified ReLU networks.

Paper aims to ensure reliable detection of out-of-distribution data with certifiable worst-case guarantees.

problem Deep neural networks are overconfident with OOD inputs, posing safety risks.
method Enforces low confidence and bounds in an ll_\infty-ball around OOD points using interval bound propagation (IBP).
result Certifiable worst-case guarantees for OOD detection are possible without significant loss in accuracy.

Paper proposes faster certified robust training methods with short warmup.

problem Certified robust training methods require long warmup schedules, making training costly.
method Proposes three improvements: new weight initialization, BN, and regularization.
result Achieves 65.03% verified error on CIFAR-10 and 82.36% on TinyImageNet with short warmup.

Training Deep Neural Networks that are robust to norm bounded adversarial attacks remains an elusive problem. While exact and inexact verification-based methods are generally too expensive to train large networks, it was demonstrated that bounded input intervals can be inexpensively propagated from a layer to another t…

2019-05-28abs ↗pdf ↗

Proposes a method for obtaining interval bounds in off-policy evaluation.

problem Provides provably correct upper and lower bounds for off-policy evaluation.
method Searches for the maximum and minimum values of the expected reward among Lipschitz Q-functions.
result Introduces a Lipschitz value iteration method to monotonically tighten interval bounds.

Paper provides efficient robustness certificates for neural networks.

problem Ensuring neural networks are robust against adversarial attacks.
method Two-step approach: 1) Efficient convex optimization for robustness certificates with bounded Hessian eigenvalues, 2) Curvature-based regularization during training.
result Significantly higher certified robust accuracy achieved compared to existing methods.

Paper proves neural networks can be approximated using interval bounds.

problem Verifying safety and robustness of neural networks.
method Introduces interval universal approximation (IUA) theorem for neural networks.
result Neural networks can be approximated using interval bounds for any continuous function and squashable activation functions.

The paper studies sub and super-replication price bounds for contingent claims defined on general trajectory based market models. No prior probabilistic or topological assumptions are placed on the trajectory space, trading is assumed to take place at a finite number of occasions but not bounded in number nor necessari…

2015-11-04abs ↗pdf ↗

A susceptibility propagation that is constructed by combining a belief propagation and a linear response method is used for approximate computation for Markov random fields. Herein, we formulate a new, improved susceptibility propagation by using the concept of a diagonal matching method that is based on mean-field app…

2017-12-01abs ↗pdf ↗

Variational inference is a powerful concept that underlies many iterative approximation algorithms; expectation propagation, mean-field methods and belief propagations were all central themes at the school that can be perceived from this unifying framework. The lectures of Manfred Opper introduce the archetypal example…

2014-09-22abs ↗pdf ↗

Guaranteed bounds for posterior inference in probabilistic programs.

problem Approximating the posterior distribution of probabilistic programs with provable correctness.
method Interval-based trace semantics, soundness and completeness proofs, weight-aware interval type system.
result Guaranteed bounds on the posterior distribution of probabilistic programs are computed and proven to be correct.

This paper proposes an alternating back-propagation algorithm for learning the generator network model. The model is a non-linear generalization of factor analysis. In this model, the mapping from the continuous latent factors to the observed signal is parametrized by a convolutional neural network. The alternating bac…

2016-06-28abs ↗pdf ↗

Unified model combines feature and label propagation for semi-supervised classification.

problem Combining feature and label propagation for effective semi-supervised classification.
method Unified Message Passing Model (UniMP) using Graph Transformer and masked label prediction.
result Obtains new state-of-the-art results in Open Graph Benchmark (OGB).

This thesis investigates belief propagation's performance in graphical models with loops.

problem Belief propagation's performance and convergence guarantees in models with loops are uncertain.
method Investigates how model parameters affect belief propagation's performance, convergence, and approximation quality.
result Model parameters influence the number of fixed points, convergence properties, and approximation quality of belief propagation.

LNPE enhances local connections in embeddings using extended neighbor propagation.

problem Improving local connections and interactions in nonlinear dimensionality reduction.
method Inspired by GCN, LNPE extends 1-hop neighbors to n-hop neighbors in LLE.
result LNPE produces more faithful and robust embeddings with better topological and geometrical properties.

Decoupled GCN is shown to be equivalent to label propagation.

problem Improving semi-supervised node classification in graph learning.
method The paper proves the equivalence of decoupled GCN and label propagation, and proposes a new method named PTA.
result Decoupled GCN is equivalent to two-step label propagation and can automatically assign weights to pseudo-labels.

The back-propagation algorithm is the cornerstone of deep learning. Despite its importance, few variations of the algorithm have been attempted. This work presents an approach to discover new variations of the back-propagation equation. We use a domain specific lan- guage to describe update equations as a list of primi…

2018-08-08abs ↗pdf ↗

A new method for target propagation using iterative approximations converges fast and is more biologically plausible.

problem Improving target propagation methods for neural networks.
method Iterative approximate inverses and local auto-encoders.
result The method converges exponentially fast under certain conditions.

Global propagator for massless Dirac operator defined and analyzed.

problem Analyzing the massless Dirac operator on 3-manifolds.
method Constructing propagator as sum of oscillatory integrals, providing global definitions and small time expansions.
result Explicit calculation of propagators' symbols and coefficients in eigenvalue counting functions.

This paper proposes methods to compute differentially private confidence intervals for the median.

problem Ensuring privacy in statistical inference for the median.
method Directly estimating interval bounds for the median under differential privacy constraints.
result The proposed methods provide valid differentially private confidence intervals for the median.

The article constructs Feynman propagators for normally hyperbolic operators on curved spacetimes.

problem Constructing Feynman propagators for non-scalar geometric operators on curved spacetimes.
method Global microlocalisation constructions for normally hyperbolic operators on globally hyperbolic spacetimes.
result Feynman propagators can be constructed to satisfy a positivity property for selfadjoint normally hyperbolic operators.

The paper proposes a scalable framework for uncertainty quantification and propagation in surrogate-based Bayesian inference.

problem Uncertainty in surrogate models and its impact on inference and decision-making.
method Bayesian inference methods for surrogate models with measurement data.
result Scalable framework for uncertainty quantification and propagation in surrogate models.

We introduce propagation kernels, a general graph-kernel framework for efficiently measuring the similarity of structured data. Propagation kernels are based on monitoring how information spreads through a set of given graphs. They leverage early-stage distributions from propagation schemes such as random walks to capt…

2014-10-13abs ↗pdf ↗

SOLBP extends efficient inference to uncertain Bayesian networks.

problem Inference in uncertain Bayesian networks with second-order probabilities.
method Extends Loopy Belief Propagation to second-order Bayesian networks.
result Generates inferences consistent with sum-product networks, more efficient and scalable.

Belief propagation (BP) can do exact inference in loop-free graphs, but its performance could be poor in graphs with loops, and the understanding of its solution is limited. This work gives an interpretable belief propagation rule that is actually minimization of a localized αα-divergence. We term this algorithm as $α…

2019-08-23abs ↗pdf ↗

We discuss positivity properties of `distinguished propagators', i.e. distinguished inverses of operators that frequently occur in scattering theory and wave propagation. We relate this to the work of Duistermaat and Hörmander on distinguished parametrices (approximate inverses), which has played a major role in quantu…

2014-11-26abs ↗pdf ↗

Study shows uniform-time chaos propagation in mean field Langevin dynamics.

problem Understanding the convergence of marginal distributions in mean field dynamics.
method Assumed functional convexity of energy, used LpL^p-convergence and Wasserstein metrics.
result Uniform-in-time propagation of chaos proved in both L2L^2-Wasserstein and relative entropy.

As one of the most important types of (weaker) supervised information in machine learning and pattern recognition, pairwise constraint, which specifies whether a pair of data points occur together, has recently received significant attention, especially the problem of pairwise constraint propagation. At least two reaso…

2015-02-19abs ↗pdf ↗

Wave propagation framework using cone structures and observers' vector fields.

problem Describing classic wave propagation in anisotropic media.
method Introduces a cone structure CC and an observers' vector field t\partial_t to describe wave propagation.
result Reduces the PDE for wavefronts to ODE for cone geodesics of CC.