Study tackles discretization problem in crafting adversarial examples for discrete integer domains.
problem Discretization problem in crafting adversarial examples for discrete integer domains.
method Proposes a black-box method to reduce adversarial example searching to a derivative-free optimization problem.
result Significantly higher success rate in crafting adversarial images in discrete integer domain compared to black-box methods.
BayesSum improves Bayesian quadrature for discrete domains, requiring fewer samples.
problem Estimating intractable expectations over discrete domains.
method BayesSum is a Bayesian quadrature extension for discrete domains, leveraging prior information through Gaussian processes.
result BayesSum requires fewer samples than Monte Carlo, achieving faster convergence rates.
For any pseudoconvex Runge domain Ω⊂C2 we prove that every closed discrete subset in Ω is contained in a properly embedded complex curve in Ω with any prescribed topology (possibly infinite).
This paper tackles convex-submodular minimax problems in mixed continuous-discrete domains.
problem Convex-submodular minimax problems in mixed continuous-discrete domains.
method Introduces new notions of optimality and proposes iterative algorithms combining discrete and continuous optimization.
result Characterizes convergence rates, computational complexity, and quality of solutions for convex and monotone-submodular minimax problems.
Generative model for discrete objects using Markov chains with valid transitions.
problem Generating valid discrete objects with unique construction histories.
method Markov chain with restricted local operations that preserve validity.
result Generative model produces valid discrete objects and compares favorably to alternatives.
We present an explicit formula for the discrete power function introduced by Bobenko, which is expressed in terms of the hypergeometric τfunctions for the sixth Painlevé equation. The original definition of the discrete power function imposes strict conditions on the domain and the value of the exponent. However, we sh…
Ada-BKB optimizes black-box functions on continuous domains with adaptive discretization.
problem Optimizing functions with continuous domains using Gaussian process optimization.
method Adaptive discretization of the function domain to avoid non-convex optimization costs.
result Ada-BKB algorithm runs in O(T2dexteff2), significantly faster than existing methods. This paper studies Bayesian ranking and selection (R&S) problems with correlated prior beliefs and continuous domains, i.e. Bayesian optimization (BO). Knowledge gradient methods [Frazier et al., 2008, 2009] have been widely studied for discrete R&S problems, which sample the one-step Bayes-optimal point. When used ove…
Paper explores neural network approximations on sphere domains.
problem Approximating functionals on sphere domains using neural networks.
method Encoder-decoder framework with spherical harmonics for infinite-dimensional domain.
result Approximation rates of neural networks with different encoder structures.
The paper defines conditions for groups acting on convex domains to be relatively hyperbolic.
problem Understanding conditions for groups acting on convex domains to be relatively hyperbolic.
method Analyzing the geometry of the convex domain to determine relative hyperbolicity.
result Established necessary and sufficient conditions for groups to be relatively hyperbolic.
This primer explains diffusion models in general state spaces.
problem Diffusion models in general state spaces are not well-introduced.
method Develops discrete-time and continuous-time views of diffusion models, deriving Fokker-Planck and master equations.
result Unified understanding of diffusion models across continuous and discrete domains.
New methods improve memory efficiency for sampling from complex distributions.
problem Sampling from complex unnormalized distributions over discrete domains.
method Two novel training methods for discrete diffusion samplers.
result Achieve state-of-the-art results in unsupervised combinatorial optimization.
Machine-learning models for security-critical applications such as bot, malware, or spam detection, operate in constrained discrete domains. These applications would benefit from having provable guarantees against adversarial examples. The existing literature on provable adversarial robustness of models, however, exclu…
This work compresses sequences by treating them as continuous-time processes, enabling efficient discretization.
problem Efficient compression of sequences, especially with deep learning models that scale with sequence length.
method Treat sequences as continuous-time processes, learn efficient discretization, and decode at different time intervals.
result Automatic bit rate reductions in video and motion capture sequences using learned discretization.
Estimates causal effect using proxies in multi-domain settings.
problem Estimating causal effect in settings with unobserved confounders across domains.
method Proposes estimation techniques using proxy variables for discrete or categorical data.
result Proves identifiability and consistency of causal effect estimation.
BIG Laplacians bridge combinatorial and Hodge Laplacians for discrete data.
problem Comparing combinatorial and Hodge Laplacians for discrete data.
method Introducing Boundary-Induced Graph (BIG) Laplacians using DEC.
result BIG Laplacian eigenvalues converge to Hodge Laplacian for simple shapes.
Generalized meshes for non-regular geometries, including fractures.
problem Discretization of partial differential equations in non-regular geometries.
method Introduces generalized meshes with overlapping elements and flexible adjacency relations.
result Discrete differential forms on virtually inflated meshes characterize the trace space of forms in surrounding volumes.
Kernel methods on discrete domains have shown great promise for many challenging data types, for instance, biological sequence data and molecular structure data. Scalable kernel methods like Support Vector Machines may offer good predictive performances but do not intrinsically provide uncertainty estimates. In contras…
SOM-VQ tokenizes discrete models with semantic structure and navigable topology.
problem Lack of semantic structure in vector quantized representations limits interpretable human control.
method Combines vector quantization with Self-Organizing Maps to learn discrete codebooks with explicit topology.
result SOM-VQ produces more learnable token sequences and provides an explicit navigable geometry in code space.
New method distills discrete diffusion models, maintaining quality and diversity.
problem Difficult to distill discrete diffusion models.
method Discrete Moment Matching Distillation (D-MMD)
result Maintains high quality and diversity in distilled models.
Let X be a CAT(0) space, and G a discrete cyclic group of isometries of X. We investigate the domain of discontinuity for the action of G on the boundary ∂X.
Simplicial, piecewise-flat discretizations of manifolds provide a clear path towards curvature analysis on discrete geometries and for solutions of PDE's on manifolds of complex topologies. In this manuscript we review and expand on discrete exterior calculus methods using hybrid domains. We then analyze the geometric …
Paper improves neural network robustness certification with tighter radii estimates.
problem Certifying neural networks' robustness against adversarial attacks.
method Advanced algorithms for discrete and continuous domains, optimizing sample size, standard deviation, and temperature.
result Significant improvement in certified test-set accuracy with tighter certified radii bounds.
Deep neural network learns discrete state abstractions for efficient planning.
problem Efficient sequential decision making in large state spaces.
method Information bottleneck method for learning approximate bisimulations using deep neural encoders and action-conditioned HMM.
result Trained method efficiently plans for unseen goals in multi-goal reinforcement learning.
Proposes a continuous relaxation for discrete Bayesian optimization.
problem Efficiently optimizing discrete data with limited target observations.
method Continuous relaxation of objective function, incorporating prior knowledge.
result Optimization can be computationally tractable with few observations.
New wavelet frames constructed from reproducing kernels for continuous and discrete domains.
problem Generating wavelet frames on non-Euclidean structures.
method Spectral filtering of integral operators associated with reproducing kernels.
result Discrete frames as Monte Carlo estimates of continuous frames, with finite-sample rates derived.
MiVaBo optimizes mixed-variable functions efficiently, handling constraints.
problem Optimizing expensive, mixed-variable functions with discrete constraints.
method Combines linear surrogate model and Thompson sampling, optimizing acquisition function.
result First BO method to handle complex constraints over discrete variables.
The paper proves convergence of discrete maps to Riemann mappings for polyhedral surfaces.
problem Discrete conformal geometry of polyhedral surfaces.
method Establishing rigidity for hexagonal triangulations and estimating quasiconformal constants.
result Discrete conformal maps converge to Riemann mappings for Jordan domains.
New wavelets use Monte Carlo for efficient discretization.
problem Efficiently discretizing continuous wavelets on general domains.
method Defined continuous wavelets via spectral calculus and proposed a Monte Carlo discretization.
result Convergence of Monte Carlo wavelets under natural regularity assumptions.
In this article, we sketch an algorithm that extends the Q-learning algorithms to the continuous action space domain. Our method is based on the discretization of the action space. Despite the commonly used discretization methods, our method does not increase the discretized problem dimensionality exponentially. We wil…
Score based learning (SBL) is a promising approach for learning Bayesian networks in the discrete domain. However, when employing SBL in the continuous domain, one is either forced to move the problem to the discrete domain or use metrics such as BIC/AIC, and these approaches are often lacking. Discretization can have …
We begin by showing that commensurators of Zariski dense subgroups of isometry groups of symmetric spaces of non-compact type are discrete provided that the limit set on the Furstenberg boundary is not invariant under the action of a (virtual) simple factor. In particular for rank one or simple Lie groups, Zariski dens…
Survey and benchmark high-dimensional Bayesian optimization of discrete sequences.
problem Heterogeneous experimental set-ups and technical barriers in high-dimensional Bayesian optimization of discrete sequences.
method Unified framework and software libraries to test and benchmark methods.
result Unified framework and software libraries for testing and benchmarking high-dimensional Bayesian optimization methods.
The paper studies convergence of discrete harmonic maps to smooth ones.
problem Discretization of harmonic maps between Riemannian manifolds.
method Introducing triangulations with vertex and edge weights, and studying convergence conditions.
result Suitable conditions on weighted triangulations ensure convergence of discrete harmonic maps to smooth ones.
A fast method for discrete OT with group-sparse regularization for class label preservation.
problem Efficiently measuring the distance between two discrete distributions with class labels.
method Fast discrete OT with group-sparse regularizers using gradient-based algorithms.
result Up to 8.6 times faster than original method without degrading accuracy.
New algorithm learns halfspaces over hypercube with random bit flips.
problem Agnostic learning of Boolean halfspaces over discrete domains is computationally hard.
method Smoothed analysis with random bit flips for discrete inputs.
result First efficient algorithm for smoothed agnostic learning of halfspaces over Boolean hypercube.
Paper proposes a method to speed up discrete diffusion models by distilling many steps into few.
problem Challenges in capturing dependencies between elements in discrete diffusion models.
method Proposes 'mixture' models and loss functions to distill many sampling steps into few.
result Effective in distilling pretrained discrete diffusion models across image and language domains.
Unified framework extends adjoint Schrödinger bridge sampler to discrete spaces.
problem Challenges in learning discrete neural samplers due to gradients and combinatorial complexity.
method Introduces discrete ASBS, a unified framework that extends adjoint Schrödinger bridge sampler to discrete spaces.
result Empirically, discrete ASBS achieves competitive sample quality with significant advantages in training efficiency and scalability.
This article presents a finite element method (FEM) for a partial integro-differential equation (PIDE) to price two-asset options with underlying price processes modeled by an exponential Levy process. We provide a variational formulation in a weighted Sobolev space, and establish existence and uniqueness of the FEM-ba…
DDMI generates high-quality INRs by adapting positional embeddings.
problem Existing INR generative models fail to produce high-quality representations.
method DDMI uses adaptive positional embeddings and a D2C-VAE to enhance expressive power.
result DDMI outperforms existing models across multiple modalities and datasets.
RAD approach models both continuous and discrete data.
problem Flow models struggle with discrete structures in data.
method Domain partitioning with locally invertible functions for real and discrete latent variables.
result RAD approach models both continuous and discrete structures.
We consider generalized linear transient convection-diffusion problems for differential forms on bounded domains in Rn. These involve Lie derivatives with respect to a prescribed smooth vector field. We construct both new Eulerian and semi-Lagrangian approaches to the discretization of the Lie derivatives…
Study identifies and analyzes three types of errors in learning Fourier operators.
problem Statistical, discretization, and truncation errors in learning Fourier operators.
method Analysis of a Discrete Fourier Transform (DFT) based least squares estimator.
result Established upper and lower bounds on statistical, discretization, and truncation errors.
A new method uses Coordinate Descent to optimize ResNet networks for private inference.
problem Reducing ReLU count in ResNet networks for private inference.
method Directly optimizing in the discrete domain using Coordinate Descent.
result Our method yields a sparse solution and is state-of-the-art.
In this paper, we study the discrete Morse flow for the Ricci flow on football, which is the 2-sphere with removed north and south poles and with the metric g0 of constant scalar curvature, and and for Porous media equation on a bounded regular domain in the plane. We show that with a suitable assumption about $g(0)…
Transforms game optimization dynamics into frequency domain for precise hyperparameter analysis.
problem Analyzing convergence of hyperparameters in game optimization.
method Frequency-domain framework using High-Resolution Differential Equations (HRDEs) and Laplace transforms.
result Derives precise convergence criteria for the Lookahead algorithm.
Parameters in deep neural networks which are trained on large-scale databases can generalize across multiple domains, which is referred as "transferability". Unfortunately, the transferability is usually defined as discrete states and it differs with domains and network architectures. Existing works usually heuristical…
The main result of this paper is a construction of fundamental domains for certain group actions on Lorentz manifolds of constant curvature. We consider the simply connected Lie group G~, the universal cover of the group SU(1,1) of orientation-preserving isometries of the hyperbolic plane. The Killing form on the Lie g…