New algorithms for sampling in constrained domains without learning rates.
problem Sampling in constrained domains with fairness constraints and post-selection inference.
method Coin betting ideas from convex optimisation and a unifying framework for constrained sampling.
result Our algorithms achieve competitive performance without hyperparameter tuning.
Develops a theory to make learning solutions fair and safe.
problem Ensuring learning solutions are unbiased and safe in critical applications.
method Generates a generalization theory based on PAC learning framework, introduces constrained learning algorithm.
result Proves that constrained learning is as learnable as unconstrained learning, provides practical algorithm.
The paper classifies a special family of knots in lens spaces using knot Floer homology.
problem Classifying constrained knots in lens spaces.
method Parameterization by five integers, characterization via spinc structures, and knot Floer homology calculations. result Complete classification of constrained knots based on knot Floer homology.
This article reviews and explains HMC-based methods for sampling constrained continuous distributions.
problem Sampling from continuous distributions with constraints.
method HMC and related methods for constrained sampling.
result HMC and related methods are more efficient for constrained sampling.
A cardinality-constrained portfolio caps the number of stocks to be traded across and within groups or sectors. These limitations arise from real-world scenarios faced by fund managers, who are constrained by transaction costs and client preferences as they seek to maximize return and limit risk. We develop a new appro…
Tensor networks constrain kernel machines to Gaussian processes.
problem Speeding up kernel machines with reduced model complexity.
method Proving CPD and TT-constrained models recover Gaussian processes with i.i.d. priors.
result TT-constrained models exhibit more Gaussian process behavior than CPD for the same parameters.
Extends GENO framework for GPU optimization of constrained ML problems.
problem Constrained optimization in classical machine learning.
method Extends GENO framework to GPU optimization, specifying problems in a modeling language.
result Solvers on GPU outperform state-of-the-art approaches by several orders of magnitude.
Constrained adaptive filtering algorithms inculding constrained least mean square (CLMS), constrained affine projection (CAP) and constrained recursive least squares (CRLS) have been extensively studied in many applications. Most existing constrained adaptive filtering algorithms are developed under mean square error (…
Paper proves unique energy-minimizing curves in constrained spaces.
problem Uniqueness of energy-minimizing curves in constrained spaces.
method Investigated energy-minimizing curves with fixed endpoints in a constrained space.
result Proved that the set of points for which the energy-minimizing curve is not unique has no interior points.
Algorithm tackles constrained reinforcement learning with concave-convex and knapsack constraints.
problem Constrained episodic reinforcement learning with concave rewards and convex constraints.
method Modular analysis with strong theoretical guarantees for concave-convex and knapsack settings.
result Significantly outperforms existing approaches in constrained episodic environments.
Energy quantization for surfaces with area, volume, and mean curvature constraints.
problem Energy quantization for constrained Willmore surfaces.
method Established through strong compactness under energy thresholds.
result Strong compactness of constrained Willmore surfaces, including minimizers.
The class of non-rigid registration methods proposed in the framework of PDE-constrained Large Deformation Diffeomorphic Metric Mapping is a particularly interesting family of physically meaningful diffeomorphic registration methods. PDE-constrained LDDMM methods are formulated as constrained variational problems, wher…
A new method solves complex constrained minimax problems.
problem Solving constrained minimax optimization problems.
method First-order augmented Lagrangian method.
result Established an operation complexity of O(ε−4logε−1). Proposes r2SGLD for efficient constrained exploration in non-convex learning.
problem Stagnation in high-temperature chains of reSGLD in distribution tails.
method r2SGLD: replica exchange with reflection steps in a bounded domain.
result Reflection steps enhance mixing rates with quadratic improvement in domain diameter.
The area of constrained clustering has been extensively explored by researchers and used by practitioners. Constrained clustering formulations exist for popular algorithms such as k-means, mixture models, and spectral clustering but have several limitations. A fundamental strength of deep learning is its flexibility, a…
We describe dimensionally constrained symbolic regression which has been developed for mass measurement in certain classes of events in high-energy physics (HEP). With symbolic regression, we can derive equations that are well known in HEP. However, in problems with large number of variables, we find that by constraini…
The paper optimizes policies constrained to Schur stabilizing controllers using a Newton-type algorithm.
problem Optimizing policies under linear constraints in control systems.
method Newton-type algorithm on a manifold of Schur stabilizing controllers with a Riemannian metric.
result Local convergence guarantees for the Newton-type algorithm without relying on exponential mapping or retractions.
Algorithm optimizes constrained reinforcement learning with dual variables.
problem Minimizing convex functional subject to convex constraint in large state spaces.
method VPDPO algorithm using Lagrangian and Fenchel duality.
result Achieves sublinear regret and constraint violation, globally optimal policy.
We show that the homogeneous and the 2-lobe Delaunay tori in the 3-sphere provide the only isothermic constrained Willmore tori in 3-space with Willmore energy below 8π. In particular, every constrained Willmore torus with Willmore energy below 8π and non-rectangular conformal class is non-degenerated.
Constrained Willmore surfaces are critical points of the Willmore functional under conformal variations. As shown in [5] one can associate to any conformally immersed constrained Willmore torus f a compact Riemann surface Σ, such that f can be reconstructed in terms of algebraic data on Σ. Particularly interesting exam…
Study of large area-constrained Willmore surfaces in Schwarzschild-like manifolds.
problem Understanding Willmore surfaces in asymptotically Schwarzschild 3-manifolds.
method Application of Lyapunov-Schmidt reduction method.
result End of the manifold is foliated by area-constrained Willmore spheres.
New method solves constrained optimization problems efficiently.
problem Equality-constrained nonlinear, nonconvex optimization problems.
method Adaptive inexact Newton method with randomized iterative sketching.
result Global almost sure convergence and local linear/superlinear convergence.
A new method for optimizing non-decomposable metrics with constraints.
problem Optimizing complex machine learning objectives with thresholded constraints.
method Formulate rate-constrained optimization using the Implicit Function theorem and solve with gradient-based methods.
result Demonstrated effectiveness over existing methods on benchmark datasets.
Constrained Willmore surfaces are conformal immersions of Riemann surfaces that are critical points of the Willmore energy W=∫H2 under compactly supported infinitesimal conformal variations. Examples include all constant mean curvature surfaces in space forms. In this paper we investigate more generally the crit…
Constrained sequence codes have been widely used in modern communication and data storage systems. Sequences encoded with constrained sequence codes satisfy constraints imposed by the physical channel, hence enabling efficient and reliable transmission of coded symbols. Traditional encoding and decoding of constrained …
The paper proves geometric inequalities in sphere using locally constrained flows.
problem Deriving geometric inequalities in sphere.
method Established the longtime existence and convergence of a locally constrained flow.
result Proved new families of three-term geometric inequalities in sphere.
Self-distillation improves constrained language generation by aligning models with target distributions.
problem Sparse and uninformative reward signals in constrained generation settings.
method Iteratively refining the base model through self-distillation, incorporating learned twist functions and proposals.
result Substantial gains in generation quality through improved model alignment with target distributions.
We call a Morse function f on a closed manifold k-constrained if neither f nor −f has critical points of indefinite Morse index <k. In this paper we study bordism groups of k-constrained Morse functions, and thus interpolate between the case k=1 of bordism groups of Morse functions (computed by Ikegami…
In this paper we consider two special classes of constrained Willmore tori in the 3-sphere. The first class is given by the rotation of closed elastic curves in the upper half plane - viewed as the hyperbolic plane - around the x-axis. The second is given as the preimage of closed constrained elastic curves, i.e., elas…
Paper uses RL to solve constrained combinatorial optimization problems.
problem Constrained combinatorial optimization problems.
method Extending NCO theory to CMDPs, using RL with penalty signals.
result Proposes a superior method for solving constrained problems.
The (constrained) minimization of a ratio of set functions is a problem frequently occurring in clustering and community detection. As these optimization problems are typically NP-hard, one uses convex or spectral relaxations in practice. While these relaxations can be solved globally optimally, they are often too loos…
New method tackles constrained optimization in multi-fidelity Bayesian optimization.
problem Efficiently identifying feasible regions in constrained optimization problems.
method Proposes CMFBO method with novel acquisition functions.
result Demonstrates effectiveness on synthetic problems and real-world ICF and joint design problems.
The paper develops methods for time-varying constrained online convex optimization.
problem Time-varying loss and constraint functions in online convex optimization.
method Model-based augmented Lagrangian methods (MALM) for time-varying and delayed feedback.
result Sublinear regret and constraint violation for both time-varying and delayed feedback scenarios.
Proposes a Gaussian process model for constrained dynamics learning.
problem Challenges in identifying constrained dynamics of mechanical systems.
method Combines analytical mechanics with Gaussian process regression.
result Improves data efficiency and constraint integrity in predictions.
DE-PSGLD samples from constrained distributions in a decentralized manner.
problem Sampling from log-concave distributions with constraints.
method Decentralized Proximal Stochastic Gradient Langevin Dynamics with proximal regularization.
result DE-PSGLD converges to a regularized Gibbs distribution and maintains posterior concentration.
VaR-CPO optimizes VaR-constrained RL problems with conservative policy updates.
problem Optimizing VaR-constrained reinforcement learning problems.
method Combines Cantelli's inequality and trust-region framework for efficient and conservative optimization.
result Achieves zero constraint violations during training in feasible environments.
Some recent studies have suggested using GANs for numeric data generation such as to generate data for completing the imbalanced numeric data. Considering the significant difference between the dimensions of the numeric data and images, as well as the strong correlations between features of numeric data, the convention…
Generalizes momentum map to Courant algebroid for constrained mechanics.
problem Generalizing momentum map to new geometric structures.
method Generalized momentum section on Lie algebroid to Courant algebroid, constructed cohomological formulations.
result Identified momentum section in constrained Hamiltonian mechanics with Courant algebroid symmetry.
New method for constrained sampling using gradient flows.
problem Sampling from constrained domains.
method Introducing a boundary condition for gradient flow to confine particles within the domain.
result Provable continuous-time convergence in total variation for constrained sampling.
We derive an interpolation version of constrained matrix Li-Yau-Hamilton estimate on Kähler manifolds. As a result, we first get a constrained matrix Li-Yau-Hamilton estimate for heat equation on a Kähler manifold with fixed Kähler metric. Secondly, we get a corresponding estimate for forward conjugate heat equation on…
New algorithms for constrained online optimization with memory and predictions.
problem Control of constrained dynamical systems and scheduling with reconfiguration budgets.
method Proposed algorithms achieving sublinear regret and constraint violation under time-varying constraints, both with and without predictions.
result First algorithms achieving sublinear regret and constraint violation in constrained online optimization with memory.
New adaptive methods for constrained convex optimization and variational inequalities.
problem Optimization of constrained convex problems and variational inequalities.
method AdaACSA and AdaAGD+ are accelerated methods that achieve nearly-optimal convergence rates for smooth and non-smooth functions.
result Achieve nearly-optimal convergence rates for both smooth and non-smooth functions, even with stochastic gradients.
New model generates data on constrained sets without losing tractability.
problem Generating data on constrained sets without losing tractability.
method Mirror Diffusion Models (MDM) learn diffusion processes in a dual space constructed from a mirror map.
result MDM generates data on convex constrained sets without losing tractability.
KL-constrained API shows optimization issues and improved with regularization.
problem Optimization issues in KL-constrained API algorithms.
method Comparison of KL divergence as a constraint vs. regularizer, empirical evaluation.
result KL-constrained API is not guaranteed to converge and incurs linear regret.
LCBO tackles constrained optimization in high dimensions, offering a polynomial convergence rate.
problem Bayesian optimization for high-dimensional constrained problems.
method LCBO uses local descent and uncertainty-driven exploration, proving polynomial convergence rate.
result LCBO achieves a polynomial convergence rate for KKT residuals in high dimensions.
The purpose of this paper is describe Lagrangian Mechanics for constrained systems on Lie algebroids, a natural framework which covers a wide range of situations (systems on Lie groups, quotients by the action of a Lie group, standard tangent bundles...). In particular, we are interested in two cases: singular Lagrangi…
New method optimizes costly evaluations in Bayesian optimization.
problem Costly evaluations in BO methods, especially in hyperparameter tuning.
method Formulated as a CMDP, developed rollout approximation for optimal policy.
result Improved cost efficiency over standard BO methods.
CoMPNetX uses neural networks to efficiently solve constrained motion planning problems.
problem Finding collision-free paths on constraint manifolds efficiently.
method Neural generator and discriminator with neural gradients-based projection operator.
result CoMPNetX finds path solutions with high success rates and lower computation times.