Physics-constrained GANs generate samples that meet deterministic constraints.
problem Ensuring GAN-generated samples comply with physical constraints.
method Enforce deterministic constraints via modified loss function.
result Physics-constrained GANs produce samples that accurately meet underlying constraints.
Holistic GLMs add constraints for better model quality.
problem Improving classical linear regression models.
method Sparsity-inducing, sign-coherence, and linear constraints.
result Holistic GLMs reliably solve GLMs for various responses.
New framework improves generative models with prediction and consistency constraints.
problem Improving generative models with sparse labeled data.
method Optimizes variational autoencoders with prediction and consistency constraints.
result Promising image classification performance, especially in semi-supervised scenarios.
Generative classifiers' properties are linked to linear constraints.
problem Understanding the Markov property in generative classifiers.
method Characterization of discrimination functions using linear constraints and a second order finite difference operator.
result Discrimination functions of undirected Markov network classifiers are characterized by sets of linear constraints.
Paper expands PR to learn constraints for diverse DGMs.
problem Difficult to incorporate structured domain knowledge with DGMs.
method Established mathematical correspondence between PR and RL, and expanded PR to learn constraints as extrinsic reward in RL.
result Models with learned knowledge constraints greatly improve over base generative models.
Improves classifier fairness and other constraints by optimizing on two datasets.
problem Training classifiers to satisfy fairness and other data-dependent constraints.
method Two-player game framework, optimizing on two independent datasets.
result Significant improvement in constraint satisfaction at evaluation time.
We propose a general method for deformation quantization of any second-class constrained system on a symplectic manifold. The constraints determining an arbitrary constraint surface are in general defined only locally and can be components of a section of a non-trivial vector bundle over the phase-space manifold. The c…
The paper defines constraints for commuting endomorphisms in generalized tangent bundles.
problem Identifying constraints for commuting endomorphisms in generalized tangent bundles.
method Using Gröbner basis techniques to construct and study tensors forming ideals.
result Explicit construction and study of tensors forming ideals of commuting endomorphisms.
CANs improve GANs by enforcing structured constraints during training.
problem Generating valid structured objects like molecules and game maps from examples alone.
method Constrained Adversarial Networks (CANs) embed constraints into the model during training, penalizing invalid structures.
result CANs efficiently generate high-quality and novel valid structures.
Proposes a method to generate text that adheres to logical constraints.
problem Generating text that respects logical constraints is hard for autoregressive models.
method Bayesian conditioning to draw samples subject to a constraint, considering the entire sequence and inducing a local, factorized distribution.
result Our approach generates samples that closely approximate the target distribution and are guaranteed to satisfy the constraints.
The paper classifies constraint mappings in optimization problems.
problem Understanding generic behavior of constraint functions in optimization.
method Using singularity theory of smooth mappings and subgroup classification.
result Families of constraint mappings are a residual set with at most 4 parameters.
New algorithm clusters data and learns kernels without relaxing constraints.
problem Learning kernels or distance metrics from pairwise constraints without losing generalization.
method Joint clustering and kernel learning without relaxing constraints.
result Outperforms existing approaches on diverse datasets.
New algorithm reduces regret and constraint violation in online convex optimization with complex constraints.
problem Online convex optimization with multiple functional constraints and a simple constraint set.
method Instance-dependent bound using online primal-dual mirror-prox algorithm in general normed spaces.
result Achieves an O(√V*(T)) regret and O(1) constraint violation, improving over previous works.
We provide a dynamic programming principle for stochastic optimal control problems with expectation constraints. A weak formulation, using test functions and a probabilistic relaxation of the constraint, avoids restrictions related to a measurable selection but still implies the Hamilton-Jacobi-Bellman equation in the …
Reduces Lie (bi-)algebroids and Dirac manifolds using constraint vector bundles.
problem Reduction of Lie (bi-)algebroids and Dirac manifolds.
method Introduces constraint manifolds and constraint vector bundles; proves constraint Serre-Swan theorem; introduces Cartan calculus for constraint forms and multivector fields; shows compatibility with reduction.
result Reduction procedure for Lie (bi-)algebroids and Dirac manifolds.
Study integrates reliability constraints into generation planning models.
problem Challenges in integrating reliability constraints with generation planning models.
method Leverages a weighted oblique decision tree (WODT) technique to embed reliability verification constraints.
result Demonstrates effectiveness in achieving reliable and optimal planning solutions.
Chance-constrained ActInf allows for small violations of constraints to drive goal-directed behavior.
problem Goal-directed behavior constrained by prior beliefs.
method Introducing chance constraints to ActInf, allowing for small violations of constraints.
result Chance-constrained ActInf allows for a trade-off between robust control and chance constraint violation.
This work is a further study on the Generalized Constraint Neural Network (GCNN) model [1], [2]. Two challenges are encountered in the study, that is, to embed any type of prior information and to select its imposing schemes. The work focuses on the second challenge and studies a new constraint imposing scheme for equa…
Paper doubles Hessian estimates for special Lagrangian equation with constraints.
problem Estimating Hessian for special Lagrangian equation under general phase constraints.
method Doubling argument, Alexandrov-type theorems.
result Established Hessian estimates for special Lagrangian equation.
Combines deep learning and logic constraints for visual generation.
problem Generating images with specific properties using deep learning and logic constraints.
method Formulates visual generation as a constrained satisfaction problem, using deep architectures to model variables and t-norm theory for logic variables.
result Promising results in generating handwritten characters and face transformations.
Proves generic nondegeneracy for solutions under volume constraint in closed manifolds.
problem Proving nondegeneracy for solutions of the Van der Waals-Allen-Cahn-Hilliard equation.
method Adapting techniques from previous research to prove nondegeneracy.
result Generic nondegeneracy for solutions of the Van der Waals-Allen-Cahn-Hilliard equation under a volume constraint in closed manifolds.
Generative models often misrepresent class frequencies; this paper calibrates them.
problem Miscalibration of class frequencies in generative models.
method Formulated as constrained optimization, using surrogate objectives to approximate constraints.
result Significant reduction in calibration error across various models and applications.
A new algorithm tackles submodular bandit problems with multiple constraints.
problem Addressing diversified retrieval and online learning with budget constraints.
method Non-greedy algorithm focusing on upper-confidence bounds.
result High-probability upper bound of an approximation regret matching fast offline algorithm's ratio.
New algorithm tackles optimization with distributed constraints.
problem Optimization problems with generalized orthogonality constraints in a decentralized setting.
method Introduced a novel algorithm that tracks gradients and Jacobians simultaneously.
result Global convergence with an iteration complexity established.
Recent work on Bayesian optimization has shown its effectiveness in global optimization of difficult black-box objective functions. Many real-world optimization problems of interest also have constraints which are unknown a priori. In this paper, we study Bayesian optimization for constrained problems in the general ca…
We present an objective function for learning with unlabeled data that utilizes auxiliary expectation constraints. We optimize this objective function using a procedure that alternates between information and moment projections. Our method provides an alternate interpretation of the posterior regularization framework (…
Study uses machine learning to optimize power generation in electrical grids.
problem Optimizing power generation in electrical grids while respecting physical and engineering constraints.
method Two formulations of ACOPF as machine learning problems: direct prediction and constraint prediction.
result Validated machine learning approaches on two benchmark grids.
Unified clustering model handles both pairwise and cardinality constraints for better performance.
problem Clustering with specific constraints (pairwise and cardinality) to improve clustering quality.
method Unified integer programming formulation, binary and quadratic constraints, reformulated as continuous constraints, solved using ADMM.
result Unified model outperforms single category constraints and achieves better clustering performance.
A new ML method teaches constraints directly to models.
problem Addressing safety and fairness in AI systems.
method Directly teaching constraint satisfaction to ML models using a constraint solver.
result Empirically, our approach performs well on fairness and synthetic constraints.
Constraint-aware neural networks improve accuracy in fluid flow simulations.
problem Ensuring physical constraints in neural network simulations for fluid dynamics.
method Two strategies to create constraint-aware neural networks for Riemann problems.
result Decrease in constraint deviation correlates with low discretization errors.
Dropout improves GAN outputs by preserving input constraints.
problem Generating multiple outputs from one input.
method Using Dropout in GANs to maintain input constraints.
result Enhanced generation of diverse outputs from a single input.
This paper considers online convex optimization (OCO) with stochastic constraints, which generalizes Zinkevich's OCO over a known simple fixed set by introducing multiple stochastic functional constraints that are i.i.d. generated at each round and are disclosed to the decision maker only after the decision is made. Th…
Unified approach adjusts classifiers to meet system-level constraints.
problem Multi-class classification under system-level constraints.
method Post-processing approach using linearly constrained stochastic program and entropic regularization.
result Finite-sample guarantees for risk and constraint satisfaction.
We suggest ways to enforce given constraints in the output of a Generative Adversarial Network (GAN) generator both for interpolation and extrapolation (prediction). For the case of dynamical systems, given a time series, we wish to train GAN generators that can be used to predict trajectories starting from a given ini…
Deep generative neural networks have proven effective at both conditional and unconditional modeling of complex data distributions. Conditional generation enables interactive control, but creating new controls often requires expensive retraining. In this paper, we develop a method to condition generation without retrai…
The paper trains neural networks with robustness guarantees using semidefinite constraints.
problem Training neural networks with robustness and stability guarantees.
method Exploiting the banded structure of semidefinite constraints, an efficient and scalable training scheme based on interior point methods is set up.
result The method allows for enforcing Lipschitz constraints in large-scale deep neural networks, as demonstrated in numerical examples.
This paper considers online convex optimization over a complicated constraint set, which typically consists of multiple functional constraints and a set constraint. The conventional online projection algorithm (Zinkevich, 2003) can be difficult to implement due to the potentially high computation complexity of the proj…
Paper tackles online DR-submodular maximization with stochastic constraints.
problem Maximizing utility while adhering to a cumulative resource constraint in an online setting.
method Proposes OLFW algorithm to solve the problem of online continuous DR-submodular maximization with linear stochastic constraints.
result Obtains sub-linear regret and constraint violation bounds.
HardCoRe-NAS finds fitting neural networks adhering to hard resource constraints.
problem Finding fitting neural networks that adhere to hard resource constraints.
method Accurate formulation of resource requirement and scalable search method.
result HardCoRe-NAS generates state-of-the-art architectures strictly satisfying hard resource constraints.
Estimation in generalized linear models (GLM) is complicated by the presence of constraints. One can handle constraints by maximizing a penalized log-likelihood. Penalties such as the lasso are effective in high dimensions, but often lead to unwanted shrinkage. This paper explores instead penalizing the squared distanc…
New approach tackles resource constraints in bandit problems with weakly adaptive algorithms.
problem Maximizing rewards while adhering to general long-term constraints.
method Weakly adaptive primal and dual regret minimizers.
result Achieves sublinear constraints violations and competitive ratios in both stochastic and adversarial settings.
Study of motion constraints and path-following on 3D space.
problem Path-following with non-holonomic constraints on R3. method Exploration of geometric structure and construction of guiding vector fields.
result General principles for constructing guiding vector fields for path-following.
In this study, it is generalized the concept of Lagrangian mechanics with constraints to complex case. To be beginning, it is considered a Kaehlerian manifold as a velocity-phase space. Then a non-holonomic constraint is given by 1-form on it. If the form is closed, it is found that the constraint is (locally) holonomi…
Develops integrators for nonholonomic systems on Lie groups.
problem Nonholonomic constraints on Lie groups.
method Using retraction maps and Hamel formulation.
result Structure-preserving numerical integrators for nonholonomic systems.
The paper introduces MU for NMF with β-divergences and disjoint constraints.
problem Nonnegative matrix factorization with constraints.
method Design multiplicative updates for NMF based on β-divergences with disjoint constraints. result Multiplicative updates satisfy constraints and decrease the objective function.
New neural network smoothness constraints improve model performance.
problem Improving model sensitivity to input changes for better generalization and robustness.
method Exploring current smoothness constraints and proposing new flexible definitions.
result Current smoothness constraints lack flexibility and understanding of data, tasks, and learning.
Proposes methods to add constraints to neural networks to improve stability and generalization.
problem Improving stability and generalization of neural networks.
method Constraint-based regularization using stochastic gradient Langevin dynamics.
result Constraints help stabilize and improve the robustness of deep neural networks.
We study mechanical systems subject to constraint functions that can be dependent at some points and independent at the rest. Such systems are modelled by means of generalized codistributions. We discuss how the constraint force can transmit an impulse to the motion at the points of dependence and derive an explicit fo…