Transforms input design for probabilistic models into optimal control of a Hamiltonian system.
problem Designing inputs for probabilistic models with intractable posterior distributions.
method Representing posterior as Hamiltonian system trajectories, solving optimal control problem.
result Parameter posterior concentrates around true parameter values.
A deep convolutional fuzzy system (DCFS) on a high-dimensional input space is a multi-layer connection of many low-dimensional fuzzy systems, where the input variables to the low-dimensional fuzzy systems are selected through a moving window across the input spaces of the layers. To design the DCFS based on input-outpu…
Aims to optimize complex multivariate systems with constraints.
problem Optimizing force-field systems in physics with large-scale simulations.
method Combines machine learning and experimental design to find feasible input combinations.
result Locates multiple good regions in the input space.
We present a probabilistic modeling framework and adaptive sampling algorithm wherein unsupervised generative models are combined with black box predictive models to tackle the problem of input design. In input design, one is given one or more stochastic "oracle" predictive functions, each of which maps from the input …
Paper shows how to linearize flat systems with two inputs.
problem Linearizing flat nonlinear control systems with two inputs.
method Using prolongations of a control, the system can be made static feedback linearizable.
result A tracking control can be designed without requiring measurements of a generalized Brunovsky state.
In this paper, we propose a method that disentangles the effects of multiple input conditions in Generative Adversarial Networks (GANs). In particular, we demonstrate our method in controlling color, texture, and shape of a generated garment image for computer-aided fashion design. To disentangle the effect of input at…
New BO method optimizes multiple objectives under input noise.
problem Optimizing multiple performance metrics in manufacturing processes subject to random input noise.
method Formalizes optimization of multivariate value-at-risk (MVaR) using random scalarizations.
result Significantly outperforms alternative methods in identifying robust designs.
Safe neural networks for input-output specifications.
problem Ensuring machine learning models adhere to input-output constraints.
method Designing constrained predictors and combining them safely.
result Demonstrated on synthetic and real-world datasets.
A framework for faster, better infographic design by non-experts and experts alike.
problem Designing infographics is time-consuming and tedious for non-experts and even professionals.
method Semi-automated infographic framework for structured and flow-based designs, including automatic design ranking and customization options.
result Designers from all expertise levels can generate generic infographic designs faster than existing methods while maintaining quality.
PAC-MOO optimizes constrained multi-objective problems with preferences.
problem Optimizing with constraints and practitioner preferences over objectives.
method Preference-aware constrained multi-objective Bayesian optimization.
result Efficacy demonstrated on real-world analog circuit design problems.
Estimates extreme probabilities using fewer simulations than Monte Carlo.
problem Estimating tail probabilities of complex systems efficiently.
method Builds a statistical surrogate with few evaluations and sequentially improves the estimate.
result Improves estimation of extreme probabilities with fewer simulations.
Improves Bayesian optimisation for engineering design problems with many variables.
problem Efficiently searching for global minima in high-dimensional design spaces.
method Integrates input and output data to identify a reduced latent subspace using probabilistic partial least squares.
result Significant improvements in convergence to the global minimum compared to existing methods.
DeepCloud uses machine learning to generate design alternatives without explicit designer input.
problem Designing with explicit specifications limits innovation potential.
method Developed a data-driven generative system combining autoencoder for point clouds and web-based interface.
result DeepCloud learns design alternatives from existing solutions without designer input.
We present a new method for design problems wherein the goal is to maximize or specify the value of one or more properties of interest. For example, in protein design, one may wish to find the protein sequence that maximizes fluorescence. We assume access to one or more, potentially black box, stochastic "oracle" predi…
Input-dependent smoothing mitigates classical issues but suffers from the curse of dimensionality.
problem Certifiably robust classifiers with input-dependent smoothing suffer from the curse of dimensionality.
method Proposed a theoretical and practical framework for input-dependent smoothing under strict restrictions.
result Input-dependent smoothing mitigates some classical issues but is limited by the curse of dimensionality.
Fairness is a critical trait in decision making. As machine-learning models are increasingly being used in sensitive application domains (e.g. education and employment) for decision making, it is crucial that the decisions computed by such models are free of unintended bias. But how can we automatically validate the fa…
We extend graph neural networks to transfer performance across different input sizes.
problem Transferability of graph neural networks across varying input dimensions.
method Introduce a general framework for transferability across dimensions, showing it corresponds to continuity in a limit space.
result Transferability of graph neural networks is driven by data and learning task, and can be ensured with design principles.
Paper bypasses backdoor detection algorithms in deep learning models.
problem Adversaries can embed backdoors in deep learning models, making them behave differently on specific inputs.
method Adversarial training algorithm that optimizes original loss function and maximizes hidden representation indistinguishability.
result The paper presents an adversarial backdoor embedding algorithm that can bypass existing detection algorithms.
The paper presents unbiased estimators for random design regression.
problem Bias in least squares solutions for random design regression.
method Volume-rescaled sampling of input points to produce unbiased estimators.
result An unbiased estimator can be constructed with a sample size of O(dlogd + d/ε).
Proposes a framework to fuse heterogeneous data sources for better modeling.
problem Heterogeneous data sources with different input parameter spaces.
method Input mapping calibration (IMC) and latent variable Gaussian process (LVGP).
result Improved predictive accuracy over single source models.
Paper tackles machine performance testing under uncertain inputs.
problem Guarantee machine performance under input uncertainty.
method Formulates as IU-rLSE problem, proposes active learning method.
result Efficient algorithm for reliable level set estimation.
Framework optimizes multiple objectives considering input uncertainty.
problem Efficiently optimizing multiple objectives with input uncertainty.
method Robust Gaussian Process model and two-stage Bayesian optimization process.
result Found a robust Pareto frontier considering input uncertainty.
Generative models learn distributions, new method finds inputs matching desired conditional distributions.
problem Designing inputs that produce specific conditional distributions, not just points.
method Conditional Distribution Matching (CDM) and MLGD-F algorithm.
result MLGD-F reliably recovers inputs matching diverse user-specified conditional distributions.
Adaptive batching improves Gaussian process surrogates for noisy level set estimation.
problem Learning the level set of noisy simulator responses.
method Developed four novel adaptive batching schemes for Gaussian process metamodels.
result Adaptive batching brings significant computational speed-ups with minimal loss of modeling fidelity.
New method selects inputs for Bayesian regression with few samples.
problem Optimal experimental design for high-dimensional inputs.
method Output-weighted optimal sampling using Bayesian regression.
result New criterion considers output values of existing samples.
Unified framework for modeling hierarchical spaces in design problems.
problem Challenges in modeling hierarchical, conditional, heterogeneous, or tree-structured domains.
method Unified framework combining feature modeling and graph theory, introducing meta and partially-decreed variables.
result Demonstrated effectiveness on complex system design problems, including neural networks and green-aircraft.
A new method reduces both input and output dimensions for better goal-oriented analysis.
problem Simultaneous reduction of input and output dimensions for more accurate analysis.
method Coupled input-output dimension reduction, optimizing gradient-based bounds.
result Determine most informative sensors and influential parameters efficiently.
We propose and analyze sequential design methods for the problem of ranking several response surfaces. Namely, given L≥2 response surfaces over a continuous input space X, the aim is to efficiently find the index of the minimal response across the entire X. The response surfaces are not known and ha…
Pantypes improve prototypical models by capturing diverse input distributions.
problem Prototypical models lack sufficient data representation in low density regions.
method Introducing pantypes, a sparse set of diverse objects to represent the full diversity of input distribution.
result Pantypes empower prototypical models to foster high diversity, interpretability, and fairness.
Optimal kernel learning improves GP regression for high-dimensional inputs.
problem High computational costs and low prediction accuracy in GP models with many inputs.
method Approximates GP covariance with a convex combination of kernel functions, identifying active variables.
result Improves prediction accuracy and correctly identifies active input variables.
PenduMAV is a 6-input omnidirectional MAV without internal forces.
problem Designing a MAV without internal forces and structural costs.
method Multibody dynamics derivation, SE(3) control, Lyapunov analysis, Gazebo simulations.
result Asymptotic stabilization of the closed-loop system under parametric uncertainty and actuator noise.
Study learns linear system dynamics from noisy bilinear data.
problem Learning linear dynamics from bilinear observations with process and measurement noise.
method Regression with Kronecker product design, data-dependent and independent error bounds.
result Upper bounds on statistical error rates and sample complexity for learning dynamics matrices.
Jacobian regularization boosts neural network robustness without degrading generalization.
problem Ensuring robustness of machine learning models against input perturbations.
method Developed a computationally efficient Jacobian regularization technique.
result Significant improvements in robustness measured against random and adversarial perturbations.
Bayesian method for estimating inputs leading to specific probability outputs.
problem Estimating inputs for specific probability outputs of uncertain functions.
method Bayesian strategy using Gaussian process modeling and SUR principle.
result Surpassed performance of existing methods through numerical experiments.
This paper investigates the role of sparsity in Reservoir Computing networks.
problem Designing efficient Recurrent Neural Networks (RNNs) with hidden recurrent layers.
method Empirical investigation of sparsity in input-reservoir connections and recurrent connections.
result Sparsity, particularly in input-reservoir connections, enhances the network's temporal memory and dimensionality.
Partial-input models fail to detect dataset artifacts, even when they perform poorly.
problem The effectiveness of partial-input models in detecting dataset artifacts is questionable.
method Design artificial datasets and identify trivial patterns in the SNLI dataset.
result Partial-input models can solve examples previously considered hard, indicating potential dataset artifacts.
Paper proposes active learning for structured output design, improving Gaussian process model predictions.
problem Finding optimal input parameters for achieving desired structured outputs.
method Developed new acquisition functions to minimize prediction error of Gaussian process model, incorporating output correlations.
result Effectiveness demonstrated in synthetic and real data experiments, including materials informatics.
New definitions of ESP for quantum reservoir computing handle non-stationary systems.
problem Traditional ESP does not apply to non-stationary systems.
method Introduce two new categories of ESP: non-stationary ESP and subset/subspace ESP.
result Demonstrates correspondence between non-stationary ESP and QRC with NARMA tasks.
In this article, we consider a stochastic numerical simulator to assess the impact of some factors on a phenomenon. The simulator is seen as a black box with inputs and outputs. The quality of a simulation, hereafter referred to as fidelity, is assumed to be tunable by means of an additional input of the simulator (e.g…
Proposes deep collective learning to learn inputs and weights together in neural networks.
problem The need to optimize inputs alongside weights in deep neural networks.
method Introduces deep collective learning to learn inputs and weights jointly, using lookup tables.
result Demonstrates advantages and promise of Lookup-VNets and deep collective learning.
An intriguing property of deep neural networks is their inherent vulnerability to adversarial inputs, which significantly hinders their application in security-critical domains. Most existing detection methods attempt to use carefully engineered patterns to distinguish adversarial inputs from their genuine counterparts…
Interview study reveals considerations for designing semi-automated bias detection tools.
problem Detecting and mitigating machine learning biases.
method Interview study with 11 machine learning practitioners.
result Four considerations identified for tool design.
Machine learning is vulnerable to adversarial examples: inputs carefully modified to force misclassification. Designing defenses against such inputs remains largely an open problem. In this work, we revisit defensive distillation---which is one of the mechanisms proposed to mitigate adversarial examples---to address it…
The paper explains DNNs by quantifying interactions among input variables.
problem Understanding and explaining the complex behavior of deep neural networks.
method The paper defines and quantifies the significance of interactions among multiple input variables using the Shapley value.
result The proposed method effectively explains the behavior of DNNs by assigning attribution values to input variables.
The paper tackles system identification via Hankel nuclear norm regularization, improving estimation rates and singular value gaps.
problem Identifying low-order linear systems from limited data.
method Hankel nuclear norm regularization to encourage low-rankness of the Hankel matrix.
result Hankel regularization enables optimal system recovery with fewer observations and better estimation rates.
Optimizes sampling for faster convergence in Bayesian experimental design and uncertainty quantification.
problem Efficiently selecting samples for faster convergence in Bayesian experimental design and uncertainty quantification.
method Output-weighted acquisition functions leveraging likelihood ratio to guide sampling towards relevant regions.
result Superiority of the proposed method in uncertainty quantification and rare event identification.
NES improves robust optimization with noisy inputs.
problem Finding robust optima in problems with input and measurement noise.
method Noisy-Input Entropy Search (NES) acquisition function based on Gaussian process modeling.
result NES reliably finds robust optima, outperforming existing methods.
MINs learn inverse mappings for high-dimensional optimization problems.
problem Data-driven optimization with high-dimensional inputs and valid subsets.
method Model Inversion Networks (MINs) learn an inverse mapping from scores to inputs.
result MINs can scale to high-dimensional input spaces and handle both offline and active data.