DeepCloud uses machine learning to generate design alternatives without explicit designer input.
problem Designing with explicit specifications limits innovation potential.
method Developed a data-driven generative system combining autoencoder for point clouds and web-based interface.
result DeepCloud learns design alternatives from existing solutions without designer input.
Introduces a new geometric method for optimal experimental design.
problem Restrictive invariance properties of traditional OED approaches based on probability densities.
method Mutual transport dependence (MTD) using optimal transport theory.
result Demonstrates high-quality designs and flexibility compared to standard methods.
Nonparametric two sample testing deals with the question of consistently deciding if two distributions are different, given samples from both, without making any parametric assumptions about the form of the distributions. The current literature is split into two kinds of tests - those which are consistent without any a…
The use of alternative measures to evaluate classifier performance is gaining attention, specially for imbalanced problems. However, the use of these measures in the classifier design process is still unsolved. In this work we propose a classifier designed specifically to optimize one of these alternative measures, nam…
Designs a DNN with alternative-specific utility functions for improved choice analysis.
problem Challenges in reconciling domain-specific knowledge with generic DNN.
method Integrates prior behavioral knowledge into DNN architecture with alternative-specific utility functions.
result 2-3% higher prediction accuracy than fully connected DNN over hyperparameter space.
Revisits PPO design choices, exposing failure modes and proposing alternatives.
problem Failure modes of standard PPO in new environments.
method Revisits standard PPO design choices, exposes failure modes, and proposes alternative approaches.
result Alternative design choices prevent failure modes in new environments.
Alt-GNNs improve travel mode choice modeling by integrating graph neural networks with GEV models.
problem Capturing alternative dependence in discrete choice models with predefined, symmetric, and uniform dependence.
method Introducing Alternative Graph Neural Networks (Alt-GNNs) that embed alternative dependence within a unified framework.
result Alt-GNNs significantly improve predictive performance over benchmark models in travel mode choice datasets.
Private ALS method improves matrix completion with tighter rates and better privacy.
problem Differential privacy in matrix completion for user-level privacy.
method Joint differentially private ALS method with tighter sample complexity and privacy trade-offs.
result Achieves nearly optimal sample complexity and best privacy/utility trade-off.
AIDA designs personalized audio processing algorithms for hearing aids.
problem Improving hearing aid performance based on user feedback.
method Active inference-based agent with Bayesian trial design.
result AIDA proposes optimal alternative values for hearing aid parameters.
DAD learns to design experiments quickly, outperforming traditional methods.
problem Real-time decision-making in sequential Bayesian experimental design.
method Amortized design network trained with contrastive information bounds.
result DAD outperforms alternative strategies on various problems.
The book explores alternatives to worst-case analysis for algorithm performance.
problem Providing strong worst-case guarantees for many algorithms is impossible.
method Surveying and detailing various nuanced analysis approaches.
result More nuanced analysis approaches are needed for fundamental problems.
Contrastive learning simplifies statistical inference for complex models.
problem Computational intractability of likelihood functions for certain models.
method Contrastive learning as an alternative for parameter estimation and inference.
result Contrastive learning enables practical methods for diverse statistical problems.
First-order optimization algorithms have been proven prominent in deep learning. In particular, algorithms such as RMSProp and Adam are extremely popular. However, recent works have pointed out the lack of ``long-term memory" in Adam-like algorithms, which could hamper their performance and lead to divergence. In our s…
Design optimization techniques are often used at the beginning of the design process to explore the space of possible designs. In these domains illumination algorithms, such as MAP-Elites, are promising alternatives to classic optimization algorithms because they produce diverse, high-quality solutions in a single run,…
Paper proposes a new method for efficient hyperparameter optimization.
problem Challenging task of optimizing hyperparameters in machine learning.
method Sequential Uniform Design (SeqUD) strategy for adaptive and efficient exploration of hyperparameter space.
result The proposed SeqUD strategy outperforms existing methods in hyperparameter optimization.
Algorithm reduces audit costs by identifying best service configurations from biased textual evidence.
problem Designing service systems from textual evidence requires accurate selection despite biased automated scoring.
method Developed PP-LUCB algorithm combining LLM scores and selective audits to minimize costs.
result Correctly identified the best model in 40/40 trials with 90% cost reduction.
This paper studies a stylized, yet natural, learning-to-rank problem and points out the critical incorrectness of a widely used nearest neighbor algorithm. We consider a model with n agents (users) {xi}i∈[n] and m alternatives (items) {yj}j∈[m], each of which is associated with a latent feat…
CO-BED optimizes experiments using Bayesian methods and information theory.
problem Optimizing experiments in a context-dependent manner.
method Formalizes contextual optimization with Bayesian experimental design, employing information-theoretic principles and black-box variational methods.
result CO-BED provides a general solution for contextual optimization problems.
BOED improves SBI by optimizing experimental designs and inference functions.
problem Efficiently use experimental resources for better inference on complex models.
method Link mutual information bounds between SBI and BOED, optimizing both design and inference.
result BOED improves inference in real-world simulators in epidemiology and biology.
Automatically designs analog circuits with deep learning.
problem Manual design of analog circuits is time-consuming and error-prone.
method Two-stage network with hypernetwork scheme and differential simulator.
result The method generates efficient and accurate circuit designs.
MCD automates counterfactual design searches for multi-modal tasks.
problem Designing for multi-objective goals and complex constraints.
method Model-agnostic counterfactual search method for multi-modal design modifications.
result MCD streamlines and automates counterfactual search, recommending effective design modifications.
Understanding the evolution of human society, as a complex adaptive system, is a task that has been looked upon from various angles. In this paper, we simulate an agent-based model with a high enough population tractably. To do this, we characterize an entity called \textit{society}, which helps us reduce the complexit…
Paper proposes a machine learning framework for VLSI mask optimization.
problem Costly VLSI mask optimization due to complex processes.
method Heterogeneous OPC framework using machine learning.
result Demonstrates efficiency and effectiveness of the proposed framework.
Symmetric nonnegative matrix factorization (NMF), a special but important class of the general NMF, is demonstrated to be useful for data analysis and in particular for various clustering tasks. Unfortunately, designing fast algorithms for Symmetric NMF is not as easy as for the nonsymmetric counterpart, the latter adm…
We consider solution of stochastic storage problems through regression Monte Carlo (RMC) methods. Taking a statistical learning perspective, we develop the dynamic emulation algorithm (DEA) that unifies the different existing approaches in a single modular template. We then investigate the two central aspects of regres…
Combines Integrated Gradients and PatternAttribution into PGIG, outperforming alternatives.
problem Improving neural network explainability methods.
method Combines Integrated Gradients and PatternAttribution into Pattern-Guided Integrated Gradients (PGIG).
result PGIG outperforms other explainability methods in a large-scale image degradation experiment.
Efficient algorithms for contextual bandits with smooth regret in continuous action spaces.
problem Efficient learning in large or continuous action spaces.
method Smooth regret notion and efficient algorithms for general function approximation.
result Statistically and computationally efficient algorithms for contextual bandits with smooth regret.
New method optimizes experimental design for specific applications.
problem Inability to adapt causal inference methods to specific downstream applications.
method Task-specific experimental design and sampling strategies.
result Significantly reduces data requirements for achieving RCT performance.
Optimizes ASL-MRF scan design for precise brain hemodynamics quantification.
problem Fixing model parameters in ASL introduces bias, and multiparametric estimation degrades precision.
method Optimizes ASL labeling durations using Cramer-Rao Lower Bound (CRLB) and proposes a neural network regression framework.
result Improved precision in estimating multiple hemodynamic parameters from a single scan.
In this note, we point out a basic link between generative adversarial (GA) training and binary classification -- any powerful discriminator essentially computes an (f-)divergence between real and generated samples. The result, repeatedly re-derived in decision theory, has implications for GA Networks (GANs), providing…
New method for factor analysis using nuclear and ℓ0 norms.
problem Finding a low-rank plus sparse decomposition from noisy covariance matrix.
method Formulated an optimization problem with nuclear norm, ℓ0 norm, and KL divergence. Used alternating minimization algorithm. result Algorithm effectively decomposes covariance matrices in synthetic and real datasets.
Efficiently allocate budgets for LLM-assisted virtual screening to reduce costs.
problem Reducing the cost of evaluating alternatives in large-scale screening tasks.
method Propose a top-m greedy evaluation mechanism and the EFG-m algorithm for efficient budget allocation. result Prove that EFG-m is both sample-optimal and consistent in large-scale virtual screening. EHVI outperforms scalarized EI in MOBO for molecule design.
problem Benchmarking MOBO strategies for molecule design.
method Compared EHVI against fixed-weight scalarized EI in MOBO.
result EHVI consistently outperforms scalarized EI in molecular optimization tasks.
The study examines how alternative resource adequacy contract designs affect market participants' risk profiles and resource mix.
problem The tension between promoting reliability and competition in liberalized electricity markets.
method Constructs a stochastic equilibrium model of a competitive market with incomplete risk trading and computes investment equilibria under different contracting regimes.
result Alternative contracting regimes can induce different risk profiles and resource mixes, affecting market outcomes.
This review introduces graph kernels for chemoinformatics.
problem Quantifying similarity between molecular graphs.
method Graph kernels as a method for quantifying molecular graph similarity.
result Graph kernels have direct applications in chemoinformatics.
Optimizes experimental design using synthetic controls for better outcomes.
problem Estimating average treatment effects in studies with pre-treatment data.
method Mixed-integer programming for selecting treated and control units and weights.
result Improves mean squared error and statistical power compared to simple alternatives.
Two Bayesian optimization methods tackle dynamic design spaces with mixed variables.
problem Optimizing complex systems with varying numbers and types of variables and constraints.
method Two Bayesian optimization approaches: budget allocation and kernel function.
result Both methods converge faster and more consistently than standard approaches.
FPGA-based multi-layer equalizer adapts to changing channels.
problem Real-time adaptation to time-varying channel impairments.
method Multi-layer machine learning on FPGA with on-chip gradient backpropagation training.
result Real-time adaptation to changing channel conditions achieved.
Algorithm identifies correct hypothesis from alternatives in bandit problems.
problem Efficiently identifying the correct hypothesis from a finite set of alternatives in structured stochastic multi-armed bandits.
method Frank-Wolfe Self-Play (FWSP) reformulates the game as a saddle-point problem, using a differential-inclusion argument to prove convergence.
result Convergence of the game value for best-arm identification in linear bandits, with uniform global convergence to the optimal value.
New algorithm selects optimal subset for multiclass classifier training.
problem Selecting optimal subset of labeled examples for multiclass classifier training.
method Regret minimization framework with new regularization scheme.
result New method consistently outperforms state-of-the-art approaches.
Adversarial CCA improves representation learning by allowing more flexible priors.
problem Improving representation learning through more flexible priors.
method Adversarial techniques applied to Deep Variational CCA (VCCA and VCCA-Private).
result Adversarial CCA offers stronger and more flexible priors for representation learning.
Action-BED: Task-Driven Bayesian Experimental Design
problem Bayesian experimental design with doubly intractable objectives
method Formulating BED in terms of expected future loss (EFL) and optimising it with stochastic gradients
result Simplified and task-driven framework for BED
BINOCULARS improves experimental design by balancing exploration and exploitation.
problem Efficiently balancing exploration and exploitation in sequential experiments.
method BINOCULARS computes a batch of experiments, then selects a single point to evaluate, avoiding myopic approaches.
result BINOCULARS significantly outperforms myopic alternatives in real-world scenarios.
Sampling one or more effective solutions from large search spaces is a recurring idea in machine learning, and sequential optimization has become a popular solution. Typical examples include data summarization, sample mining for predictive modeling and hyper-parameter optimization. Existing solutions attempt to adaptiv…
In this paper, we study a simple iterative method for finding the Dantzig selector, which was designed for linear regression problems. The method consists of two main stages. The first stage is to approximate the Dantzig selector through a fixed-point formulation of solutions to the Dantzig selector problem. The second…
Estimates effect sizes and power from a pilot experiment.
problem Estimating the distribution of effect sizes in multiple testing settings.
method Uses an inexpensive pilot experiment to estimate effect sizes and power.
result Simple and computationally efficient estimator guarantees the number of discoveries.
User engagement in social networks depends critically on the number of online actions their users take in the network. Can we design an algorithm that finds when to incentivize users to take actions to maximize the overall activity in a social network? In this paper, we model the number of online actions over time usin…
DECAF optimizes molecular graphs for ensemble properties, improving drug design accuracy.
problem Designing molecules with ensemble properties rather than single conformations.
method DECAF uses Boltzmann-expected design with decoupled annealing flows to optimize molecular graphs.
result DECAF optimizes molecular graphs to shift ensemble properties towards targets, improving accuracy over single-conformer methods.