Improved learning from multiple experiments with cost constraints.
problem Learning from multiple experiments with cost constraints.
method Rademacher complexity approach to show gap between training and generalization error.
result The gap between training and generalization error is O(C−1/2). Automated PDE discovery from multiple noisy experiments.
problem Inherent variability in experiments makes single experiment inference unreliable.
method Randomised adaptive group Lasso sparsity estimator in deep learning framework.
result More generalizable PDEs found from multiple datasets.
Bayesian Experience Reuse improves learning from multiple experts.
problem Learning from multiple experts with conflicting goals.
method Bayesian neural networks with shared features to model uncertainty and derive a probability distribution over expert models.
result BERS method effectively samples demonstrations from the derived distribution to reuse them in new tasks.
Method scales up ML science by measuring multiple molecules at once.
problem Scaling up ML-driven science with wet lab experiments.
method Neural extension of compressed sensing for function space.
result Proves orders-of-magnitude gains in information density.
Proposes a method to estimate and infer networks from multiple high-dimensional point processes.
problem Estimating and inferring networks from multiple high-dimensional point processes with shared and unique structures.
method Joint estimation procedure for networks of high-dimensional point processes incorporating weights to encourage similarity.
result Powerful hierarchical multiple testing procedure for edges of all estimated networks, controlling family-wise error rate.
Estimates effect sizes and power from a pilot experiment.
problem Estimating the distribution of effect sizes in multiple testing settings.
method Uses an inexpensive pilot experiment to estimate effect sizes and power.
result Simple and computationally efficient estimator guarantees the number of discoveries.
Extends uplift modeling for multiple cost treatments.
problem Optimizing interventions with multiple treatment groups and varying costs.
method Extended standard uplift models to support multiple treatment groups with different costs.
result Improved performance of models in synthetic and real data.
Paper introduces a Bayesian nonparametric approach for tracking multiple objects with spawning events.
problem Tracking multiple objects with birth and death events (spawning).
method Bayesian nonparametric approach with MCMC sampling for unknown number of objects.
result Advantages of nonparametric modeling for scenarios with spawning events.
The paper tackles off-policy learning from multiple loggers.
problem Learning policies from multiple historical logs in real-world applications.
method Uses counterfactual estimators to learn policies from multi-logger data, analyzes generalization error, and introduces a constrained optimization problem.
result The proposed methods achieve better performance than state-of-the-arts.
Paper proposes PRR network for better experience reuse in reinforcement learning.
problem Efficient experience reuse in reinforcement learning across multiple granularities.
method Proposes PRR network trained on multi-level architecture to extract and store experience.
result PRR network leads to better experience reuse and improved performance.
Translating potential disease biomarkers between multi-species 'omics' experiments is a new direction in biomedical research. The existing methods are limited to simple experimental setups such as basic healthy-diseased comparisons. Most of these methods also require an a priori matching of the variables (e.g., genes o…
Recurrent Neural Networks (RNNs) have long been recognized for their potential to model complex time series. However, it remains to be determined what optimization techniques and recurrent architectures can be used to best realize this potential. The experiments presented take a deep look into Hessian free optimization…
BoTier optimizes experiments by balancing multiple objectives hierarchically.
problem Balancing multiple competing objectives in scientific experiments.
method Composite objective that flexibly represents a hierarchy of preferences over outcomes and parameters.
result Demonstrates robust applicability across various use cases and seamless integration.
New algorithms control FDX while achieving more power in online multiple testing.
problem Problems with previous online multiple testing methods, including high FDX and low power.
method Developed new dynamic algorithms that adjust testing levels based on accumulated wealth.
result SupLORD algorithm achieves higher power and FDR control in synthetic experiments.
Algorithm learns from multiple tasks to improve few-shot learning accuracy.
problem Few-shot learning accuracy in transfer learning.
method Variational Bayes neural networks for accumulating knowledge across tasks.
result 74.5% accuracy on 5-shot learning in Mini-Imagenet, new state of the art.
New findings show single-treatment effects are unidentifiable in factorial experiments.
problem Identifying the effect of a single intervention in factorial experiments.
method Formalized sufficient conditions for the identifiability of single-treatment effects and developed nonparametric sharp bounds.
result Researchers must justify assumptions for extrapolating single-treatment effects.
New methods detect targets from imprecisely labeled hyperspectral data.
problem Challenges in acquiring labeled hyperspectral data.
method Multi-Target MI-ACE and MI-SMF methods that learn target signatures from imprecisely labeled samples.
result Effective at learning target signatures and performing target detection.
Recent research on multiple kernel learning has lead to a number of approaches for combining kernels in regularized risk minimization. The proposed approaches include different formulations of objectives and varying regularization strategies. In this paper we present a unifying general optimization criterion for multip…
Bayesian model ranks treatments in multi-response experiments.
problem Identifying the best treatment among competing ideal properties.
method Bayesian approach with Markov Chain Monte Carlo algorithm.
result Reliable inference of treatment ranks in practice.
SynthBH uses synthetic data to control FDR in multiple testing.
problem Controlling false discovery rate in multiple hypothesis testing.
method SynthBH, a synthetic-powered multiple testing procedure.
result SynthBH guarantees FDR control with synthetic data.
CausalRegNet generates accurate data for gene perturbation experiments, improving CSL methods.
problem Assessing and selecting causal structure learning methods in gene perturbation experiments.
method CausalRegNet, a multiplicative effect structural causal model, generates accurate observational and interventional data.
result CausalRegNet generates more accurate distributions and scales better than current simulation frameworks.
New fair regression method improves fairness in chronic kidney disease classification.
problem Mitigating societal bias in health care for multiple groups.
method Penalized fair regression framework for multiple groups, with penalties for true positive rate disparity.
result Achieves fairness-accuracy frontier beyond existing methods in simulations and real-world data.
The statistical comparison of multiple algorithms over multiple data sets is fundamental in machine learning. This is typically carried out by the Friedman test. When the Friedman test rejects the null hypothesis, multiple comparisons are carried out to establish which are the significant differences among algorithms. …
MCP learns reusable skills for complex tasks by combining simple ones.
problem Learning complex tasks with many skills requires impractical amounts of data.
method Factorizes skills into primitives that can be combined multiplicatively.
result MCP can learn and reuse skills for novel tasks from pre-training.
Can we manipulate multiple deep neural networks simultaneously?
problem Selective fooling of multiple machine learning systems.
method Formulated as a novel optimization problem.
result It is easy to selectively manipulate multiple MNIST classifiers simultaneously.
SimpleMKKM improves multi-kernel clustering efficiency.
problem Efficient multi-kernel clustering.
method Re-formulated minimization-maximization problem into a smooth minimization, solved with gradient descent.
result Outperforms state-of-the-art multi-kernel clustering alternatives.
Framework for generating multiple clusterings from multi-view data.
problem Challenges in finding optimal clustering criteria and handling incomplete multi-view data.
method DiMVMC framework that optimizes multiple decoder deep networks to complete data views and generate shared representations.
result DiMVMC outperforms state-of-the-art competitors in generating multiple clusterings with high diversity and quality.
Learning linear combinations of multiple kernels is an appealing strategy when the right choice of features is unknown. Previous approaches to multiple kernel learning (MKL) promote sparse kernel combinations to support interpretability and scalability. Unfortunately, this 1-norm MKL is rarely observed to outperform tr…
Introduces Rashomon Capacity to measure predictive multiplicity in probabilistic classifiers.
problem Predictive multiplicity in classification models leading to unjustified decisions.
method Introduces Rashomon Capacity, a metric for probabilistic classifiers, and provides a rigorous derivation.
result Rashomon Capacity captures nuanced score variations and provides strategies for disclosing conflicting models.
Study shows algorithms benefit from limited target data with many source domains.
problem Adapting to new domains with scarce labeled target data.
method New family of model selection algorithms.
result Beneficial guarantees in scenarios with limited target data.
We present a domain-general account of causation that applies to settings in which macro-level causal relations between two systems are of interest, but the relevant causal features are poorly understood and have to be aggregated from vast arrays of micro-measurements. Our approach generalizes that of Chalupka et al. (…
The paper clusters hypergraphs to find diverse and experienced groups based on past experiences.
problem Finding diverse and experienced groups with respect to past experiences.
method Regularized edge-based hypergraph clustering objective with a 2-approximation algorithm.
result Demonstrates an efficient 2-approximation algorithm for clustering hypergraphs.
Kernel and Multiple Kernel Canonical Correlation Analysis (CCA) are employed to classify schizophrenic and healthy patients based on their SNPs, DNA Methylation and fMRI data. Kernel and Multiple Kernel CCA are popular methods for finding nonlinear correlations between high-dimensional datasets. Data was gathered from …
New sampling-based approach for filtering problems using multiplicative Gaussian functions.
problem Approximate inference in filtering problems.
method Approximates distribution with a weighted sum of continuous functions using sampling for multiplications.
result Preliminary experiments show potential of the new method compared to particle filters.
Feature extraction and dimension reduction for networks is critical in a wide variety of domains. Efficiently and accurately learning features for multiple graphs has important applications in statistical inference on graphs. We propose a method to jointly embed multiple undirected graphs. Given a set of graphs, the jo…
We generalise the problem of inverse reinforcement learning to multiple tasks, from multiple demonstrations. Each one may represent one expert trying to solve a different task, or as different experts trying to solve the same task. Our main contribution is to formalise the problem as statistical preference elicitation,…
Mixed likelihood GPs improve model performance in human-in-the-loop experiments.
problem Lack of auxiliary information in traditional GPs for human responses.
method Propose mixed likelihood variational GPs to leverage auxiliary information.
result Modeling performance improvements across diverse applications.
T-Rex selector selects variables fast and controls FDR in high-dimensional data.
problem Variable selection in high-dimensional data with FDR control.
method Fused solutions of early terminated random experiments.
result FDR control at target level with high variable selection power.
We present the multiplicative recurrent neural network as a general model for compositional meaning in language, and evaluate it on the task of fine-grained sentiment analysis. We establish a connection to the previously investigated matrix-space models for compositionality, and show they are special cases of the multi…
Study on learning to defer with multiple experts using new surrogate losses.
problem Learning to defer with multiple experts in a machine learning context.
method Introducing a new family of surrogate losses for the multiple-expert setting, proving H-consistency bounds, and designing learning algorithms. result Explicit guarantees for new learning to defer algorithms based on minimization of these surrogate losses.
MPPCCA extracts multiple causal relationships from multivariate time series.
problem Extracting multiple causal relationships from multivariate time series data.
method Mixture of probabilistic partial canonical correlation analysis (MPPCCA) combined with an expectation-maximization (EM) algorithm.
result MPPCCA accurately estimates multiple partial canonical correlations in synthetic and real datasets.
Recently neural networks and multiple instance learning are both attractive topics in Artificial Intelligence related research fields. Deep neural networks have achieved great success in supervised learning problems, and multiple instance learning as a typical weakly-supervised learning method is effective for many app…
New adversarial training methods generate multiplicative perturbations for robust DNN training.
problem Training Deep Neural Networks with adversarial examples to improve robustness.
method Proposes xAT and xVAT, generating multiplicative perturbations for robust training.
result xAT and xVAT match or outperform state-of-the-art classification accuracies and are faster.
We are interested in solving the multiple measurement vector (MMV) problem for instances, where the underlying sparsity pattern exhibit spatio-temporal structure motivated by the electroencephalogram (EEG) source localization problem. We propose a probabilistic model that takes this structure into account by generalizi…
New algorithms and guarantees for multiple-source adaptation.
problem Improving model performance on target mixtures from multiple sources.
method Normalized solutions with theoretical guarantees, algorithms for distribution-weighted combination.
result Our algorithm outperforms competing approaches by producing a robust model.
Optimal algorithm reduces regret in adversarial bandit problem with multiple plays.
problem Minimizing regret in adversarial bandit problem with multiple plays.
method Introducing a new expert advice algorithm for multiple-play setting, achieving minimax optimal regret bounds.
result Minimizes regret asymptotically to the best switching strategy with optimal bounds.
This paper optimizes search experiences in two-sided marketplaces by balancing multiple conflicting metrics.
problem Balancing conflicting business metrics in two-sided marketplaces like eBay and Etsy.
method Joint optimization of market-level metrics using Evolutionary Strategies.
result Demonstrated effectiveness of the proposed method on Etsy data.
Proposes a new scoring function for linear classifiers to improve object positioning in feature space.
problem Lack of information about relative positions of recognized objects in feature space.
method Calculates a scoring function based on object distance from decision boundary and class centroid.
result Demonstrates effectiveness of the proposed method compared to other ensemble algorithms on multiple datasets.