New model improves diversity in question generation over text.
problem Inadequate evaluation metrics for diverse questions.
method Proposed a variational encoder-decoder model and evaluation scheme.
result Improved diversity in generated questions without loss of quality.
High-capacity neural network ensembles often benefit more from high-capacity models than from increased diversity.
problem The performance of high-capacity neural network ensembles is often harmed by interventions that promote predictive diversity.
method A large-scale study of nearly 600 neural network classification ensembles, examining various interventions and architectures.
result Discouraging predictive diversity can be benign in large-network ensembles, and higher-capacity models often yield better performance than diverse architectures.
Pantypes improve prototypical models by capturing diverse input distributions.
problem Prototypical models lack sufficient data representation in low density regions.
method Introducing pantypes, a sparse set of diverse objects to represent the full diversity of input distribution.
result Pantypes empower prototypical models to foster high diversity, interpretability, and fairness.
A stock market is called diverse if no stock can dominate the market in terms of relative capitalization. On one hand, this natural property leads to arbitrage in diffusion models under mild assumptions. On the other hand, it is also easy to construct diffusion models which are both diverse and free of arbitrage. Can o…
New method improves ensemble diversity and generalization.
problem Ensemble diversity does not guarantee practical generalization.
method Introduced a new diversity metric and training method for extrapolating differently on local data patches.
result Improves generalization and diversity in practical settings, especially under data limits and covariate shift.
This paper improves model generalization by integrating diverse pretrained models.
problem Leveraging diverse pretrained models for robust out-of-distribution generalization.
method Characterize and integrate diverse pretrained models based on diversity and correlation shifts.
result Demonstrates state-of-the-art out-of-distribution generalization performance.
Unified theory explains diversity in ensemble learning.
problem Explaining diversity in ensemble learning across various scenarios.
method Developed a framework revealing diversity as a hidden dimension in bias-variance decomposition.
result Proved exact bias-variance-diversity decompositions for multiple losses in regression and classification.
Proposes Vendi Score for evaluating diversity in ML models.
problem Lack of flexible diversity evaluation metrics in ML.
method Integrates ecological and quantum statistical mechanics concepts to define Vendi Score.
result Vendi Score enables flexible diversity evaluation without requiring a reference dataset.
This paper improves ensemble robustness by promoting diversity among individual models.
problem Existing ensemble models are vulnerable to adversarial attacks.
method Introduces a new diversity promoting regularizer to enhance robustness.
result The method improves adversarial robustness while maintaining normal accuracy.
Model predicts diverse chemical reactions for target compounds.
problem Making generalizable and diverse retrosynthetic reaction predictions.
method Transformer architecture with novel pre-training methods and a latent variable model.
result Improves performance on USPTO-50k dataset, generating more diverse predictions.
MO-PaDGAN generates diverse, high-performance designs with multiple metrics.
problem Challenges in generating diverse, high-performance designs with multiple metrics.
method MO-PaDGAN uses a new Determinantal Point Processes based loss function for probabilistic modeling of diversity and performances.
result MO-PaDGAN expands the design space towards high-performance regions and generates new designs with high diversity and performances.
Product diversity of large US firms has declined steadily since 1997.
problem Lack of data on global product diversity makes investigation difficult.
method Text mining of US firms' product descriptions from 1997-2017.
result Product diversity of large US firms has been declining since 1997.
Unified evaluation for both quality and diversity in NLP.
problem Measuring both quality and diversity in NLP models.
method Proposes HUSE, a metric combining human and statistical evaluation.
result HUSE detects both quality and diversity defects in NLP models.
This paper explores how diverse neural network ensembles improve prediction accuracy and robustness against deception.
problem Improving prediction accuracy and robustness of neural networks against adversarial attacks.
method Examines and measures ensemble diversity, develops algorithms for creating and combining diverse ensembles.
result Greater diversity in neural network ensembles leads to higher accuracy and robustness against deception.
Study shows diverse data sources improve cryptocurrency forecasting models.
problem Improving cryptocurrency market forecasting accuracy.
method Integrating various data types, including on-chain metrics, traditional indices, and macroeconomic indicators.
result Data source diversity significantly enhances forecasting model performance.
This paper presents a general framework for studying diverse beliefs in dynamic economies. Within this general framework, the characterization of a central-planner general equilbrium turns out to be very easy to derive, and leads to a range of interesting applications. We show how for an economy with log investors hold…
New SLC distributions enable easier control over diversity.
problem Lack of easy control over diversity in existing models.
method Developed strongly log-concave distributions and two tools for sampling and mode finding.
result Established weak log-submodularity for SLC functions and optimization guarantees for mode finding.
PaDGAN generates diverse, high-quality designs with improved performance.
problem Lack of diversity and performance improvement in generated designs.
method Integrates Determinantal Point Processes for diversity and quality, using GAN framework.
result PaDGAN generates higher quality designs with better diversity and without mode collapse.
Grassmannian packings improve CNN kernels' diversity and reduce sparsity.
problem Kernel sparsity and lack of diversity in CNNs decrease model capacity.
method Initialize CNN kernels with Grassmannian packings to maximize diversity and minimize sparsity.
result Grassmannian packings lead to diverse features and improved classification accuracy.
MOD improves ensemble-based uncertainty estimates by encouraging larger diversity.
problem Improving model uncertainty estimates for inputs not seen during training.
method Maximize Overall Diversity (MOD) approach to encourage larger diversity in ensemble predictions.
result Significantly improves predictive performance for out-of-distribution test examples.
Generating molecules with desired chemical properties is important for drug discovery. The use of generative neural networks is promising for this task. However, from visual inspection, it often appears that generated samples lack diversity. In this paper, we quantify this internal chemical diversity, and we raise the …
In 1999 Robert Fernholz observed an inconsistency between the normative assumption of existence of an equivalent martingale measure (EMM) and the empirical reality of diversity in equity markets. We explore a method of imposing diversity on market models by a type of antitrust regulation that is compatible with EMMs. T…
The paper clusters hypergraphs to find diverse and experienced groups based on past experiences.
problem Finding diverse and experienced groups with respect to past experiences.
method Regularized edge-based hypergraph clustering objective with a 2-approximation algorithm.
result Demonstrates an efficient 2-approximation algorithm for clustering hypergraphs.
Generative model learns diverse fixes for program errors.
problem Uncertainty in predicting a single fix for program errors.
method Deep conditional variational autoencoder with diversity regularizer.
result Strong improvements over state-of-the-art approaches, generating up to 45% diverse fixes.
GRATIS generates diverse time series for benchmarking.
problem Lack of diverse time series data for evaluation.
method Uses mixture autoregressive (MAR) models to generate time series.
result Generates diverse and controllable time series efficiently.
BADGE samples diverse and uncertain points for deep neural nets.
problem Efficiently selecting batches for active learning with deep models.
method Samples groups of points that are disparate and high-magnitude in a hallucinated gradient space.
result BADGE consistently performs as well or better than other methods for active learning.
Paper explores how text generation quality and diversity metrics relate to distribution fitting.
problem Unclear relation between text generation quality and diversity metrics and distribution fitting.
method Theoretical approach to prove a linear combination of quality and diversity metrics can be a divergence metric.
result CR/NRR proposed as a better substitute for BLEU/Self-BLEU metrics.
Presents STRIPE model for probabilistic forecasting of non-stationary time series.
problem Probabilistic forecasting of non-stationary time series.
method STRIPE model representing structured diversity based on shape and time features, with diversification mechanism using determinantal point processes (DPP).
result STRIPE significantly outperforms baseline methods for representing diversity while maintaining forecasting accuracy.
New measures quantify how data augmentation improves model performance.
problem Understanding the effectiveness of data augmentation in deep learning.
method Introduced Affinity and Diversity measures to quantify augmentation performance.
result Augmentation performance is best achieved by optimizing both Affinity and Diversity.
A framework generates diverse counterfactual explanations for machine learning models.
problem Creating understandable explanations for machine learning predictions.
method Framework based on determinantal point processes for generating and evaluating diverse counterfactuals.
result Framework generates diverse counterfactuals that approximate local decision boundaries better than prior approaches.
Proposes a method to generate diverse translations by conditioning on target domain.
problem NMT models lack diversity in translations, even with search algorithms.
method Condition the decoder on a latent variable representing target domain, generated by a target encoder.
result Generated diverse translations without affecting performance or training time.
DMNL bandits optimize assortment choices balancing relevance and diversity.
problem Balancing relevance-driven choice with within-assortment diversity.
method Augments MNL choice probabilities with a submodular diversity function, proposing a white-box UCB-based algorithm.
result Achieves at least a (1−e+11)-approximate regret bound of $ ilde{O}\left(d \sqrt{T/K}
ight)$. The paper analyzes sectoral diversity in startup ecosystems in Europe and the USA.
problem Investigating sectoral diversity in startup ecosystems.
method Analysis of 20+ startup ecosystems in Europe and the USA using a new visualization tool and numerical simulations.
result Emerging diversity of startup ecosystems can be explained by a preferential attachment model based on sectoral funding.
New method improves text classification without labeled target data.
problem Improving text classification under domain shift without labeled target data.
method Diversity-based generalization using multi-head attention with diversity constraints.
result Method matches state-of-the-art performance without labeled target data.
EDU method finds diverse optimal solutions for expensive simulators.
problem Optimizing expensive black-box simulators for diverse solutions.
method EDU method searches for diverse locally-optimal solutions within a tolerance level.
result EDU yields a closed-form acquisition function facilitating efficient sequential queries.
A new LLM-based method enhances diversity in oversampling for imbalanced classification.
problem Limited diversity in synthetic minority samples generated by current LLM-based approaches reduces robustness and generalizability.
method Condition synthetic sample generation on minority labels and features, use permutation strategy for fine-tuning, fine-tune on minority and interpolated samples.
result Significantly outperforms eight SOTA baselines in diverse synthetic sample generation and downstream classification tasks.
Research reveals how diversity impacts ensemble generalization in classification tasks.
problem Understanding the relationship between diversity and generalization in classification ensembles.
method Investigated diversity measurement, its relationship with generalization error, and pruning methods.
result Generalization error is reduced effectively only when diversity is increased in specific ranges, not in others.
This work tackles semi-supervised federated learning by reducing model gradient diversity.
problem Improving test accuracy in semi-supervised federated learning with limited labeled data.
method Investigates and compares various design choices including consistency regularization loss, Batch Normalization, and Group Normalization.
result Grouping-based model averaging combined with Group Normalization and consistency regularization loss improves test accuracy.
A financial market is called "diverse" if no single stock is ever allowed to dominate the entire market in terms of relative capitalization. In the context of the standard Ito-process model initiated by Samuelson (1965) we formulate this property (and the allied, successively weaker notions of "weak diversity" and "asy…
Introduce a variance-weighted batch distribution for diverse sampling in diffusion models.
problem Independent sampling in diffusion models.
method Introduce a variance-weighted batch distribution.
result Sampler with a transparent probabilistic target.
D-CBRS manages memory for continual learning by accounting for intra-class diversity.
problem Forgetting in continual learning, especially with class-imbalanced data.
method D-CBRS introduces a novel approach to store instances in memory, considering intra-class diversity.
result D-CBRS outperforms existing methods on data sets with intra-class diversity.
Proposes models to generate more interesting story endings.
problem Generating diverse and interesting story endings for a given context.
method Trains models to focus on keyphrases and promotes non-generic words.
result Models generate more diverse and interesting story endings.
We introduce a new sampling method for large language models that balances diversity and parallelism.
problem Balancing diversity and parallelism in decoding for large language models.
method Arithmetic sampling framework compatible with various sampling variations.
result Improves estimation of expected BLEU score reward and reduces the gap with beam search.
Paper presents a deterministic method for diverse subset selection.
problem Diverse subset selection problems in recommendation, summarization, and search.
method Greedy deterministic adaptation of k-DPP for low-rank approximations and image search.
result The method yields low-rank approximations of kernel matrices and demonstrates effectiveness in image search.
This paper improves ensemble learning for vision tasks by encouraging diversity in predictions.
problem Generating effective ensembles of neural networks for multi-modal data.
method Explicitly optimize a diversity inducing adversarial loss for learning stochastic latent variables.
result Significant improvements in classification accuracy and out-of-distribution detection compared to baselines.
Seq-CVAE learns a latent space for each word position to capture sentence intention.
problem Capturing diversity in image captioning models.
method Seq-CVAE learns a sequential latent space for each word position, mimicking future sentence summaries.
result Significantly improves diversity metrics on MSCOCO dataset compared to baselines.
New measures quantify diversity of latent representations using metric space magnitude.
problem Evaluating the diversity of latent representations in machine learning models.
method Developed magnitude-based measures for latent representations, stable under data perturbations.
result Demonstrated superior performance across various domains and tasks.
Improved UCB algorithm for diversity in bandits with lower bounds.
problem Improving diversity in bandit-based recommendations.
method Designing a UCB algorithm exploiting the specific structure of the problem.
result The UCB algorithm achieves bounded distribution-dependent regret under certain conditions.