This paper analyzes diversity measures for streaming data ensembles.
problem Understanding diversity measures for streaming data ensembles.
method Theoretical analysis of diversity measures for streaming data ensembles.
result Analysis provides deeper understanding of diversity and its impact on online ensemble learning.
New method improves ensemble diversity and generalization.
problem Ensemble diversity does not guarantee practical generalization.
method Introduced a new diversity metric and training method for extrapolating differently on local data patches.
result Improves generalization and diversity in practical settings, especially under data limits and covariate shift.
This paper reflects on teaching Data Science to diverse students.
problem Adapting learning practices to diverse backgrounds in Data Science.
method Summarizes experiences from teaching a postgraduate Data Science module.
result Draws lessons relevant to teaching Data Science.
Study shows diverse data sources improve cryptocurrency forecasting models.
problem Improving cryptocurrency market forecasting accuracy.
method Integrating various data types, including on-chain metrics, traditional indices, and macroeconomic indicators.
result Data source diversity significantly enhances forecasting model performance.
New framework shows diverse training data improves subgroup and overall performance.
problem Lack of understanding how diverse training data affects subgroup and overall performance.
method Casts data collection as part of the learning process, analyzes dataset compositions, and guides dataset design.
result Diverse representation in training data improves subgroup and overall performance.
D-CBRS manages memory for continual learning by accounting for intra-class diversity.
problem Forgetting in continual learning, especially with class-imbalanced data.
method D-CBRS introduces a novel approach to store instances in memory, considering intra-class diversity.
result D-CBRS outperforms existing methods on data sets with intra-class diversity.
The paper tackles fair and diverse data summarization using DPPs.
problem Tackles bias in data summarization methods.
method Uses determinantal measures of diversity and corresponding distributions (DPPs) to incorporate fairness constraints.
result Developed a fast sampler for constrained determinantal distributions that is provably good under certain conditions.
DiwE uses regional distribution changes to create diverse ensemble classifiers for concept drift.
problem Handling concept drift in evolving data streams.
method DiwE measures diversity based on regional distribution disagreement and uses it to weight instances and select classifiers.
result DiwE outperforms other algorithms on various synthetic and real-world data stream benchmarks.
The paper improves experimental design by weighting diversity metrics with quality, leading to more diverse and effective discoveries.
problem Existing experimental design techniques favor exploitation over exploration, leading to local optima and insufficient diversity.
method The paper extends Vendi scores to account for quality and applies them to various experimental design problems.
result Quality-weighted Vendi scores allow for better balance between quality and diversity, resulting in 70%-170% more effective discoveries.
SharpBalance improves deep ensemble performance by balancing sharpness and diversity.
problem Improving deep ensemble performance in both in-distribution and out-of-distribution scenarios.
method Introducing SharpBalance, a novel training approach that balances sharpness and diversity within ensembles.
result SharpBalance effectively improves the sharpness-diversity trade-off and ensemble performance in ID and OOD scenarios.
New measures quantify how data augmentation improves model performance.
problem Understanding the effectiveness of data augmentation in deep learning.
method Introduced Affinity and Diversity measures to quantify augmentation performance.
result Augmentation performance is best achieved by optimizing both Affinity and Diversity.
New method improves text classification without labeled target data.
problem Improving text classification under domain shift without labeled target data.
method Diversity-based generalization using multi-head attention with diversity constraints.
result Method matches state-of-the-art performance without labeled target data.
MO-PaDGAN generates diverse, high-performance designs with multiple metrics.
problem Challenges in generating diverse, high-performance designs with multiple metrics.
method MO-PaDGAN uses a new Determinantal Point Processes based loss function for probabilistic modeling of diversity and performances.
result MO-PaDGAN expands the design space towards high-performance regions and generates new designs with high diversity and performances.
Improves exploration in reinforcement learning with diverse population.
problem Lack of diversity in reinforcement learning agents leads to limited exploration.
method Optimizes a population of agents using volume of behavioral manifold and online learning techniques.
result Improves exploration without sacrificing performance.
Proposes Ada-Sit method for mortality prediction of rare diseases.
problem Data insufficiency and clinical diversity of rare diseases make mortality prediction hard.
method Initialization-sharing multi-task learning method (Ada-Sit) for fast adaptation to similar tasks.
result Experimental results show the proposed model is effective for mortality prediction of diverse rare diseases.
New clustering method promotes diversity while maintaining fairness.
problem Developing clustering methods that enhance diversity with respect to protected attributes.
method Attraction-repulsion dissimilarities to penalize homogeneity with respect to protected attributes.
result Improves diversity in clusters without compromising fairness.
METASET selects diverse unit cells for efficient data-driven metamaterial design.
problem Imbalanced datasets in unit cells can bias data-driven metamaterial design.
method METASET uses similarity metrics and DPPs to select diverse subsets of unit cells.
result Smaller, diverse subsets improve search process and structural performance.
GRATIS generates diverse time series for benchmarking.
problem Lack of diverse time series data for evaluation.
method Uses mixture autoregressive (MAR) models to generate time series.
result Generates diverse and controllable time series efficiently.
Diversity or complementarity of experts in ensemble pattern recognition and information processing systems is widely-observed by researchers to be crucial for achieving performance improvement upon fusion. Understanding this link between ensemble diversity and fusion performance is thus an important research question. …
Proposes Vendi Score for evaluating diversity in ML models.
problem Lack of flexible diversity evaluation metrics in ML.
method Integrates ecological and quantum statistical mechanics concepts to define Vendi Score.
result Vendi Score enables flexible diversity evaluation without requiring a reference dataset.
PaDGAN generates diverse, high-quality designs with improved performance.
problem Lack of diversity and performance improvement in generated designs.
method Integrates Determinantal Point Processes for diversity and quality, using GAN framework.
result PaDGAN generates higher quality designs with better diversity and without mode collapse.
This work tackles semi-supervised federated learning by reducing model gradient diversity.
problem Improving test accuracy in semi-supervised federated learning with limited labeled data.
method Investigates and compares various design choices including consistency regularization loss, Batch Normalization, and Group Normalization.
result Grouping-based model averaging combined with Group Normalization and consistency regularization loss improves test accuracy.
This paper improves ensemble learning for vision tasks by encouraging diversity in predictions.
problem Generating effective ensembles of neural networks for multi-modal data.
method Explicitly optimize a diversity inducing adversarial loss for learning stochastic latent variables.
result Significant improvements in classification accuracy and out-of-distribution detection compared to baselines.
Pantypes improve prototypical models by capturing diverse input distributions.
problem Prototypical models lack sufficient data representation in low density regions.
method Introducing pantypes, a sparse set of diverse objects to represent the full diversity of input distribution.
result Pantypes empower prototypical models to foster high diversity, interpretability, and fairness.
Generative model learns diverse generations using DPP to avoid mode collapse.
problem Mode collapse in generative models, limiting output to few modes.
method Inspired by DPP, proposes an unsupervised penalty loss to enhance diversity.
result Generative DPP approach consistently resists mode-collapse and outperforms state-of-the-art methods.
New method recovers diverse policies from expert data using state-action pair weighting.
problem Recovering diverse policies from expert trajectories.
method Pointwise mutual information weighted behavioral cloning.
result Effective in focusing on state-action pairs most representative of the style.
Unified framework for portfolio optimization using multiple hypotheses.
problem Risk diversification in portfolio allocation.
method Structured ensemble learning approach with diversity control.
result Structured ensembles link predictor diversity to risk diversification.
Mixreg improves RL generalization by mixing diverse training environments.
problem Overfitting in RL agents trained in limited environments.
method Trains on a mixture of diverse observations and imposes linearity constraints.
result Mixreg outperforms baselines on unseen testing environments.
New measures quantify diversity of latent representations using metric space magnitude.
problem Evaluating the diversity of latent representations in machine learning models.
method Developed magnitude-based measures for latent representations, stable under data perturbations.
result Demonstrated superior performance across various domains and tasks.
A new algorithm uses bandits to diversify database activity monitoring.
problem Limitation of current DAM systems in collecting diverse data.
method Redefined DAM sampling as a bandit problem and developed a novel algorithm combining expert knowledge and random exploration.
result Adding diversity to sampling using the bandit-based approach improves coverage without decreasing alert quality.
Efficiently finds diverse coherent counterfactual explanations.
problem Finding coherent counterfactual explanations for complex data.
method Mixed integer programming with mixed polytope constraints.
result Efficiently generates diverse coherent counterfactual explanations.
SplitNN-driven Vertical Partitioning enables distributed learning from diverse data sources.
problem Learning from vertically distributed features across institutions.
method A configuration of SplitNN that does not share raw data or model details.
result Flexibility in merging split model outputs and resource efficiency.
The study describes society as a probabilistic system with entropy and diversity, finding new statistical approaches.
problem Understanding entropy and diversity in social systems.
method Modeling society as a probabilistic system, analyzing entropy and inequality, applying thermodynamic principles.
result New statistical approaches (Fermi-Dirac and Bose-Einstein) for employment and income distribution.
A new method optimizes diversity and sparsity for index tracking.
problem Accurately replicating a benchmark index with a small number of diverse assets.
method Jointly optimizes diversity and sparsity using a regularizer based on asset similarity.
result The proposed algorithm outperforms existing methods in out-of-sample backtesting.
GM-GAN improves GANs for diverse datasets, enabling better image synthesis and clustering.
problem Limited performance of GANs on diverse datasets.
method Proposes GM-GAN with a mixture of Gaussians in latent space, and a new scoring method.
result Quantitatively outperforms baselines in diversity and quality of generated images.
Product diversity of large US firms has declined steadily since 1997.
problem Lack of data on global product diversity makes investigation difficult.
method Text mining of US firms' product descriptions from 1997-2017.
result Product diversity of large US firms has been declining since 1997.
The paper clusters hypergraphs to find diverse and experienced groups based on past experiences.
problem Finding diverse and experienced groups with respect to past experiences.
method Regularized edge-based hypergraph clustering objective with a 2-approximation algorithm.
result Demonstrates an efficient 2-approximation algorithm for clustering hypergraphs.
Interactive clustering tool TINDER generates diverse clusterings from data.
problem Difficulty in formalizing criteria for good clustering.
method Bayesian framework with feedback mechanism to elicit priors.
result TINDER produces diverse, equivalent-quality clusterings.
Proposes a self-paced multi-label learning method to handle diverse labels efficiently.
problem Learning from multi-label data with a large label space is NP-hard and prone to overfitting.
method Self-paced multi-label learning with diversity (SPMLD) approach, incorporating gradual label inclusion and diversity maintenance.
result The proposed SPMLD framework optimizes a non-convex objective function using block coordinate descent.
Task-agnostic data valuation without validation requirements.
problem Valuing data without specific task assumptions.
method Estimating data diversity and relevance through queries without raw data.
result Estimates capture the diversity and relevance of seller's data for the buyer.
A method for efficient reinforcement learning query reformulation.
problem Efficiently learn diverse strategies for query reformulation.
method A framework with specialized sub-agents and a meta-agent trained on full data.
result Improved generalization performance and diversity of reformulation strategies.
Waymo Open Dataset provides a large, diverse, and synchronized LiDAR and camera dataset for autonomous driving research.
problem Limited diversity and scale in existing self-driving datasets hinder real-world problem alignment.
method Developed a new large-scale, high-quality, diverse dataset with synchronized LiDAR and camera data.
result The dataset is 15x more diverse than the largest existing dataset based on a proposed diversity metric.
Study uses network analysis to rank countries based on food production diversity and specialization.
problem Ranking countries based on their food production diversity and specialization.
method Network analysis of country-food production data, transforming into overlap matrices, identifying subsets, and ranking based on fitness and specialization.
result Countries with high fitness produce highly specialized food commodities, while those with low fitness produce diverse but low specialized food products.
It is widely known in the machine learning community that class noise can be (and often is) detrimental to inducing a model of the data. Many current approaches use a single, often biased, measurement to determine if an instance is noisy. A biased measure may work well on certain data sets, but it can also be less effe…
Our model improves sequence prediction accuracy and diversity.
problem Predicting future sequences with uncertainty and diversity.
method Gaussian Latent Variable model with 'Best of Many' sample objective.
result Empirically outperforms prior work on diverse tasks.
Meta-learning improves few-shot land cover classification across diverse regions.
problem Capturing diversity in land cover classification across different geographic regions.
method Model-agnostic meta-learning (MAML) algorithm applied to classification and segmentation tasks.
result Few-shot model adaptation outperforms traditional methods in diverse land cover classification tasks.
DMClusts discovers multiple clusterings from multi-view data.
problem Finding multiple meaningful and diverse clusterings from multi-view data.
method Deep matrix factorization to gradually factorize multi-view data into representational subspaces and generate one clustering per layer, enforcing diversity through proximity minimization.
result DMClusts outperforms state-of-the-art multiple clustering solutions.
New algorithms improve ensemble diversity, leading to more accurate and smaller models.
problem Building accurate predictive models with diverse base predictors.
method Integrates ensemble diversity into a reinforcement learning framework for ensemble selection.
result Diversity-incorporating ensembles are more accurate and smaller in size.