Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,341 papers · 148 categories

Trend · papers per month

2825648451,127 · Jun 202019922001200920182026
48 results for disparate data modalities

A new method detects relationships between disparate data properties efficiently.

problem Detecting relationships between different data properties, especially in large datasets.
method Multiscale Graph Correlation (MGC) combines k-nearest neighbors, kernel methods, and multiscale analysis.
result MGC achieves statistical power comparable to existing methods with significantly fewer samples and provides insight into the relationship.

SiMLR reduces complex biomedical data into simpler, interpretable forms.

problem Handling high-dimensional biomedical data for better understanding and prediction.
method Similarity-driven multi-view linear reconstruction (SiMLR) with novel objective function and regularization.
result SiMLR outperforms other methods in various biomedical datasets.

Paper presents a method to align unpaired samples across different modalities.

problem Challenges in collecting paired samples for multimodal representation learning.
method Uses propensity score alignment based on Rubin's framework to estimate a common space for unpaired samples.
result Optimal transport matching significantly improves alignment in real-world data.

Study breaks down graphs into structural and featural components for task-agnostic data valuation.

problem Lack of methods to assess the value of graphs in data marketplaces.
method Introduces blind message passing framework to evaluate graphs without specific task metrics.
result Demonstrates effectiveness in capturing structural disparities, relevance, and diversity of seller data for buyers.

Study shows explanation disparities in machine learning models are influenced by data and model properties.

problem Disparities in post-hoc machine learning explanation methods across race and gender.
method Simulations and experiments on a real-world dataset to assess challenges to explanation disparities.
result Increased covariate shift, concept shift, and omission of covariates increase explanation disparities, especially for neural network models.

Study shows unequal success of membership inference attacks across different groups.

problem Unequal success of membership inference attacks across different groups.
method Established conditions for preventing MIAs and derived connections to fairness and differential privacy.
result Estimating disparate vulnerability to MIAs can lead to overestimation; suitable attacks and statistical framework provided.

Study decomposes racial healthcare disparities via shifts in mediator distributions.

problem Racial disparities in healthcare expenditures and their underlying drivers.
method Framework decomposing disparities into mediator distribution shifts and residual components, using MEPS data.
result Substantial disparities persist even when mediators are equalized, suggesting unmeasured or structural factors.

New approach to fairness in machine learning models using conformal prediction.

problem Fairness in machine learning models' downstream decision-making.
method Theoretical derivation and empirical evaluation of label-clustered conformal prediction.
result Label-clustered conformal prediction often provides a favorable balance between utility and substantive fairness.

Combines multi-task and semi-supervised learning for disparate label spaces.

problem Sequence classification tasks with multiple, unrelated label sets.
method Joint embedding space and transfer functions between label embeddings.
result Outperforms strong baselines in topic-based sentiment analysis.

Paper tackles fairness in algorithms by predicting protected class from auxiliary data.

problem Protected class membership is often unobserved in data, leading to unfair algorithmic decisions.
method Use auxiliary datasets to predict protected class from proxy variables and provide characterizations of possible disparities.
result Common disparity measures are generally unidentifiable with auxiliary data, highlighting the need for robust assessments.

Develops a multi-resolution multi-task framework for integrating noisy, varying data.

problem Integrating evidence from multiple observation processes with varying resolutions and noise levels.
method Multi-resolution Multi-task Gaussian Processes (MRGP) framework, shallow and deep Gaussian Process mixtures.
result Generalizes and outperforms state-of-the-art GP compositions, offering efficient corrections and approximations.

Paper tackles fairness in automated decision-making systems.

problem Fairness issues in automated decision-making systems.
method Introduces disparate mistreatment, a new measure of unfairness, and proposes convex-concave constraints for decision boundary-based classifiers.
result Effective at avoiding disparate mistreatment without significant accuracy loss.

Study shows label errors impact model disparity metrics, proposing mitigation methods.

problem Impact of label errors on model disparity metrics.
method Empirical study, characterizing label error effects; proposing estimation and relabeling methods.
result Label errors significantly affect model disparity metrics, particularly for minority groups.

The paper addresses fairness in machine learning by adjusting input distributions.

problem Reducing disparate impact in machine learning models over different groups.
method The approach involves learning a counterfactual distribution to adjust input variables for disadvantaged groups.
result The method can reduce disparate impact without training a new model.

Manifold matching works to identify embeddings of multiple disparate data spaces into the same low-dimensional space, where joint inference can be pursued. It is an enabling methodology for fusion and inference from multiple and massive disparate data sources. In this paper we focus on a method called Canonical Correla…

2012-09-17abs ↗pdf ↗

What does it mean for an algorithm to be biased? In U.S. law, unintentional bias is encoded via disparate impact, which occurs when a selection process has widely different outcomes for different groups, even as it appears to be neutral. This legal determination hinges on a definition of a protected class (ethnicity, g…

2014-12-11abs ↗pdf ↗

Paper explores fair classification with bounded disparity using finite datasets.

problem Ensuring fairness in binary classification with protected groups.
method Minimax optimal approach with fairness constraints and demographic disparity control.
result Proposes FairBayes-DDP+ method that achieves minimax lower bound on fairness-aware excess risk.

New research shows transparent treatment disparity is better for achieving impact parity.

problem Achieving impact parity in ML models when group membership is correlated with other features.
method Theoretical analysis and experimental testing of disparate learning processes (DLPs).
result DLPs can lead to unintended treatment disparity and within-class discrimination, undermining impact parity.

DCEM algorithm reduces bias in machine learning models trained on selective labels.

problem Bias in machine learning models trained on selective labels.
method Disparate Censorship Expectation-Maximization (DCEM) algorithm.
result DCEM improves bias mitigation without sacrificing discriminative performance.

Study federates measurement of demographic disparities from quantile sketches.

problem Misalignment of fairness goals with siloed data collection and privacy regulations.
method Federated auditing of demographic parity through score distributions, using Wasserstein--Frechet variance and quantile summaries.
result Proposes a one-shot, communication-efficient protocol to estimate global disparity and its decomposition.

Study highlights fairness issues in travel behavior prediction models.

problem Ethical challenges in travel behavior analysis using machine learning.
method Operationalized computational fairness by equality of opportunity; compared DNN and DCM; introduced absolute correlation regularization.
result Both DNN and DCM predict disparities across social groups, with DNN outperforming DCM in prediction disparities.

The paper studies and mitigates accuracy disparity in regression models.

problem Accuracy disparity between different demographic subgroups in high-stakes domains.
method Error decomposition theorem and distribution alignment algorithm.
result The proposed algorithm effectively mitigates accuracy disparity while maintaining predictive power.

Improves cross-modal retrieval by integrating unlabeled data.

problem Lack of semantic similarity constraints and unlabeled data in cross-modal retrieval.
method Integrates quadruplet ranking loss and semi-supervised contrastive loss in a multi-task learning architecture.
result Boosts cross-modal retrieval accuracy by exploiting unlabeled data.

The paper examines how adversarial robustness affects accuracy disparity across different classes.

problem Understanding the impact of adversarial robustness on accuracy disparity across different classes.
method Linear classifiers under a Gaussian mixture model, decomposing the impact into inherent and imbalance effects.
result Adversarial robustness consistently degrades standard accuracy in balanced classes, but the class imbalance ratio plays a different role in accuracy disparity.

MoCA uses a novel autoencoder to analyze multi-modal health data.

problem Challenges in analyzing continuous multi-modal health data from wearable devices.
method Proposes MoCA, a self-supervised learning framework combining transformer and masked autoencoder methods.
result Demonstrates strong performance boosts across reconstruction and classification tasks.

The paper compares different fairness definitions under various worldviews.

problem Avoiding disparity amplification under different worldviews.
method Mathematical comparison of four fairness definitions using a theoretical framework.
result Different worldviews require different fairness definitions to avoid disparity amplification.

Framework for handling long-tailed multi-modal data.

problem Class imbalance and long-tailed distributions in multi-modal data.
method Multi-expert architecture with modality-specific networks and dynamic fusion weights.
result Framework outperforms existing methods in long-tailed, class-imbalanced scenarios.

The paper analyzes and proposes an algorithm for multi-modal nonlinear embeddings with theoretical performance bounds.

problem Generalizability of multi-modal nonlinear embeddings to unseen data.
method Theoretical analysis and a multi-modal nonlinear representation learning algorithm motivated by performance bounds.
result The proposed algorithm yields promising performance in multi-modal image classification and cross-modal image-text retrieval applications.

Develops a new criterion for subgroup fairness in algorithmic decision support.

problem Identifying fair recommendations in algorithms despite group-level differences.
method IJDI criterion and IJDI-Scan approach to detect and mitigate disparities.
result Identifies significant disparities in recommendations across subpopulations.

Adaptive anchor methods improve multi-modal learning by balancing intra-modal and inter-modal information.

problem Fixed anchor methods limit multi-modal learning by over-reliance on a single modality and inadequate cross-modal correlation.
method Adaptive anchor methods using centroid-based anchors from all modalities.
result Adaptive anchor methods like CentroBind consistently outperform fixed anchor methods across various datasets.

Develops methods for fair classification under linear disparity constraints.

problem Disparate impacts of machine learning algorithms on protected groups.
method Bayes-optimal fair classification methods via pre-, in-, and post-processing.
result Explicit forms of Bayes-optimal fair classifiers under linear disparity measures.

Develops multi-modal neural network models for improved prediction and uncertainty quantification.

problem Improving prediction accuracy and uncertainty quantification for multi-modal data.
method Multi-modal Bayesian neural network models with conjugate last-layer estimation using SVI.
result Improved prediction accuracy and uncertainty quantification compared to uni-modal models.

TAP transfers knowledge from unlabeled data to improve cross-modal learning.

problem Improving supervised learning performance using unlabeled data from a different modality.
method Probabilistic approach for missing information estimation, kernel regression, cross-attention module, TAP neural network.
result TAP significantly improves generalization across different domains and neural network architectures.

A novel cross-modal auto-encoder associates different data types efficiently.

problem Cross-modal data association in heterogeneous datasets.
method Bayesian inference framework with variational auto-encoders and associators.
result Successfully associates visual and auditory data with minimal paired data.

GPCCA integrates multi-modal data with missing values, improving clustering accuracy.

problem Integrating and analyzing multi-modal data with missing values and partial observations.
method Generalized Probabilistic Canonical Correlation Analysis (GPCCA) for unsupervised multi-modal data integration and dimensionality reduction.
result GPCCA outperforms existing methods in capturing essential patterns across modalities and provides robust low-dimensional embeddings.

Study reveals class disparities in balanced datasets through spectral imbalance.

problem Class disparities in balanced datasets are overlooked despite model performance gaps.
method Developed a theoretical framework and studied 11 encoders to diagnose spectral imbalance.
result Identified spectral imbalance as a source of class disparities in balanced datasets.

LRMM learns to recommend with missing modalities, improving robustness to data sparsity and cold-start issues.

problem Learning to recommend with missing modalities and cold-start problems.
method LRMM uses modality dropout and multimodal sequential autoencoder to learn multimodal representations and impute missing modalities.
result LRMM achieves state-of-the-art performance on rating prediction tasks and is more robust to data sparsity and cold-start issues.

Machine learning models can lead to group representation disparity, affecting long-term retention.

problem Representation disparity in ML models can lead to group retention issues over time.
method Analyzed user dynamics and fairness criteria in a sequential decision-making framework.
result Representation disparity can worsen over time without proper fairness criteria.