Proxy measures in competitive systems lead to corruption and inefficiency.
problem Corruption of proxy measures in competitive systems.
method Agent-based model integrating insights from complex systems, contest theory, behavioral economics, and cultural evolution.
result Proxy measures lead to corruption and convergence towards an equilibrium level of corruption.
CUTS removes corruption from models without clean data, improving utility and security.
problem Removing corruption from models without access to clean training data.
method CUTS uses a proxy set to amplify corruption and subtract it from model weights.
result CUTS recovers a large fraction of lost utility and nearly eliminates attacks with minimal damage.
Unified study of out-of-distribution generalization across 172 datasets.
problem Measuring and improving robustness of transfer learning models.
method Collect and fine-tune 31k models on 172 dataset pairs, varying architectures and settings.
result In- and out-of-distribution accuracies increase jointly but their relation is dataset-dependent.
Study shows how adjusting for a binary proxy can bound causal effects.
problem Bounding causal effects with a binary confounder and proxy.
method Monotonicity assumption applied to a binary confounder and observed proxy.
result Adjusting for a proxy produces a measure of the effect between unadjusted and true measures.
Research suggests using deep learning for better recommendation systems.
problem Recommender systems rely on proxies for A/B testing, leading to random success.
method Advocates for using deep learning to improve recommendation performance.
result Deep learning can potentially optimize reward in recommendation systems.
Bayesian method estimates causal effects with proxy networks.
problem Estimating causal effects with only proxy measurements of a latent interference network.
method Structural causal model with Block Gibbs sampler and Locally Informed Proposals.
result Accurately estimates causal effects even with noisy proxy networks.
proxymate diagnoses and corrects proxy estimates for reliable inference.
problem Systematic bias in proxy estimates can lead to invalid inference on primary outcomes.
method Four-level framework for proxy validation and adjustment, including diagnostic checks and targeted corrections.
result Facilitated quick decision making on thousands of experiments at Meta.
New method tackles tensor regression with robust Kaczmarz approach.
problem Reconstructing tensor signals from corrupted measurements.
method Quantile-based randomized Kaczmarz method for tensor linear systems.
result Improved convergence and robustness to adversarial corruptions.
Gradient descent recovers low-rank matrices from corrupted measurements with double over-parameterization.
problem Robust recovery of low-rank matrices from grossly corrupted measurements.
method Gradient descent with discrepant learning rates for double over-parameterized models.
result Gradient descent with discrepant learning rates provably recovers the underlying matrix without prior knowledge on rank or sparsity.
We study the problem of corrupted sensing, a generalization of compressed sensing in which one aims to recover a signal from a collection of corrupted or unreliable measurements. While an arbitrary signal cannot be recovered in the face of arbitrary corruption, tractable recovery is possible when both signal and corrup…
Study robust mean estimation under coordinate-level corruptions using Hamming distance.
problem Robust mean estimation under realistic coordinate-level corruptions.
method Introduce a novel Hamming distance-based measure and present information-theoretic analysis.
result Data cleaning-inspired approaches can match information theoretic bounds for robust mean estimation.
Extends causal inference to hidden mediators with proxies.
problem Identifying causal effects with hidden mediators and error-prone proxies.
method Established causal hidden mediation analysis and hidden front-door criterion.
result Identification of population intervention indirect effect possible with hidden mediators.
Research builds an index measuring analysts' perception of informational asymmetry.
problem Measuring the level of informational asymmetry among companies.
method Developed an algorithm based on Elo rating to capture analysts' perception.
result The model shows good fit with significant variables: coverage, volatility, Tobin q, and size.
In order to investigate whether government regulations against corruption can affect the economic growth of a country, we analyze the dependence between Gross Domestic Product (GDP) per capita growth rates and changes in the Corruption Perceptions Index (CPI). For the period 1999-2004 on average for all countries in th…
Estimates proxy-based inference adjustments for distribution shifts.
problem Imperfect proxy data leads to biased inference.
method Empirical calibration of proxy-primary metric discrepancy as a random effect.
result Empowers inference without individual-level response data.
We report quantitative relations between corruption level and economic factors, such as country wealth and foreign investment per capita, which are characterized by a power law spanning multiple scales of wealth and investments per capita. These relations hold for diverse countries, and also remain stable over differen…
New framework for choosing optimal proxy metrics from past experiments.
problem Difficult to measure long-term treatment effects in experiments.
method Statistical framework to define and construct optimal proxy metrics.
result Optimal proxy metric depends on experiment's sample size.
Study on measuring vulnerability of neural network parameters via corruption.
problem Understanding the robustness and generalization of deep neural networks.
method Proposes an indicator to measure parameter robustness via parameter corruption and provides a gradient-based estimation.
result Demonstrates the effectiveness of the proposed indicator and training method in improving parameter robustness and accuracy.
New method improves treatment effect estimation using autoencoders and causal bridge.
problem Inferring causal effects with unobserved confounders.
method Coupling autoencoder with causal bridge to estimate treatment effects.
result Improves accuracy of treatment effect estimates.
Robust Kalman filter for corrupted measurements.
problem Estimating linear dynamical systems from noisy measurements, especially when a fraction of measurements are adversarially corrupted.
method Developed a robust Kalman filter framework that can handle large and unknown perturbations in measurement noise.
result First strong provable guarantees for linear quadratic estimation with adversarial corruptions.
We improve existing results in the field of compressed sensing and matrix completion when sampled data may be grossly corrupted. We introduce three new theorems. 1) In compressed sensing, we show that if the m \times n sensing matrix has independent Gaussian entries, then one can recover a sparse signal x exactly by tr…
New algorithm finds corrupted vertices in graphs with few queries.
problem Adversarial tampering of graph edges and vertices.
method Active learning algorithm with polynomial query complexity.
result Efficiently recovers corrupted vertices with small query complexity.
We inspect a possible clustering structure of the corruption perception among 134 countries. Using the average linkage clustering, we uncover a well-defined hierarchy in the relationships among countries. Four main clusters are identified and they suggest that countries worldwide can be quite well separated according t…
A data proxy reduces NAS computation cost by preserving key examples.
problem High computation cost in Neural Architecture Search (NAS).
method Measuring example importance based on relative accuracy ranking and creating a data proxy.
result Preserves almost same relative accuracy ranking with 10-20x smaller data proxy.
Proposes a method to create robust linear models with noisy proxies of unobserved variables.
problem Learning robust linear models to handle interventions on unobserved variables with noisy proxies.
method Regularization term that balances in-distribution performance and robustness to interventions.
result Single proxy can create prediction optimal estimators under interventions of bounded strength.
Efficiently estimates rotations with corrupted data.
problem Rotation synchronization under high corruption and noise.
method Message passing algorithm with reweighted least squares.
result Superior performance over state-of-the-art methods.
The study examines fairness metrics in noisy covariate settings, providing theoretical guarantees.
problem Fairness measurement under noisy covariate information.
method Theoretical analysis of group fairness metrics using proxies for covariates.
result Characterization of weaker conditions for accurate fairness evaluation.
A new probabilistic approach improves deep metric learning by considering image uncertainties and class-specific variances.
problem Proxy-based deep metric learning struggles with image uncertainties and class-specific structures.
method Introduces non-isotropic probabilistic proxy-based deep metric learning using directional von Mises-Fisher distributions.
result Improves generalization performance and competitive on standard benchmarks.
The US Census Bureau corrupts data to protect privacy, but we show how to clean and analyze it effectively.
problem Analyzing Census data with intentional corruption to maintain privacy.
method Formulated a semiparametric model, proposed data cleaning, estimation, and inference procedures.
result Demonstrated that data cleaning can maintain precision and provided theoretical and empirical support.
We use smaller proxy datasets to speed up hyperparameter search.
problem Time-consuming and costly training of neural networks on large datasets.
method Generate smaller 'proxy datasets' by sampling, training on easy/hard examples, or generating synthetic data. Compare proxy quality using variance measures.
result Proxy datasets can explain up to 95% of the variance in full dataset results, significantly faster.
We consider the robust phase retrieval problem of recovering the unknown signal from the magnitude-only measurements, where the measurements can be contaminated by both sparse arbitrary corruption and bounded random noise. We propose a new nonconvex algorithm for robust phase retrieval, namely Robust Wirtinger Flow to …
Dynamic Influence Tracker measures changing sample importance during model training.
problem Static influence measurements during training overlook how sample importance varies over time.
method Dynamic Influence Tracker (DIT) captures time-varying sample influence across arbitrary time windows.
result DIT reveals distinct learning phases with shifting priorities and detects corrupted samples more efficiently.
Unified framework for corruption-robust linear bandits with optimal gap-dependent misspecification bounds.
problem Effective learning in linear bandits with corrupted rewards across different corruption models.
method Unified framework for analyzing strong and weak corruption, connection to gap-dependent misspecification, and specialized algorithm.
result Optimal bounds for gap-dependent misspecification in linear bandits.
PPI uses proxy data to improve inference from limited labels across related tasks.
problem Statistical inference with limited labels across multiple related tasks.
method Prediction-powered inference framework that uses cross-task recalibration to improve power and accuracy.
result Cross-task recalibration can substantially reduce confidence interval widths when labels are scarce.
Paper tackles noise-robust domain adaptation in noisy environments.
problem Learning machines struggle with domain adaptation in noisy environments.
method The paper proposes offline curriculum learning and proxy distribution based margin discrepancy to mitigate label and feature noise.
result The proposed algorithm significantly outperforms state-of-the-art methods in noisy environments.
Framework learns data manifold and generative model from corrupted data.
problem Learning from corrupted data with latent manifold structures.
method Riemannian AmbientFlow, incorporating normalizing flows and Riemannian Autoencoders.
result Framework recovers underlying data distribution and smooth manifold parametrization.
Paper introduces robust deep learning method for handling random data corruption.
problem Random corruption in deep learning data due to limited quality of data.
method Inspired by median-of-means and Le Cam's principle, introduces a new approach.
result Demonstrates the approach performs well in practice and is a promising alternative to standard training methods.
Develops a method to estimate treatment effects using noisy proxies over time.
problem Estimating individualized treatment effects from noisy proxies of confounders.
method Deconfounding Temporal Autoencoder (DTA) combining autoencoder and causal regularization.
result Improves treatment effect estimates by leveraging noisy proxies and learning hidden confounders.
New framework uses geometry of embeddings to predict robustness.
problem Monitoring robustness in models without OOD labels.
method Constructs graphs from embeddings, measures spectral complexity and curvature.
result Representation geometry predicts robustness reliably.
New algorithm tackles adversarial corruption in Lipschitz bandits with sub-linear regret.
problem Adversarial corruption in Lipschitz bandits.
method Developed robust Lipschitz bandit algorithms for weak and strong adversaries.
result Achieved sub-linear regret under both weak and strong adversaries.
The paper shows how to use proxy attributes for fairness in machine learning models with missing sensitive group data.
problem Measuring and enforcing fairness in machine learning models with incomplete sensitive group data.
method Using proxy-sensitive attributes to derive upper bounds on multiaccuracy and multicalibration violations and adjust models to satisfy these fairness notions.
result Provable upper bounds on multiaccuracy and multicalibration violations can be derived using proxy-sensitive attributes in the absence of sensitive group data.
Model predicts internal fraud in retail banking is cyclical and influenced by corruption.
problem Predicting and mitigating internal fraud losses in retail banking.
method Developed a dynamic model considering internal factors and macroeconomic indicators.
result Internal fraud losses are pro-cyclical and positively affected by corruption perceptions.
New method generates clean data from corrupted observations.
problem Generating clean data from corrupted observations.
method Iterative update of a transport map using black-box corruption channel access.
result Converges to a self-consistent transport map that effectively inverts the corruption channel.
Improved model robustness against corruptions using online adaptation.
problem Machine vision models' vulnerability to image corruptions like blurring or compression artefacts.
method Using corrupted images' statistics for unsupervised online adaptation to improve robustness.
result ResNet-50 achieves 62.2% mCE on ImageNet-C with adaptation, improving from 76.7% without.
Paper tackles confounding bias in estimating individual treatment effects.
problem Estimating ITE from observational data with latent confounders.
method Adversarial learning framework using noisy proxies for latent confounders.
result Unbiased estimates of ITE achieved using noisy proxies.
New algorithm resists corruption in linear contextual bandits.
problem Adversarial corruption in linear contextual bandits.
method Variance-aware algorithm with multi-level partition and adaptive confidence sets.
result Regret bound of i l d e O ( C 2 d ∑ t = 1 T σ t 2 + C 2 R d T ) ilde{O}(C^2d\sqrt{\sum_{t = 1}^T σ_t^2} + C^2R\sqrt{dT}) i l d e O ( C 2 d ∑ t = 1 T σ t 2 + C 2 R d T ) . New model for bandits robust to adversarial corruptions.
problem Stochastic bandits with adversarial corruptions.
method Introduced a new model and a simple algorithm.
result Algorithm's performance degrades gracefully with corruption.
Improved statistical inference for expensive data using machine learning predictions.
problem Statistical inference under adaptive two-phase multiwave sampling with expensive measurements.
method Multiwave Predict-Then-Debias estimator combining proxy information and expensive measurements.
result Valid estimators and confidence intervals for M-estimation under adaptive sampling.