The paper proposes a method to trim Bayesian network classifiers robustly.
problem Removing costly features from Bayesian network classifiers while maintaining robustness.
method Introduces an expected classification agreement (ECA) metric and a branch-and-bound search algorithm to find optimal feature subsets and thresholds.
result The proposed method maximizes expected agreement between the original and trimmed classifiers, subject to a budgetary constraint.
Paper proposes iterative trimmed loss minimization for learning from corrupted data.
problem Learning from corrupted training data.
method Iterative trimmed loss minimization, alternating between selecting and retraining samples.
result Recovery of ground truth with linear convergence rate in generalized linear models.
Researchers combined linear classifiers using score functions and found simple and trimmed averages to be the best combination strategies.
problem Combining linear classifiers using their score functions.
method Two score functions tested; four combination strategies investigated; comparison with majority voting and model averaging.
result Simple and trimmed average combination strategies were the best.
Trimmed Lasso offers sparse modeling with robustness control.
problem Sparse modeling in linear regression with robustness.
method Trimmed Lasso penalty function and its analysis.
result Trimmed Lasso offers exact sparsity control and robustness.
Study connects geodesic sums to area constant.
problem Understanding geodesic sums in Teichmüller space.
method Relates trimmed sums of twists to area Siegel-Veech constant.
result Established connection between geodesic sums and area constant.
Trimming helps in conformal prediction when it separates anomaly scores.
problem Effectiveness of trimming in conformal prediction under contamination.
method Analyse fixed-threshold trimming as a replacement of the contaminated calibration law with a retained law.
result Trimming helps when it separates anomaly scores, reducing clean-target coverage to a one-dimensional score-CDF transfer problem.
We consider the problem of robustifying high-dimensional structured estimation. Robust techniques are key in real-world applications which often involve outliers and data corruption. We focus on trimmed versions of structurally regularized M-estimators in the high-dimensional setting, including the popular Least Trimme…
New method trims network data to resist adversarial contamination.
problem Adversarial contamination in network data affects statistical and algorithmic performance.
method Proposes a new trimming method operating in model space to address both block and white noise contamination.
result Demonstrates superior performance in simulations compared to direct trimming.
We describe a general framework for measuring risks, where the risk measure takes values in an abstract cone. It is shown that this approach naturally includes the classical risk measures and set-valued risk measures and yields a natural definition of vector-valued risk measures. Several main constructions of risk meas…
New method solves sparse approximation problem using trimmed lasso and generalized soft-min penalties.
problem Sparse approximation or best subset selection problem.
method Regularized approach with trimmed lasso and generalized soft-min penalties.
result The trimmed lasso provides sparse recovery guarantees and a practical optimization algorithm.
New core inflation measure predicts future headline inflation.
problem Creating a better measure of core inflation for timely policy decisions.
method Assemblage Regression, a nonnegative ridge regression that optimizes subcomponent weights.
result Significant improvements in forecasting medium-term inflation developments.
Gaussian Graphical Models (GGMs) are popular tools for studying network structures. However, many modern applications such as gene network discovery and social interactions analysis often involve high-dimensional noisy data with outliers or heavier tails than the Gaussian distribution. In this paper, we propose the Tri…
A method for estimating parameters from entangled single-sample distributions, robust to high-noise data.
problem Estimating common parameters from entangled single-sample distributions.
method Iterative trimming of samples to estimate the parameter.
result The method can tolerate a constant fraction of high-noise data points.
Alpha-trimming prunes trees in random forests to improve predictive performance.
problem Improving predictive performance of random forests by locally adaptive tree pruning.
method Alpha-trimming is a fast pruning algorithm that prunes trees in a random forest based on signal-to-noise ratio, controlled by a tuning parameter.
result Alpha-trimming often lowers mean squared prediction error compared to fully grown random forests.
New method prevents neural network breakdown by combining trimmed loss and variation regularization.
problem Outlier contamination in neural network training.
method Integrates transformed trimmed loss and higher-order variation regularization.
result Ensures robustness to outlier contamination with a high functional breakdown point.
Paper proposes robust gossip algorithms for mean and trimmed mean estimation.
problem Vulnerability of mean-based gossip algorithms to malicious nodes.
method Developed extsc{GoRank} for rank estimation and extsc{GoTrim} for trimmed mean estimation.
result Established convergence rates for rank and trimmed mean estimation.
A teacher can improve a learner's performance by selecting a smaller, more effective training subset.
problem Improving a learner's performance by selecting a smaller training subset.
method Sharp guarantees for two learners and a mixed-integer nonlinear programming-based algorithm for general learners.
result Empirical experiments show that the algorithm finds good super-teaching sets for regression and classification problems.
TrIM improves gradient-based dimension reduction and regression.
problem Efficiently identifying relevant feature subspace for high-dimensional regression.
method Introduced TrIM forest, an iterative approach using Mondrian forest and EGOP estimate.
result Consistency guarantees and convergence rates for EGOP matrix and random forest estimator.
New algorithm robustly estimates sparse models in high dimensions with corrupted data.
problem Estimating latent variable models with arbitrarily corrupted samples in high dimensional space.
method Trimmed (Gradient) Expectation Maximization with trimming gradients and hard thresholding steps.
result The algorithm converges to near optimal statistical rate geometrically under certain conditions.
Estimates GLMs robustly against label corruptions.
problem Learning GLMs under adversarial label corruptions.
method Iterative trimmed maximum likelihood estimator.
result Achieves minimax near-optimal risk.
We propose a robust elastic net (REN) model for high-dimensional sparse regression and give its performance guarantees (both the statistical error bound and the optimization bound). A simple idea of trimming the inner product is applied to the elastic net model. Specifically, we robustify the covariance matrix by trimm…
Net-Trim simplifies neural networks by pruning layers efficiently.
problem Simplifying trained deep neural networks for efficiency.
method Net-Trim is a convex post-processing technique that prunes neural network layers.
result Net-Trim can find a network with a limited number of nonzero terms from a small number of samples.
A new robust GP regression algorithm that trims outliers improves model accuracy.
problem Severe bias in GP regression due to data contamination by outliers.
method Iterative trimming of extreme data points.
result Significantly outperforms standard and robust GP variants in most test cases.
TRIM improves interpretability of deep neural networks in cosmology.
problem Understanding which features a deep neural network uses in a transformed space.
method TRIM (Transformation IMportance) attributes importances to features in a transformed space.
result Combining TRIM with contextual decomposition helps identify physical features learned by DNNs.
We assess cluster stability by trimming extreme points and tracking data range reduction.
problem Assessing stability of one-dimensional clusters.
method Probabilistic method using diameter-shrinkage ratio to track data range reduction.
result Our method achieves higher accuracy than classical tests in small or noisy samples.
A robust clustering method for noisy data using Bregman divergences.
problem Clustering data corrupted with clutter noise.
method k-means type method based on Bregman divergences with a trimming approach.
result Empirically optimal codebook converges to an optimal codebook in the distortion sense.
A new algorithm identifies outliers in Gaussian clustering models.
problem Handling outliers in Gaussian model-based clustering.
method OCLUST algorithm removes least plausible points based on subset log-likelihoods until they adhere to a reference distribution.
result OCLUST inherently estimates the number of outliers.
New method measures model variability from stochastic optimization.
problem Measuring model quality obscured by stochastic optimization.
method Robust hypothesis testing and novel summary statistic.
result Shows α-trimming level is more expressive than performance metrics. Paper proposes a framework to identify and obfuscate sensitive features via information density estimation.
problem Identifying and protecting sensitive attributes from leakage in obfuscation mechanisms.
method Information density estimation to identify leaking features, followed by a targeted obfuscation mechanism.
result Proven leakage guarantee in terms of Eγ-divergence for the obfuscation mechanism. Density ratio estimation is a vital tool in both machine learning and statistical community. However, due to the unbounded nature of density ratio, the estimation procedure can be vulnerable to corrupted data points, which often pushes the estimated ratio toward infinity. In this paper, we present a robust estimator wh…
New algorithm reduces ERM problem size while maintaining accuracy.
problem Empirical risk minimization problem size reduction.
method Adaptive Deterministic Uniform-Weight Trimming (ADUWT) algorithm.
result Uniform (1±ε) relative-error approximation for ERM objective. First place in ABC 2018: Classify bird gender from GPS trajectories.
problem Predicting the gender of shearwaters from GPS navigation data.
method Ensemble of Gradient Boosting Classifiers (CatBoost, LightGBM, XGBoost) with feature engineering.
result Ranked first among 74 teams in the Animal Behavior Challenge.
Improved robust regression for heavy-tailed and contaminated data.
problem Linear regression with heavy-tailed and adversarially contaminated covariates and responses.
method Applying a filtering algorithm to covariates and then using Huber regression, least trimmed squares, or least absolute deviation estimators on the remaining data.
result Near-optimal error rates achieved for the Huber regression estimator.
Combines VaR and ES forecasts from a large pool of methods.
problem Combining forecasts from a large pool of VaR and ES methods.
method Adapted interval forecast combination methods, including trimmed means and mixtures approach.
result Trimmed mean combinations, mixtures method, and performance-based weighting delivered strong results.
MemNet optimizes neural architectures for memory efficiency.
problem Memory constraints in mobile devices limit the use of large neural networks.
method Augment-trim learning with memory consumption ranking score.
result MemNet finds architectures with 24.17% less memory usage compared to state-of-the-art methods.
Robust Trimmed k-means improves clustering with outliers and mixed data.
problem Real-world data often contains outliers and mixed membership clusters, complicating traditional clustering methods.
method Proposes Robust Trimmed k-means (RTKM) that robustifies k-means for both single- and multi-membership data.
result RTKM outperforms other methods on multi-membership data with outliers and single membership data with outliers.
Survey on mean estimation and regression for heavy-tailed data.
problem Estimating mean and regression functions in heavy-tailed distributions.
method Sub-Gaussian mean estimators, median-of-means, trimmed mean, Catoni's estimator.
result Detailed proofs for estimators in heavy-tailed settings.
Paper develops robust OPF method using contextual information.
problem Optimal Power Flow problem under incomplete uncertainty knowledge.
method Distributionally robust chance-constrained formulation with probability trimmings and optimal transport.
result Distributional robustness improves expected cost and system reliability.
Efficiently estimates mixed effects models with nonlinear components and constraints.
problem Estimating mixed effects models with nonlinear components and constraints.
method Developed an efficient approach for mixed effects models with trimming in the marginal likelihood.
result More accurate and computationally efficient estimates in the presence of outliers.
A new robust regression method handles outliers in high-dimensional data.
problem Outliers in high-dimensional data make conventional regression methods ineffective.
method Robust penalized least squares of depth trimmed residuals regression.
result The new method outperforms existing methods in estimation and prediction accuracy.
Proposes a sensitivity framework to handle limited overlap in causal inference.
problem Limited overlap between treated and control groups in observational studies.
method Sensitivity framework based on worst-case confidence bounds on bias introduced by trimming.
result Protects against spurious findings by quantifying uncertainty in regions with limited overlap.
Efficiently clusters data with weak assumptions, robust to contamination.
problem General-shaped clustering under weak parametric assumptions with data contamination.
method Two-step hybrid robust clustering algorithm combining trimmed k-means and hierarchical agglomeration.
result Outperforms state-of-the-art methods in various applications.
We introduce and analyze a new technique for model reduction for deep neural networks. While large networks are theoretically capable of learning arbitrarily complex models, overfitting and model redundancy negatively affects the prediction accuracy and model variance. Our Net-Trim algorithm prunes (sparsifies) a train…
Paper develops robust distributed learning algorithms against Byzantine failures.
problem Security issues in large-scale distributed learning, especially Byzantine failures.
method Developed robust distributed gradient descent algorithms using median and trimmed mean operations.
result Achieved order-optimal statistical error rates for strongly convex losses.
ILTS iteratively refines linear regression models on subsets of data.
problem Linear regression with corruptions and outliers.
method Iteratively selects and refits the subset of samples with lowest loss.
result ILTS converges linearly to the closest mixture component under certain conditions.
New aggregation methods improve robustness and efficiency in distributed learning.
problem Outliers and malicious agents compromise traditional averaging in distributed learning.
method Developed statistically efficient and robust aggregation schemes based on median and trimmed mean variations.
result Achieved higher sample efficiency compared to traditional robust aggregation schemes.
This study analyzes LTS in sparse models with finite sample error bounds.
problem Robust regression in high-dimensional sparse models with limited data.
method Non-asymptotic analysis of LTS error bounds.
result Established finite sample error bounds for LTS in sparse models.
Robust clustering methods for multivariate time series data.
problem Clustering multivariate time series data robustly to outliers.
method Quantile-based fuzzy C-means with metric, noise, and trimmed approaches.
result Robust methods outperform alternatives in handling outlying series.