This article is devoted to the problem of predicting the value taken by a random permutation Σ, describing the preferences of an individual over a set of numbered items {1,…,n} say, based on the observation of an input/explanatory r.v. X e.g. characteristics of the individual), when error is measured…
Three privacy-preserving methods for median regression are proposed.
problem Protecting individual privacy in median regression analysis.
method Three privacy-preserving methods: finite smoothing, iterative, and greedy coordinate descent.
result Numerical results show varying performance across different sample sizes.
We consider the non-parametric regression problem under Huber's ε-contamination model, in which an ε fraction of observations are subject to arbitrary adversarial noise. We first show that a simple local binning median step can effectively remove the adversary noise and this median estimator is minimax optimal up t…
A new method for fast and robust sparsity learning over networks.
problem Efficiently learning sparse models in decentralized networks.
method Decentralized surrogate median regression (deSMR) method.
result Linear convergence rate with a simple implementation.
DiPriMe forests use private medians to create balanced tree splits for privacy-protected data.
problem Privacy concerns in training random forests due to multiple data queries.
method Proposes DiPriMe forests, which use a private median to generate balanced splits, ensuring differential privacy.
result DiPriMe forests achieve high utility while maintaining differential privacy, as shown both theoretically and empirically.
A regularized risk minimization procedure for regression function estimation is introduced that achieves near optimal accuracy and confidence under general conditions, including heavy-tailed predictor and response variables. The procedure is based on median-of-means tournaments, introduced by the authors in [8]. It is …
A main goal of regression is to derive statistical conclusions on the conditional distribution of the output variable Y given the input values x. Two of the most important characteristics of a single distribution are location and scale. Support vector machines (SVMs) are well established to estimate location functions …
New method improves mean estimation for heavy-tailed data.
problem Estimating mean of heavy-tailed distributions.
method Median-of-Means (MoM) with symmetrization technique.
result Improved sample complexity bound for mean estimation.
Study robust linear regression without distributional assumptions for heavy-tailed responses.
problem Linear regression with heavy-tailed responses and no distributional assumptions.
method Combining truncated least squares, median-of-means, and aggregation theory to construct a non-linear estimator.
result Achieves excess risk of order d/n with optimal sub-exponential tail. Optimal multitask learning method for sparse heterogeneous datasets.
problem Efficiently learning from multiple related datasets with sparse task-specific differences.
method MOLAR estimator, combining weighted median and shrinkage.
result Improves estimation error dependence on data dimension compared to task-wise least squares.
New method certifies regression robustness without data distribution assumptions.
problem Certifying robustness of regression models against poisoning attacks.
method Reduces certified regression to certified classification using median decision function.
result Proposes six new provably-robust regression models.
Quantile regression improves urban water demand forecasting.
problem Improving probabilistic urban water demand forecasting.
method Comparing five quantile regression algorithms and their combinations for one-day ahead forecasting.
result Linear boosting algorithm performs best for probabilistic urban water demand forecasting.
We show how to reduce the process of predicting general order statistics (and the median in particular) to solving classification. The accompanying theoretical statement shows that the regret of the classifier bounds the regret of the quantile regression under a quantile loss. We also test this reduction empirically ag…
This paper extends Median-of-Means to new learning problems involving pairwise comparisons.
problem Learning from pairwise comparisons in machine learning.
method Segmenting data into blocks, comparing pairs of decision rules, and declaring the winner based on majority performance.
result The Median-of-Means approach maintains robustness and performance under various sampling schemes.
We survey some of the recent advances in mean estimation and regression function estimation. In particular, we describe sub-Gaussian mean estimators for possibly heavy-tailed data both in the univariate and multivariate settings. We focus on estimators based on median-of-means techniques but other methods such as the t…
We develop a unified approach for classification and regression support vector machines for data subject to right censoring. We provide finite sample bounds on the generalization error of the algorithm, prove risk consistency for a wide class of probability measures, and study the associated learning rates. We apply th…
For massive data sets, efficient computation commonly relies on distributed algorithms that store and process subsets of the data on different machines, minimizing communication costs. Our focus is on regression and classification problems involving many features. A variety of distributed algorithms have been proposed …
We construct compactifications for median spaces with compact intervals, generalising Roller boundaries of CAT(0) cube complexes. Examples of median spaces with compact intervals include all finite rank median spaces and all proper median spaces of infinite rank. Our methods also work for general median algebra…
New method speeds up NIR spectroscopy calibration by 400x.
problem Efficient preprocessing selection in NIR spectroscopy.
method Operator-adaptive PLS and Ridge regression.
result Significant reduction in fitting time with comparable prediction quality.
New method for neural networks to predict histogram data.
problem Lack of principled approach for histogram regression.
method Pinball loss applied to cumulative histogram.
result Accuracy similar to EMD with less computational cost.
New concept of coarse medians for higher rank symmetric spaces.
problem Understanding medians in higher rank symmetric spaces.
method Introducing coarse r-median spaces and proving their existence. result Existence of coarse higher medians on divisible and quasi-homogeneous convex domains.
Unique median structures found in hyperbolic spaces.
problem Uniqueness of median structures in hyperbolic spaces.
method Analyzing product of hyperbolic spaces and properties of relative hyperbolicity.
result Non-hyperbolic pants graphs can have unique median structures.
Study on median algebra structures on Euclidean spaces and manifolds with local CAT(0) cubulation.
problem Understanding median algebra structures on Euclidean spaces and manifolds.
method Showed local CAT(0) cubulation for median structures on ER homology manifolds.
result Median structures on ER homology manifolds have a local CAT(0) cubulation structure.
We prove a version of the Tits alternative for groups acting on complete, finite rank median spaces. This shows that group actions on finite rank median spaces are much more restricted than actions on general median spaces. Along the way, we extend to median spaces the Caprace-Sageev machinery and part of Hagen's theor…
We show that uniform lattices of isometries of products of real hyperbolic spaces act properly discontinuously and cocompactly on a median space. For lattices in products of at least two factors, this is the strongest degree of compatibility possible with the median geometry. Our theorem is also relevant for potential …
R2T hybrid model improves robust regression for asymmetric noise.
problem Least-squares regression fails with asymmetric structured noise.
method Transformer encoder, compression NN, fixed symbolic equation.
result Median regression MSE of 6e-6 to 3.5e-5 on synthetic data.
Convex cores found for group actions on median spaces.
problem Understanding group actions on median spaces without metric or topology.
method Introduced convex cores for actions on finite-rank median algebras.
result Actions on median spaces have nonempty convex cores.
We introduce and begin to explore the mean and median of finite sets of shapes represented as integral currents. The median can be computed efficiently in practice, and we focus most of our theoretical and computational attention on medians. We consider questions on the existence and regularity of medians. While the me…
This paper is a short summary of our recent work on the medians and means of probability measures in Riemannian manifolds. Firstly, the existence and uniqueness results of local medians are given. In order to compute medians in practical cases, we propose a subgradient algorithm and prove its convergence. After that, F…
Private statistical inference methods improve confidence interval lengths.
problem Constructing private confidence intervals with differential privacy.
method Proposed two private variants of non-parametric bootstrap.
result Achieve similar coverage accuracy to non-private methods with shorter intervals.
A method for estimating the median of gradients in stochastic optimization.
problem Robust gradient estimation in stochastic optimization for various applications.
method Stochastic Proximal Point Method for median gradient estimation.
result The proposed method can converge even under heavy-tailed, state-dependent noise.
This paper introduces online algorithms to estimate robust geometric median in large data streams.
problem Detecting outliers in large data sets using robust statistical measures.
method Online stochastic Newton methods for estimating the geometric median.
result Rates of convergence for online estimation of the geometric median.
The study finds that maximizing median returns is the only viable strategy in portfolio selection.
problem Difficulties in studying optimal portfolio strategies due to discontinuity and time inconsistency in maximizing median and quantile returns.
method Used intra-personal equilibrium approach to analyze portfolio selection under median and quantile maximization.
result Median maximization is the only viable strategy, with no investment in risky assets for other quantiles.
New graph properties inherited by Frechet mean and median.
problem Characterizing the average of graph-valued samples.
method Analysis of Frechet mean and median graphs.
result Edge density is hereditary in Frechet mean and median graphs.
Tukey median performance analyzed under TV corruptions.
problem Performance analysis of Tukey median under TV corruptions.
method Analysis of Tukey median and projection algorithm under TV corruptions.
result Breakdown point reduced to 1/4 under TV corruptions, compared to 1/3 under Huber's model.
Consider a regression problem where there is no labeled data and the only observations are the predictions fi(xj) of m experts fi over many samples xj. With no knowledge on the accuracy of the experts, is it still possible to accurately estimate the unknown responses yj? Can one still detect the leas…
The consistency of Fréchet medians is proved for probability measures in proper metric spaces. In the context of Riemannian manifolds, assuming that the probability measure has more than a half mass lying in a convex ball and verifies some concentration conditions, the positions of its Fréchet medians are estimated. It…
New robust regression method works with fewer data points than previous methods.
problem Adversary can corrupt most of the data, making traditional regression models unreliable.
method Developed a Huber loss estimator for robust linear regression with nearly linear sample size and inverse-polynomial inlier fraction.
result The Huber loss estimator is consistent for nearly linear sample size and inverse-polynomial inlier fraction.
New subspace prototype flag median improves clustering on noisy data.
problem Finding robust prototypes for datasets of images and videos.
method Proposes flag median and introduces FlagIRLS algorithm for its calculation.
result Flag median is robust to outliers and improves cluster purity.
In high dimensions, the mean and geometric median are nearly identical.
problem Understanding the relationship between mean and geometric median in high-dimensional spaces.
method Analytical derivation and simulation of the distance between mean and geometric median.
result The distance between mean and geometric median vanishes with dimensionality in high dimensions.
Improved median of means estimator with tighter bounds.
problem Improving the efficiency and reliability of median of means estimator.
method Modification of the median of means estimator with sub-Gaussian deviation bounds.
result Achieves nearly optimal constants under minimal assumptions.
In this paper, we consider the problem of linear regression with heavy-tailed distributions. Different from previous studies that use the squared loss to measure the performance, we choose the absolute loss, which is capable of estimating the conditional median. To address the challenge that both the input and output c…
Empirical median performs well in estimating location with varying scales.
problem Estimating location with varying scales in data.
method Analysis of empirical median as an estimator.
result Matching upper and lower bounds on estimation error.
New estimator for symmetric kernel expectations, robust to missing data.
problem Efficient estimation of symmetric kernel expectations with missing data.
method Median-of-Incomplete-U-Statistics (MIU) estimator.
result Established finite-sample concentration rate for MIU.
Paper develops a new algorithm for sparse signal recovery.
problem Sparse signal recovery from noisy observations.
method Iterative Stochastic Optimization using Stochastic Mirror Descent.
result Linear convergence during preliminary phase of the routine.
Median-of-means sampling outperforms mean-of-means for large sample sizes in numerical integration.
problem Improving numerical integration accuracy in high dimensions.
method Median-of-means sampling compared to mean-of-means using RQMC methods.
result Median-of-means sampling is superior for large sample sizes, while mean-of-means is better for smaller sample sizes.
Upper bound for Hausdorff distance between hyperbolic space and its medianization.
problem Calculating the Hausdorff distance between hyperbolic space and its medianization.
method Using de Sitter space to model finite-dimensional hyperbolic space and its medianization, calculating the Hausdorff distance.
result An upper bound for the Hausdorff distance between hyperbolic space and its medianization is calculated.
Paper proposes a novel method to improve matrix completion with median loss for large datasets.
problem Matrix completion with absolute deviation loss for large-scale data.
method Proposes a refinement step using pseudo data to improve inefficient estimators of median matrix completion.
result Turns inefficient estimators into a rate (near-)optimal matrix completion procedure.