A novel method extracts topological features from word embeddings for text classification.
problem High dimensional and noisy text representations in natural language processing.
method Persistent homology for topological data analysis on word embeddings.
result Topological features outperform conventional text mining features on long textual documents.
We propose β-graph embedding for robustly learning feature vectors from data vectors and noisy link weights. A newly introduced empirical moment β-score reduces the influence of contamination and robustly measures the difference between the underlying correct expected weights of links and the specified generative m…
A new algorithm optimizes unknown functions with noisy data and unmatched features.
problem Sequentially maximizing a function with unknown and noisy data and features not under control.
method Bayesian conditional mean embedding and Gaussian process for uncertainty.
result Empirically outperforms state-of-the-art algorithms.
Dropout improves MIL performance on noisy WSI classification.
problem Noisy feature embeddings and weak supervision in MIL for WSI classification.
method Empirical exploration of dropout in MIL, proposing MIL-Dropout.
result MIL-Dropout boosts MIL performance with minimal computational cost.
Noise added to neural network features limits input reconstruction.
problem Protecting privacy during inference with deep neural networks.
method Hammersley-Chapman-Robbins bounds applied to noise added to neural network features.
result HCR bounds limit confidentiality but not accuracy.
We consider the problem of finding a target object t using pairwise comparisons, by asking an oracle questions of the form \emph{"Which object from the pair (i,j) is more similar to t?"}. Objects live in a space of latent features, from which the oracle generates noisy answers. First, we consider the {\em non-bli…
Proposes an ensemble framework for outlier detection with embedded feature selection.
problem Improving performance of outlier detection in noisy data.
method Unified feature selection and outlier detection, thresholded self-paced learning, alternate algorithm.
result The proposed framework ODEFS outperforms existing methods on real-world datasets.
Improves scalability and robustness of dynamic graph clustering.
problem Scalability and robustness issues in matrix factorization methods for dynamic graphs.
method Temporal separated matrix factorization, bi-clustering regularization, selective embedding updating.
result Demonstrated scalability, robustness, and effectiveness on synthetic and real-world benchmarks.
A new topology design improves zero-shot classification performance in contrastive learning.
problem Improving zero-shot classification performance in contrastive visual-textual alignment.
method Proposed an alternative topology design using multiple class tokens and an oblique manifold with negative inner product.
result Improves zero-shot classification performance by an average of 6.1%.
The performance of a Part-of-speech (POS) tagger is highly dependent on the domain ofthe processed text, and for many domains there is no or only very little training data available. This work addresses the problem of POS tagging noisy user-generated text using a neural network. We propose an architecture that trains a…
Compressed LLM embeddings improve noisy regression tasks without overfitting.
problem Noisy regression tasks with high signal-to-noise ratios.
method Comparison of embedding compression techniques using autoencoder hidden representations.
result Compression improves performance on noisy tasks like financial return prediction.
Recent research on network embedding in hyperbolic space have proven successful in several applications. However, nodes in real world networks tend to interact through several distinct channels. Simple aggregation or ignorance of this multiplexity will lead to misleading results. On the other hand, there exists redunda…
Extreme Multi-label classification (XML) is an important yet challenging machine learning task, that assigns to each instance its most relevant candidate labels from an extremely large label collection, where the numbers of labels, features and instances could be thousands or millions. XML is more and more on demand in…
A new contrastive learning method extracts asset embeddings from financial time series.
problem Extracting meaningful latent features from noisy financial data.
method Contrastive learning framework using hypothesis testing for positive and negative samples.
result Effective asset embeddings significantly outperform existing methods on financial tasks.
Kernel-spectral embedding learns low-dim. structures from noisy data.
problem Learning low-dimensional nonlinear structures from high-dimensional noisy data.
method Adaptive bandwidth spectral embedding using integral operators.
result Convergence to noiseless embeddings and eigenfunctions of integral operators.
Kernel method embeds noisy datasets, capturing shared structures.
problem Limited power in capturing nonlinear structures, noisiness, high-dimensionality, and interpretability issues.
method Kernel spectral joint embeddings using duo-landmark integral operators.
result Consistent recovery of low-dimensional noiseless signals and convergence to eigenfunctions of integral operators.
Measures time-delay embedding for noisy, sparse data.
problem Applying Takens' embedding theorem to real-world, noisy data.
method Formulated a measure-theoretic generalization of the embedding theorem, using optimal transport.
result Reconstructed full state of dynamical systems from time-lagged partial observations robust to noise and sparsity.
Introduces neural point-forms for learning geometric features from noisy point clouds.
problem Learning geometric features from noisy point clouds with missing tangency information.
method Uses Laplacian-based techniques to build comparison matrices for point clouds, proving consistency under various assumptions.
result Neural point-forms provide a competitive and interpretable representation, especially beneficial for dense or manifold-like structures.
This work proposes a hybrid method for error detection in noisy Knowledge Graphs.
problem Error detection in noisy Knowledge Graphs.
method Hybrid and modular approach combining path ranking and representation learning.
result Hybrid method outperforms individual methods on benchmarks and real-world dataset.
MPVAE learns latent embeddings and label correlations for multi-label classification.
problem Challenging task of predicting multiple targets with label correlations.
method Proposes MPVAE, a novel framework that learns latent embedding spaces and label correlations using a Multivariate Probit model.
result MPVAE outperforms state-of-the-art methods on various application domains and is robust under noisy settings.
We propose a spatial diffuseness feature for deep neural network (DNN)-based automatic speech recognition to improve recognition accuracy in reverberant and noisy environments. The feature is computed in real-time from multiple microphone signals without requiring knowledge or estimation of the direction of arrival, an…
Develops a method to estimate treatment effects using noisy proxies over time.
problem Estimating individualized treatment effects from noisy proxies of confounders.
method Deconfounding Temporal Autoencoder (DTA) combining autoencoder and causal regularization.
result Improves treatment effect estimates by leveraging noisy proxies and learning hidden confounders.
Theory and method for reducing prediction variance in noisy feature-subsampled ridge ensembles.
problem Reduction of prediction variance in noisy data with feature bagging.
method Developed analytical learning curves for noisy ridge ensembles, introduced heterogeneous feature ensembling.
result Subsampling shifts the double-descent peak, leading to improved performance over a single linear predictor.
This research tackles unsupervised topic extraction in noisy social media data.
problem Capturing customer insights from social media data is challenging due to noise and heterogeneity.
method The research presents three nonparametric approaches based on the Variational Autoencoder framework: Embedded Dirichlet Process, Embedded Hierarchical Dirichlet Process, and time-aware Dynamic Embedded Dirichlet Process.
result The models achieve equal to better performance than state-of-the-art methods in topic extraction from noisy social media data.
Paper relaxes symmetry conditions for universal feature selection in noisy data.
problem Feature selection in noisy data with weak symmetry.
method Developed a universal feature selection framework using singular value decomposition of canonical dependence matrix.
result Selected features achieve asymptotically optimal error exponents up to a residual term.
Beta-SOD detects and corrects noisy object re-identification using cosine similarity and Beta mixtures.
problem Noisy object re-identification in image datasets.
method Reframed Re-ID as a similarity task, using Siamese networks and Beta mixture models.
result Superior performance in noisy conditions compared to state-of-the-art methods.
We propose a novel probabilistic dimensionality reduction framework that can naturally integrate the generative model and the locality information of data. Based on this framework, we present a new model, which is able to learn a smooth skeleton of embedding points in a low-dimensional space from high-dimensional noisy…
Accuracy on in-distribution data correlates with out-of-distribution data when data is noisy or contains nuisance features.
problem Correlation between in-distribution and out-of-distribution accuracy in noisy or feature-rich data.
method Analyzes the impact of noise and nuisance features on model performance.
result Accuracy on in-distribution and out-of-distribution data can become negatively correlated in noisy or feature-rich data.
Improved speech enhancement with larger neural networks using novel embeddings and biases.
problem Decreased robustness of speech enhancement models to real-world use cases.
method Frequency-positional embeddings, semi-supervised training, biased loss function.
result Better performance on real recordings with improved large neural network architecture.
Paper tackles noisy labels by compressing feature representations.
problem Learning with noisy labels leads to overfitting and poor generalization.
method Introduces compression inductive bias using Dropout and Nested Dropout.
result Compression helps in combating label noise and improving performance.
Today's densely instrumented world offers tremendous opportunities for continuous acquisition and analysis of multimodal sensor data providing temporal characterization of an individual's behaviors. Is it possible to efficiently couple such rich sensor data with predictive modeling techniques to provide contextual, and…
Machine learning finds new natural laws from noisy data.
problem Discovery of natural laws relies on human inspiration.
method Recursive-LASSO-based symbolic regression (RLS) method.
result Data-driven formulation of natural laws from noisy data.
A new framework for generating predictive features in noisy multivariate time series.
problem Predicting noisy multivariate time series with limited user effort.
method Develops a feature programming framework based on spin-gas dynamical Ising models.
result Validated the method on synthetic and real-world datasets.
DIVI clusters noisy high-dimensional data with stable feature gating.
problem Challenging clustering in high-dimensional noisy data.
method Data-informed variational clustering framework combining global feature gating and adaptive structure growth.
result DIVI performs competitively under severe feature noise and remains computationally feasible.
This paper proposes an out-of-sample extension framework for a global manifold learning algorithm (Isomap) that uses temporal information in out-of-sample points in order to make the embedding more robust to noise and artifacts. Given a set of noise-free training data and its embedding, the proposed framework extends t…
Noisy Feature Mixup improves model robustness with noise-perturbed convex combinations.
problem Improving model robustness against data perturbations.
method Noise-perturbed convex combinations of pairs of data points in input and feature space.
result Improved model robustness and favorable trade-offs between accuracy and robustness.
In this paper we demonstrate continuous noisy speech recognition using connectionist temporal classification (CTC) model on limited Chinese vocabulary using electroencephalography (EEG) features with no speech signal as input and we further demonstrate single CTC model based continuous noisy speech recognition on limit…
Paper proposes a matrix optimization model for reliable Euclidean embedding from noisy data.
problem Challenges in Euclidean embedding from noisy observations containing outliers.
method Matrix optimization based embedding model to detect and remove outliers.
result The model provides high accuracy estimators and successfully identifies outliers.
We study contextual linear bandit problems under feature uncertainty, where the features are noisy and have missing entries. To address the challenges posed by this noise, we analyze Bayesian oracles given the observed noisy features. Our Bayesian analysis reveals that the optimal hypothesis can significantly deviate f…
A method to approximate instance-dependent label noise using instance-confidence embedding.
problem Real-world label noise that depends on individual instances.
method Variational approximation with instance embedding to capture instance-specific label corruption.
result ICE method effectively approximates instance-dependent noise and detects ambiguous instances.
Study tightens bounds for interpolating noisy data using minimum l1-norm.
problem Predicting noisy data with minimum l1-norm interpolation.
method Provided matching upper and lower bounds for prediction error.
result Tight consistency up to negligible terms for d≫n. The study analyzes how label noise affects deep learning feature learning.
problem The impact of label noise on deep learning feature learning.
method Theoretical analysis of a two-layer convolutional neural network under noisy label conditions.
result Two key stages identified: signal learning in Stage I and noise memorization in Stage II.
Enhances clustering quality evaluation in noisy data.
problem Reliable clustering quality assessment in noisy Gaussian mixtures.
method Feature Importance Rescaling (FIR) method.
result FIR improves correlation between cluster validity indices and ground truth.
New PINN architectures learn high-frequency features using Fourier features.
problem PINNs struggle with high-frequency or multi-scale features.
method Employ spatio-temporal and multi-scale random Fourier features.
result Effective PINN models for multi-scale PDEs.
Large-scale datasets may contain significant proportions of noisy (incorrect) class labels, and it is well-known that modern deep neural networks (DNNs) poorly generalize from such noisy training datasets. To mitigate the issue, we propose a novel inference method, termed Robust Generative classifier (RoG), applicable …
PGMs and GNNs differ in capturing network data; PGMs outperform GNNs in noisy and heterophily scenarios.
problem Comparing PGMs and GNNs in network data.
method Link prediction task with synthetic and real networks; three experiments on input features, noise, and heterophily.
result PGMs outperform GNNs in noisy and heterophily scenarios.
CAGNN learns graph embeddings without labels by clustering and refining graph topology.
problem Learning graph embeddings without labeled data.
method Cluster-aware graph neural network (CAGNN) with self-supervised learning and topology refinement.
result CAGNN achieves significant improvements in node clustering accuracy.
New method improves few-shot learning with noisy labels.
problem Robustness to label noise in few-shot learning.
method Feature aggregation and Transformer model for noisy samples.
result TraNFS outperforms other methods in noisy conditions.