Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

8.3%16.7%25.0%33.3% · Jan 199319922001200920172026
48 results for image preprocessing

Enhances diffusion models by preprocessing data to improve reconstruction quality.

problem Slow sampling and poor reconstruction quality in diffusion models, especially for small-scale networks.
method Applying Gaussianization preprocessing to the training data to make the target distribution more Gaussian-like.
result Improves generation quality, especially in the early stages of reconstruction with small networks.

Recently the GAN generated face images are more and more realistic with high-quality, even hard for human eyes to detect. On the other hand, the forensics community keeps on developing methods to detect these generated fake images and try to guarantee the credibility of visual contents. Although researchers have develo…

2019-02-27abs ↗pdf ↗

A framework uses preprocessing to improve psychiatric questionnaire predictions while maintaining interpretability.

problem Weak predictive accuracy and limited interpretability of psychiatric questionnaires.
method Two-stage method: stable preprocessing followed by a linear mapping.
result REFINE outperforms other interpretable approaches in psychiatric and non-psychiatric prediction tasks.

Unsupervised anomaly detection aids doctors in evaluating X-ray images of hands.

problem Lack of labeled medical data and ambiguous symptoms in X-ray images.
method Adopting state-of-the-art unsupervised learning methods for anomaly detection and preprocessing.
result Without preprocessing, unsupervised methods perform randomly on X-ray images of hands.

TorchIO simplifies medical image processing for deep learning.

problem Challenges in processing medical images like MRI and CT.
method Efficient loading, preprocessing, augmentation, and patch-based sampling.
result Enables researchers to focus on deep learning experiments.

The paper simplifies quickshift hyperparameter tuning for larger images.

problem Understanding and tuning hyperparameters for quickshift image segmentation.
method Theoretical analysis of a modified quickshift algorithm for homogeneous patches with i.i.d. noise.
result A heuristic to scale quickshift hyperparameters based on image size.

This study automates blood cell classification using computer vision.

problem Automated detection and classification of white blood cells.
method Color-based segmentation, morphological processing, feature extraction, PCA, Unsupervised and Supervised learning algorithms, Deep Convolutional Neural Networks.
result Identification of robust algorithms for automated blood cell classification.

DELIMIT is a framework extension for deep learning in diffusion imaging, which extends the basic framework PyTorch towards spherical signals. Based on several novel layers, deep learning can be applied to spherical diffusion imaging data in a very convenient way. First, two spherical harmonic interpolation layers are a…

2018-08-04abs ↗pdf ↗

Data preprocessing techniques are devoted to correct or alleviate errors in data. Discretization and feature selection are two of the most extended data preprocessing techniques. Although we can find many proposals for static Big Data preprocessing, there is little research devoted to the continuous Big Data problem. A…

2018-10-14abs ↗pdf ↗

SaR-SVM-STV improves hyperspectral image classification with shape-adaptive reconstruction and denoising.

problem Classifying hyperspectral images with limited labeled data.
method Shape-adaptive Reconstruction (SaR) for pixel preprocessing, SVM for probability estimation, and Smoothed Total Variation (STV) for denoising.
result SaR-SVM-STV outperforms SVM-STV with fewer labeled data.

SVMs improve forest fire detection accuracy on challenging datasets.

problem Rapid and accurate detection of forest fires.
method Training SVMs on labeled fire image datasets, focusing on data preprocessing, feature extraction, and model training.
result SVMs enhance detection accuracy on complex datasets, revealing key parameters affecting performance.

Spectral methods improve parameter estimation in structured GLMs.

problem Parameter estimation in high-dimensional generalized linear models with structured data.
method Spectral methods using the principal eigenvector of a data-dependent matrix, with preprocessing for optimal performance.
result Precise asymptotic performance characterization and optimal preprocessing identified.

Enhances solar flare prediction with advanced preprocessing and contrastive learning.

problem Accurate prediction of solar flares to mitigate risks to astronauts and equipment.
method Advanced data preprocessing pipeline and contrastive learning with GRU regression model.
result Exceptional True Skill Statistic (TSS) scores, surpassing previous methods.

TensorShield defends images from adversarial attacks using tensor decomposition.

problem Adversarial attacks on images can fool deep neural networks.
method Tensor decomposition to find low-rank approximations of images, reducing high-frequency perturbations.
result TensorShield outperforms existing methods like SLQ by 14% against FGSM attacks.

This paper uses feature preprocessing and RRL to automate profitable financial trading.

problem Automating profitable financial trading strategies.
method Feature preprocessing (PCA, DWT) followed by Recurrent Reinforcement Learning (RRL).
result The proposed strategy is effective, robust, and mitigates RRL's drawbacks.

This study compares different data preprocessing methods for gait analysis.

problem Improving the generalizability of machine learning models in gait analysis.
method Compared various data preprocessing steps including filtering, time derivative, normalization, and scaling.
result Different preprocessing combinations affect gait classification performance.

Proposes a new feature preprocessing method using kernel density integral transformation.

problem Feature preprocessing for tabular data in machine learning and statistics.
method Kernel density integral transformation as a drop-in replacement or improved alternative to min-max scaling and quantile transformation.
result Frequently outperforms min-max scaling and quantile transformation with hyperparameter tuning.

We present a new method for uncertainty estimation and out-of-distribution detection in neural networks with softmax output. We extend softmax layer with an additional constant input. The corresponding additional output is able to represent the uncertainty of the network. The proposed method requires neither additional…

2018-10-03abs ↗pdf ↗

We explore several oversampling techniques for an imbalanced multi-label classification problem, a setting often encountered when developing models for Computer-Aided Diagnosis (CADx) systems. While most CADx systems aim to optimize classifiers for overall accuracy without considering the relative distribution of each …

2018-07-07abs ↗pdf ↗

New method speeds up neural network training by preprocessing weight-data correlation.

problem Slow neural network training due to high time complexity.
method Stores weight-data correlation in a tree structure for quick detection of firing neurons.
result Achieves o(nmd)o(nmd) time per iteration with only O(nmd)O(nmd) preprocessing time.

Data mining is about obtaining new knowledge from existing datasets. However, the data in the existing datasets can be scattered, noisy, and even incomplete. Although lots of effort is spent on developing or fine-tuning data mining models to make them more robust to the noise of the input data, their qualities still st…

2019-06-20abs ↗pdf ↗

Image segmentation is widely used in a variety of computer vision tasks, such as object localization and recognition, boundary detection, and medical imaging. This thesis proposes deep learning architectures to improve automatic object localization and boundary delineation for salient object segmentation in natural ima…

2019-09-19abs ↗pdf ↗

RODMAN improves ML-based disk failure prediction accuracy in cloud environments.

problem Imperfect data quality in real-world cloud environments degrades ML-based disk failure prediction accuracy.
method RODMAN uses three data preprocessing techniques: failure-type filtering, spline-based data filling, and automated pre-failure backtracking.
result RODMAN significantly improves prediction accuracy compared to no preprocessing.