Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,181 papers · 148 categories

Trend · papers per month

106213319425 · Jun 202019922001200920182026
48 results for thresholded feature

Paper develops DLTF to learn optimized dictionaries for efficient thresholded feature recovery.

problem Efficiently recover sparse code support from time-consuming sparse coding.
method Formulates DLTF model to learn optimized dictionary for thresholded feature, derives log-linear time proximal operator.
result DLTF model demonstrates remarkable efficiency, effectiveness, and robustness in various tasks.

The article examines different thresholding methods for improving PAM algorithm in cancer classification.

problem High-dimensional classification with too many features selected by PAM.
method Extends PAM with hard and order thresholding methods and a deep search algorithm.
result Improved cancer status prediction accuracy and smaller number of features.

NeuralFDR learns optimal discovery thresholds from hypothesis features.

problem Maximizing useful discoveries while controlling false positives in rich datasets.
method Proposes NeuralFDR, a neural network that learns a discovery threshold as a function of hypothesis features.
result Demonstrates substantially more discoveries and interpretable learned thresholds in synthetic and real datasets.

Multi-task feature learning aims to identity the shared features among tasks to improve generalization. It has been shown that by minimizing non-convex learning models, a better solution than the convex alternatives can be obtained. Therefore, a non-convex model based on the capped-1,1\ell_{1},\ell_{1} regularization wa…

2014-06-16abs ↗pdf ↗

We study graph matching with correlated Gaussian features and find thresholds for exact recovery.

problem Graph matching with correlated Gaussian features.
method Information-theoretic thresholds and conditions for exact and almost exact recovery.
result Contextual information introduces a richer structure, with thresholds for exact and almost exact recovery no longer coinciding.

Lower bound proves ridgeless regression performs poorly near interpolation threshold.

problem Proving performance of ridgeless regression near interpolation threshold.
method Distribution-independent lower bound for mean squared error in noisy ridgeless linear regression.
result Lower bound implies ridgeless regression performs poorly near interpolation threshold.

Consider a two-class classification problem where the number of features is much larger than the sample size. The features are masked by Gaussian noise with mean zero and covariance matrix ΣΣ, where the precision matrix Ω=Σ1Ω=Σ^{-1} is unknown but is presumably sparse. The useful features, also unknown, are sparse and e…

2012-12-21abs ↗pdf ↗

In active learning, the user sequentially chooses values for feature XX and an oracle returns the corresponding label YY. In this paper, we consider the effect of feature noise in active learning, which could arise either because XX itself is being measured, or it is corrupted in transmission to the oracle, or the o…

2015-05-15abs ↗pdf ↗

Study connects database alignment and planted matching using Gaussian features.

problem Identify matching between correlated user features in anonymized databases.
method Derived results for database alignment and planted matching, showing connections and thresholds.
result Performance thresholds for database alignment converge to planted matching when feature dimensionality is sufficiently high.

It has recently been observed that certain extremely simple feature encoding techniques are able to achieve state of the art performance on several standard image classification benchmarks including deep belief networks, convolutional nets, factored RBMs, mcRBMs, convolutional RBMs, sparse autoencoders and several othe…

2012-08-04abs ↗pdf ↗

Proposes ACLAE-DT for unsupervised anomaly detection in multivariate time series.

problem Challenges in building anomaly detection frameworks for multivariate time series data.
method Attention-based ConvLSTM Autoencoder with Dynamic Thresholding.
result Demonstrates superior performance over state-of-the-art methods.

HARFE approximates sparse additive functions using random features and ridge regression.

problem Approximating high-dimensional sparse additive functions.
method Hard-ridge random feature expansion with sparse ridge regression and hard-thresholding pursuit.
result HARFE method converges with a given error bound and achieves lower error than other algorithms.

New method provides calibrated feature importance explanations for regression models.

problem Lack of uncertainty quantification in existing local explanation methods.
method Extension of Calibrated Explanations method to support regression and probabilistic regression.
result Calibrated Explanations for regression provides quantified uncertainty and robust explanations.

Neural regression trees convert regression to classification more effectively.

problem Suboptimal approaches for regression via classification.
method Joint optimization framework for learning optimal discretization thresholds and feature selection in a neural regression tree.
result Empirically validated as state-of-the-art on challenging regression tasks.

The paper tackles fair classification with multiple sensitive features.

problem Existing fair classification methods often consider a single sensitive feature, but in practice, individuals are defined by multiple sensitive features.
method Characterizes Bayes-optimal fair classifiers for multiple sensitive features under various fairness measures, proposing in-processing and post-processing algorithms.
result Bayes-optimal fair classifiers for multiple sensitive features are instance-dependent thresholding rules that rely on a weighted sum of group membership probabilities.

FILTER model uses fusion penalized logistic threshold regression for high-dimensional data with unknown cut points.

problem Modeling high-dimensional data with unknown cut points and binary responses.
method Fusion penalized logistic threshold regression (FILTER) model with fused lasso penalty for variable selection.
result Established non-asymptotic error bounds for coefficient estimation and model selection consistency.

Proposes an ensemble framework for outlier detection with embedded feature selection.

problem Improving performance of outlier detection in noisy data.
method Unified feature selection and outlier detection, thresholded self-paced learning, alternate algorithm.
result The proposed framework ODEFS outperforms existing methods on real-world datasets.

A new algorithm detects out-of-distribution samples by concentrating them in feature space.

problem Building safe AI systems requires effective out-of-distribution detection.
method The paper proposes a novel algorithm based on the observation that OoD samples concentrate in feature space.
result The algorithm achieves state-of-the-art performance on various OoD detection benchmarks.

STAT-SVD method reduces high-dimensional data sparsity, achieving optimal estimation.

problem Sparse tensor singular value decomposition for high-dimensional data.
method STAT-SVD method with double projection & thresholding scheme.
result STAT-SVD provides sharp thresholding criterion and minimax rate-optimal estimation.

A hierarchical model shows how scaling laws emerge from sequential feature recovery.

problem Emergence of scaling laws from feature learning in multi-layer networks.
method Layer-wise spectral algorithm adapted to compositional structure, sequential feature detection.
result Sequential detection of latent features, leading to explicit power-law decay of prediction error.

New algorithm adds discretized features to improve predictive models.

problem Improving predictive models using continuous features.
method D-MIAT algorithm for supervised discretization and feature extension.
result Combination of original data and D-MIAT-generated features yields best predictive performance.

Study shows 'Ordinal Neural Collapse' in deep OR tasks, revealing simple geometric relationships.

problem Understanding neural collapse in deep Ordinal Regression tasks.
method Combining cumulative link models and Unconstrained Feature Model to investigate neural collapse.
result Demonstrates 'Ordinal Neural Collapse' (ONC) with three key properties.

New feature selection method DRPT reduces genomic datasets by removing irrelevant features and detecting correlations.

problem Feature selection in high-dimensional genomic datasets.
method DRPT method: 1. Remove irrelevant features, 2. Detect correlations in reduced matrix.
result DRPT outperforms state-of-the-art methods in feature selection over multiple genetic datasets.

Develops a statistical test for IV, improving feature selection reliability.

problem Lack of statistical justification in conventional IV-based feature selection.
method Establishes connection with Jeffreys divergence and proposes a nonparametric hypothesis test.
result The J-Divergence test provides rigorous guarantees and is more reliable than traditional IV thresholds.

Critical volatility triggers log-normal to power-law transitions in interconnected systems.

problem Understanding the transition from log-normal to power-law distributions in interconnected systems.
method Analyzing an infinite option-on-option chain model, deriving a critical volatility threshold.
result A critical volatility threshold of approximately 250.66% for unconditional cases, dropping to 125.3% with selective survival.

The robust PCA problem, wherein, given an input data matrix that is the superposition of a low-rank matrix and a sparse matrix, we aim to separate out the low-rank and sparse components, is a well-studied problem in machine learning. One natural question that arises is that, as in the inductive setting, if features are…

2017-04-02abs ↗pdf ↗

The study examines when to trust confidence thresholding in pseudo-labelling regression.

problem Calibrated probabilities from classifiers used for pseudo-labelling need careful handling to avoid bias in downstream regression.
method Developed a diagnostic apparatus to predict and bound the bias induced by confidence thresholding, derived a closed-form expression for the attenuation bias.
result The bias can be predicted from the residual score variance VV^{*}, motivating a structural separation between classifier features and downstream controls.

DNF-Net tackles tabular data challenges with neural architecture.

problem Handling tabular data efficiently using neural networks.
method DNF-Net uses a neural architecture with inductive bias corresponding to logical Boolean formulas in disjunctive normal form over affine soft-threshold decision terms.
result DNF-Net significantly outperforms fully connected networks on tabular data.

Supervised linear feature extraction can be achieved by fitting a reduced rank multivariate model. This paper studies rank penalized and rank constrained vector generalized linear models. From the perspective of thresholding rules, we build a framework for fitting singular value penalized models and use it for feature …

2010-07-19abs ↗pdf ↗

This work efficiently learns linear threshold functions from label proportions using Gaussian distributions.

problem Efficiently learning linear threshold functions from label proportions.
method Using Gaussian distributions, the algorithm estimates means and covariance matrices, and identifies a low error hypothesis LTF.
result It is possible to efficiently learn LTFs using LTFs when given access to random bags of label proportions.

A new method monitors unstructured 3D shapes without registration.

problem Error-prone registration and mesh reconstruction steps in PCD monitoring.
method Intrinsic geometric properties of shapes, using Laplacian and geodesic distances.
result Effective monitoring of defects without registration and mesh reconstruction.

SISR improves feature attribution in complex payoff schemes.

problem Distorted feature attributions due to non-additive payoff functions and high-dimensional feature spaces.
method Sparse Isotonic Shapley Regression (SISR) learns a monotonic transformation to restore additivity and enforces L0 sparsity.
result SISR achieves strong support recovery and stable attributions across various payoff schemes.

Deep CNNs improve technical forecasting accuracy.

problem Improving financial forecasting accuracy using machine learning.
method Reframed technical analysis as feature-extractive layer in CNNs, optimizing over different resolutions.
result Ensemble of shallow, thresholded CNNs outperforms technical methods.