A new neural network model for ordinal regression.
problem Ordinal regression with non-proportional odds.
method Interpretable neural network for both continuous and discrete responses, training a non-linear neural network as a coefficient function.
result N3POM preserves interpretability while offering flexibility. Proposes a new method for rank-consistent ordinal regression without weight-sharing constraints.
problem Ordinal response variables in real-world prediction problems are often ignored by conventional classification losses.
method CORN framework using conditional training sets and the chain rule for conditional probability distributions.
result Improves performance substantially compared to the CORAL reference approach without weight-sharing restrictions.
Deep neural networks for ordinal outcomes combining image and tabular data.
problem Lack of interpretable models for ordinal outcomes in mixed data types.
method Ordinal Neural Network Transformation Models (ONTRAMs) integrating DL and classical ordinal regression.
result ONTRAMs achieve performance equivalent to standard multi-class DL models but are faster and more interpretable.
This paper applies deep learning to ordinal regression, modeling it as a binary search.
problem Ordinal regression with deep learning models.
method Formulated ordinal regression as a binary search problem, using recurrent neural networks.
result Deep learning model shows comparable or better predictive power compared to traditional methods.
In many real-world prediction tasks, class labels include information about the relative ordering between labels, which is not captured by commonly-used loss functions such as multi-category cross-entropy. Recently, the deep learning community adopted ordinal regression frameworks to take such ordering information into…
Neural network detects sex trafficking ads from escort websites.
problem Manual identification of sex trafficking ads from escort websites is inefficient and resource-intensive.
method Ordinal regression neural network with a modified cost function and deep learning enhancements.
result Significantly improved detection accuracy on Trafficking-10K dataset.
SurvCORN predicts survival curves using conditional ordinal ranking networks.
problem Challenges in survival analysis with censored data.
method SurvCORN: Conditional Ordinal Ranking Neural Network.
result SurvCORN improves accuracy in predicting time-to-event outcomes.
Develops multi-task learning models for ordinal regression with heterogeneous data.
problem Tackling ordinal regression for heterogeneous, non-IID data.
method Sparse and deep multi-task learning approaches.
result Proposed MTOR models improve prediction performance.
Simple non-convex methods outperform others in ordinal embedding.
problem Finding efficient Euclidean representations of abstract items using triplet comparisons.
method Comprehensive empirical evaluation of existing algorithms and a new neural network approach.
result Simple, non-convex methods consistently outperform other algorithms.
In this paper, we explore ordinal classification (in the context of deep neural networks) through a simple modification of the squared error loss which not only allows it to not only be sensitive to class ordering, but also allows the possibility of having a discrete probability distribution over the classes. Our formu…
This study introduces balanced DRPS and OrderedLogitNN for better QDE of discrete-level questions.
problem Lack of ordinal regression methods and fair evaluation metrics for discrete-level QDE.
method Introduces balanced DRPS and OrderedLogitNN, fine-tunes BERT on RACE++ and ARC datasets.
result OrderedLogitNN outperforms other models on complex QDE tasks.
New RNN model forecasts unseen time series with little training data.
problem Lack of data for RNNs to generalize well in time series forecasting.
method Proposes a novel RNN-based model that learns shared feature embeddings over quantised time series.
result Accurately forecasts unseen time series with minimal training data.
A new kernel measures brain network similarities, improving disease classification.
problem Lack of edge weight information in existing graph kernels for brain connectivity networks.
method Ordinal pattern kernel for weighted brain connectivity networks.
result The ordinal pattern kernel achieves better classification performance than state-of-the-art graph kernels.
BinConv improves time series forecasting by preserving ordinal information in a classification framework.
problem Lack of ordinal information in existing classification-based time series forecasting methods.
method Cumulative Binary Encoding (CBE) and BinConv architecture.
result BinConv achieves superior performance in time series forecasting compared to existing methods.
Study shows 'Ordinal Neural Collapse' in deep OR tasks, revealing simple geometric relationships.
problem Understanding neural collapse in deep Ordinal Regression tasks.
method Combining cumulative link models and Unconstrained Feature Model to investigate neural collapse.
result Demonstrates 'Ordinal Neural Collapse' (ONC) with three key properties.
Adapts deep reinforcement learning to ordinal rewards.
problem Using numerical rewards in reinforcement learning has drawbacks; ordinal rewards offer an alternative.
method Develops a general approach to converting reinforcement learning algorithms to ordinal reward systems, including Ordinal Deep Q-Networks.
result Ordinal Deep Q-Networks perform comparably to numerical variants on engineered problems and better on simpler reward signals.
Paper proposes a method to improve deep neural networks' confidence estimates.
problem Overconfident predictions limit practical use of deep neural networks in safety-critical applications.
method Proposes a novel loss function, Correctness Ranking Loss, to regularize class probabilities.
result The method produces well-ranked confidence estimates and is effective for out-of-distribution detection and active learning.
Neural model detects DD risk in 5-year-olds, predicting 2 years ahead.
problem Early detection of developmental dyslexia for preventive teaching.
method Mixed neural model using auto-encoder and ordinal regression.
result System predicts DD risk 2 years before phonological processing is assessed.
New model predicts persistent weather patterns better than persistence model.
problem Improving weather forecasting accuracy for persistent patterns.
method Mixture of experts model using ordinal neural network.
result The model outperforms persistence and other models for longer time horizon predictions.
A new scoring function improves ordinal regression by combining binary predictions.
problem Improving ordinal regression prediction accuracy.
method Introduces a cumulative sum scoring function to combine binary predictions.
result Simplified formulation and two online learning algorithms converge under rank separability condition.
Graph Convolutional Networks improve prosthetic sensation interpretation.
problem Improving neuroprosthetic performance and sensory information stability.
method Applied Graph Convolutional Networks (GCNs) to interpret neuronal spiking activity.
result GCN model achieved 73.5% performance on ordinal regression task.
This paper describes the participation of Amobee in the shared sentiment analysis task at SemEval 2018. We participated in all the English sub-tasks and the Spanish valence tasks. Our system consists of three parts: training task-specific word embeddings, training a model consisting of gated-recurrent-units (GRU) with …
The paper introduces a method to assess the reliability of model explanations.
problem Assessing the quality and reliability of model explanations.
method An Ordinal Consensus Approach using diverse bootstrapped surrogate explainers.
result Uncertainty estimates offer actionable insights beyond standard surrogate explainers.
We consider the problem of embedding unweighted, directed k-nearest neighbor graphs in low-dimensional Euclidean space. The k-nearest neighbors of each vertex provides ordinal information on the distances between points, but not the distances themselves. We use this ordinal information along with the low-dimensionality…
Proposes models to better represent ordinal data with non-unimodal distributions.
problem Real-world ordinal data often have non-unimodal conditional probability distributions.
method Develops approximately unimodal likelihood models to better represent non-unimodal CPDs.
result Proposed models can effectively represent both unimodal and nearly unimodal CPDs.
Proposes a new deep ordinal classification model enforcing label uni-modality.
problem Deep ordinal classification with label consistency issues.
method Non-parametric uni-modality constraints via inequality constraints.
result Improves scalability and performance in ordinal classification tasks.
Paper proposes an unbiased classifier from triplet comparison data.
problem Learning a classifier from triplet comparison data.
method Empirical risk minimization framework with an unbiased estimator.
result The proposed method achieves better performance than baseline methods.
Facial Key Points (FKPs) Detection is an important and challenging problem in the fields of computer vision and machine learning. It involves predicting the co-ordinates of the FKPs, e.g. nose tip, center of eyes, etc, for a given face. In this paper, we propose a LeNet adapted Deep CNN model - NaimishNet, to operate o…
Neural sorting network improves sorting accuracy for complex inputs.
problem Sorting complex inputs like multi-digit images.
method Differentiable swap function and permutation-equivariant Transformer network.
result Our method outperforms baseline methods on various sorting benchmarks.
Proposes a deep learning method for robust ordinal regression under label noise.
problem Label noise in real-world data constrains ordinal regression algorithms.
method Develops a deep learning approach that is robust to label noise and rank consistent.
result Demonstrates robustness to label noise and rank consistency on real data.
A new framework estimates causal effects for ordinal variables.
problem Existing causal inference methods fail for ordinal data.
method Presumes a latent Gaussian DAG model with constrained covariance matrix.
result Closed-form function for ordinal causal effects in latent space.
New method uniquely identifies causal structure from ordinal data.
problem Challenges in causal discovery for categorical data, especially direction of relationships.
method Exploits ordinal information to uniquely identify causal structure.
result Favorable and robust performance compared to state-of-the-art methods.
Binary feedback outperforms ordinal comparisons in ranking recovery.
problem Challenges the conventional wisdom that ordinal comparisons offer richer information.
method Proposes a parametric framework for modeling ordinal paired comparisons, binarizing ordinal data, and proving faster convergence rates for binary comparisons.
result Binarizing ordinal data significantly improves ranking recovery accuracy and exhibits a substantial performance gap.
New methods for ordinal classification of interval-valued data and functional data.
problem Ordinal classification of interval-valued data and functional data.
method Six ordinal classifiers are proposed, including parametric, binary decomposition, logistic regression, distance-based, k-nearest-neighbor, kernel PCA, and random forest methods.
result Considering ordering and interval-valued information improves the accuracy of ordinal classification.
Probability distributions produced by the cross-entropy loss for ordinal classification problems can possess undesired properties. We propose a straightforward technique to constrain discrete ordinal probability distributions to be unimodal via the use of the Poisson and binomial probability distributions. We evaluate …
New method estimates and completes tensors from ordinal data, improving accuracy and efficiency.
problem Estimating and completing tensors from incomplete, ordinal observations.
method Multi-linear cumulative link model with rank-constrained M-estimator.
result The proposed estimator achieves faster convergence and is minimax optimal.
Paper proposes FOFE for efficient WSD.
problem Word sense disambiguation (WSD) problem.
method Fixed-size ordinally forgetting encoding (FOFE) combined with FFNN.
result FOFE-based FFNN achieves comparable performance to state-of-the-art at lower cost.
Optimal bounds proven for ordinal embedding convergence rate.
problem Optimal bounds for ordinal embedding convergence rate in 1D.
method Utilized results from additive number theory and conducted computational experiments.
result Proved optimal bounds for convergence rate in 1D.
This paper proposes CF-NADE, a neural autoregressive architecture for collaborative filtering (CF) tasks, which is inspired by the Restricted Boltzmann Machine (RBM) based CF model and the Neural Autoregressive Distribution Estimator (NADE). We first describe the basic CF-NADE model for CF tasks. Then we propose to imp…
Improves regression accuracy by using multiple discrete representations.
problem Improving regression accuracy using deep learning.
method Proposes using multiple discrete representations simultaneously for regression problems.
result Reduces prediction error compared to a baseline RvC approach.
Study homeomorphism groups of ordinals, proving strong distortion and normal generators.
problem Understanding algebraic and geometric properties of homeomorphism groups of ordinals.
method Analyzing successor ordinals with connections to permutation groups and manifolds.
result Proves strong distortion and normal generators for homeomorphism groups of ordinals.
Ordinal embedding methods estimate perceptual scales from relative judgments.
problem Measuring subjective sensation using relative judgments.
method Ordinal embedding from machine learning applied to method of triads.
result Ordinal embedding allows estimating perceptual scales from few judgments, non-monotonous functions, and multi-dimensional scales.
Identifies feature relevance bounds for ordinal regression models.
problem Interpreting ordinal regression models is challenging due to variable dependencies.
method Identifies feature relevance bounds explicitly differentiating between strongly and weakly relevant features.
result Identification of feature relevance bounds for ordinal regression models.
Ordinal regression is aimed at predicting an ordinal class label. In this paper, we consider its semi-supervised formulation, in which we have unlabeled data along with ordinal-labeled data to train an ordinal regressor. There are several metrics to evaluate the performance of ordinal regression, such as the mean absol…
Develops an ordinal-similarity framework for scalable and interpretable representation alignment.
problem Measuring representation similarity in large datasets.
method Triplet and Quadruplet Similarity Indices.
result Demonstrates inherent interpretability, robustness to outliers, and computational efficiency.
Ordinal data are often seen in real applications. Regular multicategory classification methods are not designed for this data type and a more proper treatment is needed. We consider a framework of ordinal classification which pools the results from binary classifiers together. An inherent difficulty of this framework i…
When eliciting judgements from humans for an unknown quantity, one often has the choice of making direct-scoring (cardinal) or comparative (ordinal) measurements. In this paper we study the relative merits of either choice, providing empirical and theoretical guidelines for the selection of a measurement scheme. We pro…
Landmark Ordinal Embedding improves scalability of ordinal embedding.
problem Learning low-dimensional Euclidean representations from ordinal constraints.
method Landmark-based strategy (LOE) that trades statistical efficiency for computational efficiency.
result LOE is significantly more efficient than conventional methods as the number of items grows.