A new method simplifies noisy data filtering for CNNs.
problem Training CNNs with noisy labels is challenging.
method Joint Negative and Positive Learning (JNPL) combines NL+ and PL+ loss functions.
result Significantly simplifies the pipeline, achieving state-of-the-art accuracy.
Paper proposes a new method to evaluate joint risk under uncertainty.
problem Evaluating joint risk of multiple insurance risks under dependence uncertainty.
method Axiomatic approach to scalar and vector-valued distortion joint risk measures.
result Established a new scalar distortion joint risk measure with positive homogeneity.
The paper explores the relationship between joint mixability and negative dependence structures.
problem Understanding the connection between joint mixability and various negative dependence concepts.
method Analyzes the properties of joint mixes and their relation to negative dependence structures.
result Derives necessary and sufficient conditions for a joint mix to be negatively dependent.
This is a continuation of the joint paper with the same title by A.Belenkiy and Yu.Burago. It is proved here that two homeomorphic closed Alexandrov surfaces (of bounded integral curvature) are bi-Lipschitz with a constant depending only on upper bounds of their Euler number, diameters, negative integral curvatures, an…
New method for PU learning with instance-dependent propensity scores.
problem Learning from positive and unlabeled data with instance-dependent labeling.
method Empirical risk minimization of joint risk function, alternating optimization of posterior probability and propensity score.
result The method achieves comparable or better performance than state-of-the-art methods.
Introduces joint exclusivity (JE), a new form of negative dependence.
problem Negative dependence structures in probability distributions.
method Defines JE by exclusion of the interior of the non-negative orthant, establishes necessary and sufficient conditions for existence, proposes a canonical construction.
result Sharp necessary and sufficient condition for existence of JE random vectors with prescribed marginals.
New method learns from either positive or negative feedback alone.
problem Limited applicability of existing preference optimization methods in scenarios with only unpaired feedback.
method Decouples learning from positive and negative feedback, using expectation-maximization (EM) to optimize probability of positive outcomes and explicitly incorporate negative examples.
result Stable learning from negative feedback alone demonstrated.
A new multi-label CPC method improves mutual information estimation and representation learning.
problem Underestimation of mutual information in contrastive predictive coding.
method Introducing a multi-label classification problem to overcome the logm bound in mutual information estimation. result The new method exceeds the logm bound and leads to better mutual information estimation and improved unsupervised representation learning. New method models stopping times that can be equal with non-zero probability.
problem Standard stopping time models assume conditional independence, limiting flexibility.
method Modified Cox construction with bivariate exponential distribution.
result Created a family of stopping times that can be equal with positive probability.
Develops a new framework for estimating joint probability distributions.
problem Estimating joint probability distributions from large sample sizes.
method Tensor product reproducing kernel Hilbert spaces (RKHS) with normalized and positive model.
result Fast computation and applicability to prediction and classification problems.
Paper tackles rDR classification and lesion segmentation using self-supervised equivariant learning and attention-based MIL.
problem Classifying rDR and segmenting lesions from image-level labels.
method Integrates self-supervised equivariant attention mechanism (SEAM) with attention-based multi-instance learning (MIL).
result Achieved AU ROC of 0.958 on Eyepacs dataset, outperforming state-of-the-art.
Study on pairwise counter-monotonicity, a type of negative dependence.
problem Understanding and quantifying extremal negative dependence structures.
method Established stochastic representation and invariance property; showed implications and connections.
result Pairwise counter-monotonicity implies negative association and joint mix dependence.
Dictionary leaning (DL) and dimensionality reduction (DR) are powerful tools to analyze high-dimensional noisy signals. This paper presents a proposal of a novel Riemannian joint dimensionality reduction and dictionary learning (R-JDRDL) on symmetric positive definite (SPD) manifolds for classification tasks. The joint…
Extends conformal prediction to contrastive learning for better coverage of positive samples.
problem Lack of principled guarantees on coverage in contrastive learning.
method Introduces minimum-volume covering sets with learnable constraints.
result Improves inclusion-exclusion trade-offs in positive and negative samples.
New insights into negative sampling for graph representation learning.
problem Challenges in generating high-quality graph representations for large node sets.
method Theoretical analysis and derivation of negative sampling distribution correlation, proposing MCNS method.
result The negative sampling distribution should be positively but sub-linearly correlated to the positive sampling distribution.
New methods learn from PU data with non-representative positives.
problem Learning from PU data with non-representative positive classes.
method Integrates negative-unlabeled and unlabeled-unlabeled learning, or uses a recursive risk estimator.
result Effective across various real-world datasets and forms of positive bias.
New DKPP family controls positive and negative dependence in random subsets.
problem Challenges in seamlessly bridging probabilistic models for positive and negative dependence.
method Introduced DKPP family and developed computational methods for probabilistic operations and inference.
result Controllability of positive and negative dependence demonstrated through numerical experiments.
The paper proposes methods to estimate positive examples and learn classifiers from mixed data.
problem Estimating the proportion of positive examples and learning classifiers from a mixture of positive and unlabeled data.
method Best Bin Estimation (BBE) for Mixture Proportion Estimation and Conditional Value Ignoring Risk (CVIR) for PU-learning.
result The proposed methods significantly improve both mixture proportion estimation and classifier learning.
We propose to formulate multi-label learning as a estimation of class distribution in a non-linear embedding space, where for each label, its positive data embeddings and negative data embeddings distribute compactly to form a positive component and negative component respectively, while the positive component and nega…
Enhances contrastive learning for better representation learning on wild images.
problem Binary partition of views from same and different instances limits CL's performance.
method Doubly Contrastive Learning (CACR) with contrastive attraction and repulsion.
result CACR improves performance and robustness on wild image datasets.
Paper proposes a new loss function for PU learning without negative examples.
problem Traditional machine learning struggles with negative examples, leading to biased predictions.
method Developed a collective loss function (cPU) for positive and unlabeled data.
result The cPU consistently outperforms existing methods in PU learning benchmarks and real-world datasets.
New method corrects skewed confidence for PbN classification.
problem Weakly supervised binary classification with biased negative data.
method Corrects skewed confidence in negative data to improve classifier.
result Reduces distortion in posterior probability for PbN classification.
Motivated by applications in protein function prediction, we consider a challenging supervised classification setting in which positive labels are scarce and there are no explicit negative labels. The learning algorithm must thus select which unlabeled examples to use as negative training points, possibly ending up wit…
This paper tackles negative transfer in multi-task learning by introducing class-wise weights.
problem Negative transfer hampers function from achieving optimality in multi-task learning.
method Introduces class-wise weights to drive positive transfer and suppress negative transfer.
result Demonstrates improved performance in multi-task learning by reducing negative transfer.
In supervised machine learning for author name disambiguation, negative training data are often dominantly larger than positive training data. This paper examines how the ratios of negative to positive training data can affect the performance of machine learning algorithms to disambiguate author names in bibliographic …
It was asked by J.Birman, Williams, and L.Rudolph whether nontrivial Lorentz knots have always positive signature. Lorentz knots are examples of positive braids (in our convention they have all crossings negative so they are negative links). It was shown by L.Rudolph that positive braids have positive signature (if the…
NMF with specific constraints is equivalent to LDA.
problem Dimensionality reduction of non-negative data.
method NMF with ℓ1 normalization constraints and Dirichlet prior. result NMF with these constraints is equivalent to LDA.
Proposes methods to estimate posterior probability and propensity score functions without assuming constant propensity score.
problem Learning from biased positive-unlabeled data.
method Parametric approach to joint estimation of posterior probability and propensity score functions using maximum likelihood and alternating maximization.
result Proposed methods are comparable or better than existing methods based on Expectation-Maximisation scheme.
Tests factor models by decomposing market into body and tail legs, revealing inconsistent results.
problem Inconsistency between factor models and market behavior.
method Decomposes market into body and tail legs, testing factor models at daily and monthly frequencies.
result q5 model shows inconsistent results, with negative body and positive tail alphas at all split ratios.
The Bartnik mass is a quasi-local mass tailored to asymptotically flat Riemannian manifolds with non-negative scalar curvature. From the perspective of general relativity, these model time-symmetric domains obeying the dominant energy condition without a cosmological constant. There is a natural analogue of the Bartnik…
We propose weighted inner product similarity (WIPS) for neural network-based graph embedding. In addition to the parameters of neural networks, we optimize the weights of the inner product by allowing positive and negative values. Despite its simplicity, WIPS can approximate arbitrary general similarities in…
Recommender systems play a crucial role in mitigating the problem of information overload by suggesting users' personalized items or services. The vast majority of traditional recommender systems consider the recommendation procedure as a static process and make recommendations following a fixed strategy. In this paper…
In reinforcement learning, a decision needs to be made at some point as to whether it is worthwhile to carry on with the learning process or to terminate it. In many such situations, stochastic elements are often present which govern the occurrence of rewards, with the sequential occurrences of positive rewards randoml…
The study examines symmetries in spaces with positive or non-negative curvature.
problem Understanding symmetries in spaces with curvature constraints.
method Survey of existing results for Riemannian manifolds with specified curvature properties and symmetries.
result Results on symmetries in spaces with curvature bounds.
Can we learn a binary classifier from only positive data, without any negative data or unlabeled data? We show that if one can equip positive data with confidence (positive-confidence), one can successfully learn a binary classifier, which we name positive-confidence (Pconf) classification. Our work is related to one-c…
Analyzing a comprehensive news dataset, we document that joint news coverage triggers attention contagion, causing temporarily inflated valuations for affected stocks. Tracing SEC EDGAR visits from unique IPs, we provide direct evidence of attention spillovers between stocks. Stocks with greater joint news coverage exh…
Voice Onset Time (VOT), a key measurement of speech for basic research and applied medical studies, is the time between the onset of a stop burst and the onset of voicing. When the voicing onset precedes burst onset the VOT is negative; if voicing onset follows the burst, it is positive. In this work, we present a deep…
A new method for PU learning improves classification error on CIFAR-10.
problem Learning from positive and unlabeled data in practical applications.
method A simple yet effective data augmentation method based on consistency regularization.
result Achieves an averaged improvement of 3.40 points in classification error on CIFAR-10.
Negative step sizes improve second-order methods for neural networks.
problem Second-order methods discard negative curvature, limiting their effectiveness.
method Introduce negative step sizes in second-order methods combined with Wolfe line search.
result Negative step sizes lead to global convergence and improved performance.
Paper proposes a new approach to stabilize GAN training by treating generated data as unlabeled.
problem Traditional GAN training treats generated data as negative, ignoring their potential quality.
method Defines positive and unlabeled classification for GANs, treating generated data as unlabeled.
result PUGAN achieves comparable or better performance than sophisticated discriminator stabilization methods.
In this paper we combine one method for hierarchical reinforcement learning - the options framework - with deep Q-networks (DQNs) through the use of different "option heads" on the policy network, and a supervisory network for choosing between the different options. We utilise our setup to investigate the effects of ar…
Constructs metrics with negative constant scalar curvature.
problem Negative constant scalar curvature metrics.
method One-parameter family of complete metrics.
result Verifies positive energy conjecture for these metrics.
A new method improves graph node embeddings by considering both nearby and distant node similarities.
problem Improving graph node embeddings by considering both nearby and distant node similarities.
method Distance-aware Negative Sampling (DNS) which maximizes cohesion at nearby node-pairs and separation at distant node-pairs.
result DNS outperforms baseline methods in downstream node classification tasks on various datasets and GRL algorithms.
Multi-task learning is a method for improving the generalizability of multiple tasks. In order to perform multiple classification tasks with one neural network model, the losses of each task should be combined. Previous studies have mostly focused on multiple prediction tasks using joint loss with static weights for tr…
A broad range of cross-m-domain generation researches boil down to matching a joint distribution by deep generative models (DGMs). Hitherto algorithms excel in pairwise domains while as m increases, remain struggling to scale themselves to fit a joint distribution. In this paper, we propose a domain-scalable DGM, i…
Study dynamic assortment and positioning of products with varying display effects.
problem Dynamic assortment and positioning of products with varying display effects.
method Design round-based learning algorithms for both multiplicative and general position effects models, and develop efficient subroutines for optimization.
result First regret-optimal characterization for both models, with matching upper and lower bounds.
Paper explains contrastive learning using cosine similarity and proposes mitigations for batch size effects.
problem Understanding and improving contrastive learning through batch size effects.
method Unified framework of cosine similarity, theoretical insights, and auxiliary loss.
result Performance improvement in small-batch settings through proposed auxiliary loss.
From only positive (P) and unlabeled (U) data, a binary classifier could be trained with PU learning, in which the state of the art is unbiased PU learning. However, if its model is very flexible, empirical risks on training data will go negative, and we will suffer from serious overfitting. In this paper, we propose a…