Study null hypersurfaces with privileged vector fields, extending surface gravity and defining new horizon types.
problem Characterize null hypersurfaces with privileged vector fields and extend surface gravity.
method Derive identities relating deformation tensor to intrinsic and extrinsic geometry, introduce generalized surface gravity, analyze Lie derivatives, and define new horizon types.
result Introduce three new horizon types that generalize existing concepts to arbitrary topologies and fixed points.
In this paper we attempt to give a systematic account on privileged coordinates and the nilpotent approximation of Carnot manifolds. By a Carnot manifold it is meant a manifold with a distinguished filtration of subbundles of the tangent bundle which is compatible with the Lie bracket of vector fields. This paper lies …
Proposed SMO algorithm for OC-SVM+ significantly outperforms non-sequential algorithms.
problem One-class SVM with privileged information
method Sequential Minimal Optimization (SMO) algorithm
result Finite-time convergence established
This paper is a sequel of arxiv:1709.09045 and deals with privileged coordinates and nilpotent approximation of Carnot manifolds. By a Carnot manifold it is meant a manifold equipped with a filtration by subbundles of the tangent bundle which is compatible with the Lie bracket of vector fields. In this paper, we single…
Kernel method-based one-class classifier is mainly used for outlier or novelty detection. In this letter, kernel ridge regression (KRR) based one-class classifier (KOC) has been extended for learning using privileged information (LUPI). LUPI-based KOC method is referred to as KOC+. This privileged information is availa…
We construct a privileged system of coordinates with respect to the controlling distribution of a trident snake robot and, furthermore, we construct a nilpotent approximation with respect to the given filtration. Note that all constructions are local in the neighbourhood of a particular point. We compare the motions co…
We introduce a new unsupervised anomaly detection ensemble called SPI which can harness privileged information - data available only for training examples but not for (future) test examples. Our ideas build on the Learning Using Privileged Information (LUPI) paradigm pioneered by Vapnik et al. [19,17], which we extend …
MPWTSVM improves multi-view learning by reducing redundancy and enhancing accuracy.
problem Improving multi-view learning models for better accuracy and efficiency.
method Proposes MPWTSVM, which combines WLTSVM's strengths with multi-view learning principles.
result Demonstrates better accuracy and efficiency compared to existing multi-view classification models.
We introduce a learning framework called learning using privileged information (LUPI) to the computer vision field. We focus on the prototypical computer vision problem of teaching computers to recognize objects in images. We want the computers to be able to learn faster at the expense of providing extra information du…
Study on Privileged ERM showing limitations and providing capacity analysis.
problem Improving classification accuracy with privileged information.
method Theoretical analysis of Privileged ERM using VC dimension and generalization bounds.
result Worst-case guarantees for Privileged ERM cannot improve over standard ERM unless privileged information capacity is similar or smaller.
Introduces homogeneity supermanifolds for studying graded structures.
problem Graded structures on supermanifolds.
method Homogeneity degrees and weight vector field.
result Proofs of homogeneous Poincaré Lemma, Frobenius Theorem, and Darboux Theorem.
Privileged Information Dropout improves RL performance without distillation.
problem Improving sample efficiency and performance in reinforcement learning.
method Introducing Privileged Information Dropout to directly incorporate privileged information into RL agent inputs.
result Privileged Information Dropout outperforms distillation and auxiliary tasks in a partially-observed environment.
Introduces privilege scores to measure and interpret protected attribute-related privilege in machine learning models.
problem Lack of explicit formulation of non-neutrality in fairness-aware machine learning methods.
method Privilege scores (PS) and privilege score contributions (PSCs) to measure and interpret protected attribute-related privilege.
result Demonstrates the broad applicability of PS and PSCs in gender and racial privilege in mortgage and college admissions applications.
A number of important applied problems in engineering, finance and medicine can be formulated as a problem of anomaly detection. A classical approach to the problem is to describe a normal state using a one-class support vector machine. Then to detect anomalies we quantify a distance from a new observation to the const…
Study shows using time-series privileged information improves model efficiency.
problem Efficiently predicting future outcomes using supervised models with privileged information.
method Developed an algorithm for learning with privileged time-series data and proved its efficiency for non-stationary Gaussian-linear systems.
result Learning with privileged information is more efficient than without it for non-stationary Gaussian-linear systems.
Learning using privileged information is an attractive problem setting that helps many learning scenarios in the real world. A state-of-the-art method of Gaussian process classification (GPC) with privileged information is GPC+, which incorporates privileged information into a noise term of the likelihood. A drawback o…
The learning with privileged information setting has recently attracted a lot of attention within the machine learning community, as it allows the integration of additional knowledge into the training process of a classifier, even when this comes in the form of a data modality that is not available at test time. Here, …
Prior knowledge can be used to improve predictive performance of learning algorithms or reduce the amount of data required for training. The same goal is pursued within the learning using privileged information paradigm which was recently introduced by Vapnik et al. and is aimed at utilizing additional information avai…
Enhances reinforcement learning with partial state information.
problem Improving learning under partial observability with limited privileged signals.
method Introduced informed asymmetric actor-critic framework that uses arbitrary state-dependent privileged signals.
result Unbiased policy gradient estimates with arbitrary privileged signals.
This paper presents privileged multi-label learning (PrML) to explore and exploit the relationship between labels in multi-label learning problems. We suggest that for each individual label, it cannot only be implicitly connected with other labels via the low-rank constraint over label predictors, but also its performa…
Unsupervised domain adaptation improves with privileged information.
problem Domain adaptation under covariate shift and overlap limitations.
method Two-stage learning algorithm inspired by expected error analysis.
result Using privileged information reduces errors and increases sample efficiency.
New insights and algorithms improve prediction models with time-series privileged information.
problem Efficient learning of nonlinear prediction models with limited data.
method Generalization of LuPI to nonlinear tasks, using random features and representation learning.
result Theoretical and empirical evidence supports the use of privileged time-series information for nonlinear prediction.
Proposes a new method to selectively access privileged information in reinforcement learning.
problem Selective compression of privileged information in reinforcement learning.
method Formulates a variational bandwidth bottleneck to decide stochastically whether to access privileged information.
result Improves generalization and reduces access to costly information in reinforcement learning experiments.
Learning using privileged information (LUPI) is a powerful heterogenous feature space machine learning framework that allows a machine learning model to learn from highly informative or privileged features which are available during training only to generate test predictions using input space features which are availab…
This paper explores conformal prediction in the learning under privileged information (LUPI) paradigm. We use the SVM+ realization of LUPI in an inductive conformal predictor, and apply it to the MNIST benchmark dataset and three datasets in drug discovery. The results show that using privileged information produces va…
New research suggests privileged information doesn't improve model performance.
problem Challenges in transferring knowledge using privileged information in machine learning.
method Critical examination of existing theoretical and empirical analyses of LUPI methods.
result LUPI methods often fail to effectively transfer knowledge from privileged information.
For well over a quarter century, detection systems have been driven by models learned from input features collected from real or simulated environments. An artifact (e.g., network event, potential malware sample, suspicious email) is deemed malicious or non-malicious based on its similarity to the learned model at runt…
Unlike machines, humans learn through rapid, abstract model-building. The role of a teacher is not simply to hammer home right or wrong answers, but rather to provide intuitive comments, comparisons, and explanations to a pupil. This is what the Learning Under Privileged Information (LUPI) paradigm endeavors to model b…
The question of how best to estimate a continuous probability density from finite data is an intriguing open problem at the interface of statistics and physics. Previous work has argued that this problem can be addressed in a natural way using methods from statistical field theory. Here I describe new results that allo…
Improved meta-learning for dynamics using additional structured knowledge.
problem Meta-learning for dynamics with limited raw observations.
method Extended Neural ODE Process model to use privileged information.
result Improved accuracy and calibration on simulated dynamics tasks.
Distillation (Hinton et al., 2015) and privileged information (Vapnik & Izmailov, 2015) are two techniques that enable machines to learn from other machines. This paper unifies these two techniques into generalized distillation, a framework to learn from multiple machines and data representations. We provide theoretica…
Guided by the Hopf fibration, we single out a family (indexed by a positive constant K) of right invariant Riemannian metrics on the Lie group S3. Using the Yasuda-Shimada theorem as an inspiration, we determine for each K>1 a privileged right invariant Killing field of constant length. Each such Riemannian metric p…
Many machine learning algorithms assume that all input samples are independently and identically distributed from some common distribution on either the input space X, in the case of unsupervised learning, or the input and output space X x Y in the case of supervised and semi-supervised learning. In the last number of …
We adopt a multi-view approach for analyzing two knowledge transfer settings---learning using privileged information (LUPI) and distillation---in a common framework. Under reasonable assumptions about the complexities of hypothesis spaces, and being optimistic about the expected loss achievable by the student (in disti…
SAGE enhances reinforcement learning by injecting hints to prevent model stagnation.
problem Sparse rewards cause large language models to stall under relative policy optimization.
method SAGE injects privileged hints during training to increase within-group outcome diversity.
result SAGE consistently outperforms GRPO on 6 benchmarks with LLMs, achieving significant improvements.
Joint training improves model accuracy by selectively using privileged information.
problem Two-stage training can lead to model failure with noisy privileged information.
method Joint training of two models to use privileged information selectively.
result Joint training outperforms two-stage baselines on synthetic and real-world tasks.
CMRM improves robustness in noisy label settings without requiring privileged knowledge.
problem Learning with noisy labels without privileged knowledge.
method Conformal Margin Risk Minimization (CMRM) framework.
result CMRM consistently improves accuracy and reduces mislabeling under various noise conditions.
Study transverse metric expansion on null hypersurfaces, proving uniqueness for Killing horizons.
problem Analyzing transverse expansion of metric on null hypersurfaces.
method Covariant approach, general geometric identities, generalized symmetry generators.
result Transverse expansion of spacetime metric uniquely determined at non-degenerate Killing horizons.
Proposes methods to correct bias and missing data in regression models.
problem Nonignorable selection bias and missing response in regression models.
method Imputation-based and importance weighted regression methods, including repeated regression and doubly robust combination.
result Repeated regression can effectively correct bias and outperforms weighted regression in extrapolation.
Paper transforms torse-forming vector fields into simpler forms.
problem Generalizing vector fields and their transformations.
method Present techniques to transform torse-forming vector fields into simpler cases.
result Concrete examples of transformations are provided.
EDSVM uses elite observations to guide SVM classification.
problem Classical SVMs lack ways to encode trusted models or preferences.
method EDSVM augments SVMs by guiding slack variables for elite observations.
result EDSVM models closely track reference SVMs while achieving competitive performance.
The paper proves that certain modified conformal vector fields are trivial on compact and non-compact manifolds.
problem Proving triviality of modified conformal vector fields on Riemannian manifolds.
method Analyzing properties of homothetic, conformal, and gradient vector fields on compact and non-compact manifolds.
result Established conditions under which m-modified conformal vector fields are trivial. The position vector field x is the most elementary and natural geometric object on a Euclidean submanifold M. The position vector field plays very important roles in mathematics as well as in physics. Similarly, the tangential component x^T of the position vector field is the most natural vector field tangent to the …
Conformal vector fields on LCP manifolds are orthogonal and Killing.
problem Understanding conformal vector fields on specific geometric manifolds.
method Analyzing properties of conformal vector fields on compact locally conformally product manifolds.
result Conformal vector fields are orthogonal to the flat distribution and Killing.
For a submanifold M in a Euclidean space, the tangential component x^T of the position vector field x of M is the most natural vector field tangent to the Euclidean submanifold, called the canonical vector field of M. In this article, first we prove that the canonical vector field of every Euclidean submanifold is alwa…
Study on vector fields on Lie groups reveals surprising algebraic coincidences.
problem Characterizing vector fields on Lie groups with Riemannian metrics.
method Algebraic and geometric analysis of left-invariant vector fields on nilpotent Lie groups.
result Spaces of Killing, one-harmonic, and conformal vector fields coincide with the center of the Lie algebra on nilpotent Lie groups.
Study biharmonic vector fields and unit vector fields on Riemannian manifolds.
problem Determine the equivalence of biharmonicity and harmonicity for vector fields and unit vector fields on Riemannian manifolds.
method Analyze biharmonic vector fields and unit vector fields on (M,g) with pseudo-Riemannian g-natural metrics on TM and T1M. result Contrary to Sasaki metric, biharmonicity and harmonicity are not equivalent for large classes of g-natural metrics on TM. This short report establishes some basic properties of smooth vector fields on product manifolds. The main results are: (i) On a product manifold there always exists a direct sum decomposition into horizontal and vertical vector fields. (ii) Horizontal and vertical vector fields are naturally isomorphic to smooth famil…