Learning using privileged information

Sharmanska, Viktoriia and Quadrianto, Novi (2017) Learning using privileged information. In: Sammut, Claude and Webb, Geoffrey I (eds.) Encyclopedia of machine learning and data mining. Springer US, Boston, MA, pp. 734-737. ISBN 9781489976857

Full text not available from this repository.


When applying machine learning techniques to real-world problems, prior knowledge plays a crucial role in enriching the learning system. This prior knowledge is typically defined by domain experts and can be integrated into machine learning algorithms in a variety of ways: as a preference of certain prediction functions over others, as a Bayesian prior over parameters, or as additional information about the samples in the training set used for learning a prediction function. The latter setup is called learning using privileged information (LUPI) and was adopted by Vapnik and Vashist in (Neural Netw, 2009). Formally, LUPI refers to the setting when, in addition to the main data modality, the learning system has access to an extra source of information about the training examples. The additional source of information is only available during training and therefore is called privileged. The main goal of LUPI is to utilize privileged information and to learn a better model in the main data modality than one would learn without the privileged source. As an illustration, for protein classification based on amino-acid sequences, the protein tertiary structure can be considered additional information. Another example is recognizing objects in images; the textual information in the form of image tags contains additional object descriptions and can be used as privileged.

Item Type: Book Section
Schools and Departments: School of Engineering and Informatics > Informatics
Research Centres and Groups: Data Science Research Group
Subjects: Q Science > QA Mathematics > QA0276 Mathematical statistics
Depositing User: Novi Quadrianto
Date Deposited: 19 Jul 2017 10:58
Last Modified: 22 Nov 2018 15:05
URI: http://sro.sussex.ac.uk/id/eprint/69330
📧 Request an update