Two challenges of correct validation in pattern recognition

Nowotny, Thomas (2014) Two challenges of correct validation in pattern recognition. Frontiers in Robotics and AI, 1 (5). pp. 1-6. ISSN 2296-9144

[img]
Preview
PDF - Published Version
Available under License Creative Commons Attribution.

Download (5MB) | Preview

Abstract

Supervised pattern recognition is the process of mapping patterns to class labels that define their meaning. The core methods for pattern recognition have been developed by machine learning experts but due to their broad success, an increasing number of non-experts are now employing and refining them. In this perspective, I will discuss the challenge of correct validation of supervised pattern recognition systems, in particular when employed by nonexperts. To illustrate the problem, I will give three examples of common errors that I have encountered in the last year. Much of this challenge can be addressed by strict procedure in validation but there are remaining problems of correctly interpreting comparative work
on exemplary data sets, which I will elucidate on the example of the well-used MNIST data set of handwritten digits.

Item Type: Article
Schools and Departments: School of Engineering and Informatics > Informatics
Subjects: Q Science > QA Mathematics > QA0075 Electronic computers. Computer science
Depositing User: Thomas Nowotny
Date Deposited: 01 Oct 2014 10:48
Last Modified: 06 Mar 2017 20:53
URI: http://sro.sussex.ac.uk/id/eprint/50462

View download statistics for this item

📧 Request an update
Project NameSussex Project NumberFunderFunder Ref
Green brainG0924EPSRC-ENGINEERING & PHYSICAL SCIENCES RESEARCH COUNCILEP/J019690/1