Improving the robustness of neural networks using K-support norm based adversarial training

Akhtar, Sheikh, Rehman, Saad, Akthar, Mahmood, Kahn, Muazzam, Riaz, Farhan, Chaudry, Qaiser and Young, Rupert (2016) Improving the robustness of neural networks using K-support norm based adversarial training. IEEE Access, 4 (2016). pp. 9501-9511. ISSN 2169-3536

[img] PDF - Accepted Version
Available under License Creative Commons Attribution-NonCommercial.

Download (1MB)
[img] PDF - Published Version
Available under License Creative Commons Attribution.

Download (10MB)


It is of significant importance for any classification and recognition system, which claims near or better than human performance to be immune to small perturbations in the dataset. Researchers found out that neural networks are not very robust to small perturbations and can easily be fooled to persistently misclassify by adding a particular class of noise in the test data. This, so-called adversarial noise severely deteriorates the performance of neural networks, which otherwise perform really well on unperturbed dataset. It has been recently proposed that neural networks can be made robust against adversarial noise by training them using the data corrupted with adversarial noise itself. Following this approach, in this paper, we propose a new mechanism to generate a powerful adversarial noise model based on K-support norm to train neural networks. We tested our approach on two benchmark datasets, namely the MNIST and STL-10, using muti-layer perceptron and convolutional neural networks. Experimental results demonstrate that neural networks trained with the proposed technique show significant improvement in robustness as compared to state-of-the-art techniques.

Item Type: Article
Keywords: K-Support norm, robutness, generalization, Convolutional Neural networks, adversarial.
Schools and Departments: School of Engineering and Informatics > Engineering and Design
Research Centres and Groups: Industrial Informatics and Signal Processing Research Group
Subjects: Q Science
T Technology
T Technology > T Technology (General) > T0010 Communication of technical information
T Technology > T Technology (General)
Depositing User: Rupert Young
Date Deposited: 09 Jan 2017 11:46
Last Modified: 11 Feb 2022 12:16

View download statistics for this item

📧 Request an update