Benchmarking of Java verification tools at the software verification competition (SV-COMP)

Cordeiro, Lucas C, Kroening, Daniel and Schrammel, Peter (2018) Benchmarking of Java verification tools at the software verification competition (SV-COMP). The 26th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Florida, USA, Monday 5 November 2018. Published in: Software Engineering Notes. 43 (4) 55-56. Association for Computing Machinery ISSN 0163-5948

[img] PDF (©ACM,2018.This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in Software Engineering Notes,43,4,2018 https://doi.org/10.1145/3282517.3282529) - Accepted Version
Download (468kB)

Abstract

Empirical evaluation of verification tools by benchmarking is a common method in software verification research. The Competition on Software Verification (SV-COMP) aims at standardization and reproducibility of benchmarking within the software verification community in an annual basis, through comparative evaluation of fully-automatic software verifiers for C programs. Building upon this success, we describe here how to re-use the ecosystem developed around SV-COMP for benchmarking Java verification tools. We provide a detailed description of the rules for benchmark verification tasks, the integration of new tools into SV-COMP's benchmarking framework and also give experimental results of a benchmarking run on three state-of-the-art Java verification tools, JPF-SE, JayHorn and JBMC.

Item Type: Conference Proceedings
Additional Information: This paper is part of the JPF 2018 Java PathFinder Workshop.
Keywords: software verification, Java, benchmarking, competition
Schools and Departments: School of Engineering and Informatics > Informatics
Subjects: Q Science > QA Mathematics > QA0075 Electronic computers. Computer science > QA0076 Computer software
Q Science > QA Mathematics > QA0075 Electronic computers. Computer science
Related URLs:
Depositing User: Peter Schrammel
Date Deposited: 09 Oct 2018 10:39
Last Modified: 22 Jan 2019 14:39
URI: http://sro.sussex.ac.uk/id/eprint/79258

View download statistics for this item

📧 Request an update