paper.pdf (457.16 kB)
Benchmarking of Java verification tools at the software verification competition (SV-COMP)
conference contribution
posted on 2023-06-09, 15:23 authored by Lucas C Cordeiro, Daniel Kroening, Peter SchrammelEmpirical evaluation of verification tools by benchmarking is a common method in software verification research. The Competition on Software Verification (SV-COMP) aims at standardization and reproducibility of benchmarking within the software verification community in an annual basis, through comparative evaluation of fully-automatic software verifiers for C programs. Building upon this success, we describe here how to re-use the ecosystem developed around SV-COMP for benchmarking Java verification tools. We provide a detailed description of the rules for benchmark verification tasks, the integration of new tools into SV-COMP's benchmarking framework and also give experimental results of a benchmarking run on three state-of-the-art Java verification tools, JPF-SE, JayHorn and JBMC.
History
Publication status
- Published
File Version
- Accepted version
Journal
Software Engineering NotesISSN
0163-5948Publisher
Association for Computing MachineryExternal DOI
Issue
4Volume
43Page range
55-56Event name
The 26th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software EngineeringEvent location
Florida, USAEvent type
conferenceEvent date
Monday 5 November 2018Department affiliated with
- Informatics Publications
Notes
This paper is part of the JPF 2018 Java PathFinder Workshop.Full text available
- Yes
Peer reviewed?
- Yes
Legacy Posted Date
2018-10-09First Open Access (FOA) Date
2019-01-22First Compliant Deposit (FCD) Date
2018-10-08Usage metrics
Categories
No categories selectedLicence
Exports
RefWorks
BibTeX
Ref. manager
Endnote
DataCite
NLM
DC