[SMT-COMP] New official release of SMT-LIB benchmark library

Clark Barrett barrett at cs.stanford.edu
Sun May 20 12:02:26 EDT 2018


A new release of the SMT-LIB benchmark library (2018-05-20) is now
available, both on the GitLab
<https://clc-gitlab.cs.uiowa.edu:2443/explore/groups> server and on StarExec
<https://www.starexec.org/starexec/secure/explore/spaces.jsp?id=234826>.
For this release we have:

   - Fixed minor errors in formatting
   - Removed duplicate benchmarks
   - Updated statuses of 18,739 previously unknown non-incremental
   benchmarks (based on the results from 2 or more solvers from SMT-COMP'17)
   - Updated 232,167 statuses of previously unknown incremental check-sat
   calls (based on the results from 2 or more solvers from SMT-COMP'17)
   - Added 3121 new benchmarks in new logics:
   - non-incremental: AUFNIA (3)
      - incremental: QF_ABV (15), QF_AUFBV (10), QF_UF (766), QF_UFBV (2327)
   - Added 7969 new benchmarks in existing logics:
   - non-incremental: AUFLIA (3272), BV (600), NRA (2), QF_ABV (5),
      QF_AUFLIA (294), QF_BV (67), QF_LIA (806), QF_NRA (135), QF_UF (807),
      QF_UFBV (1193)
      - incremental: QF_BV (787), QF_LIA (1)

For details on the changes to SMT-LIB, please check the git logs at:
https://clc-gitlab.cs.uiowa.edu:2443/SMT-LIB-benchmarks and
https://clc-gitlab.cs.uiowa.edu:2443/SMT-LIB-benchmarks-inc

The SMT-LIB coordinators


More information about the SMT-COMP mailing list