[SMT-COMP] SMT-COMP 2015: All Jobs Complete

Alberto Griggio griggio at fbk.eu
Tue Jun 23 02:41:28 EDT 2015


Hello organizers,

> Dear SMT-COMP participants,
>
> On Sunday morning, StarExec completed the last competition job. All
> divisions (including application track divisions) are complete now.
>
> It took StarExec less than 5 days to run through the entire competition
> workload of 1,028,597 job pairs. On average, the cluster completed over
> 9000 job pairs/hour during this time.
>
> Preliminary main track results are available on the SMT-COMP web site:
>    http://smtcomp.sourceforge.net/2015/results-toc.shtml
>
> Detailed job data is available on StarExec:
>    Main track
>    https://www.starexec.org/starexec/secure/explore/spaces.jsp?id=88435
>    Application track
>    https://www.starexec.org/starexec/secure/explore/spaces.jsp?id=94314
>
> Please keep in mind that all results are preliminary at this point. We
> will be scrutinizing the data for errors, and may re-run individual
> divisions, e.g., if there were bugs in the competition tools. If you
> happen to spot any irregularities in the data, please tell us about
> them!

I just had a quick look at QF_FP, and IIUC only "schanda" and
"wintersteiger" benchmarks were considered, but not "griggio/fmcad12"
(at least looking at
https://www.starexec.org/starexec/secure/details/job.jsp?id=7772)
Is this a mistake, or have those benchmarks been excluded on purpose?

Best,
Alberto


More information about the SMT-COMP mailing list