[SMT-COMP] SMT-COMP 2016: Incorrect Answers (Main Track)

[Tjark Weber]

Dear SMT-COMP participants,

Now that we've had some time to celebrate this year's competition
winners, I'd like to draw some attention to the incorrect answers that
we've seen during the competition.

In the main track, 79 answers were classified as incorrect. The
following list shows how often each solver gave an incorrect answer (no
shaming intended):

65 Q3B
10 raSAT 0.3
 4 SMT-RAT

A more detailed list that includes benchmark information is attached.

If you find that an incorrect answer was caused by a bug in the
competition tools or by an incorrectly classified benchmark (rather than
by a bug in the solver), kindly inform us!

Best,
Tjark

-------------- next part --------------
A non-text attachment was scrubbed...
Name: Main_Track.incorrect.csv
Type: text/csv
Size: 11084 bytes
Desc: not available
URL: </pipermail/smt-comp/attachments/20160706/003d483c/attachment.csv>