[SMT-LIB] Final Benchmarks
Clark Barrett
barrett at cs.nyu.edu
Wed Jun 13 12:32:58 EDT 2007
Good catch. It's my fault: I had to run your benchmarks through my translator
to clean up a few small consistency issues. However, at the same time, it
seems to have replaced references to "distinct" with conjunctions of
disequalities. This was unintentional. I'll post a correction soon.
-Clark
>
> Hi Clark,
>
> There seems to be a bug in some of the Calysto benchmarks:
>
> For instance, bin_eventlogadm_vc331085.smt:1694 AND operator
> has only one operand.
>
> I'm pretty sure that my sf2smt tool doesn't generate such instances,
> because I would have gotten the same failure on those instances before...
> My guess is that it's your post-processing script.
>
> It could be a bug in sf2smt, but I doubt it..
>
> Regards,
>
> --
> Domagoj Babic
>
> http://www.domagoj.info/
>
>
>
> On 6/12/07, Clark Barrett <barrett at cs.nyu.edu> wrote:
> > Greetings to the SMT-COMP and SMT-LIB communities. As you know, we have been
> > working on finalizing the new bitvector theories for a while. I am happy to
> > report that the new theories and logics have now been posted on the smtlib web
> > site. They are very similar to the last draft I circulated on these lists, the
> > only changes being a correction to the definition of bvashr and removal of a
> > copule of the more obscure operators.
> >
> > I am also happy to report on the successful translation of over 8000 benchmarks
> > into the new QF_BV and QF_AUFBV logic formats. I was hoping to get these done
> > sooner, but as you can imagine, getting that many benchmarks translated is
> > quite challenging (there are always unexpected problems).
> >
> > Curiously, we actually have no benchmarks in the QF_UFBV category. The
> > benchmarks from last year have been retranslated and they all landed either in
> > QF_BV or QF_AUFBV.
> >
> > Currently the plan for the competition is to have two bitvector divisions
> > (QF_BV and QF_AUFBV) and to use all the benchmarks in QF_BV and QF_AUFBV.
> > Since this will require changes to parsers and algorithms, let me know now if
> > anyone has a big problem with this. The format has been available for some
> > time, so hopefully you've already started making the necessary modifications.
> >
> > This also represents the last changes to the benchmarks before the competition
> > (modulo any errors that are found).
> >
> > Happy benchmarking!
> >
> > -Clark
> >
> >
> > _______________________________________________
> > SMT-LIB mailing list
> > SMT-LIB at cs.nyu.edu
> > http://www.cs.nyu.edu/mailman/listinfo/smt-lib
> >
>
More information about the SMT-LIB
mailing list