[SMT-COMP] SMT-COMP 2016 Running

[Giles Reger]

I would also like to point out that it seems that the numbers displayed on the graphical interface do not seem to be consistent with the downloadable job information.

For example, in AUFNIRA there is one result that differs by one problem, which makes a difference here!

I had recently experienced StarExec reporting a number that was too low but had not seen a number that was too high before!

I assume the results will be based on this downloadable information that can be checked.

Best,
Giles

> On 1 Jun 2016, at 12:53, Tjark Weber <tjark.weber at it.uu.se> wrote:
> 
> On Wed, 2016-06-01 at 01:29 +0200, Tjark Weber wrote:
>> We have started the competition jobs for several main track divisions
>> for SMT-COMP 2016 on StarExec. The competition spaces are public:
>> 
>> https://www.starexec.org/starexec/secure/explore/spaces.jsp?id=161208
> 
> Several people kindly pointed out that some job pairs are marked as
> failed because of a "run script error" (i.e., a StarExec failure).
> 
> The reason is not entirely clear to me. It might be that recent changes
> to the number of nodes in the competition queue on StarExec are to
> blame.
> 
> In any case, we are monitoring the issue and will re-run affected job
> pairs in the near future.
> 
> Best,
> Tjark
> 
> _______________________________________________
> SMT-COMP mailing list
> SMT-COMP at cs.nyu.edu
> http://cs.nyu.edu/mailman/listinfo/smt-comp