[Termtools] [Termcomp] Fwd: Re: [color] Termination Competition 2009: Call for Participation

[Johannes Waldmann]

>>  It should be clear before starting the competition
>> how the tools (the provers AND  the
>> certifiers) are going to be evaluated?

> This should be decided by the steering committee [...]

well, who made the proposal for running complexity in three stages?
same person should make a proposal for scoring ... then SC decides :-)

We should take into account:
* all participants should be happy with the decision -
  so some open discussion seems necessary
* scoring algorithm must be easy/trivial to implement on termcomp,
  otherwise competition cannot start on schedule.

Especially with an eye to the schedule,
the most trivial implementation is none. This would mean:
* provers are evaluated according to
  whether they produced any certificate
* certifiers are evaluated according to
  whether they could verify a certificate.
so, just count answers, and use existing mechanism for display.
With no interaction between  the scorings of stages 2 and 3
of the competition, and no extra work for Simon.

Best - Johannes.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 260 bytes
Desc: OpenPGP digital signature
Url : http://lists.lri.fr/pipermail/termtools/attachments/20091211/f7801737/attachment.pgp