[Termtools] competition dec 09 started

[Frederic Blanqui]

Aart Middeldorp a écrit :
> On 01/18/2010 07:56 AM, Frederic Blanqui wrote:
> 
>> The competition started one month ago and does not seem to be finished
>> yet!... It is not even clear whether the certified competition already
>> started. Could the organizers of the competition give some information 
>> about
>> what is happening and when we can expect to have the results?
> 
> Indeed, it took quite a bit longer than anticipated, but the results are
> now available:
> 
> http://termcomp.uibk.ac.at/termcomp/competition/categoryList.seam?competitionId=101722 
> 
> 
> Despite the misleading percentages, the certified categories are complete.
> 
> Here is an preview of what will happen in the next few days:
> 
> - (a corrected version of) TCT will be rerun in the complexity categories
> - the correct version of CeTA will be rerun in the certified categories
> - Jambox will be rerun (with a corrected runme script) in the outermost
>   category
> - the same holds for COSTA in the Java bytecode categories
> 
> Best regards,
> 
> Aart

The competition website only provides raw data for the results.
In December, Rene suggested to display the following results. When do 
you plan to display those aggregated results? Thank you. Frederic.

Best tool for certification:
# TRSs for that the tool has generated a proof that could be certified

Best combination:
# TRSs for that the tool with corresponding certifier have provided
a certified proof.

Best certifier for TRSs:
# TRS for that proofs have successfully been certified

(in the above three scores, if there are several proofs for the same 
TRS, then
it only counts once, i.e., it suffices to certify one of the proofs and 
there
is no advantage in certifying more than one of them)

Best certifier for proofs:
# proofs that have been certified
(here, each CPF-file that can be certified yields one point, so if there
are multiple proofs for the same TRS perhaps from different tools,
then multiple points can be reached by the certifier)