[Termtools] SRS-certified category?

[Johannes Waldmann]

Dear all,

the message of "SRS-certified" should be "certification is important".

I think we have (or want to make) a distinction between
(1) collecting data (focus: completeness, use complete database)
(2) evaluating data (selecting/ranking data for reporting)
    (focus: "justice" (who's best), "excitement" (what's new))
we more or less agreed that (1) is the task of the execution
environment, while (2) is the task of the commmittee
(with the exec. env. providing tools for computing customized reports)

We have the "reporting problem" already for the current TRS data base
and SRS data base (separately) because of the distribution
of problems (large subdirs of "similar" problems).
This needs to be solved anyway.

Do we have any proposals to deal with the situation?
(Last year, it was "random selection", now it could be
"assign weights" - since we will have all the data)

Perhaps we can learn from the SMT community, they seem to have
this distinction between SMT-COMP (competition)
and SMT-EXEC ("ongoing" execution)
http://www.smtexec.org/introduction.shtml

Best regards, Johannes.


-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 257 bytes
Desc: OpenPGP digital signature
Url : http://lists.lri.fr/pipermail/termtools/attachments/20081020/51aaf96d/attachment.pgp