[Termtools] complexity competition
Georg
georg.moser at uibk.ac.at
Mon Nov 10 18:18:11 CET 2008
Dear All,
as it was brought to your attention by Johannes, the complexity
category has finished. As this category was present for the first
time, perhaps a very short report is in order (a more detailed report
will be part of the usual report on the competition).
In the subcategories "derivational complexity" and "derivational
complexity - innermost" CaT and TCT ran a competition, which was won
by CaT. I suppose I can speak for the whole TCT team, when I take
this opportunity to congratulate the CaT developers Martin Korp,
Christian Sternagel and Harald Zankl to this victory. In the
subcategories "runtime complexity" and "runtime complexity -
innermost" TCT ran as a demonstration.
A perhaps remarkable point of this new category is that the contesting
tools published their source under the lesser GPL and that this
category was the first to use a scoring function, which worked
surprisingly well. These ideas may be of interest in other categories
as well.
Unfortunately the analysis of the results revealed some problems with
the chosen testbeds. In all four subcategories the testbeds used in
the competition are not conform to the description on the wiki page:
http://termination-portal.org/wiki/Complexity
This was due to a combination miss-communication between Simon and
me and some technical mishap. The SC was informed about this and
agreed that the competition results should be changed accordingly.
Simon agreed to do so, as soon as the competition is finished.
Note that this will only change the absolute numbers of points,
yes-instances, etc, but will not influence the outcome of the
competition.
best wishes,
Georg.
More information about the Termtools
mailing list