[Termtools] starexec introduces benchexec, to replace runsolver

[David Korzeniewski]

Hello Johannes,

we ran a few tests and BenchExec seems to solve the memory measurement
problems we encountered last year. The memory consumption reported by
BenchExec is always in the range we expected for the benchmarks we ran.

Best regards,
David

Am Mittwoch, den 08.03.2017, 23:10 +0100 schrieb Johannes Waldmann:
> Dear all,
> 
> this may be interesting:
> 
> http://starexec.lefora.com/topic/117/New-Benchmarking-Framework-BenchExec
> 
> as it could remove the problems that runsolver had
> w.r.t. memory measurements for JVM.
> 
> Starexec wants this to become the default (over runsolver)
> "likely in a month or so".
> 
> So, I recommend you test this, and report here,
> in particular, if you had problems with runsolver earlier -
> but also if you did not,
> so we can make an informed decision to switch for the next
> competition.
> 
> I hope that changes required in other tooling
> (star-exec-presenter) are minimal. I'd appreciate
> technical help - if you have seen benchexec before.
> See https://github.com/jwaldmann/star-exec-presenter/issues/128
> 
> - Johannes.
> _______________________________________________
> Termtools mailing list
> Termtools at lists.lri.fr
> http://lists.lri.fr/cgi-bin/mailman/listinfo/termtools