The results for the repeated experiment look better. Strangely, rounding in the
correct dimension only made a noticeable difference for h^SEQ, not for the other
constraint types. Another indicator, that we get a lot of integer solutions
there. Anyway, the results are all a bit better than in the paper but are
qualitatively the same.
| Paper | v1 | v2
------------------------|--------
SEQ | 630 | 626 | 632
PhO-Sys^1 | 587 | 593 | 593
PhO-Sys^2 | 631 | 636 | 635
LMC | 744 | 756 | 756
The difference I noticed between my laptop and the grid is still there but only
affects a handful of the tasks I tried (for example freecell/pfile5). On my
laptop, I get the same amount of expanded, evaluated and generated nodes but the
total time is about 5 times as high. This might be caused by the new Cplex
version (12.5.1 on the grid, 12.6.1 on my laptop). Strangely, the newer version
is slower. We should run more extensive experiments before we switch the grid to
12.6.1, but not as part of this issue. The numbers in the reports are all
generated with Cplex 12.5.1.
I think this is ready to merge now. Do you agree?
|