I attached the reports with the overall results and pairwise diffs between all configurations.
The new results show a good increase in coverage overall. I could not find anything particularly suspicious in the diffs.
We merged the changes in Commit: https://github.com/aibasel/downward/commit/e2f4adc290814c20e9e41539d539fd5ba5d6d404
There are some open questions about if we could improve the code further. I will create separate issues for that.
First experimental results are in:
https://ai.dmi.unibas.ch/_experiments/ai/downward/issue1228/data/issue1228-exp1-eval/issue1228-exp1.htmlhttps://ai.dmi.unibas.ch/_experiments/ai/downward/issue1228/data/issue1228-exp1-eval/
This form of reporting results is a bit annoying with all the configs that failed because of unsupported arguments, and we should probably produce two separate tables from this data, one that compares the old default version before/after and one that compares the four configs in the new code.
I would then also like to see some relative comparison tables that give a better picture of what happens per domain. At first glance it looks like there is some performance loss for the old default config, and perhaps we can look at that a bit more closely.
But overall the coverage numbers look good.
summary: Implement a relevant subset of precondition choice functions from https://fai.cs.uni-saarland.de/lauer/papers/hsdip2020.pdf . (Likely just GZD+BD.) -> Implement a relevant subset of precondition choice functions from https://fai.cs.uni-saarland.de/lauer/papers/hsdip2020.pdf . (Likely just GZD+BD.)
Pull request:
https://github.com/aibasel/downward/pull/301