Results are in:
http://www.informatik.uni-freiburg.de/~helmert/exp-issue310-eval-abs-d.html
http://www.informatik.uni-freiburg.de/~helmert/exp-issue310-eval-abs-p.html
Explanations:
- M{mlcgl,mlrl} stands for the two merge strategies we've been using
- Rt means label reduction is on (always)
- G{f,l,t} means greediness = false/legacy (= old definition)/true (= new
definition)
- B{10k,100k,inf} gives the abstract state bound
- T{1,10k} gives the threshold before abstraction kicks in
(We only consider certain combinations of the last two; otherwise we consider
all combinations.)
What we expect to see:
1. on domains with unit cost, configs with Gl vs. Gt should behave identically
- on general-cost domains, configs with Gt should do OK compared to domains with Gl
What we see:
- regarding 1., I didn't check very thoroughly, but in the cases I saw, this is
indeed the case
- regarding 2., in 4 out of 6 direct comparisons, we do better with Gt compare
to Gl. We do much worse in the remaining two cases, which have infinite bound
and threshold 1. My guess is that this happens because with infinite bound, we
often fail to build the bisimulation in these cases. I would expect these
bisimulated transition systems to typically be more complicated than in the
unit-cost case, since general cost would tend to reduce the number of equivalent
states. (For example, states with different h* cannot be equivalent, and there
tend to be more different h* values with general cost.)
So I think this should be fine, and I'd merge this and remove the "legacy"
greediness option from the code unless there are objections. (I'll wait for a
few days.)
|