The effect of this on performance are much larger than they should be. They
should be essentially imperceptible. I think the reason is that the branch
merged from default, but the experiment compares to an older base version from
default. Therefore, issue524-base vs. issue524-v2 includes several changes from
other issues in addition to the change from this issue.
People on the nosy list, what is our best practice for this? Update the
issue524-base tag, or introduce a new tag for the correct reference version?
|