Fix a potentially wrong segmentation selection

The current segmentation selection should only be retrieved after the
selection of a reference image is handled completely.

Also, spare an extra recursive call in a certain edge case.