Fix Ctrl select of Labels
If a label set is "modified" because of a manual selection, do not clear the selection.