In that case, the solution is to use the onchange property of the referenceselector. The microflow should return the new set of available objects. (You can use the list substract activity to remove the item).
The selectable objects provides several options to constrain the shown objects. (Microflow or XPath constraint). This might be enough, or if not, maybe you can further describe the case.