It’s not possible to filter in calculated attributes nor in reference sets (at least in a referenced object). You can configure a calculated attribute in the filter but it’s not used during filtering. Reference sets of referenced entities can’t even be configured.
Thanks and please tell me if you need more info.