Add a reference association on People that referes to the PrimaryLocation.
In business logic you can make sure that PrimaryLocation is allways a member of the many to many reference set association
OR
A validation that checks the membership of the Primary location in the reference set before commit and raises an error with validation feedback if it is not a member.