UFE Selecting wrong identity when packaging IOS for Distribution

Signing is failing because it is trying to use the wrong signing identity.

It was also selecting the wrong profile, but I was able to force the correct profile by deleting all other profiles out of ~/Library/Mobile Devices/Provisioning Profiles

How can I force it to use the correct signing identity? (There are multiple identities on the machine)