Signing is failing because it is trying to use the wrong signing identity.
It was also selecting the wrong profile, but I was able to force the correct profile by deleting all other profiles out of ~/Library/Mobile Devices/Provisioning Profiles
How can I force it to use the correct signing identity? (There are multiple identities on the machine)