Solution:
Right click the project -> Properties -> Package Manifest
On the Package.appxmanifest go to Packaging tab -> Choose Certificate
In the new window click "Select a Certificate..." if you have one, or create a certificate if you haven't created one