How easy is it to crack gpg with private key, but without password

I was wondering if an adversary have your private gpg key but not the password/phrase, how easy/difficult would it be to crack a encrypted file compared to a encryption that only use password and not keys? (assuming that the password was the same).

would a compromised keyfile make it easier to crack the encryption, than a encryption that don't use keyfiles or would it equal out?

An example could be a gpg encrypted file where the private key has been stolen and a file encrypted with AEScrypt.