GUI front-ends to GnuPG, at least the default one in the GNOME installation, can of course store passphrases and other sensitive information in a secure manner.
Or, to be more precise, they could if the trivial fix to #472629 was applied by the PAM maintainers.