Disable the digital downloads module

So digital downloads was once a community created module, now it's added into the core, how'd you disable it?

I'm never going to use it, and it makes it look a bit silly offering something that you'll never even use.

I turned off "Allow download" in my settings, aka catalog_config_download.

Yet it still shows up in a bunch of places, including the user account page, and the sitemaps.