Can I add a downloadable file that I do not host on my server (remote download)?

Yes it is, it's a feature you can activate in the global parameters: "activate remote download". Then you can add a remote file like any other local file (both can be mixed), define a title, an URL for the file, an extension type (for the icon, zip, xls...).