In the Design tab, click the File Menu and select Save As PDF Form.... Click on the "Don't Collect Responses" button and you should be able to save a PDF without the submit button.
What if I don't have a paid subscription to save as PDF? I currently have the form linked to a website via a URL, but I want users to print the form and its contents instead of sumitting it. Is there a way in that scenario to still hide the submit button or is it set to display by default?
No, that is not supported at the current moment.
There is a way but you need to have Acrobat Pro XI. It come with a desktop version of FormCentral. FormsCentral for Acrobat can saves unlimited PDF without submit buttons (you don't need a subscription to FormsCentral to use it)