Assuming you are on Windows, try highlighting a PDF. Right-click, choose open with>Choose program. Choose Reader then select "Always use the selected program to open this kind of file".
Those are the instructions for WinXP. If you are using a different Windows OS the instructions or verbiage may change slightly bu that should get you headed in the right direction.