Depends on your output.
For WebHelp, you substitute different images for the Books and Pages using the Skin Editor.
For CHM files, you first ensure that Micrsoft HTML Help is your Primary Layout. Then you edit the Books and Pages using the TOC Editor. You right-click them and choose Properties. Then click the Advanced tab and choose the desired image.