Commenting late to this post to help others in the future:
You can right click the asset and select "go to asset" and it will preview where the image is located on your site. If there are images an asset folder, you will have to select one of those sub-images for the option to appear.
4 years ago but still. they made the preview pane bigger in CC.
this is CS6
this is CC
and there is this plugin too:
I believe you are referring to Muse. this is Ae forum