i know how to embed a single video from youtube in muse, but how do i go about creating a video playlist of several videos?
To do that you will have to embed certain code in your Muse file, which you can do either by Object->Insert HTML or Page Properties->Metadata.
Please refer to this page to find out how this can be done,
How to Embed YouTube Playlists in a Website
Europe, Middle East and Africa