You didn't mention your RH version?! I'll assume you have RoboHelp 9
This is relatively easy. Use the Insert > Multimedia command and locate the video file.
Most popular video files are supported, but the most popular are .FLV (Flash Video), .MP4, .MOV (Quicktime).
There will be a very simple "Playbar" which will overlap the bottom of the video for the user to control.
No matter which video format you use, the end-user's browser will need to support a default "player" to play the video type (Flash Player and Windows Media are most common).
The video will be automatically imported into"Multimedia" folder in your Project Manager (instead of Baggage). When you publish your project to the web server, the video file will go along for the ride.
Adobe Certified RoboHelp and Captivate Instructor