To me that looks like the path instead of a stroke.
After you add the shape and press the enter/return key or if you switch to a different tool such as the Hand Tool does the stroke go away?
Doh! Thanks. I think it used to be that when you clicked off the item the path lines disappeared... It works that way in Fireworks...