Could you please post a screenshot with the pertinent Panels visible?
Also, please identify the characteristics of the layer you're painting (penciling) on.
If it truly is a "tool gone wild" situation, you can try resetting the Pencil tool...
Beyond that, resetting the overall Photoshop preferences is sometimes helpful.
But let's determine if it's something you have set up wrong first.