Brushes only apply to strokes in all cases. Or rather, they apply to paths.
If you want the brush stroke to be the character basis, you need to create paths for the skeleton of the stroke. This means you can not use the text tool. You should use the pen tool to create spines, then apply brush strokes to the spines.