Michael Murphy is the InDesign style-meister. He wrote "Adobe InDesign Styles" for Adobe Press, and did a great Lynda.com title on InDesign styling. Here's what he says in the book:
"As mentioned at the beginning of this chapter, with all the power of table and cell styles, it is important to understand not only how they work and what they can do for you, but also to understand their limitations.
"Two formatting features missing in table and cell styles have already been discussed: You will always have to set the column width and row height of cells when applying a table style for the first time, and you will always have to convert body rows to header and/or footer rows every time you apply a table style for first time or update the table's data....
"But there's another kind of limitation that's important to keep in mind as you are designing tables: It is very easy to design a table that cannot be completely defined by a table style. In many cases, you'll need to define an extra cell style or two that lets you complete for formatting. [my emphasis]."
So I think that's what you have to do: Apply another cell style on top of the cells at the bottom of the table after applying the table style.
Thanks for pointing me in the right direction, Steve. After reading your post, I did some additional research on Cell Styles > Strokes and Fills. It turns out that I did not understand how to use the "proxy table" with the black and blue lines to set the cell strokes. I made some adjustments there, and got my row strokes to show up correctly.
I'm glad you figured it out!