I think instead of a table you'd be better off inserting the image/captions as groups and making them inline anchored objects.
Can you write me exactly what are the options names in InDesign? I use CC btw.
Since I am new to ID I will greatly appreciate if you could give me some direction.
If you cut and paste an object intothe text, it becomes an inline anchored object, which will move with the text as you edit. You can easily delete one, or add another between two exisiting objects (ID treats these as just another character in the text flow).
IN order to get both your image and the caption together you need to place the image, and add a text frame for the caption, then select them both and group before you cut and paste into the text flow.
That solved the puzzle I had. Thank you.