you mean "Red" swatch?
you'll have to loop thru each element and compare their color to the Red swatch color, if they match, remove.
You may be able to do that with just an action? ( I don't use them ). If you have CS6 then you may be able to script the same select/same fill color menu item… ( I don't have this ). I would have to loop the page items and test/remove…
As Muppet Mark stated you can use the Select Menu's options.
- Select something
- Select Menu > Same > Fill Color
This will work across artboards, layers, groups, etc..
I tried it with an action, but in order to use the Select Menu you have to select something, then that color will be linked to the action (which you may want if it's repetitive?). But otherwise you can use it without an action just by selecting something with the color you wish to target for selection and removal on a more manual basis, your not really loosing much in way of time, its only 3 clicks and a key stroke without an action. Better than manual selection of everything for sure. ;-)