To rollover on a group of objects, I first put all the objects in an Empty State Button. This allowed me to apply a different rollover state to each object.
It worked, but, when I preview, some of the objects have moved Y position down.
Is this a previewing issue? I made sure the empty state button is set to Responsive Width, as well as I removed the pins.
To better understand your query we may need some visual illustrations.
Could you please share some screenshots which display your issue?