This would be a huge help to be able to move/clone/sample across the site, right now this only happens in my current view and I end up zooming out to clone & drag to another part of the layout.
This also happens when I copy and paste. It will paste in place by default rather than down the page where my view and selected object is. Minor but frustrating to experience.
Apologize for your frustration. Please create a post for your issue here Adobe XD: Feature Requests: Hot (1048 ideas) – Adobe XD Feedback : Feature Requests & Bugs for the team to log a bug for investigation.