It baffles me as to why XD would behave any differently than other Adobe products for basic features like pan and zoom.
thank you for your feedback!
Please vote or add your suggestion in Adobe XD: Feature Requests: Top (258 ideas) – Adobe XD Feedback : Feature Requests & Bugs
I think this is similar feature request you can vote on: Zoom Tool – Adobe XD Feedback : Feature Requests & Bugs
This feature is live.