It's not happening for me on my Mac or Windows machines, but it is happening for you on both. In fact, this isn't a common complaint at all.
That means there is something unique on your systems that is not present on mine.
What third-party plugins have you installed?
What third-party scripts do you have?
What other software is installed?
Ugh, just happened again right now switching back from hipchat.
Here's some screenshots of what scripts I'm running. Typing out a list would take a while.
For plugins, I'm running Trapcode 3D stroke, particular, form, shine, and starglow, the paid Red Giant Universe suite, and Video Copilot Element, but I should add that this happens whether or not I'm working in a project using Element.
Right now, I have Chrome and AE open and I'm getting freezing. Chrome is usually always open, since I'm either listening to music or using google sheets for project notes and feedback.
I should also add, this happens at the office I'm currently working at to others as well, on different systems, doing similar work.
Chrome is getting a bad reputation as a RAM hog lately, but I often have Chrome open too without issue. Try removing all of those third-party scripts and work with it and see if the problem goes away.