Verify request.log what type of requests are hitting cq. Chances are there due to mis configuration the file might be requesting to cq instead of serving from cache.
Follow  to optimizing request performance. Optimizing the CQ Dispatcher Cache refer . More details os such semeiars & update follow us https://twitter.com/CQCare