There's overhead just to run the VM. Try backing off 1 core either in Windows or VM and see how it runs.