Recent observations suggest that large quantities of cool gas are found in the circumgalactic medium (CGM) of the galaxy halo, with temperatures of a few 10^4 K. In addition, detections of highly-ionized oxygen (O VI) indicate the existence of warm gas at a few 10^5 K around star-forming galaxies. However, the origin and stability of the combined cool, warm and hot multiphase CGM are not fully understood yet. With the FIRE-2 simulations in which cosmic ray physics is incorporated, we have found that Milky Way-mass galaxy halos at low redshifts could potentially bedominated by cosmic ray pressure rather than ordinary thermal gas pressure. This insight fundamentally reshapes our understanding of the physical states of the multiphase CGM, and may help solve longstanding puzzles such as the survival of the ubiquitous cool gas, and theusually under-predicted O VI.