Cosmology beyond thermal equilibrium