The Boltzmann equation is widely used to describe the dynamics of the medium produced in heavy ion collisions. However, the validity of such kinetic theory approach to heavy ion collisions has not been shown explicitly in the literature. In this talk I will describe an effort to correct this situation by testing the validity of the Boltzmann equation in heavy ion collisions. We consider a 2->2 parton re-scattering process happening after the partons have been produced in the initial collision. For this process, we compare the Boltzmann equation prediction to the (tour de force) exact diagrammatic calculation. We find a stark disagreement between the two: while the Boltzmann equation prediction exhibits first signs of medium isotropization, the exact diagrammatic calculation leads to anisotropic "medium" consistent with free streaming and showing no signs of isotropization. We thus see no evidence for the applicability of kinetic theory to heavy ion collisions.