The Conformal Manifold of Chern-Simons Matter Theories