The ruling JD(U) hit out at Modi, alleging that he was playing politics of polarisation and questioned why he had never visited the families of 2002 Gujarat riots.