All those who have been close to this naamdar family have carried forward the flag of dynasty: PM Modi