The Bharatiya Janata Party (BJP) on Tuesday decided to walk out of the alliance with Mehbooba Mufti's People's Democratic Party (PDP) in Jammu and Kashmir.