Modi in his election rallies in the state April 29 appealed to voters to ensure his party's victory in 300 Lok Sabha constituencies of the country.
But his use of Kargil hero Vikram Batra's oft-quoted phrase "yeh dil maange more" sparked a controversy, with Batra's parents and the Congress raising objections.
Modi defended his use of the phrase at a 3D rally held a few hours later, saying he would "rather leave politics than insult martyrs and their parents".
The hill state has four Lok Sabha seats -- Shimla, Kangra, Mandi and Hamirpur -- and the main contest is between the Congress and the BJP.
In the 2009 election, the Congress won the Mandi seat while the BJP bagged the other three.