In 1899 the battalion was once more renamed as 4th Regiment (1st Battalion Rifle Corps) Bombay Infantry and again in 1901 as 4th Bombay Rifles.
In Kitchener's 1903 reorganisation of the Indian Army, 4th Bombay Rifles became 104th Wellesley's Rifles, to commemorate the fact that the regiment had been commanded in 1800 by Arthur Wellesley.
In the further re-organisation in 1921, six regiments were brought together to form six battalions of the 6th Rajputana Rifles Regiment.