Modi said “June 4 is the ‘expiry date’ of the India Alliance