Kerala Chief Minister Oommen Chandy was first invited to and then asked to stay away from a function at Kollam on Tuesday being attended by Prime Minister Narendra Modi, prompting an angry response from former defence minister AK Antony.