Remove contact group members