Gillingham became the first side since late August to lose to Colchester United in the league on Saturday.