A local board shall investigate promptly each complaint it receives regarding the fitness, qualification, or performance of an individual appointed to be an election judge. A local board shall remove any election judge who is unfit or incompetent for the office.