Lindsey Graham suggested invalidating legally cast mail ballots, Georgia secretary of state says.