When Fact Checkers Have Trouble with Facts