I know right?
(Attachment Link)
Obama has condemned Farakkhan and didn't have dinner with him (Farakkhan showed up at the Congressional Black Caucus, where that picture was taken nearly 20 years ago.)
But it sounds like you're trying to justifiy meeting with anti-semites. Why can't you just say that's a bad thing to do?