One strategy for dealing with apparent cases of knowledge from falsehood is to deny that the knowledge actually is from a falsehood. Those endorsing such a move have suggested that cases of knowledge from falsehood are instead cases of knowledge despite falsehood. We here provide a dilemma for those wanting to reject the possibility of knowledge from falsehood. The dilemma is explained in part by examining recent attempts to deny that knowledge can be inferentially derived from falsehood.