This paper presents a new problem for the inference rule commonly known as Inference to the Best Explanation (IBE). The problem is that uncertainty about parts of one’s evidence may undermine the inferrability of a hypothesis that would provide the best explanation of that evidence, especially in cases where there is an alternative hypothesis that would provide a better explanation of only the more certain pieces of evidence. A potential solution to the problem is sketched, in which IBE is generalized to handle uncertain evidence by invoking a notion of evidential robustness.