One of the most common excuses is ignorance. Ignorance does not always excuse, however, for sometimes ignorance is culpable. One of the most natural ways to think of the difference between exculpating and culpable ignorance is in terms of justification; that is, one's ignorance is exculpating only if it is justified and one's ignorance is culpable only if it not justified (call this the justification thesis). Rosen (J Phil 105(10):591-610, 2008) explores this idea by first offering a brief account of justification, and then two cases that he claims are counter examples to the justification thesis. The aim of this paper is to defend the justification thesis against Rosen's two cases. The argument will proceed in the following way. First, I clarify a few things about the nature of culpable ignorance generally and why the justification thesis is so intuitive. I then present Rosen's purported counterexamples. Once this is done, I argue that Rosen misses an important view of justification in the epistemology literature that I call the pragmatic view. I present a general picture of the pragmatic view, and explain how it fits naturally with our practices of criticizing people's beliefs, including claims of culpable ignorance. Finally, I address Rosen's cases arguing that, if the pragmatic view is right, then Rosen's cases are not counterexamples to the justification thesis.