This week, at a teacher training for using conversation to lift student comprehension, an exasperated teacher raised her hand and asked, “I’m concerned because my students seem able to have really thoughtful conversations about books but when I turn around and give them a “test question” about it, they bomb!”
This question set me thinking—a lot.
Is the problem the topic of the conversations students are having? Is it that their conversations aren’t going deep enough? Do their ideas dance around the periphery of the real meaning of the text? Or is the problem something different all together? Is it an issue of vocabulary? Or careful reading or interpretation of the questions themselves? The fact of the matter is this: when this teacher asked this question, I had no idea how to respond because it felt like the answer rested with any one of a series of infinite possibilities.
But here’s the good news. As a follow-up to this training, I have started visiting classrooms in this district and together with the teachers who echoed the same sentiment voiced by this exasperated teacher, we’ve begun to take a close look at this lack of transference. While the jury still seems to be out on the absolute answer to this question, the observations we have made have been fascinating.
One behavior that we saw time and again was the inclination to make snap judgments. Test questions require that we fully absorb all aspects of what is being asked. They require that we not only read the text closely and carefully, but also that we take the time to fully reason and consider what a question is really asking. What we saw were students who seemed to be skimming the questions and answering according to what they knew instead of using the information provided in the text. For example, when we asked the question “What does the word prise mean in the first paragraph of “The Great Mouse Plot” from Roald Dahl’s Boy, many children saw the word knife and immediately concluded that the best definition for this word would be cut. When we asked a question about Roald Dahl’s relationship with his friends, they saw the word truthful in the line that read “When writing about oneself, one must strive to be truthful,” and immediately thought that their relationship was based on honesty. When asked how Roald Dahl felt when he was placing the mouse in the jar, students said “proud” in spite of the fact that at the point when he places the mouse in the jar the text says his “heart was thumping like mad” and his “hands had gone all sweaty.” Instead of honoring those words, they keyed into the last sentence that read it was marvelous to be so popular and called it a day.
Instead of reading closely and carefully, the students we looked at read lightly and literally. And what I’m wondering is why?
When I was first introduced to the Common Core State Standards, specifically the idea of being able to read increasingly complex text through close readings that emphasized text-based questions, I was somewhat skeptical. When I heard David Coleman speak about it, I felt that he was disparaging strategy instruction and as a teacher whose entire career has reflected the ideas espoused by Ellin Oliver Keene’s Mosaic of Thought and Harvey and Goudvis’ Strategies that Work, this felt a little blasphemous (amazon affiliate links). However, what I have observed in the last few days is enough to convince me that aspects of our strategy instruction may well be counterproductive. I sense that we may overemphasize things like making connections and predictions and underemphasize things like synthesis and determining importance. And in so doing, students’ thinking dances around the periphery of the text never quite making it to the core. And as a result, we’ve got kids who answer test questions based on what they think as opposed to what they know from the text they are reading—and you know what that means: bad scores. But what’s worse than that is this: We’re grappling with an epidemic of poor comprehension and that’s a bigger problem.
The question now is what can we do it about it? I know that’s what I’ll be thinking about in the coming days but I’d love to know what you’re thinking, too. What are you doing to help students achieve “close, careful analysis” of text?
