When it comes to course design, I’m a big fan and advocate of Wiggins & McTighe-style backward design: identify learning outcomes, create summative and formative assessments, select instructional strategies.
I like this diagram because
the loop suggests iteration: you design, teach, assess, redesign, reteach,…
the arrows are double-ended: a novel assessment might allow me to aim for a higher learning outcome and force me choose a new instructional strategy, and so on
The last 2+ years have highlighted the importance of learning management systems and other learning technologies. They don’t just enable assessment and instruction, they can enhance it. Like, say, choosing Slido to run peer instruction (aka clickers) instead of think-pair-share.
So, I want to add “learning technologies” to the design process. A novel technology (like, say, Perusall) might allow me to raise the level of the learning outcome, requiring a different assessment and instructional strategy. Let’s add it to the loop:
Uh-oh! If I just add another circle to the loop, I loose important connections, like how the learning outcome helps me select the instructional strategy, and how the assessment might rely on the capability of the learning management system. There’s an easy fix, of course.
Adding two missing arrows brings back the message that changing one component has consequences on the other three.
This is the version of backward design plus learning technologies I’ll be using when talking with course instructors. Until I iterate and revise, of course!
End notes
This post first appeared as a thread on Twitter. Probably a good idea to back it up here, just in case.
Part of my motivation for sharing these diagrams is the opportunity to practice using alternative text (alt txt), the written description that accompanies images posted on the web and Twitter. I’ve been learning a lot about alt txt from Ann Gagné @AnnGagne, Jorts @JortsTheCat (who always includes simple, clear, and wonderfully creative alt txt), and this excellent webinar “What is alternative text? How do I write it for images, charts, and graphs?” by Matthew Deeprose @VLEguru.
I use PowerPoint to create simple diagrams like these. I like the auto-align features, the fine-control over the size of objects (down to 0.01 inches), and the easy “Duplicate slide” tool (I add new elements to copies of the slide so I can go back or try different options.) A new trick for these diagrams: I started with a custom 6″ x 6″ slide. “Save as PNG” pumped out a folder of identically sized (576 x 576 pixel) PNGs so I didn’t have to do any cropping.
Peer instruction is a powerful, evidence-based instructional strategy that supports active learning in all sizes of classes. Typically in peer instruction, every 15-20 minutes,
the instructor poses a conceptually challenging, multiple choice question
students think about the question on their own and vote for one of the choices using some kind of audience response tool (“clickers”)
students turn to their neighbors and discuss the question and their answers
students may vote a second time, depending on the nature of the question
the instructor leads a class-wide discussion where students share their thinking, finishing with
the instructor models expert-like thinking and confirms why the right answers are right and the wrong answers are wrong
This can take anywhere from 2 to 10 or more minutes, depending on the question, the answers, and the richness of the discussion.
There are many pieces needed to make peer instruction effective, including
creating time in class (often by using a “flipped” model for the class),
building peer instruction into the syllabus and grading scheme,
writing good questions, and
selecting and using some education technology.
Even with all those pieces in place, there is still plenty of opportunity for an instructor to “short-circuit” the activity and lose whatever potential for learning may have existed by how they run peer instruction in class. What follows is not The Right Way To Run Peer Instruction With Clickers ™ but rather, some recommendations to reduce the risk of messing it up.
Credit where it’s due
My colleague, Beth Simon, and I came up with this particular “choreography” or “protocol” with input from
Ed Prather, Gina Brissenden, and others at the Center for Astronomy Education at the University of Arizona. The CAE is a treasure trove of resources for teaching in higher ed, particularly physics and “Astronomy 101” courses.
If you have 15 minutes, I highly recommend watching this interview with Eric Mazur who, as you’ll hear, serendipitously discovered peer instruction in his physics class.
To click or not to click?
I’m going to describe peer instruction using i>clickers but you can adapt these recommendations to other #edtech options if those alternative
allow each student to individually commit to an answer
allow the instructor to see the results of the votes WITHOUT the students seeing them
The i>clicker system does these. Other electronic polling systems like PollEverywhere, TurningPoint, REEF, and Learning Catalytics do these, too, though it might take some clever manipulation of your laptop and the display to prevent the results of the votes from automatically being projected. I have many colleagues who can pull this off using colored ABCD voting cards.
Peer instruction for 2 types of questions
I want to distinguish between 2 types of peer instruction questions because they have slightly different versions of the choreography or protocol I’m sharing here.
Questions where there is a correct answer
In these types of questions, more often found in STEM classes, have a choice that’s right and choices that are wrong. With this type of question, the instructor expects there will be an individual vote, peer discussions with neighbors, a second vote, and then the class-wide discussion.
Questions for generating discussion
What’s special about these types of questions is that every choice is correct (well, there might be one choice that’s deliberately wrong) and the goal is the get the students to commit to one of the choices and talk about it with their neighbors. Each choice is a thought prompt or conversation starter. The instructor only expects one vote here because the peer discussion is to tell your neighbors about the evidence for your choice and then listen to their thoughts about a different choice, not to convince them your choice is right. They’re ALL right!
Questions where there is a correct answer
Here’s the full protocol for running this kind of question. I encourage instructors to print out the protocol, bring it to class, and put it somewhere visible like the podium or desk. There are a lot of steps, in addition to all the other parts of the lesson, so give yourself a break and keep this “cheat sheet” handy (especially on the first few days of class where everything is harder.) I go into detail about each step below.
You work your way through your lesson and reach the peer instruction question. Say something that tells the students it’s time for peer instruction like, “And now, I’ve got a question for you…” or “Okay, let’s see what you think about this…” The slide with the question doesn’t need to be titled “Clicker Question”. The students know it’s time for peer instruction because they see the multiple choices on the slide. Why not give it a useful title related to the concept?
With the question on the screen, 2 things. First, do not read the question aloud:
the students don’t know if they’re supposed to listen to you or read the question – they can’t do both (especially students for whom English is a foreign language). Mary Jo Madda wrote a nice piece about cognitive load, Why Your Students Forgot Everything On Your PowerPoint Slides.
you might add extra information to the question or the choices that confuses the students
you might give away the answer by the tone of your voice (more enthusiastic on correct choice, monotone on incorrect) or your body language (nodding your head for correct choice, shaking your head on incorrect)
they’re going to have to carefully read questions like this on the exam so give them this chance to practice
(I’ve only heard of one good reason to read out the question, from my colleague Matthew Herbst. In his history classes, they encounter many foreign names of people and places and Matthew wants his students to hear how to pronounce those words.)
Second, remind the students to “Please answer this question on your own.” One of the key elements of peer instruction is that students first confront/confirm their own understanding of the concept. They need to know what they think so they’ll get something out of, and have something to contribute to, the upcoming discussion with their peers. If students don’t think on their own first, you’re inviting them to zone out, then listen to their loudest neighbor, and think, “Oh, yeah, that’s what I think, too.”
It’s important to remind them to think on their own every time because they soon learn that when you talk to your neighbors, you can usually figure out the right answer. And then when the students vote, almost everyone has it right. The instructor is happy (“Wow, great job everyone!”) and the students are happy (because they got it right and because they made the instructor happy) and…. Enough with the happy! You’re there to make their brains hurt, not to make them happy. Make them think! And if they insist on starting to whisper or talk with each other, try “Please answer this on your own. You’ll get a chance to talk to each other in a minute but right now, I need you to think. That’s how peer instruction helps them learn.” Another good line is, “You’re going to have to answer questions like this, by yourself, on the exam. Take this opportunity to practice.”
Open/start the poll. If you’re using i>clicker, try to keep the polling widget visible so the students see the timer counting up (not counting down – this isn’t a “Beat the Clock!” game show) and see how many other students have voted. Don’t announce that they have 30 or 60 seconds answer the question. How do you know it will take that long? The tricky part is deciding how long to leave the poll open to give students sufficient time to vote. What is “sufficient”? Here are some possibilities:
Let’s start with the best advice, courtesy of Ed Prather: Turn and look at the question on the screen – give it your full attention, just like your students should. Read each word as if you’ve never seen the question before, go through the thinking needed to arrive at the answer and (pretend to) click. That’s the MINIMUM amount of time your students need. By the way, if experts do something with their hands or bodies to answer the problem (like physicists do that hand-spinning thing for the right-hand rule) – do that, too, modeling what an expert does.
If you have a good idea how many students are in the classroom at that moment, keep the poll open until almost everyone has voted.
If this is your second, third, fourth question of the day, you know how many people voted on the previous questions so you have a target.
Watch the students. Typically, they read the question, think, click, and then sit back expectantly, waiting for something to happen. When almost everyone is sitting back, it’s time to move to the next step.
DON’T wait for every last student to vote. Who knows why the last few aren’t voting – maybe they stepped out of the classroom, maybe they just don’t want to answer. If you wait impatiently for Student #200 to click, all you’re going to do is piss off the other 199.
When you’re close to the target number of votes, get ready to close the poll. Don’t just shut it, unannounced. That will only invite groans and pleas from the few students who were just about to vote and you didn’t give them a chance. Instead, give them a countdown. I always say something like, “Okay, it looks like just about everyone so I’m closing the poll in 3… 2… 1…. Thank-you.”
The goal of the next step – peer to peer discussion – is to give the students an opportunity to “try out” their thinking about the question, in a low-stakes, just-between-friends conversation. Except for a few special cases I’ll give below, you will short-circuit that conversation if you show the students the distribution of votes. Why? Because if there’s one answer that’s more popular than the others, students will try to convince each other that that answer is correct, even if it’s not.
Okay, there are a couple of special cases described below where showing the distribution of votes might – might – help. In order to make the decision whether or not to show the distribution, the instructor should glance at the i>clicker receiver to see the votes. You don’t have a lot of time, though: you closed the poll and the students are waiting. Make the decision. Make it now. Now. Make it NOW! Ack, too much pressure! My recommendation: keep it simple, especially if you’re new to peer instruction, and let your students talk to each other.
Here’s something that always works: You look at the distribution (so you begin preparing for the up-coming, class-wide discussion) and say,
Hmm, interesting. You’re not agreeing with each other. Please turn to your neighbors and convince them you have the right answer. Oh, and if you chose the same answer, check you chose it for the same reason.
Notice the prompt, “convince your neighbor you have the right answer.” Students aren’t experts in the field yet – that’s why they’re in your class – so “discuss this with your neighbors” doesn’t mean much:
Student 1: What’d you pick?
Student 2: A
Student 1: Yeah, me, too.
Help them practice thinking and talking like experts by giving them the task of convincing their neighbors.
There are two alternatives here, depending on the distribution of votes in the individual vote. If you’re comfortable with peer instruction and able to react in real-time to the distribution of votes shown on the i>clicker receiver (remember, the students haven’t seen that distribution), you might consider these:
if the correct choice is overwhelmingly popular, your students have already solved this problem. You’ve got better things to do that spend 5 minutes going over the answer. Show the distribution, confirm the answer, perhaps give them a little praise (“Great to see so many of you got that.”) and move on. And after class, make yourself a note: DO NOT USE THIS QUESTION NEXT TIME: it’s too easy.
if there’s a roughly even split between the top 2 choices, you know there could be a great discussion (especially if one choice is correct and the other is a common misconception.) Show the graph and say something like, “Wow, you’re really split between A and D [or whatever] on this one. Turn to your neighbors and convince them you’ve got the right answer.” By showing the distribution, you’re re-assuring the students that they’re not the only one thinking like that. If a student thinks other in the room are thinking the same things, they may be more confident to share their thinking with their peers.
remember, if you have any doubt that showing the distribution will hinder the peer-to-peer conversation, or if you’re not comfortable or quick enough to make the decision, you can always rely on the standard, “Hmm, interesting…” and not showing the graph.
At this point, the room should get loud. There should be conversations going on all over the place. Take this opportunity to LEAVE YOUR STUDENTS ALONE. This is their chance to practice talking like experts. Take this opportunity to
wander back to the podium, get a drink of water, check your phone is silent, put down the keys that have been jingle-jangling in your pocket
circulate around the room. Get up close to your students, especially the ones towards the back of the room. Don’t walk up to them and look them in the eye, though. That’s a signal they should stop talking and look at you because you have something wise and important to say. Instead, just wander around, listening in on their conversations. One of my favorite tricks is to walk up the aisle, stop, and suddenly become deeply, deeply engrossed in the instructor’s remote I’m carrying. I give it my full attention, usually popping open the battery compartment. But I’m listening intently to the conversation going on next to me. Here are some things to listen for:
who’s giving the correct reasoning for the question?
who’s displaying the common misconception that you made sure you included as one of the choices?
who’s having the conversation(s) you want them to have?
Try to remember where these people are sitting so you can invite them to speak up in the upcoming class-wide discussion. If you suspect those students might not be comfortable speaking up, consider talking to them (once their conversation is done) and say, “I really liked what you were saying in this group. Would one of you be willing to share that with the class during the discussion?” This little bit of praise and affirmation from the instructor might encourage students who normally don’t contribute to speak up.
When it sounds like the conversation is quieting down (they’ve said all they can say to each other) but before it starts to get loud again (when they’re bored and start to talk about movies, sports, next week’s essay,…) invite them to vote again. You have to be pretty loud to get their attention. If I’m wearing a lav mic, I tap it with my finger. I have a colleague who brings a big tuning fork to class and he bongs the tuning fork to get their attention. Usually it goes like this:
Okay, great conversations everyone. Please vote again. Yes, on the same question.
This vote shouldn’t take long, usually only 10-20 seconds since everyone is already familiar with the question and which choice they’re going to make. Watch the vote counter as it approaches the count from the first vote and, as before, give them a countdown.
You’re not done with peer instruction yet. The upcoming class-wide discussion is critical. You don’t want to waste a potentially rich discussion. If you show the distribution, you’re likely losing the the possibility that anyone will advocate for an unpopular choice. On the other hand, if there was a big swing from a split vote the first time to consensus on the second vote, you might show the graph and say, “Well, you were really split on the first vote but now it looks like most of you have chosen B. Let’s figure out why….” If in doubt, don’t show the distribution.
By now, the students have had a chance to think on their own, to practice explaining their thinking to their peers, and to get feedback from their peers. Now they’re ready to share their revised or reinforced thinking with the class and especially with you, their instructor. Don’t deny them that opportunity by having a “class-wide discussion” where you do all the talking. Your job now is to invite and welcome students into the discussion. Here are a few discussion-starters:
“It looks like almost everyone picked the correct answer on the second vote. Can someone tell me why C [say] is correct?”
“Even after two votes, you’re still split between A and B. Let’s figure this out together. Does anyone who picked A want to tell us why?” When the student starts to speak, be careful you don’t turn it into a 1-on-1 conversation that excludes everyone else. Signal to the student that they’re addressing the entire class, not just you. In large lecture halls, it works really well if you can get a couple of wireless handheld microphones from your Edtech Services team. When you identify the student who will explain choice A, your teaching assistant runs up the aisle and hands the student the microphone. When the student speaks and their voice booms out through the speakers, it’s clear that student is addressing the entire class.
Don’t be surprised if you ask for input about choice A, students put up their hands, you pick someone, and they say, “Well, we started with A but then we decided B is correct because….” If you interrupt and cut them off (“Sorry – uh, sorry – I’m looking for answer A right now. We’ll get to B in a moment”) that student probably won’t contribute much for the rest of this class. Or the next. They felt they had something interesting to say and were so confident about it, they took a risk and volunteered to talk to the entire class. THAT experience and success is way more important than your decision to go through the choices in a particular order. Just go with it, proving to your your students you value their contributions, and double-back to the other choices later.
If you’re hoping to get another student to advocate for a different choice, be careful to neither confirm nor deny that the first student has the right or wrong answer. Listen with a neutral voice and finish with, “Thank-you, that’s an interesting explanation. Now, who can tell us about choice B?” I worked with an instructor once who always started with one of the incorrect choices. As a student explained their thinking, the instructor would unconsciously droop his shoulders and slowly shake his head as he listened to an incorrect explanation. Then when he asked for someone to advocate for the correct answer, he’d straighten up and subtly nod his head. And when he asked the students which explanation they thought was correct, surprise surprise, they picked the second one.
If there’s an incorrect answer, and it’s incorrect for a good reason (for example, it’s based on a common misconception or a common error), after you’ve gone over the right answer, ask your students, “Can someone tell me why C is wrong?” Another really good follow-up like this is, “How could I change the question so C is the CORRECT answer?”
If you identified any group with an excellent answer while you were circulating around the room during the peer discussion, invite them to share their thinking with the class (especially if you spoke to them privately and they agreed to talk to the class. If you made that arrangement and then don’t ask them to speak, they’ll be pretty disappointed.)
If all else fails and you’re not sure how to drive the discussion, you can always ask, “What did your group talk about?” Notice it’s “your group” not “you” — students are likely to feel more confident about sharing their group’s thinking (“In my group, we talked about….”) Kind of like, “Well, I’ve got this friend and he thinks…”
Okay, almost done. First, you need to confirm the correct answer. You want to be absolutely sure that when you’re finished with peer instruction and you’re transitioning to the next part of your lesson, there aren’t students whispering to each other, “So, uh, what was the right answer again?” Second, if it didn’t happen during the discussion, model how an expert would answer the problem. I’ve heard colleagues say things like, “Those were terrific answers – I think you just about answered everything. Here’s how I thought about it…” or “Let me tell you how a physicist [or whatever] would approach this…”
And now you’re done with peer instruction. In those 2 to 5 to 10 minutes, your students have practiced expert-like thinking and behavior. Segue into your next mini-lecture by highlighting they’ve learned something that confirms they understood the preceding mini-lecture or something that prepares them for what they’re about to hear. Don’t forget: students can learn new things during peer instruction. It’s not just a way to test if they understand what you’ve been talking about.
Questions to Generate Discussion
[Note: a lot of what follows is identical to the “correct answer” protocol above. It’s repeated so you get the complete story in one place.]
Here’s the full protocol for running questions where every answer is correct and you’re only expecting one vote, not two. I encourage instructors to print out the protocol, bring it to class, and put it somewhere visible like the podium or desk. There are a lot of steps, in addition to all the other parts of the lesson, so give yourself a break and keep this “cheat sheet” handy (especially on the first few days of class where everything is harder.)
You work your way through your lesson and reach the peer instruction question. Say something that tells the students it’s time for peer instruction like, “And now, I’ve got a question for you…” or “Okay, let’s see what you think about this…” The slide with the question doesn’t need to be titled “Clicker Question”. The students know it’s time for peer instruction because they see the multiple choices on the slide. Why not give it a useful title related to the concept?
With the question on the screen, 2 things. First, do not read the question aloud:
the students don’t know if they’re supposed to listen to you or read the question – they can’t do both (especially students for whom English is a foreign language). Mary Jo Madda wrote a nice piece about cognitive load, Why Your Students Forgot Everything On Your PowerPoint Slides.
you might add extra information to the question or the choices that confuses the students
you might give away the answer by the tone of your voice (more enthusiastic on correct choice, monotone on incorrect) or your body language (nodding your head for correct choice, shaking your head on incorrect)
they’re going to have to carefully read questions like this on the exam so give them this chance to practice
(I’ve only heard of one good reason to read out the question, from my colleague Matthew Herbst. In his history classes, they encounter many foreign names of people and places and Matthew wants his students to hear how to pronounce those words.)
Second, remind the students to “Please answer this question on your own.” One of the key elements of peer instruction is that students first confront/confirm their own understanding of the concept. They need to know what they think so they’ll get something out of, and have something to contribute to, the upcoming discussion with their peers. If students don’t think on their own first, you’re inviting them to zone out, then listen to their loudest neighbor, and think, “Oh, yeah, that’s what I was thinking, too….”
If they insist on starting to whisper or talk with each other, try “Please answer this on your own. You’ll get a chance to talk to each other in a minute but right now, I need you to think. That’s how peer instruction helps them learn.” Another good line is, “You’re going to have to answer questions like this, by yourself, on the exam. Take this opportunity to practice.”
Open/start the poll. If you’re using i>clicker, try to keep the polling widget visible so the students see the timer counting up (not counting down – this isn’t a “Beat the Clock!” game show) and see how many other students have voted. Don’t announce that they have 30 or 60 seconds answer the question. How do you know it will take that long? The tricky part is deciding how long to leave the poll open to give students sufficient time to vote. What is “sufficient”? Here are some possibilities:
Let’s start with the best advice, courtesy of Ed Prather:: Turn and look at the question on the screen – give it your full attention, just like your students should. Read each word as if you’ve never seen the question before. Think about what kind of evidence you have for each statement and decide which one interests you the most. That’s the MINIMUM amount of time your students need. By the way, if experts do something with their hands or bodies to answer the problem (like physicists do that hand-spinning thing for the right-hand rule) – do that, too, modeling what an expert does.
If you have a good idea how many students are in the classroom at that moment, keep the poll open until almost everyone has voted.
If this is your second, third, fourth question of the day, you know how many people voted on the previous questions so you have a target.
Watch the students. Typically, they read the question, think, click, and then sit back expectantly, waiting for something to happen. When almost everyone is sitting back, it’s time to move to the next step.
DON’T wait for every last student to vote. Who knows why the last few aren’t voting – maybe they stepped out of the classroom, maybe they just don’t want to answer. If you wait impatiently for Student #200 to click, all you’re going to do is piss off the other 199.
When you’re close to the target number of votes, get ready to close the poll. Don’t just shut it, unannounced. That will only invite groans and pleas from the few students who were just about to vote and you didn’t give them a chance. Instead, give them a countdown. I always say something like, “Okay, it looks like just about everyone so I’m closing the poll in 3… 2… 1…. Thank-you.”
The goal of the next step – peer to peer discussion – is to give the students an opportunity to “try out” their thinking about the question, in a low-stakes, just-between-friends conversation. Except for a few special cases I’ll give below, you will totally short-circuit that conversation if you show the students the distribution of votes. Why? Because if there’s one answer that’s more popular than the others, students will try to convince each other that that answer is correct, even if it’s not.
Okay, there are a couple of special cases described below where showing the distribution of votes might – might – help. In order to make the decision whether or not to show the distribution, the instructor should glance at the i>clicker receiver to see the votes. You don’t have a lot of time, though: you closed the poll and the students are waiting. Make the decision. Make it now. Now. Make it NOW! Ack, too much pressure! My recommendation: keep it simple, especially if you’re new to peer instruction, and let your students talk to each other.
Here’s something that always works: You look at the distribution (so you begin preparing for the up-coming, class-wide discussion) and say,
Hmm, interesting. Please turn to your neighbors and explain to your neighbor why you chose your choice. Use evidence from the [readings, textbook, etc.] to support your position. Oh, and if you chose the same answer, compare your evidence and reasoning.
Notice the prompt, “use evidence from the readings.” My colleagues in History, for example, remind me they’re not interested in memorized names, dates, or facts. Learning history is about making a statement and then supporting it with evidence. That’s what this kind of peer instruction is about – giving students opportunities to practice finding and sharing evidence.
There are two alternatives here, depending on the distribution of votes in the individual vote. If you’re comfortable with peer instruction and able to react in real-time to the distribution of votes shown on the i>clicker receiver (remember, the students haven’t seen that distribution), you might consider these:
if there’s a roughly even split between the top 2 choices, you know there could be a great discussion (especially if one choice is correct and the other is a common misconception.) Show the graph and say something like, “Wow, you’re really split between A and D [or whatever] on this one. Explain to your neighbors why you selected your choice.” By showing the distribution, you’re re-assuring the students that they’re not the only one thinking like that. If a student thinks other in the room are thinking the same things, they may be more confident to share their thinking with their peers.
if one choice is overwhelmingly popular, for some reason, no one feels confident about explaining and/or supporting the other options. Why not? Was the popular choice to easy or obvious? Are they unable to support the other choices? Whatever the reason, there won’t be much opportunity for students to discuss different aspects of the question. You’ve got better things to do that spend 5 minutes going over the answer. Show the distribution, ask one or two people to explain their choice and the evidence. And after class, make yourself a note: DO NOT USE THIS QUESTION NEXT TIME: it’s not rich enough, doesn’t have enough flexibility to support multiple conversations, the students are unable (unprepared?) to answer it, etc.
remember, if you have any doubt that showing the distribution will hinder the peer-to-peer conversation, or if you’re not comfortable or quick enough to make the decision, you can always rely on the standard, “Hmm, interesting…” and not showing the graph.
At this point, the room should get loud. There should be conversations going on all over the place. Take this opportunity to LEAVE YOUR STUDENTS ALONE. This is their chance to practice talking like experts. Take this opportunity to
wander back to the podium, get a drink of water, check your phone is silent, put down the keys that have been jingle-jangling in your pocket
circulate around the room. Get up close to your students, especially the ones towards the back of the room. Don’t walk up to them and look them in the eye, though. That’s a signal they should stop talking and look at you because you have something wise and important to say. Instead, just wander around, listening in on their conversations. One of my favorite tricks is to walk up the aisle, stop, and suddenly become deeply, deeply engrossed in the instructor’s remote I’m carrying. I give it my full attention, usually popping open the battery compartment. But I’m listening intently to the conversation going on next to me. Here are some things to listen for:
who’s giving the correct reasoning / evidence for their choice?
who’s displaying the common misconception that you made sure you included as one of the choices?
which students are having the conversations you want them to have? (This can be a good way to create the question and choices in the first place: what conversations do you want to hear about this concept/content? Create choices that direct students into those conversations.)
Try to remember where these people are sitting so you can invite them to speak up in the upcoming class-wide discussion. If you suspect those students might not be comfortable speaking up, consider talking to them (once their conversation is done) and say, “I really liked what you were saying in this group. Would one of you be willing to share that with the class during the discussion?” This little bit of praise and affirmation from the instructor might encourage students who normally don’t contribute to speak up.
You’re not done with peer instruction yet. The upcoming class-wide discussion is critical. You don’t want to waste a potentially rich discussion. If you show the distribution, you’re likely losing the the possibility that anyone will advocate for an unpopular choice. On the other hand, students are more likely to share their understanding / interpretation if they see they’re not the only one who made that choice. If in doubt, don’t show the distribution.
By now, the students have had a chance to think on their own, to practice explaining their thinking and evidence to their peers, and to get feedback from their peers. Now they’re ready to share their revised or reinforced thinking with the class and especially with you, their instructor. Don’t deny them that opportunity by having a “class-wide discussion” where you do all the talking. Your job now is to invite and welcome students into the discussion. Here are a few discussion-starters:
“Every one of these is a possible interpretation so let’s work our way through them. Who can tell me about choice A?”
When the student starts to speak, be careful you don’t turn it into a 1-on-1 conversation that excludes everyone else. Signal to the student that they’re addressing the entire class, not just you. In large lecture halls, it works really well if you can get a couple of wireless handheld microphones from your Edtech Services team. When you identify the student who will explain choice A, your teaching assistant runs up the aisle and hands the student the microphone. When the student speaks and their voice booms out through the speakers, it’s clear that student is addressing the entire class.
Don’t be surprised if ask for input about A, students put up their hands, you pick someone, and they say, “Well, I started with A but then switched to B because….” If you interrupt and cut them off (“Sorry – uh, sorry – I’m looking for answer A right now. We’ll get to B in a moment.”) that student probably won’t contribute much for the rest of this class. Or the next. They felt they had something interesting to say and were so confident about it, they took a risk and volunteered to talk to the entire class. THAT experience and success is way more important than your decision to go through the choices in a particular order. Just go with it, proving to your your students you value their contributions, and double-back to the other choices later.
You should have an idea of the evidence / reasoning behind each choice. If you didn’t get enough about choice A from that student, ask if anyone has anything new to add before moving onto the next choice.
If you identified any group with an excellent answer while you were circulating around the room during the peer discussion, invite them to share their thinking with the class (especially if you spoke to them privately and they agreed to talk to the class. If you made that arrangement and then don’t ask them to speak, they’ll be pretty disappointed.)
Sometimes a question can have a choice that sparks an important discussion but no one picked it because they don’t want to be seen as supporting that choice. For example, I once heard someone discussing a question about the roles and responsibilities of the guards in the Nazi concentration camps. One choice was, “they were just doing their jobs.” Few students would pick that choice because they don’t want others to think that’s what they believe. But it’s an important conversation to have. In a situation like this, the instructor can ask, “What might someone be thinking if they selected this choice?” This way, students can talk about a hypothetical person without any appearance that they agree with the statement.
If all else fails and you’re not sure how to drive the discussion, you can always ask, “What did your group talk about?” Notice it’s “your group” not “you” — students are likely to feel more confident about sharing their group’s thinking (“In my group, we talked about….”) Kind of like, “Well, I’ve got this friend and he thinks…”
Okay, almost done. You created this question and gave the students this list of thought prompts because every prompt was important (and if there was a choice that was superfluous or off-track, well, there shouldn’t be.) Before you move onto the rest of your lesson, decide if everything you wanted covered was, in fact, covered. My colleague Heidi Keller-Lapp has an excellent approach here. The next slide in her presentation is a bullet list of all the things that should have been discussed via the peer instruction question. She goes down the list, “Yep, yep, yep we talked about that, yep, yep, oh wait, we didn’t mention this: recall such-and-such because of this-and-that. Then yup, yep, yep, okay, great conversation everyone!”
And now you’re done with peer instruction. These “generate discussion” questions can take 10 minutes or more. That’s not a waste of class time, though, it’s time when your students practice expert-like thinking and behavior. With your help, they discuss important aspects/interpretations, not (just) you. It’s not that peer instruction reinforces concepts/content you’d already discussed – peer instruction replaces the mini-lecture you used to give. Now segue into your next mini-lecture by highlighting new content or skills they’ve acquired and prepares them for what they’re about to hear. Don’t forget: students can learn new things during peer instruction. It’s not just a way to test if they understand what you’ve been talking about.
Whew, this is a long post, isn’t it? Honestly, it’s a way for me to get my understanding and recommendations for peer instruction into a format I can share and reference.
As I wrote way, way up there, these recommendations are not The Right Way To Run Peer Instruction With Clickers ™. I’d be really interested to hear your variations and rationale. Hmm…
If you read something Wednesday morning and it’s still bugging you on Friday afternoon, don’t keep having a conversation in your head, write about it.
A few days ago, yet another hand-wringing, oh-dear-what-shall-we-do-about-it post about students and their phones came through my Twitter feed. Over at Faculty Focus, Maryellen Weimer offers her advice about “The Age of Distraction: Getting Students to Put Away Their Phones and Focus on Learning.” She summarizes some research by Jeffrey H. Kuznekoff and Scott Titsworth which joins Duncan, Hoekstra & Wilcox (2012) in telling us students are distracted by their phones and learn less. I’m not questioning whatsoever the validity of these works. Doug Duncan is a friend and colleague but all he admits that their paper is saying is there’s a correlation between cell phone use and student learning.
It’s when people attribute causation that my blood starts to boil. “My students aren’t learning because they’re on their phones. What can we do about it? How can we get them to pay attention? It’s for their own good…” Yadda yadda yadda.
Here’s what I think:
Sticks
Carrots
Don’t ban phones and laptops from class.
Do make what happens in class more interesting and worthwhile than what they can find on their phones. Or find activities where they can use their mad searching, tweeting, texting, drawing, instagramming skills.
Don’t show them a graph of student marks vs phone use (Learning to interpret graphs is, itself, a learning objective of many instructors. It’s a skill that takes a lot of instruction and practice. Slapping a graph on the screen and saying, “See!” even if you try to explain it, is unlikely to have much impact.) or do some other phone-y demonstration to prove to them they’re not learning.
Do help them learn by getting them engaged with your content. Like a lifeguard that says, “Walk on the pool deck, please!” instead of “No running!”, show them what they can do, don’t tell them what they can’t.
Don’t start from the assumption that students will be on their phones and the instructor needs to find ways to get students to “put away their phones.”
Do with start with the goal of engaging students so that they have neither the time nor the desire to pull out their phones.
Is it naive to think it’s possible to keep them engaged? No. Instructors using peer instruction with clickers can keep their students’ attention. And, yes, these instructors still lecture: for a maximum of 10 minutes after they’ve used some clicker questions to ensure the students are “prepared to learn,” as Dan Schwartz would say.
Is it easy to keep students engaged for 50 minutes? No, but no one ever said teaching is easy.
* the title is my portmanteau of the expression, “If all you have is a hammer, everything looks like a nail” and the “carrot and stick” approach to driving your ass, er, mule.