Tag: CWSEI

Astronomy Labs

When I worked as a Science Education Specialist in the Department of Physics & Astronomy at UBC with the Carl Wieman Science Education Initiative, I had the opportunity to create lab activities for the survey astronomy courses (aka “Astro 101”). These are courses aimed at students outside the Faculty of Science who need some science credits to graduate. One course was about the Solar System; the other is about stars and galaxies.

With the support of the CWSEI, I worked with some terrific course instructors to first write learning outcomes for each course. We then identified the outcomes that would be better supported by hands-on learning in the labs. For example, it’s well known students struggle to learn about the phases of the Moon by listening to the professor and looking at diagrams in a traditional lecture, whereas in a hands-on lab setting, students would be better able to

  1. use the geometry of the Earth, Moon, and Sun to illustrate the phases of the Moon and to predict rise/set times
  2. illustrate the geometry of the Sun, Earth, and Moon during lunar and solar eclipses and explain why there are not eclipses every month

I aimed to develop activities that gave students opportunities to practice thinking and acting in more expert-like ways, rather than replicating and confirming known results. So, some of these activities are a bit unusual, like figuring out the best night of the month to sneak across campus or spaghettifying a Playdoh astronaut as he falls into a blackhole.

Format and Files

All the activities have a similar format:

  • The activities are designed to be completed in 50 minutes by 20-30 students in a basic lab environment (large tables to support teamwork and collaboration, some specialized equipment, space for students and TAs to circulate). They’re classified as “tutorials” because they’re only 50 minutes long, rather than 3-hour “labs”.
  • Each activity has a brief intro that motivates the outcomes, one or more active, hands-on, discovery phase(s), and ends with a short assessment the students hand in on their way out the door.
  • The activities are facilitated by 1 (or sometimes 2) trained and engaged Teaching Assistants and that required us to write guides for the TAs. It’s well known that “recipe” labs are less effective: students are able to follow a detailed set of instructions but often are unable to transfer what they verify to other contexts. We learned quickly that providing TAs with a recipe for running the activity (“1. Do A. 2. Get students to do B. 3. Do C….”) did not engage the TAs, gave them no opportunity to learn about teaching, and provided minimal professional development for those looking ahead to academic careers. So, I revised the TA Guides so they identify the required equipment and steps and also give recommended questions and scripts to drive the discussions and explanations for the pedagogical choices.
  • The files linked here include PDFs of the materials handed out to students, the TA Guide, and a .zip file with LaTeX, .eps graphics, and any other supporting materials. The LaTeX files use several packages including pstricks. Overleaf has no problem compiling the files when you select xelatex instead of pdflatex.

Attribution

You’re welcome to copy, borrow, and adapt to fit your context and outcomes. If there’s an opportunity to add some attribution, you can write

Unless other wise noted, resources are shared under a Creative Commons Attribution 4.0 International (CC-BY) license by Peter Newbury peternewbury.org. This work is supported by the Carl Wieman Science Education Initiative at the University of British Columbia.

 

When a meteorite hits the surface of a planet or moon, it creates an impact crater. This picture of our Moon’s Mare Nubium and surrounding hills shows some of the Moon’s surface is quite smooth while other regions are covered in craters. By measuring the sizes and number of craters, astronomers can learn about the objects (called the “impactors”) that struck the surface and also about the ages of various regions on the planet’s surface.
An orrery is a mechanical model of the Solar System. When you turn a crank, the planets and moons orbit the Sun at correctly-scaled distances with correctly-scaled periods. In this tutorial, you and your classmates build a scale model of the Solar System by marking the locations of the visible planets, Mercury, Venus, Earth, Mars, Jupiter and Saturn, at regular intervals of time. Later, when you and your classmates step from location to location, you’ll reproduce the motion of the planets – a human orrery!
Every month, the Moon appears to change shape in the sky as it goes through phases from new Moon to full Moon and then back to new. Ancient civilizations used the phases of the Moon to track the passage of time. Today's Gregorian calendar no longer depends on the phases of the Moon but the Islamic, Hebrew and Chinese cultures still base festivals and holy days on the cycles of the Moon.

The more you understand the nature of the Moon's phases, the more you can appreciate how astronomy influences our culture and the better you'll be able to predict when important events like Ramadan, Hannukah, Easter and Lunar New Year will occur.

In this tutorial, you will explore the changing geometry of the Sun-Earth-Moon system that produces each phase of the Moon, and then the connection between the geometry and the time of day the Moon rises and sets.

Madden et al. (2020) use an adaptation of this activity in an interesting astronomy education research project that compares students' learning and experiences using VR, a desktop computer simulation, and this hands-on analog activity.
The Sun, stars and planets cross our sky in complicated patterns that depend on the Earth’s daily rotation around its tilted axis and its annual revolution of the Earth around the Sun. For thousands of years, astronomers have watched the sky, figured out the patterns and built “computers” so they could predict when and where the Sun, stars and planets rise and set each day. In this tutorial, you’ll use your 21st Century computer to explore the motion of the Sun.

 

Note: this activity was built using the NAAP Motions of the Sky Simulator which doesn't function any more. You can easily adapt the activity to a simulation that shows the path of the Sun across the sky.

(Credit: NASA/Tim Pyle)
Astronomers have discovered hundreds of planets orbiting other stars. These planets are in solar systems beyond ours so they are called “extrasolar” planets. A growing number extrasolar planets are found by the transit method. In the transit method, astronomers take precise, long term observations of the brightness (or “intensity”) of a star and create a light curve for the star. In this tutorial, you’ll explore the connections between light curves and extrasolar planets and learn how to decode the light curve. Then you’ll examine the light curve of a real star and discover the characteristics of the planet HD 209458b, the first transiting extrasolar planet ever found.

(Credit: Robert Gendler)
Stars are the building blocks of the Universe – there are billions of stars in our Galaxy and billions of galaxies in the Universe. To understand how the Universe works, we need to understand how stars work. In this tutorial, you'll create a concept map to organize the content, reveal relationships and patterns, and make the content easier to recall later.
(Image credit: : Mt. Wilson Archive, Carnegie Institution of Washington)
Since the Big Bang nearly 14 billion years ago, the Universe has been expanding. We know that because we’re watching other galaxies follow a curious pattern: the farther away the galaxy, the faster it is moving away from us. This discovery, made by Hubble in 1929, is known as the Hubble Law. The Hubble Law comes with an optical illusion: it looks like we’re at the center of the Universe. Are we really that special? In this Tutorial, you’ll clear up this illusion.
In this activity, students investigate the quantities that determine the strength of the force of gravity between two objects, identifying what matters and how that quantity changes the force. So they can recognize and appreciate the inverse-square law of gravity, the students first play with an analogy: the amount of pain the cartoon character Fry feels when he looks are different sized light bulbs, from near and far and with open or squinting eyes. They do this through an “invention activity” (Schwartz and Martin, 2004) which are proven to increase students’ understanding of the new concept (gravity) and their ability to transfer that knowledge to other situations.
Look at the desk and look around the room. Seems pretty flat, doesn’t it? But the Earth isn’t flat, so why is the room? What about the Universe? Is it flat? Does it have positive curvature? Negative? How can we tell? In this activity, you’ll do experiments that explore the effects of curvature. The key to determining the shape is the number of degrees in a triangle.
White dwarfs and neutron stars are two bizarre forms of stellar corpses left behind after the star collapses. For a very massive star, though, nothing can stop its end-of-life collapse. The star becomes a black hole, one of the strangest and most extreme objects in the Universe. How extreme? Spacetime is so curved (or as Newton would say, “gravity is so strong”) not even light can escape once it falls into a black hole. What would happen to a star or a planet that gets too close to the black hole? In this tutorial, you’ll figure that out by watching a poor astronaut fall into the black hole of death!
The colour of a glowing gas, like a candle flame, the burner on a gas stove, or a star reveals its temperature: hotter gases glow blue, colder gases glow red. On more careful inspection, though, the light we receive from each gas contains an enormous amount of information: not just its temperature but also its chemical composition, motion and more. This information is found by decoding the spectrum of the gas. In this tutorial, you’ll learn how to “crack the code” and reveal what the glowing objects are made of.
Stars come in all colours and sizes, masses and brightnesses, ages, and distances. How can we possibly learn how stars work when each one appears to be unique? What we need are some relationships between the characteristics of stars. We already know that the colour of a star is directly related to the temperature of the star: red stars are cool, blue stars are hot. That means we don’t have to measure both colour and temperature – we get one from the other. Are there any other relationships? What does a “relationship” look like, anyway? And what does a relationship tell us about how stars work? In this tutorial, you’ll see what it means for characteristics to be related (or not related) and then see how to use the relationships.  

Planning your first day of class

As Will Rogers once said, “you never get a second chance to make a first impression.” What you do in your first day of class establishes the learning environment for the rest of your course, so it’s critical to think and plan carefully.

Nobel prize winner and science educator, Carl Wieman, reminds us the goals of the first class are to

  • motivate learning – why should your students engage and invest their time and energy?
  • personalize the experience – how can each student find your course meaningful?
  • establish expectations – how will your course run and what will happen in class?

That’s a lot to accomplish in 50 or 80 minutes, especially if you also want to (and you probably do!) start teaching your students about the content and concepts of your course.

Why is this important?

Why is it important to think about and plan your first class, on top of planning your syllabus, assessments, and lessons?

  1. You want every student to leave the first class thinking

    This will be a good course.
    I’m okay, I’m safe being here.
    I have something valuable to contribute.

  2. No matter how much you prepare, when the clock strikes and finally stand up at the front of the room and flip on your wireless mic, you are not at your best. You’re anxious and exhausted and nervous and excited. And that is NOT the moment you want to be making important decisions and setting precedents that will impact the rest of the course. Now, before the course starts, is the time to think and make decisions.
  3. More from Wieman: If you don’t spend time establishing the learning environment but instead, simply “go over the syllabus” or launch right into Topic 1,

    students who are most likely to see the subject as worth learning are those whose backgrounds, and corresponding attitudes, are most like that of the instructor. Those students whose backgrounds are different, which by definition (usually) includes most members of under-represented groups, will be less likely to understand the appeal of the subject and consequently more inclined to put their efforts into pursuing some other discipline.

Do-It-Yourself first class

This excellent resource (PDF) from the Carl Wieman Science Education Initiative contains dozens of suggestions for what you could do. There isn’t time to do them all.

I invite you to download this list and print this Venn diagram. For each item A, B, C,… (and others you add to the list) decide for yourself if the item motivates learning, personalizes the experience for the student, and/or establishes expectations. When you’re done, perhaps the items at the center of the Venn diagram – the items that do all three simultaneously – are the ones to build into your first class. That way, you can be the most efficient and effective in the limited time you have with your students.

What should you do in the first day of class? Things that simultaneously motive learning, personalize the experience, and establish expectations. (Graphic by Peter Newbury CC-BY)

I think you’ll find, for example, that when an item clearly establishes expectations and personalizes the experience, with just a small change in how you present it or build it into your class syllabus or policies, you can also motivate learning.

Do’s and Don’ts

What you do (and don’t do) in your first class is up to you, of course. As a helpful reminder from people who’ve been there before and seen it happen, here are some first day of class do’s and don’ts for you to consider.

DO DON’T
Check out the classroom before the first class

  • fully connect and test your laptop
  • using clickers? connect and test the hardware and software
  • how do you log into the podium/lecturn computer, if needed?
  • what’s the wifi like, even in the back corners?
  • how do the classroom lights work?
  • try the lapel (“lav”) mic
  • are you using a presentation remote to advance your slides? Does it work from the back of the room?
  • Assume you can figure it out at the time
  • let a technical problem ruin your only chance to make a first impression
Start the class on time (establish expectations!)
  • arrive late (what expectation does that establish!)
  • have “intimate” conversations with the (enthusiastic) students who arrive early and sit in the front row. This can signal to the rest of the class who will be getting special attention. Instead, circulate around the room and speak with lots of students, or greet everyone at the door.
Tell students you think they can all succeed if they put in the effort (growth mindset). It’s fine to say the course is challenging (after all, shouldn’t it be?) as long as you also let them know the course is

  • interesting
  • valuable
  • achievable with appropriate effort
Say threatening things like

  • you expect some of them to fail (“Look left, look right – one of you won’t be here by the end of the course.”)
  • this is a “weed-out” or “gatekeeping” course (to get rid of students who shouldn’t continue to the next course)
  • students don’t usually like this course
  • this course is really hard
Give them an authentic experience of what the class will be like.

  • If you’re going to use peer instruction with clickers, do it even though not everyone has a clicker yet. If awarding participation points is part of your plan, don’t start that until Week 2.
  • If you’re going to flip your class, send them a pre-reading assignment (and welcome) before the first day.
  • If you’ll be asking them to discuss challenging issues and items in small groups throughout the course, do it in the first class, too, maybe as an icebreaker.
Use teaching practices that are inconsistent with how you’ll teach the rest of the course.
Model academic integrity, today and every day. Address it when it’s needed: discuss plagiarism in Week 3 when you assign the first essay. Emphasize penalties for academic misconduct and all the ways a student can be kicked out of the university.

  • It establishes a feeling of distrust
  • Now is not the time they need to be hearing this. It’s important, yes, but not right now.
End the class on time with a slide containing the most valuable information, just in case a lost student missed the first few minutes of the class:

  • your preferred name
  • office location and hours
  • contact info
  • course website
  • Important Thing
End the class early (establishes the wrong expectation) or
end the class late (be kind to your anxious, exhausted colleague who’s trying to get into the classroom to set up their first class!)
Repeat vital information (your preferred name, contact info, Important Thing) at the begin of second class Assume everyone was there in the first class.
DO DON’T

You got this

Taking the time now to think and plan doesn’t mean you won’t be anxious and exhausted on your first day of class. But you can be confident in what you say and do. Through your actions and inactions (h/t, @ddmeyer, for that excellent phrase), you can support your students and not intensify their struggles.

Getting the most out of peer instruction

Peer instruction is a powerful, evidence-based instructional strategy that supports active learning in all sizes of classes. Typically in peer instruction, every 15-20 minutes,

  1. the instructor poses a conceptually challenging, multiple choice question
  2. students think about the question on their own and vote for one of the choices using some kind of audience response tool (“clickers”)
  3. students turn to their neighbors and discuss the question and their answers
  4. students may vote a second time, depending on the nature of the question
  5. the instructor leads a class-wide discussion where students share their thinking, finishing with
  6. the instructor models expert-like thinking and confirms why the right answers are right and the wrong answers are wrong

This can take anywhere from 2 to 10 or more minutes, depending on the question, the answers, and the richness of the discussion.

There are many pieces needed to make peer instruction effective, including

  • creating time in class (often by using a “flipped” model for the class),
  • building peer instruction into the syllabus and grading scheme,
  • writing good questions, and
  • selecting and using some education technology.

Even with all those pieces in place, there is still plenty of opportunity for an instructor to “short-circuit” the activity  and lose whatever potential for learning may have existed by how they run peer instruction in class. What follows is not The Right Way To Run Peer Instruction With Clickers ™ but rather, some recommendations to reduce the risk of messing it up.

Credit where it’s due

My colleague, Beth Simon, and I came up with this particular “choreography” or “protocol” with input from

To click or not to click?

(Image: Peter Newbury CC-BY)I’m going to describe peer instruction using i>clickers but you can adapt these recommendations to other #edtech options if those alternative

  • allow each student to individually commit to an answer
  • allow the instructor to see the results of the votes WITHOUT the students seeing them

The i>clicker system does these. Other electronic polling systems like PollEverywhere, TurningPoint, REEF, and Learning Catalytics do these, too, though it might take some clever manipulation of your laptop and the display to prevent the results of the votes from automatically being projected. I have many colleagues who can pull this off using colored ABCD voting cards.

Peer instruction for 2 types of questions

I want to distinguish between 2 types of peer instruction questions because they have slightly different versions of the choreography or protocol I’m sharing here.

Questions where there is a correct answer

In these types of questions, more often found in STEM classes, have a choice that’s right and choices that are wrong. With this type of question, the instructor expects there will be an individual vote, peer discussions with neighbors, a second vote, and then the class-wide discussion.

This peer instruction question has one correct answer. The others are incorrect for known reasons. Question adapted from one by Derek Bruff (Vanderbilt University).
This peer instruction question has one right answer. The others are wrong for known reasons. Question by Derek Bruff (Vanderbilt University).

Questions for generating discussion

What’s special about these types of questions is that every choice is correct (well, there might be one choice that’s deliberately wrong) and the goal is the get the students to commit to one of the choices and talk about it with their neighbors. Each choice is a thought prompt or conversation starter. The instructor only expects one vote here because the peer discussion is to tell your neighbors about the evidence for your choice and then listen to their thoughts about a different choice, not to convince them your choice is right. They’re ALL right!

This peer instruction question has one correct answer. The others are incorrect for known reasons. Question adapted from one by Derek Bruff (Vanderbilt University).
All the answers are right here – the goal is to get the students to commit to one and share the evidence for that  statement with their peers. Question by Heidi Keller-Lapp (UC San Diego).

Questions where there is a correct answer

Here’s the full protocol for running this kind of question. I encourage instructors to print out the protocol, bring it to class, and put it somewhere visible like the podium or desk. There are a lot of steps, in addition to all the other parts of the lesson, so give yourself a break and keep this “cheat sheet” handy (especially on the first few days of class where everything is harder.) I go into detail about each step below.

Recommended peer instruction protocol for questions with a correct answer or answers.
Click to download a 2-page PDF with both protocols.

 


PI_correctanswer_1You work your way through your lesson and reach the peer instruction question. Say something that tells the students it’s time for peer instruction like, “And now, I’ve got a question for you…” or “Okay, let’s see what you think about this…” The slide with the question doesn’t need to be titled “Clicker Question”. The students know it’s time for peer instruction because they see the multiple choices on the slide. Why not give it a useful title related to the concept?

 


PI_correctanswer_2With the question on the screen, 2 things. First, do not read the question aloud:

  • the students don’t know if they’re supposed to listen to you or read the question – they can’t do both (especially students for whom English is a foreign language). Mary Jo Madda wrote a nice piece about cognitive load, Why Your Students Forgot Everything On Your PowerPoint Slides.

  • you might add extra information to the question or the choices that confuses the students
  • you might give away the answer by the tone of your voice (more enthusiastic on correct choice, monotone on incorrect) or your body language (nodding your head for correct choice, shaking your head on incorrect)
  • they’re going to have to carefully read questions like this on the exam so give them this chance to practice
  • (I’ve only heard of one good reason to read out the question, from my colleague Matthew Herbst. In his history classes, they encounter many foreign names of people and places and Matthew wants his students to hear how to pronounce those words.)

Second, remind the students to “Please answer this question on your own.” One of the key elements of peer instruction is that students first confront/confirm their own understanding of the concept. They need to know what they think so they’ll get something out of, and have something to contribute to, the upcoming discussion with their peers. If students don’t think on their own first, you’re inviting them to zone out, then listen to their loudest neighbor, and think, “Oh, yeah, that’s what I think, too.”

It’s important to remind them to think on their own every time because they soon learn that when you talk to your neighbors, you can usually figure out the right answer. And then when the students vote, almost everyone has it right. The instructor is happy (“Wow, great job everyone!”) and the students are happy (because they got it right and because they made the instructor happy) and…. Enough with the happy! You’re there to make their brains hurt, not to make them happy. Make them think! And if they insist on starting to whisper or talk with each other, try “Please answer this on your own. You’ll get a chance to talk to each other in a minute but right now, I need you to think. That’s how peer instruction helps them learn.” Another good line is, “You’re going to have to answer questions like this, by yourself, on the exam. Take this opportunity to practice.”


PI_correctanswer_3Open/start the poll. If you’re using i>clicker, try to keep the polling widget visible so the students see the timer counting up (not counting down – this isn’t a “Beat the Clock!” game show) and see how many other students have voted. Don’t announce that they have 30 or 60 seconds answer the question. How do you know it will take that long? The tricky part is deciding how long to leave the poll open to give students sufficient time to vote. What is “sufficient”? Here are some possibilities:

  • Let’s start with the best advice, courtesy of Ed Prather: Turn and look at the question on the screen – give it your full attention, just like your students should. Read each word as if you’ve never seen the question before, go through the thinking needed to arrive at the answer and (pretend to) click. That’s the MINIMUM amount of time your students need. By the way, if experts do something with their hands or bodies to answer the problem (like physicists do that hand-spinning thing for the right-hand rule) – do that, too, modeling what an expert does.
  • If you have a good idea how many students are in the classroom at that moment, keep the poll open until almost everyone has voted.
  • If this is your second, third, fourth question of the day, you know how many people voted on the previous questions so you have a target.
  • Watch the students. Typically, they read the question, think, click, and then sit back expectantly, waiting for something to happen. When almost everyone is sitting back, it’s time to move to the next step.
  • DON’T wait for every last student to vote. Who knows why the last few aren’t voting – maybe they stepped out of the classroom, maybe they just don’t want to answer. If you wait impatiently for Student #200 to click, all you’re going to do is piss off the other 199.

PI_correctanswer_4When you’re close to the target number of votes, get ready to close the poll. Don’t just shut it, unannounced. That will only invite groans and pleas from the few students who were just about to vote and you didn’t give them a chance. Instead, give them a countdown. I always say something like, “Okay, it looks like just about everyone so I’m closing the poll in 3… 2… 1…. Thank-you.”

The goal of the next step – peer to peer discussion – is to give the students an opportunity to “try out” their thinking about the question, in a low-stakes, just-between-friends conversation. Except for a few special cases I’ll give below,  you will short-circuit that conversation if you show the students the distribution of votes. Why? Because if there’s one answer that’s more popular than the others, students will try to convince each other that that answer is correct, even if it’s not.

Okay, there are a couple of special cases described below where showing the distribution of votes might – might – help. In order to make the decision whether or not to show the distribution, the instructor should glance at the i>clicker receiver to see the votes. You don’t have a lot of time, though: you closed the poll and the students are waiting. Make the decision. Make it now. Now. Make it NOW! Ack, too much pressure! My recommendation: keep it simple, especially if you’re new to peer instruction, and let your students talk to each other.


PI_correctanswer_5Here’s something that always works: You look at the distribution (so you begin preparing for the up-coming, class-wide discussion) and say,

Hmm, interesting. You’re not agreeing with each other. Please turn to your neighbors and convince them you have the right answer. Oh, and if you chose the same answer, check you chose it for the same reason.

Notice the prompt, “convince your neighbor you have the right answer.” Students aren’t experts in the field yet – that’s why they’re in your class – so  “discuss this with your neighbors” doesn’t mean much:

Student 1: What’d you pick?
Student 2: A
Student 1: Yeah, me, too.

Help them practice thinking and talking like experts by giving them the task of convincing their neighbors.

There are two alternatives here, depending on the distribution of votes in the individual vote. If you’re comfortable with peer instruction and able to react in real-time to the distribution of votes shown on the i>clicker receiver (remember, the students haven’t seen that distribution), you might consider these:

  • if the correct choice is overwhelmingly popular, your students have already solved this problem. You’ve got better things to do that spend 5 minutes going over the answer. Show the distribution, confirm the answer, perhaps give them a little praise (“Great to see so many of you got that.”) and move on. And after class, make yourself a note: DO NOT USE THIS QUESTION NEXT TIME: it’s too easy.
  • if there’s a roughly even split between the top 2 choices, you know there could be a  great discussion (especially if one choice is correct and the other is a common misconception.) Show the graph and say something like, “Wow, you’re really split between A and D [or whatever] on this one. Turn to your neighbors and convince them you’ve got the right answer.” By showing the distribution, you’re re-assuring the students that they’re not the only one thinking like that. If a student thinks other in the room are thinking the same things, they may be more confident to share their thinking with their peers.
  • remember, if you have any doubt that showing the distribution will hinder the peer-to-peer conversation, or if you’re not comfortable or quick enough to make the decision, you can always rely on the standard, “Hmm, interesting…” and not showing the graph.

At this point, the room should get loud. There should be conversations going on all over the place. Take this opportunity to LEAVE YOUR STUDENTS ALONE. This is their chance to practice talking like experts. Take this opportunity to

  • wander back to the podium, get a drink of water, check your phone is silent, put down the keys that have been jingle-jangling in your pocket
  • circulate around the room. Get up close to your students, especially the ones towards the back of the room. Don’t walk up to them and look them in the eye, though. That’s a signal they should stop talking and look at you because you have something wise and important to say. Instead, just wander around, listening in on their conversations. One of my favorite tricks is to walk up the aisle, stop, and suddenly become deeply, deeply engrossed in the instructor’s remote I’m carrying. I give it my full attention, usually popping open the battery compartment. But I’m listening intently to the conversation going on next to me. Here are some things to listen for:
    • who’s giving the correct reasoning for the question?
    • who’s displaying the common misconception that you made sure you included as one of the choices?
    • who’s having the conversation(s) you want them to have?

    Try to remember where these people are sitting so you can invite them to speak up in the upcoming class-wide discussion. If you suspect those students might not be comfortable speaking up, consider talking to them (once their conversation is done) and say, “I really liked what you were saying in this group. Would one of you be willing to share that with the class during the discussion?” This little bit of praise and affirmation from the instructor might encourage students who normally don’t contribute to speak up.


PI_correctanswer_6When it sounds like the conversation is quieting down (they’ve said all they can say to each other) but before it starts to get loud again (when they’re bored and start to talk about movies, sports, next week’s essay,…) invite them to vote again. You have to be pretty loud to get their attention. If I’m wearing a lav mic, I tap it with my finger. I have a colleague who brings a big tuning fork to class and he bongs the tuning fork to get their attention. Usually it goes like this:

Okay, great conversations everyone. Please vote again. Yes, on the same question.


PI_correctanswer_7This vote shouldn’t take long, usually only 10-20 seconds since everyone is already familiar with the question and which choice they’re going to make. Watch the vote counter as it approaches the count from the first vote and, as before, give them a countdown.

You’re not done with peer instruction yet. The upcoming class-wide discussion is critical. You don’t want to waste a potentially rich discussion. If you show the distribution, you’re likely losing the the possibility that anyone will advocate for an unpopular choice. On the other hand, if there was a big swing from a split vote the first time to consensus on the second vote, you might show the graph and say, “Well, you were really split on the first vote but now it looks like most of you have chosen B. Let’s figure out why….” If in doubt, don’t show the distribution.


PI_correctanswer_8By now, the students have had a chance to think on their own, to practice explaining their thinking to their peers, and to get feedback from their peers. Now they’re ready to share their revised or reinforced thinking with the class and especially with you, their instructor. Don’t deny them that opportunity by having a “class-wide discussion” where you do all the talking. Your job now is to invite and welcome students into the discussion. Here are a few discussion-starters:

  • “It looks like almost everyone picked the correct answer on the second vote. Can someone tell me why C [say] is correct?”
  • “Even after two votes, you’re still split between A and B. Let’s figure this out together. Does anyone who picked A want to tell us why?” When the student starts to speak, be careful you don’t turn it into a 1-on-1 conversation that excludes everyone else. Signal to the student that they’re addressing the entire class, not just you. In large lecture halls, it works really well if you can get a couple of wireless handheld microphones from your Edtech Services team. When you identify the student who will explain choice A, your teaching assistant runs up the aisle and hands the student the microphone. When the student speaks and their voice booms out through the speakers, it’s clear that student is addressing the entire class.
  • Don’t be surprised if you ask for input about choice A, students put up their hands, you pick someone, and they say, “Well, we started with A but then we decided B is correct because….” If you interrupt and cut them off (“Sorry – uh, sorry – I’m looking for answer A right now. We’ll get to B in a moment”) that student probably won’t contribute much for the rest of this class. Or the next. They felt they had something interesting to say and were so confident about it, they took a risk and volunteered to talk to the entire class. THAT experience and success is way more important than your decision to go through the choices in a particular order. Just go with it, proving to your your students you value their contributions, and double-back to the other choices later.
  • If you’re hoping to get another student to advocate for a different choice, be careful to neither confirm nor deny that the first student has the right or wrong answer. Listen with a neutral voice and finish with, “Thank-you, that’s an interesting explanation. Now, who can tell us about choice B?” I worked with an instructor once who always started with one of the incorrect choices. As a student explained their thinking, the instructor would unconsciously droop his shoulders and slowly shake his head as he listened to an incorrect explanation. Then when he asked for someone to advocate for the correct answer, he’d straighten up and subtly nod his head. And when he asked the students which explanation they thought was correct, surprise surprise, they picked the second one.
  • If there’s an incorrect answer, and it’s incorrect for a good reason (for example, it’s based on a common misconception or a common error), after you’ve gone over the right answer, ask your students, “Can someone tell me why C is wrong?” Another really good follow-up like this is, “How could I change the question so C is the CORRECT answer?”
  • If you identified any group with an excellent answer while you were circulating around the room during the peer discussion, invite them to share their thinking with the class (especially if you spoke to them privately and they agreed to talk to the class. If you made that arrangement and then don’t ask them to speak, they’ll be pretty disappointed.)
  • If all else fails and you’re not sure how to drive the discussion, you can always ask, “What did your group talk about?” Notice it’s “your group” not “you” — students are likely to feel more confident about sharing their group’s thinking (“In my group, we talked about….”) Kind of like, “Well, I’ve got this friend and he thinks…”

 


PI_correctanswer_9Okay, almost done. First, you need to confirm the correct answer. You want to be absolutely sure that when you’re finished with peer instruction and you’re transitioning to the next part of your lesson, there aren’t students whispering to each other, “So, uh, what was the right answer again?” Second, if it didn’t happen during the discussion, model how an expert would answer the problem. I’ve heard colleagues say things like, “Those were terrific answers – I think you just about answered everything. Here’s how I thought about it…” or “Let me tell you how a physicist [or whatever] would approach this…”

 


And now you’re done with peer instruction. In those 2 to 5 to 10 minutes, your students have practiced expert-like thinking and behavior. Segue into your next mini-lecture by highlighting they’ve learned something that confirms they understood the preceding mini-lecture or something that prepares them for what they’re about to hear. Don’t forget: students can learn new things during peer instruction. It’s not just a way to test if they understand what you’ve been talking about.


Questions to Generate Discussion

[Note: a lot of what follows is identical to the “correct answer” protocol above. It’s repeated so you get the complete story in one place.]

Here’s the full protocol for running questions where every answer is correct and you’re only expecting one vote, not two. I encourage instructors to print out the protocol, bring it to class, and put it somewhere visible like the podium or desk. There are a lot of steps, in addition to all the other parts of the lesson, so give yourself a break and keep this “cheat sheet” handy (especially on the first few days of class where everything is harder.)

By the way, this structured approach to generating a discussion seems to mesh well with Jay R. Howard’s Discussion in the College Classroom: Getting Your Students Engaged and Participating in Person and Online as summarized by James Lang’s post Building a Better Discussion in The Chronicle of Higher Education.

Recommended peer instruction protocol for questions where every choice is correct and you’re only expecting one vote. Click to download a PDF.

 


You work your way through your lesson and reach the peer instruction question. Say something that tells the students it’s time for peer instruction like, “And now, I’ve got a question for you…” or “Okay, let’s see what you think about this…” The slide with the question doesn’t need to be titled “Clicker Question”. The students know it’s time for peer instruction because they see the multiple choices on the slide. Why not give it a useful title related to the concept?


With the question on the screen, 2 things. First, do not read the question aloud:

  • the students don’t know if they’re supposed to listen to you or read the question – they can’t do both (especially students for whom English is a foreign language). Mary Jo Madda wrote a nice piece about cognitive load, Why Your Students Forgot Everything On Your PowerPoint Slides.

  • you might add extra information to the question or the choices that confuses the students
  • you might give away the answer by the tone of your voice (more enthusiastic on correct choice, monotone on incorrect) or your body language (nodding your head for correct choice, shaking your head on incorrect)
  • they’re going to have to carefully read questions like this on the exam so give them this chance to practice
  • (I’ve only heard of one good reason to read out the question, from my colleague Matthew Herbst. In his history classes, they encounter many foreign names of people and places and Matthew wants his students to hear how to pronounce those words.)

Second, remind the students to “Please answer this question on your own.” One of the key elements of peer instruction is that students first confront/confirm their own understanding of the concept. They need to know what they think so they’ll get something out of, and have something to contribute to, the upcoming discussion with their peers. If students don’t think on their own first, you’re inviting them to zone out, then listen to their loudest neighbor, and think, “Oh, yeah, that’s what I was thinking, too….”

If they insist on starting to whisper or talk with each other, try “Please answer this on your own. You’ll get a chance to talk to each other in a minute but right now, I need you to think. That’s how peer instruction helps them learn.” Another good line is, “You’re going to have to answer questions like this, by yourself, on the exam. Take this opportunity to practice.”


Open/start the poll. If you’re using i>clicker, try to keep the polling widget visible so the students see the timer counting up (not counting down – this isn’t a “Beat the Clock!” game show) and see how many other students have voted. Don’t announce that they have 30 or 60 seconds answer the question. How do you know it will take that long? The tricky part is deciding how long to leave the poll open to give students sufficient time to vote. What is “sufficient”? Here are some possibilities:

  • Let’s start with the best advice, courtesy of Ed Prather:: Turn and look at the question on the screen – give it your full attention, just like your students should. Read each word as if you’ve never seen the question before. Think about what kind of evidence you have for each statement and decide which one interests you the most. That’s the MINIMUM amount of time your students need. By the way, if experts do something with their hands or bodies to answer the problem (like physicists do that hand-spinning thing for the right-hand rule) – do that, too, modeling what an expert does.
  • If you have a good idea how many students are in the classroom at that moment, keep the poll open until almost everyone has voted.
  • If this is your second, third, fourth question of the day, you know how many people voted on the previous questions so you have a target.
  • Watch the students. Typically, they read the question, think, click, and then sit back expectantly, waiting for something to happen. When almost everyone is sitting back, it’s time to move to the next step.
  • DON’T wait for every last student to vote. Who knows why the last few aren’t voting – maybe they stepped out of the classroom, maybe they just don’t want to answer. If you wait impatiently for Student #200 to click, all you’re going to do is piss off the other 199.

When you’re close to the target number of votes, get ready to close the poll. Don’t just shut it, unannounced. That will only invite groans and pleas from the few students who were just about to vote and you didn’t give them a chance. Instead, give them a countdown. I always say something like, “Okay, it looks like just about everyone so I’m closing the poll in 3… 2… 1…. Thank-you.”

The goal of the next step – peer to peer discussion – is to give the students an opportunity to “try out” their thinking about the question, in a low-stakes, just-between-friends conversation. Except for a few special cases I’ll give below, you will totally short-circuit that conversation if you show the students the distribution of votes. Why? Because if there’s one answer that’s more popular than the others, students will try to convince each other that that answer is correct, even if it’s not.

Okay, there are a couple of special cases described below where showing the distribution of votes might – might – help. In order to make the decision whether or not to show the distribution, the instructor should glance at the i>clicker receiver to see the votes. You don’t have a lot of time, though: you closed the poll and the students are waiting. Make the decision. Make it now. Now. Make it NOW! Ack, too much pressure! My recommendation: keep it simple, especially if you’re new to peer instruction, and let your students talk to each other.


Here’s something that always works: You look at the distribution (so you begin preparing for the up-coming, class-wide discussion) and say,

Hmm, interesting. Please turn to your neighbors and explain to your neighbor why you chose your choice. Use evidence from the [readings, textbook, etc.] to support your position. Oh, and if you chose the same answer, compare your evidence and reasoning.

Notice the prompt, “use evidence from the readings.” My colleagues in History, for example, remind me they’re not interested in memorized names, dates, or facts. Learning history is about making a statement and then supporting it with evidence. That’s what this kind of peer instruction is about – giving students opportunities to practice finding and sharing evidence.

There are two alternatives here, depending on the distribution of votes in the individual vote. If you’re comfortable with peer instruction and able to react in real-time to the distribution of votes shown on the i>clicker receiver (remember, the students haven’t seen that distribution), you might consider these:

  • if there’s a roughly even split between the top 2 choices, you know there could be a great discussion (especially if one choice is correct and the other is a common misconception.) Show the graph and say something like, “Wow, you’re really split between A and D [or whatever] on this one. Explain to your neighbors why you selected your choice.” By showing the distribution, you’re re-assuring the students that they’re not the only one thinking like that. If a student thinks other in the room are thinking the same things, they may be more confident to share their thinking with their peers.
  • if one choice is overwhelmingly popular, for some reason, no one feels confident about explaining and/or supporting the other options. Why not? Was the popular choice to easy or obvious? Are they unable to support the other choices? Whatever the reason, there won’t be much opportunity for students to discuss different aspects of the question. You’ve got better things to do that spend 5 minutes going over the answer. Show the distribution, ask one or two people to explain their choice and the evidence. And after class, make yourself a note: DO NOT USE THIS QUESTION NEXT TIME: it’s not rich enough, doesn’t have enough flexibility to support multiple conversations, the students are unable (unprepared?) to answer it, etc.
  • remember, if you have any doubt that showing the distribution will hinder the peer-to-peer conversation, or if you’re not comfortable or quick enough to make the decision, you can always rely on the standard, “Hmm, interesting…” and not showing the graph.

At this point, the room should get loud. There should be conversations going on all over the place. Take this opportunity to LEAVE YOUR STUDENTS ALONE. This is their chance to practice talking like experts. Take this opportunity to

  • wander back to the podium, get a drink of water, check your phone is silent, put down the keys that have been jingle-jangling in your pocket
  • circulate around the room. Get up close to your students, especially the ones towards the back of the room. Don’t walk up to them and look them in the eye, though. That’s a signal they should stop talking and look at you because you have something wise and important to say. Instead, just wander around, listening in on their conversations. One of my favorite tricks is to walk up the aisle, stop, and suddenly become deeply, deeply engrossed in the instructor’s remote I’m carrying. I give it my full attention, usually popping open the battery compartment. But I’m listening intently to the conversation going on next to me. Here are some things to listen for:
    • who’s giving the correct reasoning / evidence for their choice?
    • who’s displaying the common misconception that you made sure you included as one of the choices?
    • which students are having the conversations you want them to have? (This can be a good way to create the question and choices in the first place: what conversations do you want to hear about this concept/content? Create choices that direct students into those conversations.)

    Try to remember where these people are sitting so you can invite them to speak up in the upcoming class-wide discussion. If you suspect those students might not be comfortable speaking up, consider talking to them (once their conversation is done) and say, “I really liked what you were saying in this group. Would one of you be willing to share that with the class during the discussion?” This little bit of praise and affirmation from the instructor might encourage students who normally don’t contribute to speak up.


PI_manyanswers_6 You’re not done with peer instruction yet. The upcoming class-wide discussion is critical. You don’t want to waste a potentially rich discussion. If you show the distribution, you’re likely losing the the possibility that anyone will advocate for an unpopular choice. On the other hand, students are more likely to share their understanding / interpretation if they see they’re not the only one who made that choice. If in doubt, don’t show the distribution.


PI_manyanswers_7 By now, the students have had a chance to think on their own, to practice explaining their thinking and evidence to their peers, and to get feedback from their peers. Now they’re ready to share their revised or reinforced thinking with the class and especially with you, their instructor. Don’t deny them that opportunity by having a “class-wide discussion” where you do all the talking. Your job now is to invite and welcome students into the discussion. Here are a few discussion-starters:

  • “Every one of these is a possible interpretation so let’s work our way through them. Who can tell me about choice A?”
  • When the student starts to speak, be careful you don’t turn it into a 1-on-1 conversation that excludes everyone else. Signal to the student that they’re addressing the entire class, not just you. In large lecture halls, it works really well if you can get a couple of wireless handheld microphones from your Edtech Services team. When you identify the student who will explain choice A, your teaching assistant runs up the aisle and hands the student the microphone. When the student speaks and their voice booms out through the speakers, it’s clear that student is addressing the entire class.
  • Don’t be surprised if ask for input about A, students put up their hands, you pick someone, and they say, “Well, I started with A but then switched to B because….” If you interrupt and cut them off (“Sorry – uh, sorry – I’m looking for answer A right now. We’ll get to B in a moment.”) that student probably won’t contribute much for the rest of this class. Or the next. They felt they had something interesting to say and were so confident about it, they took a risk and volunteered to talk to the entire class. THAT experience and success is way more important than your decision to go through the choices in a particular order. Just go with it, proving to your your students you value their contributions, and double-back to the other choices later.
  • You should have an idea of the evidence / reasoning behind each choice. If you didn’t get enough about choice A from that student, ask if anyone has anything new to add before moving onto the next choice.
  • If you identified any group with an excellent answer while you were circulating around the room during the peer discussion, invite them to share their thinking with the class (especially if you spoke to them privately and they agreed to talk to the class. If you made that arrangement and then don’t ask them to speak, they’ll be pretty disappointed.)
  • Sometimes a question can have a choice that sparks an important discussion but no one picked it because they don’t want to be seen as supporting that choice. For example, I once heard someone discussing a question about the roles and responsibilities of the guards in the Nazi concentration camps. One choice was, “they were just doing their jobs.” Few students would pick that choice because they don’t want others to think that’s what they believe. But it’s an important conversation to have. In a situation like this, the instructor can ask, “What might someone be thinking if they selected this choice?” This way, students can talk about a hypothetical person without any appearance that they agree with the statement.
  • If all else fails and you’re not sure how to drive the discussion, you can always ask, “What did your group talk about?” Notice it’s “your group” not “you” — students are likely to feel more confident about sharing their group’s thinking (“In my group, we talked about….”) Kind of like, “Well, I’ve got this friend and he thinks…”

Okay, almost done. You created this question and gave the students this list of thought prompts because every prompt was important (and if there was a choice that was superfluous or off-track, well, there shouldn’t be.) Before you move onto the rest of your lesson, decide if everything you wanted covered was, in fact, covered. My colleague Heidi Keller-Lapp has an excellent approach here. The next slide in her presentation is a bullet list of all the things that should have been discussed via the peer instruction question. She goes down the list, “Yep, yep, yep we talked about that, yep, yep, oh wait, we didn’t mention this: recall such-and-such because of this-and-that. Then yup, yep, yep, okay, great conversation everyone!”


And now you’re done with peer instruction. These “generate discussion” questions can take 10 minutes or more. That’s not a waste of class time, though, it’s time when your students practice expert-like thinking and behavior. With your help, they discuss important aspects/interpretations, not (just) you. It’s not that peer instruction reinforces concepts/content you’d already discussed – peer instruction replaces the mini-lecture you used to give. Now segue into your next mini-lecture by highlighting new content or skills they’ve acquired and prepares them for what they’re about to hear. Don’t forget: students can learn new things during peer instruction. It’s not just a way to test if they understand what you’ve been talking about.


Whew, this is a long post, isn’t it? Honestly, it’s a way for me to get my understanding and recommendations for peer instruction into a format I can share and reference.

As I wrote way, way up there, these recommendations are not The Right Way To Run Peer Instruction With Clickers ™. I’d be really interested to hear your variations and rationale. Hmm…

Navigation