Tag: teaching

Why should I use peer instruction in my class?

Image: "Lecture Hall," uniinnsbruck, Flickr (CC)

[Update (June 16): Lead author Zdeslav Hrepic pointed me to a follow-up book chapter [PDF] where he and the study co-authors describe using tablet-PCs to counter the problems uncovered in their study. Thanks, Z.]

I’m sure we’ve all heard it from skeptical instructors: Why should I use peer instruction in my class? In response, we often cite Hake’s 6000-student study or the new UBC study by my colleagues Louis, Ellen and Carl. These are still pretty abstract, though: If you use interactive, learner-centered instruction, you can expect your students to better grasp of the concepts.

“Sure, but why?” the instructors ask. “Why does it work?”

I just read a paper that can help answer that question. I ran across it while following a discussion about the Khan Academy videos and whether or not they are good tools for learning. This paper by Hrepic, Zollman and Rebello (2007) asks students in an introductory physics course and physics experts (with M.Sc’s and Ph.D’s) to watch a 15 minute video of a renowned physics educator presenting a topic in physics.

The researchers do a series of pre- and post-tests and interviews with the students and experts to compare their understanding of the concepts covered (or not) in the video. There were some significant differences. A couple that stick in my head. (1) students recalled learning about concepts that were not presented in the video. (2) Only students who knew the correct answers on the pre-test were able to infer the concepts from the video (that is, the questions were not explicitly answered in the video.) The students who did not know the concept before were unable to make the inferences. Like I said, there are significant differences between what the instructor thinks a lecture covers and what the students think is covered.

The paper nicely gives us some suggestions to counter this problem.

And my thoughts about how to use peer instruction to do that.

Making inferences: Experts make more inferences than students. And only students who already know the concepts can infer them from the lecture. Therefore, instructors need to be cautious about relying on students to fill in the blanks.

Some of the best peer instruction questions are the conceptual questions where the answer is not simple recall. No traxoline here, please. Questions that rely on students making inferences are excellent for promoting discussion because it’s likely students will interpret the question differently, make different assumptions and come to different conclusions. <soapbox> All the more reason that students need to first answer clicker questions on their own so they’re prepared to share their inferences. </soapbox>

Prior knowledge: Students’ prior knowledge influences what they perceive and can “distort” their recollection of what the lecturer says. Therefore, it’s essential that the instructor has some idea of what the students already know (particularly their misconceptions) before presenting new material.

A few, introductory clicker questions will reveal the students’ prior knowledge. Sure, maybe these are simple recall questions that won’t generate a lot of discussion. But the students’ responses will inform the agile instructor who can tailor the instruction.

Continuous feedback about students’ understanding: The trail the instructor blazes through the concepts and the path the students follow often diverge during a lecture. The instructor should be continuously gathering and reacting to feedback from the students about their understanding so the instructor can shepherd the students back on track.

Observant instructors can gather critical feedback from the discussions that occur during peer instruction or the students answers on in-class worksheets like the Lecture-Tutorials popular in introductory “Astro 101” classes and other hybrids of the Washington Tutorials. Rather than waiting weeks until after the midterm or final exam to find out students totally missed Concept X, the instructor can discover it within minutes of introducing the topic. Minutes, not weeks! The agile instructor can immediately revisit the difficult concepts. Immediately, not weeks later or never!

I’m much more confident I can answer the skeptical instructor now. “Why should I use clickers in my classroom?” Because they give the students and you to ability to assess the current level of understanding of the concepts. Current, right now, before it’s too late and the house of cards you’re so carefully building come crashing down.

How should I share materials?

[Update (9 September 2011): Finally stopped procrastin–, er, planning and did it. Follow the “Astro Labs” link at the top of the page. I’m continually adding new activities so check back periodically. Or watch for announcements on my twitter feed, @polarisdotca .]

The goal of the Carl Wieman Science Education Initiative (CWSEI) is to improve undergraduate science education. The chosen method for doing that is based on 3 “pillars”:

In my position as a CWSEI Science and Teaching Learning Fellow in the Department of Physics and Astronomy, I get to spend time working on each of these pillars. Sometimes,  I flit from pillar to pillar to pillar in a single sitting, like when I’m making up a nice think-pair-share clicker question. Other times, I can spend an hour, a day, a month working on one pillar. For instance, I spent the good part of a summer working with our introductory astronomy (“Astro 101”) instructors on a set of learning goals, statements directed at the students like

[By the end of this course, you will be able to] use the geometry of the Earth, Moon and Sun to illustrate the phases of the Moon and predict the Moon’s rise and set times.

For the last couple of terms, I’ve been working closely with the Astro 101 instructors on instructional approaches to help them become more effective instructors.

But it’s hard to be an effective instructor if you don’t have good materials to work with. (No, I’m not saying good materials make you a good instructor — I’m a math grad, I know all that necessary and/or sufficient stuff.)  So I have spent considerable time in the last few years creating activities for our Astro 101 labs. These aren’t traditional, 3-hour labs. Rather, they’re 1-hour, hands-on activities run in groups of less than 40 students. Following our American friends, we call them “tutorials” even though the rest of UBC uses “tutorial” for that hour you spend with a teaching assistant going over problems on the board.

Once we’d drafted the set of learning goals for Astro 101, we selected the learning goals that would be best tackled with a hands-on activity. The Moon phases goal mentioned above, for example. Or “describe experiments or observations that would detect if space is flat, has positive or negative curvature.” Then I set about creating the activity, cycling from CWSEI pillar to pillar.

It got pretty hectic, at times. We have some large classes with the students split into 5 or 6 tutorial sections each week. I’d get the activity ready and create a set of worksheets that we’d use in the Monday section. Then I’d sit in as the teaching assistants led the activity, observing the students, talking to them about how they answered the questions and talking to the teaching assistants about what worked and what didn’t. That afternoon (or night!) I’d make some changes and try version 2 on Tuesday. And repeat. Throughout the week. And then assess on the final exam. Eventually, we ended up with some, quite frankly, excellent activities. The most “mature” activities consist of

  • worksheets to guide the students through the activity
  • question sheet to assess their knowledge at the end of the activity
  • equipment
  • detailed guide for the teaching assistants, including how to set up the equipment, how to facilitate the activity, suggestions for prompts and Socratic-style questions to guide the students, solutions to the assessment
  • in some cases, materials for adapting the activity for use in the classroom
  • exam questions that assess the selected learning goal(s)

It’s taken several years to get here. And it’s time to visit the fourth CWSEI pillar:

disseminate what works

Yes, it’s time to share the activities. A couple of them are already out there, like the human orrery activity [with video] or a concept-mapping activity that will appear in the proceedings of Cosmos in the Classroom 2010. But what about the rest? How do I share them with the community of astronomy educators which includes, I believe

  • post-secondary Astro 101 instructors
  • teaching assistants
  • lab instructors
  • K-12 teachers
  • museum/science center presenters sharing astronomy with school children and the general public
  • astronomy education researchers

I feel there are 2 major decisions to make:

1. Are they free?

I’ve got a pretty good relationship with a certain textbook publisher and I could certainly talk to them about finding a way to bundle the activities up into a workbook. But honestly, I don’t want to go that route. The CWSEI and my Department have been paying me to create these materials – and in some sense, they’re already paid for. In the spirit of standing on the shoulders of giants, I’d like to make them available to anyone who wants them. Does it mean anything if I add ” © 2011 Peter Newbury” in the footer. Or is that “© 2011 UBC”? No, the intellectual property policies at UBC are pretty clear it belongs to me:

Copyright and other intellectual property rights to scholarly and literary works—including books, lecture notes, laboratory manuals [my emphasis], artifacts, visual art and music—produced by those connected with the University belong to the individuals involved.

Or maybe I tag them with a Creative Commons license to use, adapt but give credit where credit is due.

2. What format?

Full disclosure, right here, right now: These materials are written in LaTeX and I will not, I repeat not, Not, NOT re-write them in MS-frickin-Word. One more auto-format because apparently I’m stupid and it knows what I want and I’m going to tear out my hard-drive. And sorry, I don’t know iPages or whatever that Apple iProgram is iCalled.  Plus, I get such a geek thrill out turning this

% Jupiter orbit
t cos 5.2 mul t 9 mul cos 1.5 mul add
t sin 5.2 mul t 9 mul sin 1.5 mul add}

into this [update 7 June 2011: here’s the full .tex file]

Jupiter's spirograph orbit comes from one line of sweet, LaTeX PSTricks code.

So here’s what I’m thinking: for each activity, I’ll make available the .tex files, .eps figures, other graphics and PDFs which are ready-to-use but can’t (easily) be edited. I could add a new page to this WP blog and distribute them there.

What would work for you?

Like the heading asks, what would work for you? Something I suggested above? Or maybe something entirely different? Please leave a comment if you have any thoughts, suggestions, recommendations, requests,…

Another day of agile teaching

The prof I’m working with in our introductory #astro101 class at UBC surprised me today. I thought he was sabotaging a teachable moment when in fact, he pulled one of the most “agile” moves he’s made yet. Here’s the story:

Today is March 21, 2011, the first full day of Spring. The vernal equinox occurred yesterday, March 20 at 4:21 PDT. The instructor, let’s call him H, started today’s class with a clicker question:

The correct answer is A) but I fully expected a bunch of students to vote B), confusing the “going North” and “going South” for the Sun’s motion along the ecliptic.

The students thought, then voted. H looked at the results and said (I’m paraphrasing from memory),

The correct answer is A. 70% of you said that…

Oh, no, I thought to myself. He just gave away the answer and the success rate – only 70%, not terrific – and totally short-circuited the teachable moment that comes via peer instruction.

That thought took about 1 second, of course, so it was all over by the time H continued with

…Very few of you said B, C, or D and 30% said E. Let me show you one slide and then I’ll come back to the super moon.

The "super Moon" as seen from Vancouver. (Credit @gmarkham, used with permission.)

You see, there was another event this past weekend. The full Moon occurred near perigee, the point in the Moon’s orbit around the Earth when it is closest. This means we had a full Moon, closer than usual, so it appeared bigger. Super, even. Oh, and it was.

So, here I was, getting alarmed that H was missing the opportunity for the students who voted A) to convince the students who voted B) to change their answers. But that’s not what happened at all. Hardly anyone voted B. They either knew the right answer A) or were more interested in the astronomy-in-real-life super Moon event. And H agilely, er, with great agility, confirmed the correct answer and followed up with an something 30% of the students cared about. He talked about the full Moon, how it was 14% bigger and 29% brighter. Not twice as big – don’t believe everything you hear on TV. That’s slightly bigger and closer than usual but not much. And no, the super Moon did not cause the earthquake in Japan.

Wow. I was impressed. He had the whole thing planned out but tailored his response based on theirs. Cool.

What about you? What teaching have you done, witnessed or experienced that shows agility?