Everyday Research Methods

Podcast: WOOP, WOOP!

 

Wish, Outcome, Obstacle, Plan: An evidence-based app. Photo courtesy of Dr. Oettingen/Woopmylife.

Here's another podcast-based post. NPR's Hidden Brain podcast frequently uses psychological research to illuminate a variety of psychological topics. Today's post is based on a Hidden Brain episode called You 2.0: WOOP, WOOP!

 

The episode asks,"is there a methodical way to achieve your dreams?"

The episode starts off with the suggestion that maybe positive thinking alone isn't the best way to achieve your dreams. Of course, in the United States, we are encouraged to "dream big" and shoot for the stars. But as host Shankar Vedantam interviews researcher Dr. Gabriele Oettingen, we learn that positive thinking--by itself--may not be very helpful. 

At minute 1:40,  you hear how Dr. Oettingen first started getting interested in positive thinking--it stems from a cultural difference she observed between Germany (her home country) and the U.S.  Then Dr. Oettingen lays out the theory. She explains that positive thinking feels good, but...

(2:45)...these positive fantasies--they seduce us to feel already accomplished, and they take our energy away.

Dr. Oettingen describes a series of correlational findings:

(3:00) We found that, for example, the more positively women enrolled in a weight reduction program fantasized about their success in the program, the fewer pounds they lost--three months later, one year later, two years later.

Or the more positively university graduates fantasized about an easy transition into work life, the fewer dollars they earned two years later, the fewer job offers they had gotten, and the fewer job applications they had sent out.

a) Consider the dieting study above. Sketch a well-labeled scatterplot of the correlation she describes (one axis should have "level of fantasizing" on it, and pick one of the weight loss variables for the other axis).

b) Does this study, by itself, show that fantasizing caused these women to lose less weight? (Apply the three causal criteria).

c) Now consider the work life study above. Sketch a well-labeled scatterplot of the correlation she describes (one axis should have "level of fantasizing" on it, and you should pick only one of the job-related outcomes for the other axis).

d) Does this study, by itself, show that fantasizing caused these graduates to do worse on the job market? (Apply the three causal criteria).

In the podcast, Dr. Oettingen shared two other examples: One study on surgery patients and another study on people who had a crush on another person. [Instructors, you could consider having four different groups of students graph each of the four studies.]

e) What are the advantages of doing this same correlational study in four samples (dieters, graduates on the job market, surgery patients, and people with a crush?) Use the term "external validity" in your answer. 

Now let's move on to the rest of the theory. Dr. Oettingen's theory proposes that fantasizing by itself makes people relax--"because mentally, they're already there"--they've achieved the goal. It's better, she argues, to pair your fantasies with thoughts about obstacles. Starting at minute 9:00, Oettingen introduces the term mental contrasting, in which people follow their fantasies with thoughts about the potential obstacles, asking the question: "What is it in you that stands in the way?" 

Listen from minutes 9:00 to 15:30, as Oettingen walks through the WOOP process of activating wishes, fantasizing about the outcome, anticipating obstacles, and making a plan. (WOOP stands for Wish, Outcome, Obstacle, Plan.) 

Oettingen and her team are well aware of the limitations of correlational evidence like that introduced above.  So, although it's not described in the podcast, her team has also conducted experimental studies. In her experimental work, Oettingen and her team have randomly assigned people to engage in WOOP and others to engage in the activities in a different order (perhaps Obstacle, Wish, Outcome). They find that people in the WOOP conditions are more likely to achieve their goals.

f) If you were designing a study for people in a weight loss program, how would you design an experimental study to test if WOOP thinking would lead to more successful weight loss? 

i) What would the IV be (What would its levels be)? What would the DV be?
ii) How would you assign people to the conditions? 
iii) How would you eliminate internal validity threats? 
iv) Sketch a bar graph of your predicted outcome. 

Are you interested in trying WOOP out on your own goals and wishes? The phone app is free, and you can also access it online: www.woopmylife.org.

 

 

 

Too sleepy to choose that major

These students might misattribute their early-morning fatigue to their interest in the subject. Photo credit: Gorodenkoff/Shutterstock

Podcasts have been gaining in popularity in the last few years, and several feature psychological research. I'm going to be devoting my next few posts to some podcasts. We'll start with this very short, 3-minute episode/ interview from the NPR podcast, Hidden Brain. The episode is called "How does the way you feel shape your life?" and it's about how students might be influenced by situational factors (such as how early a class is) when they select their majors. 

The podcast opens with a story:

...behavioral economist Kareem Haggag at Carnegie Mellon University... sometimes teaches early morning classes. And he's worried that when his students are tired or sleepy, they might draw the wrong conclusion about him and about the class.

The researcher himself states (around minute 1)

DR. KAREEM HAGGAG: Our hypothesis was that students who are assigned to an early morning section of the class, or to multiple back-to-back classes before a class, might mix up how tired they are in that class with how much they like the subject, thus leading them to be less likely to choose the subject as their major.

The host, Shankar Vedantam, reports:

This is a psychological phenomenon called misattribution. You know, you go to an amusement park on a sunny day and you think the park is great. You go when it's raining - you think the park is terrible. You're unconsciously confusing your feelings about the weather for the quality of the park.

The researchers used thousands of data points from students at the U.S. Military Academy at West Point to test their hypothesis. As Vedantam points out:

... students at West Point are randomly assigned classes that are scheduled at different times of the day, which means that some students are taking this introductory class first thing in the morning. Some students are taking the very same class later in the day. The researchers then measure the chance that students would later on choose that subject as their college major.

The researchers, led by Dr. Haggag, found that students were more likely to major in the topic of that introductory class if they'd taken it at a later time of the day: 

HAGGAG: We find that students who are randomly assigned to the first period, 7:30 a.m. section, are about 10% less likely to choose the corresponding major compared to a student who takes that class later in the day. 

Questions

a) What are the two main variables of interest in this study (the independent and dependent variables)? What are the levels of each variable?

b) Is this a true experiment or a quasi-experiment? If it's a true experiment, what kind is it (prettest-posttest, posttest-only, repeated measures, concurrent measures)?

If it's a quasi-experiment, which of the four types is it (nonequivalent control groups, nonequivalent control group prettest-posttest, nonequivalent control groups interrupted time series, nonequivalent control groups interrupted time series)?

c) Which is the IV and which is the DV here?

d) Sketch a small bar graph of the results they describe.

e) Can these researchers support the causal claim that "having an early morning introductory class makes you less likely to want to major in that discipline?" Apply the three rules of causation: covariance, temporal precedence, and internal validity in your response.

f) Ask a question about this study's internal, external, statistical, and construct validity.

Bonus content:

In the study above, the main IV was "time of day of the introductory class". As a bonus, here is another independent variable they studied--"number of breaks before the introductory class":

DR. KAREEM HAGGAG: We also compared two students who are sitting in the exact same classroom, but one of whom just had a free period as a break before, and the other came from one or more back-to-back classes. We find that each additional back-to-back class reduces the likelihood that that student enrolls in the major by about 12%.

g) Which is the IV and which is the DV here?

h) Sketch a small bar graph of the results they describe.

i) Can these researchers support the causal claim that "having breaks before your introductory class makes you more likely to want to major in that discipline?" Apply the three rules of causation: covariance, temporal precedence, and internal validity.