A writer for Huffington Post has summarized a set of studies that compared two forms of note-taking: laptop-based notes, and traditional paper-and-pencil notes. Is it better to take notes on a laptop, or by hand, in a notebook? Here's what he writes:
They ran a few experiments, all basically the same. In the first one, for example, college students were assigned to classrooms, some of which were equipped with laptops and others with traditional notebooks. They all listened to the same lectures, and they were specifically instructed to use their usual note-taking strategy. Then, about half an hour after the lecture, all of the students were tested on the material covered in the lecture. Importantly, they were tested both for factual recall (How many years ago did the Indus civilization exist?) and for conceptual learning (How do Japan and Sweden differ in their approaches to social equality?).
The students using laptops were in fact more likely to take copious notes, which can be beneficial to learning. But they were also more likely to take verbatim notes, and this "mindless transcription" appeared to cancel out the benefits. Both groups memorized about the same number of facts from the lectures, but the laptop users did much worse when tested on ideas.
Questions
a) What kind of an experiment is this? Post-test only? Pretest-posttest? Repeated measures? Concurrent measures?
b) What are the IV's and DV's in the study? (Hint: there are at least two DV's)
c) Sketch a graph of the results using a bar graph form.
d) Assuming that they randomly assigned participants to the two conditions, can you support the causal claim that "taking notes on a laptop causes students to perform worse on conceptual questions about lecture material"?
e) Challenge question: There is a mediator in this report. To find it, read the Huffington Post article again, asking yourself why do students do less well after taking notes on a laptop? Sketch a graph of the mediator relationship.
Suggested answers:
a) Based on the information in the journalist's description, this is post-test only experimental design.
b) The IV is which type of notes they took (laptop or handwritten). The main DV's are performance on factual questions and performance on conceptual questions. Another DV is the nature of the notetaking--whether paraphrasing or transcription.
c) Your graph should have two bars--one for laptop notes and one for handwritten, with the y-axis labelled "performance". If you graph the performance on factual questions, the bars should be the same height. If you graph the performance on conceptual questions, the handwritten bar should be higher.
d) Yes. They have covariance (Laptop users did worse on tests of conceptual learning and handwriters did better). They have temporal precedence (the type of notetaking came before the test of conceptual learning). They have internal validity, assuming that they randomly assigned participants, and assuming that the lectures were on the same content in the same rooms and so on.
e) Apparently, the reason students do worse when using a laptop is that laptop users take more verbatim, transcribed notes, rather than processing the information more (as handwriters did). If you were to draw this mediator pattern, it might look like this:
Writing notes on a laptop (vs. handwritten) ----> more transcription ---> worse performance on conceptual questions
or even this way:
Writing notes by hand (vs. laptop) ---> more active processing ---> better performance on conceptual questions