Department of Psychology, University of California, Los Angeles
Marci S. DeCaro
Department of Psychological and Brain Sciences, University of Louisville
Gerardo Ramirez
Department of Psychology, University of California, Los Angeles, and Department of Educational Psychology, Ball State University;
Acknowledgement:
The inclusion of engaging yet unnecessary information in instructional materials is known in the psychological literature as “seductive details.” By definition, seductive details are concrete and highly interesting, but tangential to the learning objectives (
The rationale behind including seductive details within instruction is that high-interest material will catch and sustain attention throughout the learning episode. Indeed, teacher education materials explicitly promote the use of hooks (also known as “anticipatory sets” or “interest catching devices”) to activate both prior knowledge and engagement at the outset of a lesson (
Educators often include seductive details in classroom instruction, online tutorials, and textbooks despite the research suggesting seductive details are detrimental to learning outcomes (
But not all students are equally harmed by the inclusion of seductive details. Some studies find that students low in working memory, spatial ability, or prior knowledge are the most harmed by seductive details placed within computer-based learning modules, whereas participants higher in these learner characteristics do not suffer the same learning decrements (
In summary, there is an apparent disconnect between what educators presumably believe about the benefits of seductive details in lecture instruction and the findings from learning science research about the harmful effects of seductive details in student materials. One possible reason for this discrepancy is that, surprisingly, the effects of seductive details have not been studied in lectures or in settings meant to approximate the high-stakes nature of a classroom lecture. The vast majority of studies on seductive details have been conducted using textbook passages, narrated multimedia modules, and in one case (
The current study attempts to resolve this discrepancy by asking: What are the effects of seductive details on lecture learning when the affective context more closely approximates a classroom environment? Specifically, we assess whether making students feel accountable for their learning while delivering content through direct instruction alters the impact of seductive details. We also assess whether this context effect depends on students’ prior knowledge.
In the current study, the low-stakes learning context was incentivized similarly to a typical laboratory study exploring seductive details effects, in which students are instructed to process instructional materials and demonstrate what they have learned in exchange for course credit. Under conditions similar to previous research, it is likely that providing students with a video lecture on mathematics will yield similar results wherein seductive details are damaging to learning outcomes. Previous research has posed three hypotheses for the negative effects of seductive details: They distract attention away from core instruction, activate inappropriate prior knowledge, and disrupt integrated processing of relevant concepts (
Ironically, despite having their attention distracted away from the core material, students may believe that they are learning the material more deeply because it is engaging. Hence, seductive details may also lead students to fall prey to their own faulty metacognition. Research suggests that students often exert inaccurate judgments of learning by taking current indicators of fluency as future predictors of ability, and thus anticipate that they will retain material better than they actually do (
A related explanation to account for the detrimental impact of seductive details during low-stakes learning contexts is that students are simply unmotivated to attend to the important information and allow their attention to wander to the irrelevant information. Classroom field research (
Observing an impact of seductive details under a low-stakes context would provide an important replication of previous findings but extend the effect to mathematics lecture learning. However, adjusting the learning backdrop to a high-stakes context might alter the impact of seductive details on students’ affect, cognitive processes, and behavior.
With the advent of each successive educational policy emphasizing high-stakes standardized testing, seen most recently in Race to the Top (
This focus on how pressure affects testing has been informative in helping us to understand the cognitive mechanisms underlying choking under pressure, but pressure during testing is only half of the story. Students commonly learn material under high-stakes contexts which are not typical of basic laboratory studies examining learning. In educational contexts, students face daily pressures to understand lecture material, complete assignments, prepare for class assessments, pass standardized tests, and maintain high grades. Students must also learn within a social context in which they work collaboratively in groups, present their thinking in front of classmates, and undergo evaluation by peers and instructors. In contrast, students typically get involved in research studies in exchange for course credit and are not otherwise accountable for their learning.
If the mechanism underlying high-stakes learning operates similarly to the mechanism at play in high-stakes testing, then we might expect high-stakes learning contexts to undermine what individuals encode during instruction. Furthermore, seductive details presented against a high-stakes learning backdrop might further distract from relevant instruction and exacerbate underperformance (
But not all students interpret high-stakes situations in the same way (
Within a high-stakes learning context, where students are motivated to learn, the inclusion of seductive details might aid learning. This finding would be rather unexpected but not entirely unexplainable. Indeed, there are a number of accounts by which seductive details might help rather than harm learning specifically during a high-stakes learning context. First, in a learning setting with more at stake, seductive details may have an effect akin to what educators and students generally expect: they might increase interest, which in turn might foster cognitive attention to the relevant material. It is common for students to ask “Why do I need to know this?” (
Seductive details might have additional learning benefits by acting as breaks within relevant learning episodes. Previous research shows that interpolated break periods during lessons lead to sustained attention to lecture material, enhanced note taking, reduced anxiety, and increased problem-solving accuracy (
The current study explored whether the impact of seductive details on learning from a lecture depends on the stakes involved in the learning context. We also examined the moderating role of the prior knowledge level of the learner. Although the moderating effect of learning context has not been examined in the seductive details literature, research has demonstrated that the impact of seductive details may depend upon individual differences in engagement and attention (
Students were assigned to watch a lecture on matrix algebra and then asked to complete several unrelated tasks before completing a final test on the material, which served as our primary learning measure. We attempted to approximate classroom instruction while also maintaining experimental control by testing these ideas using a video recorded lecture in a laboratory setting with groups of randomly assigned research participants.
Students in the low-stakes condition completed the study for research participation credit for an unrelated class, and thus were not further incentivized to learn the material—akin to previous studies testing the impact of seductive details (for a review, see
Because we were interested in the effects of seductive details and the stakes involved during learning, and not during testing, we isolated the effects of our high-stakes manipulation to the lecture phase. We accomplished this by measuring whether our high-stakes manipulation was successfully applied immediately following the lecture. We then “turned off” the manipulation (for students assigned to the high-stakes condition), using a procedure we describe below. After removing the high stakes, we assessed any residual effects of the manipulation by asking students to complete a working memory measure. We reasoned that if we successfully turned off the high-stakes manipulation, then students assigned to the high-stakes condition should perform just as well on the working memory task as those assigned to the low-stakes condition, per previous research (
Additionally, we asked students to complete a self-report measure of individual differences in background (i.e., prior) knowledge. Prior knowledge has been shown to be a moderator of the impact of seductive details but has yet to be examined under more incentivized conditions such as the high-stakes manipulation we employ (
Lastly, we attempted to provide better clarity of results by asking students to take notes on the lesson as well as rate their lesson experience (i.e., judgments of learning, lesson quality, distractibility). We examined student notes for inclusion of relevant and seductive detail content as well as procedural thoroughness. Immediately following the video lecture, students provided judgments of learning, video quality, distractibility and felt pressure. We looked toward these measures to illuminate any significant change in affect brought about by seductive details, high-stakes pressure, or the combination of the two. We reasoned that seductive details or high-stakes conditions might differentially affect students’ interest, and this would be represented in their assessments of their own learning and the video quality of the lesson. Although students’ metacognition (
By examining students’ prior knowledge and affective state associated with learning context, and the cognitive mechanisms associated with seductive details, we might better predict when capturing students’ attention with hooks might help or hinder learning in lecture instruction.
Undergraduate students (N = 259) were invited to participate in exchange for psychology course credit. Participants were assigned to one of four conditions, using a 2 (Seductive Details: Present, Absent) × 2 (Learning Stakes: Low, High) between-subjects design. Our goal was to test participants in groups of 10 in a classroom in order to approximate the social nature of a classroom environment. However, because participant attendance varied, experimental sessions ranged in size. A total of 41 sessions with an average student sample size of 6.32 (SD = 2.08) were run. Seventeen participants were removed from analyses because they indicated on a poststudy form that they had been informed by a friend about the nature of the study prior to participation (i.e., they knew about the high-stakes manipulation).
Prior knowledge survey
The prior knowledge survey posed five statements on matrix algebra (e.g., “I can calculate the inverse of a matrix using a determinant”) using a 5-point scale ranging from not at all true of me to very true of me. Prior knowledge scores were calculated as the average of the five items. A Likert-type scale was used in place of problem solving in order to more quickly assess the numerous matrix algebra skills of interest. Items were worded in as precise a way as possible to prevent participants from inflating their ability level while limiting the time necessary to measure prior knowledge. Previous research has demonstrated that self-assessments of this kind are generally accurate reflections of prior knowledge measured with more direct problem-solving questionnaires (
Video lesson
Participants were presented with a video lesson on matrix algebra designed to teach various mathematical properties of matrices including their form and how to add, subtract, multiply, divide, and calculate an inverse. In total, the lesson covered six topics within matrix algebra with 32 conceptual facts about matrices. The specific video featured a female instructor who taught using PowerPoint slides. Our goal in using a video lesson was to control for content across all sessions.
Two versions of the video lesson were used: one version with seductive details, and one without seductive details. The instruction in each video was identical. The seductive details video differed only in that it contained seven interesting facts irrelevant to the lesson objectives but peripherally related to matrix algebra. These facts were interspersed at the beginning, middle, and end of the instruction. In line with previous research, the seductive details were designed to be concrete, interesting, and noninstructive. For instance, one seductive detail stated that matrices can be used in genetics to predict physical traits, while participants viewed a striking photo of a young boy with one blue eye and one brown eye. Another seductive detail discussed how James Joseph Sylvester (the founder of matrix algebra) once supposedly stabbed a student for a perceived slight. The seductive details avoided being informative toward the lesson objectives. Pilot testing showed that each individual seductive detail slide was rated as significantly more interesting (the mean across all SD slides was M = 4.97, SE = .30) than relevant slides (the mean across all relevant slides was M = 3.62, SE = .23), Hedges’ g = −.86, all ps < .05. The seductive details video was 14% longer: the running time of the video lesson without seductive details measured 15:31 min, and the running time of the video lesson with seductive details measured 18:00 min.
Postvideo lesson evaluation
Participants completed a survey measuring their attitudes and affective reactions to the video lesson. Survey items included a judgment of learning (“Please indicate how well you feel you have learned the content from the video lesson”), a lesson quality rating (“Please evaluate the quality of the video lesson instruction”), a measure of distraction (“I felt distracted and found it hard to pay attention”), and a high-stakes manipulation check (“Please indicate how much pressure you felt during the video lesson”). All responses were made using a 7-point scale from 1 (not at all) to 7 (very high).
Immediate postvideo test
The immediate postvideo test was composed of two items that tested material presented in the video. The first item asked “Below are two matrices. First, determine if the two matrices can be multiplied.” The second item asked “What are the dimensions of the resulting matrix?” The questions were designed to be relatively easy to answer correctly. The main purpose of this “test” was to maintain the cover story we used to administer and then turn off the high-stakes manipulation, described in the Procedure section below.
Working memory assessment
A backward letter span task served as our measure of working memory (
Final test
The final test consisted of eight free-response matrix algebra problems of near and far transfer difficulty. Test problems were aligned to the lesson objectives and video content. Problems touched on identifying elements in a matrix, transposing a vector, creating a symmetrical matrix, adding and subtracting matrices, applying the rules for multiplying matrices, and setting up matrices to solve word problems. For example, one word problem posed: “Grades are being calculated at the end of the quarter. Stacy’s quiz average was 89, her test average was 80, and her homework average was 90. Ben’s quiz average was 94, his test average was 85, and his homework average was 70. If quizzes are weighted as 50% of the grade, tests as 30% of the grade, and homework as 20% of the grade, set up the matrices to find Stacy’s and Ben’s final grades. Note: You do not actually need to do the calculation.” Each problem was worth one point, for a possible total of 8 points. Partial credit (0.5 points) was administered for answers that correctly addressed half the question or left some ambiguity in the response. Interrater reliability was at 88%.
Participants came to a psychology laboratory that was set up to look like a university seminar classroom with 10 chairs arranged around a long oval desk. Upon arrival, participants were told that we were interested in understanding how students learn from lectures. Participants began by filling out the informed consent sheet and then were asked to complete the prior knowledge survey before receiving the learning stakes manipulation.
Participants in the low-stakes condition were informed they would be evaluating video lecture resources to help the university explore the use of learning media and that they should make an effort to behave as if they were in a real class. Participants in the high-stakes condition received a similar introduction with additional instructions designed to increase the stakes involved in learning. Participants were told that the university was interested in evaluating the effectiveness of video lectures through their performance. Participants were told that they would be awarded a financial bonus of $10 if they performed well on a test at the end of the video lesson (i.e., the immediate postvideo test), but that the financial bonus was contingent upon everyone in the group scoring 100%. We also informed participants that professors and researchers from the university would view their learning behaviors and thus participants would be filmed during the video lecture and postvideo test. At this point, the screen flashed the pictures of a selection of psychology professors in the department while research assistants set up three video cameras (two in the back of the room and one in the front of the room). Lastly, participants were informed that, after completing the test, they would be asked to individually stand at the board in the front of the classroom and explain how they arrived at the solution to a test problem for the other participants and the video cameras. Initial focus group interviews prior to the main study revealed that participants found the requirement to explain their answers in public as the most stressful component of our high-stakes instructions. Our intention in the high-stakes manipulation was to increase the stakes for learning in analogue to the incentives students may feel in a typical class. Because the laboratory inherently lacks the incentives of genuine classrooms, we attempted to mimic the pressure students feel around social comparison, expert evaluation, and outcome incentives (but in this case, using money rather than grades).
After administering our learning stakes manipulation, participants in all conditions were reminded to do their best and take notes as if they were in a real course lecture. Participants were given sheets of paper on which to take notes and viewed the video lesson on matrix algebra. Once the video ended, participants were asked to complete the video evaluation items. Participants were then asked to complete the immediate postvideo test, which was described at this time as the main learning assessment.
After completing the immediate postvideo test, participants in the low-stakes condition were thanked for their participation and effort. Participants in the high-stakes condition again received a different set of instructions. Specifically, the research assistants waited until everyone was done and then one researcher noted out loud that the experiment was running a little behind schedule. As such, the researchers would have to unfortunately forgo the explanation component of the study. The research assistants walked around the room to visually inspect everyone’s accuracy on the two-item immediate postvideo test. Regardless of participants’ actual accuracy, the research assistants announced that everyone answered the questions correctly. Thus, all participants in the high-stakes condition would receive the additional monetary bonus at the end of the study. The video cameras were then put away to remove the last source of salient pressure. Research assistants reminded participants in the high-stakes condition that, even though the “main test” was completed, they should still continue to try their best on the remaining study measures.
All participants were then informed that the remainder of the study would be comprised of several memory tests. Participants were then given 5 min to study their video notes and next directed to complete the backward letter span task and final test. The final test was introduced with the following set of instructions to ensure that participants did not experience performance pressure: “In a moment, we’ll begin our last measure. You will of course receive two research participation credits no matter how you perform so we just ask that you please try your best.” Note that we did not introduce this test as an assessment, nor was it given a title indicating it to be an assessment of participants’ ability. Because this final test was presented to participants as a low-stakes activity, students were not urged to complete items as quickly as possible. Participants were, however, informed that they had 10 min to complete the final test. Finally, participants filled out some demographic measures, were debriefed and, in the high-stakes condition, received the financial bonus.
Initial analyses begin by examining students’ postvideo evaluations (i.e., ratings of felt pressure, video lesson quality, judgments of learning, and distractibility during the lesson) as well as working memory performance. These initial analyses allow us to judge the efficacy of our pressure manipulation and better understand how our interaction of learning stakes and seductive details impacted participants’ perceptions of the learning context. We next present results of final test performance to understand what impact the learning stakes and seductive details had on students’ actual learning. We then attempt to understand the cognitive mechanisms that might be driving some of these effects with two approaches: by relating postvideo judgments to final test performance, and by examining the notes students took during the lesson. Finally, we assess whether the impact of learning context and seductive details on final test performance varies by participants’ prior knowledge.
Unless noted otherwise, we examined the impact of seductive details and learning context using separate 2 (Learning Stakes: Low, High) × 2 (Seductive Details: Present, Absent) between-subjects factorial ANOVAs.
Felt pressure
We begin by examining how participants’ judgments of felt pressure varied across our manipulation of learning stakes and seductive details. We found a main effect of learning stakes: Participants reported experiencing more pressure during the video lesson in the high-stakes condition (M = 4.11 out of 7, SE = 0.14) than in the low-stakes condition (M = 2.88 out of 7, SE = 0.14), F(1, 238) = 37.89, p < .001. However, we did not find a main effect of seductive details or an interaction on participants’ reports of pressure, Fs < 1. These analyses reveal that the high-stakes manipulation was successfully implemented (see
Working memory
To confirm that the effects of increasing learning stakes were successfully removed following the immediate postvideo test, we analyzed participants’ performance on the working memory task. Because prior literature has shown that working memory is negatively impacted by high pressure situations (e.g.,
Video lesson quality
We next examined participants’ impressions of the video lesson quality to explore the effects of seductive details and high-stakes learning on participants’ evaluations of instructional value. Participants’ ratings of the video lesson quality revealed no main effects of learning stakes or seductive details, Fs < 1. However, a significant interaction was found, F(1, 238) = 7.49, p = .007. In the low-stakes condition, participants who watched the video lesson with seductive details evaluated the video quality as marginally lower (M = 5.05, SE = 0.17) than those who watched the video lesson without seductive details (M = 5.44, SE = 0.12), t(123) = 1.93, p = .056, Hedges’ g = 0.34. In contrast, for participants in the high-stakes condition, the trend reverses. Participants in a high-stakes context who watched the video with seductive details evaluated the video as marginally higher quality (M = 5.41, SE = 0.13) than those in the high-stakes without seductive details condition (M = 5.02, SE = 0.15), t(115) = 1.94, p = .054, Hedges’ g = 0.36.
Judgments of learning
Results for judgments of learning revealed a main effect of learning stakes, F(1, 237) = 6.62, p = .011. Participants in the high-stakes condition reported that they learned less from the video overall (M = 4.94, SE = 0.11) compared with participants assigned to the low-stakes condition (M = 5.32, SE = 0.10), t(239) = −2.61, p = .010, Hedges’ g = −0.34. We did not find a main effect of seductive details or a significant two-way interaction, Fs < 1.
Distraction ratings
A main effect of seductive details emerged on the measure of participant distraction, F(1, 238) = 4.08, p = .044. Individuals with seductive details reported being less distracted (M = 2.22, SE = 0.10) than individuals without seductive details (M = 2.55, SE = 0.13), t(240) = −1.98, p = .048, Hedges’ g = 0.26. Thus, the inclusion of engaging and emotional information in general served one of its presumed purposes—to keep students’ minds on the lesson—at least by their own judgment of distractibility. We did not observe a main effect of learning stakes, F < 1, or interaction, F(1, 238) = 2.03, p = .155. Despite not obtaining a significant interaction, we noticed an interesting pattern for participants assigned to the high-stakes condition: Those who received seductive details reported lower distractibility than those who did not receive seductive details. Participants in the low-stakes condition did not reveal a similar pattern. But because the interaction term was not significant, we are limited in our ability to perform and interpret the simple effects.
Of central interest was students’ performance on the final test. No main effects of learning stakes or seductive details on final test performance were found, for either participants’ final average, Fs < 1, or adjusted average taking into account the number of problems attempted, Fs < 1. However, a significant interaction emerged for both final test average, F(1, 238) = 4.40, p = .037, and adjusted average, F(1, 238) = 5.66, p = .018. For all subsequent analyses, we rely on the adjusted average as a better indicator of participants’ learning, due to the low-stakes final test instructions that de-emphasized performance. In the low-stakes condition, participants who received seductive details showed lower performance (M = .75, SE = .03) than participants who did not receive seductive details (M = .83, SE = .03), t(123) = −2.09, p = .039, Hedges’ g = −.372. In contrast, participants in the high-stakes condition did not differ in performance when seductive details were included (M = .82, SE = .03) compared with when they were omitted (M = .77, SE = .03), t(115) = 1.29, p = .198, Hedges’ g = .238 (see
Given that students were nested within sessions, we also addressed whether there exists variation in performance across sessions and whether this variation accounts for the interaction reported above. We ran an empty model without any predictors to model the variability in adjusted test score accuracy across sessions. Results revealed that the variance in final test scores between sessions was very close to zero (Intercept = 2.01e-19 [1.50e-18]), indicating that it was not necessary to model the outcome using hierarchical linear modeling.
To glean insight into how seductive details may influence student learning outcomes under high and low stakes, we examined how the adjusted final test performance and postvideo evaluation ratings relate to one another in each of the four conditions. Participants in the high-stakes condition who received seductive details showed a significant positive relationship between quality of video lesson ratings and adjusted final test performance, r(57) = .40, p = .002. This relationship was not significant among participants in the high-stakes condition who did not receive seductive details, r(56) = .00, p = .99. These two correlations were significantly different in strength of association, Z = 2.24, p = .025. Participants in the low-stakes conditions showed no significant relationship between adjusted final test performance and video quality ratings regardless of whether they received seductive details (see
A similar pattern of results emerged in participants’ judgment of learning ratings. Among participants in the high-stakes condition, a positive correlation between judgment of learning and adjusted final test performance was present for those who received seductive details, r(57) = .345, p = .007, but was absent among those who did not receive seductive details, r(56) = .142, p = .287. However, these two correlation coefficients were not significantly different from each other, Z = 1.14, p = .25, indicating that the two correlations are statistically the same. For the low-stakes condition, no relationship emerged between judgment of learning and performance in either seductive details condition (see
To summarize, only for participants who received seductive details during high-stakes lessons, ratings about the quality of lessons and judgments of learning were significantly correlated with final test performance. These findings suggest that learners may have better ability to judge their understanding of the lecture when seductive details are used in a high-stakes learning context, assuming that learners evaluate lesson quality by taking their comprehension into account. Ratings of distractibility were not significantly calibrated with final test scores in any of the four conditions.
We next examined participant notes to gain insight into how the manipulation of learning stakes and seductive details may have affected lecture learning behaviors (i.e., note taking) during the video lesson. Participant notes were coded for three qualities: concept relevance, concept irrelevance, and procedural accuracy. Participant notes were coded by research assistants who were blind to condition assignment. Two research assistants coded 20% of the notes to establish interrater reliability (>90% agreement), and one research assistant coded the remaining notes.
Concept relevance and irrelevance were assessed by summing the number of important and seductive detail concepts recorded in note form, respectively. A concept checklist was applied to determine how many of the 32 important relevant concepts and seven irrelevant seductive detail concepts covered in the lesson were recorded.
Procedural accuracy was assessed by examining a subset of each participant’s notes focusing on matrix multiplication. The subset was analyzed for procedural accuracy through a 3-point scale with the prompt “Using the student’s notes, I could teach myself matrix by scalar and matrix by matrix multiplication.” The scale was anchored by 1 at the low end (“I could not understand matrix multiplication based on the notes due to insufficient or inaccurate details”) and 3 at the high end (“I could completely understand matrix multiplication with sufficient detail from the notes”). This scale was designed to assess how well participants captured the procedures involved in matrix calculations.
Examining first the quantity of relevant concepts recorded in the notes, we found a main effect of learning stakes, F(1, 238) = 8.54, p = .004. Participants in the high-stakes condition captured more of the relevant lesson concepts (M = 19.81, SE = 0.45) than did participants in the low-stakes condition (M = 17.81, SE = 0.46), t(240) = 2.99, p = .003, Hedges’ g = 0.385. A main effect of seductive details also emerged, F(1, 238) = 8.84, p = .003, such that participants who received seductive details captured more of the relevant lesson concepts (M = 19.82, SE = 0.43) than those who saw the video without seductive details (M = 17.85, SE = 0.51), t(240) = 3.04, p = .003, Hedges’ g = 0.39. Participants in both the low-stakes, F(1, 123) = 5.30, p = .023, and high-stakes conditions, F(1, 115) = 3.64, p = .059, took more relevant notes when they received seductive details as a part of the lesson. See
We next looked at the extent to which participants took notes on the irrelevant concepts (i.e., seductive details). This analysis was limited to participants who received seductive details during the video. Participants given high stakes did not differ from those given low stakes in the number of seductive details statements recorded in their notes, p > .05 (see
Examining students’ clarity and thoroughness in procedural notes, no significant main effects or interaction were found in the content of participant notes relating to procedural accuracy, Fs < 1. Across conditions, the average procedural score was 1.79 (SD = 0.81) out of 3. This score reflects that the average participant recorded notes which may be meaningful to the participant but were judged to lack the details needed for a naïve student to accurately perform both matrix multiplication procedures (i.e., matrix by scalar and matrix by matrix multiplication). These two types of multiplication were given equal weighting in the coding procedure.
Lastly, we addressed what role prior knowledge might play in our main performance results. We began by ensuring that participants across conditions were equitable in prior knowledge. Using prior knowledge as the outcome variable, we found no evidence for a main effect of learning stakes, seductive details, nor a Learning Stakes × Seductive Details interaction, Fs < 1, suggesting that prior knowledge varied equally across conditions. We then asked whether the Learning Stakes × Seductive Details interaction might be further moderated by individual differences in prior knowledge. To address this possibility, we conducted a median split on prior knowledge (M = 1.75, SD = 0.95) and operationalized those with a score of 1 to 1.39 as lower prior knowledge (M = 1.04, SD = 0.08, n = 118) and those with a score of 1.40 to 5 as higher prior knowledge (M = 2.43, SD = 0.90, n = 124). We conducted an ANOVA with prior knowledge, learning stakes condition, and seductive details as between-subjects factors, and found a significant effect of prior knowledge, F(1, 234) = 23.96, p < .001, Learning Stakes × Seductive Details interaction, F(1, 234) = 5.11, p = .030, and the critical three-way interaction,
For participants with lower prior knowledge, we did not find main effects of learning stakes or seductive details, Fs < 1, but did find that the Learning Stakes × Seductive Details interaction was significant, F(1, 114) = 7.61, p = .007. In the low-stakes condition, participants who received seductive details (M = .67, SE = .04) performed marginally, but not significantly, worse than those who did not receive seductive details (M = .77, SE = .04), t(57) = −1.68, p = .098, Hedges’ g = −.432. (Note that the negative impact of seductive details in the low-stakes condition was significant when we ran this analysis generalizing across prior knowledge levels). In the high-stakes condition, in contrast, participants who received seductive details (M = .80, SE = .04) performed significantly better than those not given seductive details (M = .68, SE = .04), t(57) = 2.25, p = .028, Hedges’ g = .581. (Note that the positive impact of seductive details was not significant when we ran this analysis generalizing across prior knowledge levels).
For participants with higher prior knowledge, no main effects or Learning Stakes × Seductive Details interaction were found, Fs < 2.5. Participants with higher prior knowledge performed comparably regardless of whether learning stakes were high or seductive details were included.
This study examined whether the effects of seductive details can be differentiated depending on the affective state induced by the learning context. Our results suggest that seductive details can indeed derail students’ comprehension of core concepts when they are embedded within instruction in a low-stakes environment. Yet a starkly different pattern emerges during high-stakes learning—particularly for students with low prior knowledge.
Among the general sample, participants assigned to the low-stakes condition who received seductive details during the matrix algebra lesson performed significantly worse on the final test than those who did not receive seductive details. This finding aligns well with the literature demonstrating that seductive details impair textbook learning under similar low-stakes conditions, in which students are not incentivized to learn but participate in the study only for research credit (
Why did students underperform when the video lesson was accompanied by seductive details? In previous research, seductive details have been argued to impact learning by capturing students’ interest (
An account that is better aligned with these data is that students in the low-stakes learning condition appropriately recognized the seductive details as irrelevant to the lesson objectives, which made the lesson feel incoherent but not distracting. Nevertheless, they may not have had the motivation or expectation of accountability to think deeply about the relevant material beyond engaging in low-level note taking activities to overcome what they perceived as an incoherent video lesson. This account explains why students in the low-stakes condition who received seductive details rated the lesson as lower in quality relative to those who did not receive seductive details: Perhaps they considered having to dismiss unnecessary (but not distracting) information the mark of a poor lesson. Furthermore, the finding that judgments of learning did not correlate with performance suggests that in the low-stakes conditions, students did not process information deeply and their metacognition was similarly shallow and subsequently inaccurate.
The bigger pattern of results suggests that when in a low-stakes learning setting (i.e., a traditional psychology experiment), seductive details do in fact harm video lecture learning. Perhaps this effect occurs because students feel neither pressure nor motivation to find the use of seductive details efficacious.
Considering the pattern of exam performance observed among participants in the low-stakes learning context, one might expect that students watching the video lesson under a high-stakes learning context would report the lesson as less efficacious and performance decrements would be even more exacerbated. However, in a high-stakes learning context, the inclusion of seductive details led participants to perform just as well as those who did not receive seductive details, with some noteworthy affective responses.
We found that participants in a high-stakes learning context who received seductive details actually reported higher video lesson quality ratings than those who did not receive seductive details. But of course, students are often overconfident about the benefits of various learning techniques (
Ideally, use of seductive details would create interest but not distract students’ attention away from the relevant material. Within a high-stakes learning context, those who received seductive details did not report being more distracted by the video lesson than those who did not receive seductive details. We also observed that students assigned to watch the video lesson with seductive details under a high-stakes environment very rarely took notes on the seductive details, suggesting that participants recognized that seductive details were not relevant for the lesson goals. The pattern of results outlined thus far fit well with anecdotal reports from instructors and students that seductive details enhance learning by capturing students’ attention using interesting information. Students likely appreciate instructor efforts to enhance lecture by including seductive details during high-stakes learning environments, but their appreciation does not hinder them from attending to and taking notes on the relevant material.
A second possibility is that seductive details may simply give students breaks from the video lesson, which provides opportunities to monitor their own learning when motivated to do so under high-stakes conditions. Students who received “breaks” via seductive details could have viewed these moments as opportunities to think more deeply about the material, which ultimately enhanced understanding. This monitoring account would help explain why higher lesson quality perceptions and judgments of learning were related to performance in the high-stakes, seductive details condition: Break periods during high-stakes learning may, in essence, give students more “think time,” which allows for better monitoring of learning and calibration. In the current study, the seductive details provided an extra 2.5 min. Previous research suggests that even 3 s of think time breaks during question answer exchanges can go a long way to enhance student comprehension (
In fact, among students lower in background knowledge, we found that the inclusion of seductive details significantly enhanced performance in the high-stakes condition but not the low-stakes condition. Participants with high prior knowledge generally performed well regardless of the seductive details or learning stakes. Our prior knowledge results suggest that seductive details are the most efficacious for students who are most at risk for underperformance (i.e., low-knowledge students who have high stakes riding on their learning). This outcome is inconsistent with previous laboratory research suggesting that it is students with high working memory and prior knowledge that most benefit from the inclusion of seductive details (
Exposing students to a degree of accountability, more akin to a real-world classroom, was enough to significantly alter the effect of the seductive details manipulation. Whereas under low stakes, participants were harmed by the seductive details, under high stakes, participants were either unaffected or in some cases aided by their inclusion. Our results suggest that a critical moderator of the seductive details effect is the students’ level of accountability brought on by the high- or low-stakes nature of the learning environment.
Our high-stakes manipulation was meant to mimic the accountability that students are commonly exposed to in a classroom lecture learning environment: social comparison, expert evaluation, and outcome incentives (cf.
We believe our findings and high-stakes manipulation procedure have important implications for laboratory studies attempting to unravel the processes of student learning. Students completing mandated research participation in a typical psychology experiment may be doing so under a default “low-stakes” environment, which is arguably ideal when studying basic cognitive processes. However, studies focused on generalizing findings beyond the laboratory should consider whether the designated environment is consistent with the affect that students experience in the natural environment. If participants do not feel like students, the mechanisms activated may not represent student learning as it happens in vivo. As a result, any measured outcomes may lack external validity. Although the current study included laboratory components artificial to a classroom (e.g., removing high stakes prior to the test), our findings still suggest that motivation is not to be overlooked when examining cognitive processes during instruction to generalize to the realm of education.
Taking the results in sum, the current study has important implications for teachers’ instructional decisions in regard to lectures. Providing relatable, peripheral information alongside the more abstract conceptual information may provide students with the inclination to believe that the material is both learnable and worthy of being learned. Particularly in the math domain, it is common for students to believe that content is not useful for their lives outside of a school context (
Although it is likely most desirable to engage students’ interest in a lesson using information that is also relevant to the content, this is often a difficult feat when the content is abstract, procedural in nature, or is perceived to have little initial utility value. Developing appropriate anecdotes to bring material to life likely takes years of practice and requires an instructor to have significant expertise in the content domain. For novice instructors who are developing their own content and pedagogical knowledge as they teach a course, this study suggests that one feasible way to improve students’ learning outcomes for those with low background knowledge is to—somewhat paradoxically—include seductive details. This may be even more advisable considering that those higher in prior knowledge were not affected negatively.
We feel one additional important caveat should be made: We are not advocating free rein when it comes to seductive details in terms of frequency or type. We are limited in our recommendations by our methodology, and in the current study we used a few seductive details placed during the transition of concepts so as not to interfere with concept instruction. It remains to be seen if seductive details are beneficial in real courses and whether the use of tangential seductive details are just as effective as relevant content anecdotes.
Although we attempted to emulate an authentic classroom environment, one obvious and important limitation is that our findings are constrained by our laboratory paradigm. There are a number of ways in which our methodology is left wanting compared with authentic classrooms. First, the incentives we provided are approximations but not identical to those of a real classroom, no matter how motivated students became with our manipulation. As such, we can posit that seductive details may behave differently depending on motivational context as seen in the current study, but we cannot speak to classroom outcomes at the present time. Second, students did not get the chance to interact with the instructor or other students during the lesson. It is possible that providing collaborative opportunities would alter the effects of the seductive details. For instance, providing opportunities for students to discuss content may result in irrelevant discussion and reduced learning. Third, the lesson we presented was relatively brief (less than 20 min in both conditions) compared with a typical lecture, and students’ exposure consisted of only one session. Longer-term effects of seductive details in lecture learning, such as changes in academic behaviors (e.g., studying time), were not assessed. Last, the final assessment took place under low-stakes conditions in order to examine solely how seductive details impact learning during transmission. This is inherently unlike a classroom environment in which students undoubtedly also experience great stress during testing. It remains for future research to determine the effects of seductive details in high-stakes test situations. Thus, at this time we cannot speak to dosage, type of seductive details, or how they may interact with high-stakes testing; however, based on our findings there is sufficient evidence to warrant additional research on seductive details and lecture learning.
This study examined the seductive details effect during a mathematics video lecture with either high or low stakes. Consistent with previous research, seductive details negatively affected learning during the low-stakes context. However, a manipulation to increase the high-stakes nature of the context resulted in a very different effect: students who were held accountable for their learning showed either no negative effects or even positive effects of receiving seductive details. The positive learning gains were seen particularly among students with low mathematics prior knowledge—the very students most in need of high-quality instruction. Important implications arise for researchers, for whom the current study suggests that context is not to be taken for granted in laboratory studies. These findings also have important implications for teachers, for whom the current study suggests that including seductive details in lecture instruction may be an effective way to assist students in achieving greater mastery of relevant content for those most likely to struggle because of insufficient prior knowledge.
Alter, A. L., Oppenheimer, D. M., Epley, N., & Eyre, R. N. (2007). Overcoming intuition: Metacognitive difficulty activates analytic reasoning. Journal of Experimental Psychology: General, 136, 569–576. 10.1037/0096-3445.136.4.569
Baumeister, R. F., & Showers, C. J. (1986). A review of paradoxical performance effects: Choking under pressure in sports and mental tests. European Journal of Social Psychology, 16, 361–383. 10.1002/ejsp.2420160405
Beilock, S. L. (2008). Math performance in stressful situations. Current Directions in Psychological Science, 17, 339–343. 10.1111/j.1467-8721.2008.00602.x
Beilock, S. L., & Carr, T. H. (2005). When high-powered people fail: Working memory and “choking under pressure” in math. Psychological Science, 16, 101–105. 10.1111/j.0956-7976.2005.00789.x
Beilock, S. L., & Decaro, M. S. (2007). From poor performance to success under stress: Working memory, strategy selection, and mathematical problem solving under pressure. Journal of Experimental Psychology: Learning, Memory, and Cognition, 33, 983–998. 10.1037/0278-7393.33.6.983
Beilock, S. L., Kulp, C. A., Holt, L. E., & Carr, T. H. (2004). More on the fragility of performance: Choking under pressure in mathematical problem solving. Journal of Experimental Psychology: General, 133, 584–600. 10.1037/0096-3445.133.4.584
Bellinger, D. B., DeCaro, M. S., & Ralston, P. A. S. (2015). Mindfulness, anxiety, and high-stakes mathematics performance in the laboratory and classroom. Consciousness and Cognition, 37, 123–132. 10.1016/j.concog.2015.09.001
Benjamin, A. S., Bjork, R. A., & Schwartz, B. L. (1998). The mismeasure of memory: When retrieval fluency is misleading as a metamnemonic index. Journal of Experimental Psychology: General, 127, 55–68. 10.1037/0096-3445.127.1.55
Bjork, R. A. (1994). Memory and metamemory considerations in the training of human beings. In J.Metcalfe & A.Shimamura (Eds.), Metacognition: Knowing about knowing (pp. 185–205). Cambridge, MA: MIT Press.
Bjork, R. A., Dunlosky, J., & Kornell, N. (2013). Self-regulated learning: Beliefs, techniques, and illusions. Annual Review of Psychology, 64, 417–444. 10.1146/annurev-psych-113011-143823
Burgess, D. (2012). Teach like a pirate: Increase student engagement, boost your creativity, and transform your life as an educator. San Diego, CA: Dave Burgess Consulting, Inc.
Craik, F. I., Govoni, R., Naveh-Benjamin, M., & Anderson, N. D. (1996). The effects of divided attention on encoding and retrieval processes in human memory. Journal of Experimental Psychology: General, 125, 159–180. 10.1037/0096-3445.125.2.159
DeCaro, M. S., Thomas, R. D., Albert, N. B., & Beilock, S. L. (2011). Choking under pressure: Multiple routes to skill failure. Journal of Experimental Psychology: General, 140, 390–406. 10.1037/a0023466
Dewar, M., Alber, J., Butler, C., Cowan, N., & Della Sala, S. (2012). Brief wakeful resting boosts new memories over the long term. Psychological Science, 23, 955–960. 10.1177/0956797612441220
Dewar, M., Alber, J., Cowan, N., & Della Sala, S. (2014). Boosting long-term memory via wakeful rest: Intentional rehearsal is not necessary, consolidation is sufficient. PLoS ONE, 9, e109542. 10.1371/journal.pone.0109542
Dewar, M. T., Cowan, N., & Della Sala, S. (2007). Forgetting due to retroactive interference: A fusion of Müller and Pilzecker’s (1900) early insights into everyday forgetting and recent research on anterograde amnesia. Cortex, 43, 616–634. 10.1016/S0010-9452(08)70492-1
Eccles, J. S., Adler, T. F., Futterman, R., Goff, S. B., Kaczala, C. M., Meece, J. L., & Midgley, C. (1983). Expectancies, values, and academic behaviors. In J. T.Spence (Ed.), Achievement and achievement motivation (pp. 75–146). San Francisco, CA: Freeman.
Finn, B., & Tauber, S. K. (2015). When confidence is not a signal of knowing: How students’ experiences and beliefs about processing fluency can lead to miscalibrated confidence. Educational Psychology Review, 27, 567–586. 10.1007/s10648-015-9313-7
Garner, R., Brown, R., Sanders, S., & Menke, D. J. (1992). Seductive details and learning from text. In K. A.Renninger, S.Hidi, & A.Krapp (Eds.), The role of interest in learning and development (pp. 239–254). Hillsdale, NJ: Erlbaum.
Garner, R., Gillingham, M. G., & White, C. S. (1989). Effects of seductive details on macroprocessing and microprocessing in adults and children. Cognition and Instruction, 6, 41–57. 10.1207/s1532690xci0601_2
Gimmig, D., Huguet, P., Caverni, J. P., & Cury, F. (2006). Choking under pressure and working memory capacity: When performance pressure reduces fluid intelligence. Psychonomic Bulletin & Review, 13, 1005–1010. 10.3758/BF03213916
Godden, D. R., & Baddeley, A. D. (1975). Context-dependent memory in two natural environments: On land and underwater. British Journal of Psychology, 66, 325–331. 10.1111/j.2044-8295.1975.tb01468.x
Harp, S. F., & Maslich, A. A. (2005). The consequences of including seductive details during lecture. Teaching of Psychology, 32, 100–103. 10.1207/s15328023top3202_4
Harp, S. F., & Mayer, R. E. (1997). The role of interest in learning from scientific text and illustrations: On the distinction between emotional interest and cognitive interest. Journal of Educational Psychology, 89, 92–102. 10.1037/0022-0663.89.1.92
Harp, S. F., & Mayer, R. E. (1998). How seductive details do their damage: A theory of cognitive interest in science learning. Journal of Educational Psychology, 90, 414–434. 10.1037/0022-0663.90.3.414
Hunter, M. C. (1982). Mastery teaching. Thousand Oaks, CA: Corwin Press.
Kintsch, W. (1980). Learning from text, levels of comprehension, or: Why anyone would read a story anyway. Poetics, 9, 87–98. 10.1016/0304-422X(80)90013-3
Kintsch, W., & Bates, E. (1977). Recognition memory for statements from a classroom lecture. Journal of Experimental Psychology: Human Learning and Memory, 3, 150–159. 10.1037/0278-7393.3.2.150
Koriat, A., & Bjork, R. A. (2005). Illusions of competence in monitoring one’s knowledge during study. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 187–194. 10.1037/0278-7393.31.2.187
Kornell, N., & Hausman, H. (2016). Do the best teachers get the best ratings?Frontiers in Psychology, 7, 570. 10.3389/fpsyg.2016.00570
Lehman, S., Schraw, G., McCrudden, M. T., & Hartley, K. (2007). Processing and recall of seductive details in scientific text. Contemporary Educational Psychology, 32, 569–587. 10.1016/j.cedpsych.2006.07.002
Lemov, D. (2015). Teach like a champion 2.0: 62 techniques that put students on the path to college. San Francisco, CA: Jossey-Bass.
Lindquist, S. I., & McLean, J. P. (2011). Daydreaming and its correlates in an educational environment. Learning and Individual Differences, 21, 158–167. 10.1016/j.lindif.2010.12.006
Mattarella-Micke, A., Mateo, J., Kozak, M. N., Foster, K., & Beilock, S. L. (2011). Choke or thrive? The relation between salivary cortisol and math performance depends on individual differences in working memory and math-anxiety. Emotion, 11, 1000–1005. 10.1037/a0023224
Mayer, R. E. (1993). Illustrations that instruct. In R.Glaser (Ed.), Advances in instructional psychology (Vol. 5, pp. 253–284). London, UK: Routledge.
Mayer, R. E. (2008). Applying the science of learning: Evidence-based principles for the design of multimedia instruction. American Psychologist, 63, 760–769. 10.1037/0003-066X.63.8.760
Mazzocco, M. M., Hanich, L. B., & Noeder, M. M. (2012). Primary school age students’ spontaneous comments about math reveal emerging dispositions linked to later mathematics achievement. Child Development Research. Advance online publication. 10.1155/2012/170310
Metcalfe, J. (2009). Metacognitive judgments and control of study. Current Directions in Psychological Science, 18, 159–163. 10.1111/j.1467-8721.2009.01628.x
National Governors Association Center for Best Practices, Council of Chief State School Officers. (2010). Common core state standards. Washington, DC: National Governors Association Center for Best Practices, Council of Chief State School Officers.
Park, B., Korbach, A., & Brünken, R. (2015). Do learner characteristics moderate the seductive-details-effect? A cognitive-load-study using eye-tracking. Journal of Educational Technology & Society, 18, 24–36.
Park, B., Moreno, R., Seufert, T., & Brünken, R. (2011). Does cognitive load moderate the seductive details effect? A multimedia study. Computers in Human Behavior, 27, 5–10. 10.1016/j.chb.2010.05.006
Pettersson, R. (1998, October). Image functions in information design. The 30th annual conference of the International Visual Literacy Association, University of Georgia, Athens, GA.
Pozzer, L. L., & Roth, W. M. (2003). Prevalence, function, and structure of photographs in high school biology textbooks. Journal of Research in Science Teaching, 40, 1089–1114. 10.1002/tea.10122
Ramirez, G., Gunderson, E. A., Levine, S. C., & Beilock, S. L. (2012). Spatial anxiety relates to spatial abilities as a function of working memory in children. Quarterly Journal of Experimental Psychology: Human Experimental Psychology, 65, 474–487. 10.1080/17470218.2011.616214
Rey, G. D. (2012). A review of research and a meta-analysis of the seductive detail effect. Educational Research Review, 7, 216–237. 10.1016/j.edurev.2012.05.003
Risko, E. F., Buchanan, D., Medimorec, S., & Kingstone, A. (2013). Everyday attention: Mind wandering and computer use during lectures. Computers & Education, 68, 275–283. 10.1016/j.compedu.2013.05.001
Rohrer, D., & Pashler, H. E. (2003). Concurrent task effects on memory retrieval. Psychonomic Bulletin & Review, 10, 96–103. 10.3758/BF03196472
Rowe, M. B. (1986). Wait time: Slowing down may be a way of speeding up!Journal of Teacher Education, 37, 43–50. 10.1177/002248718603700110
Sanchez, C. A., & Wiley, J. (2006). An examination of the seductive details effect in terms of working memory capacity. Memory & Cognition, 34, 344–355. 10.3758/BF03193412
Schacter, D. L., & Szpunar, K. K. (2015). Enhancing attention and memory during video-recorded lectures. Scholarship of Teaching and Learning in Psychology, 1, 60–71. 10.1037/stl0000011
Smallwood, J., & Schooler, J. W. (2006). The restless mind. Psychological Bulletin, 132, 946–958. 10.1037/0033-2909.132.6.946
Smith, S. M., Glenberg, A., & Bjork, R. A. (1978). Environmental context and human memory. Memory & Cognition, 6, 342–353. 10.3758/BF03197465
Stitzman, T., & Johnson, S. (2014). The paradox of seduction by irrelevant details: How irrelevant information helps and hinders self-regulated learning. Learning and Individual Differences, 34, 1–11. 10.1016/j.lindif.2014.05.009
Szpunar, K. K., Khan, N. Y., & Schacter, D. L. (2013). Interpolated memory tests reduce mind wandering and improve learning of online lectures. Proceedings of the National Academy of Sciences of the United States of America, 110, 6313–6317. 10.1073/pnas.1221764110
Tobin, K. (1987). The role of wait time in higher cognitive level learning. Review of Educational Research, 57, 69–95. 10.3102/00346543057001069
Towler, A. (2009). Effects of trainer expressiveness, seductive details, and trainee goal orientation on training outcomes. Human Resource Development Quarterly, 20, 65–84. 10.1002/hrdq.20008
Unkelbach, C., & Greifeneder, R. (Eds.). (2013). The experience of thinking: How the fluency of mental processes influences cognition and behaviour. London, UK: Psychology Press.
U.S. Department of Education. (2009). Race to the top. Washington, DC: Author.
Wigfield, A., & Eccles, J. S. (1992). The development of achievement task values: A theoretical analysis. Developmental Review, 12, 265–310. 10.1016/0273-2297(92)90011-P
Wigfield, A., & Eccles, J. S. (2000). Expectancy–value theory of achievement motivation. Contemporary Educational Psychology, 25, 68–81. 10.1006/ceps.1999.1015
Yue, C. L., & Bjork, E. L. (2017). Using selective redundancy to eliminate the seductive details effect. Applied Cognitive Psychology, 31, 565–571. 10.1002/acp.3348
Submitted: January 19, 2018 Revised: May 29, 2018 Accepted: July 8, 2018