[This paper is part of the Focused Collection on Astronomy Education Research.] Several decades of research have contributed to our understanding of students’ reasoning about astronomical phenomena. Some authors have pointed out the difficulty in reading and interpreting images used in school textbooks as factors that may justify the persistence of misconceptions. However, only a few studies have investigated to what extent usual textbook images influence students’ understanding of such phenomena. This study examines this issue, exploring 13–14 year old students’ explanations, drawings, and conceptions about three familiar phenomena: change of seasons, Moon phases, and solar or lunar eclipses. The research questions that guided the study were (RQ1) how are students’ explanations and visual representations about familiar astronomical phenomena affected by different image-support conditions? (RQ2) How are students’ conceptions about familiar astronomical phenomena affected by different image-support conditions? (RQ3) Which features of the used images most affected the students’ visual representations and explanations of familiar astronomical phenomena? To answer our research questions, we designed three instructional contexts under increasing support conditions: textbook images and text, teaching booklets with specially designed images and text, only text. To analyze students’ drawings, we used exploratory factor analysis to deconstruct drawings into their most salient elements. To analyze students’ explanations, we adopted a constant comparison method identifying different levels of increasing knowledge. To investigate students’ conceptions, we used a mixed multiple-choice and true false baseline questionnaire. For RQ1, results show that the specially designed images condition was effective in helping students producing informed drawings in comparison to text-only condition for all phenomena, and more effective than textbook images condition when one considers seasonal change drawings. Concerning RQ2, the specially designed images condition was the most effective for all phenomena. Concerning RQ3, prevalent elements of astronomy images that affected students’ explanations and visual representations were Earth’s elliptical orbit; the position of the Sun with respect to the Moon orbit; and Sun, Moon, and Earth alignment. Our findings confirm concerns about textbook astronomy images, whose features may interfere with the identification of the relevant factors underlying the phenomena. Moreover, findings of this study suggest that affordances of the specially designed images may play an essential role in scaffolding meaningful understanding of the targeted phenomena. Implications for teaching through and learning from visual representations in astronomy education are briefly discussed.

[This paper is part of the Focused Collection on Astronomy Education Research.] As part of a larger project studying undergraduate students’ understanding of cosmology, we explored students’ ideas about the curvature of the Universe. We investigated preinstruction ideas held by introductory astronomy (ASTRO 101) students at three participating universities and postinstruction ideas at one. Through thematic analysis of responses to questions on three survey forms and preinstruction interviews, we found that prior to instruction a significant fraction of students said the Universe is round. Students’ reasoning for this included that the Universe contains round objects, therefore it must also be round, or an incorrect idea that the big bang theory describes an explosion from a central point. We also found that a majority of students think that astronomers use the term curvature to describe properties, such as dimensions, angles, or size, of the Universe or objects in the Universe, or that astronomers use the term curvature to describe the bending of space due to gravity. Students are skeptical that the curvature of the Universe can be measured, to a greater or lesser degree depending on question framing. Postinstruction responses to a multiple-choice exam question and interviews at one university indicate that students are more likely to correctly respond that the Universe as a whole is not curved postinstruction, though the idea that the Universe is round still persists for some students. While we see no evidence that priming with an elliptical or rectangular map of the cosmic microwave background on a postinstruction exam affects responses, students do cite visualizations such as diagrams among the reasons for their responses in preinstruction surveys.

[This paper is part of the Focused Collection on Astronomy Education Research.] In this paper we discuss the design and development of a learning progression (LP) to describe and interpret students’ understanding about stellar structure and evolution (SSE). The LP is built upon three content dimensions: hydrostatic equilibrium; composition and aggregation state; functioning and evolution. The data to build up the levels of the hypothetical LP (LP1) came from a 45-minute, seven-question interview, with 33 high school students previously taught about the topic. The questions were adapted from an existing multiple-choice instrument. Data were analyzed using Minstrell’s “facets” approach. To assess the validity of LP1, we designed a twelve-hour teaching module featuring paper-and-pencil tasks and practical activities to estimate the stellar structure and evolution parameters. Twenty high school students were interviewed before and after the activities using the same interview protocol. Results informed a revision of LP1 (LP2) and, in parallel, of the module. The revised module included supplementary activities corresponding to changes made to LP1. We then assessed LP2 with 30 high school students through the same interview, submitted before and after the teaching intervention. A final version of the LP (LP3) was then developed drawing on students’ emerging reasoning strategies. This paper contributes to research in science education by providing an example of the iterative development of the instruction required to support the student thinking that LPs’ levels describe. Concerning astronomy education research, our findings can inform suitable instructional activities more responsive to students’ reasoning strategies about stellar structure and evolution.

[This paper is part of the Focused Collection on Astronomy Education Research.] We report on a study of almost 13 000 undergraduate students enrolled in introductory astronomy courses at the University of Arizona. From 1989 to 2016, students completed a basic science knowledge, beliefs, and attitudes survey. From 2014 to 2016, a subset of the sample completed an additional survey that probed their overall interest in science and astronomy, where they reported getting information about science, and their judgment of those sources. Our sample of mostly nonscience major students outperformed the general public on basic science knowledge questions during the time of the study. Additionally, there was very little change over the range of time of the study in students’ basic science knowledge whose scores averaged around 79% correct over the 27 years. Students’ self-reported demographic information and beliefs and attitudes in science and technology accounted for only 11% of the variance in their science knowledge scores and there was no systematic pattern between where students reported getting their information about science and their basic science knowledge. Despite this, there was a relationship between how students rated the reliability of sources and their science knowledge. Our findings support that introductory astronomy courses are opportunities to improve students’ attitudes towards science and ability to evaluate scientific information. Although this group of students’ basic science knowledge and attitudes remained relatively unchanged over 27 years there was a measurable relationship between students’ beliefs and attitudes, interest, science knowledge, and information literacy.

[This paper is part of the Focused Collection on Astronomy Education Research.] Students taking a second astronomy course for nonscientists were asked to reflect on the nature of scientific inquiry three times during the first half of the semester. First, they were assigned a short paper in which they were asked to argue for or against the thesis that observers of the night sky in ancient civilizations were scientists, and nearly all of the students argued that yes, they were. Second, they were asked to write a second paper in which they argued the opposite of their first thesis. Lastly, they were asked, on a midterm exam, to write an essay about whether the Ancient Greek astronomers were good scientists. In writing these papers and essays, many students included definitions of science or scientists, and these definitions progressed from paper to paper. In addition, the evidence students used to argue that ancient observers were scientists changed, with students becoming more expertlike.

[This paper is part of the Focused Collection on Astronomy Education Research.] An increased interest in using video games in educational contexts has led to many innovations in both formal and informal environments. Educational researchers, instructional designers, and educators have sought and developed ways to incorporate video games or gamelike elements into a curriculum. We present a study of a web-based college-level introductory astronomy class in which content is delivered entirely in a digital world setting through nonplayer characters and built-in minigames. Based on prior research on the potential benefits of video games for use in education, we expect that topics covered in the minigames, the most gamified aspects of the course, should be particularly effective. Using data collected through pre- and post-testing of two sections of ASTRO 001V (the designation given in Penn State’s course catalog) with the Test Of Astronomy Standards, we focused our analysis on six questions that pertain directly to minigame topics. We found that two of these questions showed encouraging gains, while the other four demonstrated that students continued to hold on to common alternate conceptions within those topic areas. This finding suggests that more work is required to understand how to improve the games in ways that will further support student astronomy learning.

[This paper is part of the Focused Collection on Astronomy Education Research.] Multiple studies show that spatial thinking skills contribute to students’ performance in science, technology, engineering, and mathematics disciplines. The study of astronomy is no different with the understanding of many astronomical phenomena requiring spatial thinking skills. This paper describes traditional and contemporary approaches to characterizing and measuring spatial thinking skills and suggests how they inform research in astronomy education. It summarizes previous literature in astronomy education research and categorizes the research approaches of astronomy education peer-reviewed journal articles and conference proceedings that explicitly consider the role of spatial thinking. Additionally, it recommends directions and curricular approaches for astronomy education research informed by current research in spatial thinking.

[This paper is part of the Focused Collection on Astronomy Education Research.] One goal for a scientifically literate citizenry would be for learners to appreciate when the Earth came to be and where it resides in the Universe. Understanding the Earth’s formation in time in both a sociohistorical and scientific sense allows us to place humanity within the larger context of our existence in the Universe. This article considers prior research from cognitive science, psychology, history, and Earth and space science education to inform a new research agenda in astronomy education. While there exists prior research related to learner’s ideas of time and the Earth’s location, research on how to help students develop a coherent model of the Earth’s place in space and time in the Universe is still lacking. We highlight a set of preliminary findings from a pilot study that is part of this new agenda, which is focused on students’ ideas on how to connect the Earth’s formation with prior events in the Universe.

Research on the test structure of the Force Concept Inventory (FCI) has largely been performed with exploratory methods such as factor analysis and cluster analysis. Multidimensional Item Response Theory (MIRT) provides an alternative to traditional exploratory factor analysis which allows statistical testing to identify the optimal number of factors. Application of MIRT to a sample of $N=4716$ FCI post-tests identified a 9-factor solution as optimal. Additional analysis showed that a substantial part of the identified factor structure resulted from the practice of using problem blocks and from pairs of similar questions. Applying MIRT to a reduced set of FCI items removing blocked items and repeated items produced a 6-factor solution; however, the factors still had little relation the general structure of Newtonian mechanics. A theoretical model of the FCI was constructed from expert solutions and fit to the FCI by constraining the MIRT parameter matrix to the theoretical model. Variations on the theoretical model were then explored to identify an optimal model. The optimal model supported the differentiation of Newton’s 1st and 2nd law; of one-dimensional and three-dimensional kinematics; and of the principle of the addition of forces from Newton’s 2nd law. The model suggested by the authors of the FCI was also fit; the optimal MIRT model was statistically superior.

To prepare physics students for future careers, educators need to understand the skills and other factors necessary for entry and success on the job. Often these insights are based on CEOs, HR personnel, and managers, who provide broad perspectives regarding successful attributes of new hires. However, such insights are often more general and disconnected from specific jobs than insights gained from entry-level employees who recently transitioned from school to work. Using in-depth descriptive summaries and thematic analysis from interviews with six recently hired technicians and engineers in the field of optics, we explored factors that influenced their entry and success on the job. Six themes arose: documentation, computational skills, specialized learning, question asking, tinkering skills, and navigating cultural differences. We discuss the implications of these themes in both their value to employees as well as integration into the physics curriculum.

The reliability and validity of inventories should be verified in multiple ways. Although the epistemological beliefs about the physical science survey (EBAPS) has been deemed to be reliable and valid by the authors, the axes or factor structure proposed by the authors has not been independently checked. Using data from a study sample we discussed in previous publications, we performed exploratory factor analysis on 1,258 post-test EBAPS surveys. The students in the sample were from an introductory Astronomy course at a mid-sized western university. Inspection suggested the use of either a three-factor model or a five-factor model. Each of the factors is interpreted and discussed, and the factors are compared to the axes proposed by the authors of the EBAPS. We find that the five-factor model extrapolated from our data partially overlaps with the model put forth by the authors of the EBAPS, and that many of the questions did not load onto any factors.

This paper is inspired by the widely accepted need to develop critical thinking in physics students and teachers. More specifically, it is focused on the development of a critical attitude in prospective physics teachers. The question of a possible interplay between the development of conceptual comprehension and that of a critical attitude prompted us to conduct a series of investigations with teachers at the end of their preparation. The goal of this paper is to provide a synthesis of five previously published papers on this topic in order to inform discussion about teacher preparation. Each investigation is centered on a particular aspect of physics, and all are based on in-depth interviews with different participants. We focus on prospective teachers’ “intellectual dynamics,” that is, the way their comprehension of nonobvious topics and their critical attitudes evolve during these interviews, taking into account metacognitive and affective aspects such as intellectual satisfaction and self-esteem. We characterize several types of intellectual dynamics: “early critique,” “delayed critique,” “unstable critique,” and “expert anesthesia” and provide information on their frequency. An overall conclusion is that in this type of context, that is, a guided intellectual pathway of about an hour, the development of conceptual comprehension and critical attitude are most often deeply entangled. We discuss the implications of these results for future research and we advocate new objectives and strategies for physics teachers’ preparation.

Studies on physics identity are appearing more frequently and often responding to increased awareness of the underrepresentation of students of color in physics. In our broader research, we focus our efforts on understanding how racial identity and physics identity are negotiated throughout the experiences of Black physicists. In this paper, we present a Critical Physics Identity framework that can be used to examine racialized physics identity and demonstrate the utility of this framework by analyzing interviews with four physicists. Our framework draws from prior constructs of physics identity and racialized identity and provides operational definitions of six interacting dimensions. In this paper, we present the operationalized constructs, demonstrate how we use these constructs to code narrative data, as well as outline three methods of analysis that may be applied to study systems and structures and their influences on the experiences of Black students.

The lack of an engaging pedagogy and the highly competitive atmosphere in introductory science courses tend to discourage students from pursuing science, technology, engineering, and mathematics (STEM) majors. Once in a STEM field, academic and social integration has been long thought to be important for students’ persistence. Yet, it is rarely investigated. In particular, the relative impact of in-class and out-of-class interactions remains an open issue. Here, we demonstrate that, surprisingly, for students whose grades fall in the “middle of the pack,” the out-of-class network is the most significant predictor of persistence. To do so, we use logistic regression combined with Akaike’s information criterion to assess in- and out-of-class networks, grades, and other factors. For students with grades at the very top (and bottom), final grade, unsurprisingly, is the best predictor of persistence—these students are likely already committed (or simply restricted from continuing) so they persist (or drop out). For intermediate grades, though, only out-of-class closeness—a measure of one’s immersion in the network—helps predict persistence. This does not negate the need for in-class ties. However, it suggests that, in this cohort, only students that get past the convenient in-class interactions and start forming strong bonds outside of class are or become committed to their studies. Since many students are lost through attrition, our results suggest practical routes for increasing students’ persistence in STEM majors.

Because of its abstract nature, Albert Einstein’s theory of general relativity is rarely present in school physics curricula. Although the educational community has started to investigate ways of bringing general relativity to classrooms, field-tested educational material is rare. Employing the model of educational reconstruction, we present a collaborative online learning environment that was introduced to final year students (18–19 years old) in six Norwegian upper secondary physics classrooms. Design-based research methods guided the development of the learning resources, which were based on a sociocultural view of learning and a historical-philosophical approach to teaching general relativity. To characterize students’ learning from and interaction with the learning environment we analyzed focus group interviews and students’ oral and written responses to assigned problems and discussion tasks. Our findings show how design choices on different levels can support or hinder understanding of general relativity, leading to the formulation of design principles that help to foster qualitative understanding and encourage collaborative learning. The results indicate that upper secondary students can obtain a qualitative understanding of general relativity when provided with appropriately designed learning resources and sufficient scaffolding of learning through interaction with teacher and peers.

Evidence from psychology, cognitive science, and neuroscience suggests that cognition and emotions are coupled. Education researchers have also documented correlations between emotions (such as joy, anxiety, fear, curiosity, boredom) and academic performance. Nonetheless, most research on students’ reasoning and conceptual change within the learning sciences and physics and science education research has not attended to the role of learners’ emotions in describing or modeling the fine timescale dynamics of their conceptual reasoning. The few studies that integrate emotions into models of learners’ cognition have mostly done so at a coarse grain size. In this study, toward the long-term goal of incorporating emotions into models of in-the-moment cognitive dynamics, we present a case study of Judy, an undergraduate electrical engineering and physics major. We show that shifts in the intensity of a fine-grained aspect of Judy’s emotions, her annoyance at conceptual homework problems, co-occur with shifts in her epistemological stance toward differentiating knowledge about and the practical utility of real circuits and idealized circuit models. We then argue for the plausibility of a cognitive model in which Judy’s emotions and epistemological stances mutually affect each other. We end with discussions on how models of learners’ cognition that incorporate their emotions are generative for instructional purposes and research on learning.

Encouraged by positive clinical results at the University of Illinois, mastery-style homework was integrated into a large semester-long preparatory physics course via an online homework system that used narrated animated video solutions as correctives. This paper discusses the impact and evolution of the homework in its first two years. The first iteration revealed that students were frustrated and did not engage with the system in an effective way. Intending to reduce that frustration and quell negative behavior, the mastery requirement was relaxed, transfer between versions was reduced, and the addition of a direct discussion with students about the homework were implemented in its second year. The results showed that details of implementation can substantially affect students’ behavior; large and statistically significant effects were observed as a reduction in frustration (with self-identified “frustrated” students dropping from 60% in 2014 to 30% in 2015) and improvement in performance (average student mastery rate of 59% to 69%).

Research into teacher learning and practice over the last three decades shows that the teachers of a specific subject need to possess knowledge that is different from the knowledge of other content experts. Yet this specialized version of content knowledge that teachers need to plan instruction, respond to student ideas, and assess student understanding in real time is a theoretically elusive construct. It is crucial for the fields of precollege teacher preparation, teacher professional education, and postsecondary faculty professional development to (a) clarify the construct that underlies this specialized content knowledge, (b) operationalize it in some domain, (c) measure it in both static contexts and as it is enacted in the classroom, and (d) correlate its presence with “richness” of classroom instruction and its effect on student learning. This paper documents a piece of a multiyear, multi-institutional effort to investigate points (a)–(d) in the domain of energy in the first high school physics course. In particular, we describe the framework that we developed to clarify content knowledge for teaching in the context of high school energy learning. We then outline the process through which we developed, tested, and refined a “paper-and-pencil” assessment administered on a computer and discuss the substantive and psychometric features of several items based on a field test of the final form of the assessment. We choose to discuss these items for a dual purpose: to illustrate the application of our general framework and to present performance findings from a sample of 362 practicing high school teachers of physics.