A generally agreed upon tenant of the physics teaching community is the centrality of subject-specific expertise in effective teaching. However, studies which assess the content knowledge of incoming K–12 physics teachers in the U.S. have not yet been reported. Similarly lacking are studies on if or how the demographic makeup of aspiring physics educators is different from previously reported analyses of the actual high school physics teaching workforce. Here we present findings about the demographics and subject knowledge of prospective high school physics teachers using data from Praxis physics subject assessments administered between 2006 and 2016. Our analysis reveals significant variations in exam participation and performance between men and women, as well as those with different undergraduate majors and academic performance over the past decade. Findings from this work inform understandings and decisions about the quality, recruitment, and preparation of the high school physics teaching workforce.

When considering performing an Introductory Physics for Life Sciences course transformation for one’s own institution, life science majors’ achievement goals are a necessary consideration to ensure the pedagogical transformation will be effective. However, achievement goals are rarely an explicit consideration in physics education research topics such as metacognition. We investigate a sample population of 218 students in a first-semester introductory algebra-based physics course, drawn from 14 laboratory sections within six semesters of course sections, to determine the influence of achievement goals on life science majors’ attitudes towards physics. Learning orientations that, respectively, pertain to mastery goals and performance goals, in addition to a learning orientation that does not report a performance goal, were recorded from students in the specific context of learning a problem-solving framework during an in-class exercise. Students’ learning orientations, defined within the context of students’ self-reported statements in the specific context of a problem-solving-related research-based course implementation, are compared to pre-post results on physics problem-solving items in a well-established attitudinal survey instrument, in order to establish the categories’ validity. In addition, mastery-related and performance-related orientations appear to extend to overall pre-post attitudinal shifts, but not to force and motion concepts or to overall course grade, within the scope of an introductory physics course. There also appears to be differentiation regarding overall course performance within health science majors, but not within biology majors, in terms of learning orientations; however, health science majors generally appear to fare less well on all measurements in the study than do biology majors, regardless of learning orientations.

In 1995, Huffman and Heller used exploratory factor analysis to draw into question the factors of the Force Concept Inventory (FCI). Since then several papers have been published examining the factors of the FCI on larger sets of student responses and understandable factors were extracted as a result. However, none of these proposed factor models have been verified to not be unique to their original sample through the use of independent sets of data. This paper seeks to confirm the factor models proposed by Scott et al. in 2012, and Hestenes et al. in 1992, as well as another expert model proposed within this study through the use of confirmatory factor analysis (CFA) and a sample of 20 822 postinstruction student responses to the FCI. Upon application of CFA using the full sample, all three models were found to fit the data with acceptable global fit statistics. However, when CFA was performed using these models on smaller sample sizes the models proposed by Scott et al. and Eaton and Willoughby were found to be far more stable than the model proposed by Hestenes et al. The goodness of fit of these models to the data suggests that the FCI can be scored on factors that are not unique to a single class. These scores could then be used to comment on how instruction methods effect the performance of students along a single factor and more in-depth analyses of curriculum changes may be possible as a result.

Assessing student learning is a cornerstone of educational practice. Standardized assessments have played a significant role in the development of instruction, curricula, and educational spaces in college physics. However, the use of these assessments to evaluate student learning is only productive if they continue to align with our learning goals. Recently, there have been calls to elevate the process of science (“scientific practices”) to the same level of importance and emphasis as the concepts of physics (“core ideas” and “crosscutting concepts”). We use the recently developed Three-Dimensional Learning Assessment Protocol to investigate how well the most commonly used standardized assessments in introductory physics (i.e., concept inventories) align with this modern understanding of physics education’s learning goals. We find that many of the questions on concept inventories do elicit evidence of student understanding of core ideas, but do not have the potential to elicit evidence of scientific practices or crosscutting concepts. Furthermore, we find that the individual scientific practices and crosscutting concepts that are assessed using these tools are limited to a select few. We discuss the implications that these findings have on designing and testing curricula and instruction both in the past and for the future.

As part of a research study on student reasoning in quantum mechanics, we examine students’ use of ontologies, or the way students’ categorically organize entities they are reasoning about. In analyzing three episodes of focus group discussions with modern physics students, we present evidence of the dynamic nature of ontologies, and refine prior theoretical frameworks for thinking about dynamic ontologies. We find that in a given reasoning episode ontologies can be dynamic in construction (referring to when the reasoner constructs the ontologies) or application (referring to which ontologies are applied in a given reasoning episode). In our data, we see instances of students flexibly switching back and forth between parallel stable structures as well as constructing and negotiating new ontologies in the moment. Methodologically, we use a collective conceptual blending framework as an analytic tool for capturing student reasoning in groups. In this research, we value the messiness of student reasoning and argue that reasoning in a tentative manner can be productive for students learning quantum mechanics. As such, we shift away from a binary view of student learning which sees students as either having the correct answer or not.

We investigated physics students’ epistemological views on measurements and validity of experimental results. The roles of experiments in physics have been underemphasized in previous research on students’ personal epistemology, and there is a need for a broader view of personal epistemology that incorporates experiments. An epistemological framework incorporating the structure, methodology, and validity of scientific knowledge guided the development of an open-ended survey. The survey was administered to students in algebra-based and calculus-based introductory physics courses, upper-division physics labs, and physics Ph.D. students. Within our sample, we identified several differences in students’ ideas about validity and uncertainty in measurement. The majority of introductory students justified the validity of results through agreement with theory or with results from others. Alternatively, Ph.D. students frequently justified the validity of results based on the quality of the experimental process and repeatability of results. When asked about the role of uncertainty analysis, introductory students tended to focus on the representational roles (e.g., describing imperfections, data variability, and human mistakes). However, advanced students focused on the inferential roles of uncertainty analysis (e.g., quantifying reliability, making comparisons, and guiding refinements). The findings suggest that lab courses could emphasize a variety of approaches to establish validity, such as by valuing documentation of the experimental process when evaluating the quality of student work. In order to emphasize the role of uncertainty in an authentic way, labs could provide opportunities to iterate, make repeated comparisons, and make decisions based on those comparisons.

A critical component of scientific reasoning is the consideration of alternative explanations. Recognizing that decades of cognitive psychology research have demonstrated that relative cognitive accessibility, or “what comes to mind,” strongly affects how people reason in a given context, we articulate a simple “cognitive accessibility rule”, namely that alternative explanations are considered less frequently when an explanation with relatively high accessibility is offered first. In a series of four experiments, we test the cognitive accessibility rule in the context of consideration of alternative explanations for six physical scenarios commonly found in introductory physics curricula. First, we administer free recall and recognition tasks to operationally establish and distinguish between the relative accessibility and availability of common explanations for the physical scenarios. Then, we offer either high or low accessibility explanations for the physical scenarios and determine the extent to which students consider alternatives to the given explanations. We find two main results consistent across algebra- and calculus-based university level introductory physics students for multiple answer formats. First, we find evidence that, at least for some contexts, most explanatory factors are cognitively available to students but not cognitively accessible. Second, we empirically verify the cognitive accessibility rule and demonstrate that the rule is strongly predictive, accounting for up to 70% of the variance of the average student consideration of alternative explanations across scenarios. Overall, we find that cognitive accessibility can help to explain biases in the consideration of alternatives in reasoning about simple physical scenarios, and these findings lend support to the growing number of science education studies demonstrating that tasks relevant to science education curricula often involve rapid, automatic, and potentially predictable processes and outcomes.

PeerWise is an online application where students are encouraged to generate a bank of multiple choice questions for their classmates to answer. After answering a question, students can provide feedback to the question author about the quality of the question and the question author can respond to this. Student use of, and attitudes to, this online community within PeerWise was investigated in two large first year undergraduate physics courses, across three academic years, to explore how students interact with the system and the extent to which they believe PeerWise to be useful to their learning. Most students recognized that there is value in engaging with PeerWise, and many students engaged deeply with the system, thinking critically about the quality of their submissions and reflecting on feedback provided to them. Students also valued the breadth of topics and level of difficulty offered by the questions, recognized the revision benefits afforded by the resource, and were often willing to contribute to the community by providing additional explanations and engaging in discussion.

We explore the sources of student engagement with curricular content in an Introductory Physics for Life Science (IPLS) course at Swarthmore College. Do IPLS students find some life-science contexts more interesting than others, and, if so, what are the sources of these differences? We draw on three sources of student data to answer this question: (1) quantitative survey data illustrating how interested students were in particular contexts from the curriculum, (2) qualitative survey data in which students describe the source of their interest in these particular contexts, and (3) interview data in which students reflect on the contexts that were and were not of interest to them. We find that examples that make interdisciplinary connections with students’ other coursework in biology and chemistry, and examples that make connections to what students perceive to be the “real world,” are particularly effective at fostering interest. More generally, students describe being deeply engaged with contexts that foster a sense of coherence or have personal meaning to them. We identify various “engagement pathways” by which different life-science students engage with IPLS content, and suggest that a curriculum needs to be flexible enough to facilitate these different pathways.

The Conceptual Survey of Electricity and Magnetism (CSEM) has been used to assess student understanding of introductory concepts of electricity and magnetism because many of the items on the CSEM have strong distractor choices which correspond to students’ alternate conceptions. Instruction is unlikely to be effective if instructors do not know the common alternate conceptions of introductory physics students and explicitly take into account common student difficulties in their instructional design. Here, we discuss research involving the CSEM to evaluate one aspect of the pedagogical content knowledge of teaching assistants (TAs): knowledge of introductory students’ alternate conceptions in electricity and magnetism as revealed by the CSEM. For each item on the CSEM, the TAs were asked to identify the most common incorrect answer choice selected by introductory physics students if they did not know the correct answer after traditional instruction. Then, we used introductory student CSEM post-test data to assess the extent to which TAs were able to identify the most common alternate conception of introductory students in each question on the CSEM. We find that the TAs were thoughtful when attempting to identify common student difficulties and they enjoyed learning about student difficulties this way. However, they struggled to identify many common difficulties of introductory students that persist after traditional instruction. We discuss specific alternate conceptions that persist after traditional instruction, the extent to which TAs were able to identify them, and results from think-aloud interviews with TAs which provided valuable information regarding why the TAs sometimes selected certain alternate conceptions as the most common but were instead very rare among introductory students. We also discuss how tasks such as the one used in this study can be used in professional development programs to engender productive discussions about the importance of being knowledgeable about student alternate conceptions in order to help students learn. Interviews with TAs engaged in this task as well as our experience with such tasks in our professional development programs suggest that they are beneficial.

Relating mathematical concepts to graphical representations is a challenging task for students. In this paper, we introduce two visual strategies to qualitatively interpret the divergence of graphical vector field representations. One strategy is based on the graphical interpretation of partial derivatives, while the other is based on the flux concept. We test the effectiveness of both strategies in an instruction-based eye-tracking study with $N=41$ physics majors. We found that students’ performance improved when both strategies were introduced (74% correct) instead of only one strategy (64% correct), and students performed best when they were free to choose between the two strategies (88% correct). This finding supports the idea of introducing multiple representations of a physical concept to foster student understanding. Relevant eye-tracking measures demonstrate that both strategies imply different visual processing of the vector field plots, therefore reflecting conceptual differences between the strategies. Advanced analysis methods further reveal significant differences in eye movements between the best and worst performing students. For instance, the best students performed predominantly horizontal and vertical saccades, indicating correct interpretation of partial derivatives. They also focused on smaller regions when they balanced positive and negative flux. This mixed-method research leads to new insights into student visual processing of vector field representations, highlights the advantages and limitations of eye-tracking methodologies in this context, and discusses implications for teaching and for future research. The introduction of saccadic direction analysis expands traditional methods, and shows the potential to discover new insights into student understanding and learning difficulties.

Measuring student learning is a complicated but necessary task for understanding the effectiveness of instruction and issues of equity in college science, technology, engineering, and mathematics (STEM) courses. Our investigation focused on the implications on claims about student learning that result from choosing between one of two commonly used metrics for analyzing shifts in concept inventories. The metrics are normalized gain ($\mathbf{g}$), which is the most common method used in physics education research and other discipline based education research fields, and Cohen’s $d$, which is broadly used in education research and many other fields. Data for the analyses came from the Learning About STEM Student Outcomes (LASSO) database and included test scores from 4551 students on physics, chemistry, biology, and math concept inventories from 89 courses at 17 institutions from across the United States. We compared the two metrics across all the concept inventories. The results showed that the two metrics lead to different inferences about student learning and equity due to the finding that $\mathbf{g}$ is biased in favor of high pretest populations. We discuss recommendations for the analysis and reporting of findings on student learning data.

Drawing appropriate diagrams is a useful problem solving heuristic that can transform a problem into a representation that is easier to exploit for solving it. One major focus while helping introductory physics students learn effective problem solving is to help them understand that drawing diagrams can facilitate problem solution. We conducted an investigation in which two different interventions were implemented during recitation quizzes in a large enrollment algebra-based introductory physics course. Students were either (i) asked to solve problems in which the diagrams were drawn for them or (ii) explicitly told to draw a diagram. A comparison group was not given any instruction regarding diagrams. We developed rubrics to score the problem solving performance of students in different intervention groups and investigated ten problems. We found that students who were provided diagrams never performed better and actually performed worse than the other students on three problems, one involving standing sound waves in a tube (discussed elsewhere) and two problems in electricity which we focus on here. These two problems were the only problems in electricity that involved considerations of initial and final conditions, which may partly account for why students provided with diagrams performed significantly worse than students who were not provided with diagrams. In order to explore potential reasons for this finding, we conducted interviews with students and found that some students provided with diagrams may have spent less time on the conceptual analysis and planning stage of the problem solving process. In particular, those provided with the diagram were more likely to jump into the implementation stage of problem solving early without fully analyzing and understanding the problem, which can increase the likelihood of mistakes in solutions.

A growing body of scholarly work indicates that student performance on physics problems stems from many factors, including relevant conceptual understanding. However, in contexts in which significant conceptual difficulties have been documented via research, it can be difficult to pinpoint and isolate such factors because students’ written and interview responses rarely reveal the full richness of their conscious and, perhaps more importantly, subconscious reasoning paths. In this investigation, informed by dual-process theories of reasoning and decision making as well as the theoretical construct of accessibility, we conducted a series of experiments in order to gain greater insight into the factors impacting student performance on the “five-block problem,” which has been used in the literature to probe student thinking about buoyancy. In particular, we examined both the impact of problem design (including salient features and cueing) and the impact of targeted instruction focused on density-based arguments for sinking and floating and on neutral buoyancy. The investigation found that instructional modifications designed to remove the strong intuitive appeal of the first-available response led to significantly improved performance, without improving student conceptual understanding of the requisite buoyancy concepts. As such, our findings represent an important first step in identifying systematic strategies for using theories from cognitive science to guide the development and refinement of research-based instructional materials.

In this study, we analyze the systematic error from false positives of the Force Concept Inventory (FCI). We compare the systematic errors of question 6 (Q.6), Q.7, and Q.16, for which clearly erroneous reasoning has been found, with Q.5, for which clearly erroneous reasoning has not been found. We determine whether or not a correct response to a given FCI question is a false positive using subquestions. In addition to the 30 original questions, subquestions were introduced for Q.5, Q.6, Q.7, and Q.16. This modified version of the FCI was administered to 1145 university students in Japan from 2015 to 2017. In this paper, we discuss our finding that the systematic errors of Q.6, Q.7, and Q.16 are much larger than that of Q.5 for students with mid-level FCI scores. Furthermore, we find that, averaged over the data sample, the sum of the false positives from Q.5, Q.6, Q.7, and Q.16 is about 10% of the FCI score of a midlevel student.

In response to national calls for improved physical sciences education for students pursuing careers in the life sciences and medicine, reformed introductory physics for life sciences (IPLS) courses are being developed. This exploratory study is among the first to assess the effect of an IPLS course on students’ attitudes, interest, and performance. The IPLS course studied was the second semester of introductory physics, following a standard first semester course, allowing the outcomes of the same students in a standard course and in an IPLS course to be compared. In the IPLS course, each physics topic was introduced and elaborated in the context of a life science example, and developing students’ skills in applying physics to life science situations was an explicitly stated course goal. Items from the Colorado Learning about Science Survey were used to assess change in students’ attitudes toward and their interest in physics. Whereas the same students’ attitudes declined during the standard first semester course, we found that students’ attitudes toward physics hold steady or improve in the IPLS course. In particular, students with low initial interest in physics displayed greater increases in both attitudes and interest during the IPLS course than in the preceding standard course. We also find that in the IPLS course, students’ interest in the life science examples is a better predictor of their performance than their pre-IPLS interest in physics. Our work suggests that the life science examples in the IPLS course can support the development of student interest in physics and positively influence their performance.

This article discusses our investigation regarding nature of science (NOS) implementations and epistemological beliefs within an undergraduate introductory astronomy course. The five year study consists of two years of baseline data in which no explicit use of NOS material was implemented, then three years of subsequent data in which specific NOS material was integrated into the classroom. Our original study covered two years of baseline data and one year of treatment data. Two additional years of treatment course data have revealed intriguing new insights into our students’ epistemic belief structure. To monitor the evolution of belief structures across each semester we used student pre-post data on the Epistemological Beliefs About the Physical Sciences (EBAPS) assessment. The collected data were also partitioned and analyzed according to the following variables: college (Letters of Science, Business, Education, etc.), degree (BA or BS), status (freshman, sophomore, etc.), and gender (male or female). We find that the treatment course no longer undergoes significant overall epistemic deterioration after a semester of instruction. We also acquire a more detailed analysis of these findings utilizing the aforementioned variables. Most notably, we see that this intervention had a pronounced positive impact on males and on students within the college of Education, Arts & Architecture, and those with no concentration. Lastly, whether or not students believe their ability to learn science is innate or malleable did not seem to change, remaining a rigid construct with student epistemologies.

Although active learning is supported by strong evidence of efficacy in undergraduate science instruction, institutions of higher education have yet to embrace comprehensive change. Costs of transforming instruction are regularly cited as a key factor in not adopting active-learning instructional practices. Some cite that alternative methods to stadium-style, lecture-based education are not financially viable to an academic department. This paper examines that argument by presenting an ingredients approach to estimating costs of two instructional methods used in introductory university physics courses at a large public U.S. university. We use a metric common in educational economics, cost effectiveness (CE), which is the total cost per student passing the class. We then compare the CE of traditional, passive-learning lecture courses to those of a well-studied, active-learning curriculum (Modeling Instruction) as a way of evaluating the claim that active learning is cost prohibitive. Our findings are that the Modeling Instruction approach has a higher cost per passing student ($\mathrm{MI}=\$1,030/\mathrm{passing}$ student vs $\mathrm{Trad}=\$790/\mathrm{passing}$ student). These results are discussed from perspectives of university administrators, students, and taxpayers. We consider how MI would need to adapt in order to make the benefits of active learning (particularly higher pass rates and gains on multiple measured student outcomes) available in a cost-neutral setting. This approach aims to provide a methodology to better inform decision makers balancing financial, personnel, and curricular considerations.

This paper investigates the efficacy of an open-inquiry approach to achieve a long term stability of physics instruction. This study represents the natural continuation of a research project started four years ago when a sample of thirty engineering undergraduates, having already attended traditional university physics instruction, were involved in a six-week long learning experience of open-inquiry research activities within the highly motivating context of developing a thermodynamically efficient space base on Mars. Four years later, we explore the effectiveness of that learning experience by analyzing the outcomes that the students achieved by answering again the same questionnaire that was administered them both prior to and immediately after those activities. As we did in the first work, students’ answers were classified within three epistemological profiles. Now, a comparison among students’ outcomes during the three phases, namely, preinstruction, postinstruction, and after four years has been carried out. Immediately after the open-inquiry experience, the students obtained significant benefits in terms of the strengthening of their practical and reasoning abilities, by proficiently applying the learned concepts to face and solve real-world problem situations. In this study, the students’ answers do not highlight any significant regress towards their preinstruction profiles. The global robustness of the teaching strategy adopted four years ago is confirmed by a statistically significant comparison with a control group of students who experienced the same curricular instruction except for the open inquiry-based workshop. Nevertheless, some changes have been observed and discussed in the light of the answers the students provided to a short interview regarding their studying or working experiences across the four-year temporal window.

Student attitudes, defined as the extent to which one holds expertlike beliefs about and approaches to physics, are a major research topic in physics education research. An implicit but rarely tested assumption underlying much of this research is that student attitudes play a significant part in student learning and performance. The current study directly tested this attitude-learning link by measuring the association between incoming attitudes (Colorado Learning Attitudes about Science Survey) and student learning during the semester after statistically controlling for the effects of prior knowledge [early-semester Force Concept Inventory (FCI) or Brief Electricity and Magnetism Assessment (BEMA)]. This study spanned four different courses and included two complementary measures of student knowledge: late-semester concept inventory scores (FCI or BEMA) and exam averages. In three of the four courses, after controlling for prior knowledge, attitudes significantly predicted both late-semester concept inventory scores and exam averages, but in all cases these attitudes explained only a small amount of variance in concept-inventory and exam scores. Results indicate that after accounting for students’ incoming knowledge, attitudes may uniquely but modestly relate to how much students learn and how well they perform in the course.