This paper presents a new astronomy self-efficacy instrument, composed of two factors; one relating to learning astronomy content, which we call astronomy personal self-efficacy, and the other relating to the use of astronomical instrumentation, specifically the use of remote robotic telescopes for data collection. The latter is referred to as the astronomy instrumental self-efficacy factor. The instrument has been tested for reliability and construct validity. Reliability testing showed that factor 1 had a Cronbach’s $\alpha$ of 0.901 and factor 2 had a Cronbach’s $\alpha$ of 0.937. Construct validity was established by computing one-way analyses of variances, with the $p$ value suitably protected, using independent variables peripherally related to the constructs. These analyses demonstrate that both scales possess high construct validity. The development of this astronomy specific instrument is an important step in evaluating self-efficacy as a precursor to investigating the construct of science identity in the field of astronomy.

Physics is a science, technology, engineering, and mathematics discipline in which women are severely underrepresented. Prior work has identified motivation-based explanations for low participation and retention rates of women in physics. Among various motivational factors, intelligence mindsets (i.e., having fixed or growth mindsets) have been rarely examined in the context of physics. Because physics is commonly associated with requiring brilliance to be successful, many students are likely to hold fixed mindset views for physics, which can be especially detrimental for students from underrepresented groups. We examined physics mindset views of 755 engineering and physical-science majors enrolled in calculus-based Physics 1 to understand separable aspects of such views, how these views varied by gender or sex (i.e., for female versus male students), and whether they predicted physics course grade. Multidimensional scaling analyses revealed four different mindset views that are relatively independently held beliefs. Multiple regression analyses showed that physics course grade is most closely associated with whether students deny or accept a fixed mindset view about themselves in particular. One particular view also had the largest gender difference. Therefore, understanding why students hold different mindset views and designing appropriate interventions for physics courses are important areas to consider in efforts seeking to improve outcomes in physics for diverse student groups.

More progress is needed to achieve equity in racial and gender representation in the push to diversify the physical sciences. In order to continue moving towards representation and equity, there is a need for more analytic tools that can help us understand where we are and how we got here. This may also enable meaningful systemic change. In this article, we will review two theoretical frameworks: critical race theory (CRT) and feminist standpoint theory (FST). This paper will guide the reader through the historical context in which each theory was formed, present core tenets and major ideas of each theory, along with external critiques to each theory and where they stand today. This will help readers to further understand CRT and FST, what their role is in education, and how they may be used in physics education research. Simultaneously, this article will serve to broaden perspectives of fundamental societal problems such as racism and sexism.

Abilities in scientific thinking and reasoning have been emphasized as core areas of initiatives, such as the Next Generation Science Standards or the College Board Standards for College Success in Science, which focus on the skills the future will demand of today’s students. Although there is rich literature on studies of how these abilities develop in students across grade levels, the research community has not reached consensus on their definition, modeling, or assessment. To advance research in this important area, a coherent theoretical model of scientific reasoning is needed for practically guiding instruction and assessment. For decades, the only instrument available for large-scale application was the Lawson’s Classroom Test of Scientific Reasoning, but the instrument has demonstrated validity weaknesses and ceiling limitations, and its design is missing an explicit modeling framework for justifying the included skills. As a result, there is an urgent need for the development of a comprehensive modeling framework of scientific reasoning and a valid scientific reasoning assessment that targets the wide-ranging skills required for 21st century learners. This paper reports on the development of a modeling framework of scientific reasoning along with a new assessment instrument, adding to the research literature in a much needed area. The modeling framework integrates research in scientific and causal reasoning and operationally defines the skills and subskills that underlie the reasoning for knowledge development through scientific inquiry. Subsequently, this framework is used to guide the development of an assessment instrument on scientific reasoning. The validity and reliability of the instrument, which have been established based on large-scale testing, will also be discussed.

The academic performance of undergraduate physics students at a research-intensive UK university were studied to identify whether there were any significant differences between underrepresented and overrepresented groups. Exit qualification, degree classification, average yearly marks, and course marks were analyzed to determine statistically significant associations with gender or widening participation status. Significant association was found between gender and the integrated masters qualification, with a higher proportion of female students attaining a first class or second class (upper) classification. A performance gap was identified between widening participation and non-widening participation students in second year, but no significant association was found between widening participation status and exit qualification or degree classification. In examining the intersection of gender and widening participation status, no significant association was found between these groups and exit qualification. These results contrast with previous studies, which suggest that the effects of underrepresentation adversely impact academic performance. The reasons why this might be the case, with particular consideration of the context of the sample studied, are discussed.

The vast majority of research involving active learning pedagogies uses passive lecture methods as a baseline. We propose to move beyond such comparisons to understand the mechanisms that make different active learning styles unique. Here, we use COPUS observations to record student and instructor activities in six known styles of active learning in physics, and use latent profile analysis to classify these observations. Latent profile analysis using two profiles successfully groups COPUS profiles into interactive lecturelike and other. Five latent profiles successfully sorts observations into interactive lecturelike, Modeling Instruction, ISLE labs, context-rich problems labs, and recitationlike or discussionlike. This analysis serves as a proof of concept, and suggests instructional differences across pedagogies that can be further investigated using this method.

This paper presents improvements made to a computerized adaptive testing (CAT)-based version of the FCI (FCI-CAT) in regards to test security and test efficiency. First, we will discuss measures to enhance test security by controlling for item overexposure, decreasing the risk that respondents may (i) memorize the content of a pretest for use on the post-test or (ii) share information about the items with their classmates who take the assessment later. Second, we will discuss measures to enhance test efficiency, so that a shorter test length can yield a desired accuracy and precision of the measurement. Specifically, we utilized collateral information in the form of a pretest proficiency estimate of each respondent for selecting items and estimating respondent proficiency level in the post-test. To shorten the total testing time further, we also allowed the test lengths to be different for the pre- and post-test. To analyze how these improvements affect the accuracy and precision (which we measure in terms of root-mean-square error) of Cohen’s $d$, we conducted a Monte Carlo simulation and a post hoc simulation. Then, we calculated the minimal test length of the FCI-CAT whose accuracy and precision are equivalent to that of the paper-and-pencil version of the FCI. Consequently, we obtained the following three findings: (i) By using collateral information, we can achieve the accuracy and precision of the full-length FCI with fewer items via the FCI-CAT. (ii) For a class size of 40, we can control for test security while still reducing the sum of the pre- and post-test lengths of the FCI-CAT to a total of 33 items (17 items on the pretest and 16 items on the post-test), thereby reducing the testing time to 55%. (iii) If one’s goal is to maximize test efficiency, the pretest length should be slightly larger than the post-test length. On the other hand, if the goal is to maximize test security, the pretest length should be smaller and the post-test length should be larger. If one desires a balance of these two goals, it would be reasonable to choose equal pre- and post-test lengths.

Physics inquiry can be interpreted as the construction of a cogent argument in which students apply inquiry knowledge and knowledge of physics to the systematic collection of relevant, valid, and reliable data, creating optimal scientific support for a conclusion that answers the research question. In learning how to devise, conduct and evaluate a rigorous physics inquiry, students should learn to choose and apply suitable techniques and adhere to scientific conventions that guarantee the collection of such data. However, they also need to acquire and apply an understanding of how to justify their choices and present an optimally convincing argument in support of their conclusion. In this modified and augmented Delphi study we present a view of inquiry knowledge and a way to assess it that acknowledges both of these components. Using our own expertise with teaching physics inquiry and using curriculum documents on physics inquiry, “inquiry knowledge” is deconstructed as a set of “understandings of evidence” (UOE)—insights and views that an experimental researcher relies on in constructing and evaluating scientific evidence. While insights cannot be observed directly, we argue that their presence can be inferred from a student’s actions and decisions in inquiry, inferred with more definitude as a more explicit and adequate justification is provided. This set of UOE is presented and validated as an adequate, coherent, partially overlapping set of learning goals for introductory inquiry learning. We specify conceivable types of actions and decisions expected in inquiry as descriptors of five attainment levels, providing an approach to assessing the presence and application of inquiry knowledge. The resulting construct, the assessment rubric for physics inquiry, is validated in this study. It distinguishes nineteen UOE divided over six phases of inquiry. Preliminary results suggesting a high degree of ecological validity are presented and evaluated. Several directions for future research are proposed.

The typical introductory physics lecture requires students to consolidate and assimilate a large quantity of complex information that is often novel to them. This can leave students overwhelmed, slow the pace of their learning, and lower their motivation. We find that carefully designed multimedia summaries in the form of one-minute videos and short text summaries can significantly increase students’ understanding of the material as well as their ability to organize information into a useful mental framework, as measured by their performances on a concept mapping exercise and a conceptual test of learning. Notably, we show that these improvements can be achieved with negligible increase in overall time students spend on the course material each week. We discuss reasons why these short postlecture summaries helped students learn more, namely, that (i) they likely increased students’ ability to chunk and organize information while minimizing the extraneous cognitive load imposed by the materials, and (ii) they likely improved students’ ability to consolidate and transfer knowledge through the use of contrasting cases. We provide a set of detailed recommendations that instructors can use to develop effective postlecture multimedia summaries. We suggest that one of the most important and impactful recommendations is incorporating student thinking in the design of these types of summaries informed by the input of qualified former students or teaching assistants with significant experience interacting with students in the course.

We studied the impact of metacognitive reflections on recently-completed work as a way to improve the retention of newly learned problem-solving techniques. Students video recorded themselves talking through problems immediately after finishing them, completed ongoing problem-solving strategy maps or problem-sorting exercises, and filled out detailed exam wrappers. We assessed students’ problem-solving skillfulness using a combination of validated instruments and final exam questions scored using a rubric that targets problem-solving best practices. We found a small but significant difference between the rubric score distributions for the control and treatment groups. However, a multiple ordered logistic regression using treatment and Force Concept Inventory (FCI) pretest score as predictors showed that this difference is better explained by the latter. The surprising impact of conceptual preparation on problem-solving skill suggests two things: the importance of remediation for students with insufficient conceptual understanding and the need to consider problem-solving interventions in the context of students’ conceptual knowledge base.

The structure of many science programs at the college level assumes that students are able to draw on and integrate ideas from multiple disciplinary contexts. However, most assessment tools focus on learning in the context of a single discipline. We describe the development and validation of an instrument to measure how well students are able to combine energy ideas from different disciplines into a coherent understanding of a phenomenon. The final version of the instrument consists of a pair of multiple-choice online assessments, along with a metric calculated from the assessment scores: the cross disciplinary learning index (CDLI). The items on both assessments were found to have satisfactory psychometric properties for our sample. Furthermore, CDLI scores correlated with other relevant factors such as amount of science coursework. The CDLI is an easy-to-use metric that could be a useful component of program-level assessment for science, technology, engineering, and mathematics majors. Furthermore, the broader measurement approach, involving a pair of assessments set in different disciplinary contexts, provides a model for assessing cross-disciplinary learning that could be utilized for other cross-cutting scientific concepts.

Both in physics education and in science education more generally concerns exist that formal K-12 education structures limit and, in some cases, diminish students’ interest and agency in these fields. Many stakeholders have turned to informal learning experiences as a means to inspire young people to pursue continual learning in these fields in ways that foster creativity and self-determination. While research exists on the effect of these informal science experiences on students’ science identities and broader science, technology, engineering, and math (STEM) identities, little is known about how specific informal science education experiences relate to students’ physics identity—a construct strongly associated with physics career choice. The current study contributes to the literature by examining the effect of several informal science experiences on students’ physics identity. Drawing on data from a national survey administered to students in required English courses at 27 colleges and universities across the US ($N=15847$), we used multiple regression to test the relationship between informal science experiences in various topical areas at two educational levels (K-8 and 9–12) and students’ physics identity, while controlling for science background and demographics. The results reveal positive effects for stereotypic informal experiences in physical science (e.g., tinkering, competitions) as well as for talking science with friends or family. In addition, there were negative relationships between biology-related experiences (at both levels) and physics identity. Group comparisons further revealed that female students were more likely to report participating in biology-related activities and less likely to report participating in tinkering, STEM competitions, and talking science with friends or family. Students who identified themselves as Black or Hispanic were also less likely than those of other racial or ethnic groups to report tinkering and talking science with friends or family. We use this evidence to build the case that informal learning experiences in physics should move beyond stereotypic activities, increase accessibility, facilitate discourse with family or friends, and focus on interdisciplinary experiences that better engage young participants with a wide range of interests that are connected to physics.

Physics education research is replete with observations and proposed explanations for gender disparities in physics. In this work, we operationalize a definition for equity as everyone has access to the learning environment and everyone’s voice is heard (adapted from previous definitions). We review prior research that observed inequities in physics lab group work and evaluate the degree to which these inequities may arise from student preferences. Regarding access to the learning environment, we find that men and women have similar preferences for experimentation roles, though women generally preferred sharing, rather than dividing or rotating, roles. Regarding everyone’s voice being heard, we find that students prefer when no single student takes charge, though many preferred that students take turns leading the group, with no significant differences between men’s and women’s preferences. We also find no significant differences in men’s and women’s preferences for the gender composition of their group. We conclude that the observed inequities are not explained by student preference and explore implications for instruction and future research.

The proliferation of remote laboratory instruction increased substantially during the recent global pandemic. Many physics departments implemented this rapid transition without the previous experience, time, and deliberation to optimize learning experiences for students. The present quasi-experimental, nonequivalent group design study examined social connections and communities of practice in both in-person and remote undergraduate physics laboratories during the Fall 2020 academic semester. A social networking and communities of practice theoretical framework guided the study design and methodology. Study participants ($N=697$) included in-person and remote undergraduate students in introductory physics laboratories at a research university in the Northeastern United States. A survey instrument was designed to measure students’ perspectives relating to their social connectedness with peers and instructors as well as their physics laboratory self-efficacy. Survey factor analysis identified subdimensions related to student-student social learning perspectives, student-instructor social learning perspectives, and physics laboratory self-efficacy. Analysis of variance indicated remote students experienced weaker levels of engagement with instructors and peers than in-person students, and remote students who connected with one another experienced more social engagement than remote students who did not. Remote students who connected with one another reported having a lower physics laboratory self-efficacy than their in-person counterparts. Isolated remote students did not show a statistical difference in their physics laboratory self-efficacy from their remote-connecting nor their in-person counterparts. Correlations between factors were tested, with instructor interactions most closely related to self-efficacy formation. Results suggest that remote laboratories, which have proliferated extensively during the recent pandemic, may need formalized mechanisms and incentives to promote social interactions and foster communities of practice among peers. This is also the case for student-instructor interactions, which are often diminished in the online platform and may not be socially situated within the larger class community. Sources of self-efficacy, such as creating opportunities for vicarious learning, may also inform ways these changes can be made. Implications for policy and practice of remote physics laboratory instruction are discussed.

Diagrams are ubiquitous in physics, especially in physics education and physics problem solving. Physics problem solvers may generate diagrams to orient to a scenario, to organize information, to directly obtain an answer, or as a tool of communication. In this study, we asked 19 undergraduate and graduate physics majors to answer 18 multiple-choice (MC) physics questions and then complete six diagramming tasks of situations similar to six of the MC problems: the MC problems contained no prompting regarding diagrams, while the diagramming tasks explicitly asked participants to carefully generate diagrams. This prompting placed participants in one of two epistemic frames, problem solving or communicating, which allowed us to explore which elements and features the students include (or not) in diagrams generated when students are working within these two frames. By comparing students’ spontaneously generated diagrams to their prompted diagrams, we found differences in size, accuracy, and amount of detail in unprompted problem-solving diagrams and prompted communicating diagrams. We also looked at correlations between the presence and features of unprompted diagrams with participants’ answer choice. Looking at the different cohorts (e.g., lower-division undergraduate and graduate students), we found that the differences in diagramming between cohorts were generally smaller than the differences within a cohort. We also explore implications for teaching and research.

A new diagnostic instrument, the Conceptual Survey on Wave Optics (CSWO), was developed and validated on 224 high school students (aged 18–19 years) in Croatia. The process of test construction, which included the testing of 61 items on the total of 712 students is presented. The final version of the test consists of 26 multiple-choice items which cover basic conceptual aspects of interference, diffraction, and polarization of light at the high school level. The construction of the test and the evaluation of its functioning and validity were conducted using the Rasch model. The test construct was based on the increasing levels of cognitive complexity in accordance with the Webb’s depth of knowledge model. The theoretical construct was empirically confirmed, and it suggests that the explanations of wave optics phenomena and their application to real-life situations are the most difficult aspects of high school students’ understanding of wave optics. The results of the Rasch analysis suggest that the CSWO is a reliable diagnostic instrument suitable for administration as a post-test to high school students after instruction on wave optics and possibly also for university level students in some introductory physics courses.

Understanding social interactions among students comprises a rich area of physics education research. Here we focus on the social interactions in introductory physics laboratories (labs). Most existing research in such contexts focuses on within-group social dynamics, however, we argue that interactions between different lab groups are just as valuable, especially in nontraditional (reformed) labs where students have more control over the experimental designs. Using video recordings of lab sessions and social network analysis methods, we examined whether and for how long groups interact with each other, comparing across three offerings of an introductory mechanics course. We observed significant variability in the interactions across lab sessions and no clear pattern in how strongly lab groups were connected in the networks between the different courses. More prolonged intergroup interactions, however, occurred in three of the four reformed lab sections, as compared to a traditional lab section and a reformed lab section that took place in the evening. We also developed a group-level social role classification scheme based on groups’ interaction patterns, identifying four roles: noninteractors, information seekers, responders, and mutual interactors. We found that groups in the traditional lab section disproportionately acted as noninteractors, indicating that many groups in this lab did not engage in intergroup interactions at all. In contrast, groups in reformed lab sections took on the remaining three roles more frequently. We also found possible relationships between the distributions of the social roles within each type of lab by the groups’ gender compositions. All-male groups took on interactive roles more often than all-female and mixed-gender groups in the reformed lab sections, but not in the traditional lab. Results indicate that the amount of time students spend on intergroup interactions may depend on the lab curriculum itself, the time of day of the section, and/or the student population of the section. Still, instructors can encourage collaboration between lab groups through direct prompts, but such prompts need to be repeated throughout the semester.

In the summer of 2020, due to COVID-19, institutions either canceled or remotely hosted their research experience for undergraduates (REU) programs. We carried out a 16-week longitudinal study examining the impact of these fully remote research experiences on mentees’ psychosocial gains (e.g., identity). We studied the phenomenon of a remote research experience from the standpoint of the mentees ($N=10$) and their mentors ($N=8$), who were each interviewed seven and three times, respectively (94 total interviews). All mentees reported that this experience was highly beneficial through different factors such as other recognition and self-recognition, which led to their development of a sense of belonging, self-efficacy, and identity despite working remotely. Then, we synthesize these results with prior literature and develop a framework showing how different experiences and constructs affect the physics and researcher identity development. Gaining a greater understanding regarding factors leading to the growth of psychosocial gains may help REU coordinators and REU mentors to redesign their undergraduate research program and provide the support that their mentees’ need to have a positive undergraduate research experience.

This paper describes a comprehensive review of 31 quasi or experimental research studies from the past decade on the effect of PhET simulations on students’ conceptual understanding of physics. Two questions guided the review: (i) To what extent do PhET simulations enhance students’ conceptual understanding of physics? (ii) What are the best ways to use PhET simulations to enhance conceptual understanding of physics? The reviewed literature provides robust evidence that PhET simulations can significantly enhance students’ conceptual understanding of physics and can be integrated into many active learning instructional environments. The paper also points out gaps and directions of future research and suggests that educators integrate PhET simulations in physics to create more meaningful learning.

We present a model for sharing quantitative data in the field of physics education research and use it to present a newly available dataset as an example. This model is in line with calls from across physics and science more generally to democratize data and results through open access. The model includes suggestions for data collection, creation of a data schema, and data sharing. It attends to the specific needs of the physics education research community, such as anonymization of human subjects data. As an example of this model, we use the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS) dataset, which includes over 70 000 responses to the E-CLASS survey. These data cover 133 institutions, 599 unique courses, and 204 instructors, and was collected between 2016 and 2019. These data are made available at the time of publication and can be used freely, without the need of any institutional review board approval.