This study presents findings on the physics identity development of female students in the German Physics Olympiad who participated in an intervention designed to support their engagement in physics. Enrichment programs such as the Physics Olympiad have been found to positively impact students’ engagement and intent to pursue a career in science. However, many enrichment programs, including the Physics Olympiad, suffer from an underrepresentation of young women. The intervention investigated in this study capitalizes on gender-related research in physics education in order to explore ways in which gender equity can be raised in enrichment programs. To this end, we designed an identity-safe learning environment that facilitates participating young women’s physics identity development. For example, same-sex groupings and considerately adopted physics contents that particularly acknowledge young women’s interests (e.g., relation to medical issues and the human body) were utilized. Overall, 30 Olympians took part in a one-day intervention (13 females, 17 males). Positive effects in two important physics identity constructs, namely, interest and competence, for young women were found, while at the same time no effects were found for young men. Furthermore, the young women were more likely to participate in next year’s Physics Olympiad, compared to the overall female Physics Olympiad population. These results indicate that the careful design of an intervention based on gender research and science identity theory can support young women’s physics identity development.

We compute nodal centrality measures on the collaboration networks of students enrolled in three upper-division physics courses, usually taken sequentially, at the Colorado School of Mines. These are complex networks in which links between students indicate assistance with homework. The courses included in the study are intermediate classical mechanics, introductory quantum mechanics, and intermediate electromagnetism. By correlating these nodal centrality measures with students’ scores on homework and exams, we find four centrality measures that correlate significantly with students’ homework scores in all three courses: in-strength, out-strength, closeness centrality, and harmonic centrality. These correlations suggest that students who not only collaborate often, but also collaborate significantly with many different people tend to achieve higher grades. Centrality measures between simultaneous collaboration networks (analytical versus numerical homework collaboration) composed of the same students also correlate with each other, suggesting that students’ collaboration strategies remain relatively stable when presented with homework assignments targeting different skills. Additionally, we correlate centrality measures between collaboration networks from different courses and find that the four centrality measures with the strongest relationship to students’ homework scores are also the most stable measures across networks involving different courses. Correlations of centrality measures with exam scores were generally smaller than the correlations with homework scores, though this finding varied across courses.

This study is focused on student recognition beliefs as related to a role identity development. More specifically, using the theoretical framework of physics identity and emotional scaffolding, we investigate the impact of two types of recognizing strategies, i.e., explicit (ER) and implicit recognizing (IR), on high school students’ sense of recognition and physics identity. ER is teachers directly conveying their acknowledgment of students’ qualities or abilities, such as acknowledging good work and expressing faith in student ability, and IR is teachers indirectly acknowledging students’ qualities or abilities via assigning them a position or a task that demands those qualities or abilities, such as valuing student opinions and assigning a challenging task. Through six longitudinal surveys for one year, we trace the physics identity development of 134 students from three high school physics classes as well as aspects related to physics identity construction including interest, competence beliefs, and sense of recognition. The patterns suggest that the recognizing strategies used by the teachers relate to a positive shift in students’ sense of recognition, which in turn facilitates the development of a physics identity. The postinterviews with six students from the three classes reveal possible mechanisms by which ER and IR strategies are internalized by students. Our findings indicate that the synergy with ER and IR strategies used as well as the nature of the activities (i.e., attainable success) are critical features of effective teacher recognition that can be internalized by the student.

Prior research has established that students often underprepare for midterm examinations yet remain overconfident in their proficiency. Research concerning the testing effect has demonstrated that utilizing testing as a study strategy leads to higher performance and more accurate confidence compared to more common study strategies such as rereading or reviewing homework problems. We report on three experiments that explore the viability of using computer adaptive testing (CAT) for assessing students’ physics proficiency, for preparing students for midterm exams by diagnosing their weaknesses, and for predicting scores in midterm exams in an introductory calculus-based mechanics course for science and engineering majors. The first two experiments evaluated the reliability and validity of the CAT algorithm. In addition, we investigated the ability of the CAT test to predict performance on the midterm exam. The third experiment explored whether completing two CAT tests in the days before a midterm exam would facilitate performance on the midterm exam. Scores on the CAT tests and the midterm exams were significantly correlated and, on average, were not statistically different from each other. This provides evidence for moderate parallel-forms reliability and criterion-related validity of the CAT algorithm. In addition, when used as a diagnostic tool, CAT showed promise in helping students perform better on midterm exams. Finally, we found that the CAT tests predicted the average performance on the midterm exams reasonably well, however, the CAT tests were not as accurate as desired at predicting the performance of individual students. While CAT shows promise for practice testing, more research is needed to refine testing algorithms to increase reliability before implementing CAT for summative evaluations. In light of these findings, we believe that more research is needed comparing CAT to traditional paper-and-pencil practice tests in order to determine whether the effort needed to create a CAT system is worthwhile.

Previous studies have identified physics students’ difficulties with graph slope and area under a graph in different contexts. In this study we compared physics and nonphysics (psychology) students’ understanding of graphs; i.e., we evaluated the effects of concept (graph slope vs area under graph), type of question (qualitative vs quantitative), and context (physics vs finance) on their scores, strategies, and eye-tracking data. All students solved questions about graph slope better than the questions about area under a graph. Psychology students scored rather low on the questions about area under a graph, and physics students spent more time on questions about area under a graph than on slope questions, indicating that understanding of area under a graph is quite a difficult concept that seems unlikely to develop spontaneously. Generally, physics students had comparable scores on the qualitative and quantitative questions, whereas psychology students solved qualitative questions much better. As expected, students’ scores and eye-tracking measures indicated that problems involving physics context were easier for physics students since they typically had higher scores and shorter total and axes viewing times for physics than finance questions. Some physics students may have transferred the concepts and techniques from physics to finance because they typically scored better than psychology students on the finance questions that were novel for both groups. Analysis of student strategies showed that physics students mostly relied on strategies learned in physics courses, with strong emphasis on the use of formulas, whereas psychology students mostly used common-sense strategies, as they did not know the physics formulas. The implications of the results for teaching and learning about graphs in physics courses are also discussed.

This paper reports on the results from administering a modified version of the Introductory Astronomy Questionnaire (IAQ) to middle school students and preservice science teachers in Norway. Ranking tasks formed a key part of the instrument, and we detail a new method for analyzing ranking task data. One of our main findings was that even after instruction, a significant proportion of students held erroneous views and conceptions regarding sizes, distances, and the nature of basic astronomical entities, such as stars and planets. We argue that the commonalities between some of the issues we identified and those presented in extant studies—from a variety of countries, with samples ranging from junior high school students and undergraduates to primary school teachers—may point to deeper cognitive issues inherent in, and possibly unique to, engaging with astronomy.

Discussion forums provide a channel for students to engage with peers and course material outside of class, accessible even to commuter and nontraditional populations. Forums can build classroom community and aid learning, but students do not always take up these tools. We use network analysis to compare three semesters of forum logs from an introductory calculus-based physics course. The networks show dense structures of collaboration that differ significantly between semesters, even though aggregate participation statistics remain steady. After characterizing network structure for each semester, we correlate students’ centrality—a numeric measure of network position—with final course grade. Finally, we use a backbone extraction procedure to clean up “noise” in the network and clarify centrality-grade correlations. We find that more central network positions are positively linked with course success in the two semesters with denser forum networks. Centrality is a more reliable indicator of grade than non-network measures such as postcount. Backbone extraction destroys these correlations, suggesting that the noise is in fact signal and further analysis of the discussion transcripts is required.

In science, technology, engineering, and mathematics education there has been increased emphasis on teaching goals that include not only the learning of content knowledge but also the development of scientific reasoning skills. The Lawson classroom test of scientific reasoning (LCTSR) is a popular assessment instrument for scientific reasoning. Through large scale applications, however, several issues have been observed regarding the validity of the LCTSR. This paper will review the literature on the assessment of scientific reasoning and provide a detailed analysis of the current version of LCTSR in regards to its validity and measurement features. The results suggest that the LCTSR is a practical tool for assessing a unidimensional scale of scientific reasoning. The instrument has a good overall reliability for the whole test. However, inspections of individual question pairs reveal a variety of validity concerns for five of the total twelve question pairs. These five question pairs have a considerable amount of inconsistent response patterns. Qualitative analysis also indicates wide ranging question design issues. Therefore, assessment of subskills involved with the five question pairs may have less power due to their questionable validity.

This study reports on the development, validation, and administration of a 48-item multiple-choice test to assess students’ representational fluency of linear functions in a physics context (1D kinematics) and a mathematics context. The test includes three external representations: graphs, tables, and formulas, which result in six possible representational transitions between them. Moreover, four linear function types are included: negative $y$ intercept and positive slope, zero $y$ intercept and positive slope, positive $y$ intercept and negative slope, and positive $y$ intercept and positive slope. The test is administered to 385 students aged 14–15 in the 9th grade from 13 schools in Flanders (Belgium) and—after validation—is analyzed by means of generalized estimating equations (GEE). The results show a significant main effect for all design factors and a significant interaction effect between representational transition and function type, as well as additional interaction effects with the gender of the respondents. Furthermore, representational transitions which include a formula prove to be significantly more difficult; in particular for the directly proportional function type, the transition to a formula stands out from the analysis. Mean accuracies in physics are significantly lower compared to mathematics. Function types with negative values for either $y$ intercept or slope also result in significantly lower mean accuracies indicating the difficulty students have with negative numbers in linear functions. A distractor analysis of the incorrect answers chosen by the students reveals three distinct dominant errors: concept switching, sign switching, and switching of the directly proportional function type and the function type with positive $y$ intercept and positive slope.

Assessment instruments composed of two-tier multiple choice (TTMC) items are widely used in science education as an effective method to evaluate students’ sophisticated understanding. In practice, however, there are often concerns regarding the common scoring methods of TTMC items, which include pair scoring and individual scoring schemes. The pair-scoring method is effective in suppressing “false positives” at the cost of missing possible middle states of progression of student understanding. On the other hand, the individual scoring method captures an undistinguished middle level but is prone to rewarding guessing, which leads to “false positives”. In addition, this middle level does not discriminate the progression between knowing the result and explaining the reason, which limits the capacity of drawing meaningful implications from the assessment outcomes. To address the concerns with the current scoring methods, it is valuable to explore new scoring method(s) that can fully utilize the information measured with TTMC items. In this study, a number of scoring models are studied using Rasch analysis on data of a popular TTMC test, the Lawson classroom test of scientific reasoning (LCTSR), collected from four considerably different populations. The results show that the model fit quality of the scoring methods varies with student population and item design. In general, there is no one-fits-all solution; however, given the new information obtained in this study, a three-step process is suggested that can guide the development of new mixed scoring models tailored for a particular population and or test. The evaluation results show that the mixed models produce the most reliable model fitting and better than average goodness of fit. Furthermore, the results in this study also confirm previous studies, which suggest that it is harder to come up with a correct explanation than to just know the answer.

Gender gaps on the most widely used conceptual inventories created by physics education researchers have been extensively studied. Most of the research exploring the consistent gender gaps has been performed at the student level using the total evaluation score; less research has been performed examining these assessments at the item level and this research has been predominately restricted to the Force Concept Inventory (FCI). Many studies have identified subsets of FCI items as unfair to either men or women. An item is fair if men and women of equal ability in conceptual physics score equally on the item. This study explored the item-level gender fairness of the Force and Motion Conceptual Evaluation (FMCE) and the Conceptual Survey of Electricity and Magnetism (CSEM). Classical test theory and differential item functioning (DIF) analysis were employed to examine item fairness. Fairness was investigated with four large post-test samples, two for the FMCE ($n_1=3016$, $n_2=3719$) and two for the CSEM ($n_1=2014$, $n_2=2657$). Men and women performed significantly differently on the majority of FMCE items but with no more than a small effect size. There were fewer items in the CSEM where men and women performed differently. Using DIF analysis, which assumes that overall test score is an accurate measure of ability, only one item in the FMCE demonstrated large DIF in both samples with that item unfair to women. One additional item showed large DIF in a single sample, also unfair to women. Only one item in the CSEM demonstrated large DIF. The item was unfair to men but this result was not consistent across all samples. The number of large DIF items identified in both the FMCE and the CSEM was substantially smaller than the number of large DIF items identified in the FCI by previous studies.

The NASA/IPAC Teacher Archive Research Program (NITARP) provides a year-long authentic astronomy research project by partnering a research astronomer with small groups of educators. NITARP has worked with a total of 103 educators since 2005. In this paper, surveys are explored that were obtained from 74 different educators, at up to four waypoints during the course of 13 months, from the class of 2010 through the class of 2017; those surveys reveal how educator participants describe the major changes and outcomes in themselves fostered by NITARP. Three-quarters of the educators self-report some or major changes in their understanding of the nature of science. The program provides educators with experience collaborating with astronomers and other educators, and forges a strong link to the astronomical research community; the NITARP community of practice encourages and reinforces these linkages. During the experience, educators get comfortable with learning complex new concepts, with $\sim 40\%$ noting in their surveys that their approach to learning has changed. Educators are provided opportunities for professional growth; at least 12% have changed career paths substantially in part due to the program, and 14% report that the experience was “life changing.” At least 60% express a desire to include richer, more authentic science activities in their classrooms. This work illuminates what benefits the program brings to its participants; the NITARP approach could be mirrored in similar professional development programs in other STEM subjects.

Federal legislation specifies equitable access to education for all students at all levels of education, including postsecondary. To explore how well the physics education research (PER) community is currently serving students who inherently vary in needs, abilities, and interests, four research-based curricula (Tutorials in Introductory Physics, Open Source Tutorials in Physics Sensemaking, Physics by Inquiry, and Next Generation Physical Science and Everyday Thinking) were compared with the Universal Design for Learning (UDL) framework. This framework originates in the education literature base and is composed of 3 guiding principles (1. Provide multiple means of representation, 2. provide multiple means of action and expression, and 3. provide multiple means for engagement) further described by 9 principles and 31 checkpoints. The UDL guidelines provide a framework for designing courses to be supportive of and accessible to all learners, taking into account variations among learners during curriculum development. Activities in these four curricula were analyzed for alignment between the in-class curricular elements and the UDL guidelines. Overall, all of the curricula aligned with two of the checkpoints: foster collaboration and community and support planning and strategy development. However, the curricula were unaligned with many of the checkpoints, specifically with regards to providing multiple means of engagement. Who we are prepared to teach indicates who we expect to participate in the physics community. We propose suggestions for modifications to existing curricula and for future curricula to better support all learners. We also argue that, if these research-based curricula do not meet federal legislative guidelines about accessibility for all students, the burden of creating an accessible environment and complying with these federal laws falls on the instructors, which could deter them from using the curricula. If we as a community want instructors to use high quality, research-based curricula, curriculum developers should prioritize supporting all learners.

Postdoc positions, intended to be advanced or continued research training in a field, are a part of the physics education research (PER) enterprise yet little is known about them. PER postdocs differ from their traditional physics counterparts in that they may have different education and research experiences. This study examined the types of postdoc positions available as well as what hiring is like. To determine the types of postdoc positions available, we used the advertisements posted in PERJobs blog. To learn more about hiring practices, interviews were conducted with both principal investigators (PIs) and current and former postdocs. Results show that many PER postdoc positions have been available since 2008, with many of these advertisements indicating that the PI will consider hiring someone with a physics or a PER or science, technology, engineering, or mathematics education background. The interviews indicate that there is no typical way for hiring PER postdocs. Some aspects that PIs consider include the background of the candidates and how well the candidates fit in with the group. Postdocs likewise consider whether they like the research group when accepting offers. For both, having ties to the PER community is important for hiring. Overall, PIs and postdocs have been satisfied. Postdocs who were originally in traditional physics have felt that being a PER postdoc has allowed them to transition to PER. In giving advice, both PIs and postdocs reiterate the importance of connecting to the community, evaluating the postdoc position as a stepping stone in the career trajectory, and holistically considering candidates.

[This paper is part of the Focused Collection on Astronomy Education Research.] This study investigates students’ perceived impacts regarding their participation in course-based undergraduate research experiences (CUREs) in astronomy. Each research experience adopted one or more projects from the Research Based Science Education for Undergraduates (RBSEU) curriculum, which teaches analysis of astronomical data coming from various national observatories. Participating students were enrolled in introductory astronomy courses at one of four universities using the curriculum. They were invited to respond to several instruments, including surveys ($N=199$), essays ($N=94$), and interviews ($N=19$). Each university implemented the curriculum differently with respect to content covered, length of instruction, and whether students’ research results were contributed to the astronomical community. We found that participation in all versions of the curriculum had the potential to significantly increase students’ perceived confidence participating in science. However, participation in experiences wherein results were contributed to the scientific community more often led to students’ nuanced perceptions of science processes, including increased understanding of the role of analysis and the utility of scientific communities and collaborations. We frame our study according to a pathway model under study by discipline-based education researchers of CUREs and explore our findings’ connections with psychological theories.

[This paper is part of the Focused Collection on Astronomy Education Research.] We examined teachers’ spatial-scientific reasoning and the alternative conceptions they held regarding Earth-space content. While participating in a professional development (PD) workshop, teachers engaged in an integrated mathematics and science project-based unit designed to foster spatial reasoning and improve lunar-related conceptual understanding. The Purdue Spatial Visualization Test-Rotation (PSVT-Rot) and the Lunar Phases Concept Inventory (LPCI) were used to assess understanding. We found the teachers held similar alternative conceptions as their students. Moreover, we discovered that teachers had limited understanding of the Earth-Moon-Sun scale, motions, and geometric configurations. To determine how teachers’ spatial-scientific confidence and ability translated to their classroom practice, we videotaped and analyzed instruction conducted by 6 teachers on an Earth-space lesson. Two teachers with the highest spatial-scientific confidence and ability had students achieving significant learning outcomes on both the PSVT-Rot and the LPCI.

[This paper is part of the Focused Collection on Astronomy Education Research.] This paper presents the first item response theory (IRT) analysis of the national data set on introductory, general education, college-level astronomy teaching using the Light and Spectroscopy Concept Inventory (LSCI). We used the difference between students’ pre- and postinstruction IRT-estimated abilities as a measure of learning gain. This analysis provides deeper insights than prior publications both into the LSCI as an instrument and into the effectiveness of teaching and learning in introductory astronomy courses. Our IRT analysis supports the classical test theory findings of prior studies using the LSCI with this population. In particular, we found that students in classes that used active learning strategies at least 25% of the time had average IRT-estimated learning gains that were approximately 1 logit larger than students in classes that spent less time on active learning strategies. We also found that instructors who want their classes to achieve an improvement in abilities of average $\mathrm{\Delta }\theta =1$ logit must spend at least 25% of class time on active learning strategies. However, our analysis also powerfully illustrates the lack of insight into student learning that is revealed by looking at a single measure of learning gain, such as average $\mathrm{\Delta }\theta$. Educators and researchers should also examine the distributions of students’ abilities pre- and postinstruction in order to understand how many students actually achieved an improvement in their abilities and whether or not a majority of students have moved to postabilities significantly greater than the national average.

[This paper is part of the Focused Collection on Astronomy Education Research.] The NASA/IPAC Teacher Archive Research Program (NITARP) partners small groups of educators with a research astronomer for a year-long authentic research project. This program aligns well with the characteristics of high-quality professional development (PD) programs and has worked with a total of 103 educators since 2005. In this paper, surveys were explored that were obtained from 74 different educators, at up to four waypoints during the course of 13 months, incorporating data from the class of 2010 through the class of 2017. This paper investigates how participating teachers describe their motivations for participating in NITARP as evidenced in these feedback forms. Analysis of self-reported data allows a mapping onto a continuum ranging from more inward focused to more outward focused; there is a shift from more inward-focused responses to more outward-focused responses. This insight into teacher motivations has implications for how the educators might be supported during their year with the program. This work provides a new way of parametrizing why educators participate in PD programs that require a considerable investment of time. NITARP, since it has many qualities of successful PD, serves as a model for similar PD programs in other STEM subjects. Likewise, the analysis method might also be useful to similarly evaluate other PD programs.

[This paper is part of the Focused Collection on Astronomy Education Research.] This qualitative study investigates astronomers’ and urban public middle school teachers’ beliefs about the characteristics of effective outreach partnerships in formal science classroom settings. Twelve astronomers and twelve science teachers participating in Baltimore Project ASTRO, a NSF grant-funded astronomer-educator partnership outreach program, were interviewed after participation using semistructured, in-depth interview techniques. Constant comparative analysis was used to analyze the interview transcripts. The findings suggest that astronomers and urban public middle school teachers believe that the characteristics of effective outreach partnerships center on the following three themes: partnership collaboration, astronomer and teacher characteristics, and astronomer and teacher dispositions. Regarding partnership collaboration, astronomers and teachers believed that establishing a relationship; maintaining communication; planning, preparing, and facilitating lessons collaboratively; and following up on lessons taught and modifying lessons for future implementation were vital characteristics for effective astronomer-educator partnerships. Concerning astronomer and teacher characteristics, effective astronomer partners were described as being willing to volunteer their time, willing to provide resources, and willing to purchase supplies. Effective educator partners were characterized as being responsible for managing the classroom and students, differentiating lessons and activities, and administering pre- and postastronomy assessments to students before and after their astronomer partner visits. In reference to astronomer and teacher dispositions, effective astronomers were prompt, able to relate to kids, exited, passionate about what they do, knowledgeable, tolerant, and easy going. Effective teachers were committed, motivated to have a volunteer astronomer in their classroom, passionate about teaching and about their students, and knowledgeable about the astronomy curriculum. The findings of this study help to provide a more comprehensive understanding of the characteristics of effective astronomer-educator partnerships in formal urban middle school science classrooms and help to provide essential guidance to all who are interested in designing and facilitating such science educational outreach programming.

[This paper is part of the Focused Collection on Astronomy Education Research.] This paper presents the cases of two doctoral students in observational astrophysics whose circumstances and experiences led them on a career trajectory out of academic research. In this article, I employ a sociocultural lens that provides insight into the dynamics of students’ experiences in astrophysics, which can in turn enrich our understandings of the lack of women in physics. I documented ethnographically two doctoral students’ experiences in a physics department at a large research university in Canada. In turn, I employed an analytic framework of figured worlds, cultural models, and identity trajectories to understand the challenges these two doctoral students faced. I use data drawn from observational field notes, interviews, and participants’ photo-narrative journals to explore the dominant cultural models of astrophysicist that were reproduced in their doctoral program. The analysis shows cultural models for recognizable astrophysicists in this doctoral program often did not fit neatly with these students’ experiences, and at times interfered with their trajectories into astrophysics careers. Additionally, results indicate that a prevailing discourse of gender neutrality and the rejection of normative femininity in astrophysics both afforded and constrained participants’ opportunities for recognition as insiders to astrophysics. However, the two participants repositioned themselves on alternative trajectories into physics teaching outside of academia, which had positive consequences for their astrophysicist identities. This study provides insights into the experiences of doctoral astrophysics that figure students’ insider or outsider identities, and the role that gender plays in the shaping of those identity and career trajectories.