[This paper is part of the Focused Collection on Upper Division Physics Courses.] Standardized assessment tests that allow researchers to compare the performance of students under various curricula are highly desirable. There are several research-based conceptual tests that serve as instruments to assess and identify students’ difficulties in lower-division courses. At the upper-division level assessing students’ difficulties is a more challenging task. Although several research groups are currently working on such tests, their reliability and validity are still under investigation. We analyze the results of the Colorado Upper-Division Electrostatics diagnostic from Oregon State University and compare it with data from the University of Colorado. In particular, we show potential shortcomings in the Oregon State University curriculum regarding separation of variables and boundary conditions, as well as uncover weaknesses of the rubric to the free-response version of the diagnostic. We also demonstrate how the diagnostic can be used to obtain information about student learning during a gap in instruction. Our work complements and extends the previous findings from the University of Colorado by highlighting important differences in student learning that may be related to the curriculum, illuminating difficulties with the rubric for certain problems and verifying decay in post-test results over time.

[This paper is part of the Focused Collection on Upper Division Physics Courses.] Most introductory quantum physics instructors would agree that transitioning students from classical to quantum thinking is an important learning goal, but may disagree on whether or how this can be accomplished. Although (and perhaps because) physicists have long debated the physical interpretation of quantum theory, many instructors choose to avoid emphasizing interpretive themes; or they discuss the views of scientists in their classrooms, but do not adequately attend to student interpretations. In this synthesis and extension of prior work, we demonstrate the following: (i) instructors vary in their approaches to teaching interpretive themes; (ii) different instructional approaches have differential impacts on student thinking; and (iii) when student interpretations go unattended, they often develop their own (sometimes scientifically undesirable) views. We introduce here a new modern physics curriculum that explicitly attends to student interpretations, and provide evidence-based arguments that doing so helps them to develop more consistent interpretations of quantum phenomena, more sophisticated views of uncertainty, and greater interest in quantum physics.

[This paper is part of the Focused Collection on Upper Division Physics Courses.] We present results of our investigation into student understanding of the physical significance and utility of the Boltzmann factor in several simple models. We identify various justifications, both correct and incorrect, that students use when answering written questions that require application of the Boltzmann factor. Results from written data as well as teaching interviews suggest that many students can neither recognize situations in which the Boltzmann factor is applicable nor articulate the physical significance of the Boltzmann factor as an expression for multiplicity, a fundamental quantity of statistical mechanics. The specific student difficulties seen in the written data led us to develop a guided-inquiry tutorial activity, centered around the derivation of the Boltzmann factor, for use in undergraduate statistical mechanics courses. We report on the development process of our tutorial, including data from teaching interviews and classroom observations of student discussions about the Boltzmann factor and its derivation during the tutorial development process. This additional information informed modifications that improved students’ abilities to complete the tutorial during the allowed class time without sacrificing the effectiveness as we have measured it. These data also show an increase in students’ appreciation of the origin and significance of the Boltzmann factor during the student discussions. Our findings provide evidence that working in groups to better understand the physical origins of the canonical probability distribution helps students gain a better understanding of when the Boltzmann factor is applicable and how to use it appropriately in answering relevant questions.

[This paper is part of the Focused Collection on Upper Division Physics Courses.] This study concentrates on evaluating the consistency of upper-division students’ use of the second law of thermodynamics at macroscopic and microscopic levels. Data were collected by means of a paper and pencil test ($N=48$) focusing on the macroscopic and microscopic features of the second law concerned with heat transfer processes. The data analysis was based on a qualitative content analysis where students’ responses to the macroscopic- and microscopic-level items were categorized to provide insight into the consistency of the students’ ideas; if students relied on the same idea at both levels, they ended up in the same category at both levels, and their use of the second law was consistent. The most essential finding is that a majority of students, 52%–69% depending on the physical system under evaluation, used the second law of thermodynamics consistently at macroscopic and microscopic levels; approximately 40% of the students used it correctly in terms of physics while others relied on erroneous ideas, such as the idea of conserving entropy. The most common inconsistency harbored by 10%–15% of the students (depending on the physical system under evaluation) was students’ tendency to consider the number of accessible microstates to remain constant even if the entropy was stated to increase in a similar process; other inconsistencies were only seen in the answers of a few students. In order to address the observed inconsistencies, we would suggest that lecturers should utilize tasks that challenge students to evaluate phenomena at macroscopic and microscopic levels concurrently and tasks that would guide students in their search for contradictions in their thinking.

[This paper is part of the Focused Collection on Upper Division Physics Courses.] Instructors and researchers think “thinking like a physicist” is important for students’ professional development. However, precise definitions and observational markers remain elusive. We reinterpret popular beliefs inventories in physics to indicate what physicists think thinking like a physicist entails. Through discourse analysis of upper-division students’ speech in natural settings, we show that students may appropriate or resist these elements. We identify a new element in the physicist speech genre: brief, embedded, spontaneous metacognitive talk (BESM talk). BESM talk communicates students’ in-the-moment enacted expectations about physics as a technical field and a cultural endeavor. Students use BESM talk to position themselves as physicists or nonphysicists. Students also use BESM talk to communicate their expectations in four ways: understanding, confusion, spotting inconsistencies, and generalized expectations.

[This paper is part of the Focused Collection on Upper Division Physics Courses.] As part of a longitudinal study into identity development in upper-level physics students, we used a phenomenographic research method to examine students’ perceptions of what it means to be a physicist. Analysis revealed six different categories of perception of what it means to be a physicist. We found the following themes: research and its association with being a physicist, differences in mindset, and exclusivity of accomplishments. The paper highlights how these perceptions relate to two communities of practice that the students are members of, and also highlights the importance of undergraduate research for students to transition from the physics undergraduate community of practice to the community of practicing physicists.

[This paper is part of the Focused Collection on Upper Division Physics Courses.] Compared with introductory physics, relatively little is known about the development of expertise in advanced physics courses, especially in the case of quantum mechanics. Here, we describe a framework for understanding the patterns of student reasoning difficulties and how students develop expertise in quantum mechanics. The framework posits that the challenges many students face in developing expertise in quantum mechanics are analogous to the challenges introductory students face in developing expertise in introductory classical mechanics. This framework incorporates both the effects of diversity in upper-level students’ prior preparation, goals, and motivation in general (i.e., the facts that even in upper-level courses, students may be inadequately prepared, have unclear goals, and have insufficient motivation to excel) as well as the “paradigm shift” from classical mechanics to quantum mechanics. The framework is based on empirical investigations demonstrating that the patterns of reasoning, problem-solving, and self-monitoring difficulties in quantum mechanics bear a striking resemblance to those found in introductory classical mechanics. Examples from research in quantum mechanics and introductory classical mechanics are discussed to illustrate how the patterns of difficulties are analogous as students learn to unpack the respective principles and grasp the formalism in each knowledge domain during the development of expertise. Embracing such a framework and contemplating the parallels between the difficulties in these two knowledge domains can enable researchers to leverage the extensive literature for introductory physics education research to guide the design of teaching and learning tools for helping students develop expertise in quantum mechanics.

[This paper is part of the Focused Collection on Upper Division Physics Courses.] As part of an ongoing project to examine student learning in upper-division courses in thermal and statistical physics, we have examined student reasoning about entropy and the second law of thermodynamics. We have examined reasoning in terms of heat transfer, entropy maximization, and statistical treatments of multiplicity and probability. In this paper, we describe student responses in interviews focused on the approach of macroscopic systems to thermal equilibrium. Our data suggest that students do not use a single simple model of entropy, but rather use a variety of conceptual resources. Individual students frequently shifted between resources, in some cases leading to contradictory predictions. Among the resources that students employed were some that have been previously described in the literature, including inappropriate use of conservation. However, our results suggest that student use of resources connected to disorder are neither simple nor monolithic. For example, many students used a previously unreported association between the equilibrium state of a system and an increase in order, rather than disorder.

[This paper is part of the Focused Collection on Upper Division Physics Courses.] Learning advanced physics, in general, is challenging not only due to the increased mathematical sophistication but also because one must continue to build on all of the prior knowledge acquired at the introductory and intermediate levels. In addition, learning quantum mechanics can be especially challenging because the paradigms of classical mechanics and quantum mechanics are very different. Here, we review research on student reasoning difficulties in learning upper-level quantum mechanics and research on students’ problem-solving and metacognitive skills in these courses. Some of these studies were multiuniversity investigations. The investigations suggest that there is large diversity in student performance in upper-level quantum mechanics regardless of the university, textbook, or instructor, and many students in these courses have not acquired a functional understanding of the fundamental concepts. The nature of reasoning difficulties in learning quantum mechanics is analogous to reasoning difficulties found via research in introductory physics courses. The reasoning difficulties were often due to overgeneralizations of concepts learned in one context to another context where they are not directly applicable. Reasoning difficulties in distinguishing between closely related concepts and in making sense of the formalism of quantum mechanics were common. We conclude with a brief summary of the research-based approaches that take advantage of research on student difficulties in order to improve teaching and learning of quantum mechanics.

[This paper is part of the Focused Collection on Upper Division Physics Courses.] We report on several specific student difficulties regarding the second law of thermodynamics in the context of heat engines within upper-division undergraduate thermal physics courses. Data come from ungraded written surveys, graded homework assignments, and videotaped classroom observations of tutorial activities. Written data show that students in these courses do not clearly articulate the connection between the Carnot cycle and the second law after lecture instruction. This result is consistent both within and across student populations. Observation data provide evidence for myriad difficulties related to entropy and heat engines, including students’ struggles in reasoning about situations that are physically impossible and failures to differentiate between differential and net changes of state properties of a system. Results herein may be seen as the application of previously documented difficulties in the context of heat engines, but others are novel and emphasize the subtle and complex nature of cyclic processes and heat engines, which are central to the teaching and learning of thermodynamics and its applications. Moreover, the sophistication of these difficulties is indicative of the more advanced thinking required of students at the upper division, whose developing knowledge and understanding give rise to questions and struggles that are inaccessible to novices.

[This paper is part of the Focused Collection on Upper Division Physics Courses.] The use of validated conceptual assessments alongside conventional course exams to measure student learning in introductory courses has become standard practice in many physics departments. These assessments provide a more standard measure of certain learning goals, allowing for comparisons of student learning across instructors, semesters, institutions, and pedagogies. Researchers at the University of Colorado Boulder have developed several similar assessments designed to target the more advanced physics of upper-division classical mechanics, electrostatics, quantum mechanics, and electrodynamics courses. Here, we synthesize the existing research on our upper-division assessments and discuss some of the barriers and challenges associated with their development, validation, and implementation as well as some of the strategies we have used to overcome these barriers.

[This paper is part of the Focused Collection on Upper Division Physics Courses.] Students learning to separate variables in order to solve a differential equation have multiple ways of correctly doing so. The procedures involved in separation include division or multiplication after properly grouping terms in an equation, moving terms (again, at times grouped) from one location on the page to another, or simply carrying out separation as a single act without showing any steps. We describe student use of these procedures in terms of Hammer’s resources, showing that each of the previously listed procedures is its own “piece” of a larger problem solving activity. Our data come from group examinations of students separating variables while solving an air resistance problem in an intermediate mechanics class. Through detailed analysis of four groups of students, we motivate that the mathematical procedures are resources and show the issues that students must resolve in order to successfully separate variables. We use this analysis to suggest ways in which new resources (such as separation) come to be.

[This paper is part of the Focused Collection on Upper Division Physics Courses.] We review and extend existing frameworks on modeling to develop a new framework that describes model-based reasoning in introductory and upper-division physics laboratories. Constructing and using models are core scientific practices that have gained significant attention within K–12 and higher education. Although modeling is a broadly applicable process, within physics education, it has been preferentially applied to the iterative development of broadly applicable principles (e.g., Newton’s laws of motion in introductory mechanics). A significant feature of the new framework is that measurement tools (in addition to the physical system being studied) are subjected to the process of modeling. Think-aloud interviews were used to refine the framework and demonstrate its utility by documenting examples of model-based reasoning in the laboratory. When applied to the think-aloud interviews, the framework captures and differentiates students’ model-based reasoning and helps identify areas of future research. The interviews showed how students productively applied similar facets of modeling to the physical system and measurement tools: construction, prediction, interpretation of data, identification of model limitations, and revision. Finally, we document students’ challenges in explicitly articulating assumptions when constructing models of experimental systems and further challenges in model construction due to students’ insufficient prior conceptual understanding. A modeling perspective reframes many of the seemingly arbitrary technical details of measurement tools and apparatus as an opportunity for authentic and engaging scientific sense making.

[This paper is part of the Focused Collection on Upper Division Physics Courses.] The time evolution of quantum states is arguably one of the more difficult ideas in quantum mechanics. In this article, we report on results from an investigation of student understanding of this topic after lecture instruction. We demonstrate specific problems that students have in applying time dependence to quantum systems and in recognizing the key role of the energy eigenbasis in determining the time dependence of wave functions. Through analysis of student responses to a set of four interrelated tasks, we categorize some of the difficulties that underlie common errors. The conceptual and reasoning difficulties that have been identified are illustrated through student responses to four sets of questions administered at different points in a junior-level course on quantum mechanics. Evidence is also given that the problems persist throughout undergraduate instruction and into the graduate level.

[This paper is part of the Focused Collection on Upper Division Physics Courses.] Energy measurements play a fundamental role in the theory of quantum mechanics, yet there is evidence that the underlying concepts are difficult for many students, even after all undergraduate instruction. We present results from an investigation into student ability to determine the possible energies that can be measured for a given wave function and Hamiltonian, to determine the probabilities of each energy measurement and how they depend on time, and to recognize how a measurement of energy affects the state. By analyzing student responses to open-ended questions, we identify five broad, interrelated sets of conceptual and reasoning difficulties related to energy measurements. Data are drawn from sophomore-, junior-, and graduate-level quantum mechanics courses. Particular attention is paid to incorrect ideas that persist across all levels.

[This paper is part of the Focused Collection on Upper Division Physics Courses.] In response to the need for a scalable, institutionally supported model of educational change, the Science Education Initiative (SEI) was created as an experiment in transforming course materials and faculty practices at two institutions—University of Colorado Boulder (CU) and University of British Columbia. We find that this departmentally focused model of change, which includes an explicit focus on course transformation as supported by a discipline-based postdoctoral education specialist, was generally effective in impacting courses and faculty across the institution. In CU’s Department of Physics, the SEI effort focused primarily on upper-division courses, creating high-quality course materials, approaches, and assessments, and demonstrating an impact on student learning. We argue that the SEI implementation in the CU Physics Department, as compared to that in other departments, achieved more extensive impacts on specific course materials, and high-quality assessments, due to guidance by the physics education research group—but with more limited impact on the departmental faculty as a whole. We review the process and progress of the SEI Physics at CU and reflect on lessons learned in the CU Physics Department in particular. These results are useful in considering both institutional and faculty-led models of change and course transformation.

[This paper is part of the Focused Collection on Upper Division Physics Courses.] The formalism of quantum mechanics includes a rich collection of representations for describing quantum systems, including functions, graphs, matrices, histograms of probabilities, and Dirac notation. The varied features of these representations affect how computations are performed. For example, identifying probabilities of measurement outcomes for a state described in Dirac notation may involve identifying expansion coefficients by inspection, but if the state is described as a function, identifying those expansion coefficients often involves performing integrals. In this study, we focus on three notational systems: Dirac notation, algebraic wave-function notation, and matrix notation. These quantum notations must include information about basis states and their associated complex probability amplitudes. In this theory paper, we identify four structural features of quantum notations, which we term individuation, degree of externalization, compactness, and symbolic support for computational rules. We illustrate how student reasoning interacts with these structural features with episodes from interviews with advanced undergraduate physics majors reasoning about a superposition state of an infinite square well system. We find evidence of the students coordinating different notations through the use of Dirac notation, using an expression in Dirac notation to guide their work in another notation. These uses are supported by the high degree of individuation, compactness, and symbolic support for computation and the moderate degree of externalization provided by Dirac notation.

[This paper is part of the Focused Collection on Upper Division Physics Courses.] We present a study of active learning pedagogies in an upper-division physics course. This work was guided by the principle of deliberate practice for the development of expertise, and this principle was used in the design of the materials and the orchestration of the classroom activities of the students. We present our process for efficiently converting a traditional lecture course based on instructor notes into activities for such a course with active learning methods. Ninety percent of the same material was covered and scores on common exam problems showed a 15% improvement with an effect size greater than 1 after the transformation. We observe that the improvement and the associated effect size is sustained after handing off the materials to a second instructor. Because the improvement on exam questions was independent of specific problem topics and because the material tested was so mathematically advanced and broad (including linear algebra, Fourier transforms, partial differential equations, and vector calculus), we expect the transformation process could be applied to most upper-division physics courses having a similar mathematical base.

Women currently outnumber men in obtaining undergraduate degrees but are underrepresented within STEM fields. However, women’s representation varies by STEM field, and even further by STEM subfield. One field that has held a persistent low representation of women is physics. This paper seeks to uncover the truth behind an anecdotal claim that the subfield of physics education research (PER) has a higher representation of women than physics as a whole. Graduate students in PER completed an online survey to assess their demographics, trajectory in PER, climate experiences, and goals for their research. The response rate for the survey was 68%, yielding 125 total respondents. This paper will focus on the 91 respondents enrolled in U.S. graduate programs. It was found that women make up 51% of the U.S. PER graduate students in this sample, as compared to only 19% of physics graduate students overall. Survey findings also revealed that both women and men in PER graduate programs experience similarly positive working relationships with faculty and fellow students. Last, both men and women reported building a stronger scientific workforce and becoming better teachers as goals for their PER research.