In this study, we investigated students’ understanding of concepts related to the microscopic model of gas. We thoroughly reviewed the relevant literature and conducted think alouds with students by asking them to answer open-ended questions about the kinetic molecular theory of gases. Thereafter, we transformed the open-ended questions into multiple-choice questions, whereby distractors were based on the results of the think alouds. Thus, we obtained a set of 22 questions, which constitutes our current version of the kinetic molecular theory of gases concept inventory. The inventory has been administered to 250 students from different universities in Croatia, and its content validity has been investigated trough physics teacher surveys. The results of our study not only corroborate the existence of some already known student misconceptions, but also reveal new insights about a great spectrum of students’ misconceptions that had not been reported in earlier research (e.g., misconceptions about intermolecular potential energy and molecular velocity distribution). Moreover, we identified similar distribution of students’ responses across the surveyed student groups, despite the fact that they had been enrolled in different curricular environments.

Testwiseness is defined as the set of cognitive strategies used by a student that is intended to improve his or her score on a test regardless of the test’s subject matter. Questions with elements that may be affected by testwiseness are common in physics assessments, even in those which have been extensively validated and widely used as evaluation tools in physics education research. The potential effect of several elements of testwiseness were analyzed for questions in the Force Concept Inventory (FCI) and Conceptual Survey on Electricity and Magnetism that contain distractors that are predicted to be influenced by testwiseness. This analysis was performed using data sets collected between fall 2001 and spring 2014 at one midwestern U.S. university (including over 9500 students) and between Spring 2011 and Spring 2015 at a second eastern U.S. university (including over 2500 students). Student avoidance of “none of the above” or “zero” distractors was statistically significant. The effect of the position of a distractor on its likelihood to be selected was also significant. The effects of several potential positive and negative testwiseness effects on student scores were also examined by developing two modified versions of the FCI designed to include additional elements related to testwiseness; testwiseness produced little effect post-instruction in student performance on the modified instruments.

Previous literature on learners’ epistemological beliefs about physics has almost exclusively focused on analysis of university classroom instruction and its effects on students’ views. However, little is known about other populations or factors other than classroom instruction on learners’ epistemologies. In this study, we used a cross-sequential method, combining both longitudinal and cross-sectional designs, to investigate an epistemological progression trend from preservice to in-service teachers. Six cohorts of participants were studied, who either were then attending or had completed an undergraduate teacher preparation program in physics at a major Chinese university. These cohorts were incoming freshmen, end-of-year freshmen, end-of-year sophomores, end-of-year juniors, end-of-year seniors, and 1st-year high school physics teachers who were about to enter the 2nd year of teaching. We used the Colorado Learning Attitudes about Science Survey (CLASS) as both a pretest and a post-test to gauge the changes in the participants’ epistemological views over an entire academic year. Follow-up interviews were also conducted to explore factors responsible for such changes. Results showed that the epistemological trend as measured by CLASS did not increase monotonically. Instead, there was a decrease in the epistemological trend among the incoming freshmen in their first year undergraduate studies, followed by a long stasis until the end of the senior year. Then, there was a rebound for the end-of-year seniors in their 1st year of teaching, followed by another plateau. Interviews revealed that the competitive learning environment, increased content difficulty, and unfamiliar pedagogies in college were major factors that negatively influenced incoming freshmen’s views about physics. Conversely, a role change from student to teacher and relatively easy content in high school positively impacted end-of-year seniors’ views about physics and learning.

Professional development workshops are one of the primary mechanisms used to help faculty improve their teaching, and draw in many STEM instructors every year. Although workshops serve a critical role in changing instructional practices within our community, we rarely assess workshops through careful consideration of how they engage faculty. Initial evidence suggests that workshop leaders often overlook central tenets of education research that are well established in classroom contexts, such as the role of interactivity in enabling student learning [S. Freeman et al., Proc. Natl. Acad. Sci. U.S.A. 111, 8410 (2014)]. As such, there is a need to develop more robust, evidence-based models of how best to support faculty learning in professional development contexts, and to actively support workshop leaders in relating their design decisions to familiar ideas from other educational contexts. In response to these needs, we have developed an observation tool, the real-time professional development observation tool (R-PDOT), to document the form and focus of faculty engagement during workshops. In this paper, we describe the motivation and methodological considerations behind the development of the R-PDOT, justify our decisions to highlight particular aspects of workshop sessions, and demonstrate how the R-PDOT can be used to analyze three sessions from the Physics and Astronomy New Faculty Workshop. We also justify the accessibility and potential utility of the R-PDOT output as a reflective tool using preliminary data from interviews with workshop leaders, and consider the roles the R-PDOT could play in supporting future research on faculty professional development.

This study investigated the multiple-choice test of understanding of vectors (TUV), by applying item response theory (IRT). The difficulty, discriminatory, and guessing parameters of the TUV items were fit with the three-parameter logistic model of IRT, using the parscale program. The TUV ability is an ability parameter, here estimated assuming unidimensionality and local independence. Moreover, all distractors of the TUV were analyzed from item response curves (IRC) that represent simplified IRT. Data were gathered on 2392 science and engineering freshmen, from three universities in Thailand. The results revealed IRT analysis to be useful in assessing the test since its item parameters are independent of the ability parameters. The IRT framework reveals item-level information, and indicates appropriate ability ranges for the test. Moreover, the IRC analysis can be used to assess the effectiveness of the test’s distractors. Both IRT and IRC approaches reveal test characteristics beyond those revealed by the classical analysis methods of tests. Test developers can apply these methods to diagnose and evaluate the features of items at various ability levels of test takers.

Many students struggle with the use of mathematics in physics courses. Although typically well trained in rote mathematical calculation, they often lack the ability to apply their acquired skills to physical contexts. Such student difficulties are particularly apparent in undergraduate electrodynamics, which relies heavily on the use of vector calculus. To gain insight into student reasoning when solving problems involving divergence and curl, we conducted eight semistructured individual student interviews. During these interviews, students discussed the divergence and curl of electromagnetic fields using graphical representations, mathematical calculations, and the differential form of Maxwell’s equations. We observed that while many students attempt to clarify the problem by making a sketch of the electromagnetic field, they struggle to interpret graphical representations of vector fields in terms of divergence and curl. In addition, some students confuse the characteristics of field line diagrams and field vector plots. By interpreting our results within the conceptual blending framework, we show how a lack of conceptual understanding of the vector operators and difficulties with graphical representations can account for an improper understanding of Maxwell’s equations in differential form. Consequently, specific learning materials based on a multiple representation approach are required to clarify Maxwell’s equations.

Just-in-Time Teaching (JiTT) is an instructional strategy involving feedback from students on prelecture activities in order to design in-class activities to build on the continuing feedback from students. We investigate the effectiveness of a JiTT approach, which included in-class concept tests using clickers in an upper-division quantum mechanics course. We analyze student performance on prelecture reading quizzes, in-class clicker questions answered individually, and clicker questions answered after group discussion, and compare those performances with open-ended retention quizzes administered after all instructional activities on the same concepts. In general, compared to the reading quizzes, student performance improved when individual clicker questions were posed after lectures that focused on student difficulties found via electronic feedback. The performance on the clicker questions after group discussion following individual clicker question responses also showed improvement. We discuss some possible reasons for the improved performance at various stages, e.g., from prelecture reading quizzes to postlecture clicker questions, and from individual to group clicker questions.

Improving students’ understanding of the nature of experimental physics is often an explicit or implicit goal of undergraduate laboratory physics courses. However, lab activities in traditional lab courses are typically characterized by highly structured, guided labs that often do not require or encourage students to engage authentically in the process of experimental physics. Alternatively, open-ended laboratory activities can provide a more authentic learning environment by, for example, allowing students to exercise greater autonomy in what and how physical phenomena are investigated. Engaging in authentic practices may be a critical part of improving students’ beliefs around the nature of experimental physics. Here, we investigate the impact of open-ended activities in undergraduate lab courses on students’ epistemologies and expectations about the nature of experimental physics, as well as their confidence and affect, as measured by the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS). Using a national data set of student responses to the E-CLASS, we find that the inclusion of some open-ended lab activities in a lab course correlates with more expertlike postinstruction responses relative to courses that include only traditional guided lab activities. This finding holds when examining postinstruction E-CLASS scores while controlling for the variance associated with preinstruction scores, course level, student major, and student gender.

We describe Module Analysis for Multiple Choice Responses (MAMCR), a new methodology for carrying out network analysis on responses to multiple choice assessments. This method is used to identify modules of non-normative responses which can then be interpreted as an alternative to factor analysis. MAMCR allows us to identify conceptual modules that are present in student responses that are more specific than the broad categorization of questions that is possible with factor analysis and to incorporate non-normative responses. Thus, this method may prove to have greater utility in helping to modify instruction. In MAMCR the responses to a multiple choice assessment are first treated as a bipartite, student X response, network which is then projected into a response X response network. We then use data reduction and community detection techniques to identify modules of non-normative responses. To illustrate the utility of the method we have analyzed one cohort of postinstruction Force Concept Inventory (FCI) responses. From this analysis, we find nine modules which we then interpret. The first three modules include the following: Impetus Force, More Force Yields More Results, and Force as Competition or Undistinguished Velocity and Acceleration. This method has a variety of potential uses particularly to help classroom instructors in using multiple choice assessments as diagnostic instruments beyond the Force Concept Inventory.

Model analysis provides a mechanism for representing student learning as measured by standard multiple-choice surveys. The model plot contains information regarding both how likely students in a particular class are to choose the correct answer and how likely they are to choose an answer consistent with a well-documented conceptual model. Unfortunately, Bao’s original presentation of the model plot did not include a way to represent uncertainty in these measurements. I present details of a method to add error bars to model plots by expanding the work of Sommer and Lindell. I also provide a template for generating model plots with error bars.

The existence of gender differences in student performance on conceptual assessments and their responses to attitudinal assessments has been repeatedly demonstrated. This difference is often present in students’ preinstruction responses and persists in their postinstruction responses. However, one area in which the presence of gender differences has not been extensively explored is undergraduate laboratory courses. For example, one of the few laboratory focused research-based assessments, the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS), has not been tested for the existence of gender differences in students’ responses. Here, we utilize a national data set of responses to the E-CLASS to determine if they demonstrate significant gender differences. We also investigate how these differences vary along multiple student and course demographic slices, including course level (first-year vs beyond-first-year) and major (physics vs nonphysics). We observe a gender gap in pre- and postinstruction E-CLASS scores in the aggregate data both for the overall score and for most items individually. However, for some subpopulations (e.g., beyond-first-year students) the size or even existence of the gender gap depends on another dimension (e.g., student major). We also find that for all groups the gap in postinstruction scores vanishes or is greatly reduced when controlling for preinstruction scores, course level, and student major.

In experimental physics, lab notebooks play an essential role in the research process. For all of the ubiquity of lab notebooks, little formal attention has been paid to addressing what is considered “best practice” for scientific documentation and how researchers come to learn these practices in experimental physics. Using interviews with practicing researchers, namely, physics graduate students, we explore the different experiences researchers had in learning how to effectively use a notebook for scientific documentation. We find that very few of those interviewed thought that their undergraduate lab classes successfully taught them the benefit of maintaining a lab notebook. Most described training in lab notebook use as either ineffective or outright missing from their undergraduate lab course experience. Furthermore, a large majority of those interviewed explained that they did not receive any formal training in maintaining a lab notebook during their graduate school experience and received little to no feedback from their advisors on these records. Many of the interviewees describe learning the purpose of, and how to maintain, these kinds of lab records only after having a period of trial and error, having already started doing research in their graduate program. Despite the central role of scientific documentation in the research enterprise, these physics graduate students did not gain skills in documentation through formal instruction, but rather through informal hands-on practice.

This paper describes the second year of a multi-year study on the implementation of Peer Instruction and PeerWise-inspired pedagogies in a physics methods course in a teacher education program at a large research university in Western Canada. In the first year of this study, Peer Instruction was implemented consistently in the physics methods course and teacher candidates were asked to submit five conceptual multiple-choice questions as a final assignment. In the second year of the study we incorporated PeerWise online tool to facilitate teacher candidates’ design of conceptual questions by allowing them to provide and receive feedback from their peers, and consequently improve their questions. We have found that as a result of this collaboration teacher candidates improved their pedagogical content knowledge as measured by the rubric developed for the study.

A lock-in amplifier is a versatile instrument frequently used in physics research. However, many students struggle with the basic operating principles of a lock-in amplifier which can lead to a variety of difficulties. To improve students’ understanding, we have been developing and evaluating a research-based tutorial which makes use of a computer simulation of a lock-in amplifier. The tutorial is based on a field-tested approach in which students realize their difficulties after predicting the outcome of simulated experiments involving a lock-in amplifier and check their predictions using the simulated lock-in amplifier. Then, the tutorial provides guidance and strives to help students develop a coherent understanding of the basics of a lock-in amplifier. The tutorial development involved interviews with physics faculty members and graduate students and iteration of many versions of the tutorial with professors and graduate students. The student difficulties with lock-in amplifiers and the development and evaluation of the research-based tutorial to help students develop a functional understanding of this device are discussed.

Through the transformation of undergraduate STEM courses, the Colorado Learning Assistant Program recruits and prepares talented STEM majors for careers in teaching by providing them with early, sustained teaching experiences. The research reported here compares teaching practices of K-12 teachers who served as learning assistants (LAs) as undergraduates to colleagues that were certified through the same teacher certification program but did not serve as LAs. Observations of teacher practices revealed that former LAs used significantly more reformed teaching practices than their colleagues, especially in their first year of teaching. These results suggest the LA Program serves as a valuable supplement to traditional teacher certification programs.

Interactive engagement-based (IE) physics classes have the potential to invigorate and motivate students, but students may resist or oppose the pedagogy. Understanding the major influences on student satisfaction is a key to successful implementation of such courses. In this study, we note that one of the major differences between IE and traditional physics classes lies in the interpersonal relationships between the instructor and students. Therefore, we introduce the interpersonal communication constructs of instructor credibility and facework as possible frameworks for understanding how instructors and students navigate the new space of interactions. By interpreting survey data ($N=161$ respondents in eight sections of an IE introductory algebra-based physics course), we found both frameworks to be useful in explaining variance in student ratings of their satisfaction in the course, although we are unable to distinguish at this point whether instructor credibility acts as a mediating variable between facework and course satisfaction.

The Modeling Instruction (MI) approach to introductory physics manifests significant increases in student conceptual understanding and attitudes toward physics. In light of these findings, we investigated changes in student self-efficacy while considering the construct’s contribution to the career-decision making process. Students in the Fall 2014 and 2015 MI courses at Florida International University exhibited a decrease on each of the sources of self-efficacy and overall self-efficacy ($N=147$) as measured by the Sources of Self-Efficacy in Science Courses-Physics (SOSESC-P) survey. This held true regardless of student gender or ethnic group. Given the highly interactive nature of the MI course and the drops observed on the SOSESC-P, we chose to further explore students’ changes in self-efficacy as a function of three centrality measures (i.e., relational positions in the classroom social network): inDegree, outDegree, and PageRank. We collected social network data by periodically asking students to list the names of peers with whom they had meaningful interactions. While controlling for PRE scores on the SOSESC-P, bootstrapped linear regressions revealed post-self-efficacy scores to be predicted by PageRank centrality. When disaggregated by the sources of self-efficacy, PageRank centrality was shown to be directly related to students’ sense of mastery experiences. InDegree was associated with verbal persuasion experiences, and outDegree with both verbal persuasion and vicarious learning experiences. We posit that analysis of social networks in active learning classrooms helps to reveal nuances in self-efficacy development.

Teaching assistants (TAs) that lead reformed recitations and labs must understand and buy into the design of the course and the research-based instructional strategies that the course requires in order to create high-fidelity implementations. We present a model that outlines possible influences on TAs’ buy-in and their in-class actions coupled with a method, using a Real-time Instructor Observation Tool-based [E. A. West et al. Phys. Rev. ST Phys. Educ. Res. 9, 010109 (2013)] exercise, to measure the effect of these influences that is not only quicker than interviews but also allows one to quantify these effects. We use this method to measure the influences on six graduate TAs teaching algebra-based introductory mechanics and electricity and magnetism recitations and labs (“mini studios”) at the University of Central Florida. The results from the exercise are confirmed by interview responses from the TAs. We find a relatively high degree of buy-in to the design of the course, yet this is not reflected in the TAs’ actions. The TAs’ actions appear to be most influenced by student responses and expectations which do not align with the design of the course. Our study examines the effect of three influences shown in our model, and we argue that our method could be easily adapted to examine additional influences.

In a recent study, the 30-question Force Concept Inventory (FCI) was theoretically split into two 14-question “half-length” tests (HFCIs) covering the same set of concepts and producing mean scores that can be equated to those of the original FCI. The HFCIs require less administration time and reduce test-retest issues when different versions are used in pre-post testing. This study experimentally evaluates the practical validity and measurement uncertainty of the HFCIs with three different college student populations. Measured mean scores on each HFCI were within $\sim 3\%$ of each other at every university. Measured mean score differences between the HFCI and FCI were also within $\sim 3\%$. These differences are less than the value of a single question on the 30-question FCI and are not statistically significant. The overall results suggest that, in conditions similar to this study, the HFCIs can be used as alternatives to the full-length FCI when total scores or score gains are the measurement goals.