This study examined the regulation of out-of-class time invested in the academic activities associated with a physics class for 20 consecutive semesters. The academic activities of 1676 students were included in the study. Students reported investing a semester average of $6.5\pm 2.9\mathrm{h}$ out of class per week. During weeks not containing an examination, a total of $4.3\pm 2.1\mathrm{h}$ was reported which was divided between $2.5\pm 1.2\mathrm{h}$ working homework and $1.8\pm 1.4\mathrm{h}$ reading. Students reported spending $7.6\pm 4.8\mathrm{h}$ preparing for each in-semester examination. Students showed a significant correlation between the change in time invested in examination preparation ($r=-0.12$, $p<0.0001$) and their score on the previous examination. The correlation increased as the data were averaged over semester ($r=-0.70$, $p=0.0006$) and academic year ($r=-0.82$, $p=0.0039$). While significant, the overall correlation indicates a small effect size and implies that an increase of 1 standard deviation of test score (18%) was related to a decrease of 0.12 standard deviations or 0.9 h of study time. Students also modified their time invested in reading as the length of the textbook changed; however, this modification was not proportional to the size of the change in textbook length. Very little regulation of the time invested in homework was detected either in response to test grades or in response to changes in the length of homework assignments. Patterns of regulation were different for higher performing students than for lower performing students with students receiving a course grade of “C” or “D” demonstrating little change in examination preparation time in response to lower examination grades. This study suggests that homework preparation time is a fixed variable while examination preparation time and reading time are weakly mutable variables.

Problem solving, which often involves multiple steps, is an integral part of physics learning and teaching. Using the perspective of the epistemic game, we documented a specific game that is commonly pursued by students while solving mathematically based physics problems: the analytical derivation game. This game involves deriving an equation through symbolic manipulations and routine mathematical operations, usually without any physical interpretation of the processes. This game often creates cognitive obstacles in students, preventing them from using alternative resources or better approaches during problem solving. We conducted hour-long, semi-structured, individual interviews with fourteen introductory physics students. Students were asked to solve four “pseudophysics” problems containing algebraic and graphical representations. The problems required the application of the fundamental theorem of calculus (FTC), which is one of the most frequently used mathematical concepts in physics problem solving. We show that the analytical derivation game is necessary, but not sufficient, to solve mathematically based physics problems, specifically those involving graphical representations.

Student learning in instructional physics labs represents a growing area of research that includes investigations of students’ beliefs and expectations about the nature of experimental physics. To directly probe students’ epistemologies about experimental physics and support broader lab transformation efforts at the University of Colorado Boulder and elsewhere, we developed the Colorado Learning Attitudes about Science Survey for experimental physics (E-CLASS). Previous work with this assessment has included establishing the accuracy and clarity of the instrument through student interviews and preliminary testing. Several years of data collection at multiple institutions has resulted in a growing national data set of student responses. Here, we report on results of the analysis of these data to investigate the statistical validity and reliability of the E-CLASS as a measure of students’ epistemologies for a broad student population. We find that the E-CLASS demonstrates an acceptable level of both validity and reliability on measures of item and test discrimination, test-retest reliability, partial-sample reliability, internal consistency, concurrent validity, and convergent validity. We also examine students’ responses using principal component analysis and find that, as expected, the E-CLASS does not exhibit strong factors (a.k.a. categories).

Computer-automated assessment of students’ text responses to short-answer questions represents an important enabling technology for online learning environments. We have investigated the use of machine learning to train computer models capable of automatically classifying short-answer responses and assessed the results. Our investigations are part of a project to develop and test an interactive learning environment designed to help students learn introductory physics concepts. The system is designed around an interactive video tutoring interface. We have analyzed 9 with about 150 responses or less. We observe for 4 of the 9 automated assessment with interrater agreement of 70% or better with the human rater. This level of agreement may represent a baseline for practical utility in instruction and indicates that the method warrants further investigation for use in this type of application. Our results also suggest strategies that may be useful for writing activities and questions that are more appropriate for automated assessment. These strategies include building activities that have relatively few conceptually distinct ways of perceiving the physical behavior of relatively few physical objects. Further success in this direction may allow us to promote interactivity and better provide feedback in online learning systems. These capabilities could enable our system to function more like a real tutor.

An earlier investigation found that the performance of advanced students in a quantum mechanics course did not automatically improve from midterm to final exam on identical problems even when they were provided the correct solutions and their own graded exams. Here, we describe a study, which extended over four years, in which upper-level undergraduate students in a quantum physics course were given four identical problems in both the midterm exam and final exam. Approximately half of the students were given explicit incentives to correct their mistakes in the midterm exam. In particular, they could get back up to 50% of the points lost on each midterm exam problem. The solutions to the midterm exam problems were provided to all students in both groups but those who corrected their mistakes were provided the solution after they submitted their corrections to the instructor. The performance on the same problems on the final exam suggests that students who were given incentives to correct their mistakes significantly outperformed those who were not given an incentive. The incentive to correct the mistakes had greater impact on the final exam performance of students who had not performed well on the midterm exam.

Students often complain that they cannot see the relevance of what they are being taught in foundation physics classes. While revising and adjusting the curriculum and teaching are important, this study suggests it might also be useful to help students view their learning in relation to their future career aspirations. This paper reports on a study conducted with first-year students enrolled in a compulsory foundation physics unit with a history of low pass rates. Working within a “possible selves” framework, activities were designed to help students position their learning in relation to possible future lives and careers. Two cohorts of students ($N=93$) engaged in an intensive workshop comprising multiple activities relating to self and career. Self-reflection worksheets were analyzed using content analysis. The results indicate that students experience immediate benefits from these activities through self-reflection on the current self, future possible professional selves, and the role of current studies in narrowing the gap between the two.

This study investigated if and to what extent grade 8 and 9 students in Taiwan attributed materialistic properties to sound concepts, and whether they hold scientific views in parallel with materialistic views. Taiwanese middle school students are a special population since their scores in international academic comparison tests such as TIMSS and PISA are among the highest in the world. The “Sound Concept Inventory Instrument” with both materialistic and scientific statements of sound concepts was applied to explore Taiwanese students’ ideas and corresponding confidence. The results showed that although the subject of sound is taught extensively in grade 8 in Taiwan, students still hold materialistic views of sound. The participants agreed, on average, with 41% of the statements that associate sound with materialistic properties. Moreover, they were quite confident in their materialistic answers ($\text{mean}=3.27$ on a 5-point Likert scale). In parallel, they also agreed with 71% of the scientific statements in the questions. They were also confident of their scientific answers ($\text{mean}=3.21$). As for the difference between grade 8 and 9 students, it seems that in grade 9, when students do not learn about sound, there is a kind of regression to a more materialistic view of sound. The girls performed better than the boys ($t=3.59$, $p<0.001$). The paper uses Vosniadou and Brewer’s [Cogn. Sci. 18, 123 (1994).] framework theory to explain the results, and suggests some ideas for improving the teaching of sound.

This study investigates how elite Turkish high school physics students claim to approach learning physics when they are simultaneously (i) engaged in a curriculum that led to significant gains in their epistemological sophistication and (ii) subject to a high-stakes college entrance exam. Students reported taking surface (rote) approaches to learning physics, largely driven by college entrance exam preparation and therefore focused on algorithmic problem solving at the expense of exploring concepts and real-life examples more deeply. By contrast, in recommending study strategies to “Arzu,” a hypothetical student who doesn’t need to take a college entrance exam and just wants to understand physics deeply, the students focused more on linking concepts and real-life examples and on making sense of the formulas and concepts—deep approaches to learning that reflect somewhat sophisticated epistemologies. These results illustrate how students can epistemically compartmentalize, consciously taking different epistemic stances—different views of what counts as knowing and learning—in different contexts even within the same discipline.

[This paper is part of the Focused Collection on Preparing and Supporting University Physics Educators.] Undergraduate students are increasingly being used to support course transformations that incorporate research-based instructional strategies. While such students are typically selected based on strong content knowledge and possible interest in teaching, they often do not have previous pedagogical training. The current training models make use of real students or classmates role playing as students as the test subjects. We present a new environment for facilitating the practice of physics pedagogy skills, a highly immersive mixed-reality classroom simulator, and assess its effectiveness for undergraduate physics learning assistants (LAs). LAs prepared, taught, and reflected on a lesson about motion graphs for five highly interactive computer generated student avatars in the mixed-reality classroom simulator. To assess the effectiveness of the simulator for this population, we analyzed the pedagogical skills LAs intended to practice and exhibited during their lessons and explored LAs’ descriptions of their experiences with the simulator. Our results indicate that the classroom simulator created a safe, effective environment for LAs to practice a variety of skills, such as questioning styles and wait time. Additionally, our analysis revealed areas for improvement in our preparation of LAs and use of the simulator. We conclude with a summary of research questions this environment could facilitate.

[This paper is part of the Focused Collection on Preparing and Supporting University Physics Educators.] In order to promote sustained and impactful educational transformation, it is essential for change agents to understand more about faculty perceptions associated with either adopting or not adopting a research-based instructional strategy (RBIS). In this paper, we use interviews with 35 physics faculty to examine barriers and affordances to the use of the research-based instructional strategy of Peer Instruction. We found that the most common reasons faculty give for aligning their instruction with Peer Instruction is that it is not lecture and they have had positive experiences with Peer Instruction. The most common reasons faculty give for not using Peer Instruction are concerns about the time it will take, the loss of content coverage, and having had bad experiences with it. Additionally, we found the perceived barriers to be very different depending on whether the interviewee was a user of Peer Instruction or not, with nonusers being more concerned with time and users being more concerned with implementation difficulties. It is important for change agents to understand and address concerns faculty have about implementing research-based instructional strategies. Based on these results we offer four recommendations for those interested in promoting educational transformation toward research-based instructional strategies: (1) do not waste a lot of time criticizing lecture-based instruction and convincing faculty of the value of research-based strategies (they are already dissatisfied with lecture), (2) understand and address concerns faculty have about implementing active learning techniques, (3) focus on supporting and encouraging faculty experiences with RBIS, (4) address concerns faculty new to RBIS have about the time and energy needed to change.

[This paper is part of the Focused Collection on Preparing and Supporting University Physics Educators.] To help faculty use research-based materials in a more significant way, we learn about their perceived needs and desires and use this information to suggest ways for the physics education research community to address these needs. When research-based resources are well aligned with the perceived needs of faculty, faculty members will more readily take them up. We used phenomenographic interviews of ordinary physics faculty and department chairs to identify four families of issues that faculty have around research-based assessments (RBAs). First, many faculty are interested in using RBAs but need help with the practicalities of administering RBAs: how to find them, which ones there are, and how to administer them. Second, at the same time, many faculty think that RBAs are limited and do not measure many of the things they care about, or are not applicable in their classes. They want assessments to measure skills, perceptions, and specific concepts. Third, many faculty want to turn to communities of other faculty and experts to help them interpret their assessment results and suggest other ways to do assessment. They want to better understand their assessment results by comparing to others and interacting with faculty from other schools to learn about how they do assessment. Fourth, many faculty consider their courses in the broader contexts of accountability and their departments. They want help with assessment in these broader contexts. We also discuss how a faculty member’s role in their department and type of institution influence their perceived wants and needs around assessment.

[This paper is part of the Focused Collection on Preparing and Supporting University Physics Educators.] We present a newly validated and refined framework, TA-PIVOT (TA Practices In and Views Of Teaching), for examining how physics TAs talk about and how they engage in physics teaching. This work builds upon and extends prior efforts to characterize instructors’ beliefs and practices by examining both domains in parallel. We present the comprehensive framework (developed from a study of 31 total TAs) and demonstrate its utility in analyzing both interviews and classroom video observations for a sample of eight TAs. We also discuss how this framework may be used to examine variation in beliefs and practices, track the development of beliefs over time, and inform TA preparation.

[This paper is part of the Focused Collection on Preparing and Supporting University Physics Educators.] This paper provides a research-based framework for promoting institutional change in higher education. To date, most educational change efforts have focused on relatively narrow subsets of the university system (e.g., faculty teaching practices or administrative policies) and have been largely driven by implicit change logics; both of these features have limited the success of such efforts at achieving sustained, systemic change. Drawing from the literature on organizational and cultural change, our framework encourages change agents to coordinate their activities across three key levels of the university and to ground their activities in the various change perspectives that emerge from that literature. We use examples from a change project that we have been carrying out at a large research university to illustrate how our framework can be used as a basis for planning and implementing holistic change.

[This paper is part of the Focused Collection on Preparing and Supporting University Physics Educators.] The physics education research community has produced a wealth of knowledge about effective teaching and learning of college level physics. Based on this knowledge, many research-proven instructional strategies and teaching materials have been developed and are currently available to instructors. Unfortunately, these intensive research and development activities have failed to influence the teaching practices of many physics instructors. This paper describes interim results of a larger study to develop a model of designing materials for successful propagation. The larger study includes three phases, the first two of which are reported here. The goal of the first phase was to characterize typical propagation practices of education developers, using data from a survey of 1284 National Science Foundation (NSF) principal investigators and focus group data from eight disciplinary groups of NSF program directors. The goal of the second phase was to develop an understanding of successful practice by studying three instructional strategies that have been well propagated. The result of the first two phases is a tentative model of designing for successful propagation, which will be further validated in the third phase through purposeful sampling of additional well-propagated instructional strategies along with typical education development projects. We found that interaction with potential adopters was one of the key missing ingredients in typical education development activities. Education developers often develop a polished product before getting feedback, rely on mass-market communication channels for dissemination, and do not plan for supporting adopters during implementation. The tentative model resulting from this study identifies three key propagation activities: interactive development, interactive dissemination, and support of adopters. Interactive development uses significant feedback from potential adopters to develop a strong product suitable for use in many settings. Interactive dissemination uses personal interactions to reach and motivate potential users. Support of adopters is missing from typical propagation practice and is important to reduce the burden of implementation and increases the likelihood of successful adoption.

[This paper is part of the Focused Collection on Preparing and Supporting University Physics Educators.] University educators (UEs) have a long history of teaching physics not only in formal classroom settings but also in informal outreach environments. The pedagogical practices of UEs in informal physics teaching have not been widely studied, and they may provide insight into formal practices and preparation. We investigate the interactions between UEs and children in an afterschool physics program facilitated by university physics students from the University of Colorado Boulder. In this program, physics undergraduates, graduate students, and postdoctoral researchers work with K-8 children on hands-on physics activities on a weekly basis over the course of a semester. We use an activity theoretic framework as a tool to examine situational aspects of individuals’ behavior in the complex structure of the afterschool program. Using this framework, we analyze video of UE-child interactions and identify three main pedagogical modalities that UEs display during activities: instruction, consultation, and participation modes. These modes are characterized by certain language, physical location, and objectives that establish differences in UE-child roles and division of labor. Based on this analysis, we discuss implications for promoting pedagogical strategies through purposeful curriculum development and university educator preparation.

[This paper is part of the Focused Collection on Preparing and Supporting University Physics Educators.] The lack of knowledge about how to effectively spread and sustain the use of research-based instructional strategies is currently a significant barrier to the improvement of undergraduate physics education. In this paper we address this lack of knowledge by reporting on an interview study of 35 physics faculty, of varying institution types, who were self-reported users of, former users of, or knowledgeable nonusers of the research-based instructional strategy Peer Instruction. Interview questions included in this analysis focused on the faculty’s experiences, knowledge, and use of Peer Instruction, along with general questions about current and past teaching methods used by the interviewee. The primary findings include the following: (i) Faculty self-reported user status is an unreliable measure of their actual practice. (ii) Faculty generally modify specific instructional strategies and may modify out essential components. (iii) Faculty are often unaware of the essential features of an instructional strategy they claim to know about or use. (iv) Informal social interactions provide a significant communication channel in the dissemination process, in contrast to the formal avenues of workshops, papers, websites, etc., often promoted by change agents, and (v) experience with research-based strategies as a graduate student or through curriculum development work may be highly impactful. These findings indicate that educational transformation can be better facilitated by improving communication with faculty, supporting effective modification by faculty during implementation, and acknowledging and understanding the large impact of informal social interactions as a mode of dissemination.

[This paper is part of the Focused Collection on Preparing and Supporting University Physics Educators.] In this study, we analyze the experience of students in the Physics Learning Assistant (LA) program at Texas State University in terms of the existing theoretical frameworks of community of practice and physics identity, and explore the implications suggested by these theories for LA program adoption and adaptation. Regression models from physics identity studies show that the physics identity construct strongly predicts intended choice of a career in physics. The goal of our current project is to understand the details of the impacts of participation in the LA experience on participants’ practice and self-concept, in order to identify critical elements of LA program structure that positively influence physics identity and physics career intentions for students. Our analysis suggests that participation in the LA program impacts LAs in ways that support both stronger “physics student” identity and stronger “physics instructor” identity, and that these identities are reconciled into a coherent integrated physics identity. Increased comfort in interactions with peers, near peers, and faculty seems to be an important component of this identity development and reconciliation, suggesting that a focus on supporting community membership is useful for effective program design.

We have investigated whether and how a categorization of responses to questions on linear distance-time graphs, based on a study of Irish students enrolled in an algebra-based course, could be adopted and adapted to responses from students enrolled in calculus-based physics courses at universities in Flanders, Belgium (KU Leuven) and the Basque Country, Spain (University of the Basque Country). We discuss how we adapted the categorization to accommodate a much more diverse student cohort and explain how the prior knowledge of students may account for many differences in the prevalence of approaches and success rates. Although calculus-based physics students make fewer mistakes than algebra-based physics students, they encounter similar difficulties that are often related to incorrectly dividing two coordinates. We verified that a qualitative understanding of kinematics is an important but not sufficient condition for students to determine a correct value for the speed. When comparing responses to questions on linear distance-time graphs with responses to isomorphic questions on linear water level versus time graphs, we observed that the context of a question influences the approach students use. Neither qualitative understanding nor an ability to find the slope of a context-free graph proved to be a reliable predictor for the approach students use when they determine the instantaneous speed.

In this article we present several modifications of the mechanical waves conceptual survey, the most important test to date that has been designed to evaluate university students’ understanding of four main topics in mechanical waves: propagation, superposition, reflection, and standing waves. The most significant changes are (i) modification of several test questions that had some problems in their original design, (ii) standardization of the number of options for each question to five, (iii) conversion of the two-tier questions to multiple-choice questions, and (iv) modification of some questions to make them independent of others. To obtain a final version of the test, we administered both the original and modified versions several times to students at a large private university in Mexico. These students were completing a course that covers the topics tested by the survey. The final modified version of the test was administered to 234 students. In this study we present the modifications for each question, and discuss the reasons behind them. We also analyze the results obtained by the final modified version and offer a comparison between the original and modified versions. In the Supplemental Material we present the final modified version of the test. It can be used by teachers and researchers to assess students’ understanding of, and learning about, mechanical waves.