We developed a web-based tool to provide students with access to old exam problems and solutions. By controlling the order in which students saw the problems, as well as their access to solutions, we obtained data about student learning by studying old exam problems. Our data suggest that in general students learn from doing old exam problems, and that having access to the problem solutions increases their learning. However, the data also suggest the depth of learning may be relatively shallow. In addition, the data show that doing old exam problems provides important formative assessment about the student’s overall preparedness for the exam and their particular areas of strength and weakness.

We describe an inquiry-based course in physics and chemistry for preservice K-8 teachers developed at California State University Fullerton. The course is one of three developed primarily to enhance the science content understanding of prospective teachers. The course incorporates a number of innovative instructional strategies and is somewhat unusual for its interdisciplinary focus. We describe the course structure in detail, providing examples of course materials and assessment strategies. Finally, we provide research data illustrating both the need for the course and the effectiveness of the course in developing student understanding of selected topics. Student responses to various questions reflect a lack of understanding of many relatively simple physical science concepts, and a level of performance that is usually lower than that in comparable courses serving a general education audience. Additional data suggest that course activities improve student understanding of selected topics, often dramatically.

In this paper we present the results of two experiments designed to understand how physics students’ learning of the concept of refraction is influenced by the cognitive phenomenon of “specificity.” In both experiments participants learned why light bends as it travels from one optical medium to another with an analogy made to a car driving from paved road into mud and vice versa. They then learned how to qualitatively draw the direction of refracted light rays with an example of a glass prism. One group learned with a rectangular prism example while a second group learned with a triangular prism example. In a transfer test, the participants revealed how, even when they seemed able to implement the refraction concept, their responses were biased by the example they had seen. Participants frequently violated the refraction principle they had just learned (reversing the bend direction) in order to make sure their response matched the surface features of their learning example. This tended to happen when their test question looked superficially similar to their learning example. We discuss the implications of these results for physics instruction.

We investigate student confusion of concepts of electric and magnetic force. At various times during a traditional university-level course, we administered a series of simple questions about the direction of force on a charged particle moving through either an electric or a magnetic field. We find that after electric force instruction but before magnetic force instruction most students answer electric force questions correctly, and we replicate well-known results that many students incorrectly answer that magnetic forces are in the same direction as the magnetic field. After magnetic force instruction, most students answer magnetic force questions correctly, but surprisingly many students incorrectly answer that electric forces are perpendicular to electric fields, as would happen if a student confused electric forces with magnetic forces. As a further indication of interference between electric and magnetic concepts, we also find that students’ responses depend on whether electric or magnetic force questions are posed first, and this effect depends on whether electric or magnetic force was most recently taught.

Novice problem solvers are rather sensitive to surface problem features, and they often resort to trial and error formula matching rather than identifying an appropriate solution approach. These observations have been interpreted to imply that novices structure their knowledge according to surface features rather than according to problem type categories. However, it may also be the case that novices do know problem types, but cannot map the problem at hand to a known type, because they fail to create a sufficiently well-elaborated problem representation. This study aims to distinguish between these explanations. In this study novice physics students at high and low levels of proficiency completed two problem-sorting tasks from the domain of electricity and magnetism, one with and one without elaboration support. Results confirm that these students do distinguish problem types in accordance with their required solution approaches, and that their problem-sorting performance improves with elaboration support. Therefore, it was concluded that their major difficulty lies in the process of matching concrete problems to a proper category. Within-group analysis revealed that the performance of proficient novices clearly improved with elaboration support, whereas the effect for less proficient novices remained inconclusive. The latter finding is explained from the less proficient novices’ problem representations being too fragmented to integrate new information. These results suggest that, in order to promote schema-based problem solving, instruction in the domain of electricity and magnetism should be based not so much on restructuring the conceptual knowledge base but rather on enriching situational knowledge.

We have been piloting web-based multimedia learning modules (MLMs), developed by the Physics Education Research Group at the University of Illinois at Urbana Champaign (UIUC), as a “prelecture assignment” in several introductory physics courses at California State Polytechnic University at Pomona. In this study, we report the results from a controlled study utilizing modules on electricity and magnetism as a part of a blended hybrid-online course. We asked students in the experimental section to view the MLMs prior to attending the face-to-face class, and to make sure this would not result in additional instructional time, we reduced the weekly class time by one-third. We found that despite reduced class time, student-learning outcomes were not hindered; in fact, the implementation of the UIUC MLMs resulted in a positive effect on student performance on conceptual tests and classroom discussion questions.

We measured mastery and retention of conceptual understanding of quantum mechanics in a modern physics course. This was studied for two equivalent cohorts of students taught with different pedagogical approaches using the Quantum Mechanics Conceptual Survey. We measured the impact of pedagogical approach both on the original conceptual learning and on long-term retention. The cohort of students who had a very highly rated traditional lecturer scored 19% lower than the equivalent cohort that was taught using interactive engagement methods. However, the amount of retention was very high for both cohorts, showing only a few percent decrease in scores when retested 6 and 18 months after completion of the course and with no exposure to the material in the interim period. This high level of retention is in striking contrast to the retention measured for more factual learning from university courses and argues for the value of emphasizing conceptual learning.

Effective physics instruction benefits from respecting the physics ideas that introductory students bring into the classroom. We argue that it is similarly beneficial to respect the teaching ideas that novice physics instructors bring to their classrooms. We present a case study of a tutorial teaching assistant (TA), Alan. When we first examined Alan’s teaching, we focused our attention on the mismatch between his actions and those advocated by the TA instructors. Further study showed us that Alan cared about helping his students and that his teaching was well integrated with his beliefs about how students learn physics and how teachers can best assist students. Learning about Alan’s beliefs and motivations changed our thinking about what might constitute effective professional development for Alan and other TAs. We advocate a new perspective on TA professional development: one in which TAs are seen as partners in the endeavor of educating students and one that seeks to find and build upon productive elements in their beliefs.

Students’ attitudes and approaches to problem solving in physics can profoundly influence their motivation to learn and development of expertise. We developed and validated an Attitudes and Approaches to Problem Solving survey by expanding the Attitudes toward Problem Solving survey of Marx and Cummings and administered it to physics graduate students. Comparison of their responses to the survey questions about problem solving in their own graduate-level courses vs problem solving in the introductory physics courses provides insight into their expertise in introductory and graduate-level physics. The physics graduate students’ responses to the survey questions were also compared with those of introductory physics and astronomy students and physics faculty. We find that, even for problem solving in introductory physics, graduate students’ responses to some survey questions are less expertlike than those of the physics faculty. Comparison of survey responses of graduate students and introductory students for problem solving in introductory physics suggests that graduate students’ responses are in general more expertlike than those of introductory students. However, survey responses suggest that graduate-level problem solving by graduate students on several measures has remarkably similar trends to introductory-level problem solving by introductory students.

This paper summarizes variations in instructors’ implementation practices during Peer Instruction (PI) and shows how these differences in practices shape different norms of classroom interaction. We describe variations in classroom norms along three dimensions of classroom culture that are integral to Peer Instruction, emphasis on: (1) faculty-student collaboration, (2) student-student collaboration, and (3) sense-making vs answer-making. Based on interpretations by an observing researcher, we place three different PI classrooms along a continuum representing a set of possible norms. We then check these interpretations against students’ perceptions of these environments from surveys collected at the end of the term. We find significant correspondence between the researchers’ interpretations and students’ perceptions of Peer Instruction in these environments. We find that variation in faculty practices can set up what students perceive as discernibly different norms. For interested instructors, concrete classroom practices are described that appear to encourage or discourage these norms.

We describe a methodology for identifying evidence for the use of three types of scientific reasoning. In two case studies of high school physics classes, we used this methodology to identify multiple instances of students using analogies, extreme cases, and Gedanken experiments. Previous case studies of expert scientists have indicated that these processes can be central during scientific model construction; here we code for their spontaneous use by students. We document evidence for numerous instances of these forms of reasoning in these classes. Most of these instances were associated with motion- and force-indicating depictive gestures, which we take as one kind of evidence for the use of animated mental imagery. Altogether, this methodology shows promise for use in highlighting the role of nonformal reasoning in student learning and for investigating the possible association of animated mental imagery with scientific reasoning processes.

The Quantum Mechanics Conceptual Survey (QMCS) is a 12-question survey of students’ conceptual understanding of quantum mechanics. It is intended to be used to measure the relative effectiveness of different instructional methods in modern physics courses. In this paper, we describe the design and validation of the survey, a process that included observations of students, a review of previous literature and textbooks and syllabi, faculty and student interviews, and statistical analysis. We also discuss issues in the development of specific questions, which may be useful both for instructors who wish to use the QMCS in their classes and for researchers who wish to conduct further research of student understanding of quantum mechanics. The QMCS has been most thoroughly tested in, and is most appropriate for assessment of (as a posttest only), sophomore-level modern physics courses. We also describe testing with students in junior quantum courses and graduate quantum courses, from which we conclude that the QMCS may be appropriate for assessing junior quantum courses, but is not appropriate for assessing graduate courses. One surprising result of our faculty interviews is a lack of faculty consensus on what topics should be taught in modern physics, which has made designing a test that is valued by a majority of physics faculty more difficult than expected.

This study examined the written work of students in the introductory calculus-based electricity and magnetism course at the University of Arkansas. The students’ solutions to hourly exams were divided into a small set of countable features organized into three major categories, mathematics, language, and graphics. Each category was further divided into subfeatures. The total number of features alone explained more than 30% of the variance in exam scores and from 9% to 15% of the variance in conceptual posttest scores. If all features and subfeatures are used, between 44% and 49% of the variance in exam scores is explained and between 22% and 28% of the variance in conceptual posttest scores. The use of language is consistently positively correlated with both exam performance and conceptual understanding.

The widely held constructivist view of learning advocates student engagement via interactivity. Within the physics education research community, several specific interactive strategies have been developed to enhance conceptual understanding. One such strategy, the Interactive Lecture Demonstration (ILD) is designed for large lecture classes and, if measured using specific conceptual surveys, is purported to provide learning gains of up to 80%. This paper reports on learning gains for two different Projects over ten years. In Project 1, the ILDs were implemented from 1999 to 2001 with students who had successfully completed senior high school physics. The learning gains for students not exposed to the ILDs were in the range 13% to 16% while those for students exposed to the ILDs was 31% to 50%. In Project 2, the ILDs were implemented from 2007 to 2009 with students who had not studied senior high school physics. Since the use of ILDs in Project 1 had produced positive results, ethical considerations dictated that all students be exposed to ILDs. The learning gains were from 28% to 42%. On the one hand it is pleasing to note that there is an increase in learning gains, yet on the other, we note that the gains are nowhere near the claimed 80%. This paper also reports on teacher experiences of using the ILDs, in Project 2.

This study explores what introductory physics students actually look at when studying worked-out examples. Our classroom experiences indicate that introductory physics students neither discuss nor refer to the conceptual information contained in the text of worked-out examples. This study is an effort to determine to what extent students incorporate the textual information into the way they study. Student eye-gaze patterns were recorded as they studied the examples to aid them in solving a target problem. Contrary to our expectations from classroom interactions, students spent $40\pm 3\mathrm{\%}$ of their gaze time reading the textual information. Their gaze patterns were also characterized by numerous jumps between corresponding mathematical and textual information, implying that they were combining information from both sources. Despite this large fraction of time spent reading the text, student recall of the conceptual information contained therein remained very poor. We also found that having a particular problem in mind had no significant effects on the gaze-patterns or conceptual information retention.

This paper extends prior research on student use of computer simulations (sims) to engage with and explore science topics, in this case wave interference. We describe engaged exploration; a process that involves students actively interacting with educational materials, sense making, and exploring primarily via their own questioning. We analyze interviews with college students using PhET sims in order to demonstrate engaged exploration, and to identify factors that can promote this type of inquiry. With minimal explicit guidance, students explore the topic of wave interference in ways that bear similarity to how scientists explore phenomena. PhET sims are flexible tools which allow students to choose their own learning path, but also provide constraints such that students’ choices are generally productive. This type of inquiry is supported by sim features such as concrete connections to the real world, representations that are not available in the real world, analogies to help students make meaning of and connect across multiple representations and phenomena, and a high level of interactivity with real-time, dynamic feedback from the sim. These features of PhET sims enable students to pose questions and answer them in ways that may not be supported by more traditional educational materials.

The learning outcome of a physics laboratory course for medical students was examined in an interdisciplinary field study and discussed for the electrical physiology (“Propagation of Excitation and Nerve Cells”). At the Ludwig-Maximilians-University of Munich (LMU) at a time about 300 medicine students were assessed in two successive years. Students from the control group worked with standard experiments, while students from the treatment group performed newly developed “addressee-specific” experiments, designed to guide students to transfer physics knowledge to physiological problems. The assessment took place within the laboratory course on physiology, after the students had finished their laboratory classes in physics, and consisted of the construction of a concept map with additional multiple choice questions. The results showed that standard physics experiments are not adequate for teaching students to transfer physical principles to physiology. Introducing new addressee-specific experiments enriched the physics laboratory course by improving student attitudes toward physics and demonstrating better ability of students to relate concepts of physics and medicine, and overall to improve their understanding of the physics taught in the course.