The paper reports on how educational research informed and supported both the process of refinement of introductory physics laboratory instruction and student development of scientific abilities. In particular we focus on how the action research approach paradigm combined with instructional approaches such as scaffolding and formative assessment can be used to design the learning environment, investigate student learning, revise curriculum materials, and conduct subsequent assessment. As the result of the above efforts we found improvement in students’ scientific abilities over the course of three years. We suggest that the process used to improve the curriculum under study can be extended to many instructional innovations.

Physics education literature recommends using multiple representations to help students understand concepts and solve problems. However, there is little research concerning why students use the representations and whether those who use them are more successful. This study addresses these questions using free-body diagrams (diagrammatic representations used in problems involving forces) as a type of representation. We conducted a two-year quantitative and qualitative study of students’ use of free-body diagrams while solving physics problems. We found that when students are in a course that consistently emphasizes the use of free-body diagrams, the majority of them do use diagrams on their own to help solve exam problems even when they receive no credit for drawing the diagrams. We also found that students who draw diagrams correctly are significantly more successful in obtaining the right answer for the problem. Lastly, we interviewed students to uncover their reasons for using free-body diagrams. We found that high achieving students used the diagrams to help solve the problems and as a tool to evaluate their work while low achieving students only used representations as aids in the problem-solving process.

The two genders make different use of being allowed multiple tries to solve online homework problems: male students frequently attempt to immediately solve the problem, while female students are more likely to first interact with peers and teaching assistants before entering answers. More male than female students state that they use the multiple allowed attempts to enter “random stuff,” while more female than male students state that the multiple attempts allow them to explore their own problem solving approaches without worrying or being stressed out by grades.

Introductory undergraduate courses in classical physics stress a perspective that can be characterized as realist; from this perspective, all physical properties of a classical system can be simultaneously specified and thus determined at all future times. Such a perspective can be problematic for introductory quantum physics students, who must develop new perspectives in order to properly interpret what it means to have knowledge of quantum systems. We document this evolution in student thinking in part through pre- and post-instruction evaluations using the Colorado Learning Attitudes about Science Survey. We further characterize variations in student epistemic and ontological commitments by examining responses to two essay questions, coupled with responses to supplemental quantum attitude statements. We find that, after instruction in modern physics, many students are still exhibiting a realist perspective in contexts where a quantum-mechanical perspective is needed. We further find that this effect can be significantly influenced by instruction, where we observe variations for courses with differing learning goals. We also note that students generally do not employ either a realist or a quantum perspective in a consistent manner.

In this paper we compare and contrast student’s pretest/post-test performance on the Halloun-Hestenes force concept inventory (FCI) to the Thornton-Sokoloff force and motion conceptual evaluation (FMCE). Both tests are multiple-choice assessment instruments whose results are used to characterize how well a first term, introductory physics course promotes conceptual understanding. However, the two exams have slightly different content domains, as well as different representational formats; hence, one exam or the other might better fit the interests of a given instructor or researcher. To begin the comparison, we outline how to determine a single-number score for the FMCE and present ranges of normalized gains on this exam. We then compare scores on the FCI and the FMCE for approximately 2000 students enrolled in the Studio Physics course at Rensselaer Polytechnic Institute over a period of eight years (1998–2006) that encompassed significant evolution of the course and many different instructors. We found that the mean score on the FCI is significantly higher than the mean score on the FMCE, however there is a very strong relationship between scores on the two exams. The slope of a best fit line drawn through FCI versus FMCE data is approximately 0.54, and the correlation coefficient is approximately $r=0.78$, for preinstructional and postinstructional testings combined. In spite of this strong relationship, the assessments measure different normalized gains under identical circumstances. Additionally, students who scored well on one exam did not necessarily score well on the other. We use this discrepancy to uncover some subtle, but important, differences between the exams. We also present ranges of normalized gains for the FMCE in a variety of instructional settings.

We report the results of an analysis of the Texas Assessment of Knowledge and Skills (TAKS) designed to determine whether the TAKS is a valid indicator of whether students know and can do physics at the level necessary for success in future coursework, STEM careers, and life in a technological society. We categorized science items from the 2003 and 2004 10th and 11th grade TAKS by content area(s) covered, knowledge and skills required to select the correct answer, and overall quality. We also analyzed a 5000 student sample of item-level results from the 2004 11th grade exam, performing full-information factor analysis, calculating classical test indices, and determining each item's response curve using item response theory. Triangulation of our results revealed strengths and weaknesses of the different methods of analysis. The TAKS was found to be only weakly indicative of physics preparation and we make recommendations for increasing the validity of standardized physics testing.

Students in introductory physics courses are likely to have views about physics that differ from those of experts. However, students who continue to study physics eventually become experts themselves. Presumably these students either possess or develop more expertlike views. To investigate this process, the views of introductory physics students majoring in physics are compared with the views of introductory physics students majoring in engineering. In addition, the views of physics majors are assessed at various stages of degree progress. The Colorado learning attitudes about science survey is used to evaluate students’ views about physics, and students’ overall survey scores and responses to individual survey items are analyzed. Beginning physics majors are significantly more expertlike than nonmajors in introductory physics courses, and this high level of sophistication is consistent for most of undergraduate study.

A common format for assessment of learning is pretesting and post-testing. In this study, we collect student test data several times per week throughout a course, allowing for the measurement of the changes in student knowledge with a time resolution on the order of a few days. To avoid the possibility of test-retest effects, separate and quasirandom subpopulations of students are tested on a variety of tasks. We report on data taken in a calculus-based introductory E&M class populated primarily by engineering majors. Unsurprisingly for a traditional introductory course, there is little change in many conceptual questions. However, the data suggest that some student performance peaks and decays rapidly during a quarter, a pattern consistent with memory research yet unmeasurable by pretesting and post-testing. In addition, it appears that some course topics can interfere with prior knowledge, decreasing performance on questions related to earlier topics in the course.

With student numbers decreasing and traditional teaching methods having been found inefficient, it is widely accepted that alternative teaching methods need to be explored in tertiary physics education. In 2006 a different teaching environment was offered to 244 first year students with little or no prior formal instruction in physics. Students were invited to attend additional enrichment classes 1 h a week called map meetings. The focus of these classes was a different type of visual presentation of physics material called link maps. Link maps explicitly show the key concepts covered in lectures and how these interrelate to help novices establish their physics schemata. In each map meeting the link map for the different topic was interactively discussed by the researcher before the students worked on problems in groups using the link map. The class ended with the researcher going through one problem, talking aloud about how to logically attack it. The results were promising. Each week about 20% of the class voluntarily attended map meetings whereas 22% reported that they did not attend due to timetable clashes. Two questionnaires revealed that students thought the classes were helpful for gaining an overview of physics and for developing their problem solving abilities. In the final examination the 32 students who had attended at least eight out of ten map meetings achieved, on average, 9 points out of 90 better in the examination $\left(p=0.004\right)$ than a comparison group $\left(N=40\right)$ with similar academic background which had not attended map meetings. The results of this study suggest that map meetings are a valuable learning environment for physics novices. Further investigations are currently being undertaken.

Previous research [S. J. Pollock et al., Phys. Rev. ST Phys. Educ. Res. 3, 1 (2007)] showed that despite the use of interactive engagement techniques, the gap in performance between males and females on a conceptual learning survey persisted from pretest to post-test at the University of Colorado at Boulder. Such findings were counter to previously published work [M. Lorenzo et al., Am. J. Phys. 74, 118 (2006)]. This study begins by identifying a variety of other gender differences. There is a small but significant difference in the course grades of males and females. Males and females have significantly different prior understandings of physics and mathematics. Females are less likely to take high school physics than males, although they are equally likely to take high school calculus. Males and females also differ in their incoming attitudes and beliefs about physics. This collection of background factors is analyzed to determine the extent to which each factor correlates with performance on a conceptual post-test and with gender. Binned by quintiles, we observe that males and females with similar pretest scores do not have significantly different post-test scores $\left(p>0.2\right)$. The post-test data are then modeled using two regression models (multiple regression and logistic regression) to estimate the gender gap in post-test scores after controlling for these important prior factors. These prior factors account for about 70% of the observed gender gap. The results indicate that the gender gap exists in interactive physics classes at our institution but is largely associated with differences in previous physics and math knowledge and incoming attitudes and beliefs.

Most of the time, instructors of introductory physics limit their goals to students’ acquisition of basic concepts and end-of-the-chapter problem solving efficiency. They overlook the development of students’ science process abilities required for constructing scientific knowledge and approaching complex problems as scientists do. This goal is attainable and very valuable at the same time. This paper describes how learners improved their scientific abilities during the course of one semester and reports on the activities and facilitations that helped students in the process. We investigated how long it takes for novices to develop complex scientific abilities and whether the content and the context of the tasks affect the abilities that students demonstrate. We found that students need to conduct several cycles of scaffolded investigations to gain competence in the application of scientific abilities. Depending on the particular ability, a period of five to eight weeks of work is necessary to achieve it.

The modeling instruction pedagogy for the teaching of physics has been proven to be quite effective at increasing the conceptual understanding and problem-solving abilities of students to a much greater extent than that of nonmodeling students. Little research has been conducted concerning the cognitive and metacognitive skills that modeling students develop that allow for these increases. Two studies were designed to answer the following question: In what ways do the knowledge structures, metacognitive skills, and problem-solving abilities differ between modeling and nonmodeling students? In study 1, the knowledge structures developed by two groups of high school physics students taught using differing pedagogies (modeling instruction in physics and traditional methods) were determined using a card-sort task. The student’s knowledge structures were then correlated with the scores they obtained on two measures: the force concept inventory (FCI) and a problem-solving task (PS task) developed for this study. The modeling students had a more expertlike knowledge structure, while the nonmodeling students produced structures that were novicelike. In addition, the expert score correlated highly with performance on both the FCI and PS task scores demonstrating that a higher expert score predicted a higher value on each of these measures while a higher surface feature score predicted a lower score on both of these measures. In study 2, a verbal protocol design allowed for a detailed study of the problem-solving and metacognitive skills utilized by the two groups. It was determined that the skills utilized by the modeling instruction students were more expertlike. In addition, the modeling students produced significantly fewer physics errors while catching and repairing a greater percentage of their errors.

We measured what students perceive physicists to believe about physics and solving physics problems and how those perceptions differ from the students’ personal beliefs. In this study, we used a modified version of the Colorado Learning Attitudes about Science Survey which asked students to respond to each statement with both their personal belief and the response they thought a physicist would give. Students from three different types of university introductory physics courses were studied. Students who have not yet taken physics in college have a surprisingly accurate idea of what physicists believe about physics no matter what their high school background and what physics courses they choose to take in college. These ideas are largely unaffected by their college physics instruction. In contrast, students’ personal beliefs about physics differ with varying high school physics backgrounds and college physics courses in which they enroll, and these beliefs are affected by college physics instruction. Women have a larger difference between their reported personal beliefs and their perceptions of physicists’ beliefs than do men.

We investigate the interplay between mathematics and physics resources in intermediate mechanics students. In the mechanics course, the selection and application of coordinate systems is a consistent thread. At the University of Maine, students often start the course with a strong preference to use Cartesian coordinates, in accordance with their prior physics and mathematics classes. In small-group interviews and in homework help sessions, we ask students to define a coordinate system and set up the equations of motion for a simple pendulum for which polar coordinates are more appropriate. We analyze video data from several encounters using a combination of Process/Object theory and Resource Theory. We find that students sometimes persist in using an inappropriate Cartesian system. Furthermore, students often derive (rather than recall) the details of the polar coordinate system, indicating that their knowledge is far from solid. To describe our work more precisely, we define a scale of plasticity and several heuristics for defining resources and their plasticity.

Instructional techniques based on research in cognitive science and physics education have been used in physics courses to enhance student learning. While dramatic increases in conceptual understanding have been observed, students enrolled in these courses tend to move away from scientistlike views of the discipline and toward novicelike views, as measured by various assessment instruments. It has been proposed that course materials and instruction that explicitly address epistemology, the nature of science, and the nature of learning science will help students develop views more closely aligned with the views of scientists. The Physics and Everyday Thinking (PET) curriculum has specific goals for helping nonscience majors explicitly reflect on the nature of science and the nature of learning science. We show that in PET courses with small and large enrollments, shifts toward expert responses ranged from $+4\%$ to $+16.5\%$ on the Colorado Learning Attitudes about Science Survey. These results are compared to results from other studies using a variety of similar assessment instruments.

We report on a large-scale study of student learning of quantum tunneling in four traditional and four transformed modern physics courses. In the transformed courses, which were designed to address student difficulties found in previous research, students still struggle with many of the same issues found in other courses. However, the reasons for these difficulties are more subtle, and many new issues are brought to the surface. By explicitly addressing how to build models of wave functions and energy and how to relate these models to real physical systems, we have opened up a floodgate of deep and difficult questions as students struggle to make sense of these models. We conclude that the difficulties found in previous research are the tip of the iceberg, and the real issue at the heart of student difficulties in learning quantum tunneling is the struggle to build the complex models that are implicit in experts’ understanding but often not explicitly addressed in instruction.

We describe the results of an experiment conducted to test predictions about student responses to questions about motion based on an explicit model of student thinking in terms of the cuing of a variety of different physical intuitions or conceptual resources. This particular model allows us to account for observed variations in patterns of student responses in a way that positing the existence of fixed student conceptions about motion does not. As a result of the experiment, we suggest refinements of our model in order to better account for additional features of the student responses.

We suggest one redefinition of common clusters of questions used to analyze student responses on the Force and Motion Conceptual Evaluation. Our goal is to propose a methodology that moves beyond an analysis of student learning defined by correct responses, either on the overall test or on clusters of questions defined solely by content. We use the resources framework theory of learning to define clusters within this experimental test that was designed without the resources framework in mind. We take special note of the contextual and representational dependence of questions with seemingly similar physics content. We analyze clusters in ways that allow the most common incorrect answers to give as much, or more, information as the correctness of responses in that cluster. We show that false positives can be found, especially on questions dealing with Newton’s third law. We apply our clustering to a small set of data to illustrate the value of comparing students’ incorrect responses which are otherwise identical on a correct or incorrect analysis. Our work provides a connection between theory and experiment in the area of survey design and the resources framework.