As part of a long-term program to develop effective, research-based professional development programs for physics graduate student teaching assistants (TAs), we first identify their current classroom practices and why they engage in these practices. In this paper, we identify a set of teaching practices we call “focusing on indicators,” which occurs when TAs use signs such as key words or diagrams as evidence that students understand the target idea; these indicators are more superficial than a detailed explanation. Our primary finding is that although the three TAs discussed here share a common behavior, the beliefs and motivations that underlie this behavior vary. We argue that TA professional development focused on changing these TAs’ focus-on-indicator behavior is unlikely to be effective. Instead, responsive TA professional development will need to address the TAs’ beliefs that guide the observed classroom behavior.

Submissions to an online homework tutor were analyzed to determine whether they were copied. The fraction of copied submissions increased rapidly over the semester, as each weekly deadline approached and for problems later in each assignment. The majority of students, who copied less than 10% of their problems, worked steadily over the three days prior to the deadline, whereas repetitive copiers (those who copied $>30\mathrm{\%}$ of their submitted problems) exerted little effort early. Importantly, copying homework problems that require an analytic answer correlates with a $2\left(\sigma \right)$ decline over the semester in relative score for similar problems on exams but does not significantly correlate with the amount of conceptual learning as measured by pretesting and post-testing. An anonymous survey containing questions used in many previous studies of self-reported academic dishonesty showed $\sim 1/3$ less copying than actually was detected. The observed patterns of copying, free response questions on the survey, and interview data suggest that time pressure on students who do not start their homework in a timely fashion is the proximate cause of copying. Several measures of initial ability in math or physics correlated with copying weakly or not at all. Changes in course format and instructional practices that previous self-reported academic dishonesty surveys and/or the observed copying patterns suggested would reduce copying have been accompanied by more than a factor of 4 reduction of copying from $\sim 11\mathrm{\%}$ of all electronic problems to less than 3%. As expected (since repetitive copiers have approximately three times the chance of failing), this was accompanied by a reduction in the overall course failure rate. Survey results indicate that students copy almost twice as much written homework as online homework and show that students nationally admit to more academic dishonesty than MIT students.

The Force Concept Inventory (FCI) is an important diagnostic instrument which is widely used in the field of physics education research. It is therefore very important to evaluate and monitor its functioning using different tools for statistical analysis. One of such tools is the stochastic Rasch model, which enables construction of linear measures for persons and items from raw test scores and which can provide important insight in the structure and functioning of the test (how item difficulties are distributed within the test, how well the items fit the model, and how well the items work together to define the underlying construct). The data for the Rasch analysis come from the large-scale research conducted in 2006-07, which investigated Croatian high school students’ conceptual understanding of mechanics on a representative sample of 1676 students (age 17–18 years). The instrument used in research was the FCI. The average FCI score for the whole sample was found to be $\left(27.7\pm 0.4\right)\mathrm{\%}$, indicating that most of the students were still non-Newtonians at the end of high school, despite the fact that physics is a compulsory subject in Croatian schools. The large set of obtained data was analyzed with the Rasch measurement computer software WINSTEPS 3.66. Since the FCI is routinely used as pretest and post-test on two very different types of population (non-Newtonian and predominantly Newtonian), an additional predominantly Newtonian sample ($N=141$, average FCI score of 64.5%) of first year students enrolled in introductory physics course at University of Zagreb was also analyzed. The Rasch model based analysis suggests that the FCI has succeeded in defining a sufficiently unidimensional construct for each population. The analysis of fit of data to the model found no grossly misfitting items which would degrade measurement. Some items with larger misfit and items with significantly different difficulties in the two samples of students do require further examination. The analysis revealed some problems with item distribution in the FCI and suggested that the FCI may function differently in non-Newtonian and predominantly Newtonian population. Some possible improvements of the test are suggested.

We present a measure, which we have named the Pedagogical Expectancy Violation Assessment (PEVA), for instructors to gauge one aspect of the success of their implementation of pedagogical reform by assessing the expectations and experiences of the students in the classroom. We implemented the PEVA in four physics classes at three institutions that used the Student Centered Active Learning Environment for Undergraduate Programs (SCALE-UP) pedagogy in order to gain an understanding of students’ initial expectations, how those expectations are shifted during early classes, and what students report experiencing at the end of the semester. The results indicate appropriate shifts in student expectations during orientation, but some gaps between student expectations and experiences persisted. Students rated the communication aspects of SCALE-UP as desirable and indicated an overall positive affect toward the pedagogy, indicating that violations of their initial expectations were largely positive. By studying the patterns of the shifts in students’ expectations and gaps between those expectations and their experiences, we gain insight for improving both the orientation of the students and the implementation of the course.

Just as expert physicists vary in their personal stances on interpretation in quantum mechanics, instructors vary on whether and how to teach interpretations of quantum phenomena in introductory modern physics courses. In this paper, we document variations in instructional approaches with respect to interpretation in two similar modern physics courses recently taught at the University of Colorado, and examine associated impacts on student perspectives regarding quantum physics. We find students are more likely to prefer realist interpretations of quantum-mechanical systems when instructors are less explicit in addressing student ontologies. We also observe contextual variations in student beliefs about quantum systems, indicating that instructors who choose to address questions of ontology in quantum mechanics should do so explicitly across a range of topics.

We have investigated the long-term effect of student-centered instruction at the freshman level on juniors’ performance on a conceptual survey of Electricity and Magnetism (E&M). We measured student performance on a research-based conceptual instrument—the Brief Electricity & Magnetism Assessment (BEMA)–over a period of 8 semesters (2004–2007). Concurrently, we introduced the University of Washington's Tutorials in Introductory Physics as part of our standard freshman curriculum. Freshmen took the BEMA before and after this Tutorial-based introductory course, and juniors took it after completion of their traditional junior-level E&M I and E&M II courses. We find that, on average, individual BEMA scores do not change significantly after completion of the introductory course—neither from the freshman to the junior year, nor from upper-division E&M I to E&M II. However, we find that juniors who had completed a non-Tutorial freshman course scored significantly lower on the (post-upper-division) BEMA than those who had completed the reformed freshman course—indicating a long-term positive impact of freshman Tutorials on conceptual understanding.

Successful implementation of tutorials includes establishing norms for learning in the tutorial classroom. The teaching assistants (TAs) who lead each tutorial section are important arbiters of these norms. TAs who value (buy into) tutorials are more likely to convey their respect for the material and the tutorial process to the students, as well as learning more themselves. We present a case study of a TA who does not buy into certain aspects of the tutorials he teaches and demonstrate how his lack of buy-in affects specific classroom interactions. We would hope to design professional development programs to help TAs appreciate the power of tutorial instruction. However, our research suggests that the typical professional development activities offered to tutorial TAs are not likely to be effective. Instead, it appears that what we call the “social and environmental context” of the tutorials—including classroom, departmental, and institutional levels of implementation—has the potential to strongly affect TA buy-in to tutorials and probably outweighs the influence of any particular activity that we might prepare for them.

Developing expertise in physics entails learning to use mathematics effectively and efficiently as applied to the context of physical situations. Doing so involves coordinating a variety of concepts and skills including mathematical processing, computation, blending ancillary information with the math, and reading out physical implications from the math and vice versa. From videotaped observations of intermediate level students solving problems in groups, we note that students often “get stuck” using a limited group of skills or reasoning and fail to notice that a different set of tools (which they possess and know how to use effectively) could quickly and easily solve their problem. We refer to a student’s perception or judgment of the kind of knowledge that is appropriate to bring to bear in a particular situation as epistemological framing. Although epistemological framing is often unstated (and even unconscious), in group problem-solving situations students sometimes get into disagreements about how to progress. During these disagreements, they bring forth reasons or warrants in support of their point of view. For the context of mathematics use in physics problem solving, we present a system for classifying physics students’ warrants and analyze a case study. This warrant analysis provides a general widely applicable technique for identifying students’ epistemological framings.

During the Fall of 2008 we designed and administered a web survey to collect information about pedagogical knowledge and practices of physics faculty. The survey was completed by a representative sample of 722 physics faculty across the United States (a 50.3% response rate). This paper presents results of one part of the survey where faculty were asked to rate their level of knowledge and use of 24 Research-Based Instructional Strategies (RBIS) that are applicable to an introductory quantitative physics course. Almost all faculty (87.1%) indicated familiarity with one or more RBIS and approximately half of faculty (48.1%) said that they currently use at least one RBIS. Results also indicate that faculty rarely use RBIS as recommended by the developer, but instead commonly make significant modifications.

The increasing ease of video recording offers new opportunities to create richly detailed records of classroom activities. These recordings, in turn, call for research methodologies that balance generalizability with interpretive validity. This paper shares methodology for two practices of video analysis: (1) gaining insight into specific brief classroom episodes and (2) developing and applying a systematic observational protocol for a relatively large corpus of video data. These two aspects of analytic practice are illustrated in the context of a particular research interest but are intended to serve as general suggestions.

The performance of over 2000 students in introductory calculus-based electromagnetism (E&M) courses at four large research universities was measured using the Brief Electricity and Magnetism Assessment (BEMA). Two different curricula were used at these universities: a traditional E&M curriculum and the Matter & Interactions (M&I) curriculum. At each university, postinstruction BEMA test averages were significantly higher for the M&I curriculum than for the traditional curriculum. The differences in post-test averages cannot be explained by differences in variables such as preinstruction BEMA scores, grade point average, or SAT Reasoning Test (SAT) scores. BEMA performance on categories of items organized by subtopic was also compared at one of the universities; M&I averages were significantly higher in each topic. The results suggest that the M&I curriculum is more effective than the traditional curriculum at teaching E&M concepts to students, possibly because the learning progression in M&I reorganizes and augments the traditional sequence of topics, for example, by increasing early emphasis on the vector field concept and by emphasizing the effects of fields on matter at the microscopic level.

Common forms of testing of student understanding of science content can be misleading about their understanding of the nature of scientific thinking. Observational astronomy integrated with related ideas of force and motion is a rich context to explore the correlation between student content knowledge and student understanding of the scientific thinking about that content. In this paper, we describe this correlation in detail with a focus on a question about the relative motion of the Sun and the Earth. We find that high achieving high school students throughout New York City struggle with what constitutes scientific justification and thought processes, but can improve these skills tremendously in an inquiry-oriented summer astronomy-physics program.

This paper introduces five commonly used approaches to analyzing multiple-choice test data. They are classical test theory, factor analysis, cluster analysis, item response theory, and model analysis. Brief descriptions of the goals and algorithms of these approaches are provided, together with examples illustrating their applications in physics education research. We minimize mathematics, instead placing emphasis on data interpretation using these approaches.

The Colorado Learning Attitudes about Science Survey (CLASS) has been widely acknowledged as a useful measure of student cognitive attitudes about science and learning. The initial University of Colorado validation study included only 20% non-Caucasian student populations. In this Brief Report we extend their validation to include a predominately under-represented minority population. We validated the CLASS instrument at Florida International University, a Hispanic-serving institution, by interviewing students in introductory physics classes using a semistructured protocol, examining students’ responses on the CLASS item statements, and comparing them to the items’ intended meaning. We find that in our predominately Hispanic population, 94% of the students’ interview responses indicate that the students interpret the CLASS items correctly, and thus the CLASS is a valid instrument. We also identify one potentially problematic item in the instrument which one third of the students interviewed consistently misinterpreted.

Most students struggle when faced with complex and open-ended tasks because the strategies taught in schools and universities simply require finding and applying the correct formulae or strategy to answer well-structured, algorithmic problems. For students to develop their ability to solve ill-structured problems, they must first believe that standardized procedural approaches will not always be sufficient for solving engineering and scientific challenges. In this paper we document the range of beliefs university students have about problem solving. Students enrolled in a physics course submitted a written reflection both at the start and the end of the course on how they solve problems. We coded approximately 500 of these reflections for the presence of different problem-solving approaches. At the start of the semester over 50% of the students mention in written reflections that they use Rolodex equation matching, i.e., they solve problems by searching for equations that have the same variables as the knowns and unknowns. We then describe the extent to which students’ beliefs about physics problem solving change by the end of a semester-long course that emphasized problem solving via context-rich, multifaceted problems. The frequency of strategies such as the Rolodex method reduces only slightly by the end of the semester. However, there is an increase in students describing more expansive strategies within their reflections. In particular there is a large increase in describing the use of diagrams, and thinking about concepts first.

While educational reforms in introductory physics are becoming more widespread, how these reforms are implemented is less well understood. This paper examines the variation in faculty practices surrounding the implementation of educational reform in introductory physics courses. Through observations of classroom practice, we find that professors’ actual practices differ strikingly. We present a framework for describing and capturing instructional choices and resulting variations in enacted practices for faculty who are implementing Peer Instruction. Based on our observations, there are a variety of scientific practices that are supported and modeled in the use of Peer Instruction. In all of the classrooms studied, students were found trying out and applying new physical concepts and discussing physics with their peers. However, there were large discrepancies in students’ opportunities to engage in formulating and asking questions, evaluating the correctness and completeness of problem solutions, interacting with physicists, identifying themselves as sources of solutions, explanations, or answers, and communicating scientific ideas in a public arena. Case studies of six professors demonstrate how these variations in classroom practices, in aggregate, create different classroom norms, such as the relative emphasis on student sense-making vs answer-making during Peer Instruction.

We introduce a linguistic framework through which one can interpret systematically students’ understanding of and reasoning about force and motion. Some researchers have suggested that students have robust misconceptions or alternative frameworks grounded in everyday experience. Others have pointed out the inconsistency of students’ responses and presented a phenomenological explanation for what is observed, namely, knowledge in pieces. We wish to present a view that builds on and unifies aspects of this prior research. Our argument is that many students’ difficulties with force and motion are primarily due to a combination of linguistic and ontological difficulties. It is possible that students are primarily engaged in trying to define and categorize the meaning of the term “force” as spoken about by physicists. We found that this process of negotiation of meaning is remarkably similar to that engaged in by physicists in history. In this paper we will describe a study of the historical record that reveals an analogous process of meaning negotiation, spanning multiple centuries. Using methods from cognitive linguistics and systemic functional grammar, we will present an analysis of the force and motion literature, focusing on prior studies with interview data. We will then discuss the implications of our findings for physics instruction.

Among the most surprising findings in Physics Education Research is the lack of positive results on attitudinal measures, such as Colorado Learning Attitudes about Science Survey (CLASS) and Maryland Physics Expectations Survey (MPEX). The uniformity with which physics teaching manages to negatively shift attitudes toward physics learning is striking. Strategies which have been shown to improve conceptual learning, such as interactive engagement and studio-format classes, provide more authentic science experiences for students; yet do not seem to be sufficient to produce positive attitudinal results. Florida International University’s Physics Education Research Group has implemented Modeling Instruction in University Physics classes as part of an overall effort toward building a research and learning community. Modeling Instruction is explicitly designed to engage students in scientific practices that include model building, validation, and revision. Results from a preinstruction/postinstruction CLASS measurement show attitudinal improvements through both semesters of an introductory physics sequence, as well as over the entire two-course sequence. In this Brief Report, we report positive shifts from the CLASS in one section of a modeling-based introductory physics sequence, for both mechanics $\left(N=22\right)$ and electricity and magnetism $\left(N=23\right)$. Using the CLASS results and follow up interviews, we examine how these results reflect on modeling instruction and the unique student community and population at FIU.