Validation study of the Colorado Learning Attitudes about Science Survey at a Hispanic-serving institution
Vashti Sawtelle, Eric Brewe, and Laird Kramer
Phys. Rev. ST Phys. Educ. Res. 5, 023101 (2009) - Published 28 August, 2009
Vashti Sawtelle, Eric Brewe, and Laird Kramer
Phys. Rev. ST Phys. Educ. Res. 5, 023101 (2009) - Published 28 August, 2009
The Colorado Learning Attitudes about Science Survey (CLASS) has been widely acknowledged as a useful measure of student cognitive attitudes about science and learning. The initial University of Colorado validation study included only 20% non-Caucasian student populations. In this Brief Report we extend their validation to include a predominately under-represented minority population. We validated the CLASS instrument at Florida International University, a Hispanic-serving institution, by interviewing students in introductory physics classes using a semistructured protocol, examining students’ responses on the CLASS item statements, and comparing them to the items’ intended meaning. We find that in our predominately Hispanic population, 94% of the students’ interview responses indicate that the students interpret the CLASS items correctly, and thus the CLASS is a valid instrument. We also identify one potentially problematic item in the instrument which one third of the students interviewed consistently misinterpreted.
C. A. Ogilvie
Phys. Rev. ST Phys. Educ. Res. 5, 020102 (2009) - Published 28 August, 2009
Most students struggle when faced with complex and open-ended tasks because the strategies taught in schools and universities simply require finding and applying the correct formulae or strategy to answer well-structured, algorithmic problems. For students to develop their ability to solve ill-structured problems, they must first believe that standardized procedural approaches will not always be sufficient for solving engineering and scientific challenges. In this paper we document the range of beliefs university students have about problem solving. Students enrolled in a physics course submitted a written reflection both at the start and the end of the course on how they solve problems. We coded approximately 500 of these reflections for the presence of different problem-solving approaches. At the start of the semester over 50% of the students mention in written reflections that they use Rolodex equation matching, i.e., they solve problems by searching for equations that have the same variables as the knowns and unknowns. We then describe the extent to which students’ beliefs about physics problem solving change by the end of a semester-long course that emphasized problem solving via context-rich, multifaceted problems. The frequency of strategies such as the Rolodex method reduces only slightly by the end of the semester. However, there is an increase in students describing more expansive strategies within their reflections. In particular there is a large increase in describing the use of diagrams, and thinking about concepts first.
Chandra Turpen and Noah D. Finkelstein
Phys. Rev. ST Phys. Educ. Res. 5, 020101 (2009) - Published 20 August, 2009
While educational reforms in introductory physics are becoming more widespread, how these reforms are implemented is less well understood. This paper examines the variation in faculty practices surrounding the implementation of educational reform in introductory physics courses. Through observations of classroom practice, we find that professors’ actual practices differ strikingly. We present a framework for describing and capturing instructional choices and resulting variations in enacted practices for faculty who are implementing Peer Instruction. Based on our observations, there are a variety of scientific practices that are supported and modeled in the use of Peer Instruction. In all of the classrooms studied, students were found trying out and applying new physical concepts and discussing physics with their peers. However, there were large discrepancies in students’ opportunities to engage in formulating and asking questions, evaluating the correctness and completeness of problem solutions, interacting with physicists, identifying themselves as sources of solutions, explanations, or answers, and communicating scientific ideas in a public arena. Case studies of six professors demonstrate how these variations in classroom practices, in aggregate, create different classroom norms, such as the relative emphasis on student sense-making vs answer-making during Peer Instruction.
David T. Brookes and Eugenia Etkina
Phys. Rev. ST Phys. Educ. Res. 5, 010110 (2009) - Published 25 June, 2009
We introduce a linguistic framework through which one can interpret systematically students’ understanding of and reasoning about force and motion. Some researchers have suggested that students have robust misconceptions or alternative frameworks grounded in everyday experience. Others have pointed out the inconsistency of students’ responses and presented a phenomenological explanation for what is observed, namely, knowledge in pieces. We wish to present a view that builds on and unifies aspects of this prior research. Our argument is that many students’ difficulties with force and motion are primarily due to a combination of linguistic and ontological difficulties. It is possible that students are primarily engaged in trying to define and categorize the meaning of the term “force” as spoken about by physicists. We found that this process of negotiation of meaning is remarkably similar to that engaged in by physicists in history. In this paper we will describe a study of the historical record that reveals an analogous process of meaning negotiation, spanning multiple centuries. Using methods from cognitive linguistics and systemic functional grammar, we will present an analysis of the force and motion literature, focusing on prior studies with interview data. We will then discuss the implications of our findings for physics instruction.
Eric Brewe, Laird Kramer, and George O’Brien
Phys. Rev. ST Phys. Educ. Res. 5, 013102 (2009) - Published 19 June, 2009
Among the most surprising findings in Physics Education Research is the lack of positive results on attitudinal measures, such as Colorado Learning Attitudes about Science Survey (CLASS) and Maryland Physics Expectations Survey (MPEX). The uniformity with which physics teaching manages to negatively shift attitudes toward physics learning is striking. Strategies which have been shown to improve conceptual learning, such as interactive engagement and studio-format classes, provide more authentic science experiences for students; yet do not seem to be sufficient to produce positive attitudinal results. Florida International University’s Physics Education Research Group has implemented Modeling Instruction in University Physics classes as part of an overall effort toward building a research and learning community. Modeling Instruction is explicitly designed to engage students in scientific practices that include model building, validation, and revision. Results from a preinstruction/postinstruction CLASS measurement show attitudinal improvements through both semesters of an introductory physics sequence, as well as over the entire two-course sequence. In this Brief Report, we report positive shifts from the CLASS in one section of a modeling-based introductory physics sequence, for both mechanics and electricity and magnetism . Using the CLASS results and follow up interviews, we examine how these results reflect on modeling instruction and the unique student community and population at FIU.
Eugenia Etkina, Anna Karelina, Sahana Murthy, and Maria Ruibal-Villasenor
Phys. Rev. ST Phys. Educ. Res. 5, 010109 (2009) - Published 3 June, 2009
The paper reports on how educational research informed and supported both the process of refinement of introductory physics laboratory instruction and student development of scientific abilities. In particular we focus on how the action research approach paradigm combined with instructional approaches such as scaffolding and formative assessment can be used to design the learning environment, investigate student learning, revise curriculum materials, and conduct subsequent assessment. As the result of the above efforts we found improvement in students’ scientific abilities over the course of three years. We suggest that the process used to improve the curriculum under study can be extended to many instructional innovations.
David Rosengrant, Alan Van Heuvelen, and Eugenia Etkina
Phys. Rev. ST Phys. Educ. Res. 5, 010108 (2009) - Published 1 June, 2009
Physics education literature recommends using multiple representations to help students understand concepts and solve problems. However, there is little research concerning why students use the representations and whether those who use them are more successful. This study addresses these questions using free-body diagrams (diagrammatic representations used in problems involving forces) as a type of representation. We conducted a two-year quantitative and qualitative study of students’ use of free-body diagrams while solving physics problems. We found that when students are in a course that consistently emphasizes the use of free-body diagrams, the majority of them do use diagrams on their own to help solve exam problems even when they receive no credit for drawing the diagrams. We also found that students who draw diagrams correctly are significantly more successful in obtaining the right answer for the problem. Lastly, we interviewed students to uncover their reasons for using free-body diagrams. We found that high achieving students used the diagrams to help solve the problems and as a tool to evaluate their work while low achieving students only used representations as aids in the problem-solving process.
Gerd Kortemeyer
Phys. Rev. ST Phys. Educ. Res. 5, 010107 (2009) - Published 26 May, 2009
The two genders make different use of being allowed multiple tries to solve online homework problems: male students frequently attempt to immediately solve the problem, while female students are more likely to first interact with peers and teaching assistants before entering answers. More male than female students state that they use the multiple allowed attempts to enter “random stuff,” while more female than male students state that the multiple attempts allow them to explore their own problem solving approaches without worrying or being stressed out by grades.
Charles Baily and Noah D. Finkelstein
Phys. Rev. ST Phys. Educ. Res. 5, 010106 (2009) - Published 23 March, 2009
Introductory undergraduate courses in classical physics stress a perspective that can be characterized as realist; from this perspective, all physical properties of a classical system can be simultaneously specified and thus determined at all future times. Such a perspective can be problematic for introductory quantum physics students, who must develop new perspectives in order to properly interpret what it means to have knowledge of quantum systems. We document this evolution in student thinking in part through pre- and post-instruction evaluations using the Colorado Learning Attitudes about Science Survey. We further characterize variations in student epistemic and ontological commitments by examining responses to two essay questions, coupled with responses to supplemental quantum attitude statements. We find that, after instruction in modern physics, many students are still exhibiting a realist perspective in contexts where a quantum-mechanical perspective is needed. We further find that this effect can be significantly influenced by instruction, where we observe variations for courses with differing learning goals. We also note that students generally do not employ either a realist or a quantum perspective in a consistent manner.
Ronald K Thornton, Dennis Kuhl, Karen Cummings, and Jeffrey Marx
Phys. Rev. ST Phys. Educ. Res. 5, 010105 (2009) - Published 20 March, 2009
In this paper we compare and contrast student’s pretest/post-test performance on the Halloun-Hestenes force concept inventory (FCI) to the Thornton-Sokoloff force and motion conceptual evaluation (FMCE). Both tests are multiple-choice assessment instruments whose results are used to characterize how well a first term, introductory physics course promotes conceptual understanding. However, the two exams have slightly different content domains, as well as different representational formats; hence, one exam or the other might better fit the interests of a given instructor or researcher. To begin the comparison, we outline how to determine a single-number score for the FMCE and present ranges of normalized gains on this exam. We then compare scores on the FCI and the FMCE for approximately 2000 students enrolled in the Studio Physics course at Rensselaer Polytechnic Institute over a period of eight years (1998–2006) that encompassed significant evolution of the course and many different instructors. We found that the mean score on the FCI is significantly higher than the mean score on the FMCE, however there is a very strong relationship between scores on the two exams. The slope of a best fit line drawn through FCI versus FMCE data is approximately 0.54, and the correlation coefficient is approximately , for preinstructional and postinstructional testings combined. In spite of this strong relationship, the assessments measure different normalized gains under identical circumstances. Additionally, students who scored well on one exam did not necessarily score well on the other. We use this discrepancy to uncover some subtle, but important, differences between the exams. We also present ranges of normalized gains for the FMCE in a variety of instructional settings.
Jill A. Marshall, Eric A. Hagedorn, and Jerry O’Connor
Phys. Rev. ST Phys. Educ. Res. 5, 010104 (2009) - Published 4 March, 2009
We report the results of an analysis of the Texas Assessment of Knowledge and Skills (TAKS) designed to determine whether the TAKS is a valid indicator of whether students know and can do physics at the level necessary for success in future coursework, STEM careers, and life in a technological society. We categorized science items from the 2003 and 2004 10th and 11th grade TAKS by content area(s) covered, knowledge and skills required to select the correct answer, and overall quality. We also analyzed a 5000 student sample of item-level results from the 2004 11th grade exam, performing full-information factor analysis, calculating classical test indices, and determining each item's response curve using item response theory. Triangulation of our results revealed strengths and weaknesses of the different methods of analysis. The TAKS was found to be only weakly indicative of physics preparation and we make recommendations for increasing the validity of standardized physics testing.
Elizabeth Gire, Barbara Jones, and Edward Price
Phys. Rev. ST Phys. Educ. Res. 5, 010103 (2009) - Published 23 February, 2009
Students in introductory physics courses are likely to have views about physics that differ from those of experts. However, students who continue to study physics eventually become experts themselves. Presumably these students either possess or develop more expertlike views. To investigate this process, the views of introductory physics students majoring in physics are compared with the views of introductory physics students majoring in engineering. In addition, the views of physics majors are assessed at various stages of degree progress. The Colorado learning attitudes about science survey is used to evaluate students’ views about physics, and students’ overall survey scores and responses to individual survey items are analyzed. Beginning physics majors are significantly more expertlike than nonmajors in introductory physics courses, and this high level of sophistication is consistent for most of undergraduate study.
Eleanor C. Sayre and Andrew F. Heckler
Phys. Rev. ST Phys. Educ. Res. 5, 013101 (2009) - Published 12 February, 2009
A common format for assessment of learning is pretesting and post-testing. In this study, we collect student test data several times per week throughout a course, allowing for the measurement of the changes in student knowledge with a time resolution on the order of a few days. To avoid the possibility of test-retest effects, separate and quasirandom subpopulations of students are tested on a variety of tasks. We report on data taken in a calculus-based introductory E&M class populated primarily by engineering majors. Unsurprisingly for a traditional introductory course, there is little change in many conceptual questions. However, the data suggest that some student performance peaks and decays rapidly during a quarter, a pattern consistent with memory research yet unmeasurable by pretesting and post-testing. In addition, it appears that some course topics can interfere with prior knowledge, decreasing performance on questions related to earlier topics in the course.
Christine Lindstrøm and Manjula D. Sharma
Phys. Rev. ST Phys. Educ. Res. 5, 010102 (2009) - Published 22 January, 2009
With student numbers decreasing and traditional teaching methods having been found inefficient, it is widely accepted that alternative teaching methods need to be explored in tertiary physics education. In 2006 a different teaching environment was offered to 244 first year students with little or no prior formal instruction in physics. Students were invited to attend additional enrichment classes 1 h a week called map meetings. The focus of these classes was a different type of visual presentation of physics material called link maps. Link maps explicitly show the key concepts covered in lectures and how these interrelate to help novices establish their physics schemata. In each map meeting the link map for the different topic was interactively discussed by the researcher before the students worked on problems in groups using the link map. The class ended with the researcher going through one problem, talking aloud about how to logically attack it. The results were promising. Each week about 20% of the class voluntarily attended map meetings whereas 22% reported that they did not attend due to timetable clashes. Two questionnaires revealed that students thought the classes were helpful for gaining an overview of physics and for developing their problem solving abilities. In the final examination the 32 students who had attended at least eight out of ten map meetings achieved, on average, 9 points out of 90 better in the examination than a comparison group with similar academic background which had not attended map meetings. The results of this study suggest that map meetings are a valuable learning environment for physics novices. Further investigations are currently being undertaken.
Lauren E. Kost, Steven J. Pollock, and Noah D. Finkelstein
Phys. Rev. ST Phys. Educ. Res. 5, 010101 (2009) - Published 8 January, 2009
Previous research [S. J. Pollock et al., Phys. Rev. ST Phys. Educ. Res. 3, 1 (2007)] showed that despite the use of interactive engagement techniques, the gap in performance between males and females on a conceptual learning survey persisted from pretest to post-test at the University of Colorado at Boulder. Such findings were counter to previously published work [M. Lorenzo et al., Am. J. Phys. 74, 118 (2006)]. This study begins by identifying a variety of other gender differences. There is a small but significant difference in the course grades of males and females. Males and females have significantly different prior understandings of physics and mathematics. Females are less likely to take high school physics than males, although they are equally likely to take high school calculus. Males and females also differ in their incoming attitudes and beliefs about physics. This collection of background factors is analyzed to determine the extent to which each factor correlates with performance on a conceptual post-test and with gender. Binned by quintiles, we observe that males and females with similar pretest scores do not have significantly different post-test scores . The post-test data are then modeled using two regression models (multiple regression and logistic regression) to estimate the gender gap in post-test scores after controlling for these important prior factors. These prior factors account for about 70% of the observed gender gap. The results indicate that the gender gap exists in interactive physics classes at our institution but is largely associated with differences in previous physics and math knowledge and incoming attitudes and beliefs.
Eugenia Etkina, Anna Karelina, and Maria Ruibal-Villasenor
Phys. Rev. ST Phys. Educ. Res. 4, 020108 (2008) - Published 3 December, 2008
Most of the time, instructors of introductory physics limit their goals to students’ acquisition of basic concepts and end-of-the-chapter problem solving efficiency. They overlook the development of students’ science process abilities required for constructing scientific knowledge and approaching complex problems as scientists do. This goal is attainable and very valuable at the same time. This paper describes how learners improved their scientific abilities during the course of one semester and reports on the activities and facilitations that helped students in the process. We investigated how long it takes for novices to develop complex scientific abilities and whether the content and the context of the tasks affect the abilities that students demonstrate. We found that students need to conduct several cycles of scaffolded investigations to gain competence in the application of scientific abilities. Depending on the particular ability, a period of five to eight weeks of work is necessary to achieve it.
Kathy L. Malone
Phys. Rev. ST Phys. Educ. Res. 4, 020107 (2008) - Published 20 November, 2008
The modeling instruction pedagogy for the teaching of physics has been proven to be quite effective at increasing the conceptual understanding and problem-solving abilities of students to a much greater extent than that of nonmodeling students. Little research has been conducted concerning the cognitive and metacognitive skills that modeling students develop that allow for these increases. Two studies were designed to answer the following question: In what ways do the knowledge structures, metacognitive skills, and problem-solving abilities differ between modeling and nonmodeling students? In study 1, the knowledge structures developed by two groups of high school physics students taught using differing pedagogies (modeling instruction in physics and traditional methods) were determined using a card-sort task. The student’s knowledge structures were then correlated with the scores they obtained on two measures: the force concept inventory (FCI) and a problem-solving task (PS task) developed for this study. The modeling students had a more expertlike knowledge structure, while the nonmodeling students produced structures that were novicelike. In addition, the expert score correlated highly with performance on both the FCI and PS task scores demonstrating that a higher expert score predicted a higher value on each of these measures while a higher surface feature score predicted a lower score on both of these measures. In study 2, a verbal protocol design allowed for a detailed study of the problem-solving and metacognitive skills utilized by the two groups. It was determined that the skills utilized by the modeling instruction students were more expertlike. In addition, the modeling students produced significantly fewer physics errors while catching and repairing a greater percentage of their errors.
Kara E. Gray, Wendy K. Adams, Carl E. Wieman, and Katherine K. Perkins
Phys. Rev. ST Phys. Educ. Res. 4, 020106 (2008) - Published 14 November, 2008
We measured what students perceive physicists to believe about physics and solving physics problems and how those perceptions differ from the students’ personal beliefs. In this study, we used a modified version of the Colorado Learning Attitudes about Science Survey which asked students to respond to each statement with both their personal belief and the response they thought a physicist would give. Students from three different types of university introductory physics courses were studied. Students who have not yet taken physics in college have a surprisingly accurate idea of what physicists believe about physics no matter what their high school background and what physics courses they choose to take in college. These ideas are largely unaffected by their college physics instruction. In contrast, students’ personal beliefs about physics differ with varying high school physics backgrounds and college physics courses in which they enroll, and these beliefs are affected by college physics instruction. Women have a larger difference between their reported personal beliefs and their perceptions of physicists’ beliefs than do men.
Eleanor C. Sayre and Michael C. Wittmann
Phys. Rev. ST Phys. Educ. Res. 4, 020105 (2008) - Published 12 November, 2008
We investigate the interplay between mathematics and physics resources in intermediate mechanics students. In the mechanics course, the selection and application of coordinate systems is a consistent thread. At the University of Maine, students often start the course with a strong preference to use Cartesian coordinates, in accordance with their prior physics and mathematics classes. In small-group interviews and in homework help sessions, we ask students to define a coordinate system and set up the equations of motion for a simple pendulum for which polar coordinates are more appropriate. We analyze video data from several encounters using a combination of Process/Object theory and Resource Theory. We find that students sometimes persist in using an inappropriate Cartesian system. Furthermore, students often derive (rather than recall) the details of the polar coordinate system, indicating that their knowledge is far from solid. To describe our work more precisely, we define a scale of plasticity and several heuristics for defining resources and their plasticity.
Valerie K. Otero and Kara E. Gray
Phys. Rev. ST Phys. Educ. Res. 4, 020104 (2008) - Published 16 October, 2008
Instructional techniques based on research in cognitive science and physics education have been used in physics courses to enhance student learning. While dramatic increases in conceptual understanding have been observed, students enrolled in these courses tend to move away from scientistlike views of the discipline and toward novicelike views, as measured by various assessment instruments. It has been proposed that course materials and instruction that explicitly address epistemology, the nature of science, and the nature of learning science will help students develop views more closely aligned with the views of scientists. The Physics and Everyday Thinking (PET) curriculum has specific goals for helping nonscience majors explicitly reflect on the nature of science and the nature of learning science. We show that in PET courses with small and large enrollments, shifts toward expert responses ranged from to on the Colorado Learning Attitudes about Science Survey. These results are compared to results from other studies using a variety of similar assessment instruments.