- Open Access
Validated diagnostic test for introductory physics course placement
Phys. Rev. Phys. Educ. Res. 17, 010127 – Published 19 April, 2021
DOI: https://doi.org/10.1103/PhysRevPhysEducRes.17.010127
Abstract
Diagnostic tests for placing students into appropriate courses are commonly used in higher education math and science departments. We found no physics education research examining the validity of such exams, how well they are placing students into appropriate courses, and what guidance these exams can give for better focusing instruction. In this study, we present criteria by which to evaluate the validity and value of a diagnostic test, and we then apply these to the test developed for physics course placement at Stanford University. We examine the data collected from the first year in which all students intending to enroll in an introductory physics course were required to take the test and received an email suggesting which course would best match their level of preparation based on their score. We found that most students followed this advice. We also found that the diagnostic test score was a good predictor of performance in both the introductory physics course for physics majors and the course targeting science and engineering majors. It was not a good predictor of performance in two other courses, likely due to lack of alignment between course objectives and diagnostic measures. We found many individual questions which were particularly discriminating in predicting performance in the various courses, suggesting specific topics on which instruction should focus. We found that 27 of the 38 questions were predictive of performance in at least one of the courses studied, and only 8 questions that were not predictive of course performance or did not show any difference between students enrolled in different courses. These results provide evidence for the validity and usefulness of our diagnostic test, and we offer it to instructors at other institutions who might find it of value.
Physics Subject Headings (PhySH)
Article Text
References (19)
- E. Hsu and D. Bressoud, Placement, and student performance in calculus I, in Insights and Recommendations from the MAA National Study of College Calculus, edited by D. Bressoud, V. Mesa, and C. Rasmussen (MAA Press, Washington, D.C., 2015), Chap. 5.
- C. McFate and J. Olmsted III, Assessing student preparation through placement tests, J. Chem. Educ. 76 (1999).
- G. W. White, D. M. Miller, L. C. Matten, D. C. Englert, and M. Douglas Scott, National and local proficiency tests: Their validity for an introductory biology course, Educ. Psych Meas. 36, 993 (1976).
- R. L. Forrest, D. W. Stokes, A. B. Burridge, and C. D. Voight, Math remediation intervention for student success in the algebra-based introductory physics course, Phys. Rev. Phys. Educ. Res. 13, 020137 (2017).
- A. G. Medhanie, D. N. Dupuis, B. LeBeau, M. R. Harwell, and T. R. Post, The role of the ACCUPLACER mathematics placement test on a student’s first college mathematics course, Educ. Psychol. Meas. 72, 332 (2012).
- J. Scott-Clayton, Do High-Stakes Placement Exams Predict College Success?, CCRC Working Paper No. 41 (2012).
- M. J. Legg, J. C. Legg, and T. J. Greenbowe, Analysis of success in general chemistry based on diagnostic testing using logistic regression, J. Chem. Educ. 78, 1117 (2001).
- W. K. Adams and C. E. Wieman, Development and validation of instruments to measure learning of expert-like thinking, Int. J. Sci. Educ. 33, 1289 (2011).
- S. Salehi, E. W. Burkholder, G. P. Lepage, S. Pollock, and C. Wieman, Demographic gaps or preparation gaps?: The large impact of incoming preparation on performance of students in introductory physics, Phys. Rev. Phys. Educ. Res. 15, 020114 (2019).
- The diagnostic may be accessed here: https://stanforduniversity.qualtrics.com/jfe/form/SV_6sdi9NK9c7ynWx7.
- The College Board(2018), Guide to the 2018 ACT/SAT concordance, Retrieved from: https://collegereadiness.collegeboard.org/pdf/guide-2018-act-sat-concordance.pdf.
- R. Thornton and D. Sokoloff, Assessing student learning of Newton’s laws: The Force and Motion Conceptual Evaluation and the evaluation of active learning laboratory and lecture curricula, Am. J. Phys. 66, 338 (1998).
- D. Kleppner and R. Kolenkow, An Introduction to Mechanics, 2nd ed. (Cambridge University Press, Cambridge, England, 2013).
- D. Morin, Special Relativity: For the Enthusiastic Beginner, 1st ed. (Create Space, Cambridge, MA, 2017).
- H. D. Young and R. A. Freedman, University Physics with Modern Physics, 14th ed. (Pearson, Boston, 2015).
- L. C. McDermott and P. S. Shaffer, Tutorials in Introductory Physics (Prentice Hall, Upper Saddle River, NJ, 2002).
- D. C. Giancoli, Physics: Principles with Applications, 7th ed. (Pearson Boston, 2014).
- J. Nissen, R. Donatello, and B. Van Dusen, Missing data and bias in physics education research: A case for using multiple imputation, Phys. Rev. Phys. Educ. Res. 15, 020106 (2019).
- E. W. Burkholder and C. E. Wieman, What do AP physics courses teach and the AP physics exam measure?, Phys. Rev. Phys. Educ. Res. 15, 020117 (2019).
