All JournalsPhysics Magazine

Export citation

Export citation

Choose format for download:

Download Citation
  • Access by Xinjiang University

The Calculation of Errors by the Method of Least Squares

Raymond T. Birge

  • University of California, Berkeley

Phys. Rev. 40, 207 – Published 15 April, 1932

DOI: https://doi.org/10.1103/PhysRev.40.207

Abstract

Present status of least squares' calculations.—There are three possible stages in any least squares' calculation, involving respectively the evaluation of (1) the most probable values of certain quantities from a set of experimental data, (2) the reliability or probable error of each quantity so calculated, (3) the reliability or probable error of the probable errors so calculated. Stages (2) and (3) are not adequately treated in most texts, and are frequently omitted or misused, in actual work. The present article is concerned mainly with these two stages.

Validity of the Gaussian error curve.—All least squares' calculations of probable error assume that the residuals follow a Gaussian error curve. This curve is derived from a consideration only of accidental errors. Probable errors are, however, evaluated frequently in cases where constant or systematic errors are known to be present. Such a procedure, when used judiciously, is believed by the writer to be better than any alternative procedure, but the results are naturally less reliable than a strict reliance on theory would indicate. The statement is sometimes made that in practise one often gets more large residuals than are predicted by theory. This point is tested by 500 measurements of a spectral line, and the resulting Gaussian curve, plotted in Fig. 1, shows no indication of such a deviation. It is possible to account for an excess of large residuals (with the necessary accompaniment of a deficiency of small residuals), by assuming that the various observations used were not in fact of equal reliability. The formulas by which the probable error r may be calculated from the observed residuals, and the reliability of each such value, are briefly considered.

Internal versus external consistency.—Probable errors are calculated usually on the basis of internal consistency, and most texts discuss only this method. Scarborough, in a recent article, claims that there is no logical basis for the calculation from external consistency. This matter is considered in detail, and it is shown that the two methods must necessarily lead to the same result, except for statistical fluctuations, provided that only accidental errors are present. Formulas for the magnitude of the expected fluctuations are given. It is shown that a probable error based on internal consistency (ri) is virtually a prediction and that the probable error based on external consistency (re) is the answer to this prediction. When the ratio reri exceeds unity by an amount much greater than is to be expected on the basis of statistical fluctuation, one has almost certain evidence of the presence of systematic errors. In such a case new arbitrary weights should be assigned. Then one has available only external consistency as a basis for the calculation of errors. The false deductions that result from a failure to note the above facts are illustrated by several examples from the literature, and a numerical problem illustrating all of these relations is presented in detail.

Probable error of a function evaluated by least squares.—The probable error of a function of directly observed quantities is given by the well-known law of "propagation of Error." When, however, one has a function whose coefficients have been evaluated by least squares, the probable error of the function is scarcely mentioned in the literature, and the writer has never seen it calculated in practise. Explicit formulas for the error of a rational integral function of any degree are derived by the writer, from elementary considerations, and are found to agree with the very general formula already known. Practically all of the results presented here find frequent application in the article on probable values of e, h, etc., which immediately follows.

References (36)

  1. J. B. Scarborough, Proc. Nat. Acad. Sci. 15, 665 (1929) verbatim, in his book "Numerical Mathematical Analysis" (Johns Hopkins Press, 1930) pp. 328-332
  2. Omitted endnote

  3. M. Merriman "Method of Least Squares" 8th edition, articles 17-28 Whittaker and Robinson "Calculus of Observations" pp. 168-173
  4. Tuttle and Satterly "Theory of Measurements" p. 175 The Frontis-piece of G. C. Comstock "Method of Least Squares" Merriman, [3], page 33 Scarborough "Numerical Mathematical Analysis", page 314
  5. Omitted endnote

  6. T. C. Fry, "Probability and Its Engineering Uses", p. 183
  7. Merriman, [3], page 73
  8. Merriman, [3], pp. 79-82
  9. Whittaker and Robinson, [3], p. 201
  10. Merriman, [3], p. 208
  11. Omitted endnote

  12. N. R. Campbell, on page Whittaker and Robinson182 of his book "Measurement and Calculation", , [3], pp. 258-259 H. L. Rietz "Handbook of Mathematical Statistics", p. 64 Scarborough, [1], pp. 357-363 (N. R. Campbell, Phil. Mag. 39, 177, 1920) ( 10, 745, 1930) ( 47, 816, 1924)
  13. Omitted endnote

  14. Omitted endnote

  15. Omitted endnote

  16. Omitted endnote

  17. Omitted endnote

  18. A. Palmer "Theory of Measurements" pp. 66-71
  19. Omitted endnote

  20. A. PalmerPhil. Mag. 11, 146 (1931)
  21. Palmer, [18] Merriman, [3]
  22. Omitted endnote

  23. Omitted endnote

  24. Omitted endnote

  25. Omitted endnote

  26. Omitted endnote

  27. F. W. Clarke "A Redetermination of Atomic Weights" 4th edition (1920) Printed as Part 3, Vol. 16 of Memoirs, Nat. Acad. Science
  28. R. T. Birge "Probable Values of the General Physical Constants," Phys. Rev. Supplement (now called Reviews of Modern Physics) 1, 1, 1929. pages 25 and 19-20 This article is referred to as G.C. 1929
  29. M. Merriman, [3], page 90
  30. Omitted endnote

  31. Wright and Hayford "Adjustment of Observations" pp. 74-77 Tuttle and Satterly, [4], pp. 202-203
  32. Merriman, [3], pp. 75-79 Palmer, [18], pp. 95-104
  33. Palmer, [18], Chap. IX Whittaker and Robinson, [3], pp. 239-242
  34. Whittaker and Robinson, [3], near top of page 243 Wright and Hayford, [31] near bottom of page 138
  35. Palmer, [18], page 112
  36. Whittaker and Robinson, [3], pp. 231 and 241

Outline

Information

Sign In to Your Journals Account

Filter

Filter

Article Lookup

Enter a citation