NIST
[skip navigation]National Institute of Standards and TechnologyNational Institute of Standards and Technology - TimeNational Institute of Standards and Technology - Home PageNational Institute of Standards and Technology - About NISTNational Institute of Standards and Technology - Contact UsNational Institute of Standards and Technology - A-Z Site IndexNIST Physical Measurement LaboratoryPML Semiconductor & Dimensional Metrology DivisionSDMD Dimensional Metrology GroupSDMD Surface & Nanostructure Metrology GroupSDMD Nanoscale Metrology GroupSDMD Microelectronics Device Integration GroupSDMD CMOS Reliability & Advanced Devices Group
  ENGINEERING METROLOGY TOOLBOX  
 Selected Publications 

Selected Publications is a web-based collection of publications about dimensional metrology.

Download Free Acrobat Reader
PDF Icon

The Use of the Method of Least Squares in Calibration; NBSIR 74-587; 1974


Cameron, J.

NBS Internal Report 74-587; 30p. September 1974.

Keywords:
Least squares; calibration; statistics; measurement restraints in least squares.

Abstract:
This paper presents a discussion of the techniques of statistics that arise in the analysis of data from the comparative experiments used in the calibration of objects relative to a reference group of standards. In calibration one usually measures differences between nominally equal objects and uses the values assigned to the standards as the linear restraint to bring the system up to full rank. The use of the method of least squares in this situation is discussed with examples taken from the calibration work of the National Bureau of Standards.

This summary of statistical techniques is intended for metrologists and was presented at the NBS seminar on High-Efficiency Methods for Dimensional Calibrations given 10-11 June 1974.


Return to Top of Document

Web Site Home: Engineering Metrology Toolbox
Technical Inquiries: Ted Doiron, Group Leader
Dimensional Metrology
Semiconductor and Dimensional Metrology Division
Physical Measurement Laboratory
NIST, 100 Bureau Drive, Stop 8211, Gaithersburg, MD 20899-8211

The National Institute of Standards and Technology (NIST) is an agency of the U.S. Department of Commerce.
NIST / PML / Semiconductor and Dimensional Metrology Division

NIST Program Questions: Public Inquires Unit
(301) 975-NIST (6478) TTY (301) 975-8295
NIST, 100 Bureau Drive, Stop 3460, Gaithersburg, MD 20899-3460

Privacy Policy / Security Notice / Accessibility Statement / Disclaimer / Freedom of Information Act (FOIA) / 
Environmental Policy Statement / No Fear Act Policy / ExpectMore.gov (performance of federal programs) / 
NIST Information Quality Standards / Scientific Integrity Summary

Date Created: Friday, October 18, 2002
Last Updated: Wednesday, December 28, 2011
Technical Web Site Questions: Jay Zimmerman
Feedback and Comments: Webmaster