Instrument types and performance characteristics

2.2.3 Tolerance

Tolerance is a term that is closely related to accuracy and defines the maximum error that is to be expected in some value. Whilst it is not, strictly speaking, a static characteristic of measuring instruments, it is mentioned here because the accuracy of some instruments is sometimes quoted as a tolerance figure. When used correctly, tolerance describes the maximum deviation of a manufactured component from some specified value. For instance, crankshafts are machined with a diameter tolerance quoted as so many microns (10[1]6 m), and electric circuit components such as resistors have tolerances of perhaps 5%. One resistor chosen at random from a batch having a nominal value 1000 W and tolerance 5% might have an actual value anywhere between 950 W and 1050 W.

 

2.2.4 Range or span

The range or span of an instrument defines the minimum and maximum values of a quantity that the instrument is designed to measure

 

2.2.5 Linearity

It is normally desirable that the output reading of an instrument is linearly proportional to the quantity being measured. The Xs marked on Figure 2.6 show a plot of the typical output readings of an instrument when a sequence of input quantities are applied to it. Normal procedure is to draw a good fit straight line through the Xs, as shown in Figure 2.6. (Whilst this can often be done with reasonable accuracy by eye, it is always preferable to apply a mathematical least-squares line-fitting technique, as described in Chapter 11.) The non-linearity is then defined as the maximum deviation of any of the output readings marked X from this straight line. Non-linearity is usually expressed as a percentage of full-scale reading.