User`s guide
117
Chapter 4 Features and Functions
General Measurement Configuration
4
Measurement Resolution
Resolution is expressed in terms of number of digits the instrument can
measure or display on the front panel. You can set the resolution to 4, 5,
or 6 full digits, plus a “½” digit which can only be a “0” or “1”. To increase
your measurement accuracy and improve noise rejection, select 6½
digits. To increase your measurement speed, select 4½ digits.
This is the 10 VDC range, 5½ digits are displayed.
This is the 100 mVDC range, 4½ digits are displayed.
This is the 100 ohm range, 6½ digits are displayed.
• For temperature measurements taken from the remote interface, the
resolution is fixed at 6½ digits. From the front panel, you can set the
resolution in terms of the number of digits displayed past the decimal
point (Measure menu).
• For AC voltage measurements, the resolution is fixed at 6½ digits.
The only way to control the reading rate for AC measurements is by
changing the channel delay (see page 105) or by setting the AC filter
to the highest frequency limit (see page 131).
10.216,5 VDC
-045.23 mVDC
113.325,6 OHM
34970A Refresh UG.book Page 117 Wednesday, February 17, 2010 12:34 PM