Datasheet
N6731B-N6792A DC Power & Load Modules
N6700C-N6705C Mainframes
52 Specifications Guide
Measurement Accuracy and Resolution
(with shorter measurement intervals)
The following table shows changes to the short-term measurement
accuracy and resolution with various number of power line cycle (NPLC)
measurement settings. Changes are due to the A-to-D converter’s noise
performance. The table’s baseline is 1 NPLC with no added noise. To
determine the measurement accuracy at shorter averaging intervals,
simply add the noise value to the fixed accuracy value in the
specification table.
N6785A and N6786A
NPLC @ 60 Hz:
0.0003
0.003
0.006
0.010
0.031
0.06
0.1
0.6
1
Time:
5.1E-6
51.2E-6
102.4E-6
169E-6
512E-6
998.4E-6
1.7E-3
10E-3
16.7E-3
Averaged points:
1
10
20
33
100
195
325
1953
3255
20V range noise:
2.9E-3
1.3E-3
1.0E-3
1.0E-3
394.2E-6
298.5E-6
260.6E-6
98.1E-6
69.8E-6
Resolution (bits):
12.7
13.9
14.2
14.2
15.6
16
16.2
17.6
18.1
8A range noise:
1.2E-3
552.2E-6
409.7E-6
313.8E-6
198.9E-6
138.0E-6
94.4E-6
45.6E-6
43.5E-6
Resolution (bits):
12.7 13.8 14.2 14.6 15.2 15.8 16.3 17.4 17.4
100mA range noise:
13.5E-6
7.1E-6
5.4E-6
4.1E-6
2.5E-6
1.7E-6
1.3E-6
644.2E-9
471.5E-9
Resolution (bits):
12.8
13.7
14.1
14.5
15.2
15.8
16.2
17.2
17.6
1mA range noise:
1.4E-6
594.3E-9
306.2E-9
191.0E-9
67.7E-9
38.8E-9
23.8E-9
8.2E-9
6.9E-9
Resolution (bits):
9.4
10.7
11.6
12.3
13.8
14.6
15.3
16.8
17.1
N6781A, N6782A and N6784A
NPLC @ 60 Hz:
0.0003
0.003
0.006
0.010
0.031
0.06
0.1
0.6
1
Time:
5.1E-6
51.2E-6
102.4E-6
169E-6
512E-6
998.4E-6
1.7E-3
10E-3
16.7E-3
Averaged points:
1
10
20
33
100
195
325
1953
3255
20V range noise:
2.3E-3
1.2E-3
993.7E-6
894.8E-6
533.4E-6
297.5E-6
276.6E-6
87.4E-6
69.6E-6
Resolution (bits):
13
14
14.2
14.4
15.1
16
16.1
17.7
18.1
1V range noise:
186.6E-6
90.3E-6
57.0E-6
45.5E-6
26.7E-6
22.1E-6
19.8E-6
7.1E-6
4.8E-6
Resolution (bits):
12.3
13.4
14
14.4
15.1
15.4
15.6
17.1
17.6
100mV range noise:
38.9E-6
20.7E-6
12.5E-6
10.5E-6
5.9E-6
5.1E-6
5.0E-6
3.9E-6
3.4E-6
Resolution (bits):
11.3
12.2
12.9
13.2
14
14.2
14.2
14.6
14.8
3A range noise:
480.3E-6
206.4E-6
159.7E-6
120.5E-6
71.0E-6
48.3E-6
41.4E-6
16.8E-6
18.5E-6
Resolution (bits):
12.6
13.8
14.2
14.6
15.3
15.9
16.1
17.4
17.2
100mA range noise:
14.1E-6
8.7E-6
6.4E-6
4.4E-6
2.5E-6
2.2E-6
1.5E-6
858.1E-9
573.3E-9
Resolution (bits):
12.8
13.4
13.9
14.4
15.2
15.4
16
16.8
17.4
1mA range noise:
1.8E-6
798.7E-9
363.1E-9
248.5E-9
74.1E-9
44.8E-9
27.3E-9
8.5E-9
6.8E-9
Resolution (bits):
9.1
10.2
11.4
11.9
13.7
14.4
15.1
16.8
17.1
10uA range noise:
15.9E-9
18.0E-9
20.3E-9
15.4E-9
11.0E-9
4.8E-9
3.3E-9
752.2E-12
456.3E-12
Resolution (bits):
9.2
9.1
8.9
9.3
9.8
11
11.5
13.7
14.4