Owner manual
Publication 1762-UM003A-EN-P - February 2003
3-22 Module Data, Status, and Channel Configuration
Table 3.10 Effective Resolution and Range for 50-60 Hz Filter Frequency
Input
Type
Raw/Proportional Data
Over Full Input Range
Engineering Units x 1
Over Full Range
Engineering Units x 10
Over Full Range
Scaled for PID Over Full
Range
Percent of Full Scale
0 to 100%
Decimal
Range
Resolution
Decimal
Range
Resolution
Decimal
Range
Resolution
Decimal
Range
Resolution
Decimal
Range
Resolution
°C °F °C °F °C °F °C °F °C °F
100Ω
Pt 385
±32767
0.224°C /
14 counts
0.404°F/
14 counts
-2000
to
+8500
0.3°C /
3 counts
0.540°F/
3 counts
-200
to
+850
1.0°C/
1 count
1.8°F/
1 count
0 to 16383
0.256°C/4
counts
0.461°F/
4 counts
0 to 10000
0.315°C/
3 counts
0.567°F/
3 counts
200Ω
Pt 385
0.112°C /
7 counts
0.202°F/
7 counts
-2000
to
+8500
0.2°C /
2 counts
0.360°F/
2 counts
-200
to
+850
1.0°C/
1 count
1.8°F/
1 count
0.128°C/
2 counts
0.231°F/
2 counts
0.210°C/
2 counts
0.378°F/
2 counts
500Ω
Pt 385
0.176°C /
11 counts
0.317°F/
11 counts
-2000
to
+8500
0.2°C /
2 counts
0.360°F/
2 counts
-200
to
+850
1.0°C/
1 count
1.8°F/
1 count
0.192°C/
3 counts
0.346°F/
3 counts
0.210°C/
2 counts
0.378°F/
2 counts
1000Ω
Pt 385
0.352°C /
22 counts
0.634°F/
22 counts
-2000
to
+8500
0.4°C /
4 counts
0.720°F/
4 counts
-200
to
+850
1.0°C/
1 count
1.8°F/
1 count
0.385°C/
6 counts
0.692°F/
6 counts
0.420°C/
4 counts
0.756°F/
4 counts
100Ω
Pt
3916
0.114°C /
9 counts
0.205°F/
9 counts
-2000
to
+6300
0.2°C /
2 counts
0.360°F/
2 counts
-200
to
+630
1.0°C/
1 count
1.8°F/
1 count
0.152°C/
3 counts
0.274°F/
3 counts
0.166°C/
2 counts
0.299°F/
2 counts
200Ω
Pt
3916
0.063°C /
5 counts
0.114°F/
5 counts
-2000
to
+6300
0.1°C /
1 count
0.18°C /
1 count
-200
to
+630
1.0°C/
1 count
1.8°F/
1 count
0.101°C/
2 counts
0.182°F/
2 counts
0.083°C/
1 count
0.149°F/
1 count
500Ω
Pt
3916
0.101°C /
8 counts
0.182°F/
8 counts
-2000
to
+6300
0.1°C /
1 counts
0.18°F /
1 counts
-200
to
+630
1.0°C/
1 count
1.8°F/
1 count
0.101°C/
2 counts
0.182°F/
2 counts
0.166°C/
2 counts
0.299°F/
2 counts
1000Ω
Pt
3916
0.101°C /
8 counts
0.182°F/
8 counts
-2000
to
+6300
0.1°C /
1 count
0.18°F /
1 count
-200
to
+630
1.0°C/
1 count
1.8°F/
1 count
0.101°C/
2 counts
0.182°F/
2 counts
0.166°C/
2 counts
0.299°F/
2 counts
10Ω
Cu 426
15.381°C
/ 2800
counts
27.686°F/
2800
counts
-1000
to
+2600
15.40°C /
154
counts
27.720°F/
154
counts
-100
to
+260
16.00°C/
16 counts
28.80°F/
16 counts
15.381°C
/700
counts
27.686°F/
700
counts
15.406°C/
428
counts
27.732°F/
428
counts
120Ω
Ni 618
0.055°C /
10 counts
0.099°F/
10 counts
-1000
to
+2600
0.1°C /
1 count
0.18°F /
1 count
-100
to
+260
1.0°C/
1 count
1.8°F/
1 count
0.066°C/
3 counts
0.119°F/
3 counts
0.072°C/
2 counts
0.130°F/
2 counts
120Ω
Ni 672
0.042°C /
8 counts
0.075°F/
8 counts
-800 to
+2600
0.1°C /
1 count
0.18°F /
1 count
-80 to
+260
1.0°C/
1 count
1.8°F/
1 count
0.042°C/
2 counts
0.075°F/
2 counts
0.068°C/
2 counts
0.122°F/
2 counts
604Ω
NiFe
518
0.121°C /
22 counts
0.181°F/
22 counts
-1000
to
+2000
0.12°C /
1 count
0.18°F /
1 count
-100
to
+200
1.2°C/
1 counts
1.8°F/
1 count
0.132°C/
6 counts
0.198°F/
6 counts
0.144°C/
4 counts
0.216°F/
4 counts
150Ω 0.153Ω /67 counts 0 to
+15000
0.160Ω / 16 counts 0 to
+1500
0.2Ω /2 counts 0.156Ω / 17 counts 0.165Ω / 11 counts
500Ω 0.046Ω /6 counts 0 to
+5000
0.1Ω / 1 count 0 to
+500
1.0Ω / 1 count 0.061Ω / 2 count 0.050Ω / 1 count
1000Ω 0.092Ω /6 counts 0 to
+10000
0.1Ω / 1 count 0 to
+1000
1.0Ω / 1 count 0.122Ω / 2 counts 0.100Ω / 1 count
3000Ω 0.641Ω /14 counts 0 to
+30000
0.700Ω / 7 counts 0 to
+3000
1.0Ω /1 count 0.732Ω /4 counts 0.900Ω / 3 counts