Owner manual
Publication 1762-UM003A-EN-P - February 2003
Module Data, Status, and Channel Configuration 3-23
Table 3.11 Effective Resolution and Range for 250 Hz Filter Frequency
Input
Type
Raw/Proportional Data
Over Full Input Range
Engineering Units x 1
Over Full Range
Engineering Units x
10 Over Full Range
Scaled for PID Over Full
Range
Percent of Full Scale
0 to 100%
Decimal
Range
Resolution
Decimal
Range
Resolution
Decimal
Range
Resolution
Decimal
Range
Resolution
Decimal
Range
Resolution
°C °F °C °F °C °F °C °F °C °F
100Ω
Pt 385
±32767
0.224°C/
14 counts
0.404°F/
14 counts
-2000
to
+8500
0.3°C/ 3
counts
0.540°F/
3 counts
-200
to
+850
1.0°C/
1 count
1.8°F/1
count
0 to 16383
0.256°C/
4 counts
0.461°F/
4 counts
0 to 10000
0.315°C/
3 counts
0.567°F/
3 counts
200Ω
Pt 385
0.224°C/
14 counts
0.404°F/
14 counts
-2000
to
+8500
0.3°C/ 3
counts
0.540°F/
3 counts
-200
to
+850
1.0°C/
1 count
1.8°F/1
count
0.256°C/
4 counts
0.461°F/
4 counts
0.315°C/
3 counts
0.567°F/
3 counts
500Ω
Pt 385
0.176°C/
11 counts
0.317°F/
11 counts
-2000
to
+8500
0.2°C/ 2
counts
0.360°F/
2 counts
-200
to
+850
1.0°C/
1 count
1.8°F/1
count
0.192°C/
3 counts
0.346°F/
3 counts
0.210°C/
2 counts
0.378°F/
2 counts
1000Ω
Pt 385
0.176°C/
11 counts
0.317°F/
11 counts
-2000
to
+8500
0.2°C/
2 counts
0.360°F/
2 counts
-200
to
+850
1.0°C/
1 count
1.8°F/1
count
0.192°C/
3 counts
0.346°F/
3 counts
0.210°C/
2 counts
0.378°F/
2 counts
100Ω
Pt 3916
0.114°C/
9 counts
0.205°F/
9 counts
-2000
to
+6300
0.2°C/
2 counts
0.360°F/
2 counts
-200
to
+630
1.0°C/ 1
count
1.8°F/1
count
0.152°C/
3 counts
0.274°F/
3 counts
0.166°C/
2 counts
0.299°F/
2 counts
200Ω
Pt 3916
0.114°C/
9 counts
0.205°F/
9 counts
-2000
to
+6300
0.2°C/
2 counts
0.360°F/
2 counts
-200
to
+630
1.0°C/
1 count
1.8°F/1
count
0.152°C/
3 counts
0.274°F/
3 counts
0.166°C/
2 counts
0.299°F/
2 counts
500Ω
Pt 3916
0.101°C/
8 counts
0.182°F/
8 counts
-2000
to
+6300
0.1°C/
1 count
0.18°F/
1 count
-200
to
+630
1.0°C/
1 count
1.8°F/1
count
0.101°C/
2 counts
0.182°F/
2 counts
0.166°C/
2 counts
0.299°F/
2 counts
1000Ω
Pt 3916
0.190°C/
15 counts
0.342°F/
15 counts
-2000
to
+6300
0.2°C/
2 counts
0.360°F/
2 counts
-200
to
+630
1.0°C/
1 count
1.8°F/1
count
0.203°C/
4 counts
0.365°F/
4 counts
0.249°C/
3 counts
0.448°F/
3 counts
10Ω
Cu 426
15.381°C/
2800
counts
27.686°F/
2800
counts
-1000
to
+2600
15.4°C/
154
counts
27.72°F/
154
counts
-100
to
+260
16.0°C/
16
counts
28.8°F/
16
counts
15.381°C/
700 counts
27.686°F/
700 counts
15.406°C
/ 428
counts
27.732°F/
428
counts
120Ω
Ni 618
0.110°C/
20 counts
0.198°F/
20 counts
-1000
to
+2600
0.2°C/
2 counts
0.360°F/
2 counts
-100
to
+260
1.0°C/
1 count
1.8°F/
1 count
0.110°C/
5 counts
0.198°F/
5 counts
0.108°C/
3 counts
0.194°F/
3 counts
120Ω
Ni 672
0.042°C/
8 counts
0.075°F/
8 counts
-800 to
+2600
0.1°C/
1 count
0.18°F/
1 count
-80 to
+260
1.0°C/
1 count
1.8°F/
1 count
0.042°C/
2 counts
0.075°F/
2 counts
0.068°C/
2 counts
0.122°F/
2 counts
604Ω
NiFe
518
0.242°C/
44 counts
0.363°F/
44 counts
-1000
to
+2000
0.240°C/
2 counts
0.360°F/
2 counts
-100
to
+200
1.2°C/
1 count
1.8°F/
1 count
0.242°C/
11 counts
0.363°F/
11 counts
0.252°C/
7 counts
0.378°F/
7 counts
150Ω 0.078Ω / 34 counts 0 to
+15000
0.080Ω / 8 counts 0 to
+1500
0.10Ω /1 count 0.082Ω / 9 counts 0.090Ω / 6 counts
500Ω 0.046Ω / 6 counts 0 to
+5000
0.1Ω / 1 count 0 to
+500
1.0Ω /1 count 0.061Ω / 2 count 0.050Ω / 1 count
1000Ω 0.092Ω / 6 counts 0 to
+10000
0.1Ω / 1 count 0 to
+1000
1.0Ω /1 count 0.122Ω / 2 counts 0.100Ω / 1 count
3000Ω 0.641Ω / 14 counts 0 to
+30000
0.7Ω / 7 counts 0 to
+3000
1.0Ω /1 count 0.732Ω / 4 counts 0.900Ω / 3 counts