Datasheet

Section 16 A/D Converter (8 Analog Input Channel Version)
Rev.6.00 Sep. 27, 2007 Page 720 of 1268
REJ09B0220-0600
• Full-scale error
The deviation of the analog input voltage value from the ideal A/D conversion characteristic
when the digital output changes from B'1111111110 to B'1111111111. (See figure 16.9.)
• Quantization error
The deviation inherent in the A/D converter, given by 1/2 LSB. (See figure 16.8.)
• Nonlinearity error
The error with respect to the ideal A/D conversion characteristic between the zero voltage and
the full-scale voltage. Does not include the offset error, full-scale error, or quantization error.
• Absolute precision
The deviation between the digital value and the analog input value. Includes the offset error,
full-scale error, quantization error, and nonlinearity error.
111
110
101
100
011
010
001
000
FS
Quantization error
Digital output
Ideal A/D conversion
characteristic
Analog
input voltage
1
1024
2
1024
1022
1024
1023
1024
Figure 16.8 A/D Conversion Precision Definitions (1)