Datasheet

Section 19 A/D Converter
Rev. 4.00 Jun 06, 2006 page 571 of 1004
REJ09B0301-0400
H'3FF
H'3FE
H'3FD
H'004
H'003
H'002
H'001
H'000
1
1024
2
1024
1023
1024
1022
1024
FS
Quantization error
Digital output
Ideal A/D conversion
characteristic
Analog
input voltage
Figure 19.9 A/D Conversion Precision Definitions (1)
FS
Offset error
Nonlinearity
error
Actual A/D conversion
characteristic
Analog
input voltage
Digital output
Ideal A/D conversion
characteristic
Full-scale error
Figure 19.10 A/D Conversion Precision Definitions (2)