User manual

Calibration 2
U2300A Series DAQ Service Guide 39
Hence, the 16 bits binary read back calculation will be as
follows.
Bipolar:
Unipolar:
To perform a sample calculation of the conversion, take
the U2331A as an example. The resolution of U2331A is
12 bits and the range is taken as 10 V. The Int12b value
calculated using conversion algorithm is 12768.
LSB MSB
<11100000> <00110001>
= 12768
NOTE
The raw data provided by U2300A series DAQ devices is in the byte order
of LSB first.
Converted value
2 Int16 value×
2
resolution
--------------------------------------
⎝⎠
⎛⎞
Range×=
Example of converted value
2 12768×
2
16
------------------------
⎝⎠
⎛⎞
10× 3.896 V==
Converted value
Int16 value
2
resolution
----------------------------
0.5+
⎝⎠
⎛⎞
Range×=
Example of converted value
12768
2
16
---------------
0.5+
⎝⎠
⎛⎞
10× 6.948 V==
NOTE
The converted value is of float type. As such, you may need to type cast
the Int16 value to float in your programming environment.
LSB MSB
<11100000> <00110001>
= 12768