TM 5-3895-374-10APPENDIXB............................................................................................................................................... DATA RANGE and PRECISIONAll computations and variables stored within the computer are done in floating point. Floating point numbers have aprecision of nine (9) digits and may be in the range of 10-36 to 10+36.Even though numbers are often displayed on thescreen or printed at the printer with less precision, the number is maintained in the computer with full 9 digit precision. Forexample:actual valuefloating point value-.0935674281-9.35674281X 10-20.9356742819.35674281X 10-19.356742819.3567428193.56742819.35674281X 101-935.674281-9.35674281X 102page F - 105SYSTEMS Equipment Corp. 8/31/89 Page (57)
Integrated Publishing, Inc. - A (SDVOSB) Service Disabled Veteran Owned Small Business
