Lines Matching full:precision
4 double-precision arithmetic internally, so there are still
6 IEEE double-precision arithmetic.
51 /* On a machine with IEEE extended-precision registers, it is
52 * necessary to specify double-precision (53-bit) rounding precision
74 * 1. We only require IEEE, IBM, or VAX double-precision
104 * that use extended-precision instructions to compute rounded
112 * high-precision integer arithmetic. Whether this speeds things
131 * digits. When converting IEEE double precision values, the
159 * precision conversions (which could also be done by the strtog in