Lines Matching full:precision
531 * on C doubles is set to use 53-bit precision. It also requires that the
534 * If your FPU isn't already set to 53-bit precision/round-half-to-even, and
542 * set FPU to 53-bit precision/round-half-to-even
600 /* If we can't guarantee 53-bit precision, don't use the code
607 (2) we're on x86 with the rounding precision set to 64-bits
608 (extended precision), and we don't know how to change
609 the rounding precision.
618 /* double rounding is symptomatic of use of extended precision on x86. If
620 changing the FPU rounding precision, then don't use Python/dtoa.c. */
