Lines Matching full:precision
373 * on C doubles is set to use 53-bit precision. It also requires that the
376 * If your FPU isn't already set to 53-bit precision/round-half-to-even, and
384 * set FPU to 53-bit precision/round-half-to-even
442 /* Set double precision / round to nearest. */ \
461 /* If we can't guarantee 53-bit precision, don't use the code
468 (2) we're on x86 with the rounding precision set to 64-bits
469 (extended precision), and we don't know how to change
470 the rounding precision.
479 /* double rounding is symptomatic of use of extended precision on x86. If
481 changing the FPU rounding precision, then don't use Python/dtoa.c. */
