Lines Matching full:rounding
123 * accurate to the requested precision; no cumulative rounding errors
325 // Multiply by 2**n, rounding result
1036 // Rounding error from the cale call is <= 1/2 ulp, so that
1137 // to the rounding error, and the final rounding adds
1169 // final rounding introduces a 0.5 ulp
1203 // Total rounding error in series computation is
1211 // Sum of term eval. rounding error is < 1/16 ulp.
1213 // Final rounding error is <= 1/2 ulp.
1245 // Total rounding error in series computation is
1253 // Cumulative arithmetic rounding error is < 1/16 ulp.
1255 // Final rounding error is <= 1/2 ulp.
1290 // Total rounding error in series computation is
1296 // Cumulative arithmetic rounding error is < 1/4 ulp.
1298 // Final rounding error is <= 1/2 ulp.
1394 // Total rounding error in series computation is
1406 // Cumulative arithmetic rounding error is < 3/16 ulp (relative to p).
1410 // Final rounding error is <= 1/2 ulp.
1440 // Remove extra 2 bits. 1/2 ulp rounding error.
1441 // Current_factor has original 3 ulp rounding error, which we
1442 // reduced by 1, plus < 1 ulp new rounding error.