Lines Matching full:precision
23 precision: 9
142 -- Precision 1 squareroot tests [exhaustive, plus exponent adjusts]
146 precision: 1
220 -- Precision 2 squareroot tests [exhaustive, plus exponent adjusts]
224 precision: 2
1018 -- Precision 3 squareroot tests [exhaustive, f and f/10]
1022 precision: 3
2824 -- A group of precision 4 tests where Hull & Abrham adjustments are
2829 precision: 4
2849 precision: 9
2859 precision: 9
2869 precision: 10 -- note no normalizatoin here
2871 precision: 11
2873 precision: 12
2875 precision: 9
2877 precision: 15
2881 precision: 7
2892 precision: 5
2900 precision: 9
2908 precision: 20
2918 -- Etiny = -(Emax + (precision-1))
2922 precision: 9 -- Etiny=-17
2925 precision: 10 -- Etiny=-18
2929 precision: 11 -- Etiny=-19
2932 precision: 12 -- Etiny=-20
2936 precision: 13 -- Etiny=-21
2939 precision: 14 -- Etiny=-22
2945 precision: 16
2967 precision: 5
2976 -- (1) cases where the input precision exceeds the context precision, and
2981 -- cases; only the precision changes. The rounding also does not
2986 -- exact results, input precision > context precision
2987 precision: 1
3001 precision: 2
3105 precision: 3
3128 precision: 6
3221 precision: 1
3232 precision: 2
3324 precision: 6
3349 precision: 2
3361 -- precision 3, input precision <= 5
3362 precision: 3
3396 --precision 4, input precision <= 4
3397 precision: 4
3409 --precision 5, input precision <= 5
3410 precision: 5
3445 precision: 1
3467 precision: 2
3489 precision: 3
3511 precision: 6
3534 precision: 1
3539 precision: 2
3561 precision: 3
3580 -- result exactly representable with precision p, but not necessarily
3582 precision: 2
3589 precision: 3
3606 precision: 2
3627 precision: 3
3648 precision: 4
3671 precision: 1
3680 precision: 2
3692 precision: 6
3712 precision: 3
3719 precision: 5
3758 precision: 2
3760 precision: 3
3762 precision: 4
3766 precision: 4
3768 precision: 3
3770 precision: 2
3772 precision: 1
3776 precision: 7
3780 precision: 4
3811 precision: 15
3818 precision: 16
3825 -- High-precision exact and inexact
3828 precision: 400
