Lines Matching full:precision
27 precision: 16
59 precision: 9
63 precision: 10
66 precision: 9
180 -- The Vienna case. Checks both setup and 1/acc working precision
187 precision: 3
195 precision: 7
230 precision: 9
248 precision: 15
261 precision: 5
300 precision: 5
345 precision: 9
477 precision: 9
485 precision: 15
496 precision: 9
516 precision: 9
585 precision: 9
586 -- [precision is 9, so smallest exponent is -1000000007
629 precision: 16
669 precision: 5
679 -- Below here are tests with a precision or context outside of the --
686 precision: 9
706 -- A (rare) case where the last digit is not within 0.5 ULP with classic precision
707 precision: 9
709 precision: 20
713 precision: 9
779 precision: 9
780 -- [precision is 9, so smallest exponent is -1000000007
827 precision: 16
846 precision: 4
848 precision: 3
856 precision: 9
861 precision: 5
869 precision: 3
910 precision: 9
927 precision: 16
1047 precision: 4
1061 precision: 50
1063 precision: 49
1065 precision: 48
1067 precision: 47
1069 precision: 46
1071 precision: 45
1073 precision: 44
1075 precision: 43
1077 precision: 42
1079 precision: 41
1081 precision: 40
1083 precision: 39
1085 precision: 38
1087 precision: 37
1089 precision: 36
1091 precision: 35
1093 precision: 34
1095 precision: 33
1097 precision: 32
1099 precision: 31
1101 precision: 30
1103 precision: 29
1105 precision: 28
1107 precision: 27
1109 precision: 26
1111 precision: 25
1113 precision: 24
1115 precision: 23
1117 precision: 22
1119 precision: 21
1121 precision: 20
1123 precision: 19
1125 precision: 18
1127 precision: 17
1129 precision: 16
1131 precision: 15
1133 precision: 14
1135 precision: 13
1137 precision: 12
1139 precision: 11
1141 precision: 10
1143 precision: 9
1145 precision: 8
1147 precision: 7
1149 precision: 6
1151 precision: 5
1153 precision: 4
1155 precision: 3
1157 precision: 2
1159 precision: 1
1164 precision: 16
1168 precision: 34
1192 Precision: 34
1235 Precision: 16
1278 Precision: 7
1321 Precision: 34
1364 Precision: 16
1407 Precision: 7
1452 precision: 100000000
1454 precision: 99999999
1457 precision: 9
1482 precision: 7
1559 precision: 7
1563 -- For x=nextfp(1)=1.00..001 (where the number of 0s is precision-2)
1591 -- For x=prevfp(1)=0.99..99 (where the number of 9s is precision)
