Home	Sort by relevance Sort by last modified time

Full Search Definition Symbol File Path History   | | Help

    Searched full:underflow (Results 26 - 50 of 1078) sorted by null

12 3 4 5 6 7 8 91011>>

/prebuilts/python/darwin-x86/2.7.5/lib/python2.7/test/decimaltestdata/
ddBase.decTest	[all...]
dqBase.decTest	[all...]
dsBase.decTest	[all...]
minus.decTest	117 -- subnormals and underflow 127 minx115 minus 0.999E-999 -> -1.00E-999 Inexact Rounded Subnormal Underflow 128 minx116 minus 0.099E-999 -> -1.0E-1000 Inexact Rounded Subnormal Underflow 129 minx117 minus 0.009E-999 -> -1E-1001 Inexact Rounded Subnormal Underflow 130 minx118 minus 0.001E-999 -> -0E-1001 Inexact Rounded Subnormal Underflow Clamped 131 minx119 minus 0.0009E-999 -> -0E-1001 Inexact Rounded Subnormal Underflow Clamped 132 minx120 minus 0.0001E-999 -> -0E-1001 Inexact Rounded Subnormal Underflow Clamped 140 minx135 minus -0.999E-999 -> 1.00E-999 Inexact Rounded Subnormal Underflow 141 minx136 minus -0.099E-999 -> 1.0E-1000 Inexact Rounded Subnormal Underflow 142 minx137 minus -0.009E-999 -> 1E-1001 Inexact Rounded Subnormal Underflow     [all...]
power.decTest	252 powx392 power 0.099 999 -> 4.360732062E-1004 Underflow Subnormal Inexact Rounded 253 powx393 power 0.098 999 -> 1.71731E-1008 Underflow Subnormal Inexact Rounded 254 powx394 power 0.097 999 -> 6E-1013 Underflow Subnormal Inexact Rounded 255 powx395 power 0.096 999 -> 0E-1013 Underflow Subnormal Inexact Rounded Clamped 256 powx396 power 0.01 999 -> 0E-1013 Underflow Subnormal Inexact Rounded Clamped 257 powx397 power 0.02 100000000 -> 0E-1013 Underflow Subnormal Inexact Rounded Clamped 260 -- of underflow 266 mulx400 multiply 1E-502 1e-502 -> 0E-1003 Subnormal Inexact Underflow Rounded Clamped 274 powx400 power 1E-502 2 -> 0E-1003 Underflow Subnormal Inexact Rounded Clamped 283 mulx410 multiply 1E-670 1e-335 -> 0E-1003 Underflow Subnormal Inexact Rounded Clampe     [all...]
base.decTest	[all...]
add.decTest	[all...]
fma.decTest	283 -- test some cases that are close to exponent overflow/underflow 591 -- overflow and underflow tests .. note subnormal results 608 fmax2755 fma 1e-777777 1e-411111 0E+999999 -> 0E-1000007 Underflow Subnormal Inexact Rounded Clamped 609 fmax2756 fma 1e-777777 -1e-411111 0E+999999 -> -0E-1000007 Underflow Subnormal Inexact Rounded Clamped 610 fmax2757 fma -1e-777777 1e-411111 0E+999999 -> -0E-1000007 Underflow Subnormal Inexact Rounded Clamped 611 fmax2758 fma -1e-777777 -1e-411111 0E+999999 -> 0E-1000007 Underflow Subnormal Inexact Rounded Clamped 613 -- 'subnormal' boundary (all hard underflow or overflow in base arithemtic)     [all...]
squareroot.decTest	[all...]
/prebuilts/python/linux-x86/2.7.5/lib/python2.7/test/decimaltestdata/
ddBase.decTest	[all...]
dqBase.decTest	[all...]
dsBase.decTest	[all...]
minus.decTest	117 -- subnormals and underflow 127 minx115 minus 0.999E-999 -> -1.00E-999 Inexact Rounded Subnormal Underflow 128 minx116 minus 0.099E-999 -> -1.0E-1000 Inexact Rounded Subnormal Underflow 129 minx117 minus 0.009E-999 -> -1E-1001 Inexact Rounded Subnormal Underflow 130 minx118 minus 0.001E-999 -> -0E-1001 Inexact Rounded Subnormal Underflow Clamped 131 minx119 minus 0.0009E-999 -> -0E-1001 Inexact Rounded Subnormal Underflow Clamped 132 minx120 minus 0.0001E-999 -> -0E-1001 Inexact Rounded Subnormal Underflow Clamped 140 minx135 minus -0.999E-999 -> 1.00E-999 Inexact Rounded Subnormal Underflow 141 minx136 minus -0.099E-999 -> 1.0E-1000 Inexact Rounded Subnormal Underflow 142 minx137 minus -0.009E-999 -> 1E-1001 Inexact Rounded Subnormal Underflow     [all...]
power.decTest	252 powx392 power 0.099 999 -> 4.360732062E-1004 Underflow Subnormal Inexact Rounded 253 powx393 power 0.098 999 -> 1.71731E-1008 Underflow Subnormal Inexact Rounded 254 powx394 power 0.097 999 -> 6E-1013 Underflow Subnormal Inexact Rounded 255 powx395 power 0.096 999 -> 0E-1013 Underflow Subnormal Inexact Rounded Clamped 256 powx396 power 0.01 999 -> 0E-1013 Underflow Subnormal Inexact Rounded Clamped 257 powx397 power 0.02 100000000 -> 0E-1013 Underflow Subnormal Inexact Rounded Clamped 260 -- of underflow 266 mulx400 multiply 1E-502 1e-502 -> 0E-1003 Subnormal Inexact Underflow Rounded Clamped 274 powx400 power 1E-502 2 -> 0E-1003 Underflow Subnormal Inexact Rounded Clamped 283 mulx410 multiply 1E-670 1e-335 -> 0E-1003 Underflow Subnormal Inexact Rounded Clampe     [all...]
base.decTest	[all...]
add.decTest	[all...]
fma.decTest	283 -- test some cases that are close to exponent overflow/underflow 591 -- overflow and underflow tests .. note subnormal results 608 fmax2755 fma 1e-777777 1e-411111 0E+999999 -> 0E-1000007 Underflow Subnormal Inexact Rounded Clamped 609 fmax2756 fma 1e-777777 -1e-411111 0E+999999 -> -0E-1000007 Underflow Subnormal Inexact Rounded Clamped 610 fmax2757 fma -1e-777777 1e-411111 0E+999999 -> -0E-1000007 Underflow Subnormal Inexact Rounded Clamped 611 fmax2758 fma -1e-777777 -1e-411111 0E+999999 -> 0E-1000007 Underflow Subnormal Inexact Rounded Clamped 613 -- 'subnormal' boundary (all hard underflow or overflow in base arithemtic)     [all...]
squareroot.decTest	[all...]