HomeSort by relevance Sort by last modified time
    Searched full:rounding (Results 651 - 675 of 1661) sorted by null

<<21222324252627282930>>

  /libcore/luni/src/main/native/
java_lang_RealToString.cpp 91 * 1.0e23 (caused too much rounding)
  /pdk/apps/CameraITS/tests/
test_capture_result.py 65 # there may be different interpolation and rounding used to get the
  /prebuilts/python/darwin-x86/2.7.5/lib/python2.7/bsddb/test/
test_lock.py 131 # Floating point rounding
  /prebuilts/python/darwin-x86/2.7.5/lib/python2.7/test/decimaltestdata/
ddLogB.decTest 27 rounding: half_even
ddMultiply.decTest 29 rounding: half_even
142 -- test some edge cases with exact rounding
451 -- for detecting tininess (before or after rounding) -- if after
452 -- rounding then the result would be the same, but the Underflow flag
ddNextMinus.decTest 28 rounding: half_even
ddNextPlus.decTest 28 rounding: half_even
dqLogB.decTest 27 rounding: half_even
dqNextMinus.decTest 28 rounding: half_even
dqNextPlus.decTest 28 rounding: half_even
invert.decTest 24 rounding: half_up
nextminus.decTest 24 rounding: half_up
nextplus.decTest 24 rounding: half_up
  /prebuilts/python/linux-x86/2.7.5/lib/python2.7/bsddb/test/
test_lock.py 131 # Floating point rounding
  /prebuilts/python/linux-x86/2.7.5/lib/python2.7/test/decimaltestdata/
ddLogB.decTest 27 rounding: half_even
ddMultiply.decTest 29 rounding: half_even
142 -- test some edge cases with exact rounding
451 -- for detecting tininess (before or after rounding) -- if after
452 -- rounding then the result would be the same, but the Underflow flag
ddNextMinus.decTest 28 rounding: half_even
ddNextPlus.decTest 28 rounding: half_even
dqLogB.decTest 27 rounding: half_even
dqNextMinus.decTest 28 rounding: half_even
dqNextPlus.decTest 28 rounding: half_even
invert.decTest 24 rounding: half_up
nextminus.decTest 24 rounding: half_up
nextplus.decTest 24 rounding: half_up
  /external/chromium_org/third_party/mesa/src/src/gallium/auxiliary/gallivm/
lp_bld_conv.c 171 * in the lowest significant bits of the mantissa, with correct rounding.
196 * multiplication followed by casting. No further rounding is necessary.
300 * followed by casting. No further rounding is necessary.

Completed in 827 milliseconds

<<21222324252627282930>>