| /prebuilts/clang/host/linux-x86/clang-4053586/lib64/clang/5.0/include/ |
| pmmintrin.h | 224 /// \brief Moves and duplicates one double-precision value to double-precision
236 /// A pointer to a double-precision value to be moved and duplicated.
241 /// \brief Moves and duplicates the double-precision value in the lower bits of
242 /// a 128-bit vector of [2 x double] to double-precision values stored in a
|
| /prebuilts/clang/host/linux-x86/clang-4393122/lib64/clang/5.0.1/include/ |
| pmmintrin.h | 226 /// \brief Moves and duplicates one double-precision value to double-precision
238 /// A pointer to a double-precision value to be moved and duplicated.
243 /// \brief Moves and duplicates the double-precision value in the lower bits of
244 /// a 128-bit vector of [2 x double] to double-precision values stored in a
|
| /prebuilts/clang/host/linux-x86/clang-4479392/lib64/clang/5.0.2/include/ |
| pmmintrin.h | 226 /// \brief Moves and duplicates one double-precision value to double-precision
238 /// A pointer to a double-precision value to be moved and duplicated.
243 /// \brief Moves and duplicates the double-precision value in the lower bits of
244 /// a 128-bit vector of [2 x double] to double-precision values stored in a
|
| /prebuilts/clang/host/linux-x86/clang-4579689/lib64/clang/6.0.1/include/ |
| pmmintrin.h | 226 /// \brief Moves and duplicates one double-precision value to double-precision
238 /// A pointer to a double-precision value to be moved and duplicated.
243 /// \brief Moves and duplicates the double-precision value in the lower bits of
244 /// a 128-bit vector of [2 x double] to double-precision values stored in a
|
| /prebuilts/clang/host/linux-x86/clang-4630689/lib64/clang/6.0.1/include/ |
| pmmintrin.h | 226 /// \brief Moves and duplicates one double-precision value to double-precision
238 /// A pointer to a double-precision value to be moved and duplicated.
243 /// \brief Moves and duplicates the double-precision value in the lower bits of
244 /// a 128-bit vector of [2 x double] to double-precision values stored in a
|
| /prebuilts/clang/host/linux-x86/clang-4639204/lib64/clang/6.0.1/include/ |
| pmmintrin.h | 226 /// \brief Moves and duplicates one double-precision value to double-precision
238 /// A pointer to a double-precision value to be moved and duplicated.
243 /// \brief Moves and duplicates the double-precision value in the lower bits of
244 /// a 128-bit vector of [2 x double] to double-precision values stored in a
|
| /prebuilts/clang/host/linux-x86/clang-4691093/lib64/clang/6.0.2/include/ |
| pmmintrin.h | 226 /// \brief Moves and duplicates one double-precision value to double-precision
238 /// A pointer to a double-precision value to be moved and duplicated.
243 /// \brief Moves and duplicates the double-precision value in the lower bits of
244 /// a 128-bit vector of [2 x double] to double-precision values stored in a
|
| /prebuilts/gdb/darwin-x86/lib/python2.7/test/decimaltestdata/ |
| tointegralx.decTest | 30 precision: 9
84 -- numbers around precision
85 precision: 9
167 precision: 9
243 precision: 16
|
| quantize.decTest | 28 precision: 9
340 precision: 9
357 precision: 7
366 precision: 9
408 precision: 8
435 precision: 7
461 precision: 6
487 precision: 3
514 precision: 3
534 precision:
[all...] |
| /prebuilts/gdb/linux-x86/lib/python2.7/test/decimaltestdata/ |
| tointegralx.decTest | 30 precision: 9
84 -- numbers around precision
85 precision: 9
167 precision: 9
243 precision: 16
|
| quantize.decTest | 28 precision: 9
340 precision: 9
357 precision: 7
366 precision: 9
408 precision: 8
435 precision: 7
461 precision: 6
487 precision: 3
514 precision: 3
534 precision:
[all...] |
| /prebuilts/python/darwin-x86/2.7.5/lib/python2.7/test/decimaltestdata/ |
| tointegralx.decTest | 30 precision: 9
84 -- numbers around precision
85 precision: 9
167 precision: 9
243 precision: 16
|
| quantize.decTest | 28 precision: 9
340 precision: 9
357 precision: 7
366 precision: 9
408 precision: 8
435 precision: 7
461 precision: 6
487 precision: 3
514 precision: 3
534 precision:
[all...] |
| /prebuilts/python/linux-x86/2.7.5/lib/python2.7/test/decimaltestdata/ |
| tointegralx.decTest | 30 precision: 9
84 -- numbers around precision
85 precision: 9
167 precision: 9
243 precision: 16
|
| quantize.decTest | 28 precision: 9
340 precision: 9
357 precision: 7
366 precision: 9
408 precision: 8
435 precision: 7
461 precision: 6
487 precision: 3
514 precision: 3
534 precision:
[all...] |
| /prebuilts/sdk/renderscript/clang-include/ |
| pmmintrin.h | 225 /// \brief Moves and duplicates one double-precision value to double-precision
237 /// A pointer to a double-precision value to be moved and duplicated.
242 /// \brief Moves and duplicates the double-precision value in the lower bits of
243 /// a 128-bit vector of [2 x double] to double-precision values stored in a
|
| /external/eigen/blas/testing/ |
| zblat2.f | 121 DOUBLE PRECISION RZERO
129 DOUBLE PRECISION EPS, ERR, THRESH
144 DOUBLE PRECISION G( NMAX )
149 DOUBLE PRECISION DDIFF
288 * Compute EPS (the machine precision).
404 9998 FORMAT( ' RELATIVE MACHINE PRECISION IS TAKEN TO BE', 1P, D9.1 )
455 DOUBLE PRECISION RZERO
458 DOUBLE PRECISION EPS, THRESH
469 DOUBLE PRECISION G( NMAX )
473 DOUBLE PRECISION ERR, ERRMA
[all...] |
| /prebuilts/gcc/linux-x86/host/x86_64-w64-mingw32-4.8/share/doc/mpfr/ |
| TODO | 56 - many functions currently taking into account the precision of the *input*
58 This is nonsense since the "average" working precision should only depend
59 on the precision of the *output* variable (and maybe on the *value* of
61 -> remove those dependencies from the input precision.
258 full precision when precision <= MPFR_EXP_THRESHOLD. The reason is
261 - speed up const_euler for large precision [for x=1.1, prec=16610, it takes
269 for precision 300 and k=1000, we get 1070ms, and 500ms only for p=400!
283 be less than the selected precision, thereby allowing low precision
[all...] |
| /device/linaro/bootloader/edk2/AppPkg/Applications/Python/Python-2.7.2/Lib/test/decimaltestdata/ |
| quantize.decTest | 28 precision: 9
340 precision: 9
357 precision: 7
366 precision: 9
408 precision: 8
435 precision: 7
461 precision: 6
487 precision: 3
514 precision: 3
534 precision: 9
[all...] |
| /external/deqp/external/vulkancts/modules/vulkan/ssbo/ |
| vktSSBOLayoutTests.cpp | 300 glu::Precision precision; local
304 // Precision.
305 static const glu::Precision precisionCandidates[] = { glu::PRECISION_LOWP, glu::PRECISION_MEDIUMP, glu::PRECISION_HIGHP };
306 precision = rnd.choose<glu::Precision>(&precisionCandidates[0], &precisionCandidates[DE_LENGTH_OF_ARRAY(precisionCandidates)]);
309 precision = glu::PRECISION_LAST;
311 return glu::VarType(type, precision);
1065 const glu::Precision precision = glu::Precision(precNdx); local
1078 const glu::Precision precision = glu::Precision(precNdx); local
[all...] |
| /external/python/cpython2/Lib/test/decimaltestdata/ |
| quantize.decTest | 28 precision: 9
340 precision: 9
357 precision: 7
366 precision: 9
408 precision: 8
435 precision: 7
461 precision: 6
487 precision: 3
514 precision: 3
534 precision:
[all...] |
| /external/python/cpython3/Lib/ |
| _pydecimal.py | 26 Decimal floating point has finite precision with arbitrarily large bounds.
283 longer than precision). The result is [0,qNaN].
317 on creation and either the precision exceeds the capability of the
335 operation (or sequence of operations) caused a loss of precision.
363 current precision, with the sign of the intermediate result. For
519 # uses a precision 2 greater than normal
520 return +s # Convert result to normal precision
[all...] |
| /external/python/cpython3/Lib/test/decimaltestdata/ |
| quantize.decTest | 28 precision: 9
340 precision: 9
357 precision: 7
366 precision: 9
408 precision: 8
435 precision: 7
461 precision: 6
487 precision: 3
514 precision: 3
534 precision:
[all...] |
| /external/python/cpython2/Lib/ |
| decimal.py | 30 Decimal floating point has finite precision with arbitrarily large bounds.
255 longer than precision). The result is [0,qNaN].
289 on creation and either the precision exceeds the capability of the
307 operation (or sequence of operations) caused a loss of precision.
335 current precision, with the sign of the intermediate result. For
473 # uses a precision 2 greater than normal
474 return +s # Convert result to normal precision
[all...] |
| /prebuilts/gdb/darwin-x86/lib/python2.7/ |
| decimal.py | 30 Decimal floating point has finite precision with arbitrarily large bounds.
256 longer than precision). The result is [0,qNaN].
290 on creation and either the precision exceeds the capability of the
308 operation (or sequence of operations) caused a loss of precision.
336 current precision, with the sign of the intermediate result. For
474 # uses a precision 2 greater than normal
475 return +s # Convert result to normal precision
[all...] |
