HomeSort by relevance Sort by last modified time
    Searched full:precision (Results 2726 - 2750 of 7852) sorted by null

<<101102103104105106107108109110>>

  /device/linaro/bootloader/edk2/AppPkg/Applications/Python/Python-2.7.2/Lib/test/decimaltestdata/
dqCopy.decTest 25 precision: 34
dqCopyAbs.decTest 25 precision: 34
dqCopyNegate.decTest 25 precision: 34
dqMinus.decTest 25 precision: 34
dqPlus.decTest 25 precision: 34
rounding.decTest 36 precision: 5 -- for easier visual inspection
    [all...]
  /device/linaro/bootloader/edk2/AppPkg/Applications/Python/Python-2.7.2/Lib/test/
test_random.py 226 # This should pass whenever a C double has 53 bit precision.
317 # code. Create 2000 53-bit precision random floats. Compare only
349 # at least 53 bits of precision (the underlying algorithm suffers
378 # This should pass whenever a C double has 53 bit precision.
  /device/linaro/bootloader/edk2/EdkCompatibilityPkg/Foundation/Library/EdkIIGlueLib/Library/BasePrintLib/
PrintLibInternal.h 42 #define PRECISION 0x800
  /device/linaro/bootloader/edk2/IntelFsp2Pkg/FspSecCore/Ia32/
SaveRestoreSseNasm.inc 141 ; all exceptions masked, double-precision, round-to-nearest
  /device/linaro/bootloader/edk2/IntelFspPkg/FspSecCore/Ia32/
SaveRestoreSse.inc 138 ; all exceptions masked, double-precision, round-to-nearest
  /device/linaro/bootloader/edk2/OvmfPkg/Include/IndustryStandard/Xen/hvm/
params.h 89 /* Boolean: Enable virtual HPET (high-precision event timer)? (x86-only) */
  /device/linaro/bootloader/edk2/StdLib/LibC/Locale/
_wcstod.h 45 * Convert a string to a double-precision number.
  /external/ImageMagick/utilities/
identify.1 42 \-precision value maximum number of significant digits to print
identify.1.in 42 \-precision value maximum number of significant digits to print
  /external/apache-commons-math/src/main/java/org/apache/commons/math/dfp/
package.html 28 <li>Settable precision (but no mix between numbers using different settings)</li>
  /external/apache-commons-math/src/main/java/org/apache/commons/math/optimization/univariate/
BrentOptimizer.java 69 * <em>macheps</em> is the relative machine precision. {@code t} should be
  /external/autotest/client/tests/unixbench/
unixbench.py 135 Double-Precision Whetstone 55.0 1948.2 354.2
  /external/clang/include/clang/StaticAnalyzer/Core/PathSensitive/
ConstraintManager.h 172 /// conjured symbolic value in order to recover some precision.
  /external/clang/test/Analysis/
loop-widening.c 19 // FIXME loss of precision as a result of evaluating the widened loop body
  /external/compiler-rt/lib/builtins/
comparedf2.c 1 //===-- lib/comparedf2.c - Double-precision comparisons -----------*- C -*-===//
comparesf2.c 1 //===-- lib/comparesf2.c - Single-precision comparisons -----------*- C -*-===//
comparetf2.c 1 //===-- lib/comparetf2.c - Quad-precision comparisons -------------*- C -*-===//
  /external/compiler-rt/lib/sanitizer_common/tests/
sanitizer_printf_test.cc 143 TEST(Printf, Precision) {
  /external/crcalc/
impl.html 59 producing variable precision intervals is probably more efficient
  /external/deqp/doc/
qpa_file_format.txt 77 [tag] = Performance,Quality,Precision,Time

Completed in 866 milliseconds

<<101102103104105106107108109110>>