HomeSort by relevance Sort by last modified time
    Searched full:rounding (Results 101 - 125 of 2466) sorted by null

1 2 3 45 6 7 8 91011>>

  /frameworks/av/media/libstagefright/codecs/on2/h264dec/omxdl/arm11/vc/m4p2/src/
omxVCM4P2_MCReconBlock_s.s 50 ;// Similar to UHADD8 instruction, but with a rounding value of 1 added to
59 ;// $round 0 if no rounding to be added, 1 if rounding to be done
290 ;// $rndVal Assembler Variable. 0 for rounding, 1 for no rounding
293 ;// $sum0 (a + b + c + d + 1) / 4 : If no rounding
294 ;// (a + b + c + d + 2) / 4 : If rounding
300 IF $rndVal = 0 ;// rounding case
303 ELSE ;// Not rounding case
330 ;// alignment offsets and 2 types of rounding fla
    [all...]
  /hardware/intel/img/psb_video/src/
tng_yuv_processor.h 35 uint32_t coded_width; /* width of the image rounding up to nearest multiple of 16 */
36 uint32_t coded_height; /* height of the image rounding up to nearest multiple of 16 */
  /external/icu/android_icu4j/src/main/java/android/icu/math/
MathContext.java 23 /* 1998.06.05 Add Round (rounding modes) property */
51 * the algorithm to be used for rounding.
71 * The rounding mode constants have the same names and values as the
123 // The rounding modes match the original BigDecimal class values
125 * Rounding mode to round to a more positive number.
126 * Used as a setting to control the rounding mode used during a
135 * Rounding mode to round towards zero.
136 * Used as a setting to control the rounding mode used during a
145 * Rounding mode to round to a more negative number.
146 * Used as a setting to control the rounding mode used during
    [all...]
  /external/icu/icu4j/eclipse-build/plugins.template/com.ibm.icu.base/src/com/ibm/icu/math/
MathContext.java 22 /* 1998.06.05 Add Round (rounding modes) property */
50 * the algorithm to be used for rounding.
70 * The rounding mode constants have the same names and values as the
126 // The rounding modes match the original BigDecimal class values
128 * Rounding mode to round to a more positive number.
129 * Used as a setting to control the rounding mode used during a
139 * Rounding mode to round towards zero.
140 * Used as a setting to control the rounding mode used during a
150 * Rounding mode to round to a more negative number.
151 * Used as a setting to control the rounding mode used during
    [all...]
  /external/icu/icu4j/main/classes/core/src/com/ibm/icu/math/
MathContext.java 22 /* 1998.06.05 Add Round (rounding modes) property */
50 * the algorithm to be used for rounding.
70 * The rounding mode constants have the same names and values as the
126 // The rounding modes match the original BigDecimal class values
128 * Rounding mode to round to a more positive number.
129 * Used as a setting to control the rounding mode used during a
139 * Rounding mode to round towards zero.
140 * Used as a setting to control the rounding mode used during a
150 * Rounding mode to round to a more negative number.
151 * Used as a setting to control the rounding mode used during
    [all...]
  /external/valgrind/none/tests/ppc32/
test_dfp2.stdout.exp 3 test with rounding mode 0
20 test with rounding mode 1
37 test with rounding mode 2
54 test with rounding mode 3
71 test with rounding mode 4
88 test with rounding mode 5
105 test with rounding mode 6
122 test with rounding mode 7
140 test with rounding mode 0
157 test with rounding mode 1
    [all...]
test_dfp2.stdout.exp_Without_dcffix 3 test with rounding mode 0
20 test with rounding mode 1
37 test with rounding mode 2
54 test with rounding mode 3
71 test with rounding mode 4
88 test with rounding mode 5
105 test with rounding mode 6
122 test with rounding mode 7
140 test with rounding mode 0
157 test with rounding mode 1
    [all...]
  /external/valgrind/none/tests/s390x/
rounding-6.c 7 #include "rounding.h"
9 /* Test "convert to fixed" with rounding mode given in insn (m3 field)
10 Covers all generally available rounding modes that can be mapped to
93 /* Note when testing M3_NEAR need to set the FPC rounding mode
94 to something else. FPC rounding mode is NEAR by default.
95 Setting the FPC rounding mode to != NEAR is the only way to make
dfpconv.c 102 /* rounding mode is not used for the I64 -> D128 conversion */
105 /* Omit rounding mode value 0 and 2 as the current DFP rounding
  /bionic/libm/upstream-freebsd/lib/msun/src/
s_fma.c 66 * were lost to rounding. This adjustment negates the effects of double
67 * rounding when the result is added to another number with a higher
94 * Compute ldexp(a+b, scale) with a single rounding error. It is assumed
96 * double rounding does not occur.
133 * The current rounding mode must be round-to-nearest.
161 * Fused multiply-add: Compute x * y + z with a single rounding error.
169 * This algorithm is sensitive to the rounding precision. FPUs such
208 * will overflow, so we handle these cases specially. Rounding
269 * There is no need to worry about double rounding in directed
270 * rounding modes
    [all...]
s_fmal.c 66 * were lost to rounding. This adjustment negates the effects of double
67 * rounding when the result is added to another number with a higher
90 * Compute ldexp(a+b, scale) with a single rounding error. It is assumed
92 * double rounding does not occur.
125 * The current rounding mode must be round-to-nearest.
157 * Fused multiply-add: Compute x * y + z with a single rounding error.
196 * will overflow, so we handle these cases specially. Rounding
257 * There is no need to worry about double rounding in directed
258 * rounding modes.
s_fmaf.c 36 * Fused multiply-add: Compute x * y + z with a single rounding error.
40 * rounding occurs.
  /libcore/luni/src/test/java/libcore/java/math/
OldBigDecimalTest.java 88 // testing rounding Mode RoundingMode.CEILING
101 // testing rounding Mode RoundingMode.DOWN
113 // testing rounding Mode RoundingMode.FLOOR
124 // testing rounding Mode RoundingMode.HALF_DOWN
141 // testing rounding Mode RoundingMode.HALF_EVEN
163 // testing rounding Mode RoundingMode.HALF_UP
176 // testing rounding Mode RoundingMode.UNNECESSARY
183 // testing rounding Mode RoundingMode.UP
196 // testing invalid rounding modes
199 fail("IllegalArgumentException is not caught for wrong rounding mode")
    [all...]
  /external/libhevc/common/arm/
ihevc_inter_pred_chroma_vert_w16inp.s 155 vqrshrun.s16 d0,q0,#6 @rounding shift
156 vqrshrun.s16 d30,q15,#6 @rounding shift
213 vqrshrun.s16 d30,q15,#6 @rounding shift
228 vqrshrun.s16 d28,q14,#6 @rounding shift
241 vqrshrun.s16 d26,q13,#6 @rounding shift
253 vqrshrun.s16 d24,q12,#6 @rounding shift
266 vqrshrun.s16 d30,q15,#6 @rounding shift
280 vqrshrun.s16 d28,q14,#6 @rounding shift
295 vqrshrun.s16 d26,q13,#6 @rounding shift
305 vqrshrun.s16 d24,q12,#6 @rounding shif
    [all...]
ihevc_itrans_recon_4x4_ttype1.s 162 vqrshrn.s32 d14,q3,#shift_stage1_idct @ (pi2_out[0] + rounding ) >> shift_stage1_idct
163 vqrshrn.s32 d15,q4,#shift_stage1_idct @ (pi2_out[1] + rounding ) >> shift_stage1_idct
164 vqrshrn.s32 d16,q5,#shift_stage1_idct @ (pi2_out[2] + rounding ) >> shift_stage1_idct
165 vqrshrn.s32 d17,q6,#shift_stage1_idct @ (pi2_out[3] + rounding ) >> shift_stage1_idct
202 vqrshrn.s32 d0,q3,#shift_stage2_idct @ (pi2_out[0] + rounding ) >> shift_stage1_idct
203 vqrshrn.s32 d1,q4,#shift_stage2_idct @ (pi2_out[1] + rounding ) >> shift_stage1_idct
204 vqrshrn.s32 d2,q5,#shift_stage2_idct @ (pi2_out[2] + rounding ) >> shift_stage1_idct
205 vqrshrn.s32 d3,q6,#shift_stage2_idct @ (pi2_out[3] + rounding ) >> shift_stage1_idct
  /external/libhevc/common/arm64/
ihevc_inter_pred_chroma_vert_w16inp.s 160 sqrshrun v0.8b, v0.8h,#6 //rounding shift
161 sqrshrun v30.8b, v30.8h,#6 //rounding shift
220 sqrshrun v30.8b, v30.8h,#6 //rounding shift
236 sqrshrun v28.8b, v28.8h,#6 //rounding shift
249 sqrshrun v26.8b, v26.8h,#6 //rounding shift
263 sqrshrun v24.8b, v24.8h,#6 //rounding shift
276 sqrshrun v30.8b, v30.8h,#6 //rounding shift
290 sqrshrun v28.8b, v28.8h,#6 //rounding shift
306 sqrshrun v26.8b, v26.8h,#6 //rounding shift
316 sqrshrun v24.8b, v24.8h,#6 //rounding shif
    [all...]
  /external/icu/icu4c/source/i18n/
precision.h 32 * Handles rounding of number to prepare it for formatting.
55 * The rounding increment or zero if there is no rounding increment.
62 * any rounding is done. Default is FALSE.
73 * Controls the rounding mode that initVisibleDigits uses.
198 * Returns FALSE if this is not possible such as when rounding
208 * has no rounding increment set.
  /bionic/libc/upstream-openbsd/lib/libc/gdtoa/
dtoa.c 46 * when rounding the final digit up. This is often faster.
72 #define Rounding Flt_Rounds
134 int Rounding;
136 Rounding = Flt_Rounds;
138 Rounding = 1;
140 case FE_TOWARDZERO: Rounding = 0; break;
141 case FE_UPWARD: Rounding = 2; break;
142 case FE_DOWNWARD: Rounding = 3;
191 if (Rounding >= 2) {
193 Rounding = Rounding == 2 ? 0 : 2
    [all...]
  /external/compiler-rt/lib/builtins/
fp_mul_impl.inc 11 // rounding (to nearest, ties to even).
88 // Result is denormal before rounding
102 // Result is normal before rounding; insert the exponent.
110 // Final rounding. The final result may overflow to infinity, or underflow
112 // default IEEE-754 round-to-nearest, ties-to-even rounding mode.
  /external/valgrind/VEX/priv/
s390_defs.h 65 /* BFP Rounding mode as it is encoded in the m3 field of certain
79 /* BFP Rounding mode as it is encoded in bits [29:31] of the FPC register.
80 Only rounding modes 0..3 are universally supported. Others require
92 /* DFP Rounding mode as it is encoded in the m3 field of certain
114 /* DFP Rounding mode as it is encoded in bits [25:27] of the FPC register. */
  /libcore/harmony-tests/src/test/java/org/apache/harmony/tests/java/math/
BigIntegerConvertTest.java 88 * Rounding is needed.
89 * The rounding bit is 1 and the next bit to the left is 1.
101 * Rounding is needed.
102 * The rounding bit is 1 and the next bit to the left is 0
114 * Rounding is NOT needed.
126 * Rounding is needed.
138 * Rounding is needed.
139 * The rounding bit is 1 and the next bit to the left is 0
152 * Rounding is NOT needed.
165 * The rounding bit is 0
    [all...]
  /external/libvpx/libvpx/vpx_dsp/x86/
vpx_high_subpixel_bilinear_sse2.asm 25 movq xmm3, rcx ;rounding
48 paddd xmm0, xmm3 ;rounding
81 movq xmm4, rcx ;rounding
106 paddd xmm6, xmm4 ;rounding
107 paddd xmm0, xmm4 ;rounding
140 paddd xmm9, xmm4 ;rounding
  /bionic/libm/amd64/
fenv.c 37 * rounding direction constants defined above.
200 * The fegetround() function gets the current rounding direction.
209 * rounding mode. Reading the control word on the x87 turns
219 * The fesetround() function establishes the rounding direction represented by
220 * its argument `round'. If the argument is not equal to the value of a rounding
221 * direction macro, the rounding direction is not changed.
229 /* Check whether requested rounding direction is supported */
236 /* Set the rounding direction */
  /development/ndk/platforms/android-9/arch-x86/include/
fenv.h 61 /* Rounding modes */
81 /* C99 rounding control functions */
  /external/jemalloc/test/unit/
smoothstep.c 18 * rounding error distant from 1/2. Regarding rounding, each table

Completed in 850 milliseconds

1 2 3 45 6 7 8 91011>>