Lines Matching refs:DWord
9385 /// targeted at the same half of the final vector, and then use a dword shuffle
9389 /// The exact breakdown of how to form these dword pairs and align them on the
9429 // we can shuffle that half so each is splatted to a dword, then splat those
9490 // Compute the index of dword with only one word among the three inputs in
9505 // We use xor with one to compute the adjacent DWord to whichever one the
9533 auto FixFlippedInputs = [&V, &DL, &Mask, &DAG](int PinnedIdx, int DWord,
9538 // Determine whether the free index is in the flipped dword or the
9539 // unflipped dword based on where the pinned index is. We use this bit
9540 // in an xor to conditionally select the adjacent dword.
9541 int FixFreeIdx = 2 * (DWord ^ (PinnedIdx / 2 == DWord));
9601 // those dwords can then be moved to the correct half with a dword shuffle.
9603 // inputs into dwords, and finally a dword shuffle to place them.
9636 // a dword. We find the adjacent index by toggling the low bit.
9645 // Now gather the cross-half inputs and place them into a free dword of
9694 // Map the input's dword into the correct half.
9704 // as we will have mirrored the dword containing the element into the
9714 // Ensure we have the input in a viable dword of its current half. This
9733 // dword slot in the source mask.
9752 // The two inputs are in the same DWord but it is clobbered and the
9753 // adjacent DWord isn't used at all. Move both inputs to the free
9798 // Now hoist the DWord down to the right half.
9800 assert(PSHUFDMask[FreeDWord] < 0 && "DWord not free");
13213 // mov ecx, dword [rel _tls_index]: Load index (from C runtime)
14105 // Use TESTD/Q, extended vector to packed dword/qword.
18972 // 2. i8/i16 vector implemented using dword LZCNT vector instruction
25525 // Found another dword shuffle.
25530 // dword shuffle, and the high words are self-contained.
25540 // dword shuffle, and the low words are self-contained.
25550 // For either i8 -> i16 or i16 -> i32 unpacks, we can combine a dword
25953 // Map the word mask through the DWord mask.
