Commit Graph

70 Commits

Author SHA1 Message Date
Konstantinos Margaritis
2b3d0a355b Add missing copyright info from tampered files 2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
45f395245b add simd_onebit_masks as static in arm simd_utils.h as well 2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
f2e45ccc06 remove simd_utils.c 2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
3248393d1a use movemask 2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
5563f0c3b6 firstMatch/lastMatch are now arch-dependent, emulating movemask on non-Intel is very costly, the alternative is almost twice as fast on Arm 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
cf4b95fff2 remove Windows/ICC support 2021-10-12 11:51:34 +03:00
George Wort
3bdd48fd61 Move SVE functions into their own files.
Change-Id: I995ba4b7d2b558ee403693ee45d747d414d3b177
2021-10-12 11:51:34 +03:00
George Wort
87ee8d4d7f Use SVE for single shufti.
Change-Id: Ic76940c5bb9b81a1c45d39e9ca396a158c50a7dc
2021-10-12 11:51:34 +03:00
George Wort
7ba060bbf8 Add Licence to state_compress and bitutils.
Change-Id: I958daf82e5aef5bd306424dcfa7812382b266d65
2021-10-12 11:51:34 +03:00
George Wort
b6a7ee7e84 Add SVE2 support for dvermicelli
Change-Id: I056ef15e162ab6fb1f78964321ce893f4096367e
2021-10-12 11:51:34 +03:00
George Wort
ace6cd15f2 Use SVE2 Bitperm's bdep instruction in bitutils and state_compress
Specifically for pdep64, expand32, and expand64 in bitutils,
as well as all of the loadcompressed functions used in
state_compress.

Change-Id: I92851bd12481dbee6a7e344df0890c4901b56d01
2021-10-12 11:51:34 +03:00
George Wort
acfa11a34f Add SVE2 support for vermicelli
Change-Id: Ia025de53521fbaefe5fb1e4425aaf75c7d80a14e
2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
d72038bc31 fix compilation on C++ 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
7262ae8b74 simplify function 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
bc2e3dfd2e add arm support for the new SuperVector class 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
c3101d53f4 add C++ template SIMD library (WIP) 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
317fb3dcfc add global definitions for CHUNKSIZE/VECTORSIZE, define HAVE_AVX512* only when BUILD_AVX512 is also enabled 2021-10-12 11:51:33 +03:00
Konstantinos Margaritis
5171627e3b fix typo 2021-10-12 11:51:33 +03:00
Konstantinos Margaritis
73bab6346d fix some AVX512 function names, to fix AVX512 build failure, also rename the expand* functions to broadcast*() ones for consistency 2021-02-15 13:54:19 +02:00
Konstantinos Margaritis
2a2609229c fix x86 implementations for compress128/expand128 2021-02-15 13:54:19 +02:00
Konstantinos Margaritis
71c59a95e9 add BUILD_AVX2 definition, enable non-AVX2 building selectively 2021-02-15 13:54:19 +02:00
Konstantinos Margaritis
e2ed30f42c fixes in shifting primitives 2021-02-08 19:38:20 +02:00
Konstantinos Margaritis
2ebb7d2b21 bugfix compress128/expand128, add unit tests 2021-02-08 19:20:37 +02:00
Konstantinos Margaritis
1e41465eff make const 2021-02-08 19:19:52 +02:00
Wang Xiang W
723b469cf7 Limex: exception handling with AVX512 2021-01-25 14:13:13 +02:00
Chang, Harry
86b57e409f Add cpu feature / target info "AVX512VBMI". 2021-01-25 14:13:13 +02:00
Zhu,Wenjun
1c8c7ea806 MCSHENG64: extend to 64-state based on mcsheng 2021-01-25 14:13:13 +02:00
Hong, Yang A
8436f95f24 lookaround:
add 64x8 and 64x16 shufti models
add mask64 model
expand entry quantity
2021-01-25 14:13:13 +02:00
Konstantinos Margaritis
444bec59fb remove loads from movemask128, variable_byte_shift, add palignr_imm(), minor fixes 2021-01-25 12:13:35 +02:00
Konstantinos Margaritis
72e044fc16 fix non-const char * write-strings compile error 2021-01-25 12:13:35 +02:00
Konstantinos Margaritis
f30ced88c2 add some useful intrinsics 2021-01-25 12:13:35 +02:00
Konstantinos Margaritis
0b14b24616 add expand128() implementation for NEON 2021-01-25 12:13:35 +02:00
Konstantinos Margaritis
59af972d72 fix IA32 build, as we need minimum SSSE3 support for compilation to succeed 2020-12-30 19:57:44 +02:00
Konstantinos Margaritis
bddf7b9209 fix x86 compilation 2020-12-08 11:42:30 +02:00
Konstantinos Margaritis
9716197623 optimize *shiftbyte_m128() functions to use palign instead of variable_byte_shift_m128() 2020-12-07 23:12:26 +02:00
Konstantinos Margaritis
ffbb6eb548 fix movq and load_m128_from_u64a and resp. test for NEON 2020-12-03 19:27:38 +02:00
Konstantinos Margaritis
fe2fbc4af8 define debug vector print functions to NULL in non-debug mode 2020-12-03 19:27:05 +02:00
Konstantinos Margaritis
fe4196da3e helper functions to print a m128 vector in debug mode 2020-11-24 17:57:16 +02:00
Konstantinos Margaritis
505d7215c3 when building in debug mode, vgetq_lane_*() and vextq_*() need immediate operands, and we have to use switch()'ed versions 2020-11-24 17:56:40 +02:00
Konstantinos Margaritis
1d02082052 remove debug from functions 2020-11-05 20:33:17 +02:00
Konstantinos Margaritis
c728b76898 add compress128 function and implementation 2020-11-05 19:20:06 +02:00
Konstantinos Margaritis
5e2d704bcd add extra instructions (currently arm-only), fix order of elements in set4x32/set2x64 2020-11-05 19:18:53 +02:00
Konstantinos Margaritis
c9b338fd6c fix ARM implementations 2020-10-30 10:38:41 +02:00
Konstantinos Margaritis
d48a4d6171 don't redefine function on x86 2020-10-16 13:09:08 +03:00
Konstantinos Margaritis
a34cbf8edb scalar implementations of diffrich256 and diffrich384 2020-10-16 13:02:40 +03:00
Konstantinos Margaritis
7248399f8a Revert "move x86 popcount.h implementations to util/arch/x86/popcount.h"
This reverts commit 6581aae90e.
2020-10-16 12:32:44 +03:00
Konstantinos Margaritis
75aadb76f8 split arch-agnostic simd_utils.h functions into the common file 2020-10-16 12:30:34 +03:00
Konstantinos Margaritis
74919026c3 fix compilation paths for cpuid_flags for x86 2020-10-16 12:29:45 +03:00
Konstantinos Margaritis
6ff47528ba add scalar versions of the vectorized functions for architectures that don't support 256-bit/512-bit SIMD vectors such as ARM 2020-10-15 16:30:18 +03:00
Konstantinos Margaritis
08c3114090 add ARM simd_utils vectorized functions for 128-bit vectors 2020-10-15 16:26:49 +03:00