Commit Graph

1297 Commits

Author SHA1 Message Date
George Wort
ceb230c7db Replace USE_ARM_SVE with HAVE_SVE.
Change-Id: I469efaac197cba93201f2ca6eca78ca61be3054d
2021-10-12 11:51:34 +03:00
George Wort
7ba060bbf8 Add Licence to state_compress and bitutils.
Change-Id: I958daf82e5aef5bd306424dcfa7812382b266d65
2021-10-12 11:51:34 +03:00
George Wort
b54710d208 Implement new Vermicelli16 acceleration functions using SVE2.
The scheme utilises the MATCH and NMATCH instructions to
scan for 16 characters at the same rate as vermicelli
scans for one.

Change-Id: Ie2cef904c56651e6108593c668e9b65bc001a886
2021-10-12 11:51:34 +03:00
George Wort
b6a7ee7e84 Add SVE2 support for dvermicelli
Change-Id: I056ef15e162ab6fb1f78964321ce893f4096367e
2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
3296d538ea add arm rshift128/rshift128 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
0033cec725 fix failing corner case, add pshufb_maskz() 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
5adbfc94b8 use STL make_unique, remove wrapper header, breaks C++17 compilation 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
0ec5dc37ca remove low4bits from the arguments, fix cases that mostly affect loading large (64) vectors and falling out of bounds 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
dca605d187 fix loadu_maskz, add {l,r}shift128_var(), tab fixes 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
2012c503b6 minor fixes, add 2 constructors from half size vectors 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
1fe06faffe fix lastMatch<64> 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
3b8f70af70 provide an {l,r}shift128_var() to fix immediate value build failure in loadu_maskz 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
744125bd53 fix arm loadu_maskz() 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
8b612c3923 add arm rshift128/rshift128 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
03e7d788b6 use rshift128() instead of vector-wide right shift 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
5fd1ed58e6 add {l,r}shift128()+tests, rename printv_u64() to print64() 2021-10-12 11:51:34 +03:00
George Wort
ace6cd15f2 Use SVE2 Bitperm's bdep instruction in bitutils and state_compress
Specifically for pdep64, expand32, and expand64 in bitutils,
as well as all of the loadcompressed functions used in
state_compress.

Change-Id: I92851bd12481dbee6a7e344df0890c4901b56d01
2021-10-12 11:51:34 +03:00
George Wort
7e5138b78f Fix CROSS_COMPILE_AARCH64 for SVE issues.
Change-Id: I7b9ba3ccb754d96eee22ca01714c783dae1e4956
2021-10-12 11:51:34 +03:00
George Wort
acfa11a34f Add SVE2 support for vermicelli
Change-Id: Ia025de53521fbaefe5fb1e4425aaf75c7d80a14e
2021-10-12 11:51:34 +03:00
George Wort
b2332218a4 Remove possibly undefined behaviour from Noodle.
Change-Id: I9a7997cea6a48927cb02b00c5dba5009bbf83850
2021-10-12 11:51:34 +03:00
George Wort
ddffd031ed Remove first check from scanDouble Noodle.
Change-Id: I00eabb3cb06ef6a2060df52c26fa8591907a2711
2021-10-12 11:51:34 +03:00
apostolos
b1dfc6abc4 Supervector test fixes 2021-10-12 11:51:34 +03:00
apostolos
a369e3aa53 SuperVector AVX512 implementations 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
5c601e2505 really fix lshift for avx2 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
f16abb1789 fix truffle SIMD for S>16 as well 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
f50ba1096b add AVX2 specializations 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
7c82af0089 lots of fixes to AVX2 implementation 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
69e708e3fd convert print helper functions to class methods 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
2a7e6b71bc fix last failing Shufti/Truffle tests 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
07960672d7 fix arm SuperVector implementation 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
db72de41ba fix rtruffle, was failing Lbr and a few ReverseTruffle tests 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
36e8a55bf5 fix x86 debug alignr 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
ff02749a73 move firstMatch, lastMatch to own header in util 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
31aca74801 minor fixes 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
472b119e35 compilation fixes for debug mode 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
176fa17970 fix arm implementation of alignr() 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
f59be47288 harmonise syntax of x86 SuperVector impl.cpp like arm, fix alignr, define printv_* functions when on debug mode only 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
ec1858febd style fixes 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
fe2596ff5b removed obsolete file 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
c2a5de03e0 rename supervector class header, use dup_*() functions names instead of set1_*(), minor fixes 2021-10-12 11:51:34 +03:00
apostolos
bab390d442 Truffle simd vectorized 2021-10-12 11:51:34 +03:00
George Wort
db26cdd4bf Fix error in initial noodle double final call.
Change-Id: Ie044988f183b47e0b2f1eed3b4bd23de75c3117d
2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
ca8b6932f2 nits 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
cb0bcbccdb fix typo 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
24b984483b fix unit tests, and resp. ARM SuperVector methods based on those unit tests, add print functions for SuperVector 2021-10-12 11:51:34 +03:00
George Wort
0ba1cbb32b Add SVE2 support for noodle
Change-Id: Iacb7d1f164bdd0ba50e2e13d26fe548cf9b45a6a
2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
fb71288740 add missing ARM SuperVector methods, some tests still fail, WIP 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
9258894087 rename arm impl.hpp to impl.cpp, add operator|() to SuperVector class 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
f689179a82 refactor shufti algorithm to use SuperVector class, WIP 2021-10-12 11:51:34 +03:00
George Wort
d59f11dc01 Add SVE, SVE2, and SVE2_BITPERM as targets
Change-Id: I5231e2eb0a31708a16c853dc83ea48db32e0b0a5
2021-10-12 11:51:34 +03:00