Konstantinos Margaritis
41b98d7d8f
add len parameter to arm matchers as well
2021-11-08 19:45:36 +00:00
Konstantinos Margaritis
dcf6b59e8d
split vermicelli block implementations per arch
2021-11-08 19:45:21 +00:00
Konstantinos Margaritis
24fa54081b
add len parameter and mask, fixes corner cases on AVX512
2021-11-05 14:30:22 +02:00
Konstantinos Margaritis
210295a702
remove vermicelli.h and replace it with vermicelli.hpp
2021-11-02 22:30:53 +02:00
Konstantinos Margaritis
869d2bd53b
refactor vermicelliDoubleMaskedExec()
2021-11-02 22:30:21 +02:00
Konstantinos Margaritis
f6fd845400
complete refactoring and unification of Vermicelli functions
2021-11-01 16:28:50 +00:00
Konstantinos Margaritis
d47641c2fc
remove unneeded header
2021-11-01 16:28:50 +00:00
Konstantinos Margaritis
bc1a1127cf
add new include file
2021-11-01 16:28:50 +00:00
Konstantinos Margaritis
5eabceddcf
renamed matcher functions, added new ones for Vermicelli
2021-11-01 16:28:50 +00:00
Konstantinos Margaritis
16e5e2ae64
nits
2021-11-01 16:05:43 +00:00
Konstantinos Margaritis
713aaef799
move casemask helper functions to separate header
2021-11-01 16:05:43 +00:00
Konstantinos Margaritis
2fa947af9c
added refactored vermicelli_simd.cpp implementation
2021-11-01 16:05:43 +00:00
Konstantinos Margaritis
7b65b298c1
add arm vector types in union, avoid -flax-conversions, fix castings
2021-11-01 16:52:17 +02:00
Konstantinos Margaritis
4e044d4142
Add missing copyright info from tampered files
2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
c3baf3d296
fix multiple/undefined symbols when using fat runtimes
2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
2d9f52d03e
add arm truffle block function
2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
9d0c15c448
add simd_onebit_masks as static in arm simd_utils.h as well
2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
aea10b8ab0
simplify truffle and provide arch-specific block functions
2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
623c64142b
simplify shufti and provide arch-specific block functions
2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
577e03e0c7
rearrange method declarations
2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
9c54412447
remove simd_utils.c
2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
8b7ba89cb5
add x86 vsh* implementations
2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
eebd6c97bc
use movemask
2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
6ceab8435d
add header define to avoid double inclusion
2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
fad39b6058
optimize and simplify Shufti and Truffle to work with a single block method instead
2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
9e6c1c30cf
remove asserts, as they are not needed
2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
fa3d509fad
firstMatch/lastMatch are now arch-dependent, emulating movemask on non-Intel is very costly, the alternative is almost twice as fast on Arm
2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
9ab18cf419
fix for new pshufb
2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
67e0674df8
Changes/Additions to SuperVector class * added ==,!=,>=,>,<=,< operators * reworked shift operators to be more uniform and orthogonal, like Arm ISA * Added Unroller class to allow handling of multiple cases but avoid code duplication * pshufb method can now emulate Intel or not (avoids one instruction).
2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
e7161fdfec
initial SSE/AVX2 implementation
2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
08357a096c
remove Windows/ICC support
2021-10-12 11:51:34 +03:00
apostolos
67fa6d2738
alignr methods for avx2 and avx512 added
2021-10-12 11:51:34 +03:00
apostolos
b3a20afbbc
limex_shuffle added and it's unit tests
2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
de30471edd
remove duplicate functions from previous merge
2021-10-12 11:51:34 +03:00
George Wort
a879715953
Move SVE functions into their own files.
...
Change-Id: I995ba4b7d2b558ee403693ee45d747d414d3b177
2021-10-12 11:51:34 +03:00
George Wort
6c6aee9682
Implement new DoubleVermicelli16 acceleration functions using SVE2
...
Change-Id: Id4a8ffca840caab930a6e78cc0dfd0fe7d320b4e
2021-10-12 11:51:34 +03:00
George Wort
25183089fd
Use SVE shufti for counting miracles.
...
Change-Id: Idd4aaf5bbc05fc90e9138c6fed385bc6ffa7b0b8
2021-10-12 11:51:34 +03:00
George Wort
00fff3f53c
Use SVE for double shufti.
...
Change-Id: I09e0d57bb8a2f05b613f6225dea79ae823136268
2021-10-12 11:51:34 +03:00
George Wort
c95a4c3dd1
Use SVE for single shufti.
...
Change-Id: Ic76940c5bb9b81a1c45d39e9ca396a158c50a7dc
2021-10-12 11:51:34 +03:00
George Wort
56ef2d5f72
Use SVE2 for counting miracles.
...
Change-Id: I048dc182e5f4e726b847b3285ffafef4f538e550
2021-10-12 11:51:34 +03:00
George Wort
ab5d4d9279
Replace USE_ARM_SVE with HAVE_SVE.
...
Change-Id: I469efaac197cba93201f2ca6eca78ca61be3054d
2021-10-12 11:51:34 +03:00
George Wort
8242f46ed7
Add Licence to state_compress and bitutils.
...
Change-Id: I958daf82e5aef5bd306424dcfa7812382b266d65
2021-10-12 11:51:34 +03:00
George Wort
df926ef62f
Implement new Vermicelli16 acceleration functions using SVE2.
...
The scheme utilises the MATCH and NMATCH instructions to
scan for 16 characters at the same rate as vermicelli
scans for one.
Change-Id: Ie2cef904c56651e6108593c668e9b65bc001a886
2021-10-12 11:51:34 +03:00
George Wort
c7086cb7f1
Add SVE2 support for dvermicelli
...
Change-Id: I056ef15e162ab6fb1f78964321ce893f4096367e
2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
a38324a5a3
add arm rshift128/rshift128
2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
603bc14cdd
fix failing corner case, add pshufb_maskz()
2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
e35b88f2c8
use STL make_unique, remove wrapper header, breaks C++17 compilation
2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
6f44a1aa26
remove low4bits from the arguments, fix cases that mostly affect loading large (64) vectors and falling out of bounds
2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
f2d9784979
fix loadu_maskz, add {l,r}shift128_var(), tab fixes
2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
f8ce0bb922
minor fixes, add 2 constructors from half size vectors
2021-10-12 11:51:34 +03:00