Commit Graph

46 Commits

Author SHA1 Message Date
Konstantinos Margaritis
89a85a8e90 HWCAP is only available on Linux 2023-09-08 10:08:44 +03:00
Konstantinos Margaritis
394d09fe45 initial attempt for fat binary on Aarch64 2023-08-23 09:42:00 +00:00
Konstantinos Margaritis
4b41c5fe25 [NEON] simplify/optimize shift/align primitives 2022-09-12 13:09:51 +00:00
Konstantinos Margaritis
0052df5f5b [NEON] optimize mask1bit128, get rid of simd_onebit_masks 2022-09-07 10:20:01 +00:00
Konstantinos Margaritis
76a31d1bc0 remove simd_onebit_masks from arm/x86 headers, as they moved to common 2022-09-07 12:41:32 +03:00
Danila Kutenin
45fe139224 Minor fix 2022-06-26 23:02:02 +00:00
Danila Kutenin
4b83ea1c78 Fix formatting of a couple files 2022-06-26 22:59:58 +00:00
Danila Kutenin
eb7b0bb50c Optimize vectorscan for aarch64 by using shrn instruction
This optimization is based on the thread
https://twitter.com/Danlark1/status/1539344279268691970 and uses
shift right and narrow by 4 instruction https://developer.arm.com/documentation/ddi0596/2020-12/SIMD-FP-Instructions/SHRN--SHRN2--Shift-Right-Narrow--immediate--

To achieve that, I needed to redesign a little movemask into comparemask
and have an additional step towards mask iteration. Our benchmarks
showed 10-15% improvement on average for long matches.
2022-06-26 22:55:45 +00:00
Daniel Kutenin
2360314f9d Optimized and correct version of movemask128 for ARM
Closes #99

https://gcc.godbolt.org/z/cTjKqzcvn

Previous version was not correct because movemask thought of having bytes 0xFF. We can fully match the semantics + do it faster with USRA instructions.

Re-submission to a develop branch
2022-04-18 13:37:53 +01:00
Konstantinos Margaritis
242a460115 minor fixes 2021-12-07 08:49:59 +00:00
Konstantinos Margaritis
b6ddf2b41c fix clang-release-arm compilation 2021-12-07 08:43:52 +00:00
Konstantinos Margaritis
f4ccc40c58 fix wrong castings for NEON 2021-12-06 21:35:51 +00:00
Konstantinos Margaritis
ef2bc5cfbc fix compilation with clang and some incomplete/wrong implementations for arm this time 2021-12-06 18:22:58 +00:00
Konstantinos Margaritis
959fea25f7 use __builtin_constant_p() instead for arm as well 2021-11-25 06:20:53 +00:00
Konstantinos Margaritis
a69fe428e3 add len parameter to arm matchers as well 2021-11-08 19:45:36 +00:00
Konstantinos Margaritis
54245bc5ac renamed matcher functions, added new ones for Vermicelli 2021-11-01 16:28:50 +00:00
Konstantinos Margaritis
5e59b36634 add arm vector types in union, avoid -flax-conversions, fix castings 2021-11-01 16:52:17 +02:00
Konstantinos Margaritis
2b3d0a355b Add missing copyright info from tampered files 2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
45f395245b add simd_onebit_masks as static in arm simd_utils.h as well 2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
f2e45ccc06 remove simd_utils.c 2021-10-12 11:51:35 +03:00
Konstantinos Margaritis
5563f0c3b6 firstMatch/lastMatch are now arch-dependent, emulating movemask on non-Intel is very costly, the alternative is almost twice as fast on Arm 2021-10-12 11:51:34 +03:00
George Wort
3bdd48fd61 Move SVE functions into their own files.
Change-Id: I995ba4b7d2b558ee403693ee45d747d414d3b177
2021-10-12 11:51:34 +03:00
George Wort
87ee8d4d7f Use SVE for single shufti.
Change-Id: Ic76940c5bb9b81a1c45d39e9ca396a158c50a7dc
2021-10-12 11:51:34 +03:00
George Wort
7ba060bbf8 Add Licence to state_compress and bitutils.
Change-Id: I958daf82e5aef5bd306424dcfa7812382b266d65
2021-10-12 11:51:34 +03:00
George Wort
b6a7ee7e84 Add SVE2 support for dvermicelli
Change-Id: I056ef15e162ab6fb1f78964321ce893f4096367e
2021-10-12 11:51:34 +03:00
George Wort
ace6cd15f2 Use SVE2 Bitperm's bdep instruction in bitutils and state_compress
Specifically for pdep64, expand32, and expand64 in bitutils,
as well as all of the loadcompressed functions used in
state_compress.

Change-Id: I92851bd12481dbee6a7e344df0890c4901b56d01
2021-10-12 11:51:34 +03:00
George Wort
acfa11a34f Add SVE2 support for vermicelli
Change-Id: Ia025de53521fbaefe5fb1e4425aaf75c7d80a14e
2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
bc2e3dfd2e add arm support for the new SuperVector class 2021-10-12 11:51:34 +03:00
Konstantinos Margaritis
e2ed30f42c fixes in shifting primitives 2021-02-08 19:38:20 +02:00
Konstantinos Margaritis
2ebb7d2b21 bugfix compress128/expand128, add unit tests 2021-02-08 19:20:37 +02:00
Konstantinos Margaritis
444bec59fb remove loads from movemask128, variable_byte_shift, add palignr_imm(), minor fixes 2021-01-25 12:13:35 +02:00
Konstantinos Margaritis
f30ced88c2 add some useful intrinsics 2021-01-25 12:13:35 +02:00
Konstantinos Margaritis
0b14b24616 add expand128() implementation for NEON 2021-01-25 12:13:35 +02:00
Konstantinos Margaritis
9716197623 optimize *shiftbyte_m128() functions to use palign instead of variable_byte_shift_m128() 2020-12-07 23:12:26 +02:00
Konstantinos Margaritis
ffbb6eb548 fix movq and load_m128_from_u64a and resp. test for NEON 2020-12-03 19:27:38 +02:00
Konstantinos Margaritis
505d7215c3 when building in debug mode, vgetq_lane_*() and vextq_*() need immediate operands, and we have to use switch()'ed versions 2020-11-24 17:56:40 +02:00
Konstantinos Margaritis
1d02082052 remove debug from functions 2020-11-05 20:33:17 +02:00
Konstantinos Margaritis
c728b76898 add compress128 function and implementation 2020-11-05 19:20:06 +02:00
Konstantinos Margaritis
5e2d704bcd add extra instructions (currently arm-only), fix order of elements in set4x32/set2x64 2020-11-05 19:18:53 +02:00
Konstantinos Margaritis
c9b338fd6c fix ARM implementations 2020-10-30 10:38:41 +02:00
Konstantinos Margaritis
a34cbf8edb scalar implementations of diffrich256 and diffrich384 2020-10-16 13:02:40 +03:00
Konstantinos Margaritis
08c3114090 add ARM simd_utils vectorized functions for 128-bit vectors 2020-10-15 16:26:49 +03:00
Konstantinos Margaritis
64535610f5 add arm simple cpuid_flags 2020-10-15 16:26:04 +03:00
Konstantinos Margaritis
d3b33ac02d add ARM version of simd_utils.h 2020-10-13 09:19:56 +03:00
Konstantinos Margaritis
73297dea33 add arm bitutils.h header 2020-10-08 20:50:55 +03:00
Konstantinos Margaritis
b77ffbf4ed add arm architecture basic defines 2020-10-07 14:28:12 +03:00