]> git.ipfire.org Git - thirdparty/glibc.git/commit - sysdeps/x86_64/multiarch/wcschr.c
x86-64: Optimize strchr/strchrnul/wcschr with AVX2
authorH.J. Lu <hjl.tools@gmail.com>
Fri, 9 Jun 2017 12:42:16 +0000 (05:42 -0700)
committerH.J. Lu <hjl.tools@gmail.com>
Fri, 9 Jun 2017 12:42:29 +0000 (05:42 -0700)
commit8fe57365bfb5a417d911ab715a5671b3b1d7b155
tree9b6a729305aaa4f9b30e8a016469fbbd5a7bc664
parentdc485ceb2ac596d27294cc1942adf3181f15e8bf
x86-64: Optimize strchr/strchrnul/wcschr with AVX2

Optimize strchr/strchrnul/wcschr with AVX2 to search 32 bytes with vector
instructions.  It is as fast as SSE2 versions for size <= 16 bytes and up
to 1X faster for or size > 16 bytes on Haswell.  Select AVX2 version on
AVX2 machines where vzeroupper is preferred and AVX unaligned load is fast.

NB: It uses TZCNT instead of BSF since TZCNT produces the same result
as BSF for non-zero input.  TZCNT is faster than BSF and is executed
as BSF if machine doesn't support TZCNT.

* sysdeps/x86_64/multiarch/Makefile (sysdep_routines): Add
strchr-sse2, strchrnul-sse2, strchr-avx2, strchrnul-avx2,
wcschr-sse2 and wcschr-avx2.
* sysdeps/x86_64/multiarch/ifunc-impl-list.c
(__libc_ifunc_impl_list): Add tests for __strchr_avx2,
__strchrnul_avx2, __strchrnul_sse2, __wcschr_avx2 and
__wcschr_sse2.
* sysdeps/x86_64/multiarch/strchr-avx2.S: New file.
* sysdeps/x86_64/multiarch/strchr-sse2.S: Likewise.
* sysdeps/x86_64/multiarch/strchr.c: Likewise.
* sysdeps/x86_64/multiarch/strchrnul-avx2.S: Likewise.
* sysdeps/x86_64/multiarch/strchrnul-sse2.S: Likewise.
* sysdeps/x86_64/multiarch/strchrnul.c: Likewise.
* sysdeps/x86_64/multiarch/wcschr-avx2.S: Likewise.
* sysdeps/x86_64/multiarch/wcschr-sse2.S: Likewise.
* sysdeps/x86_64/multiarch/wcschr.c: Likewise.
* sysdeps/x86_64/multiarch/strchr.S: Removed.
13 files changed:
ChangeLog
sysdeps/x86_64/multiarch/Makefile
sysdeps/x86_64/multiarch/ifunc-impl-list.c
sysdeps/x86_64/multiarch/strchr-avx2.S [new file with mode: 0644]
sysdeps/x86_64/multiarch/strchr-sse2.S [new file with mode: 0644]
sysdeps/x86_64/multiarch/strchr.S [deleted file]
sysdeps/x86_64/multiarch/strchr.c [new file with mode: 0644]
sysdeps/x86_64/multiarch/strchrnul-avx2.S [new file with mode: 0644]
sysdeps/x86_64/multiarch/strchrnul-sse2.S [new file with mode: 0644]
sysdeps/x86_64/multiarch/strchrnul.c [new file with mode: 0644]
sysdeps/x86_64/multiarch/wcschr-avx2.S [new file with mode: 0644]
sysdeps/x86_64/multiarch/wcschr-sse2.S [new file with mode: 0644]
sysdeps/x86_64/multiarch/wcschr.c [new file with mode: 0644]