From patchwork Wed Jan 10 12:47:52 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Adhemerval Zanella Netto X-Patchwork-Id: 124091 Delivered-To: patch@linaro.org Received: by 10.140.22.227 with SMTP id 90csp5236673qgn; Wed, 10 Jan 2018 04:51:10 -0800 (PST) X-Google-Smtp-Source: ACJfBosQryoyChaTLL6NPzWxhPhPC+q/KkMyXUcd0BmsE69OOb8qFlzZly4G9ir8pQvjsaFfttTT X-Received: by 10.84.234.16 with SMTP id m16mr19283824plk.201.1515588669946; Wed, 10 Jan 2018 04:51:09 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1515588669; cv=none; d=google.com; s=arc-20160816; b=DM+W03TEDikK+nuxgcB8nLUpTgOcHnaRmBx9aReHhNRGhsjWyT/m/aoHTz9lgGcG2e L7cEbi2RIoUf5lgA9ifpqAcRw/TkQhRcwTXn+h7N1Zy2GnOR83+eYepQLQjcqdD2TmUO xkT6k/OxhxPDcLlKHtZ0VX4TBICwcIDuFh6HzA4puwCqlpdqYq+FN2TfSiP6zFIoEbPK 5tKrtIf/a7amp5fYtyIx10SKyL/+GzEDh9kvbHrlECNfRA2XT9zCENQJ0k89XcFVmK4X dmTI1M+0KhrdSvu5iKkVbRXMSJvDFuf+9g7vKXxZ0qtCg++AUbXt3Ymht87Hlgbsv+fv ZOwg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=references:in-reply-to:message-id:date:subject:to:from:delivered-to :sender:list-help:list-post:list-archive:list-subscribe :list-unsubscribe:list-id:precedence:mailing-list:dkim-signature :domainkey-signature:arc-authentication-results; bh=8bv47aTmfuJAHJFWqyz9SpqrVAG+Ypqse/uIo8TvPwo=; b=OBjrL4WAP8NxGfMVXXfgvkIfm4bnY2Pv97j0EKrrOFagLp1R+UZoBLvReP3ddoMwWi 3Y6amB+yXU7ezMts8WqxPt5+Nq9jnY3QyItkIcSy40OuBHKJiWxKd4lhG5Q9p9fWzF8I ySVBSu2y7daK0mshLWj6akfISVe9P/kaLJAYtK80EPk7TcJFPwCy6MyTa6hr/trSmLy0 N/yvIv8nPCHPJpONxWk5fPuursPF1M4S+9E6WzAaz9xfhldylRghtnY/FEVGUZuVubWk dTfphgVlPlx08Z1PqDZ0pVo3fh6hWJGGAv7Zlhw+AVkOXkdCUtXZfJ5ENANCT/6xfxdt KdBw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@sourceware.org header.s=default header.b=AmYLvtZC; spf=pass (google.com: domain of libc-alpha-return-89013-patch=linaro.org@sourceware.org designates 209.132.180.131 as permitted sender) smtp.mailfrom=libc-alpha-return-89013-patch=linaro.org@sourceware.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from sourceware.org (server1.sourceware.org. [209.132.180.131]) by mx.google.com with ESMTPS id a3si10483186pgd.336.2018.01.10.04.51.09 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 10 Jan 2018 04:51:09 -0800 (PST) Received-SPF: pass (google.com: domain of libc-alpha-return-89013-patch=linaro.org@sourceware.org designates 209.132.180.131 as permitted sender) client-ip=209.132.180.131; Authentication-Results: mx.google.com; dkim=pass header.i=@sourceware.org header.s=default header.b=AmYLvtZC; spf=pass (google.com: domain of libc-alpha-return-89013-patch=linaro.org@sourceware.org designates 209.132.180.131 as permitted sender) smtp.mailfrom=libc-alpha-return-89013-patch=linaro.org@sourceware.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org DomainKey-Signature: a=rsa-sha1; c=nofws; d=sourceware.org; h=list-id :list-unsubscribe:list-subscribe:list-archive:list-post :list-help:sender:from:to:subject:date:message-id:in-reply-to :references; q=dns; s=default; b=jwXOXw/y1oaNMiqrslAW/naIeISNpkP N2wPuPH7MroCGooOrrYJ3bIXieXtZ/U/g7hPLZZ9KpWHTeLLa8ykWy01PbPTMaTZ PwUej8R6SrSs9wJ3TXmQcbRyrW8KHCLotVOy16ID+dZGrhmQPID7WqwKTh/glM+e iIOHsHakQoM8= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=sourceware.org; h=list-id :list-unsubscribe:list-subscribe:list-archive:list-post :list-help:sender:from:to:subject:date:message-id:in-reply-to :references; s=default; bh=MzlE6fBEMOo2x/BywsI4GMB5/AI=; b=AmYLv tZCk72F7WECTy6lzdpM0UznfKtYCIeBNtES1fo9dKuIwxti2vh6E8y6K31Ne9AKN k/ZmHWWja3iXYAAcM9iWLXRdYscpe6MivwSApWlVPE5zyeol+FhbM5fnH7c3nXVx RaLZrSIa+4inggdDNQZys3DEk91TlvOhKDUvJI= Received: (qmail 130785 invoked by alias); 10 Jan 2018 12:48:45 -0000 Mailing-List: contact libc-alpha-help@sourceware.org; run by ezmlm Precedence: bulk List-Id: List-Unsubscribe: List-Subscribe: List-Archive: List-Post: List-Help: , Sender: libc-alpha-owner@sourceware.org Delivered-To: mailing list libc-alpha@sourceware.org Received: (qmail 124475 invoked by uid 89); 10 Jan 2018 12:48:33 -0000 Authentication-Results: sourceware.org; auth=none X-Virus-Found: No X-Spam-SWARE-Status: No, score=-25.9 required=5.0 tests=AWL, BAYES_00, GIT_PATCH_0, GIT_PATCH_1, GIT_PATCH_2, GIT_PATCH_3, KAM_SHORT, RCVD_IN_DNSWL_NONE, SPF_PASS autolearn=ham version=3.3.2 spammy=1712, 1819, 2430 X-HELO: mail-qk0-f170.google.com X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:date:message-id:in-reply-to :references; bh=8bv47aTmfuJAHJFWqyz9SpqrVAG+Ypqse/uIo8TvPwo=; b=lq8S4zKPg5+EUTDd1S21DG7eahz0N8q+t5vqAsYSVEnBhh7SPBaS/rTdCz6QhtY5qY arS/jL4vKrj8w6KMIOR0qL5sfgAekVMb81yTAnCvCp15rqbf9Q6w56l9NYuC/3omhSEp m8/tGMFhiekz92VViWqinSfnHQ2ejjD83RuNrrBuUHsGrUy5kAutds9grJZcxUw199Oe q0WS0qDavLAewpc3Q2dNwOOOadJ61Yrk1jwOsIyAxQZ44UUHRGDnD0BRipj5Wh7ftLiZ Z7tCkWsZWVqlUvEdoqlgvqY4lSIYjCiyndS1Lr4kcWXAVJnBiOQyKouQfAn6OYA0N0Ki /1ig== X-Gm-Message-State: AKwxyte/RsybXjB1I9ddazdSYcVPo81q1FFLpq9eibHqQH3Kp9deZ+ZF xzLxkzoJzuTesaEv3qXK8mMS7xZNLYM= X-Received: by 10.55.204.18 with SMTP id r18mr25604273qki.212.1515588501439; Wed, 10 Jan 2018 04:48:21 -0800 (PST) From: Adhemerval Zanella To: libc-alpha@sourceware.org Subject: [PATCH v3 08/18] string: Improve generic strnlen Date: Wed, 10 Jan 2018 10:47:52 -0200 Message-Id: <1515588482-15744-9-git-send-email-adhemerval.zanella@linaro.org> In-Reply-To: <1515588482-15744-1-git-send-email-adhemerval.zanella@linaro.org> References: <1515588482-15744-1-git-send-email-adhemerval.zanella@linaro.org> With an optimized memchr, new strnlen implementation basically calls memchr and adjust the result pointer value. It also cleanups the multiple inclusion by leaving the ifunc implementation to undef the weak_alias and libc_hidden_def. Richard Henderson Adhemerval Zanella [BZ #5806] * string/strnlen.c: Rewrite in terms of memchr. * sysdeps/i386/i686/multiarch/strnlen-c.c: Redefine weak_alias and libc_hidden_def. * sysdeps/powerpc/powerpc32/power4/multiarch/strnlen-ppc32.c: Likewise. * sysdeps/s390/multiarch/strnlen-c.c: Likewise. --- string/strnlen.c | 139 ++------------------- sysdeps/i386/i686/multiarch/strnlen-c.c | 19 +-- .../powerpc32/power4/multiarch/strnlen-ppc32.c | 19 +-- sysdeps/s390/multiarch/strnlen-c.c | 18 ++- 4 files changed, 43 insertions(+), 152 deletions(-) -- 2.7.4 diff --git a/string/strnlen.c b/string/strnlen.c index c2ce1eb..a3ec6af 100644 --- a/string/strnlen.c +++ b/string/strnlen.c @@ -21,146 +21,21 @@ not, see . */ #include -#include /* Find the length of S, but scan at most MAXLEN characters. If no '\0' terminator is found in that many characters, return MAXLEN. */ -#ifdef STRNLEN -# define __strnlen STRNLEN +#ifndef STRNLEN +# define STRNLEN __strnlen #endif size_t -__strnlen (const char *str, size_t maxlen) +STRNLEN (const char *str, size_t maxlen) { - const char *char_ptr, *end_ptr = str + maxlen; - const unsigned long int *longword_ptr; - unsigned long int longword, himagic, lomagic; - - if (maxlen == 0) - return 0; - - if (__glibc_unlikely (end_ptr < str)) - end_ptr = (const char *) ~0UL; - - /* Handle the first few characters by reading one character at a time. - Do this until CHAR_PTR is aligned on a longword boundary. */ - for (char_ptr = str; ((unsigned long int) char_ptr - & (sizeof (longword) - 1)) != 0; - ++char_ptr) - if (*char_ptr == '\0') - { - if (char_ptr > end_ptr) - char_ptr = end_ptr; - return char_ptr - str; - } - - /* All these elucidatory comments refer to 4-byte longwords, - but the theory applies equally well to 8-byte longwords. */ - - longword_ptr = (unsigned long int *) char_ptr; - - /* Bits 31, 24, 16, and 8 of this number are zero. Call these bits - the "holes." Note that there is a hole just to the left of - each byte, with an extra at the end: - - bits: 01111110 11111110 11111110 11111111 - bytes: AAAAAAAA BBBBBBBB CCCCCCCC DDDDDDDD - - The 1-bits make sure that carries propagate to the next 0-bit. - The 0-bits provide holes for carries to fall into. */ - himagic = 0x80808080L; - lomagic = 0x01010101L; - if (sizeof (longword) > 4) - { - /* 64-bit version of the magic. */ - /* Do the shift in two steps to avoid a warning if long has 32 bits. */ - himagic = ((himagic << 16) << 16) | himagic; - lomagic = ((lomagic << 16) << 16) | lomagic; - } - if (sizeof (longword) > 8) - abort (); - - /* Instead of the traditional loop which tests each character, - we will test a longword at a time. The tricky part is testing - if *any of the four* bytes in the longword in question are zero. */ - while (longword_ptr < (unsigned long int *) end_ptr) - { - /* We tentatively exit the loop if adding MAGIC_BITS to - LONGWORD fails to change any of the hole bits of LONGWORD. - - 1) Is this safe? Will it catch all the zero bytes? - Suppose there is a byte with all zeros. Any carry bits - propagating from its left will fall into the hole at its - least significant bit and stop. Since there will be no - carry from its most significant bit, the LSB of the - byte to the left will be unchanged, and the zero will be - detected. - - 2) Is this worthwhile? Will it ignore everything except - zero bytes? Suppose every byte of LONGWORD has a bit set - somewhere. There will be a carry into bit 8. If bit 8 - is set, this will carry into bit 16. If bit 8 is clear, - one of bits 9-15 must be set, so there will be a carry - into bit 16. Similarly, there will be a carry into bit - 24. If one of bits 24-30 is set, there will be a carry - into bit 31, so all of the hole bits will be changed. - - The one misfire occurs when bits 24-30 are clear and bit - 31 is set; in this case, the hole at bit 31 is not - changed. If we had access to the processor carry flag, - we could close this loophole by putting the fourth hole - at bit 32! - - So it ignores everything except 128's, when they're aligned - properly. */ - - longword = *longword_ptr++; - - if ((longword - lomagic) & himagic) - { - /* Which of the bytes was the zero? If none of them were, it was - a misfire; continue the search. */ - - const char *cp = (const char *) (longword_ptr - 1); - - char_ptr = cp; - if (cp[0] == 0) - break; - char_ptr = cp + 1; - if (cp[1] == 0) - break; - char_ptr = cp + 2; - if (cp[2] == 0) - break; - char_ptr = cp + 3; - if (cp[3] == 0) - break; - if (sizeof (longword) > 4) - { - char_ptr = cp + 4; - if (cp[4] == 0) - break; - char_ptr = cp + 5; - if (cp[5] == 0) - break; - char_ptr = cp + 6; - if (cp[6] == 0) - break; - char_ptr = cp + 7; - if (cp[7] == 0) - break; - } - } - char_ptr = end_ptr; - } - - if (char_ptr > end_ptr) - char_ptr = end_ptr; - return char_ptr - str; + const char *found = memchr (str, '\0', maxlen); + return found ? found - str : maxlen; } -#ifndef STRNLEN -libc_hidden_def (__strnlen) + weak_alias (__strnlen, strnlen) -#endif +libc_hidden_def (__strnlen) libc_hidden_def (strnlen) diff --git a/sysdeps/i386/i686/multiarch/strnlen-c.c b/sysdeps/i386/i686/multiarch/strnlen-c.c index 351e939..bfbf811 100644 --- a/sysdeps/i386/i686/multiarch/strnlen-c.c +++ b/sysdeps/i386/i686/multiarch/strnlen-c.c @@ -1,10 +1,15 @@ #define STRNLEN __strnlen_ia32 +#undef weak_alias +#define weak_alias(a,b) +#undef libc_hidden_def +#define libc_hidden_def(a) + +#include + #ifdef SHARED -# undef libc_hidden_def -# define libc_hidden_def(name) \ - __hidden_ver1 (__strnlen_ia32, __GI_strnlen, __strnlen_ia32); \ - strong_alias (__strnlen_ia32, __strnlen_ia32_1); \ - __hidden_ver1 (__strnlen_ia32_1, __GI___strnlen, __strnlen_ia32_1); +/* Alias for internal symbol to avoid PLT generation, it redirects the + libc_hidden_def (__strnlen/strlen) to default implementation. */ +__hidden_ver1 (__strnlen_ia32, __GI_strnlen, __strnlen_ia32); +strong_alias (__strnlen_ia32, __strnlen_ia32_1); +__hidden_ver1 (__strnlen_ia32_1, __GI___strnlen, __strnlen_ia32_1); #endif - -#include "string/strnlen.c" diff --git a/sysdeps/powerpc/powerpc32/power4/multiarch/strnlen-ppc32.c b/sysdeps/powerpc/powerpc32/power4/multiarch/strnlen-ppc32.c index df940d3..e2ccd21 100644 --- a/sysdeps/powerpc/powerpc32/power4/multiarch/strnlen-ppc32.c +++ b/sysdeps/powerpc/powerpc32/power4/multiarch/strnlen-ppc32.c @@ -17,12 +17,17 @@ . */ #define STRNLEN __strnlen_ppc -#ifdef SHARED -# undef libc_hidden_def -# define libc_hidden_def(name) \ - __hidden_ver1 (__strnlen_ppc, __GI_strnlen, __strnlen_ppc); \ - strong_alias (__strnlen_ppc, __strnlen_ppc_1); \ - __hidden_ver1 (__strnlen_ppc_1, __GI___strnlen, __strnlen_ppc_1); -#endif +#undef weak_alias +#define weak_alias(a,b) +#undef libc_hidden_def +#define libc_hidden_def(a) #include + +#ifdef SHARED +/* Alias for internal symbol to avoid PLT generation, it redirects the + libc_hidden_def (__strnlen/strlen) to default implementation. */ +__hidden_ver1 (__strnlen_ppc, __GI_strnlen, __strnlen_ppc); \ +strong_alias (__strnlen_ppc, __strnlen_ppc_1); \ +__hidden_ver1 (__strnlen_ppc_1, __GI___strnlen, __strnlen_ppc_1); +#endif diff --git a/sysdeps/s390/multiarch/strnlen-c.c b/sysdeps/s390/multiarch/strnlen-c.c index 353e83e..f77f59d 100644 --- a/sysdeps/s390/multiarch/strnlen-c.c +++ b/sysdeps/s390/multiarch/strnlen-c.c @@ -18,13 +18,19 @@ #if defined HAVE_S390_VX_ASM_SUPPORT && IS_IN (libc) # define STRNLEN __strnlen_c +# undef weak_alias +# define weak_alias(a,b) +# undef libc_hidden_def +# define libc_hidden_def(a) + +# include + # ifdef SHARED -# undef libc_hidden_def -# define libc_hidden_def(name) \ - __hidden_ver1 (__strnlen_c, __GI_strnlen, __strnlen_c); \ - strong_alias (__strnlen_c, __strnlen_c_1); \ - __hidden_ver1 (__strnlen_c_1, __GI___strnlen, __strnlen_c_1); +/* Alias for internal symbol to avoid PLT generation, it redirects the + libc_hidden_def (__strnlen/strlen) to default implementation. */ +__hidden_ver1 (__strnlen_c, __GI_strnlen, __strnlen_c); +strong_alias (__strnlen_c, __strnlen_c_1); +__hidden_ver1 (__strnlen_c_1, __GI___strnlen, __strnlen_c_1); # endif /* SHARED */ -# include #endif /* HAVE_S390_VX_ASM_SUPPORT && IS_IN (libc) */