From patchwork Thu Feb 8 16:49:09 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: Richard Henderson X-Patchwork-Id: 127684 Delivered-To: patch@linaro.org Received: by 10.46.124.24 with SMTP id x24csp1669877ljc; Thu, 8 Feb 2018 08:55:25 -0800 (PST) X-Google-Smtp-Source: AH8x226OGvF0raLnDR2X00WNkBQ+HTVhKWiog9xC6JtHigz3jruysH8mY9LjlmBCBehyQp5yZLnY X-Received: by 10.37.58.5 with SMTP id h5mr972094yba.391.1518108925563; Thu, 08 Feb 2018 08:55:25 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1518108925; cv=none; d=google.com; s=arc-20160816; b=E1kKVPJwVdxtVrrfa/fgqadLBdBBbXlydx/Z9+w0MglMc4DrEY4capegdrkJ1zJrxA 4GxVJeGOo0NT4GMr+zIW+futoB/OfprbYmAdJit+deBLFCSpL9ogVTh8v/OGS2EHInU5 iXWWN2pJcUs9SVARLBnaT5dSfVXmiKFwk9x4m1m7wCjTwTzepDPOTZ4t4J7vPoohlmzb j9VpusZNdd5v80ThmEu5ju1C4Ry9005rZyrN0OgXjnSBY3KI8y2UuBcC8w7PAwcPPku6 hmM2zben36BrdbSUSZlYcu2F64Sl3gHbD1pZdamZZ+QEMGWUT8JvXdTrEmiR/uiNPh9C 3Q9Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:cc:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:subject :content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:to:from:dkim-signature:arc-authentication-results; bh=j7Nwpc+lXRiPbrWW7BLxZVOVPLSJ6tN2arN7R+rTs8g=; b=D6W0ZgTzDzUQCp2Pg/MOo6UREoBQCh5Z/zlCuOSys9E48J2L/QL9AHteaasJhfLk7f kbCj7g0q8mooe7eAQRMbgtswMrk0yYc1yBTBdYE417MZp2CJFPmq8xJlXPo8Ry9whG36 0CTL4L+s/qcoPeBhsrS6VxUM3nwqmE69XTARDl1W8z8oQzlQdx0ORwhMxNACMABtP2dz ofrTGX3nY0tSYXjIi57wwPhRh8TVPtMtUiD3wJaumkpJlwUdCA1xtpbiyGdGc3Cr6DmT dojTHFTYkSMmYqfE4fhcstVL5z0fUc7w2UYwkf86yI1ITtWcsrjLV7uQrlXzSH+Yoxl/ oHZQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@linaro.org header.s=google header.b=XANMzI5x; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 2001:4830:134:3::11 as permitted sender) smtp.mailfrom=qemu-devel-bounces+patch=linaro.org@nongnu.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from lists.gnu.org (lists.gnu.org. [2001:4830:134:3::11]) by mx.google.com with ESMTPS id o126si66006ywe.153.2018.02.08.08.55.25 for (version=TLS1 cipher=AES128-SHA bits=128/128); Thu, 08 Feb 2018 08:55:25 -0800 (PST) Received-SPF: pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 2001:4830:134:3::11 as permitted sender) client-ip=2001:4830:134:3::11; Authentication-Results: mx.google.com; dkim=fail header.i=@linaro.org header.s=google header.b=XANMzI5x; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 2001:4830:134:3::11 as permitted sender) smtp.mailfrom=qemu-devel-bounces+patch=linaro.org@nongnu.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: from localhost ([::1]:52868 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ejpTo-0004jd-0N for patch@linaro.org; Thu, 08 Feb 2018 11:55:25 -0500 Received: from eggs.gnu.org ([2001:4830:134:3::10]:42019) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ejpNs-00089T-Qd for qemu-devel@nongnu.org; Thu, 08 Feb 2018 11:49:18 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ejpNq-00044H-So for qemu-devel@nongnu.org; Thu, 08 Feb 2018 11:49:16 -0500 Received: from mail-pf0-x242.google.com ([2607:f8b0:400e:c00::242]:40292) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1ejpNq-00043M-LZ for qemu-devel@nongnu.org; Thu, 08 Feb 2018 11:49:14 -0500 Received: by mail-pf0-x242.google.com with SMTP id u20so669289pfl.7 for ; Thu, 08 Feb 2018 08:49:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=j7Nwpc+lXRiPbrWW7BLxZVOVPLSJ6tN2arN7R+rTs8g=; b=XANMzI5x0I5Y8XSbIUl4r8e4SsIamIfQ4xgbxCDuQLiVF0hF0U4KgA1IEPAPs9Wdvn j7CcKWFRE5XyqbroUuDS+lcziaD+kBZzbpyYR6wRvbvLdEtvzpBRmhSn0ZCb9SuR+2JP Hf8iNiNkZ93cMw6PxE6qJSgIhRsBHuOS7mlcc= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=j7Nwpc+lXRiPbrWW7BLxZVOVPLSJ6tN2arN7R+rTs8g=; b=rxwMpgVxLkJuHg9HW3RT0S+fZOQ0BAE2prv2Gkte6GR+cHT6qtssBCwzPFY+y8DMC4 UlTBtK4EF+PPiOZIsVdHvrGBQ2JaYEivS8uQkksE5dEM8y3Z0rCUhM0Br+zU5bh/yfBr QoIcXPUVzun1dI5Lch2F/dN5RywTo9BWrrHpsaFx+oBBKA4WddS2uYVd+eaj/B8NuLVL y5R7UlFqoiFkyWu7QUSk/kRzXE0xyHNVMpfGLhRfK/buZvuroTAiyFiOsx6NsHCZ2fgM 1gkTg5DvW0VTtT0W/hp2zF3A3aHCZ8OmqEGgcO8tjBGkGTiMYEaQMx6hMr5aD31gTILp mShw== X-Gm-Message-State: APf1xPDIGIa0yb1Kbs5iJa323x+mqX1oCySHRJHHz4VSyKjAySmYBhPg OluWRhu2lQqk3H3BZ3bCjxlk+Dcd0VM= X-Received: by 10.98.214.7 with SMTP id r7mr1307296pfg.24.1518108553284; Thu, 08 Feb 2018 08:49:13 -0800 (PST) Received: from cloudburst.twiddle.net (174-21-6-47.tukw.qwest.net. [174.21.6.47]) by smtp.gmail.com with ESMTPSA id o186sm681255pga.16.2018.02.08.08.49.12 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Thu, 08 Feb 2018 08:49:12 -0800 (PST) From: Richard Henderson To: qemu-devel@nongnu.org Date: Thu, 8 Feb 2018 08:49:09 -0800 Message-Id: <20180208164909.8639-2-richard.henderson@linaro.org> X-Mailer: git-send-email 2.14.3 In-Reply-To: <20180208164909.8639-1-richard.henderson@linaro.org> References: <20180208164909.8639-1-richard.henderson@linaro.org> MIME-Version: 1.0 X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-Received-From: 2607:f8b0:400e:c00::242 Subject: [Qemu-devel] [PULL v2 01/20] tcg: Allow multiple word entries into the constant pool X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: peter.maydell@linaro.org Errors-To: qemu-devel-bounces+patch=linaro.org@nongnu.org Sender: "Qemu-devel" This will be required for storing vector constants. Reviewed-by: Alex Bennée Reviewed-by: Peter Maydell Signed-off-by: Richard Henderson --- tcg/tcg-pool.inc.c | 113 +++++++++++++++++++++++++++++++++++++++++++---------- 1 file changed, 92 insertions(+), 21 deletions(-) -- 2.14.3 diff --git a/tcg/tcg-pool.inc.c b/tcg/tcg-pool.inc.c index 8a85131405..7af5513ff3 100644 --- a/tcg/tcg-pool.inc.c +++ b/tcg/tcg-pool.inc.c @@ -22,39 +22,110 @@ typedef struct TCGLabelPoolData { struct TCGLabelPoolData *next; - tcg_target_ulong data; tcg_insn_unit *label; intptr_t addend; - int type; + int rtype; + unsigned nlong; + tcg_target_ulong data[]; } TCGLabelPoolData; -static void new_pool_label(TCGContext *s, tcg_target_ulong data, int type, - tcg_insn_unit *label, intptr_t addend) +static TCGLabelPoolData *new_pool_alloc(TCGContext *s, int nlong, int rtype, + tcg_insn_unit *label, intptr_t addend) { - TCGLabelPoolData *n = tcg_malloc(sizeof(*n)); - TCGLabelPoolData *i, **pp; + TCGLabelPoolData *n = tcg_malloc(sizeof(TCGLabelPoolData) + + sizeof(tcg_target_ulong) * nlong); - n->data = data; n->label = label; - n->type = type; n->addend = addend; + n->rtype = rtype; + n->nlong = nlong; + return n; +} + +static void new_pool_insert(TCGContext *s, TCGLabelPoolData *n) +{ + TCGLabelPoolData *i, **pp; + int nlong = n->nlong; /* Insertion sort on the pool. */ - for (pp = &s->pool_labels; (i = *pp) && i->data < data; pp = &i->next) { - continue; + for (pp = &s->pool_labels; (i = *pp) != NULL; pp = &i->next) { + if (nlong > i->nlong) { + break; + } + if (nlong < i->nlong) { + continue; + } + if (memcmp(n->data, i->data, sizeof(tcg_target_ulong) * nlong) >= 0) { + break; + } } n->next = *pp; *pp = n; } +/* The "usual" for generic integer code. */ +static inline void new_pool_label(TCGContext *s, tcg_target_ulong d, int rtype, + tcg_insn_unit *label, intptr_t addend) +{ + TCGLabelPoolData *n = new_pool_alloc(s, 1, rtype, label, addend); + n->data[0] = d; + new_pool_insert(s, n); +} + +/* For v64 or v128, depending on the host. */ +static inline void new_pool_l2(TCGContext *s, int rtype, tcg_insn_unit *label, + intptr_t addend, tcg_target_ulong d0, + tcg_target_ulong d1) +{ + TCGLabelPoolData *n = new_pool_alloc(s, 2, rtype, label, addend); + n->data[0] = d0; + n->data[1] = d1; + new_pool_insert(s, n); +} + +/* For v128 or v256, depending on the host. */ +static inline void new_pool_l4(TCGContext *s, int rtype, tcg_insn_unit *label, + intptr_t addend, tcg_target_ulong d0, + tcg_target_ulong d1, tcg_target_ulong d2, + tcg_target_ulong d3) +{ + TCGLabelPoolData *n = new_pool_alloc(s, 4, rtype, label, addend); + n->data[0] = d0; + n->data[1] = d1; + n->data[2] = d2; + n->data[3] = d3; + new_pool_insert(s, n); +} + +/* For v256, for 32-bit host. */ +static inline void new_pool_l8(TCGContext *s, int rtype, tcg_insn_unit *label, + intptr_t addend, tcg_target_ulong d0, + tcg_target_ulong d1, tcg_target_ulong d2, + tcg_target_ulong d3, tcg_target_ulong d4, + tcg_target_ulong d5, tcg_target_ulong d6, + tcg_target_ulong d7) +{ + TCGLabelPoolData *n = new_pool_alloc(s, 8, rtype, label, addend); + n->data[0] = d0; + n->data[1] = d1; + n->data[2] = d2; + n->data[3] = d3; + n->data[4] = d4; + n->data[5] = d5; + n->data[6] = d6; + n->data[7] = d7; + new_pool_insert(s, n); +} + /* To be provided by cpu/tcg-target.inc.c. */ static void tcg_out_nop_fill(tcg_insn_unit *p, int count); static bool tcg_out_pool_finalize(TCGContext *s) { TCGLabelPoolData *p = s->pool_labels; - tcg_target_ulong d, *a; + TCGLabelPoolData *l = NULL; + void *a; if (p == NULL) { return true; @@ -62,24 +133,24 @@ static bool tcg_out_pool_finalize(TCGContext *s) /* ??? Round up to qemu_icache_linesize, but then do not round again when allocating the next TranslationBlock structure. */ - a = (void *)ROUND_UP((uintptr_t)s->code_ptr, sizeof(tcg_target_ulong)); + a = (void *)ROUND_UP((uintptr_t)s->code_ptr, + sizeof(tcg_target_ulong) * p->nlong); tcg_out_nop_fill(s->code_ptr, (tcg_insn_unit *)a - s->code_ptr); s->data_gen_ptr = a; - /* Ensure the first comparison fails. */ - d = p->data + 1; - for (; p != NULL; p = p->next) { - if (p->data != d) { - d = p->data; - if (unlikely((void *)a > s->code_gen_highwater)) { + size_t size = sizeof(tcg_target_ulong) * p->nlong; + if (!l || l->nlong != p->nlong || memcmp(l->data, p->data, size)) { + if (unlikely(a > s->code_gen_highwater)) { return false; } - *a++ = d; + memcpy(a, p->data, size); + a += size; + l = p; } - patch_reloc(p->label, p->type, (intptr_t)(a - 1), p->addend); + patch_reloc(p->label, p->rtype, (intptr_t)a - size, p->addend); } - s->code_ptr = (void *)a; + s->code_ptr = a; return true; }