From patchwork Sun Nov 8 20:25:38 2015 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Bill Fischofer X-Patchwork-Id: 56159 Delivered-To: patch@linaro.org Received: by 10.112.1.169 with SMTP id 9csp122801lbn; Sun, 8 Nov 2015 12:29:34 -0800 (PST) X-Received: by 10.55.27.230 with SMTP id m99mr24413865qkh.103.1447014574733; Sun, 08 Nov 2015 12:29:34 -0800 (PST) Return-Path: Received: from lists.linaro.org (lists.linaro.org. [54.225.227.206]) by mx.google.com with ESMTP id u21si2017361qgu.96.2015.11.08.12.29.34; Sun, 08 Nov 2015 12:29:34 -0800 (PST) Received-SPF: pass (google.com: domain of lng-odp-bounces@lists.linaro.org designates 54.225.227.206 as permitted sender) client-ip=54.225.227.206; Authentication-Results: mx.google.com; spf=pass (google.com: domain of lng-odp-bounces@lists.linaro.org designates 54.225.227.206 as permitted sender) smtp.mailfrom=lng-odp-bounces@lists.linaro.org; dkim=neutral (body hash did not verify) header.i=@linaro_org.20150623.gappssmtp.com Received: by lists.linaro.org (Postfix, from userid 109) id 5C3796194C; Sun, 8 Nov 2015 20:29:34 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on ip-10-142-244-252 X-Spam-Level: X-Spam-Status: No, score=-2.5 required=5.0 tests=BAYES_00,DKIM_SIGNED, RCVD_IN_DNSWL_LOW, RCVD_IN_MSPIKE_H3, RCVD_IN_MSPIKE_WL, T_DKIM_INVALID, URIBL_BLOCKED autolearn=disabled version=3.4.0 Received: from [127.0.0.1] (localhost [127.0.0.1]) by lists.linaro.org (Postfix) with ESMTP id 847E961988; Sun, 8 Nov 2015 20:26:06 +0000 (UTC) X-Original-To: lng-odp@lists.linaro.org Delivered-To: lng-odp@lists.linaro.org Received: by lists.linaro.org (Postfix, from userid 109) id B7ECF61975; Sun, 8 Nov 2015 20:25:51 +0000 (UTC) Received: from mail-yk0-f169.google.com (mail-yk0-f169.google.com [209.85.160.169]) by lists.linaro.org (Postfix) with ESMTPS id 1F00161941 for ; Sun, 8 Nov 2015 20:25:48 +0000 (UTC) Received: by ykfs79 with SMTP id s79so7010963ykf.1 for ; Sun, 08 Nov 2015 12:25:47 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro_org.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:date:message-id:in-reply-to:references; bh=YSH/LSSjlgjCjinYtRse6RiN4Ic9s5jrelEXqXPuyXc=; b=buQ4yAnm5Cq+hcDzmp1TCDyqRm/0m063c6zhr1BuxdYuTHsF2OTPmkEgAfWsgwlbiP 5MNS9VRDVJSTFrRL2+Pc8njKtSNxaazzUDJOvNj7sBWqKsvPNiaM2hfZFKJS3+W4wxYi LxUFrpg5/pW4w0ni8P3YMkGe2S8F4tdfz6fZXMvBLMa27L8YWMBa3fs0QRVkPgGEWdtL vEtGJCshEMJ91ousG4yFQUBWi4H2COfetEAUPfj70fRUMnXQ8ZAtcmoN8OPc2GlpPXH+ /jzsvAjISy3YWAZZUDzY8BWM1U/kTDisRzOjAPWznCXDKANuZHrYraz+l7VVRywb42oE hIAA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references; bh=YSH/LSSjlgjCjinYtRse6RiN4Ic9s5jrelEXqXPuyXc=; b=CGmlzJb4iDsa0rrc+n8Z0ynPCRovjPK1LXEkbpMOAQQtVG7fb/4QAHGlEo6Mfm8WKp njzSOXHM3qApwkM7bKbhGlWkdyHyY0Px5BG9ZtPiarqQ6ryxkSVDu1dYyGJ4tkleMiba Rxr6UooYKINPPIznrztUlFR4/FwqpiV8e1ssWQdf3UgWPnmsabobPYiQ1/ha0wQQVRcm 46qG7Cn6H3WWfi4fLNMA+QZewi5A/zQUo1cTnqX4MSEhpKRJkrcJYO5m+jEbivY2/p1s D+eMZlb0O8DXji69VQI8Arxd15JzpVeO1KEwzxz0mCwiWx7oCI/zl4yycOO1cUVo+WHZ 6XdQ== X-Gm-Message-State: ALoCoQl6CySSaNaQvOih0zSVcP9CZtSTZ0d7/PN493x9VE4++EdlPJLTfHf13+mJndRC9UVijy9+ X-Received: by 10.129.138.5 with SMTP id a5mr19258506ywg.178.1447014347821; Sun, 08 Nov 2015 12:25:47 -0800 (PST) Received: from Ubuntu15.localdomain (cpe-66-68-129-43.austin.res.rr.com. [66.68.129.43]) by smtp.gmail.com with ESMTPSA id h83sm7362134ywc.6.2015.11.08.12.25.47 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Sun, 08 Nov 2015 12:25:47 -0800 (PST) From: Bill Fischofer To: lng-odp@lists.linaro.org Date: Sun, 8 Nov 2015 14:25:38 -0600 Message-Id: <1447014338-6409-7-git-send-email-bill.fischofer@linaro.org> X-Mailer: git-send-email 2.1.4 In-Reply-To: <1447014338-6409-1-git-send-email-bill.fischofer@linaro.org> References: <1447014338-6409-1-git-send-email-bill.fischofer@linaro.org> X-Topics: patch Subject: [lng-odp] [API-NEXT PATCH 6/6] linux-generic: queue: streamline and correct release_order() routine X-BeenThere: lng-odp@lists.linaro.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "The OpenDataPlane \(ODP\) List" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , MIME-Version: 1.0 Errors-To: lng-odp-bounces@lists.linaro.org Sender: "lng-odp" Resolve the corner case of releasing order for an order that still has events on the reorder queue. This also allows the reorder_complete() routine to be streamlined. This patch resolves Bug https://bugs.linaro.org/show_bug.cgi?id=1879 Signed-off-by: Bill Fischofer --- .../linux-generic/include/odp_queue_internal.h | 5 +- platform/linux-generic/odp_queue.c | 53 ++++++++++++++++++---- 2 files changed, 46 insertions(+), 12 deletions(-) diff --git a/platform/linux-generic/include/odp_queue_internal.h b/platform/linux-generic/include/odp_queue_internal.h index 6120740..a70044b 100644 --- a/platform/linux-generic/include/odp_queue_internal.h +++ b/platform/linux-generic/include/odp_queue_internal.h @@ -335,8 +335,7 @@ static inline int reorder_deq(queue_entry_t *queue, static inline void reorder_complete(queue_entry_t *origin_qe, odp_buffer_hdr_t **reorder_buf_return, odp_buffer_hdr_t **placeholder_buf, - int placeholder_append, - int order_released) + int placeholder_append) { odp_buffer_hdr_t *reorder_buf = origin_qe->s.reorder_head; odp_buffer_hdr_t *next_buf; @@ -356,7 +355,7 @@ static inline void reorder_complete(queue_entry_t *origin_qe, reorder_buf = next_buf; order_release(origin_qe, 1); - } else if (!order_released && reorder_buf->flags.sustain) { + } else if (reorder_buf->flags.sustain) { reorder_buf = next_buf; } else { *reorder_buf_return = origin_qe->s.reorder_head; diff --git a/platform/linux-generic/odp_queue.c b/platform/linux-generic/odp_queue.c index 9cab9b2..f388dfc 100644 --- a/platform/linux-generic/odp_queue.c +++ b/platform/linux-generic/odp_queue.c @@ -39,6 +39,11 @@ #include +#define RESOLVE_ORDER 0 +#define SUSTAIN_ORDER 1 + +#define NOAPPEND 0 +#define APPEND 1 typedef struct queue_table_t { queue_entry_t queue[ODP_CONFIG_QUEUES]; @@ -521,8 +526,7 @@ int ordered_queue_enq(queue_entry_t *queue, if (sched && schedule_queue(queue)) ODP_ABORT("schedule_queue failed\n"); - reorder_complete(origin_qe, &reorder_buf, &placeholder_buf, - 1, 0); + reorder_complete(origin_qe, &reorder_buf, &placeholder_buf, APPEND); UNLOCK(&origin_qe->s.lock); if (reorder_buf) @@ -606,7 +610,8 @@ int odp_queue_enq_multi(odp_queue_t handle, const odp_event_t ev[], int num) for (i = 0; i < num; i++) buf_hdr[i] = odp_buf_to_hdr(odp_buffer_from_event(ev[i])); - return num == 0 ? 0 : queue->s.enqueue_multi(queue, buf_hdr, num, 1); + return num == 0 ? 0 : queue->s.enqueue_multi(queue, buf_hdr, + num, SUSTAIN_ORDER); } int odp_queue_enq(odp_queue_t handle, odp_event_t ev) @@ -620,7 +625,7 @@ int odp_queue_enq(odp_queue_t handle, odp_event_t ev) /* No chains via this entry */ buf_hdr->link = NULL; - return queue->s.enqueue(queue, buf_hdr, 1); + return queue->s.enqueue(queue, buf_hdr, SUSTAIN_ORDER); } int queue_enq_internal(odp_buffer_hdr_t *buf_hdr) @@ -879,7 +884,7 @@ int queue_pktout_enq(queue_entry_t *queue, odp_buffer_hdr_t *buf_hdr, order_release(origin_qe, release_count + placeholder_count); /* Now handle sends to other queues that are ready to go */ - reorder_complete(origin_qe, &reorder_buf, &placeholder_buf, 1, 0); + reorder_complete(origin_qe, &reorder_buf, &placeholder_buf, APPEND); /* We're fully done with the origin_qe at last */ UNLOCK(&origin_qe->s.lock); @@ -947,13 +952,43 @@ int release_order(queue_entry_t *origin_qe, uint64_t order, odp_buffer_t placeholder_buf; odp_buffer_hdr_t *placeholder_buf_hdr, *reorder_buf, *next_buf; - /* Must tlock the origin queue to process the release */ + /* Must lock the origin queue to process the release */ LOCK(&origin_qe->s.lock); - /* If we are in the order we can release immediately since there can - * be no confusion about intermediate elements + /* If we are in order we can release immediately since there can be no + * confusion about intermediate elements */ if (order <= origin_qe->s.order_out) { + reorder_buf = origin_qe->s.reorder_head; + + /* We're in order, however there may be one or more events on + * the reorder queue that are part of this order. If that is + * the case, remove them and let ordered_queue_enq() handle + * them and resolve the order for us. + */ + if (reorder_buf && reorder_buf->order == order) { + odp_buffer_hdr_t *reorder_head = reorder_buf; + + next_buf = reorder_buf->next; + + while (next_buf && next_buf->order == order) { + reorder_buf = next_buf; + next_buf = next_buf->next; + } + + origin_qe->s.reorder_head = reorder_buf->next; + reorder_buf->next = NULL; + + UNLOCK(&origin_qe->s.lock); + reorder_head->link = reorder_buf->next; + return ordered_queue_enq(reorder_head->target_qe, + reorder_head, RESOLVE_ORDER, + origin_qe, order); + } + + /* Reorder queue has no elements for this order, so it's safe + * to resolve order here + */ order_release(origin_qe, 1); /* Check if this release allows us to unblock waiters. At the @@ -965,7 +1000,7 @@ int release_order(queue_entry_t *origin_qe, uint64_t order, * element(s) on the reorder queue */ reorder_complete(origin_qe, &reorder_buf, - &placeholder_buf_hdr, 0, 1); + &placeholder_buf_hdr, NOAPPEND); /* Now safe to unlock */ UNLOCK(&origin_qe->s.lock);