From patchwork Fri Aug 23 13:57:29 2013 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Mika Kuoppala X-Patchwork-Id: 2848842 Return-Path: X-Original-To: patchwork-intel-gfx@patchwork.kernel.org Delivered-To: patchwork-parsemail@patchwork2.web.kernel.org Received: from mail.kernel.org (mail.kernel.org [198.145.19.201]) by patchwork2.web.kernel.org (Postfix) with ESMTP id 8D82EBF546 for ; Fri, 23 Aug 2013 13:58:17 +0000 (UTC) Received: from mail.kernel.org (localhost [127.0.0.1]) by mail.kernel.org (Postfix) with ESMTP id B0C4020335 for ; Fri, 23 Aug 2013 13:58:12 +0000 (UTC) Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) by mail.kernel.org (Postfix) with ESMTP id 6686A20319 for ; Fri, 23 Aug 2013 13:58:11 +0000 (UTC) Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id 3F785E7668 for ; Fri, 23 Aug 2013 06:58:11 -0700 (PDT) X-Original-To: intel-gfx@lists.freedesktop.org Delivered-To: intel-gfx@lists.freedesktop.org Received: from mga02.intel.com (mga02.intel.com [134.134.136.20]) by gabe.freedesktop.org (Postfix) with ESMTP id E4625E790D for ; Fri, 23 Aug 2013 06:57:52 -0700 (PDT) Received: from orsmga001.jf.intel.com ([10.7.209.18]) by orsmga101.jf.intel.com with ESMTP; 23 Aug 2013 06:57:33 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="4.89,941,1367996400"; d="scan'208";a="367397974" Received: from rosetta.fi.intel.com (HELO rosetta) ([10.237.72.86]) by orsmga001.jf.intel.com with ESMTP; 23 Aug 2013 06:57:32 -0700 Received: by rosetta (Postfix, from userid 1000) id 53C28801A9; Fri, 23 Aug 2013 16:57:31 +0300 (EEST) From: Mika Kuoppala To: intel-gfx@lists.freedesktop.org Date: Fri, 23 Aug 2013 16:57:29 +0300 Message-Id: <1377266249-16854-2-git-send-email-mika.kuoppala@intel.com> X-Mailer: git-send-email 1.7.9.5 In-Reply-To: <1377266249-16854-1-git-send-email-mika.kuoppala@intel.com> References: <1377266249-16854-1-git-send-email-mika.kuoppala@intel.com> Cc: miku@iki.fi Subject: [Intel-gfx] [PATCH 2/2] drm/i915: ban badly behaving contexts X-BeenThere: intel-gfx@lists.freedesktop.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Intel graphics driver community testing & development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , MIME-Version: 1.0 Sender: intel-gfx-bounces+patchwork-intel-gfx=patchwork.kernel.org@lists.freedesktop.org Errors-To: intel-gfx-bounces+patchwork-intel-gfx=patchwork.kernel.org@lists.freedesktop.org X-Spam-Status: No, score=-7.0 required=5.0 tests=BAYES_00, RCVD_IN_DNSWL_MED, RP_MATCHES_RCVD, UNPARSEABLE_RELAY autolearn=unavailable version=3.3.1 X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on mail.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP Now when we have mechanism in place to track which context was guilty of hanging the gpu, it is possible to punish for bad behaviour. If context has recently submitted a faulty batchbuffers guilty of gpu hang and submits another batch which hangs gpu in a 16 seconds time window, ban it permanently. Ban means that batchbuffers from this fd/context will not be accepted anymore for execution. v2: Store guilty ban status bool in gpu_error instead of pointers that might become danling before hang is declared. v3: Use return value for banned status instead of stashing state into gpu_error (Chris Wilson) v4: - rebase on top of fixed hang stats api - add define for ban period - rename commit and improve commit msg Signed-off-by: Mika Kuoppala --- drivers/gpu/drm/i915/i915_drv.c | 6 +++-- drivers/gpu/drm/i915/i915_drv.h | 10 +++++++- drivers/gpu/drm/i915/i915_gem.c | 35 +++++++++++++++++++++------- drivers/gpu/drm/i915/i915_gem_execbuffer.c | 12 ++++++++++ 4 files changed, 51 insertions(+), 12 deletions(-) diff --git a/drivers/gpu/drm/i915/i915_drv.c b/drivers/gpu/drm/i915/i915_drv.c index e19dec5..8934365 100644 --- a/drivers/gpu/drm/i915/i915_drv.c +++ b/drivers/gpu/drm/i915/i915_drv.c @@ -804,6 +804,7 @@ int i915_reset(struct drm_device *dev) { drm_i915_private_t *dev_priv = dev->dev_private; bool simulated; + bool ctx_banned; int ret; if (!i915_try_reset) @@ -811,11 +812,12 @@ int i915_reset(struct drm_device *dev) mutex_lock(&dev->struct_mutex); - i915_gem_reset(dev); + ctx_banned = i915_gem_reset(dev); simulated = dev_priv->gpu_error.stop_rings != 0; - if (!simulated && get_seconds() - dev_priv->gpu_error.last_reset < + if (!(simulated || ctx_banned) && + get_seconds() - dev_priv->gpu_error.last_reset < DRM_I915_WEDGE_PERIOD) { DRM_ERROR("GPU hanging too fast, declaring wedged!\n"); ret = -ENODEV; diff --git a/drivers/gpu/drm/i915/i915_drv.h b/drivers/gpu/drm/i915/i915_drv.h index 9c0ca78..9d99937 100644 --- a/drivers/gpu/drm/i915/i915_drv.h +++ b/drivers/gpu/drm/i915/i915_drv.h @@ -575,6 +575,12 @@ struct i915_ctx_hang_stats { /* This context had batch active when hang was declared */ unsigned batch_active; + + /* Time when this context was last blamed for a GPU reset */ + unsigned long batch_active_reset_ts; + + /* This context is banned to submit more work */ + bool banned; }; /* This must match up with the value previously used for execbuf2.rsvd1. */ @@ -978,6 +984,8 @@ struct i915_gpu_error { #define DRM_I915_HANGCHECK_JIFFIES msecs_to_jiffies(DRM_I915_HANGCHECK_PERIOD) /* Hangcheck needs >2 periods to declare a hang */ #define DRM_I915_WEDGE_PERIOD DIV_ROUND_UP(5*DRM_I915_HANGCHECK_PERIOD, 1000) + /* Hang gpu twice in this window and your context gets banned */ +#define DRM_I915_CONTEXT_BAN_PERIOD (2 * DRM_I915_WEDGE_PERIOD) struct timer_list hangcheck_timer; @@ -1922,7 +1930,7 @@ static inline bool i915_terminally_wedged(struct i915_gpu_error *error) return atomic_read(&error->reset_counter) == I915_WEDGED; } -void i915_gem_reset(struct drm_device *dev); +bool i915_gem_reset(struct drm_device *dev); bool i915_gem_clflush_object(struct drm_i915_gem_object *obj, bool force); int __must_check i915_gem_object_finish_gpu(struct drm_i915_gem_object *obj); int __must_check i915_gem_init(struct drm_device *dev); diff --git a/drivers/gpu/drm/i915/i915_gem.c b/drivers/gpu/drm/i915/i915_gem.c index 23c4256..0592966 100644 --- a/drivers/gpu/drm/i915/i915_gem.c +++ b/drivers/gpu/drm/i915/i915_gem.c @@ -2201,16 +2201,16 @@ static bool i915_request_guilty(struct drm_i915_gem_request *request, return false; } -static void i915_set_reset_status(struct intel_ring_buffer *ring, +static bool i915_set_reset_status(struct intel_ring_buffer *ring, struct drm_i915_gem_request *request, u32 acthd) { struct i915_ctx_hang_stats *hs = NULL; - bool inside, guilty; + bool inside, guilty, banned; unsigned long offset = 0; /* Innocent until proven guilty */ - guilty = false; + guilty = banned = false; if (request->batch_obj) offset = i915_gem_obj_offset(request->batch_obj, @@ -2237,11 +2237,21 @@ static void i915_set_reset_status(struct intel_ring_buffer *ring, hs = &request->file_priv->hang_stats; if (hs) { - if (guilty) + if (guilty) { + if (!hs->banned && + get_seconds() - hs->batch_active_reset_ts < + DRM_I915_CONTEXT_BAN_PERIOD) { + hs->banned = banned = true; + DRM_ERROR("context hanging too fast, declaring banned\n"); + } hs->batch_active++; - else + hs->batch_active_reset_ts = get_seconds(); + } else { hs->batch_pending++; + } } + + return banned; } static void i915_gem_free_request(struct drm_i915_gem_request *request) @@ -2255,11 +2265,12 @@ static void i915_gem_free_request(struct drm_i915_gem_request *request) kfree(request); } -static void i915_gem_reset_ring_lists(struct drm_i915_private *dev_priv, +static bool i915_gem_reset_ring_lists(struct drm_i915_private *dev_priv, struct intel_ring_buffer *ring) { u32 completed_seqno; u32 acthd; + bool ctx_banned = false; acthd = intel_ring_get_active_head(ring); completed_seqno = ring->get_seqno(ring, false); @@ -2272,7 +2283,8 @@ static void i915_gem_reset_ring_lists(struct drm_i915_private *dev_priv, list); if (request->seqno > completed_seqno) - i915_set_reset_status(ring, request, acthd); + ctx_banned |= i915_set_reset_status(ring, + request, acthd); i915_gem_free_request(request); } @@ -2286,6 +2298,8 @@ static void i915_gem_reset_ring_lists(struct drm_i915_private *dev_priv, i915_gem_object_move_to_inactive(obj); } + + return ctx_banned; } void i915_gem_restore_fences(struct drm_device *dev) @@ -2309,16 +2323,19 @@ void i915_gem_restore_fences(struct drm_device *dev) } } -void i915_gem_reset(struct drm_device *dev) +bool i915_gem_reset(struct drm_device *dev) { struct drm_i915_private *dev_priv = dev->dev_private; struct intel_ring_buffer *ring; int i; + bool ctx_banned = false; for_each_ring(ring, dev_priv, i) - i915_gem_reset_ring_lists(dev_priv, ring); + ctx_banned |= i915_gem_reset_ring_lists(dev_priv, ring); i915_gem_restore_fences(dev); + + return ctx_banned; } /** diff --git a/drivers/gpu/drm/i915/i915_gem_execbuffer.c b/drivers/gpu/drm/i915/i915_gem_execbuffer.c index 792c52a..50c6bf5 100644 --- a/drivers/gpu/drm/i915/i915_gem_execbuffer.c +++ b/drivers/gpu/drm/i915/i915_gem_execbuffer.c @@ -886,6 +886,7 @@ i915_gem_do_execbuffer(struct drm_device *dev, void *data, struct drm_i915_gem_object *batch_obj; struct drm_clip_rect *cliprects = NULL; struct intel_ring_buffer *ring; + struct i915_ctx_hang_stats *hs; u32 ctx_id = i915_execbuffer2_get_context_id(*args); u32 exec_start, exec_len; u32 mask, flags; @@ -1077,6 +1078,17 @@ i915_gem_do_execbuffer(struct drm_device *dev, void *data, if (ret) goto err; + hs = i915_gem_context_get_hang_stats(dev, file, ctx_id); + if (IS_ERR(hs)) { + ret = PTR_ERR(hs); + goto err; + } + + if (hs->banned) { + ret = -EIO; + goto err; + } + ret = i915_switch_context(ring, file, ctx_id); if (ret) goto err;