From patchwork Fri Dec 4 15:15:24 2015 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Takashi Iwai X-Patchwork-Id: 7769011 Return-Path: X-Original-To: patchwork-intel-gfx@patchwork.kernel.org Delivered-To: patchwork-parsemail@patchwork1.web.kernel.org Received: from mail.kernel.org (mail.kernel.org [198.145.29.136]) by patchwork1.web.kernel.org (Postfix) with ESMTP id 9D89E9F54E for ; Fri, 4 Dec 2015 15:15:32 +0000 (UTC) Received: from mail.kernel.org (localhost [127.0.0.1]) by mail.kernel.org (Postfix) with ESMTP id 430B6205B4 for ; Fri, 4 Dec 2015 15:15:31 +0000 (UTC) Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) by mail.kernel.org (Postfix) with ESMTP id C7C5320588 for ; Fri, 4 Dec 2015 15:15:29 +0000 (UTC) Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id 442126E207; Fri, 4 Dec 2015 07:15:29 -0800 (PST) X-Original-To: intel-gfx@lists.freedesktop.org Delivered-To: intel-gfx@lists.freedesktop.org Received: from mx2.suse.de (mx2.suse.de [195.135.220.15]) by gabe.freedesktop.org (Postfix) with ESMTPS id 16A0C6E207 for ; Fri, 4 Dec 2015 07:15:27 -0800 (PST) X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay1.suse.de (charybdis-ext.suse.de [195.135.220.254]) by mx2.suse.de (Postfix) with ESMTP id 7ACA7AD62; Fri, 4 Dec 2015 15:15:25 +0000 (UTC) Date: Fri, 04 Dec 2015 16:15:24 +0100 Message-ID: From: Takashi Iwai To: Daniel Vetter In-Reply-To: <20151204150046.GR10243@phenom.ffwll.local> References: <1448986198-3488-1-git-send-email-tiwai@suse.de> <1448986198-3488-3-git-send-email-tiwai@suse.de> <20151204102102.GM10243@phenom.ffwll.local> <20151204150046.GR10243@phenom.ffwll.local> User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI/1.14.6 (Maruoka) FLIM/1.14.9 (=?UTF-8?B?R29qxY0=?=) APEL/10.8 Emacs/24.5 (x86_64-suse-linux-gnu) MULE/6.0 (HANACHIRUSATO) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Cc: alsa-devel@alsa-project.org, Mengdong Lin , Vinod Koul , intel-gfx@lists.freedesktop.org, Daniel Vetter , David Henningsson Subject: Re: [Intel-gfx] [PATCH v2 2/9] drm/i915: Add get_eld audio component X-BeenThere: intel-gfx@lists.freedesktop.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Intel graphics driver community testing & development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: intel-gfx-bounces@lists.freedesktop.org Sender: "Intel-gfx" X-Spam-Status: No, score=-4.2 required=5.0 tests=BAYES_00, RCVD_IN_DNSWL_MED, T_RP_MATCHES_RCVD, UNPARSEABLE_RELAY autolearn=unavailable version=3.3.1 X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on mail.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP On Fri, 04 Dec 2015 16:00:46 +0100, Daniel Vetter wrote: > > On Fri, Dec 04, 2015 at 11:49:46AM +0100, Takashi Iwai wrote: > > On Fri, 04 Dec 2015 11:21:02 +0100, > > Daniel Vetter wrote: > > > > > > On Tue, Dec 01, 2015 at 05:09:51PM +0100, Takashi Iwai wrote: > > > > Implement a new i915_audio_component_ops, get_eld(). It's called by > > > > the audio driver to fetch the current audio status and ELD of the > > > > given HDMI/DP port. It returns the size of expected ELD bytes if it's > > > > valid, zero if no valid ELD is found, or a negative error code. The > > > > current state of audio on/off is stored in the given pointer, too. > > > > > > > > Note that the returned size isn't limited to the given max bytes. If > > > > the size is greater than the max bytes, it means that only a part of > > > > ELD has been copied back. > > > > > > > > A big warning about the usage of this callback is: you must not call > > > > it from eld_notify. The eld_notify itself is called in the modeset > > > > lock, and it leads to a deadlock since get_eld takes the modeset lock, > > > > too. You need to call get_eld in a work, for example, in such a case. > > > > We'll see the actual implementation in the later patch in > > > > sound/pci/hda/patch_hdmi.c. > > > > > > > > For achieving this implementation, a new field audio_enabled is added > > > > to struct intel_digital_port. This is set/reset at each audio > > > > enable/disable call in intel_audio.c. It's protected with the modeset > > > > lock as well. > > > > > > > > Signed-off-by: Takashi Iwai > > > > --- > > > > v1->v2: > > > > * Use modeset lock for get_eld lock, drop av mutex > > > > * Return the expected size from get_eld, not the copied size > > > > > > > > drivers/gpu/drm/i915/intel_audio.c | 40 ++++++++++++++++++++++++++++++++++++++ > > > > drivers/gpu/drm/i915/intel_drv.h | 1 + > > > > include/drm/i915_component.h | 6 ++++++ > > > > 3 files changed, 47 insertions(+) > > > > > > > > diff --git a/drivers/gpu/drm/i915/intel_audio.c b/drivers/gpu/drm/i915/intel_audio.c > > > > index 0c38cc6c82ae..1965a61769ea 100644 > > > > --- a/drivers/gpu/drm/i915/intel_audio.c > > > > +++ b/drivers/gpu/drm/i915/intel_audio.c > > > > @@ -521,6 +521,7 @@ void intel_audio_codec_enable(struct intel_encoder *intel_encoder) > > > > > > > > connector->eld[6] = drm_av_sync_delay(connector, adjusted_mode) / 2; > > > > > > > > + intel_dig_port->audio_enabled = true; > > > > if (dev_priv->display.audio_codec_enable) > > > > dev_priv->display.audio_codec_enable(connector, intel_encoder, > > > > adjusted_mode); > > > > @@ -545,6 +546,7 @@ void intel_audio_codec_disable(struct intel_encoder *intel_encoder) > > > > struct intel_digital_port *intel_dig_port = enc_to_dig_port(encoder); > > > > enum port port = intel_dig_port->port; > > > > > > > > + intel_dig_port->audio_enabled = false; > > > > if (dev_priv->display.audio_codec_disable) > > > > dev_priv->display.audio_codec_disable(intel_encoder); > > > > > > > > @@ -702,6 +704,43 @@ static int i915_audio_component_sync_audio_rate(struct device *dev, > > > > return 0; > > > > } > > > > > > > > +static int i915_audio_component_get_eld(struct device *dev, int port, > > > > + bool *enabled, > > > > + unsigned char *buf, int max_bytes) > > > > +{ > > > > + struct drm_i915_private *dev_priv = dev_to_i915(dev); > > > > + struct drm_device *drm_dev = dev_priv->dev; > > > > + struct intel_encoder *intel_encoder; > > > > + struct intel_digital_port *intel_dig_port; > > > > + struct drm_connector *connector; > > > > + unsigned char *eld; > > > > + int ret = -EINVAL; > > > > + > > > > + drm_modeset_lock_all(drm_dev); > > > > > > This is super expensive and shouldn't ever be used in new code. So either > > > just the connection_mutex or resurrect the av_mutex and just cache what > > > you need under that. > > > > OK, I need to make it harder, then. > > > > > Tbh I prefer the separate lock + cache for such > > > specific things since it completely avoids spreading and entangling > > > locking contexts. We use the same design to get modeset information into > > > the PSR tracking, FBC tracking and other code which sits between KMS and > > > other subsystems. > > > > I didn't want to be involved with the modeset lock, but it has to be. > > This function calls drm_select_eld() and it requires both > > mode_config.mutex and connection_mutex. > > > > (snip) > > > > struct i915_audio_component_audio_ops { > > > > @@ -55,6 +58,9 @@ struct i915_audio_component_audio_ops { > > > > * pin sense and/or ELD information has changed. > > > > * @audio_ptr: HDA driver object > > > > * @port: Which port has changed (PORTA / PORTB / PORTC etc) > > > > + * > > > > + * Note that you can't call i915_audio_component_ops.get_eld directly > > > > + * from the notifier callback as it may lead to deadlocks. > > > > > > With av_mutex we don't even need that note here ;-) > > > > So here is the problem. av_mutex itself doesn't suffice for > > drm_select_eld(), and taking the modeset lock leads to a deadlock when > > invoked from eld_notify. > > Yeah, select_eld is broken currently in atomic land, and we need to fix > that. It's by far not the only one that's iffy. > > > Maybe one alternative is to pass the audio state and ELD bytes already > > in eld_notify itself. Then it doesn't have to call get_eld from > > there. But we still need the explicit fetch in some cases (at the > > first probe and at resume), so get_eld op is still required. Then it > > needs to take locks by itself. > > Well my idea was that in the enable/disable hooks (where we should hold > relevant modeset locks already, except for that icky unsolved thing I need > to take care of anyway), and store a copy (protected by av_lock). Then > get_eld would only look at that copy. That kind of "cache relevant data, > protected with new leaf lock" trick is what I meant we should use here, > and it's the usual approach to avoid acquiring modeset locks from random > other subsystems (since that ends in deadlocks sooner or later). So no > calling drm_get_eld from the new get_eld hook at all. > > There's still the problem that currently calling drm_get_eld is broken > with atomic modesets even in i915 audio enable/disable functions. But > that's a preexisting problem with atomic, and one I know we need to fix > still before we can enable atomic for real (all legacy paths get away > since there we take more locks). While I'm coding it, I wonder whether we really need to cache/copy the whole ELD content again. Wouldn't tracking the drm_connector point work? If the connector might be removed / updated, then it involves with the modeset updates, and calling audio_codec_disable() in anyway. FWIW, the below is the draft version I finished rewriting now (just compile-tested). thanks, Takashi -- 8< -- From: Takashi Iwai Subject: [PATCH] drm/i915: Add get_eld audio component Implement a new i915_audio_component_ops, get_eld(). It's called by the audio driver to fetch the current audio status and ELD of the given HDMI/DP port. It returns the size of expected ELD bytes if it's valid, zero if no valid ELD is found, or a negative error code. The current state of audio on/off is stored in the given pointer, too. Note that the returned size isn't limited to the given max bytes. If the size is greater than the max bytes, it means that only a part of ELD has been copied back. For achieving this implementation, a new field audio_connector is added to struct intel_digital_port. It points to the connector assigned to the given digital port. It's set/reset at each audio enable/disable call in intel_audio.c, and protected with av_mutex. Signed-off-by: Takashi Iwai --- drivers/gpu/drm/i915/intel_audio.c | 42 ++++++++++++++++++++++++++++++++++++++ drivers/gpu/drm/i915/intel_drv.h | 2 ++ include/drm/i915_component.h | 3 +++ 3 files changed, 47 insertions(+) diff --git a/drivers/gpu/drm/i915/intel_audio.c b/drivers/gpu/drm/i915/intel_audio.c index 4dccd9b003a1..7f45e73f58f5 100644 --- a/drivers/gpu/drm/i915/intel_audio.c +++ b/drivers/gpu/drm/i915/intel_audio.c @@ -525,6 +525,10 @@ void intel_audio_codec_enable(struct intel_encoder *intel_encoder) dev_priv->display.audio_codec_enable(connector, intel_encoder, adjusted_mode); + mutex_lock(&dev_priv->av_mutex); + intel_dig_port->audio_connector = connector; + mutex_unlock(&dev_priv->av_mutex); + if (acomp && acomp->audio_ops && acomp->audio_ops->pin_eld_notify) acomp->audio_ops->pin_eld_notify(acomp->audio_ops->audio_ptr, (int) port); } @@ -548,6 +552,10 @@ void intel_audio_codec_disable(struct intel_encoder *intel_encoder) if (dev_priv->display.audio_codec_disable) dev_priv->display.audio_codec_disable(intel_encoder); + mutex_lock(&dev_priv->av_mutex); + intel_dig_port->audio_connector = NULL; + mutex_unlock(&dev_priv->av_mutex); + if (acomp && acomp->audio_ops && acomp->audio_ops->pin_eld_notify) acomp->audio_ops->pin_eld_notify(acomp->audio_ops->audio_ptr, (int) port); } @@ -706,6 +714,39 @@ static int i915_audio_component_sync_audio_rate(struct device *dev, return 0; } +static int i915_audio_component_get_eld(struct device *dev, int port, + bool *enabled, + unsigned char *buf, int max_bytes) +{ + struct drm_i915_private *dev_priv = dev_to_i915(dev); + struct drm_device *drm_dev = dev_priv->dev; + struct intel_encoder *intel_encoder; + struct intel_digital_port *intel_dig_port; + const u8 *eld; + int ret = -EINVAL; + + mutex_lock(&dev_priv->av_mutex); + for_each_intel_encoder(drm_dev, intel_encoder) { + if (intel_encoder->type != INTEL_OUTPUT_DISPLAYPORT && + intel_encoder->type != INTEL_OUTPUT_HDMI) + continue; + intel_dig_port = enc_to_dig_port(&intel_encoder->base); + if (port == intel_dig_port->port) { + ret = 0; + *enabled = intel_dig_port->audio_connector != NULL; + if (!*enabled) + break; + eld = intel_dig_port->audio_connector->eld; + ret = drm_eld_size(eld); + memcpy(buf, eld, min(max_bytes, ret)); + break; + } + } + + mutex_unlock(&dev_priv->av_mutex); + return ret; +} + static const struct i915_audio_component_ops i915_audio_component_ops = { .owner = THIS_MODULE, .get_power = i915_audio_component_get_power, @@ -713,6 +754,7 @@ static const struct i915_audio_component_ops i915_audio_component_ops = { .codec_wake_override = i915_audio_component_codec_wake_override, .get_cdclk_freq = i915_audio_component_get_cdclk_freq, .sync_audio_rate = i915_audio_component_sync_audio_rate, + .get_eld = i915_audio_component_get_eld, }; static int i915_audio_component_bind(struct device *i915_dev, diff --git a/drivers/gpu/drm/i915/intel_drv.h b/drivers/gpu/drm/i915/intel_drv.h index 0598932ce623..607922e4937c 100644 --- a/drivers/gpu/drm/i915/intel_drv.h +++ b/drivers/gpu/drm/i915/intel_drv.h @@ -800,6 +800,8 @@ struct intel_digital_port { struct intel_hdmi hdmi; enum irqreturn (*hpd_pulse)(struct intel_digital_port *, bool); bool release_cl2_override; + /* for communication with audio component; protected by av_mutex */ + const struct drm_connector *audio_connector; }; struct intel_dp_mst_encoder { diff --git a/include/drm/i915_component.h b/include/drm/i915_component.h index 30d89e0da2c6..058d39e8d57f 100644 --- a/include/drm/i915_component.h +++ b/include/drm/i915_component.h @@ -38,6 +38,7 @@ * @codec_wake_override: Enable/Disable generating the codec wake signal * @get_cdclk_freq: get the Core Display Clock in KHz * @sync_audio_rate: set n/cts based on the sample rate + * @get_eld: fill the audio state and ELD bytes for the given port */ struct i915_audio_component_ops { struct module *owner; @@ -46,6 +47,8 @@ struct i915_audio_component_ops { void (*codec_wake_override)(struct device *, bool enable); int (*get_cdclk_freq)(struct device *); int (*sync_audio_rate)(struct device *, int port, int rate); + int (*get_eld)(struct device *, int port, bool *enabled, + unsigned char *buf, int max_bytes); }; struct i915_audio_component_audio_ops {