From patchwork Sun Mar 2 14:32:02 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Cindy Lu X-Patchwork-Id: 13997831 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 4D31438384 for ; Sun, 2 Mar 2025 14:33:34 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=170.10.129.124 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1740926016; cv=none; b=cOW4MCyZotS4m4JYSWYJMdCek0a/XxMRJuyAqrP0E13dKS6HD4XlSB+iQ4re9eRXel627r7vPYDJ+tI9k/7Cw+r27tj1jyQ//RCd7poPfiCaRltZAXYTQUnuufXaKb8YcpXlDRvUsdN6fTtcMFLuU16TOdq0bqhhBxe3ds0cd3o= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1740926016; c=relaxed/simple; bh=5A8Pz3pMwh9UoelkS2AbKkUE/4GZ7PZqwfjnsFbWfZY=; h=From:To:Subject:Date:Message-ID:MIME-Version; b=X4q9BTJekYcks5oV2rgnN6h3iB5P/VXiM2UAWcKx+0Wa+jFntpPkb5CB+bqY8dRW0GUDtYSOhzsphHygWdaZwpo4WlmKGvEXs1mE1oufbxvK5ai+KHK1hunsXZWMOQC8pM4Du1yazXqFkhwMxGu9RxcO8qhbEJkOL/Eo5lUz5l4= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=redhat.com; spf=pass smtp.mailfrom=redhat.com; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b=gIHFn2VC; arc=none smtp.client-ip=170.10.129.124 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=redhat.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=redhat.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b="gIHFn2VC" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1740926013; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding; bh=7j2K5a1YoG1AaUdqSBrB7rnRQcl6BL0ziicJNzchzQQ=; b=gIHFn2VCcT6aHb5pHoQFTQu+5qYqQRKk+3sza7L8OOyKVrmpIxStIAyjvrnHzmqToo0FQ2 X7rlE1TpANPnFavJiJUrtWr3LvQc6hQmFOrCPZeNmDxzwxJqyaHRpqrbdr5lSdAr3Ew9Mb HgfzutB4yQ3gkQjkCC5/XTto+lmvqgk= Received: from mx-prod-mc-05.mail-002.prod.us-west-2.aws.redhat.com (ec2-54-186-198-63.us-west-2.compute.amazonaws.com [54.186.198.63]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-49-_CeCGF50MwmXtU-MEZFW9g-1; Sun, 02 Mar 2025 09:33:15 -0500 X-MC-Unique: _CeCGF50MwmXtU-MEZFW9g-1 X-Mimecast-MFC-AGG-ID: _CeCGF50MwmXtU-MEZFW9g_1740925994 Received: from mx-prod-int-06.mail-002.prod.us-west-2.aws.redhat.com (mx-prod-int-06.mail-002.prod.us-west-2.aws.redhat.com [10.30.177.93]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mx-prod-mc-05.mail-002.prod.us-west-2.aws.redhat.com (Postfix) with ESMTPS id 9FBCC19560B5; Sun, 2 Mar 2025 14:33:13 +0000 (UTC) Received: from server.redhat.com (unknown [10.72.112.49]) by mx-prod-int-06.mail-002.prod.us-west-2.aws.redhat.com (Postfix) with ESMTP id D0A5F1800359; Sun, 2 Mar 2025 14:33:08 +0000 (UTC) From: Cindy Lu To: lulu@redhat.com, jasowang@redhat.com, mst@redhat.com, michael.christie@oracle.com, sgarzare@redhat.com, linux-kernel@vger.kernel.org, virtualization@lists.linux-foundation.org, netdev@vger.kernel.org Subject: [PATCH v7 0/8] vhost: Add support of kthread API Date: Sun, 2 Mar 2025 22:32:02 +0800 Message-ID: <20250302143259.1221569-1-lulu@redhat.com> Precedence: bulk X-Mailing-List: netdev@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-Scanned-By: MIMEDefang 3.4.1 on 10.30.177.93 In commit 6e890c5d5021 ("vhost: use vhost_tasks for worker threads"), the vhost now uses vhost_task and operates as a child of the owner thread. This aligns with containerization principles. However, this change has caused confusion for some legacy userspace applications. Therefore, we are reintroducing support for the kthread API. In this series, a new UAPI is implemented to allow userspace applications to configure their thread mode. Changelog v2: 1. Change the module_param's name to enforce_inherit_owner, and the default value is true. 2. Change the UAPI's name to VHOST_SET_INHERIT_FROM_OWNER. Changelog v3: 1. Change the module_param's name to inherit_owner_default, and the default value is true. 2. Add a structure for task function; the worker will select a different mode based on the value inherit_owner. 3. device will have their own inherit_owner in struct vhost_dev 4. Address other comments Changelog v4: 1. remove the module_param, only keep the UAPI 2. remove the structure for task function; change to use the function pointer in vhost_worker 3. fix the issue in vhost_worker_create and vhost_dev_ioctl 4. Address other comments Changelog v5: 1. Change wakeup and stop function pointers in struct vhost_worker to void. 2. merging patches 4, 5, 6 in a single patch 3. Fix spelling issues and address other comments. Changelog v6: 1. move the check of VHOST_NEW_WORKER from vhost_scsi to vhost 2. Change the ioctl name VHOST_SET_INHERIT_FROM_OWNER to VHOST_FORK_FROM_OWNER 3. reuse the function __vhost_worker_flush 4. use a ops sturct to support worker relates function 5. reset the value of inherit_owner in vhost_dev_reset_owner s. Changelog v7: 1. add a KConfig knob to disable legacy app support 2. Split the changes into two patches to separately introduce the ops and add kthread support. 3. Utilized INX_MAX to avoid modifications in __vhost_worker_flush 4. Rebased on the latest kernel 5. Address other comments Tested with QEMU with kthread mode/task mode/kthread+task mode Cindy Lu (8): vhost: Add a new parameter in vhost_dev to allow user select kthread vhost: Reintroduce vhost_worker to support kthread vhost: Add the cgroup related function vhost: Introduce vhost_worker_ops in vhost_worker vhost: Reintroduce kthread mode support in vhost vhost: uapi to control task mode (owner vs kthread) vhost: Add check for inherit_owner status vhost: Add a KConfig knob to enable IOCTL VHOST_FORK_FROM_OWNER drivers/vhost/Kconfig | 15 +++ drivers/vhost/vhost.c | 227 +++++++++++++++++++++++++++++++++---- drivers/vhost/vhost.h | 21 ++++ include/uapi/linux/vhost.h | 15 +++ 4 files changed, 259 insertions(+), 19 deletions(-) Tested-by: Lei Yang