From patchwork Wed Apr 7 23:12:56 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Felix Kuehling X-Patchwork-Id: 12189539 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-16.5 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,MSGID_FROM_MTA_HEADER,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED, USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id DAF55C433B4 for ; Wed, 7 Apr 2021 23:13:41 +0000 (UTC) Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 63BE4610E8 for ; Wed, 7 Apr 2021 23:13:41 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 63BE4610E8 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=amd.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=dri-devel-bounces@lists.freedesktop.org Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id 7F6F26E9AC; Wed, 7 Apr 2021 23:13:40 +0000 (UTC) Received: from NAM04-MW2-obe.outbound.protection.outlook.com (mail-mw2nam08on2078.outbound.protection.outlook.com [40.107.101.78]) by gabe.freedesktop.org (Postfix) with ESMTPS id 56C466E9AC; Wed, 7 Apr 2021 23:13:39 +0000 (UTC) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=NAC4ZVj2qKyCBAy8ahizGCHTZoiPX9yg0rs8+guYURYQ+H0JkSSeXW5v+Su08IopmXvqiD1bGSNJJmIk5aACIjqrvM0A3L/FcAO1svL1o/Fs9rVeFoffhb+Sgt3je2eC9ZUcJNlGVGAAXADlkTrckxEDzhOwiGf21/tAPBpXQ1FgVIsRR3ga0x6Ggul30/mbLwGvSTL09YXQGRbsvHNWQ35DUNYpgtg6Frn/tp6gZmP4W7su70fFqWC8HX9wGkr0hfx+7xcN2xK28X8iEoJieaokb2hKi1iEmLg61WuVf/t+O+andpetrjMsPpffw9Z8qBI/kDS7DUqTz/Sh4SDfog== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=oDnilKetB8iHmON2nYxNTpARzZRuEyJTWWQpDwoqHBc=; b=Umc2Y5NchQkrV1yGHFlEZqgEEu7V8VtJrOsEfjQGHxGCMIuK/qaifOtT+BS9DNr0jnbjw1lmtJJNIm71h9Rd5uyCqwIegyMIn4U+ZgAFm2Qaxd/ItdXo4wuHsrGo+JOeHT7lcRX7KIUgccEaMCJzcplM7U3Gr2jypydWYSUC+IQVcZHe/sOu3HugAdoWpiv90lpyCy0vm4retG7BC3T34ZmjIBioaGr0y9vCx9YoAWvSb1/Umjl6x71Mw/micd0KYRRwog7tIG13/85BNb69aMcVycWU4lW33qDrcE53wLY6vqbBvMbxCcaDWXHEWNJp21z67HFxOhqt4Tq69rUIXA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=amd.com; dmarc=pass action=none header.from=amd.com; dkim=pass header.d=amd.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=oDnilKetB8iHmON2nYxNTpARzZRuEyJTWWQpDwoqHBc=; b=VkKJAbwOKCSQayW4bZwo/Cc+EFtE5MmynbvA/iFDZDQ6R0LAA395uR46+3NxLS1j/8awYEEliIFdFHStlIQBPCOA6CHa3qXQFqWaxmsQLfEYbYMBCzxuspfIV51N9FuirwiNd3qJE/0VE35go23RLleWUGE/0ChlGHBYnN5+9RY= Authentication-Results: lists.freedesktop.org; dkim=none (message not signed) header.d=none; lists.freedesktop.org; dmarc=none action=none header.from=amd.com; Received: from BL0PR12MB4948.namprd12.prod.outlook.com (2603:10b6:208:1cc::20) by MN2PR12MB4392.namprd12.prod.outlook.com (2603:10b6:208:264::24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3999.28; Wed, 7 Apr 2021 23:13:37 +0000 Received: from BL0PR12MB4948.namprd12.prod.outlook.com ([fe80::70f5:99ed:65a1:c033]) by BL0PR12MB4948.namprd12.prod.outlook.com ([fe80::70f5:99ed:65a1:c033%7]) with mapi id 15.20.3933.039; Wed, 7 Apr 2021 23:13:37 +0000 From: Felix Kuehling To: amd-gfx@lists.freedesktop.org, dri-devel@lists.freedesktop.org Subject: [PATCH 1/4] drm/amdkfd: Remove legacy code not acquiring VMs Date: Wed, 7 Apr 2021 19:12:56 -0400 Message-Id: <20210407231259.1787-1-Felix.Kuehling@amd.com> X-Mailer: git-send-email 2.31.1 X-Originating-IP: [165.204.55.251] X-ClientProxiedBy: YT1PR01CA0141.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:2f::20) To BL0PR12MB4948.namprd12.prod.outlook.com (2603:10b6:208:1cc::20) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from Harpoon.amd.com (165.204.55.251) by YT1PR01CA0141.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:2f::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3999.32 via Frontend Transport; Wed, 7 Apr 2021 23:13:36 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: eb1abebb-f9b0-4c4b-75fd-08d8fa1ac5e1 X-MS-TrafficTypeDiagnostic: MN2PR12MB4392: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:8273; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: C2FDYVg0X1C5FEGn0PVATJFVVSwjBHbCMbwO4ZMQC9ELaJYfnPfZQNUuwnQQcjY1DjPnn21p15g2UPma7vCwzoAqWgv2KLY2tId0M23ZEXCEt4YPoUdpXZvneGTdDbecZ57qAEEAwxJvWxNmWkUPV9JaBFB7yTibagu5yYOggLOEZMOyv3vr4BYpJud3hG+InrAhIzWvOGcnm1m81r52ciXl1mR/uTcD829aPpkl8bHoK2lFhkOfjeaYsZAHpmV2VoZ7Y1PMJmC2jSBo2phUMT7ul+HhiQxb+LT4Nv5Re+g5r80qZktQQ9fXyby/ZZA5QzKbdRtT+u+mTPyHZRPaFRfi/FgTyoZHRBnbpGX7W4Iyd3bQZ+IGnLwSp0JgtddyBZ3Zb7n0mP9LK+WfKQP377Z98TSlwrm5axMDwFRkNQhT0Rf1XO8M3Wdw91xFSBAGy4m/cvBOmbw94Shb7mxdwOrtRGppors1fGow9v60K2/Q2ChBfFKF+91VKq+o3XpIZ6nHCrznWLoyY6rJxA9y9/Ogb1tU7jEQJ/TNcKdY/8kZK4bw/k/um9lMCKtxMMhP+PYN+rLAQ86DRt1euV964KM3hpY/DdP0P5W5MUGbL6CQ5Or+xNL54VXTEswKqQjH6qKzfSZ8uu2FgQ4kdjt7YgJgA4Sf1kbz5sZn2fiWqHGSJh4pI1wDZacO5EsiIBmi X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BL0PR12MB4948.namprd12.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(39860400002)(366004)(136003)(376002)(346002)(396003)(66556008)(66946007)(316002)(16526019)(86362001)(186003)(52116002)(83380400001)(26005)(66476007)(1076003)(478600001)(7696005)(5660300002)(6666004)(2616005)(38100700001)(2906002)(36756003)(8936002)(8676002)(956004)(38350700001)(4326008)(6486002); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData: toTeszJc1gDZOLfUOwvLX29e9kGv4S0UZeXJKm/IDN4n4M8aty8ZQTiFvFBrz2lxGTyvVpBBmt1obc2ALM8Yy/OkE+RcDnzjWOs71RK3xKtaGBfA8GK29bTImoERpnbHCshcX66uMdRHXuyD3JzbWDM/t0M7wUzd7JtP37sV3fNDWJGvcIM+Lt6AQUop+a61K+HfENDjytS9Wwh6cf9JmC2s3kRhnIyTmM0ubEAO+hLG8qhPaYhpWTmoa8N+hOrBQVbgKQ+Cbl5gR2j3rp5oHznLA74ykc4YTsX6H8yThcUaSqLPbqVnAKBInWQ3AHIzYonXRUqkFUhEJi94rdbHPB3g9s2fU+1lRcSXTRqe19xHUVQxYvm0KVHJEicftbannRv54lX9AN/72kzTD0LpYk760ENNjTl7NqB/K7t8tH/Wy5DVnPwGUusqUuPdN+IRIhjCelzLtmYElZLK4kWjvlGnn/MXOuIh3+D6wyMQGgdnTONxmRn5CD/15n8+x9OLAv4mV0U//xh8V3XuhVD/WRSJucBfn/D4YO2cXhqCF1GcqOkTSPiKi6E7g4rnIGb2FJrzG1xo5z0UY+Z7FdISknHi2XX8NcTBeikShzAWhvx2iiapvIst82V+gKvjqlk3O4dqXLPGy0neRxTBzHphpnI3FVSR3VzQzAQ7e/t5pOWra6TDDBy8yeDPnCyp1715cnZP047IhvdLhir5RaTUgI64/wfTc2Jv3HG3wPNDKTbUSrH7rG6cRY3CBFkCdF/v4jfCNbBEgNyH/WmmDfbBoQmnMbwX6v2NNBwyIW9nKtjLo3UJ/ks1tF9rbb04JIdQlH2bN3fehXc6ro8YIjpwI0mAf08YQ1o7BydHhV4cSmsh5x4lRlayuJcrH344Rs424X5cWy2o72lDry1GjAu1eDNNwxzXCkZ1V4w7NTkGwLgq+eCwR2jKnONHG2H8V9MXOveK5ctHG28QC5FlxL+Pyl4g5VcGLKY7fNzPlGcxVRdprwFI8JShZrs4kQMaROZjT+jNC9vyl76drYMWD79jCwEsiIjNur9G3iUyHYboCJFWQ6d+NoPV2qIp0sCcMhlKOEDlbK/zrvJ9qHYzWvtITKr5NEcBK7HB2VoQ4kEfie/WdmqdDYtnXfCL38eiw2N30Ndf10MEGXN/Bt7LDkG3xyQUHyt8PCHuUArWP/Y0K0I0CLLQu9ld1ypyIjUMTv/2U7MFJUyyLLtoomy2DPZZn8+4tnHpSWeja1KfSZCioGE34U77CY8VQvexUS2vpTxSUTX/wM5vczyY5rMdlzYl2k4QGuHPeSyvAhkjvGbhOlfLEvAEznB33ZpTxm3Iploq X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-Network-Message-Id: eb1abebb-f9b0-4c4b-75fd-08d8fa1ac5e1 X-MS-Exchange-CrossTenant-AuthSource: BL0PR12MB4948.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 07 Apr 2021 23:13:36.9891 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: QmKRQHIHqkd31Vjb6SB0mlJ8SGRZddQNH+0vB4Y9v2k+YjlUaTOsOYsXvl16rwRM+9mc/yWxjNU+ks+K4RewNg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR12MB4392 X-BeenThere: dri-devel@lists.freedesktop.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Direct Rendering Infrastructure - Development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: christian.koenig@amd.com, tzimmermann@suse.de Errors-To: dri-devel-bounces@lists.freedesktop.org Sender: "dri-devel" ROCm user mode has acquired VMs from DRM file descriptors for as long as it supported the upstream KFD. Legacy code to support older versions of ROCm is not needed any more. Signed-off-by: Felix Kuehling --- drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h | 4 -- .../gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c | 50 ------------------- drivers/gpu/drm/amd/amdkfd/kfd_process.c | 27 ++++------ 3 files changed, 10 insertions(+), 71 deletions(-) diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h index 14f68c028126..5ffb07b02810 100644 --- a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h +++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h @@ -234,14 +234,10 @@ uint8_t amdgpu_amdkfd_get_xgmi_hops_count(struct kgd_dev *dst, struct kgd_dev *s }) /* GPUVM API */ -int amdgpu_amdkfd_gpuvm_create_process_vm(struct kgd_dev *kgd, u32 pasid, - void **vm, void **process_info, - struct dma_fence **ef); int amdgpu_amdkfd_gpuvm_acquire_process_vm(struct kgd_dev *kgd, struct file *filp, u32 pasid, void **vm, void **process_info, struct dma_fence **ef); -void amdgpu_amdkfd_gpuvm_destroy_process_vm(struct kgd_dev *kgd, void *vm); void amdgpu_amdkfd_gpuvm_release_process_vm(struct kgd_dev *kgd, void *vm); uint64_t amdgpu_amdkfd_gpuvm_get_process_page_dir(void *vm); int amdgpu_amdkfd_gpuvm_alloc_memory_of_gpu( diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c index e93850f2f3b1..36012229ccc1 100644 --- a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c +++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c @@ -1037,41 +1037,6 @@ static int init_kfd_vm(struct amdgpu_vm *vm, void **process_info, return ret; } -int amdgpu_amdkfd_gpuvm_create_process_vm(struct kgd_dev *kgd, u32 pasid, - void **vm, void **process_info, - struct dma_fence **ef) -{ - struct amdgpu_device *adev = get_amdgpu_device(kgd); - struct amdgpu_vm *new_vm; - int ret; - - new_vm = kzalloc(sizeof(*new_vm), GFP_KERNEL); - if (!new_vm) - return -ENOMEM; - - /* Initialize AMDGPU part of the VM */ - ret = amdgpu_vm_init(adev, new_vm, AMDGPU_VM_CONTEXT_COMPUTE, pasid); - if (ret) { - pr_err("Failed init vm ret %d\n", ret); - goto amdgpu_vm_init_fail; - } - - /* Initialize KFD part of the VM and process info */ - ret = init_kfd_vm(new_vm, process_info, ef); - if (ret) - goto init_kfd_vm_fail; - - *vm = (void *) new_vm; - - return 0; - -init_kfd_vm_fail: - amdgpu_vm_fini(adev, new_vm); -amdgpu_vm_init_fail: - kfree(new_vm); - return ret; -} - int amdgpu_amdkfd_gpuvm_acquire_process_vm(struct kgd_dev *kgd, struct file *filp, u32 pasid, void **vm, void **process_info, @@ -1138,21 +1103,6 @@ void amdgpu_amdkfd_gpuvm_destroy_cb(struct amdgpu_device *adev, } } -void amdgpu_amdkfd_gpuvm_destroy_process_vm(struct kgd_dev *kgd, void *vm) -{ - struct amdgpu_device *adev = get_amdgpu_device(kgd); - struct amdgpu_vm *avm = (struct amdgpu_vm *)vm; - - if (WARN_ON(!kgd || !vm)) - return; - - pr_debug("Destroying process vm %p\n", vm); - - /* Release the VM context */ - amdgpu_vm_fini(adev, avm); - kfree(vm); -} - void amdgpu_amdkfd_gpuvm_release_process_vm(struct kgd_dev *kgd, void *vm) { struct amdgpu_device *adev = get_amdgpu_device(kgd); diff --git a/drivers/gpu/drm/amd/amdkfd/kfd_process.c b/drivers/gpu/drm/amd/amdkfd/kfd_process.c index d4241d29ea94..d97e330a5022 100644 --- a/drivers/gpu/drm/amd/amdkfd/kfd_process.c +++ b/drivers/gpu/drm/amd/amdkfd/kfd_process.c @@ -935,9 +935,6 @@ static void kfd_process_destroy_pdds(struct kfd_process *p) pdd->dev->kgd, pdd->vm); fput(pdd->drm_file); } - else if (pdd->vm) - amdgpu_amdkfd_gpuvm_destroy_process_vm( - pdd->dev->kgd, pdd->vm); if (pdd->qpd.cwsr_kaddr && !pdd->qpd.cwsr_base) free_pages((unsigned long)pdd->qpd.cwsr_kaddr, @@ -1375,19 +1372,18 @@ int kfd_process_device_init_vm(struct kfd_process_device *pdd, struct kfd_dev *dev; int ret; + if (!drm_file) + return -EINVAL; + if (pdd->vm) - return drm_file ? -EBUSY : 0; + return -EBUSY; p = pdd->process; dev = pdd->dev; - if (drm_file) - ret = amdgpu_amdkfd_gpuvm_acquire_process_vm( - dev->kgd, drm_file, p->pasid, - &pdd->vm, &p->kgd_process_info, &p->ef); - else - ret = amdgpu_amdkfd_gpuvm_create_process_vm(dev->kgd, p->pasid, - &pdd->vm, &p->kgd_process_info, &p->ef); + ret = amdgpu_amdkfd_gpuvm_acquire_process_vm( + dev->kgd, drm_file, p->pasid, + &pdd->vm, &p->kgd_process_info, &p->ef); if (ret) { pr_err("Failed to create process VM object\n"); return ret; @@ -1409,8 +1405,6 @@ int kfd_process_device_init_vm(struct kfd_process_device *pdd, err_init_cwsr: err_reserve_ib_mem: kfd_process_device_free_bos(pdd); - if (!drm_file) - amdgpu_amdkfd_gpuvm_destroy_process_vm(dev->kgd, pdd->vm); pdd->vm = NULL; return ret; @@ -1435,6 +1429,9 @@ struct kfd_process_device *kfd_bind_process_to_device(struct kfd_dev *dev, return ERR_PTR(-ENOMEM); } + if (!pdd->vm) + return ERR_PTR(-ENODEV); + /* * signal runtime-pm system to auto resume and prevent * further runtime suspend once device pdd is created until @@ -1452,10 +1449,6 @@ struct kfd_process_device *kfd_bind_process_to_device(struct kfd_dev *dev, if (err) goto out; - err = kfd_process_device_init_vm(pdd, NULL); - if (err) - goto out; - /* * make sure that runtime_usage counter is incremented just once * per pdd From patchwork Wed Apr 7 23:12:57 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Felix Kuehling X-Patchwork-Id: 12189543 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-16.5 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,MSGID_FROM_MTA_HEADER,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED, USER_AGENT_GIT autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id AB4EDC43600 for ; Wed, 7 Apr 2021 23:13:50 +0000 (UTC) Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 60857611EE for ; Wed, 7 Apr 2021 23:13:50 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 60857611EE Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=amd.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=dri-devel-bounces@lists.freedesktop.org Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id 6FD706E9B3; Wed, 7 Apr 2021 23:13:41 +0000 (UTC) Received: from NAM04-MW2-obe.outbound.protection.outlook.com (mail-mw2nam08on2078.outbound.protection.outlook.com [40.107.101.78]) by gabe.freedesktop.org (Postfix) with ESMTPS id 82FB76E9AE; Wed, 7 Apr 2021 23:13:39 +0000 (UTC) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=lnJZpbECu7iBcAub4lTKx6XjfzTWGvWpP2El7L5hrucR4Qk88ufh99jSwfdm2xtmS+8u9kcpyM/nVK9N98skCCoYFXB7uCHb2/ppE3cWiF9nMxdwGGD5ZPcLyj++hG2xZvb2uwt903SscTBpqRlP/7+Of1wMDlYEgN7aGSYlV7wLaTy4BOXzeodHN66kxPqnikJxWpXiJAB8GMkUqOqjKQi/xmJL/MWGjtIRmjYXfLLIN+Ki1L4EkzvSE2zdmV60LeEhvs6oSRvHu0aFJu2CQO45IMaoQhM4WhaDjU3+v5T085vsC+M6hGhp38WNFz8wcgO66ch44sJ7Xrw0xUtujA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=otwCauVhtQ0DzDt2JV6j39P7uomxRJ8PRz2KzjwdLTo=; b=KqUKxpI7l/8bzmvNZycrdHon23kJBUlF1huyMPJGOJzycGWwInSNGIP+mFMhU3MpJpObkpCQJnGkxGa4G52fzETVE9JUGei/rTmOURUpDSRRxMEVY692+0TgXkrlEdt7CC4tMOzy/eXofZcM9C6xWWDLMUAer+VmaLhSb8nlOrgSILHKb32zVb9+Q+MIvJvYZxRcR0GfA6Bx6Z3gqBRAWxTo28yZXW+8/NZavVWk0nmLRTBrUFfLiN6ZHMgQinnJrlHFrxYk3MfW2U2Bplr0VqOHavzk+0IydbD0q7DZLqc0FwTgTw5emtRurGLZYk15R275CobfCTkTGL4WopKGfg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=amd.com; dmarc=pass action=none header.from=amd.com; dkim=pass header.d=amd.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=otwCauVhtQ0DzDt2JV6j39P7uomxRJ8PRz2KzjwdLTo=; b=BUsyAO1Fs2Sev/nK9EQ1Ukq2Xd03Um8Bk0GkQL6VRDKi5658Af83wKR8GoU9JNurjiQx8tIOjuMr69EATKW/fz8LqTB6Gl63bO0syAOq7hPtjd+3zrU82zErx7PJ8LX3qeYPHY+tVPzwwRCbNratK8A2zxA0pEBHp1VFge83VEk= Authentication-Results: lists.freedesktop.org; dkim=none (message not signed) header.d=none; lists.freedesktop.org; dmarc=none action=none header.from=amd.com; Received: from BL0PR12MB4948.namprd12.prod.outlook.com (2603:10b6:208:1cc::20) by MN2PR12MB4392.namprd12.prod.outlook.com (2603:10b6:208:264::24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3999.28; Wed, 7 Apr 2021 23:13:37 +0000 Received: from BL0PR12MB4948.namprd12.prod.outlook.com ([fe80::70f5:99ed:65a1:c033]) by BL0PR12MB4948.namprd12.prod.outlook.com ([fe80::70f5:99ed:65a1:c033%7]) with mapi id 15.20.3933.039; Wed, 7 Apr 2021 23:13:37 +0000 From: Felix Kuehling To: amd-gfx@lists.freedesktop.org, dri-devel@lists.freedesktop.org Subject: [PATCH 2/4] drm/amdkfd: Use drm_priv to pass VM from KFD to amdgpu Date: Wed, 7 Apr 2021 19:12:57 -0400 Message-Id: <20210407231259.1787-2-Felix.Kuehling@amd.com> X-Mailer: git-send-email 2.31.1 In-Reply-To: <20210407231259.1787-1-Felix.Kuehling@amd.com> References: <20210407231259.1787-1-Felix.Kuehling@amd.com> X-Originating-IP: [165.204.55.251] X-ClientProxiedBy: YT1PR01CA0141.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:2f::20) To BL0PR12MB4948.namprd12.prod.outlook.com (2603:10b6:208:1cc::20) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from Harpoon.amd.com (165.204.55.251) by YT1PR01CA0141.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:2f::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3999.32 via Frontend Transport; Wed, 7 Apr 2021 23:13:37 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 5232fa61-6bf6-43bf-06fb-08d8fa1ac622 X-MS-TrafficTypeDiagnostic: MN2PR12MB4392: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:334; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: dBh/3x8JKilIf4+6V6wJZyEnC1JT7gBfI+athsxW+jzuVQGd5/fUjbip6JkHJmpFavdEN3D5HfbB1WpCeB2bT6UDtubCuuXskM2bSBFWd9FAmcu6dt7wDBJhwqi/I9DyL6pzOawZdublgJVNXTH60F4gPNVc9Bhpu6e5RKWKjjYEIKygSjk4kWqlit2VOpgWVgOv1qu2L/qIFrPtNV77LkR7yR9gSGK+EVc+zQlalbqfNRNO2um6fb/29Ztjo9iG7czM3c/NdS0SpVjX5OcrMpUgV9/9kIK+aW69rNC5hHnr4Fh16ebZmUrkkwKLYKXvNTI6tDaBZqdTv46K+OCRFSRC5oYKL+Nojz5/FIinHQyG3U/tg4ZyO0niBO1HDKRPUMw/vuNkajp1Lw8lRKyJItZ7AORWKSf8MWT70bC0aL+zjSR5Ol0w9piNjZbDAtdTaKftsusf7Hw8GELm3Yu4QRv92hPQR3rfBAxtqSqpFrZNF182aA5EBB3hZu3f7I0sv11jksP4w7/Ucz1NFoiPgB7+iIrR9VHORfZfgyl8Iz/22pC5OsTvvTBrAr7OOb8UOJl3TvRGzKokeQBaT6ri55GakuyeRtLxqGAIx/QhAOfTDyJKllsReYXKspuO0XBcH3N3PaEU8eBhYhToVsZpIrZofD3c40Yct4dGVJ/iQj/ckZiyjwr6l9YNRkxnI+p5 X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BL0PR12MB4948.namprd12.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(39860400002)(366004)(136003)(376002)(346002)(396003)(66556008)(66946007)(316002)(16526019)(86362001)(186003)(52116002)(83380400001)(26005)(66476007)(1076003)(478600001)(7696005)(5660300002)(6666004)(2616005)(38100700001)(2906002)(36756003)(8936002)(8676002)(956004)(38350700001)(4326008)(6486002); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData: AuYwOVBfObcZw8FcUNTC27zGXHygkm6xbB21q0lR5ayaMYD5KJXCRVOlEkJcHPa4MMjbT2Tp2kKFDx1CQNEZqrwzfmBzGuj5+RRU+SRFkxqgZYEc6gsbiWrhVri1+ENzaI6gIWXwHSNFnIAbo5tgMeIagxHC45LvUoaJLZfgDaDxVTP0Bb12IP6x0VLtL7Xfx82a0uxa7b/760yPRIrcDTZI9tSIKamWisHxRDmUOIElcMwiym/0LVphrobo5xslBHxvmSdyszPs8D3Qpit4c5lGmhlZaotgNrq0u/tCy7lK98C5X92IJhC3Xxd7CaoqLrhoLN68O4AZp3TAaOI9yTVzUfyRn2W0NL0r7Db8RzTCLAfFE7SBdHlx1kTrY7Z9f6fPqZ8X7ssxybYddiX/sVwAQkwJSJrihrN4VkivBPS6s6AOjDN+awet15Lvor5oemFzD+Xw3ju5c9XTizCXkBC8VY2kE4leOAmzgoGgEaoKFgR6fRpGJXj/y2+9jDi+dJA+M56YOn09KCQpp1k6EvR2npnmVXffJzThRXigt8edjjeDxubQ4WNSPAMI3oXH8grM+72ghurFFS57RgecWBLK6QvAz/GozqSd6ZXiN0/+4g5Sk+RRtCWSVg2MSZP7nNIrBnQwVaZjWBys1On8LJOBSObNh5LaIg0DtoE7p+yuHPjj+GP083Sc5Yjp24lmjXMV3hFPgR1fJ/NACV66qHTTFG5Ob91xEPeEH6xlWhDicsljPnDzIKvRkCYpOOQhUGuwJwcSW2xxxBShSbJJs9aVFFroe5967RJlrreYfR618xg54yv95YLPO6Rhf+d4W8kSDy4SeLgyBAc9t38W5QRpGeuRy7n2cC6B+kAnFeRHtY7AG1yoF7RuDcjMafB/+hKIclvamRYKIcXHduQCjo0esMrfygg5IAryNhsAcKSXLyEpteVo3Pmrf/8V0zjd/OJPxbxnZDd6O6oSfq49sJTAX3nDyYO9TaRn56qo7SJkJUcpH7WyYiqx+oJZ/X9exU8q1mtjkZvTUv3EN86Sp2EK9cyxjU2h4IIBa9d16U/UdFUyMCspkQg9ML/9DUxNZwOrm6gHvUxqvQ+wqQPkxc16mq9FeS/cRbWlcY6n+rIJdlNlJsnYwzEFsmlBbOZGfFmQlUvgVi6WPwSEtRoIo3A0h5/2heF6e+6IylXLmbyBRRqz3PVYl3IAXv4ZbY82V1T5/VcwD0o2uhs2qTDnY1h6MOOhaRVLSrtaHLD4sScUyGfNszguQMjaWkuX2HgjFFf4Q86Gz3AWup0L9gb630nBnwEwoqmUCU3X7xIAC4VrAnTvDHlGyGvxAgkz6I+R X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-Network-Message-Id: 5232fa61-6bf6-43bf-06fb-08d8fa1ac622 X-MS-Exchange-CrossTenant-AuthSource: BL0PR12MB4948.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 07 Apr 2021 23:13:37.8394 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: a7txgQU4WgjNtNl2xph25JbdzFDpBs1WHRv+66VYLnDGRCxgveU4dUSu9HhUIjJ6qXuLuWMcBIPGL2eVa679cw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR12MB4392 X-BeenThere: dri-devel@lists.freedesktop.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Direct Rendering Infrastructure - Development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: christian.koenig@amd.com, tzimmermann@suse.de Errors-To: dri-devel-bounces@lists.freedesktop.org Sender: "dri-devel" amdgpu_amdkfd_gpuvm_alloc_memory_of_gpu needs the drm_priv to allow mmap to access the BO through the corresponding file descriptor. Signed-off-by: Felix Kuehling --- drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h | 14 ++-- .../gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c | 69 +++++++++++-------- drivers/gpu/drm/amd/amdkfd/kfd_process.c | 5 +- 3 files changed, 50 insertions(+), 38 deletions(-) diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h index 5ffb07b02810..0d59bebd92af 100644 --- a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h +++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h @@ -236,20 +236,20 @@ uint8_t amdgpu_amdkfd_get_xgmi_hops_count(struct kgd_dev *dst, struct kgd_dev *s /* GPUVM API */ int amdgpu_amdkfd_gpuvm_acquire_process_vm(struct kgd_dev *kgd, struct file *filp, u32 pasid, - void **vm, void **process_info, + void **process_info, struct dma_fence **ef); -void amdgpu_amdkfd_gpuvm_release_process_vm(struct kgd_dev *kgd, void *vm); -uint64_t amdgpu_amdkfd_gpuvm_get_process_page_dir(void *vm); +void amdgpu_amdkfd_gpuvm_release_process_vm(struct kgd_dev *kgd, void *drm_priv); +uint64_t amdgpu_amdkfd_gpuvm_get_process_page_dir(void *drm_priv); int amdgpu_amdkfd_gpuvm_alloc_memory_of_gpu( struct kgd_dev *kgd, uint64_t va, uint64_t size, - void *vm, struct kgd_mem **mem, + void *drm_priv, struct kgd_mem **mem, uint64_t *offset, uint32_t flags); int amdgpu_amdkfd_gpuvm_free_memory_of_gpu( struct kgd_dev *kgd, struct kgd_mem *mem, uint64_t *size); int amdgpu_amdkfd_gpuvm_map_memory_to_gpu( - struct kgd_dev *kgd, struct kgd_mem *mem, void *vm); + struct kgd_dev *kgd, struct kgd_mem *mem, void *drm_priv); int amdgpu_amdkfd_gpuvm_unmap_memory_from_gpu( - struct kgd_dev *kgd, struct kgd_mem *mem, void *vm); + struct kgd_dev *kgd, struct kgd_mem *mem, void *drm_priv); int amdgpu_amdkfd_gpuvm_sync_memory( struct kgd_dev *kgd, struct kgd_mem *mem, bool intr); int amdgpu_amdkfd_gpuvm_map_gtt_bo_to_kernel(struct kgd_dev *kgd, @@ -260,7 +260,7 @@ int amdgpu_amdkfd_gpuvm_get_vm_fault_info(struct kgd_dev *kgd, struct kfd_vm_fault_info *info); int amdgpu_amdkfd_gpuvm_import_dmabuf(struct kgd_dev *kgd, struct dma_buf *dmabuf, - uint64_t va, void *vm, + uint64_t va, void *drm_priv, struct kgd_mem **mem, uint64_t *size, uint64_t *mmap_offset); int amdgpu_amdkfd_get_tile_config(struct kgd_dev *kgd, diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c index 36012229ccc1..95442bcd60fb 100644 --- a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c +++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c @@ -951,6 +951,13 @@ static int process_update_pds(struct amdkfd_process_info *process_info, return 0; } +static struct amdgpu_vm *drm_priv_to_vm(struct drm_file *drm_priv) +{ + struct amdgpu_fpriv *fpriv = drm_priv->driver_priv; + + return &fpriv->vm; +} + static int init_kfd_vm(struct amdgpu_vm *vm, void **process_info, struct dma_fence **ef) { @@ -1039,15 +1046,19 @@ static int init_kfd_vm(struct amdgpu_vm *vm, void **process_info, int amdgpu_amdkfd_gpuvm_acquire_process_vm(struct kgd_dev *kgd, struct file *filp, u32 pasid, - void **vm, void **process_info, + void **process_info, struct dma_fence **ef) { struct amdgpu_device *adev = get_amdgpu_device(kgd); - struct drm_file *drm_priv = filp->private_data; - struct amdgpu_fpriv *drv_priv = drm_priv->driver_priv; - struct amdgpu_vm *avm = &drv_priv->vm; + struct amdgpu_fpriv *drv_priv; + struct amdgpu_vm *avm; int ret; + ret = amdgpu_file_to_fpriv(filp, &drv_priv); + if (ret) + return ret; + avm = &drv_priv->vm; + /* Already a compute VM? */ if (avm->process_info) return -EINVAL; @@ -1062,7 +1073,7 @@ int amdgpu_amdkfd_gpuvm_acquire_process_vm(struct kgd_dev *kgd, if (ret) return ret; - *vm = (void *)avm; + amdgpu_vm_set_task_info(avm); return 0; } @@ -1103,15 +1114,17 @@ void amdgpu_amdkfd_gpuvm_destroy_cb(struct amdgpu_device *adev, } } -void amdgpu_amdkfd_gpuvm_release_process_vm(struct kgd_dev *kgd, void *vm) +void amdgpu_amdkfd_gpuvm_release_process_vm(struct kgd_dev *kgd, void *drm_priv) { struct amdgpu_device *adev = get_amdgpu_device(kgd); - struct amdgpu_vm *avm = (struct amdgpu_vm *)vm; + struct amdgpu_vm *avm; - if (WARN_ON(!kgd || !vm)) + if (WARN_ON(!kgd || !drm_priv)) return; - pr_debug("Releasing process vm %p\n", vm); + avm = drm_priv_to_vm(drm_priv); + + pr_debug("Releasing process vm %p\n", avm); /* The original pasid of amdgpu vm has already been * released during making a amdgpu vm to a compute vm @@ -1122,9 +1135,9 @@ void amdgpu_amdkfd_gpuvm_release_process_vm(struct kgd_dev *kgd, void *vm) amdgpu_vm_release_compute(adev, avm); } -uint64_t amdgpu_amdkfd_gpuvm_get_process_page_dir(void *vm) +uint64_t amdgpu_amdkfd_gpuvm_get_process_page_dir(void *drm_priv) { - struct amdgpu_vm *avm = (struct amdgpu_vm *)vm; + struct amdgpu_vm *avm = drm_priv_to_vm(drm_priv); struct amdgpu_bo *pd = avm->root.base.bo; struct amdgpu_device *adev = amdgpu_ttm_adev(pd->tbo.bdev); @@ -1135,11 +1148,11 @@ uint64_t amdgpu_amdkfd_gpuvm_get_process_page_dir(void *vm) int amdgpu_amdkfd_gpuvm_alloc_memory_of_gpu( struct kgd_dev *kgd, uint64_t va, uint64_t size, - void *vm, struct kgd_mem **mem, + void *drm_priv, struct kgd_mem **mem, uint64_t *offset, uint32_t flags) { struct amdgpu_device *adev = get_amdgpu_device(kgd); - struct amdgpu_vm *avm = (struct amdgpu_vm *)vm; + struct amdgpu_vm *avm = drm_priv_to_vm(drm_priv); enum ttm_bo_type bo_type = ttm_bo_type_device; struct sg_table *sg = NULL; uint64_t user_addr = 0; @@ -1350,10 +1363,10 @@ int amdgpu_amdkfd_gpuvm_free_memory_of_gpu( } int amdgpu_amdkfd_gpuvm_map_memory_to_gpu( - struct kgd_dev *kgd, struct kgd_mem *mem, void *vm) + struct kgd_dev *kgd, struct kgd_mem *mem, void *drm_priv) { struct amdgpu_device *adev = get_amdgpu_device(kgd); - struct amdgpu_vm *avm = (struct amdgpu_vm *)vm; + struct amdgpu_vm *avm = drm_priv_to_vm(drm_priv); int ret; struct amdgpu_bo *bo; uint32_t domain; @@ -1394,9 +1407,9 @@ int amdgpu_amdkfd_gpuvm_map_memory_to_gpu( pr_debug("Map VA 0x%llx - 0x%llx to vm %p domain %s\n", mem->va, mem->va + bo_size * (1 + mem->aql_queue), - vm, domain_string(domain)); + avm, domain_string(domain)); - ret = reserve_bo_and_vm(mem, vm, &ctx); + ret = reserve_bo_and_vm(mem, avm, &ctx); if (unlikely(ret)) goto out; @@ -1440,7 +1453,7 @@ int amdgpu_amdkfd_gpuvm_map_memory_to_gpu( } list_for_each_entry(entry, &mem->bo_va_list, bo_list) { - if (entry->bo_va->base.vm == vm && !entry->is_mapped) { + if (entry->bo_va->base.vm == avm && !entry->is_mapped) { pr_debug("\t map VA 0x%llx - 0x%llx in entry %p\n", entry->va, entry->va + bo_size, entry); @@ -1452,7 +1465,7 @@ int amdgpu_amdkfd_gpuvm_map_memory_to_gpu( goto map_bo_to_gpuvm_failed; } - ret = vm_update_pds(vm, ctx.sync); + ret = vm_update_pds(avm, ctx.sync); if (ret) { pr_err("Failed to update page directories\n"); goto map_bo_to_gpuvm_failed; @@ -1488,11 +1501,11 @@ int amdgpu_amdkfd_gpuvm_map_memory_to_gpu( } int amdgpu_amdkfd_gpuvm_unmap_memory_from_gpu( - struct kgd_dev *kgd, struct kgd_mem *mem, void *vm) + struct kgd_dev *kgd, struct kgd_mem *mem, void *drm_priv) { struct amdgpu_device *adev = get_amdgpu_device(kgd); - struct amdkfd_process_info *process_info = - ((struct amdgpu_vm *)vm)->process_info; + struct amdgpu_vm *avm = drm_priv_to_vm(drm_priv); + struct amdkfd_process_info *process_info = avm->process_info; unsigned long bo_size = mem->bo->tbo.base.size; struct kfd_bo_va_list *entry; struct bo_vm_reservation_context ctx; @@ -1500,7 +1513,7 @@ int amdgpu_amdkfd_gpuvm_unmap_memory_from_gpu( mutex_lock(&mem->lock); - ret = reserve_bo_and_cond_vms(mem, vm, BO_VM_MAPPED, &ctx); + ret = reserve_bo_and_cond_vms(mem, avm, BO_VM_MAPPED, &ctx); if (unlikely(ret)) goto out; /* If no VMs were reserved, it means the BO wasn't actually mapped */ @@ -1509,17 +1522,17 @@ int amdgpu_amdkfd_gpuvm_unmap_memory_from_gpu( goto unreserve_out; } - ret = vm_validate_pt_pd_bos((struct amdgpu_vm *)vm); + ret = vm_validate_pt_pd_bos(avm); if (unlikely(ret)) goto unreserve_out; pr_debug("Unmap VA 0x%llx - 0x%llx from vm %p\n", mem->va, mem->va + bo_size * (1 + mem->aql_queue), - vm); + avm); list_for_each_entry(entry, &mem->bo_va_list, bo_list) { - if (entry->bo_va->base.vm == vm && entry->is_mapped) { + if (entry->bo_va->base.vm == avm && entry->is_mapped) { pr_debug("\t unmap VA 0x%llx - 0x%llx from entry %p\n", entry->va, entry->va + bo_size, @@ -1645,14 +1658,14 @@ int amdgpu_amdkfd_gpuvm_get_vm_fault_info(struct kgd_dev *kgd, int amdgpu_amdkfd_gpuvm_import_dmabuf(struct kgd_dev *kgd, struct dma_buf *dma_buf, - uint64_t va, void *vm, + uint64_t va, void *drm_priv, struct kgd_mem **mem, uint64_t *size, uint64_t *mmap_offset) { struct amdgpu_device *adev = (struct amdgpu_device *)kgd; + struct amdgpu_vm *avm = drm_priv_to_vm(drm_priv); struct drm_gem_object *obj; struct amdgpu_bo *bo; - struct amdgpu_vm *avm = (struct amdgpu_vm *)vm; if (dma_buf->ops != &amdgpu_dmabuf_ops) /* Can't handle non-graphics buffers */ diff --git a/drivers/gpu/drm/amd/amdkfd/kfd_process.c b/drivers/gpu/drm/amd/amdkfd/kfd_process.c index d97e330a5022..bad0ecd6ef87 100644 --- a/drivers/gpu/drm/amd/amdkfd/kfd_process.c +++ b/drivers/gpu/drm/amd/amdkfd/kfd_process.c @@ -1383,13 +1383,12 @@ int kfd_process_device_init_vm(struct kfd_process_device *pdd, ret = amdgpu_amdkfd_gpuvm_acquire_process_vm( dev->kgd, drm_file, p->pasid, - &pdd->vm, &p->kgd_process_info, &p->ef); + &p->kgd_process_info, &p->ef); if (ret) { pr_err("Failed to create process VM object\n"); return ret; } - - amdgpu_vm_set_task_info(pdd->vm); + pdd->vm = drm_file->private_data; ret = kfd_process_device_reserve_ib_mem(pdd); if (ret) From patchwork Wed Apr 7 23:12:58 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: Felix Kuehling X-Patchwork-Id: 12189541 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-16.5 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,MSGID_FROM_MTA_HEADER,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED, USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4A0A2C43461 for ; Wed, 7 Apr 2021 23:13:49 +0000 (UTC) Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 9619F611EE for ; Wed, 7 Apr 2021 23:13:47 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 9619F611EE Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=amd.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=dri-devel-bounces@lists.freedesktop.org Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id C7F706E9AF; Wed, 7 Apr 2021 23:13:40 +0000 (UTC) Received: from NAM04-MW2-obe.outbound.protection.outlook.com (mail-mw2nam08on2078.outbound.protection.outlook.com [40.107.101.78]) by gabe.freedesktop.org (Postfix) with ESMTPS id AB7116E9AC; Wed, 7 Apr 2021 23:13:39 +0000 (UTC) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=d/dyiWZ+i1xPS6KOqcIkPQlOKOKPIHVle34/p+30F4fxtvZd00IClU9bOMSPppgMJ8v1BxzagBSl+XFUEMML3YuuRln5mj/sWZ8L2+c3n9GuTSK5n6iQQABbUBZjas7ewLo5Fk1Fni8iS2ru/GO9R3LChacdZUiJE3jzi6QE9/pLb+qFbiFiGeqwLBIupWLhVQYMivcYqgRpUUpLQk892fA7VqqYe+O9Yq2TxOoSfjyZkVu4ROlh6lYuXVGBouqDihnLmXY+EtGR/ibbrcDHIlOMs1KkP7Gw3SNwPRwqHW3VYpfSvYWwwx0OZnl2bInDf8u0aYC56Hl0fIl2JryTLw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=OWrL/PHa0ceCg3zmOPN5MvKhY1P8bu7AthqKE1jSQd0=; b=cTitv0NixzBGH6dL3Jkl5L01GP/rwr/UX4PZABg3gQBocJuCNzVtwR8ODRwi+HLlqYZdTsL+5Oq/9hIoieedtuigJB7ENPIwk0DjRTO+7EpG53AcESt9lm/sTOySDz35kmWKhSF5BZE9RV5TXqNZ/QiE8XEyksU7xEz1AD132KNHIYJq4QL65jqIJuSHywqQcAYoIcz/lxoQJljV9Z1LLIhZiT85BoIv4OuudAwt5EF+vBv1nITGfnM7K91MfUNnTCMaX2HCLbx58MH2IpACwMWoZO1802AvgNqmJNs5eTPEY/0ZgKLPWJNUqaHA+1Ld99aLNj/XwAm1KYnIXDlfgQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=amd.com; dmarc=pass action=none header.from=amd.com; dkim=pass header.d=amd.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=OWrL/PHa0ceCg3zmOPN5MvKhY1P8bu7AthqKE1jSQd0=; b=5HnjmshsPCrRPcYMOLYHb618PuMR4Aptkw+UNCmZhLC6tkQHtfsfUkm1cdspzYP/QhfvSywJDbRxtL19j09fkGRUWb3CMwdDIDXfdimYT27jPr4fDfkqIzvPRzf4AliMv13gsNCQieZnCpCPgURK8Xx2lpPnLWG8y+gXy+2Dvas= Authentication-Results: lists.freedesktop.org; dkim=none (message not signed) header.d=none; lists.freedesktop.org; dmarc=none action=none header.from=amd.com; Received: from BL0PR12MB4948.namprd12.prod.outlook.com (2603:10b6:208:1cc::20) by MN2PR12MB4392.namprd12.prod.outlook.com (2603:10b6:208:264::24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3999.28; Wed, 7 Apr 2021 23:13:38 +0000 Received: from BL0PR12MB4948.namprd12.prod.outlook.com ([fe80::70f5:99ed:65a1:c033]) by BL0PR12MB4948.namprd12.prod.outlook.com ([fe80::70f5:99ed:65a1:c033%7]) with mapi id 15.20.3933.039; Wed, 7 Apr 2021 23:13:38 +0000 From: Felix Kuehling To: amd-gfx@lists.freedesktop.org, dri-devel@lists.freedesktop.org Subject: [PATCH 3/4] drm/amdkfd: Allow access for mmapping KFD BOs Date: Wed, 7 Apr 2021 19:12:58 -0400 Message-Id: <20210407231259.1787-3-Felix.Kuehling@amd.com> X-Mailer: git-send-email 2.31.1 In-Reply-To: <20210407231259.1787-1-Felix.Kuehling@amd.com> References: <20210407231259.1787-1-Felix.Kuehling@amd.com> X-Originating-IP: [165.204.55.251] X-ClientProxiedBy: YT1PR01CA0141.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:2f::20) To BL0PR12MB4948.namprd12.prod.outlook.com (2603:10b6:208:1cc::20) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from Harpoon.amd.com (165.204.55.251) by YT1PR01CA0141.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:2f::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3999.32 via Frontend Transport; Wed, 7 Apr 2021 23:13:38 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: cd8555a8-783d-441d-0f48-08d8fa1ac6ab X-MS-TrafficTypeDiagnostic: MN2PR12MB4392: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:2657; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: kZBOHsLkxVlN8kSWF8rEk1Owrv1/IWlzdPVJHqw0BkMh5PgZa3oq011zD8cXHxWwZNDCVGSQJkw1Z/yNvFg3K7RCOvKOi0SYRcG2Uc50oJBQ45Emfg9aVg+FMFzKp34G8N4OhQV/ukMDN0PzPLO4koOAInTLUP73617iS4TULxgdx4sEEIiGc33sPUmrenpBqloG2FKPkcYWPn6MoBjYjjXNMBP+xJq6ETZ2IDXPGKbfH5ALN+3aR/v8R0eshxdYzIXHcSw+fLCJ8Cws8wMmCTY3t8Jp82buCceY6XFqirJXoEYtEwagt4CdxzwoxMScGGfU2arXcJ+ft4TYTk7DIdnbrdqHMOuucEmsu5Dwy7JiuqnuS0oBSrEQuMJ3ICAu7mdBlFGFR4SwqLZaR+cwmDXc8dPvXPR4MD8SzrHXTwUE7I8HcU1Dzpse88uBfAdqCQwCwRLSXbdJA8ab7aLESdivIN8LmPq6DS6hWGmI3/UoujmCjhgKavAm2k0HKYXkaCNNjLlksJrBr6YGr34ZiKlhzww9pAdY208bymirViW1G1iAwA0tyAcRRC5Yspfp6yh4QWrOn9BtDpduygeTtR9Gd+VsnDe1LgjEngKMk4LZ1ZWTH/Y7pNf0dCJ7M9XEHpJ0QJ/IyWaY/9n4opc+QseLNBrVmAA6ijkM0Fij6Lnij8r96P+idM4pmjekITpK X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BL0PR12MB4948.namprd12.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(39860400002)(366004)(136003)(376002)(346002)(396003)(66556008)(66946007)(316002)(16526019)(86362001)(186003)(52116002)(83380400001)(26005)(66476007)(1076003)(478600001)(7696005)(5660300002)(6666004)(2616005)(38100700001)(2906002)(36756003)(8936002)(8676002)(956004)(38350700001)(4326008)(6486002); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData: hwwFZD83SF1S2CjROpITar8MfilnEf0G1j4WYCMYsRXJj62H7DHJ60BXifmi+cX/xkGCFpJcut89LFi34w2vxtoAxkln2cHWGbXKFUBxAjIVmMpgVIuVfuNYLfMzkwB6M5RuARP6ovmWxtquBd9c/TcvVmDtgmoMBngqe7gWOpTuFk8/oIzHIlBIR89qBTyIjES/wZ46HgDYEIQkmzH+wEfK2QTDJNewpljuDtiCgwBdXnBTMyO/zkUfIx2gn3PLauaHD8c1/yLF3u8nHqzzZ3DNssm6dk4QHJGJOjbjtUNADxe5sjypaIS87yBNvCzqG9yEHUUAIgrQlWJFJSHqwYayuY7oN2TVbLQ0AprCJaAkJjhllMOQA7tR6GQ3vczjCWD1HrQJcJwI67CHo13DtAKWnViM5DhxaItQJT/FyceeJd6XDz9CxdyvOoUyEH9TDooT3PzE6tb5m08hrp8ScjwdXzJqR4EjzCm33Ll/FsUK68qCujIsUOYvm9DM9TfLAlOQ2pQN4UhQV43CvEiTxBr6PNV/wXUUmnLoPqOM1R2sOP5cxw8ZktWrgrRLsic8sswV7hDNruXXIW3ZxkdG0y//84kPFeevPtj8xkulYL1u6z+JFATEpkjB85L0fB4U8xi4OvyV648sMIhK04rMZK9vEHs/9PN1/faicy/jw+/hJiW5YVFqi3Sgj5W1EVMQVRfl1PdtizePVv9ld5BaaZ4pfBdyy/1ajbJqIIJrlRtzhH7NAhOwK/tKDF8YA8Gorh6Z3oHChRHu1dUClEK1HC4Cq/bnwobdJKanZC/uahVgcFU8nVe4g2vVXFgQlRgpfRaw1aamybHqiZi6Y2nbGXf6xIeE2wd9GfKZYFU626Fh3v26Ldrlh23x9EBpmY7OuWeXwk28zHBP0h+kSp3vh24LbPweVp8UHEeMQ/2FZHOC7oH8PE2dF+EtnpvgHQojM+1OYGKj+syVv+ma1f3zGzFMBpY5uRUGq3a2Tp9YZK9x1qT04xnb1mW3fpQICtFdIQ0bdFueuqHAcdJdSRJAQQ0TPlKJwaSI4zebMr9x4UFk/RhmFz+NOfpVtQOe7dmw9F48XxtwkhZYrTO5K0jtODCKWjbnyYb+ua+aPFYQRRi8yeOJ7sZGG3ff1Sc7LHXva3PwA1uKgoU2oZCaY4FKBDakTlUNmr17rFuF4F65fdEk77J2HAAFqCiAigeT6/PnQrm0iFhPNbMs9qRE/w8deuLK3JEbhwZrDY7RF8uLrYikPGIGWCUf3NuXHTMgtN0gEfibDGDaQT83PHI7YSilvwE1FDVZENDdjeglKA5LIuB3iAw4b4clRjbI0k9w+38X X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-Network-Message-Id: cd8555a8-783d-441d-0f48-08d8fa1ac6ab X-MS-Exchange-CrossTenant-AuthSource: BL0PR12MB4948.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 07 Apr 2021 23:13:38.3900 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: cQ4BGxZZSorZb3EqdK+sJEgG+6SOQF26fDLwZ3R9aOjUTXbqPNLRdUoSHCM3Fht1dDbnNVKQq4yP4u69K0xtjQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR12MB4392 X-BeenThere: dri-devel@lists.freedesktop.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Direct Rendering Infrastructure - Development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: christian.koenig@amd.com, tzimmermann@suse.de Errors-To: dri-devel-bounces@lists.freedesktop.org Sender: "dri-devel" DRM allows access automatically when it creates a GEM handle for a BO. KFD BOs don't have GEM handles, so KFD needs to manage access manually. Signed-off-by: Felix Kuehling Acked-by: Christian König --- drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h | 3 ++- .../gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c | 19 ++++++++++++++++++- drivers/gpu/drm/amd/amdkfd/kfd_chardev.c | 8 +++++--- drivers/gpu/drm/amd/amdkfd/kfd_process.c | 7 ++++--- 4 files changed, 29 insertions(+), 8 deletions(-) diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h index 0d59bebd92af..7c8c5e469707 100644 --- a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h +++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h @@ -245,7 +245,8 @@ int amdgpu_amdkfd_gpuvm_alloc_memory_of_gpu( void *drm_priv, struct kgd_mem **mem, uint64_t *offset, uint32_t flags); int amdgpu_amdkfd_gpuvm_free_memory_of_gpu( - struct kgd_dev *kgd, struct kgd_mem *mem, uint64_t *size); + struct kgd_dev *kgd, struct kgd_mem *mem, void *drm_priv, + uint64_t *size); int amdgpu_amdkfd_gpuvm_map_memory_to_gpu( struct kgd_dev *kgd, struct kgd_mem *mem, void *drm_priv); int amdgpu_amdkfd_gpuvm_unmap_memory_from_gpu( diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c index 95442bcd60fb..e7d61ec966b6 100644 --- a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c +++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c @@ -1232,6 +1232,12 @@ int amdgpu_amdkfd_gpuvm_alloc_memory_of_gpu( domain_string(alloc_domain), ret); goto err_bo_create; } + ret = drm_vma_node_allow(&gobj->vma_node, drm_priv); + if (ret) { + pr_debug("Failed to allow vma node access. ret %d\n", + ret); + goto err_node_allow; + } bo = gem_to_amdgpu_bo(gobj); if (bo_type == ttm_bo_type_sg) { bo->tbo.sg = sg; @@ -1261,6 +1267,8 @@ int amdgpu_amdkfd_gpuvm_alloc_memory_of_gpu( allocate_init_user_pages_failed: remove_kgd_mem_from_kfd_bo_list(*mem, avm->process_info); + drm_vma_node_revoke(&gobj->vma_node, drm_priv); +err_node_allow: amdgpu_bo_unref(&bo); /* Don't unreserve system mem limit twice */ goto err_reserve_limit; @@ -1278,7 +1286,8 @@ int amdgpu_amdkfd_gpuvm_alloc_memory_of_gpu( } int amdgpu_amdkfd_gpuvm_free_memory_of_gpu( - struct kgd_dev *kgd, struct kgd_mem *mem, uint64_t *size) + struct kgd_dev *kgd, struct kgd_mem *mem, void *drm_priv, + uint64_t *size) { struct amdkfd_process_info *process_info = mem->process_info; unsigned long bo_size = mem->bo->tbo.base.size; @@ -1355,6 +1364,7 @@ int amdgpu_amdkfd_gpuvm_free_memory_of_gpu( } /* Free the BO*/ + drm_vma_node_revoke(&mem->bo->tbo.base.vma_node, drm_priv); drm_gem_object_put(&mem->bo->tbo.base); mutex_destroy(&mem->lock); kfree(mem); @@ -1666,6 +1676,7 @@ int amdgpu_amdkfd_gpuvm_import_dmabuf(struct kgd_dev *kgd, struct amdgpu_vm *avm = drm_priv_to_vm(drm_priv); struct drm_gem_object *obj; struct amdgpu_bo *bo; + int ret; if (dma_buf->ops != &amdgpu_dmabuf_ops) /* Can't handle non-graphics buffers */ @@ -1686,6 +1697,12 @@ int amdgpu_amdkfd_gpuvm_import_dmabuf(struct kgd_dev *kgd, if (!*mem) return -ENOMEM; + ret = drm_vma_node_allow(&obj->vma_node, drm_priv); + if (ret) { + kfree(mem); + return ret; + } + if (size) *size = amdgpu_bo_size(bo); diff --git a/drivers/gpu/drm/amd/amdkfd/kfd_chardev.c b/drivers/gpu/drm/amd/amdkfd/kfd_chardev.c index 43de260b2230..8fc18de7cff4 100644 --- a/drivers/gpu/drm/amd/amdkfd/kfd_chardev.c +++ b/drivers/gpu/drm/amd/amdkfd/kfd_chardev.c @@ -1328,7 +1328,8 @@ static int kfd_ioctl_alloc_memory_of_gpu(struct file *filep, return 0; err_free: - amdgpu_amdkfd_gpuvm_free_memory_of_gpu(dev->kgd, (struct kgd_mem *)mem, NULL); + amdgpu_amdkfd_gpuvm_free_memory_of_gpu(dev->kgd, (struct kgd_mem *)mem, + pdd->vm, NULL); err_unlock: mutex_unlock(&p->mutex); return err; @@ -1365,7 +1366,7 @@ static int kfd_ioctl_free_memory_of_gpu(struct file *filep, } ret = amdgpu_amdkfd_gpuvm_free_memory_of_gpu(dev->kgd, - (struct kgd_mem *)mem, &size); + (struct kgd_mem *)mem, pdd->vm, &size); /* If freeing the buffer failed, leave the handle in place for * clean-up during process tear-down. @@ -1721,7 +1722,8 @@ static int kfd_ioctl_import_dmabuf(struct file *filep, return 0; err_free: - amdgpu_amdkfd_gpuvm_free_memory_of_gpu(dev->kgd, (struct kgd_mem *)mem, NULL); + amdgpu_amdkfd_gpuvm_free_memory_of_gpu(dev->kgd, (struct kgd_mem *)mem, + pdd->vm, NULL); err_unlock: mutex_unlock(&p->mutex); dma_buf_put(dmabuf); diff --git a/drivers/gpu/drm/amd/amdkfd/kfd_process.c b/drivers/gpu/drm/amd/amdkfd/kfd_process.c index bad0ecd6ef87..da452407c4e5 100644 --- a/drivers/gpu/drm/amd/amdkfd/kfd_process.c +++ b/drivers/gpu/drm/amd/amdkfd/kfd_process.c @@ -648,7 +648,7 @@ static void kfd_process_free_gpuvm(struct kgd_mem *mem, struct kfd_dev *dev = pdd->dev; amdgpu_amdkfd_gpuvm_unmap_memory_from_gpu(dev->kgd, mem, pdd->vm); - amdgpu_amdkfd_gpuvm_free_memory_of_gpu(dev->kgd, mem, NULL); + amdgpu_amdkfd_gpuvm_free_memory_of_gpu(dev->kgd, mem, pdd->vm, NULL); } /* kfd_process_alloc_gpuvm - Allocate GPU VM for the KFD process @@ -712,7 +712,7 @@ static int kfd_process_alloc_gpuvm(struct kfd_process_device *pdd, return err; err_map_mem: - amdgpu_amdkfd_gpuvm_free_memory_of_gpu(kdev->kgd, mem, NULL); + amdgpu_amdkfd_gpuvm_free_memory_of_gpu(kdev->kgd, mem, pdd->vm, NULL); err_alloc_mem: *kptr = NULL; return err; @@ -907,7 +907,8 @@ static void kfd_process_device_free_bos(struct kfd_process_device *pdd) peer_pdd->dev->kgd, mem, peer_pdd->vm); } - amdgpu_amdkfd_gpuvm_free_memory_of_gpu(pdd->dev->kgd, mem, NULL); + amdgpu_amdkfd_gpuvm_free_memory_of_gpu(pdd->dev->kgd, mem, + pdd->vm, NULL); kfd_process_device_remove_obj_handle(pdd, id); } } From patchwork Wed Apr 7 23:12:59 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Felix Kuehling X-Patchwork-Id: 12189545 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-16.5 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,MSGID_FROM_MTA_HEADER,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED, USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 5E0DFC43461 for ; Wed, 7 Apr 2021 23:13:52 +0000 (UTC) Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 124CF610E8 for ; Wed, 7 Apr 2021 23:13:52 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 124CF610E8 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=amd.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=dri-devel-bounces@lists.freedesktop.org Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id E96786E9AE; Wed, 7 Apr 2021 23:13:41 +0000 (UTC) Received: from NAM10-DM6-obe.outbound.protection.outlook.com (mail-dm6nam10on2083.outbound.protection.outlook.com [40.107.93.83]) by gabe.freedesktop.org (Postfix) with ESMTPS id C74A96E9AE; Wed, 7 Apr 2021 23:13:40 +0000 (UTC) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Q9mBl8CyElNHZ89wNqYE79lZcbgt45MHXOKB7e3SkwHes3MumA/JMjQWD/Ngz6cj8bCug7Vg2hwgeNEE5IJOktxl0FK0U7OuaLlsTrdHYFxvLMZeQ4VNuP6c9ErwXlc+Jtes5aybeGxf30QoP0hRHCVwXNWRRnJ37eJVUQfxZ6xHSuDgbkgUl97dRq0Uu5JpT8Egy8y4wIApxCqjkC4ljn9Za77uXgO7H7DS8zguhIO7fPL1ESyYAqONhQHYix+6afF78hvtjfD4/wdnJvdry3cWKe1WsFOvswXLy1xZjCfU4Tx46aGR/miVgDFDIquz5pBXhF7HkQ6Pv4lC+oRkGQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=jwDOAVRuEegC3nUAD3TkeI+jLF1nUslZK+5ORu+Z3TI=; b=CpgJspO7RrMs0QPNiH0bYB26XqKvT0XpQ3vonUO36uFqwXD3T8JsluOnaUGgXLiyxnejQmLT1v/zDGlqHR1xphRQaOleyhG99FQ43Ac9SXDkzzKrK/PHU9591Bf1yTu4p2jRoZ6SG1Y+adxEhRRDp6fIDn+06b5cNU4rcnm6uTWWkUvNKtfvcECZ8lel6MSRLzFdxkScdbRtgQEylXHKcDdoGYi1JBUJ0HI5uyAvqARD7ZbQKuzG1XURqbxR7/YXd0ZqZeff8chZtGvLCTNXlP8LjBqEOr4thsutGiE+bskk1aey6bnmcUOK1wSNK+iepyoDFHT1QV8t3EEkIY1PKg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=amd.com; dmarc=pass action=none header.from=amd.com; dkim=pass header.d=amd.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=jwDOAVRuEegC3nUAD3TkeI+jLF1nUslZK+5ORu+Z3TI=; b=lRouyhA5ouburb22o7vMnOx0Tvpj5GDL4ABbcVOSkj5EUOk4IIlqB0znlYHON5jM98mcO4Dd7e6e5AwtTAjGt+K7Ec3m40h44SvE2ey4uiUJ2pRRWaLXYukiuyDaXdiaoYxpbiZ9QzovMMlM2pPpd9lalPF49Ao5XAg6cIy6ZAk= Authentication-Results: lists.freedesktop.org; dkim=none (message not signed) header.d=none; lists.freedesktop.org; dmarc=none action=none header.from=amd.com; Received: from BL0PR12MB4948.namprd12.prod.outlook.com (2603:10b6:208:1cc::20) by MN2PR12MB3887.namprd12.prod.outlook.com (2603:10b6:208:168::32) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3999.27; Wed, 7 Apr 2021 23:13:39 +0000 Received: from BL0PR12MB4948.namprd12.prod.outlook.com ([fe80::70f5:99ed:65a1:c033]) by BL0PR12MB4948.namprd12.prod.outlook.com ([fe80::70f5:99ed:65a1:c033%7]) with mapi id 15.20.3933.039; Wed, 7 Apr 2021 23:13:39 +0000 From: Felix Kuehling To: amd-gfx@lists.freedesktop.org, dri-devel@lists.freedesktop.org Subject: [PATCH 4/4] drm/amdgpu: Remove verify_access shortcut for KFD BOs Date: Wed, 7 Apr 2021 19:12:59 -0400 Message-Id: <20210407231259.1787-4-Felix.Kuehling@amd.com> X-Mailer: git-send-email 2.31.1 In-Reply-To: <20210407231259.1787-1-Felix.Kuehling@amd.com> References: <20210407231259.1787-1-Felix.Kuehling@amd.com> X-Originating-IP: [165.204.55.251] X-ClientProxiedBy: YT1PR01CA0141.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:2f::20) To BL0PR12MB4948.namprd12.prod.outlook.com (2603:10b6:208:1cc::20) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from Harpoon.amd.com (165.204.55.251) by YT1PR01CA0141.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:2f::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3999.32 via Frontend Transport; Wed, 7 Apr 2021 23:13:38 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: e07c39b1-4761-4137-32e6-08d8fa1ac701 X-MS-TrafficTypeDiagnostic: MN2PR12MB3887: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:989; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: wGPnsET3UHero7EfKOGtX+BBISy82kPkDkHok8q/vOsKCZVDgRzg6+78l+Cpi9ICNN/cArifZN43pjQtpe9CQ29g/KOHPHlJ6gFWsW1Kt6IC+Oc96n+GdiCSrbxy/91w9gg84BiqUhHONW4CtRbGAeUOJ/smWA+TRPyNWDJ0FAp1aGkkGPkuqSe2xo/SPOz4Kg1Xz+2gUgUfIQgNYn1fYJElP0z2zhK/Zr2Cos+vCOeAWkiS5n/JdSP4o+cAtg7o9vxWX7gmLC3a5d1j9v5Wzrzul3PenuhBmt4Zp4RULsfYIVC6CA0ZeIivr20/MoHFqxeAuI1Iu00QldFlXhsXd1FNTZEl4D3tWXZ3gp5irgo8o5Cak52TX1k5Wxvk3GSXXRIzpjCI2UvWDsNBQKoaMpB3m5N13B9b+CO8hWhv7FwDmPE0Ymd78ZttSwXLUfCyV54I4m5GlN7D5y7OMtmPaq5fBFKzjnJV9yn+wBr41iYws9D/JE5FMfsFw7z9txbQNYt3Zp4T4Th0JRVDrlnl0cb68yUEDSxTRbZg6omWYAFC6T+8NO4iN4wJy6gtj9dfeQiWCYbiz09T4fwAYPSN02biqaIzzxcD5VY75PvEKhvo3U7Vq4QVUczh8ymOogUmbSYHoPPuBWiPfFppIeWkSKlOJe2NInFdS1kUg/gjp7/O9gBOq4mQhz7NLm6xXsfy X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BL0PR12MB4948.namprd12.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(136003)(376002)(366004)(39860400002)(346002)(396003)(316002)(66476007)(8936002)(8676002)(52116002)(2906002)(7696005)(38350700001)(16526019)(36756003)(6666004)(38100700001)(26005)(66556008)(1076003)(5660300002)(4326008)(4744005)(6486002)(956004)(186003)(15650500001)(86362001)(2616005)(478600001)(66946007)(83380400001); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData: bEdhsApIgsYxADKCQyjsph6l7rPFuBTwq3AaKCGsl9IiOMv4zhbXFmc6+uzyxCiF+cSIXAD3MaQujYiJoNYkVzPT4NqaU4fL1UAG0KlPBUBHyzmzKxiglS/NjtpO3YmIj+FRKw92wRlFEPTfhTMO304dBcD2ODPMstv4M7YRTmWvDtS5f/yGnrFOC7kw5fNpPUbsB4IYXFXM7ByttvZY2SWSlMyuoF3/lfO3UiejHdDpruPU8298A5im/gGVuFYH9b0JdCwq36a7soIIP+tw4Q57A6PYAce4hkIWvuwrY5Xu32zbuSVDGvMPQy1Y75EgLS4WMvif2N+fKDtU9CJHz8svwhB/KGrDggao1pZscxh9KNoojpdbYZtLX0f3Lrm8KG6SlrFdgNE3Tv1A0z0ugFJcHvZxKjZ4E+KF9PFcLZPkJ3LDUc/d5zshfjg1yJBbNuhEOTTHunKTqrXQ/9QdELG2VN9FaHWHvvnBqmsI+XDy+iO5JImWb3h6t1eFZiG9uBkouecSZHfJ8lC5XO8awGW4NBXBSccEP7FJAtr8RI+2Xmbnh7L3YgJ0Rt2U+jLViKyxsJ3ThZgQBuE91CWUuHq+WGNvc1PZC4dNmXoRGbDWa/iiWFp5DhWkHWTAuwreKBzP1xrhjFL16oetUE38wlp8x6I6rChvTmJoYI8H0Q8jPtuEHf+SlvRKxfMSweXsHbSKpWN/6X5fseM9lWxp916MDGB2dH7kab0SLEBi4N288FWjX3WQsQH15Ld0408cafsyhIqV9bqUMs6qQJJ5xV2JRIeX0r2tnMpmC1DPS2L9bEASbGj+lDOPRcEKq+zRAP/GpJi6VHkkVs48UccAhaAXpXBVg+v6lmo/YouQPxvqglmFKWQ5D6Cb9wDE812ctZguOpI1E7Aufd39gP4lR8z7zEwODQIJK+ZShIyVR77+PcjKDqnQNLlIeDnXnb2tW1NqHhXuPknIg6kPB9QT5r6Pzn1Shg4wBGeGwsv4bIr2zUGvrf8J5r0UbDyTnSDC/mKLIgOS+BwOMQkQD0LksHfRDNdvLplrtlVz0HVDcJ0IZ8wZ7zhV/B8L13uQmrK6K0lqWTsEbuII9RuleuOmKU64QdCTGNvnnCj7IT6ybCOg8gkNCW46Xl/fmfUEfifxa+56FPvaKTba879JN3cPYSPxzq7YHi+A+KNtfZFJKb7+1oetsw+7sdeK6TWp/WSaKMzVmYMMAK2itUPReth4CeA5Wv9uiJ3ADofrhgZGPzgF6OYv6ZL9CB0fMh97gdTpLgw3s/p0l2wa07dIN4N8+JOv/lZ818LX0erAeJnHUNV1IFxne6EvnkV2y+THmZVD X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-Network-Message-Id: e07c39b1-4761-4137-32e6-08d8fa1ac701 X-MS-Exchange-CrossTenant-AuthSource: BL0PR12MB4948.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 07 Apr 2021 23:13:39.0939 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: wizIBumFUp/lJrVFYSjGO0CNmrjY3aOrSJwsKcmsqpIFn8L+VvJ5qLkiOBxVLwbv+PDUnu/cQy8uAUSnDvFLVA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR12MB3887 X-BeenThere: dri-devel@lists.freedesktop.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Direct Rendering Infrastructure - Development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: christian.koenig@amd.com, tzimmermann@suse.de Errors-To: dri-devel-bounces@lists.freedesktop.org Sender: "dri-devel" This shortcut is no longer needed with access managed progerly by KFD. Signed-off-by: Felix Kuehling --- drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.c | 7 ------- 1 file changed, 7 deletions(-) diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.c b/drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.c index 936b3cfdde55..4947dfe9aa70 100644 --- a/drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.c +++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_ttm.c @@ -165,13 +165,6 @@ static int amdgpu_verify_access(struct ttm_buffer_object *bo, struct file *filp) { struct amdgpu_bo *abo = ttm_to_amdgpu_bo(bo); - /* - * Don't verify access for KFD BOs. They don't have a GEM - * object associated with them. - */ - if (abo->kfd_bo) - return 0; - if (amdgpu_ttm_tt_get_usermm(bo->ttm)) return -EPERM; return drm_vma_node_verify_access(&abo->tbo.base.vma_node,