Message ID | 20230117092723.60441-1-jacek.lawrynowicz@linux.intel.com (mailing list archive) |
---|---|
Headers | show |
Series | New DRM accel driver for Intel VPU | expand |
On Tue, Jan 17, 2023 at 10:27:16AM +0100, Jacek Lawrynowicz wrote: > Hi, > > This patchset contains a new Linux* Kernel Driver for Intel® VPUs. > > VPU stands for Versatile Processing Unit and it is an AI inference accelerator > integrated with Intel non-server CPUs starting from 14th generation. > VPU enables efficient execution of Deep Learning applications > like object detection, classification etc. > > The whole driver is licensed under GPL-2.0-only except for two headers imported > from the firmware that are MIT licensed. > > User space stack is open source and available at: > - UMD driver: https://github.com/intel/linux-vpu-driver > - Compiler and OpenVINO plugin: https://github.com/openvinotoolkit/vpux-plugin > > The firmware for the VPU will be distributed as a closed source binary in > the UMD driver repo. > > This is hopefully the last revision of the patchset with minor changes outlined > below. Entire series pushed to drm-misc-next, thanks a lot and apologies that this all got hold up for longer than usual with the drivers/accel transition. But hopefully bright future ahead! Cheers, Daniel > > Regards, > Jacek > > Changelog > > v6: > - Remove userptr ioctl as it will be probably replaced with dma-buf heaps > - Added dependency on !UML > - Simplify struct file_operations ivpu_fops definition > - Fixed compilation issues in patch 4 and 6 > - Updated TODO > > v5: https://lore.kernel.org/all/20230109122344.253994-1-jacek.lawrynowicz@linux.intel.com/ > - Rename ivpu_drm.h to ivpu_accel.h > - Cleanup ivpu_mmu_config_check() > - Optimize locking in ivpu_mmu_cd_add() > - Invalidate user context if it has MMU faults > - Move ivpu_ipc_match_consumer() outside ivpu_ipc_dispatch() > > v4: https://lore.kernel.org/all/20221208110733.5498-1-jacek.lawrynowicz@linux.intel.com/ > - Switch to the accel framework (DRIVER_COMPUTE_ACCEL) > - Move the driver from drivers/gpu/drm to drivers/accel > - Rename kconfig DRM_IVPU option to DRM_ACCEL_IVPU and update dependencies > - Create context on open() instead of lazy allocating it > - Remove status_offset from submit ioctl, as status is now reported in bo_wait ioctl > - Use managed resources in ivpu_drv.c > - Optimize locking in ivpu_ipc.c - add new rx_msg_lock for consumer msg list > - Refactor vpu_hw_mtl_reg.h to use BIT_MASK() and GENMASK() macros > - Use module_pci_driver() for mudule init > - Remove mutex from "struct ivpu_pm_info" > - Add explicit "vdev" arg to ivpu_dbg() > - Use drm_WARN_ON() instead of WARN_ON() where possible > - Add comments for boot related functions > - Update firmware API headers > > v3: https://lore.kernel.org/all/20220924151149.323622-1-jacek.lawrynowicz@linux.intel.com/ > - Fixed alignment warning in ivpu_ipc.c when building with W=1 > > v2: https://lore.kernel.org/all/20220913121017.993825-1-jacek.lawrynowicz@linux.intel.com/ > - Rename the driver from "drm/vpu" to "drm/ivpu" > - Add a TODO file > - Add support for WC buffers > > v1: https://lore.kernel.org/all/20220728131709.1087188-1-jacek.lawrynowicz@linux.intel.com/ > > Jacek Lawrynowicz (7): > accel/ivpu: Introduce a new DRM driver for Intel VPU > accel/ivpu: Add Intel VPU MMU support > accel/ivpu: Add GEM buffer object management > accel/ivpu: Add IPC driver and JSM messages > accel/ivpu: Implement firmware parsing and booting > accel/ivpu: Add command buffer submission logic > accel/ivpu: Add PM support > > MAINTAINERS | 9 + > drivers/Makefile | 1 + > drivers/accel/Kconfig | 2 + > drivers/accel/Makefile | 3 + > drivers/accel/ivpu/Kconfig | 15 + > drivers/accel/ivpu/Makefile | 16 + > drivers/accel/ivpu/TODO | 11 + > drivers/accel/ivpu/ivpu_drv.c | 654 +++++++++++++++ > drivers/accel/ivpu/ivpu_drv.h | 190 +++++ > drivers/accel/ivpu/ivpu_fw.c | 423 ++++++++++ > drivers/accel/ivpu/ivpu_fw.h | 38 + > drivers/accel/ivpu/ivpu_gem.c | 753 +++++++++++++++++ > drivers/accel/ivpu/ivpu_gem.h | 127 +++ > drivers/accel/ivpu/ivpu_hw.h | 170 ++++ > drivers/accel/ivpu/ivpu_hw_mtl.c | 1084 +++++++++++++++++++++++++ > drivers/accel/ivpu/ivpu_hw_mtl_reg.h | 280 +++++++ > drivers/accel/ivpu/ivpu_hw_reg_io.h | 115 +++ > drivers/accel/ivpu/ivpu_ipc.c | 510 ++++++++++++ > drivers/accel/ivpu/ivpu_ipc.h | 93 +++ > drivers/accel/ivpu/ivpu_job.c | 614 ++++++++++++++ > drivers/accel/ivpu/ivpu_job.h | 67 ++ > drivers/accel/ivpu/ivpu_jsm_msg.c | 169 ++++ > drivers/accel/ivpu/ivpu_jsm_msg.h | 23 + > drivers/accel/ivpu/ivpu_mmu.c | 883 ++++++++++++++++++++ > drivers/accel/ivpu/ivpu_mmu.h | 50 ++ > drivers/accel/ivpu/ivpu_mmu_context.c | 398 +++++++++ > drivers/accel/ivpu/ivpu_mmu_context.h | 50 ++ > drivers/accel/ivpu/ivpu_pm.c | 329 ++++++++ > drivers/accel/ivpu/ivpu_pm.h | 38 + > drivers/accel/ivpu/vpu_boot_api.h | 349 ++++++++ > drivers/accel/ivpu/vpu_jsm_api.h | 999 +++++++++++++++++++++++ > include/uapi/drm/ivpu_accel.h | 306 +++++++ > 32 files changed, 8769 insertions(+) > create mode 100644 drivers/accel/Makefile > create mode 100644 drivers/accel/ivpu/Kconfig > create mode 100644 drivers/accel/ivpu/Makefile > create mode 100644 drivers/accel/ivpu/TODO > create mode 100644 drivers/accel/ivpu/ivpu_drv.c > create mode 100644 drivers/accel/ivpu/ivpu_drv.h > create mode 100644 drivers/accel/ivpu/ivpu_fw.c > create mode 100644 drivers/accel/ivpu/ivpu_fw.h > create mode 100644 drivers/accel/ivpu/ivpu_gem.c > create mode 100644 drivers/accel/ivpu/ivpu_gem.h > create mode 100644 drivers/accel/ivpu/ivpu_hw.h > create mode 100644 drivers/accel/ivpu/ivpu_hw_mtl.c > create mode 100644 drivers/accel/ivpu/ivpu_hw_mtl_reg.h > create mode 100644 drivers/accel/ivpu/ivpu_hw_reg_io.h > create mode 100644 drivers/accel/ivpu/ivpu_ipc.c > create mode 100644 drivers/accel/ivpu/ivpu_ipc.h > create mode 100644 drivers/accel/ivpu/ivpu_job.c > create mode 100644 drivers/accel/ivpu/ivpu_job.h > create mode 100644 drivers/accel/ivpu/ivpu_jsm_msg.c > create mode 100644 drivers/accel/ivpu/ivpu_jsm_msg.h > create mode 100644 drivers/accel/ivpu/ivpu_mmu.c > create mode 100644 drivers/accel/ivpu/ivpu_mmu.h > create mode 100644 drivers/accel/ivpu/ivpu_mmu_context.c > create mode 100644 drivers/accel/ivpu/ivpu_mmu_context.h > create mode 100644 drivers/accel/ivpu/ivpu_pm.c > create mode 100644 drivers/accel/ivpu/ivpu_pm.h > create mode 100644 drivers/accel/ivpu/vpu_boot_api.h > create mode 100644 drivers/accel/ivpu/vpu_jsm_api.h > create mode 100644 include/uapi/drm/ivpu_accel.h > > -- > 2.34.1
Hi, On 19.01.2023 12:11, Daniel Vetter wrote: > On Tue, Jan 17, 2023 at 10:27:16AM +0100, Jacek Lawrynowicz wrote: >> Hi, >> >> This patchset contains a new Linux* Kernel Driver for Intel® VPUs. >> >> VPU stands for Versatile Processing Unit and it is an AI inference accelerator >> integrated with Intel non-server CPUs starting from 14th generation. >> VPU enables efficient execution of Deep Learning applications >> like object detection, classification etc. >> >> The whole driver is licensed under GPL-2.0-only except for two headers imported >> from the firmware that are MIT licensed. >> >> User space stack is open source and available at: >> - UMD driver: https://github.com/intel/linux-vpu-driver >> - Compiler and OpenVINO plugin: https://github.com/openvinotoolkit/vpux-plugin >> >> The firmware for the VPU will be distributed as a closed source binary in >> the UMD driver repo. >> >> This is hopefully the last revision of the patchset with minor changes outlined >> below. > Entire series pushed to drm-misc-next, thanks a lot and apologies that > this all got hold up for longer than usual with the drivers/accel > transition. But hopefully bright future ahead! Sure. Thanks for guidance and support. The driver got definitely a lot better because of the upstreaming process. Regards, Jacek