Insiders Hub

YOLOX Plugin for Unity

Christian Mills

Christian Mills

California

1 0
  • 0 Collaborators

This project demonstrates how to create a native plugin for the YOLOX object detection model for Unity that leverages the OpenVINO™ Toolkit. ...learn more

Project status: Under Development

Game Development, Artificial Intelligence

Intel Technologies
Intel Iris Xe, OpenVINO, Intel Iris Xe MAX

Code Samples [1]

Overview / Usage

This goal of this project is to integrate the OpenVINO inference engine with the Unity game engine to use the YOLOX object detection model.

Methodology / Approach

My current methodolgy involves building an OpenVINO project in Visual Studio as a DLL. I then access the DLL as a native plugin inside a Unity project. Currently, I need to download each frame from the GPU to the CPU before performing inference with OpenVINO. This causes a significant performance bottleneck. I might be able to remove this bottleneck in the future by leveraging OpenVINO's Remote Blob API.

Technologies Used

  • Unity Real-Time Development Platform
  • OpenVINO™ Toolkit
  • Intel Iris Xe MAX

Repository

https://github.com/cj-mills/Unity-OpenVINO-YOLOX

Comments (0)