HoloXR Edu

HoloXR uses VR and AR to create a live view of a real-world environment (“reality”) with computer-generated input (sound, 3D Machinery graphics, 3D text, 360 video, and GPS information) and thus supplementing (“augmenting”) the visual elements in the view. Using 3-D AR systems enables real tasks to be completed with the help of virtual agents. 3-D AR, mechanical technology learners disassembling an engine will see live, real-time directions overlaid on the parts set out in front of them, and a 360 video showing exactly what steps to take next. We use object detection and segmentation software to create high-quality and accurate content for computer-aided design (CAD) models. ...learn more

Project status: Published/In Market

Virtual Reality, Mobile, Game Development, Artificial Intelligence

Intel Technologies
Intel GPA

Code Samples [1]Links [1]

Overview / Usage

The Key Challenges that are inherent in the technical education sector in the Republic of South Africa:
• Infrastructure, outdated equipment and machinery; teachers were not up to date with the trends of industry;
• Learning and teacher support material (LTSM), which requires updating;
• The collapse of partnerships that existed between Technical Schools and industry, which has created a major gap in affording learners work experience whilst affording industries an opportunity to contribute to schools in preparing learners for the world of work.
•The above have negative ramifications in terms of learner participation and teacher retention Instructional Augmented Reality for Technology Education

Methodology / Approach

Educational objective:
Real time access to virtual equipment and machinery, linking movements and AR feedback systems, to enhance task performance on cognitive tasks.

Implementation and context:
Quite fine granular registration of real world overlays is used to implement instructional environments in AR.

Main Components

Virtual Media: 3D Equipment and machinery
Sharing virtual media: Learners may share 3D models or link to real world objects for other learners to access.
Collaboration: Learners may collaborate on completing cognitive tasks
Educator Portal: Teachers may assign tasks to learners and use the dashboard to obtain learner progress
Main Users: Learners and Teachers

Technologies Used

Tools and SDK:

These are the tools used to generate debug and optimize content
We use vuforia for digital content storage and augmenting 3D models.
We use opencv for background segementation and object tracking

Intel® GPA (Intel GPA is a powerful, free graphics performance analyzer tool, which can be downloaded at https://software.intel.com/en-us/gpa)

System Analyzer: Real-time display of game performance indicators.
Graphics Frame Analyzer: The frame analyzer.
Platform Analyzer: Locates the CPU and GPU workloads.
Graphics Trace Analyzer: Captures detailed event traces for other analyzer analysis.

Middleware:
Unity3D Game Engine was used as the Optimized Middleware for 3D graphiics rendering, analytics and infrastructure

Drivers:
DirectX 12 and Vulkan where used to optimize system-level latency reduction, tuning and api acceleration

Operating System:
Our application is optimized for Andriod and Apple iOS

Repository

https://github.com/TebogoNakampe/HoloXR_EDU

Collaborators

There are no people to show.

Comments (0)