Robot-avatar SenseDrive - symbiosis of human, mechatronics and virtual reality!

Maksim Masalski

Maksim Masalski

Gdańsk, Województwo pomorskie

1 0
  • 0 Collaborators

The main idea is to control different devices and robots with use of virtual reality. ...learn more

Robotics, RealSense™, Internet of Things

Overview / Usage

This page is about our project SenseDrive! The main idea is to control different devices throw virtual reality. This project has two parts. First part is Virtual Reality Part. We use Intel RealSense camera to detect gestures of the hand and VR glasses + smartphone (it is display of glasses) to draw your hands in virtual reality world. Then this virtual hands can control real devices throw a virtual dashboard. Second part is a Real Robot. This is three-wheel robot based on two Intel Edison modules. This robot has a biomechanical hand to repeat your real hand gestures.
This projects was presented to public at IoT RoadShow hackathon in St. Petersburg on 27 June 2015 and took second place.
Here is videos about this robot:
https://www.youtube.com/watch?v=HPleRjK_XlA
https://www.youtube.com/watch?v=wvkR6yGv2WQ

I want to suggest you my project SenseDrive and tell how my project can help people with disabilities of motion to work on the factory or other place, but at the same time stay at home. Our solution is to unite robotics (with Intel Edison computer), virtual reality glasses (it can be Intel Project Alloy too) and 3D-camera Intel RealSense together. My solution is to control real objects throw virtual reality by robot-avatars. Robot-avatars can help people with disabilities to live in the world and feel freedom. For example, person without opportunities to move, he wears VR-glasses and deeps into robot-avatar which is far away from him and situated on the factory or other place. 3D-camera detects hand gestures of the person and sends it to the robot mechanical hand. As a result robot, which controlled by disabled person, can do necessary things. For example, robot can assemble parts on the factory, control factory machines, repair them or even can control robots for deactivating bombs!

My team now has an MVP of this technology. For today we have fully working prototype of our robot-avatar SenseDrive. And mobile application for VR-glasses to control this robot. You can see photos of our project here https://www.facebook.com/pg/sensedrive.net/photos/?tab=album&album_id=1741122799509423 and here https://www.facebook.com/pg/sensedrive.net/photos/?tab=album&album_id=1686048875016816

Comments (0)