Overview / Usage

You draw the controls and you can interact with them in the real world and it will output to serial port to arduino and turn on lights and things.

Methodology / Approach

We used OpenCV image processing Java library to detect specific contour shapes for controls, and detect skin colour blobs for user interaction. We then checked if a specific vertex of the bloc is interacting with a draw element. If we send an output to serial port with is then decoded by the Arduino board and it performs some task like dimming or turning off/on an led.

Repository

https://github.com/CoDeRgAnEsh/Dreamote