Software UX enhancement using AI and NLP
Peter Darveau
Toronto, Ontario
- 0 Collaborators
Voice Commander (VC) is an app that runs on the iPhone paired with an API on a host computer. VC allows the target software to accept voice commands. This function improves productivity on complexe software programs and assists visually impaired people to use these types of software. ...learn more
Project status: Published/In Market
Internet of Things, Artificial Intelligence
Intel Technologies
Intel CPU,
Other,
Intel Python
Overview / Usage
Our product consists of a software tool that uses a data model to interpret a set of voice commands to execute functions that would otherwise need to be performed manually. Currently, the model uses a database lookup and no learning algorithms which pose limitations to the application of the software and constraints to its functionality. Our solution includes the development of unsupervised (classification, association) and deep learning (NLP) models in the tool capable of adapting to different users and applications, minimizing time to configure the software across industries and improving performance.
Darveau, P. Prognostics and Availability for Industrial Equipment Using High Performance Computing (HPC) and AI Technology. Preprints 2021, 2021090068
Methodology / Approach
The product is commercially available.
We are following the 6sigma DMAIC methodology from a product development standpoint. The software development follows the SCRUM framework.
Methodology Used:
Problem Statement: Automate multiple events under one single keystroke
Measure: 1 event at a time.
Analyze: During your recording sessions, your midi/audio edits and the mixing phase you want to limit dull/repetitive clicks in order to iterate faster (experiments). Navigation scrolls through the timeline (horizontal axis) through tracks (vertical axis) is also time-consuming and markers can only help to a certain extent. Ultimately you want to automate multiple events under one single keystroke. If you merge two events into one, you are now going twice as fast! At the end of the day, it can really save you a lot of time in the studio. Now, how about 3 events or more? Maybe along these lines:
- Select the bass track.
- Solo it.
- Open each of the currently active plugins.
Implement: Identify issues and causes, consult with plant SMEs as required to validate.
Control: Design and Implement relevant Engineering Controls to address issues and make model improvements.
Technologies Used
The API runs on Intel Core i5 processor technology. Programming was done in C++ and Xcode