TaskTape AR Features Spike

Chris Mathias

Chris Mathias

Austin, Texas

1 0
  • 0 Collaborators

A Spike to produce proof-of-concept AR/AI features for the TaskTape program. These demo features when tightened up will be included in Walkthrough by TaskTape https://itunes.apple.com/us/app/walkthrough-by-tasktape/id1336050583?ls=1&mt=8 ...learn more

Project status: Under Development

Mobile, Artificial Intelligence

Intel Technologies
OpenVINO

Code Samples [1]Links [3]

Overview / Usage

This is a Spike to produce a Proof of Concept (POC) and as such, is just a simple menu UI that takes the user to a demo-version of each intended feature.

Two features are implemented so far:

Job Finder

Intended for use when the user is looking at the Job List and deciding where to go next.
Job Finder uses Core Location + AR & the ARCL library to present job images, names, and distance in a AR context (live camera + AR) to let the user
"take a look around" to see roughly the direction their jobs are in, and how far away.
Once the user selects a job they can tap on it, and from there be given the option to "open in maps" or "view job details".

Area Finder

Intended for use when the user is new to the job and trying to locate where on the job site a particular Area is located.
Area Finder uses Core Location heading data + ARKit to create a "finder arrow" that constant updates relative to the users position
to literally "point them in the right direction".

Methodology / Approach

One of the missions at SolipsAR is to find ways to go beyond the AR hype and attempt to develop useful AR applications. Walkthrough by TaskTape is an excellent tool for its intended purpose, and we believe additional value can be added through the use of Augmented Reality.

AR is a tough sell in the handset format, and we are very excited to pursue headset-based apps and ideas, but firmly believe that for the next 18 - 60 months, AR's primary delivery mechanism will remain the handset (mobile phones).

This project is a first cut at what AR features might be useful in a handset format for the TaskTape product.

We work with a product manager, as well as users of the app, to determine interest in different ideas we have for using advanced technologies such as AR and ML to push the envelope. While the AR features are generally non-critical to the core use case for the app, users do find them interesting and useful.

We are prototyping these features using IOS and ARKit but will also be developing for Android.

Technologies Used

Insofar as the apple IOS devices and macbooks for development use Intel technologies, we are using intel tech. Additionally, we are working on building out the same app on Android. As we are just getting started with the Intel programs, we are beginning to explore how we might use some of the Intel software technologies also for the CV & ML cases.

Other tech includes:

  • ARKit
  • ARCL
  • CoreLocation

We are excited to start looking at OpenVino to increase the AR capabilities particularly around the TapeCreator and TapeFinder features.

Repository

https://github.com/revelfire/tasktape-ar-spike/tree/master/TasktapeARFeatures

Comments (0)