Working with Microsoft and RealWear

Last month, the team was involved in another Microsoft hack in Sydney along with one of our mining clients. The focus was v4 of Microsoft’s Bot Framework, and getting an existing chatbot deployed on the RealWear HMT-1.

The HMT-1 is a fully-rugged head-mounted tablet which attaches to your hardhat. They’re soon releasing the HMT-1Z1, which is the world’s first intrinsically safe head mounted wearable.

With great support from the Microsoft CSE team, we successfully achieved fully hands-free operation with voice authentication, voice interaction with SAP, object recognition using a custom vision model and image and document retrieval based on the equipment recognised.

We will demo the software to a mining client late May and see how the HMT-1 operates in a noisy environment, on the mine.

Excited to see the possibilities when we combine a conversational interface, machine learning and computer vision on a fully rugged wearable.

Working with Microsoft and RealWear