Loading Curly
Experiment · remote assistance
Cover image for the HelpAR project
Experiment · remote assistance

HelpAR

HelpAR connects an Android field application with a web interface for the remote expert. A shared session provides the operator’s camera view, conversation and visual guidance. Development includes validation on Vuzix M4000 smart glasses and integration of media streaming with assistance workflows.

.NETNext.jsKotlinLiveKit

Prototype under development and device validation. Sustained connection stability and final user acceptance remain open.

Problem

What needed solving

A remote expert struggles to help without seeing the same problem as the person working with the equipment.

Solution

How I approached it

A Kotlin Android client, a Next.js expert interface and a .NET session backend, with LiveKit media transport and SignalR events.

Outcome

What it became

An evolving assistance prototype with video, audio and guidance, also tested on a real field device.

Project gallery

A closer look

The original diagram connects the Android field client, backend and expert web interface.

01 — Connected assistance

HelpAR diagram connecting the Android operator, backend and web expert
An architecture diagram of the collaboration; not a screenshot of a live assistance session.

Done with this case study?

Back to the experiments.

← Back to experiments