Voice AI Assistant and VR App for HealthTech Startup

Challenge

To integrate mobile application, wearable and insertable biosensors, medical records, XR health studio, and digital twin with multiple organ systems as data sources for LLM-backed AI Assistant to provide health, diet and exercise recommendations

Solution

A scalable cloud backend with an integrated health information database, a VR healthcare studio with an LLM-powered voice AI avatar, a 3D digital twin, and a healthcare studio were developed.

The system combined and analyzed data streams from the VR and mobile applications, wearable and insertable sensors, patient health records, and metrics of multiple organ systems and provided the user with insights into their health, advice on diet and exercise, and a healthy lifestyle.

Stack

Python, JavaScript, C#, Unity, GCP