Lost in Japan

Our agent, “Lost in Japan,” proactively calls registered users in an earthquake zone, talks to them in their language, extracts key details, and builds a live triage view with geo-location. The working prototype runs end-to-end in the browser: Clerk login → call page → real-time ElevenLabs voice session → structured status + Mapbox map update. Technically, it streams mic audio via WebSockets to an ElevenLabs conversational agent, receives synthesized speech and transcripts, and synchronizes that with browser geolocation and a triage data model. The innovation is a push-based disaster helper that calls you first, stays on the line to keep you calm and conscious, and converts messy panic speech into structured, map-ready information. Real-world impact is high for foreign residents and tourists in Japan, where earthquakes are frequent and language/location explanations during 119 calls are especially hard.