LINGO BUD

Year

2025

Project Type

Platform

Immersive Insiders XR Challenge

Quest 3

Lingo Bud was created during a 6 week XR Challenge hosted by Immersive Insiders with over 3000 participants, and it made finalists! It is a Mixed Reality language learning application that targets language learners that are at the intermediate to advanced level. The only true way to master a language is to be in an environment that fosters active conversations, and that is a pain point for numerous people. Lingo Bud provides a solution to this problem. I partnered with two NYU ITP students: Georgia Chen who is responsible for branding and the 3D models and animations, and Cathy Li who brought in UI UX expertise into the project.

CONTENT

DEVPOST PAGE

Promotional Video

We are very proud of this project as we started the brain storming phase more than 2 weeks behind schedule as Georgia and Cathy were busy with their finals. With less than a month we crafted a fun and intuitive MR app that can greatly enhance the language learning journey.

Tools Used

Azure Speech Service

I utilized this tool to convert text to speech and give the characters their own unique voices.

Open AI

I used Open AI to generate meticulous study plans and realistic and natural character responses

Meta SDK

I included numerous Meta features such as the Voice SDK and the Presence Platform to create an immersive MR experience.

Buddy Customization Update

Each character on top their unique name, personality and teaching materials will now have unique accessories generated for them based on their personalities. For this current iteration there are only eye wear and head wear but this is easily expandable.

Use Case Video

Here is a showcase of how even a fluent Japanese speaker is able to use the app to enhance his speaking. He set his goal to becoming better at interviews and professional environments.

Thanks for scrolling! Enjoy these random Kamenrider scribbles I drew in Miro.

LIMINAL CACOPHONY

ART