Revolutionizing Language Learning: Duolingo Max Takes Japan by Storm with Groundbreaking ‘Video Call with Lily’ Feature

Duolingo (Headquarters: Pittsburgh, USA, hereinafter “Duolingo”), the world’s most popular language learning app, has launched a new plan “Duolingo Max” equipped with generative AI for Japanese-speaking users. In addition to “Smart Commentary” and “Role Play”, a new plan “Video Call with Lily” has been introduced, where you can enjoy free conversation with the character Lily. With character personalities trained by AI models, mouth movements and facial expressions that match the speech, and conversation memory, it is a new learning experience that allows you to enjoy natural and immersive English conversation.

Duolingo Max is a new plan that uses OpenAI’s GPT-4 to provide a completely new learning experience that was launched in March 2023. Until now, it was only available in the United States and some other markets, but Duolingo Max is now available to users in Japan.

In addition to all the benefits of Super Duolingo (Duolingo’s premium subscription)*1, you will have access to three new AI features: “Smart Commentary,” “Role Play,” and the newly introduced “Video Calls with Lily.”

Smart commentary/role-play is available for several courses, including our English for Japanese Speakers course and our Spanish and French for English Speakers course, but video calling with Lily is currently only available on iOS.

• role play:In role-playing, learners can practice their conversation skills with Duolingo characters through a conversational AI chatbot experience. The scenarios range from “Everyday Life,” “Work & School,” and “Hobbies & Leisure,” ranging from everyday scenarios such as “Ordering an in-flight meal” and “Discussing a new company policy” to unique and humorous scenarios such as “Interviewing an 800-year-old vampire.” Voice input is also possible, making it ideal for practicing listening and speaking, and feedback and encouragement on better phrasing are provided after learning.

New feature with GPT-4/GPT-4o! “Video Call with Lily” provides an immersive English learning experience

In addition, Duolingo announced a new feature, “Video Calls with Lily,” at its annual conference, Duocon 2024(*2), to be held on September 24, 2024. In addition to the two features of “Smart Commentary” and “Role Play,” Duolingo Max subscribers can enjoy natural and immersive conversations with the popular character Lily.

“Video Call with Lily” is an interactive (two-way) free talk format that differs from the “role-playing feature” which has a set scenario, and recreates a natural conversation like talking with a friend.

Behind its friendly interface, it is a world-class conversational AI that combines learning science, thoughtful design and cutting-edge technology to deliver an authentic, realistic and immersive English learning experience.

Feature 1. Train generative AI models to match the character’s personality. Realize realistic English conversation through a new interface: video calling

Lily has appeared frequently in Duolingo lessons, and her personality as an introverted and lethargic teenager has been popular with users. The new feature trains an AI model based on her personality and features cool responses that are characteristic of her.
In addition, unlike the chatbot format that previously supported voice input in the role-playing feature, this new feature uses an interface that mimics a video call. Not only is the content of conversations with Lily generated by AI, but the facial expressions, mouth movements, and other aspects of the design are elaborately crafted, providing a more realistic English conversation experience.
This is a unique, immersive experience made possible by Duolingo’s unique worldview and technology that has been developed over the past 10 years.

Feature 2. The contents of your conversations are remembered, and the more you talk, the more your conversations will be personalized.

Duolingo has been using AI to provide learning tailored to each individual. The new feature automatically adjusts the difficulty level according to the speaker’s speaking skill, so learners of a wide range of levels, from beginners to advanced, can enjoy English conversation.

Lily also remembers the conversations you have with her, so each conversation becomes more personalized and immersive, just like talking to a real friend.

Feature 3. Focused on communication! Learning in parallel with role-playing makes learning more effective

Unlike role-play features that point out mistakes or count words, the “Video Call with Lily” feature focuses on communication itself. When learners are placed in an environment where they are told to make corrections, the brain’s self-correcting function becomes overactive, which can hinder learning. To prevent learners from being unable to speak due to fear of making mistakes, Lily does not emphasize correcting grammar or pronunciation, but instead supports smooth communication. For example, Lily provides training that is closer to real conversations by paraphrasing or simplifying parts that are difficult to understand. This allows learners to speak with confidence to native speakers and develop the ability to overcome hesitation and anxiety during conversations.

Duolingo CEO and co-founder Louis von Ahn had this to say about this:

“Our mission is to develop the world’s best education, accessible to everyone. To achieve this, we believe we need to constantly push the boundaries of technology. With our AI-powered Lily video chat feature, Duolingo offers a new, immersive way to learn languages ​​and helps learners feel more confident. These innovations are just the beginning of how we are using technology to better serve our global community of learners.”

We are working to support more courses, language interfaces, and platforms in the future.

*1 Benefits included in Super Duolingo: unlimited HP, ad-free, personalized lessons, etc.

*2 For more information about Duocon 2024 talks, discussions, and product announcements, visit duolingo.com/duocon.

About Duolingo

Duolingo (www.duolingo.com) is the most popular language learning platform and the most downloaded education app in the world. Its bite-sized lessons make learning a new language fun. Our mission is to develop the world’s best education, accessible to everyone. Duolingo offers a total of more than 100 courses across 42 different languages, from Spanish, French, German, and Korean to Navajo and Yiddish. (The Japanese version offers four languages: English, Chinese, Korean, and French.)

Additionally, we offer learners an affordable and convenient way to take the Duolingo English Test, an online English exam accepted by over 5,000 educational institutions worldwide.