Duolingo announces real-time AI video calls, pop music at annual event

Duolingo users can now make video calls in English, French and Spanish to the app’s signature character Lily, who responds in grumpy monotone.

Principal product manager Zan Gilani went so far as to call the AI conversationalist “slightly offensive,” during a live demo.

But despite her attitude, Lily can remember what users tell her, recall past conversations and teach learners in an open-ended, spontaneous way – making for an experience that more closely mirrors what language learners would encounter in the real world.

The new AI feature was part of several announcements the East Liberty-based company made at its annual Duocon presentation on Sept 24, which featured a conversation between Duolingo’s chief executive Luis von Ahn and music legend Jon Batiste.

Dozens of interns, friends and family members crowded into PNC Playhouse at Point Park University earlier this summer for the event, which was prerecorded then livestreamed. About 18,000 people watched Wednesday on YouTube – representing a fraction of the eight million daily users who have a Duolingo streak longer than a year.

Last year’s Duocon featured an expansion into math and music – and presenters returned to those offerings this year. Both sets of courses, which are now on Android, have expanded based on consumer interest.

The math section includes “life skills” like measurements to help lessons feel more applicable to real life, as well as mini games similar to Wordle by the New York Times.

Music is no longer limited to Jingle Bells – the company earlier this year partnered with Sony Music to add tunes by Meghan Trainer, Pharrell Williams, Sia and a host of other popular musicians. Users can also purchase a US$249 (RM1,029) miniature piano in the company’s signature shade of green, to make the lessons more hands-on.

The company declined to say how many math and music learners it notched in the first year. Mr von Ahn said 250 million math and music lessons have been completed so far.

Both courses help users maintain their daily streaks – which is one of the main reasons people return to the app every day to complete a five minute lesson.

For Pittsburgh nurse Leah Feinberg, who has a 320-day streak in Spanish, completing her daily lesson is a nonnegotiable.

“I gotta keep going, I’m in so deep,” she told the Post-Gazette.

“My boyfriend has a streak as well and if we’re hanging out and it’s about to be midnight, we’re both like ‘Hold on, it’s Duolingo time,'” the 22-year-old said.

Asked whether she would use Duolingo’s new features, like the AI video call, Ms Feinberg was a bit doubtful.

“I truly just go on Duolingo and do my lesson a day and then don’t do much else past that,” she said. “But if you’re very serious about learning a language or trying to learn it before visiting a country, I think that would be a very effective way to learn.”

Video calls are currently available only to paid subscribers through Duolingo Max, though a version of the feature could eventually trickle down to the free courses.

The company announced friend streaks, which will help people pair up and hold their friends accountable. The feature is similar to the connection many young people made on Snapchat, which required users to send a photo every day to maintain a streak.

Due to the popularity of Duolingo’s in-app characters, like Lily, the company is expanding its world to include “adventures” – Nintendo-like games where users can control a personality and interact with computer characters, practicing their language skills along the way.

“The more involved you are in the story, the more present you are in your own learning process,” senior learning designer Kate Barker explained.

The presentation concluded with Jon Batiste at the piano, explaining to Mr Von Ahn how Blues scales helped him learn the keys.

His message to new learners was straight out of the Duolingo playbook: “Consistency.”

“Just do it every day,” Mr. Batiste said. “The synapses (will) start firing in a different way.”

When the Grammy-winning musician started writing music, he said video games like Sonic were a guide. Looking impressed, Mr Von Ahn admitted that he doesn’t play the piano.

“I’m still at the point where I’m frustrated because I can’t do the simplest things,” the tech founder said.

Mr Von Ahn said he hopes that the next Mr Batiste, twenty years from now, will have gotten their start on the Duolingo app.

“Trust me, I believe it,” was Mr Batiste’s reply. – Pittsburgh Post-Gazette/Tribune News Service