[Music] I've been at Duolingo for 8 years now. What keeps me here is our mission, the fact that we get to work on a product that changes people's lives for the better. Being a product manager at Duolingo is you really own the entire life cycle of the product, and you own it, and a large chunk of it, so you just spend a lot of time thinking through what are the new big features that we should be creating, or what are the massive ways in which we can update these features from very beginning to the end to have a big impact. Product managers at Duolingo are really involved in the idea process and are very much partners with design. They know the art; I know what's good for product. It kind of feels like you're running your own kind of miniature startup within the company. There's room to have that big idea and run with it. We really try to be very risk-taking when it comes to the features that we develop. A lot of things

we are innovative and experimental. We had this team called the experimental AI team, and our goal was just to figure out a new application of this technology that's actually useful. So, we tried a bunch of different things. I would say it was honestly a year of exploration that led us eventually to something that was a conversational AI experience. There's something special about putting a character on the whole screen and getting them to look at you and have a conversation. Everything that we change in the app, we run it first as an AB test, and we look a lot at the metrics to make sure that the change is actually impacting the app and our users in the way that we expected. We have a very great experiment dashboard. You have some kind of hypothesis or intuition about, Okay, I wonder if English learners are actually doing more calls, and I wonder if they have longer conversations 'cause they're more likely to have proficiency in English. You can just go into the metrics and find that out yourself, and

validate that question you have very quickly. We take pride, I would say, in the amount of experimentation we do at Duolingo. At any point in time, Duolingo will have roughly 300 A/B tests running on its product. Half the things won't work out, and that's the expectation. We actually celebrate that because now that means we've tried something that is innovative, that's changing the user experience in a fundamental way. We have this process called product review at Duolingo, where essentially we review all the product changes that are going to be implemented in the app, be it a change to a notification or if it's a huge brand new bet. We will bring it to senior leadership, including our CEO, Luis. How do we know if our CEO, Luis, likes an idea in product review? Without you finishing your proposal, he would just cut you and be like, Ship it, ship it. Then it's like, Oh my God, he loves this idea. Fed exit, How long is this going to take to get in the app? Why is this not in the

app already exposure to how senior leadership thinks, and honestly, just how a group of people that have been doing product for over a decade thinks is like immensely valuable. I think a lot of our PMS are energized by being the best at their craft, um, so I would love to take that further. One of my big aspirations at Duolingo is to build the best PM team, period.

Product at Duolingo

Product at Duolingo

스크립트