0:00Learning is inherently human. Especially when you talk about languages, you're talking about cultural nuances. You're talking about human connections. You learn a language to connect with other humans. The tutors are at the core of everything that we do at Preply. [music] Without tutors, there's no Preply. Tutors are the reason that students progress. They are the ones generating amazing lesson plans and providing [music] progress to all of the learners.
0:27>> [snorts] >> Now that you have this AI capabilities, you are able to essentially personalize at the nth level to every single user based on what they told you. We can generate a learning plan with the help of the tutor very specifically for [music] that learner. Welcome to Subversive, a podcast dedicated to sharing stories from the best consumer [music] subscription apps in the world. We'll bring you lessons for how to grow your consumer subscription business, including insights and inflection points that led to [music] exponential growth from leaders at category defining companies and innovative startups.
1:00Let's get into the show. My guest today is Simone Mizzy, who joined Preply as a director of product in 2021 and now serves as the company's VP of product growth. In this episode, I talked to Simone about the unique opportunities and challenges of building a humanpowered marketplace for language learning rather than a digital language learning app like Duolingo or Babel. About how the company's new user onboarding flow has needed to evolve as the company scales and about how Simone expects AI to change how people learn languages over the next 3 to 5 years.
1:30All right, welcome Simone to the Subversive podcast. really excited to have you on today to talk about Preply uh which is one of the leading online platforms for language learning in the world and importantly connects language learners with human tutors. So a little bit different than Duallingingo or Babel or some of the other language learning apps out there. Um but before we jump straight to Preply would love to start just with your background and how you found your way to this company.
1:53>> Thanks Phil very very happy to be here. Um, listen, Preply is uh the second company that I've uh really worked at. I initially worked at an online travel agency based out of Bangkok called Agoda, part of the uh booking holdings group. I started there in marketing actually and not in product. And after a couple of years in marketing, uh the product team actually came to me and said, "Hey, Simon, would you be interested in in joining the product team? You seem to like uh building systems and stuff." So why don't you join us and you know took the leap. Um it was uh I guess fairly different types of products than most people think about when you initially think about product.
2:37You know you're like I'm going to build customerf facing product and people are going to touch what I build and and all of that. It wasn't that. you know I was building uh marketing backend automation uh which was a great entry into uh into product uh which I then moved towards more consumerf facing product and so on so forth we can talk more uh about that and then uh after 8 years there I joined joined Preply. >> Yeah. So you were at this company AOD for eight years and it sounds like you worked on a lot of SEO and SEM work in particular in the early days. How did some of that work and sort of seeing things from both the marketing and the product perspective help prepare you for a career leading product growth at Preply?
3:20>> Yeah, so I mean I I I like to think about I think there's a few different types of product, right? You can think about you've got the B2C and the B2B product. And within B2C, you're going to have the uh customer side and supply side or you're going to have customerf facing or more backend side. And I kind of think of it as sexy product versus unsexy product if you know what I mean. Where the sexy product is kind of what you can touch, what you can show to your friends and family. Hey look, this is what I built with my own hands. Uh I I was very much on the unsexy side of of the product building these automations like like I was mentioning just just earlier. But I think uh honestly I don't think that I would have started any other way because uh I I genuinely believe it it's taught me a lot first starting with systems thinking you know when you build uh a system that is supposed to automate keyword creation
4:17ads creation on SEM across 50 different languages with hundreds of millions if not billions of keywords with a system that has many many different steps in between. And you have to think through how step one of your system is going to be impacting step 15 of your system very early on. Otherwise, you know, you're you find yourself having to to rebuild uh everything afterwards, which is obviously not great. And and you have to think at scale because when you have these hundreds of millions, if not billions of of entities that that you deal with in your product, uh you need to think at scale and it needs to work in every single language. needs to work for different attributes of of these entities and and so you definitely have to think through that and I think these are things that you need to apply in any type of product that you build whether they're PLG whether they're backend it really just teaches you that that that
5:16core that core thinking all in all very helpful even to what I'm doing today even though that was that unsexy part of uh of the product >> well I was going to say sexiness is all in the eye of the beholder >> absolutely And so it's really just about the type of product work you love and and I can relate because I started my product career at Ibata. I was one of the first product managers there and for most of my time at Ibata I was doing core product work consumerf facing. So I guess what you would have described as the sexy work but I found myself gravitating more and more towards the growth product work specifically. So how to optimize funnels, how to improve onboarding experiences, how to deliver value right away in the first minute of the user's experience. So consumerf facing uh but maybe not as interesting to some people as building entirely new product features. And I I found that it
6:02really just depends on what type of product work you love. And I think
Why Simon took a leap of faith to join Preply
6:056:05that's a good segue to July 2021 you decide to join Preply. It sounds like at first you were reluctant to leave a go because you had such a great experience there. But ultimately Preply convinced you. So how did they convince you to to jump to not only a new company but an entirely new continent? And how has your role evolved over the last many years as you've been at Preply? >> Yes, I I can remember exactly where I was when I decided, okay, I'm I'm I'm going back. But I think there was a bit of a mixture of of personal and and professional reasons. Like you said, I was very very happy at Agora.
6:39>> The team there was was amazing, very happy with the products that uh that I was working on. And I had no intention to leave really uh until somebody from Preply reached out and and it sounded very very very interesting. And on on the personal level at the time I was 30, I was single. I had been at Agoda for 8 years in Thailand for 12 years. And something in my mind was okay, you're so happy here. If you don't try something new now, you never will. which in and of its own wouldn't be a problem, but I felt like, okay, why not try uh something new or or it's never going to or it's never going to happen. So, that was part of the reason. Let's try something new. What is the worst that can happen? Uh I'll just come back to Thailand, you know, and and then that is going to work out. And on the professional level there's on on the one hand I guess I had and still have always I think I will always have some form of
7:42an imposter syndrome where I was performing well at uh at AOD but something in my mind was are you performing well just because you've been groomed here like would you be able to perform in in another place so you know try and challenge yourself a little bit and see if that uh if that works out. And and lastly, I think I just love language learning. You know, I'm French. We're talking in English right now. I lived in Thailand. I was traveling all over the country and communicating with people in Thailand in Thai. And since very very young I've always been very passionate about language learning and feeling that oh wow this is actually I I can work there and help so many more people to to do that uh I think was also a very very exciting prospect for me and so take all of that together July 2021 still in the pandemic decided okay you know what let's go let's do it >> well good for you I mean they say that
8:46the biggest regrets you have in life are the leaps you don't take so you take this big leap. And as you said, I mean, language learning has played a huge role in my life. I majored in economics and Chinese in college, spent almost half my time as a college student in Beijing and other parts of China. Uh, we were talking before we jumped on the podcast about your trip to Tanzania and my wife has uh spent a lot of her life over there and learned Swahili. So, language learning really can be transformative.
9:12And one of the things that makes uh Preply so special relative to some of the other well-known language apps out there is that it's a human marketplace. So you're connecting language learners with human tutors. Um walk me through
Pros vs. cons of building a language learning marketplace
9:249:25some of the opportunities and challenges that are created by a human language learning marketplace as opposed to a digital app like Duallingingo or Battle. Yeah, I mean I think the term human I guess is something that we're going to talk about a lot in in this conversation and and I think to me that's that that's the biggest opportunity right learning in its own is deeply and inherently human. The motivation that you need to learn something you get from another human being that supports you that motivates you. uh the personalization somebody to understand what is exactly your specific need feel that is going to be very different from mine. So creating that human connections that you know is how many people do you know that tells you oh I took French in high school for 4 years and I went to France and I couldn't order a cafe you know it's it's all about that it's all about learning especially language it's all about these
10:25human connections that you have and and this is the biggest opportunity because this is where real progress happens and at the end of the day people learn a language to make progress and so when Put all of that together, it's it's the biggest opportunity of a human-based marketplace when it comes to language learning. You progress faster. You create deep relationships with your tutor and with other humans. Yeah, >> I think that point you made around motivation is so important because a lot of ink has been spilled on the efficacy or lack of efficacy of an app like Dolingo just when it comes to the pure pedigogy of how quickly and effectively you're learning the language. But there's a separate component to it which is staying motivated. Learning a language is really hard and it takes a long time and having a human coach who can be there for you not just to teach you the language but to keep you
11:13motivated is so important.
How Preply matches language learners with the right tutors
11:1511:15>> And so this brings us to one of the core competencies of a platform like Preply which is matching supply and demand. And in this case that's matching the tutors with the students. So what are some of the most important criteria that Preply has identified for matching the right student to the right tutor at the right time? >> That is the million-dollar question. A few weeks ago we were talking about uh everything that we do as a team and where we are going and and somebody saw you know part obviously a big part of our strategy in growth is that yeah matching students with the right tutor for them and somebody raised their hand and said hey guys I've been at Prely for 4 years now and I've seen this very same problem come up again and again for the last four years when are we going to solve it and my answer was well you know there's companies like booking or Amazon that have been added for the last 20
12:05years and they still have not solved it completely. So we're probably still going to have this as a problem to solve for the next many many many years. One of the core challenge is what we were talking about just earlier. It's very human. Preply is extremely human. So if you think about travel or e-commerce, you know, it's very tangible. You have some very easy comparable parts. What is the star rating of the hotel? What is the size of the room? Does it have a swimming pool? Does it have a view? Yes or no? So, it's fairly binary. When you think about humans, it's a lot about the vibe, which is very hard to quantify and it's not something that is that is binary on whether you're going to vibe with uh with a person or not. And every learner is very very different.
12:56So >> what's very important to consider when you think about that matching is you're at a point in a journey of many many months where you are helping the learner make the decision of their lifelong partner you could say to uh to learn a language. So how do you do that? How do you take all of that complexity and are able to create uh a great match? I I think of it as something that I refer to as the holy trinity. It starts with the learner. You need to learn as much as possible about the learner. It cannot just be a learner that wants to learn English that comes from France. It needs to be much much deeper than that.
13:42your French wanting to learn English because you have an exam in three weeks and you need to get better at the reading part because you've already studied with another tutor to work on that other part. So you need to go very deep in understanding what why is that learner here but then you also need to have the same type of information from your tutors and the same understanding about what the tutors can provide to the student. So if you have all of that information from the student and you don't know if the tutor can help [clears throat] with that specific exam, it's not going to work. So there's a lot of work to be done in understanding which tutor is going to be able to help you at that specific thing that you're looking for.
14:26And then in the middle of that trinity, you have the intelligence layer. that is everything that we do with our machine learning algorithms and and AI to really match these two sides of the marketplace together towards the needs and ensure that we're going to create that uh longlasting relationship. >> So what I'm hearing is and this makes sense you need to deeply understand the learner and not at a surface level like what country they're from and what language they're learning but why they're learning the language, what level of proficiency they're already at, what level of proficiency they're trying to get to. Are they learning it for academic or career reasons? Are they learning it for travel? There's a long list of questions to understand the learner. Similarly, on the tutor side, you want to understand how many years of experience do they have tutoring? Uh are they a native speaker? Did they learn
15:12this language later in life? Do they have any sort of certifications? There long list on the tutor side. And then it sounds like the hardest part is I loved your analogy to travel since you spent eight years working at a go. You know, when you're matching somebody to a hotel or to a a particular activity as part of a trip. There are a set of structured fields that you can just sort of fill in and compare apples to apples. But with a human human interaction, so much of it is difficult to quantify. So I'll push you a little bit on are there any
Experiments that significantly improved matching quality
15:4215:42specific metadata or um characteristics of learners and tutors that you have found to be most important in driving successful matches? Or maybe another way of asking the question is can you give me a specific example of a matching improvement that Preply has rolled out during your time there over the last four years and and sort of what sort of impact that drove. >> Yeah. So impact let's start with impact because I think it's it's good to work backwards from from that in growth at Preply. We thrive for impact that represents what we are really trying to achieve. And like we mentioned earlier, learning is not something that happens in a day. It's many many months and sometimes years depending on where you start from. Yes. And so again, unlike travel or e-commerce where you book a hotel for one weekend, when you try to make an improvement on the matching, we try to measure it as how many longlasting connections have we created.
16:46So it's not about getting the user to >> to pay for that first lesson and then go then this is not a success because we're not helping the learner to hit progress and to hit the value right so what we're really trying to achieve what we define as success in growth is how many longlasting connections we we generate that we measure as a subscription um I would love to go even beyond subscription plus one month two month etc. Uh but for now we're we're at the subscription that is already a great representation of commitment because you wouldn't commit to a relatively large ticket size to somebody that you don't feel is going to help you achieve your goals. Right? So that's success how we measure everything that we do in growth and we measure all of that via experimentation. Purple is extremely experimentationdriven. So every change that we roll out is going to be experimented with and checked against
17:40our uh success metric. So now to to some of the specific uh improvements that we've made. We've run hundreds of experiments. So you're kind of asking me to pick my my favorite child here. Um [laughter and gasps] and I think there's there's a lot of obvious wins. So I I'll mention a couple. Uh there's some obvious wins because I think obvious is good. you know there's you've worked in growth for a long time as well and you know that there's very often the most obvious things all the things that generate the most value and maybe some about uh less obvious um one that I'm particularly excited about is how do you play back the information to the learners on the matching so you can have the best algorithm the best if we go back to the holy trinity you can understand the learner super well have the great data from the tutor have the best intelligence in the middle. If the user goes through your funnel and does not
18:39understand that that intelligence is there and that the tutor is there, it it's all for nothing. >> So really explaining to the user why is that shooter good for you has been some of the best uh wins that we've had in in that matching in that matching funnel. Everything that we do on the intelligence layer with the machine learning improvement. And so as soon as we get more data from the learner, how do we integrate that in the way that uh we show the tutors. So a lot of that a lot of wins we have gotten from these machine learning improvements. And then there's also a lot more about uh UGC specifically about reviews. So like we said it's intrinsically human. We are matching two different people. And so for learners to see that other learners, other humans have had a good experience with that other human is something that is extremely valuable and gives a lot of confidence in the match especially if
19:39that other learner is similar to you. And so going much deeper into the UGC, understanding what student like about the tutor and why and again playing that back to the learner based on what we know of their needs are some of the things that where we've seen some some great success in in improving matching. But like I said, there's hundreds of them. So it's very hard to pick my favorite child. >> But that makes a lot of sense. And let me you said a lot there. So I want to try to break down some of the most important insights I heard and then let's make sure I got them right. So, first you measure success based off of long-term subscriber relationships with a tutor. So, as a new learner on Preply, you have what's called a trial lesson where you're able to do one lesson with a tutor to make sure that they're the right fit. But for you, that's just a leading indicator of success.
20:29Ultimately, success is measured based off of a long-term retained subscriber with that tutor. That's the success metric. And then what I heard you say was, I'm oversimplifying a little bit, but there are three primarily primary sources of value you've found in driving up successful learner tutor match rates. The first is the metadata you're showing in the actual user interface to the learner about that tutor. So this could be things like the average five-star rating of the tutor, how many years they've been teaching this language, what types of certifications they have.
21:04The second component is the machine learning layer that's happening on the back end. So it's stuff that the learner doesn't necessarily see, but it's driving which recommendations you're making to the learner. It's driving the order of tutors that appear in search search results when they search for a tutor for a particular language. And then the third layer, if I'm understanding correctly, is userenerated content. and and I understood that to mean content that the tutor is creating like a video or a short bio about themselves that explains to the learner who they are and it goes beyond the sort of ones and zeros of why they're a good match towards the vibe of like am I actually going to be a good fit with this person and all three of those pillars the metadata that you surface in the user interface the machine learning algorithm that's driving recommendations and search results behind the scenes and
21:56the UGC created by the tutor are all driving the perception of on the learner side that they're going to be a good match because even if they're the perfect match, even if you've done the math and you've determined they're the perfect match, if the learner doesn't perceive it that way, it's all for not. Did I get that right? >> That's correct. The only thing I would uh maybe comment on is I I don't know that I would necessarily qualify these three as pillars as opposed to some tactical example of uh of what has happened. I think the pillars slightly higher level goes back a little bit more to the holy trinity that I was talking about earlier and there's another very important component that that we can deep dive into if you're if you're keen that is the the actual trial lesson experience where you know at the end of the day you can do a lot of things around the platform so you can make prep
22:46play as great as possible if the delivery of the lesson if the experience if that human experience is not great it's again all going to be for not because it would be the equivalent of you going to a gym that looks great but all of the machines are broken you know so you're not going to go back to that gym >> so yeah I think they're good examples but I wouldn't necessarily qualify them our as the key pillars that we're after as opposed to tactical examples >> yeah that makes sense you describe the holy trinity your three pillars as the learner the tutor and the machine learning algorithm that connects the two of them these are the tactical uh areas of opportunity you focused on and I
How Preply’s new user onboarding experience has evolved
23:2523:25think your point around the trial lesson is a good segue into the second major topic I wanted to cover today and so that is the user on boarding experience which for any consumer application is important and it's only becoming increasingly important over time because human attention spans are getting shorter and shorter so prepply is now a fairly large company as you've scaled and gotten more complex and you have hundreds of thousands of users and tutors on the platform and you're covering all of these different languages across all these different countries I imagine that the onboarding flow has needed to evolve and adapt to support all that additional complexity.
23:57So what did the onboarding experience originally look like at Preply and how has that evolved over time? >> Yeah, I mean the initial on boarding experience was very very basic. It was mostly based upon uh filtering basically and it's definitely been an area where we've invested a lot uh over over the last few years and you know um we initially introduced a much deeper questionnaire and just as a fun fact you know me coming from travel where friction is bad uh you just got to get to people you got to get people to the hotel as quickly as you can and and that's how you win. I was very skeptical about this ever providing an uplift and hold and behold the the win in terms of conversion was like nothing I'd seen before by introducing friction into uh into the funnel. Yeah.
24:58And I think it's been since then we've had dozens and dozens of improvement on this going deeper into the needs of the learner like like I was mentioning and what we've learned at this point is there is such a thing as as good friction for for the learners and it helps identify who are the high intent learners because Preply is a paid uh subscription. Therefore, you need a certain level of commitment to um to get into the funnel and and and become a and become a user. And so, the good friction has helped us in better qualifying these higher intent users that are ready to put in the work to find really the best match for them while potentially tiring out the low intent users that probably would never have uh converted anyway.
25:50And so it's this very fine line that we're constantly walking that is to find what is the good friction that we can introduce that generates genuine utility to the learners to find a better match and creates that long-lasting relationship. >> That makes a lot of sense and this is something that's come up on a lot of my podcast episodes. This idea of short onboarding flow, long onboarding flow, good friction, bad friction. Where do you strike the balance? And I find that it's so dependent on the nature of the product and the target customer. And in your case, it makes sense, right? You're making a significant investment in finding a tutor, a coach who can help you on this journey of learning a language. And in some cases, this is a very high stakes journey, right? It will determine where you go to college or what sort of job you're able to get or how how high you're able to climb in your career. So, it's very important.
26:37Uh, and it sounds like in your case, a little bit more good friction in the form of asking the right questions in that onboarding experience has has been successful. Are there any specific
Preply’s most successful onboarding experiments
26:4726:47experiments that you can again point to that have been big needle movers in terms of boosting new user registration rate, trial lesson and start rate and most importantly long-term subscriber conversion or retention rate? >> Yeah. So, you know, I uh I'll go back to what we were talking about earlier, right? We focus on subscriptions. Everything in between is a proxy. But there is not a single team in the company optimizing for visits, registrations, trials and so on so forth. Especially because usually what ends up happening is you focus on one thing top of the funnel, the other thing at the bottom of the funnel drops and you're flat at the end, right? And you tap yourself on the back because you've increased the metric when what you really want to achieve has not been achieved. So um we obviously look at them from a funnel perspective that is okay is there unnecessary friction or something that can be improved here but
27:42we would not claim success on something that increases registrations but not subscriptions at the end and I think that's very very important to the way that we think about product in in growth and and I think at Preply in general that is we optimize for the success of of the business and the learner not for a vanity metric. Let's let's put it that way. >> I think I agree. I I'll just quickly say I think that's so important. It's part of why I often coach our clients to if they don't already have a very well-defined activation metric, make sure you understand what your activation metric is. Because unless and until you understand what that aha moment is that is causing you to understand why your product is valuable and why they should not only stick around but pay for the product then you can optimize for the wrong things in the onboarding flow in the life cycle marketing communications and end up driving up vanity metrics
28:32that don't actually drive value for the business. >> Exactly. And so you know thinking about it from from this lens some of the experiments that have been the biggest needle movers again it's a little bit hard to to choose uh what I would talk about because if you think about the whole funnel product is very deeply embedded across every single stage of that funnel starting from marketing automation going to all of the matching that we were talking about to the checkouts. Um, but I think I'll talk a little bit about because that's the part that I'm the most excited about and also the probably the harder one to solve. You know, we were talking just earlier about the uh trial experience itself, like that human experience. And usually what you find in a lot of the platforms or the marketplace, you know, booking optimizes for their platform. They don't optimize for what happens when you're in
29:22the hotel. Same for Airbnb. Amazon doesn't optimize for what happens when you get your product. And but for us because it's so intrinsically human everything that we do for a very long time I felt we were optimizing what happens before great match great experience what was optimizing after how do we help you uh with the next steps of your subscription and your learning etc. But we were not really tackling that moment. That 25 minutes or 50 minutes that you spend with your tutor in that trial lesson that arguably >> is going to be the make or break decision for you. If you don't have a great experience, you're not going to subscribe. If you have a great experience, no matter what the platform is around you, you're probably going to subscribe to Preply. So, it's kind of the harder because then you are working with humans. you're not working with a platform, right? But I think that has been a major unlock for us really
30:21tackling this part of the trial lesson experience, whether it is how do we prepare the tutor better for the class? How do we help in the class both the student and the tutor to build a great rapport to talk about what we know from a pedagogical perspective plus talking with many hundreds of tutors what matters for a great trial lesson. How do you drive that experience in the class when you don't have control over it? Um, it's been a very challenging and inspiring problem uh to solve and and we're still at it and I think it's going to continue being a major unlock in in what we do in that uh in that acquisition fun.
31:03>> I mean that trial lesson really is I love how you called it the make or break moment, right? because that really is the first time the learner is experiencing the core value promise of Preply and in your case that core value promise is only as good as the tutors on your platform. And so that brings me back to
How Preply has maintained tutor quality as it scales
31:2231:23another question which is you know so many startups face challenges scaling just the consumer side of their business but as a two-sided marketplace you also have the supply side of your business. So, how have you been able to maintain very high quality standards among your tutors as you've scaled from thousands to tens of thousands to however many thousands of tutors you have on the platform now? >> Yes. So, maybe I'll start by saying that the tutors are at the core of everything that we do at Preply. Without tutors, there's there's no Preply. Tutors are the reason that students progress. They are the ones generating amazing lesson plans and providing progress to uh to all of the learners and you know a lot of them are full-time on Preply making a full-on living uh with with the platform. So tutors are a really critical part of everything that we do uh at Preply. But indeed maintaining a
32:19high quality experience that it's it's something that uh that we think a lot about. And when I think about one of the biggest uh challenge that we have to solve is it's going to seem very functional but is actually really important is availability. At the end of the day a tutor is selling their time and their time is very finite. There's only 24 hours in a day and seven days in a week. And when you think about most of our t tutorings being crossborder which is also what I find amazing with Preply right the vast majority of all the relationships we create are from people that are in two completely different countries that adds a lot to the availability concern to the availability challenge that we have to solve. So from an acquisition standpoint, if you find the perfect tutor for you that you believe you're going to vibe with, but that tutor is not available at the time that you're available to learn, then it's as if this
33:21tutor didn't exist. Yes. >> Mhm. >> And similarly, as the tutors, as they do very often, uh get more and more popular on the platform, their agenda start to fill up. And so maybe now your slot is uh starting to get uh taken by another student. And you layer on top of that the very human component of tutors being human beings. So they get sick, they also have holidays, they also have things to take care of in real life or things that happen. So you mix all of that together. It makes avail availability one of the core challenges for us to to solve and ensuring that learners can find the right tutor for them but also maintain a uh the same pace of learning over time.
34:08>> Yeah, that makes a lot of sense. I'm a big American football fan. I'm from Minnesota so I'm a Vikings fan and I listen to a number of podcasts and they often like to say the best ability is availability because if you're injured and you can't play then it doesn't matter how talented you are, right? You've got to be on the field. And so the equivalent here is making sure that the tutors are available when they need to be available for the learners to get value. And so that brings me to the last question in this section which is just
Tactics Preply uses to accelerate “time to value”
34:3434:33um as you have scaled both the demand and supply sides of your platform, what investments has Preply and your team in particular made to try to accelerate this idea of time to value meaning getting the learner not just matched to the right tutor, but getting the student matched to the right tutor as quickly as possible. something I I spend a lot of time thinking about and maybe we should start by defining value because we're talking about it just earlier, [clears throat] right? The the core value for somebody learning a language is progress in that language and communication with other other people which can take many many months for it to happen. If you think about like the real value of Preply so you kind of have to work backwards from that. Okay, what is the previous stage of that? It's about learning something, feeling some level of progress, right? If you work backwards from that is having your trial
35:29lesson with the tutor where you have to feel like you are learning and this tutor is going to help you to achieve your goal at the end, that value that you're here to find. And if you move backwards from that, again, it's about getting that match earlier uh as early as possible with uh with that. And there's a few different ways that we're thinking about it. Uh on the one hand uh focusing a little bit more on that first part of that of that funnel that we just talked about. Uh reducing the functional blockers, you know, finding the tutors, you getting to find the best match based on all of the information that you gave us as quickly as possible. Uh availability. So there's a difference if the best tutor for you is available a week from now than if it's available this afternoon at 2 p.m. Right? We're going to be accelerating that time. How do we make scheduling as easy as possible uh for you? And so those are
36:25very functional let's say and then there's maybe a little bit more of the emotional layer because we know that this eventual value can can take more time. So there's how do you feel about the value that you are getting in in the meantime. So how do we create that feeling of the learner that this is the right place for me to get that value? For example, by showing what a class looks like. We know that learners are very anxious. You know, when you think about it, it's crazy. You're telling people you're going to meet a stranger online in a language that you don't speak.
37:02>> Like speak about a nightmare for people. Yeah. It's extremely anxietyinducing. So, how do we make people feel comfortable about what they're about to experience? and not only the tutor but also on on the platform and going back to everything we talked about on the matching and the personalization. How do you feel really that yes that tutor if I I'm trying to take an exam two two months from now and I see on the platform this tutor has helped 10 other students just like you take their exam.
37:36I can already taste the value that I am about to get from Prep. So all of that together, there's not a single answer on how you accelerate the time to value and you kind of have to think through all of these all of these different components. >> I love how you started with defining value and it reminds me of how you emphasize the importance of on the metric side driving long-term subscriber relationships, not just trial, lesson starts. Because similarly, if you define value as well, they have one tutoring session with a tutor. Okay, they've gotten some value.
38:11That will lead to one set of decisions. But if you define value as building a lasting trusting relationship with a tutor and ultimately achieving their language learning goals, then that's more of a marathon versus a sprint and you will make different decisions. >> Absolutely. >> That even if it requires a little bit longer to get there, it's still worth it if they're ultimately getting a lot more value. So, I love that. That's how the the prism through which you're looking looking at it. Um, let's transition to
How AI is changing how people learn languages
38:3638:36talking a little bit about AI. Uh, obviously everybody's talking about AI right now and having been somebody who spent a large part of my career in edtech, I think it's particularly interesting for products that help people learn. So, I'll just start with how do you think AI is going to change how people learn over the next 3 to 5 years? Both broadly, but then more specifically within language learning. >> Right. I think the true answer is nobody knows because things are evolving so quickly at unprecedented pace that it's it's very very hard to tell. I think AI is absolutely changing the paradigm and making learning more accessible and that's extremely extremely exciting. Um on on the other hand, you know, I hear a lot of things about the the doomsday scenario where um oh, we're not going to need to learn languages anymore because AI is going to translate everything for us real time. You know, we're going to
39:34have this thing in our ears or AI is going to replace the tutors and and I don't believe that. Uh I I don't believe that at all cuz I think like we were discussing in you know the opportunities of a humanbased marketplace. I think human learning is inherently human and you need that motivation and especially when you talk about languages, you're talking about cultural nuances. You're talking about human connections. Like you learn a language to connect with other humans.
40:06So you're not just going to learn this with with an AI that is not going to have all of these all of these nuances. And on the other hand, I I do believe that AI is going to be an extremely powerful accelerant to learning both for the student and what they can achieve in between lessons with with the humans, but also for tutors. tutors the same way as we gain efficiency in our work through AI uh tutors can do the same they can create better exercises for the student because they understand them deeply and they can use AI to make their lives easier. Um, so I think there's there's a lot to be excited about when it comes to the combinations of how human and AI work together in in learning uh both in non- languages but especially in in languages. I guess I'm biased obviously working in Prely. So I think yeah there's a lot to be excited about in that uh combination of of human plus AI. Yeah, I tend to agree with you
41:08and I love how you pointed out that when you really boil it down, language is all about connection, right? One of the keys to I'm getting a little philosophical here, but one of the keys to human success as a species is that we are so good at working in groups and one of the keys to us being so good at working in groups is the sophistication of human language. And so even if artificial intelligence makes it easier and easier from a purely transactional standpoint to learn a language or not even have to learn a language because you'll just have technology auto translating between humans, I actually think the demand for learning a language in order to connect at a deeper level with another human being will only go up because the world is becoming an increasingly lonely place and people are seeking uh more ways to find genuine human connection. So I really like that argument. I guess to get a little bit more practical. So as a
How Simon’s team is using AI to accelerate Preply’s growth
42:0142:01product growth leader, how are you and your team using AI both to accelerate growth within existing channels but also unlock new channels like generative engine optimization or GEO? >> When you operate at the scale that we operate, you have opportunities at every single step of your funnel to leverage AI for. And you know, I think AI now has has this big hype with the LLMs and let's call it the generative AI, but let's not forget about the good old machine learning uh part of the AI family, right? Let's let's put it that way. And I think about the entire funnel of our our growth funnel and AI is going to be extremely useful in marketing for us to create uh text, images, videos, scale marketing across many different geos. If you think about uh the matching process now that you have this AI capabilities with uh much more context you are able to essentially personalize at the end level to every single user
43:07based on what they told you. You can you know going to give a very tactical example but the headline of the page can be very much specifically for that user. the learning plan. we can generate a learning plan with the help of the tutor very specifically for that learner when probably a year or two ago we might not have been able to go um to go that much in in depth right and you keep going down the funnel we can help the tutors to provide a better trial experience again to communicate with the student uh AI is great at translation uh we can help student and tutors communicate so I see so many applications all across the funnel, >> but it's also the case of those may not be all of the features that are AI branded, you know, >> and I don't know that I'm such a believer of putting a chatbot everywhere for you to leverage AI all across your funnel. I think there's a lot of smarter way smarter ways that you can use AI to
44:09subtly but helpfully customize your funnel to the learner and based on what you know about them. So, you know, I think there's there's a lot that we are doing and and we will continue doing there on the growth funnel and that's without talking about everything that is happening on on the new frontiers that that we're pushing when it comes to learning with AI and tracking your progress with AI and all of the feedback that that we can provide you as a learner to help you uh progress faster.
44:41you are looking for ways to use AI to solve real customer problems rather than the making the mistake that I think a lot of companies are making right now which is just building the sexy sexiest new AI tools they can and then it becomes technology in search of a problem and oftent times that can at the very least be a distraction and at worst actually be counterproductive to the user in terms of accomplishing what they're using the project to try to accomplish. Uh and then the next thing you said there was sometimes those applications of AI that are most incrementally valuable at least in the short term are not the really pie in the sky you know like generative AI chatbot.
45:24It's it's just using AI to make the matching algorithm a little bit better or using the AI to make the experience for a new user feel slightly more personalized. And yes, there will be more and more interesting applications as time goes on, but right now you're just you're looking for value. And value doesn't always have to be some big new generative AI application >> or at least not to the user. It might it might be in the background, but to the user, it's simply value.
45:52>> Yep. Yep. I think that makes a lot of sense. There's one other flavor that I'd
Why AI is changing Preply’s hiring process
45:5545:56love to ask about in terms of how you're thinking about AI, and that's in terms of hiring and training new team members. So, I guess I'd love to step back and understand a little bit better. How is the current growth team structured at Preply? How many people are on your team? What do those teams look like? And then as that team is expanding and evolving, how are you using AI to both ramp new new employees up to speed faster and help them be more productive?
46:18>> So, there's currently about uh 10 people on uh on the growth team. So, 10 10 different uh 10 different product squads. Um and we've been hiring uh a lot not only on the growth squad but across uh all of product and you know I think initially when we started hiring and um we AI was there we started looking a little bit differently at uh the interviews and the case studies that we were having. You know we were like oh wait is that person actually smart or did they just get this information from AI? So I think initially kind of like everyone it was a little bit more of a uh risk um of a risk averse kind of kind of behavior but then that quickly changed and it became well now my expectations are only higher I know what you can get with AI so if you just meet that bar then you're not meeting the bar right um similarly if we now know that it takes two minutes in one of the many prototyping tool that
47:24exist to write a prompt to illustrate your idea then why didn't you do it >> you know or why not uh so I think essentially what's happened is it moved from um more of being skeptical to now increasing the bar of of what you expect in uh in in the hiring process because the reality is you expect people to be using AI in the day-to-day work so >> they should be using it during the interview and that means that the quality should only be uh that much that much higher, right? And I also found that I had to rethink my questions a little bit because um you know I've been interviewing now for for many many years and you tend to to use the same questions over and over again. You have a very good benchmark. Um, and so I kind of had to rethink my questions because there's critical thinking and answering to the challenges on the spot is still not something that AI can can really achieve. And so to really be able to uh
48:28to assess the candidates whether they would be able to demonstrate the strength in in role uh I also had to rethink these these uh these questions. What I heard you say was the bar has gotten higher because what you're able to do in a certain amount of time has shifted radically with all of these new AI tools. And so in the hiring process, you're needing to adjust the interview guide and the specific questions you're asking in each interview to account for the fact that people can now do a lot more with AI than they they were able to do before. And you want to specifically test for somebody who is using AI on a regular basis because if they're not doing that in the interview, then they're not going to be doing it on the job and they they need to be doing it on the job in order to be maximally productive.
49:12>> Well, let's jump into our lightning round. So, I always start with the first question, same first question, and that is what is the best part about working at Preply, and what's one thing that you would change? >> It's uh going to sound very cheesy uh but I genuinely believe it. Uh the best part to me about working at Preply is is its people. Uh for two reasons. Preply is very missiondriven. You know, you're helping people change their lives. And I feel it attracts a certain breed of people that are genuinely passionate about what it is that they do. And when you layer that on top of exceptional talent, which I was very surprised when I joined Preply 4 years ago, uh the company was much smaller than it is today. And yet the level of talent was already incredible and that's only gotten better. So you mix the passion with uh the smarts and the talent. It's it's just amazing. It's it's a pleasure
50:07to uh to come to work every day and and work with with these people. >> Yeah. I mean, often that is the answer I get. And I've certainly worked in a lot of those environments myself. Quizlet was similar. I feel like education, edtech in general, attracts missionaries, not mercenaries. >> It's a good way to put it. >> Wonderful to work with talented people of any kind, but it's even more wonderful to work for talented people who really believe in the mission that they're getting up every day and working hard for. Um, second one is a language specific question. So, you speak multiple languages. At the very least, you've mentioned French, Thai, English.
50:39What is your favorite foreign language idiom or phrase? And what do you love so much about it? I gotta say, I may be biased because I'm French, but I think the French win in the idioms. I I think like >> I agree with you. [laughter] Uh >> somewhat sarcastic, like a little biting humor idioms. I think I think you do. >> Exactly. And I don't know, for some reason when I think about idioms, I think a lot about like these things that my mom or my dad would say. And and there's one that you know when you're a kid and you forget to uh turn off the light in in your bedroom then in France your dad would actually come in and tell you which means hey this is not versai where the light is always on [laughter] which basically tells you turn the damn light off when you go out.
51:26>> Yeah. Um, >> I'm laughing because I was also raised by a father who, you know, grew up in a blueco collar household and very much believed in saving money whenever you could. And the equivalent for me was when we were at dinner and my brother or I would say like, "We don't like this. We want something else." He'd say, "We're not a restaurant, so you eat what's put in front of you." >> Uh, okay. So, switching back into more of a professional question. So you've mentioned that your chief product officer at Preply once told you there's more than one way to do product. So what impact did that have on you and how has that influenced your growth as a product leader?
52:01>> Yeah, I think that happened maybe a few months after I joined Preply and you know I just came fresh of a like I said I spent eight years there. So I was very much I got a good brain let's put it that way and agoda was had a lot of amazing things and was extremely quantitative in its mindset while I arrived in preply that was uh quantitative and also very qualitative and um so I I had to sort of like rewire my brain and and when I heard this I was like okay yeah that's Right. And so I started I guess reading much more, listening much more whether it is podcasts, uh videos on YouTubes and etc.
52:49And also really digging much deeper into the other viewpoints and you know there's always going to be extreme viewpoints on on both sides of the spectrum of any spectrum really. And so instead of being on one side of the spectrum and sticking there, it was really more about okay, let me listen to all of the sides of the spectrums, understand what everybody has to say and why they are saying it, especially why, and then make make up your mind about it because there's definitely something out of what everyone is saying that you're going to agree with or that can supplement the way that you're currently thinking about things. And I think that's helped me a lot because it's uh evolved and added much more layers to how I thought about things and and then once you break that barrier, you just keep it going. So now I do that all the time and I find this to be extremely uh extremely helpful and really helps with my own personal
53:45growth. I'm so glad you said that because I think a lot of the best, not even just product leaders, a lot of the best leaders at any tech company or or really in any organization, as you get more senior, more and more of your job becomes being an infore and like absorbing all of the best information, all of the best ideas, all of the new cutting edge technologies so that you can then distribute that to your team. And it can be hard to do because especially as a product growth leader, you're so busy. You're pulled in so many different directions. You're responsible for so many metrics. And so the temptation can be to just keep your head down and work harder, but that ends up leading you to a local maximum. And so carving out the time every day, every week to be learning and getting 1% better is so important because it leads to this compounding effect of being more more productive with every hour of time
54:28you are spending on the actual work. A related question is how has your leadership style evolved as you built a larger and larger team? >> I think it's very much related to the previous question also. I reflect on on that a lot, you know, about how do you how do you keep on growing And when I look back at when I started leading teams maybe 10 or so odd years years ago, I think I was I was not really leading teams. I was leading an output. I was leading an outcome and I was doing it with the people with with arguably is not uh is not leading. And especially it doesn't scale. You can do that with one, two, three teams maybe, but at some point it's just going to get out of hand. you cannot be in the detail of every single thing that that comes out.
55:14>> So I think the way that that everything has evolved for me is how do I make sure that the right decisions are being made when I'm not there and that everyone in the team is alive. If I if I ask every single person on the team where are we going and why very importantly why then everybody should be able to give the same answer and take it in separate rooms they should be giving the right answer uh not the right answer the same answer sorry and if that happens then I think it means that the right decisions get made when when you're not in the room and the outputs get that much better because eventually people working on their teams are the experts of what's happening. And you're never going to be as deep in everything that's happening than than they are. And so by mixing this understanding of where we are going and why with their expertise of what is happening, we enter a very virtuous loop
56:14of of impact essentially. And I found that this is so much more gratifying for the team, for the people, for myself and eventually leads to leads to better results. >> Yeah. Yeah, I love that and there were shades of what you said there that relate to a lot of similar answers I've heard around well you stop working on the product and you start working on the team and the team becomes your product but I think you went further and said something I haven't heard before which is creating the right conditions so that the the right or the best decisions are being made even when you're not in the room which of course makes sense because at some point your team is too large you can't be in the room all the time and then the next question is well what does that require and I think what it requires more than anything is hiring the right people and creating the right culture, but then also providing a north
56:59star that everybody can be excited about and agree on and so people can make their own decisions and know that they're moving together in the right direction. >> Yeah. And I'll add something to that that is the northstar is important but then everyone being part of the conversation because I think and I I can relate back to this to to when I was working on a team. I absolutely disliked when my boss just came to me where you need to do that or this is the vision. I may not agree with the vision and I may have very valid reasons why I disagree with the vision >> and and so I think bringing everyone along in the conversation and hearing the words of the experts like we were just talking about earlier to shape that vision and that northstar make the whole difference in the world. That's the difference between you receiving a message telling you this is the vision or you having built the vision alongside
57:51the rest of the team. >> Yeah. it becomes sort of a collective decision-making process around what that north star is and and I would imagine at a tech company in particular it's also a bit of a moving target because the right answer is changing as the the market evolves last question. So to borrow from Lenny Richitzky uh cuz he always likes to ask this question. What is one life motto or guiding principle that you live by? One of the things that I repeat both myself and my team and in my personal life as well is uh statistically you're going to be wrong 50% of the time. So don't sweat it. Like it's okay to be wrong. It's okay to fail.
58:31>> It's not okay to not know why you're doing something in the first place or not know why it failed. So that part is not okay. But statistically you're going to fail 50% of the time. So just chill. Just focus on having the right hypothesis, the right analysis afterwards, and and keep going. You're going to be wrong. You're going to keep being wrong for the rest of your life. So, just keep going. >> I love that. I love that. And there's so much liberation in that statement, right? Don't be afraid of failure. Focus on learning and growth. And as a growth leader, uh it's very appropo to have such a growth mindset. Well, this has been a pleasure, Simone. Thank you so much for coming on. I really enjoyed the conversation. anything you want to say to the audience before we wrap up here?
59:14>> Yeah, thanks Phil. It's been great. It's been great talking. I think uh what I'd like to leave the audience with is uh Preply is hiring. Uh we are uh we're doing really well. We are hiring like crazy around all possible departments of tech and non tech. So whether it is product, data, engineering, design, research, marketing, you name it, we are hiring across the board. So, uh, feel free to reach out, look out for the roles that are out there and and and come and join us.
59:48>> I love it. It sounds like a great opportunity, and having worked with Simone and his team myself for six months, I can say it's a great organization and a great culture. Uh, well, thanks again, Simone. This this was a great conversation, and I appreciate having you on. >> Great. Thanks a lot, Phil.