Introducing Mike Charniatsou of Flo
0:000:00Mike Charniatsou: Flo is at a very privileged position. 40% of all subscriptions take place after six months. The nature of the relationship between Flo and our customers is slightly different because we aim to be a lifelong partner to the user, and the user needs differ over time. We just keep track of the user needs, how they evolve. And when we see that there is something of value that we can bring to the user beside our core product offering, this is what lets us convert users from freemium into paying three months, six months, you know, 12 months later.
0:41David Barnard: Welcome to the Sub Club Podcast, a show dedicated to the best practices for building and growing app businesses. We sit down with the entrepreneurs, investors, and builders behind the most successful apps in the world to learn from their successes and failures. Sub Club is brought to you by RevenueCat. Thousands of the world's best apps trust RevenueCat to power in-app purchases, manage customers, and grow revenue across iOS, Android, and the web.
1:05You can learn more at revenuecat.com. Let's get into the show. Hello, I'm your host, David Barnard. My guest today is Mike Charniatsou, senior growth product manager at Flo, the women's health app with nearly 80 million monthly users. On the podcast, I talk with Mike about separating paywall wins from business wins, the A/B test that lost twice before delivering a 23% lift, and why you should borrow ideas, not steal solutions.
1:13Hey Mike, thanks so much for joining me on the podcast today. Mike Charniatsou: Thanks for having me. I've been a long time fan, so great to be here. David Barnard: And we are live, you might notice a different set. I'm not in my home office. We're actually at App Growth Annual in New York City. This is lunchtime, so thank you for skipping lunch to join me today. But super excited to have this chat. And I couldn't miss the opportunity since you were in town for this, to have this conversation.
1:34And I wanted to start with your experience prior to Flo. So you were at a company called Loona. Give me a quick history of that as your growth in the app space. Mike Charniatsou: I was the first product hire at Loona, so later I was promoted to CPO as the team grew, but it was a company focused on transforming
Scaling Luna to Nearly $6M ARR
1:481:54what was at that time a very popular thing like sleep stories into something of a more interactive experience. It was like an early stage startup and we did lots of great things. We achieved lots of rewards. Loona won the app store design award. David Barnard: Oh, wow. Mike Charniatsou: Yeah. And as a growth leader, I'm really proud of this story because we managed to scale the app from zero to almost 6 million R&R, so over that period of time.
2:23David Barnard: Nice. And so you grew up at Loona and learned a lot and became chief product officer, and then you transitioned to Flo. And I wanted to bring up Loona to give you an opportunity to talk about what it's like going from chief product officer at a small startup to then joining and being more a part of the team at a much bigger company, why you did it and how that transition has been. Mike Charniatsou: I guess there are two reasons why I decided to do that.
2:51Reason number one is it was during the time when AI was getting bigger and I felt like there was never more
Why Mike Left a CPO Role to Build Again at Flo
2:523:00interest in time to be an individual contributor, to build things, something that you can do when you're a CEO because you're more focused on managing people, leading people, setting up the strategy, and I wanted to build things. The second reason is that I recognized that Flo web division at that moment of time was where Loona were as a business maybe a year ago or so.
3:29I mean, I had a very clear idea what needs to be done to hit the business objectives, but I could do that at a scale. So for me, that was a no-brainer. It was the opportunity that I could not just bus up. David Barnard: Yeah, I hear on that. I mean, I probably should be a manager at this point, but I have held onto the individual contributor badge for probably longer than I should have. But I hear you because it's like I'm not spending my days managing people.
3:57I'm spending my days having conversations, making content, doing stuff, which I enjoy. Mike Charniatsou: It's just fun. It's a long forgotten feeling. David Barnard: So at Loona, you focus a lot on web paywalls, and then that's something you've also been working on a lot at Flo. So I'd love to hear some of the reasoning behind that and some of the successes you had in that. Mike Charniatsou: So when we started exploring the web acquisition, web onboardings with Loona, I guess the web as a thing was just getting traction.
Building Web Onboarding Without a Playbook
4:254:31It was not that popular. There were few companies in the market doing so. And Noom was a great example. I guess they were trailblazer. The biggest challenge for us was Loona was a sleep meditation app. And at that point of time, there was no big player in the niche that we can look up to, like take that playbook and do the same by the playbook. Because when you're a small team, it's good to look up to bigger players because first of all, you can save money not making the same mistakes.
5:08You know what to do and it can be a very good start. So we had to do and to learn everything from scratch, what's the goal of this onboarding? How long should it be? What are the friction points? We have to figure out all that stuff. When I was approached by the Flo team, I felt like the guys, they were in the same position because as you may know, Flo is the biggest women health app and there is no one bigger than Flo.
5:40So I mean, there is no playbook for these kind of companies. That's why I took this opportunity. David Barnard: Yeah. And these days there are so many playbooks. People have been talking about web more and more and more, but you were kind of, like you said, figuring it out. There wasn't a playbook. And I think in some ways that's a huge advantage and probably why Flo poached you and approached you because when you have to start something from scratch and there aren't playbooks, you have to make a lot of mistakes and you learn and you figure things out and, I hate the term, but go back to first principles and figure things out.
6:17And so how's it been at Flo and what are some of the things you've been able to learn and bring to the team? Mike Charniatsou: When you speak about web onboarding flows and web to app thing as a growth channel, the first thing that you hear is like, "Okay,
The Hidden Cost of Web-to-App Funnels
6:276:32that's a good way to bypass App Store and Google Play commissions, all that stuff." And that's what we heard at that moment of time, but nobody told us how expensive it would be to build this thing because you need the infrastructure. And at that point of time, there was no RevenueCat. I mean, there was RevenueCat obviously, but- David Barnard: We didn't have web funnels and web payments and everything. Mike Charniatsou: Yeah. And you had to figure out it from scratch.
6:59You had to make so many mistakes.
How Growth Changes From Early Stage to Flo’s Scale
7:007:02There was no one coherent platform that allowed you to start and running and run things. And when I moved to Flo, things were slightly different. The main difference between a early stage startup and late stage startup as Flo is that it's how you learn to treat differently the progress that you make at Loona. And I guess most of the guys who work at the early stage startup would agree with me, you paint in white strokes, you're trying to figure out the fundamentals, how this thing should work, how should the onboarding journey look like.
7:42At Flo, it's different because there was a product feed behind every feature and you had to appreciate how to grow with a more focus to specific details of the funnel.
8:00David Barnard: I wanted to dive into both Loona and Flo. So what were some of the key moments of success or unlocks at Loona? And then I imagine as we've been discussing, every business is different, but were there anything that did translate and then things that didn't translate, anything that's been working well with web payments at Flo that you didn't even get a chance to try at Loona? Mike Charniatsou: When you're talking about Flo, the first thing that comes to mind is scale.
What Ad Budget Scale Unlocks for Experimentation
8:288:28Product scale, advertising, budget scale, all that kind of things. And there is a wide range of opportunities that come at that scale that were not just accessible to us like when I was part of the Loona team. And scale, advertising scale, allows you to explore more growth opportunities, again, that were also not available to us at Loona.
8:56For example, lots of great experiments at Flo came from insights that were collected by the marketing team because they were able to scan the market to test
9:08lots of hypothesis at scale, gather those insights, process those insights, and pass them on to the product team at Flo. At Loona, we operated in a slightly different way. All we had were market insights, gut feeling, indicated guesses, some tips from the investors. It's just a completely different paradigm how you operate. David Barnard: So do you have any examples of the insights from the marketing team and the process of translating those insights into a web funnel or a specific type of paywall or a specific angle of the web funnel?
9:47Any specific examples to make that more concrete? Mike Charniatsou: Yeah, there is a good one from my time at Flo. The marketing team, user acquisition team, they noticed that
Turning a Meta Ad Insight Into a New Onboarding Goal
9:549:57a specific kind of ads with a specific kind of narratives around enhancing your sex life started to gain traction at Meta. The numbers were pretty good even with the existing funnel. We kind of took that insight and started to dissect it and we figured out that there was a user need that we did not completely explore with the existing onboarding funnels. So what we did, first of all, we created a separate user goal of enhancing sex life and we enriched the onboarding funnel with more questions to tailor
10:43to that experience so that when the user clicks on the ad and gets into the funnel, we acknowledge that the user has come from a specific ad narrative. And with a specific set of questions, we help them to explore that particular narrative to continue seamlessly. It turned out to be a great revenue driver for us. So I guess the biggest finding here is sharing insights between marketing and product teams is crucial. That's a no-brainer, but many teams kind of disregard that which is not a good thing to do because marketing team has a better insight into things
11:30that resonate with your audience and they can validate those insights much faster than you ever can do with your product funnel, for example. David Barnard: Yeah, I think something we've been talking more and more about on the podcast because five years ago you had to be at Flo scale or bigger to be able to build out that much complexity of funnels and everything, but it's getting easier and easier with tools and we're trying to make it easier at RevenueCat and things like that.
12:00But it's so important that gaining those insights from marketing, like you're saying, the ads resonate because it's hitting that specific pain point and need. And then, like you said, it was performing well going into the normal funnel that didn't even highlight that need, but marrying the two where you can go from that whole cohesive experience of identifying the pain point and then reinforcing it along the way, it's just such a powerful combination and it's getting easier for subscale apps to explore that kind of thing.
12:31Mike Charniatsou: Yeah. I think that when you have that synergy between the marketing team and the product team is probably the
Easing the Tension Between Marketing and Product Teams
12:3512:38only way when you can reinforce and make your growth engine stronger. Because if you act separately, you can be just this good, but when there is this synergy between the teams, because usually I guess most of the listeners would agree with me that there's always exist a tension between marketing and product teams because marketing thinks that funnel is not working that well, does not convert that well, and the product folks usually think that marketing does not bring the right audience.
13:12There is always this kind of tension, but when you find a way to overcome it and get to that synergy, it's when you can build a really strong growth engine. David Barnard: I love it when I talk to product teams and marketing teams that are really well integrated, where they really see it as a cohesive product growth team versus marketing team, product team, and then each has their own little fiefdom. And it sounds like… I mean, is that something you've been able to do at Flo or how does that go?
13:44How do you achieve that, especially at a company of the scale of Flo? Mike Charniatsou: I'm not going to lie, it's not like a happy marriage.
How Flo Shares Insights Through Weekly Syncs
13:5213:52The best way is just figure out how you can seamlessly exchange those insights. The thing that we do at Flo is we have weekly syncs. We keep exchanging everything that we do, even if we think it does not matter because you never know what matters, you never know what insights will be valued by a different team. So we kind of instill this practice that every change that we introduce, every change that the marketing team introduces to the ad campaigns, we just share that info and you never know where the conversation may take you from that point.
14:32David Barnard: One of the things that came up as we were preparing for the podcast was this line, and I love it, so I'm going to read it here
Why Paywall Conversion Is Not Your Monetization Strategy
14:3614:37from my laptop, is, "Your paywall conversion is not your monetization strategy." I really like that mentality. So dig a little deeper in what that means and what you meant by that. Mike Charniatsou: I think there are a few things that many growth teams tend to overestimate, and one of them is that short-term conversion wins smoothly translates to business wins, which is not true. And the second point is that which many growth team got wrong, is that a subscription conversion is a one-time event, which is not.
15:14There are lots of things like starting a trial, activating a trial, retaining the user, and so on and so forth. So it's a life cycle. What I meant by that is that usually a prerequisite for building a strong growth engine is building a monetization around the user life cycle, not just focusing on
15:37short-term conversion wins at a certain point of your funnel because onboarding paywalls, for example, is just the beginning of a whole journey for the user.
15:50And there are so many times when you launch an experiment, you see an uplifting conversion rate at the paywall and you think that it's a thing that's
16:02going to boost my business to the moon, which is not true because quite often if you keep analyzing the experiments, even after rolling them out for a long time, you'll see that not all of these wins translate to business wins. And I guess most of the product guys would agree with me. David Barnard: Recent example from the podcast, I had Anada Lakra from BoldVoice on, and she shared some experiments
When a Hard Paywall Win Led to a Spike in Refunds
16:3116:33they ran where they removed the X button from the paywall to make it a fully hard paywall, and it was crushing it. They were so excited, they were going to roll it out to everyone. And then they started looking at refunds, and refunds spiked massively. And so what looked like just this incredible win that they figured out ended up being a negative drain. It became a drain on revenue because they had so many refunds. And so yeah, to your point, it's like there's so many things that look like wins that you're just not exploring the funnel deep enough.
17:08Mike Charniatsou: And usually you're very incentivized to report those wins. Like on LinkedIn, for example, to your management, "Hey, we've got this new win, let's roll it out." I guess it's one of those cool things that you can do at Flo is that you have a possibility to analyze all those things three months after the rollout, six months after the rollout, 12 months after rollout, and figure out whether the win that you reported as a win is actually a business win.
17:41David Barnard: Right. How do you think about business wins then?
How to Tell a Short-Term Win From a Business Win
17:4517:44What is the kind of KPI that you would ultimately work against? And I mean, I imagine it's going to be different for each company, but is it just LTV? Is it revenue in 90 days? Is it retained subscribers? Is it active usage of the app? There's so many different ways to think about what is a business win, and it's not always just the immediate financial. Kind of what you were alluding to earlier, sometimes a short-term financial win is at a sacrifice of long-term business goals.
18:14So what are all the factors that go into how you think about what a business win actually is versus a paywall win versus a onboarding win versus the smaller wins? Mike Charniatsou: I guess over the course of a year, you kind of shape tens of successful experiments with 5, 7, 10% uplift. And at the end of the year, you just do this exercise and check, did your business grow by the same percentage that you reported over the course of the year?
18:46Did the effect compound over the time or not? And that's probably the best exercise to separate short-term wins from business wins and just ask yourself if you are actually growing or you're just
19:06reporting those relative uplifts that don't matter when you zoom out and have a look at how healthy your business is. David Barnard: Yeah. And I mean digging deeper into that though, Flo does have a lot of free users in certain countries and does have a freemium experience, right?
Balancing Freemium Users and Monetization
19:1919:23And I was actually talking to the chief product officer of Duolingo about this is they have, into the detriment of their stock performance, chosen the long-term business goal of not squeezing the freemium experience too hard. So how do you think about that in balancing the product wins, the paywall wins and things like that without ostracizing? Because you could remove features from the free experience to push people to pay.
19:52I mean, there's so many ways to just squeeze the lemon more and more, but then like you said, in the long run, is that the business goals? How do you balance all that and think through all of that? Or how does the team? I know that's not all fall on you either. How do you discuss it internally inside Flo? Mike Charniatsou: There are so many ways to squeeze the lemons until you run out of all those ways.
Why 40% of Flo’s Subscriptions Come After Six Months
20:1220:13And suddenly there are not that many ways to keep squeezing that lemon. So it's one thing that you should be aware of as a growth leader because Flo is at every privileged position. 40% of all subscriptions take place after six months. David Barnard: Oh, wow. Mike Charniatsou: Yeah. Flo is a subscription-based business, but the nature of the relationship between Flo and our customers is slightly different because we aim to be a lifelong partner to the user, and the user needs differ over time.
20:52They may easily fall in and out of different needs and the level of willingness to pay may be different and that's okay. So we accept those rules of the game. And by prioritizing this kind of relationship of being a lifelong partner to every woman, we are not forced to figure out how we monetize our customers.
21:21If we have a look at the life cycle of our customers, as the woman goes through different stages of their life, they may experience different needs. Most of the needs, like tracking your cycle, for example, is covered by Flo without asking the user to pay. David Barnard: I love that point you made earlier about 40% of Flo's subscribers come after six months. I don't think there's many, at least I've heard of, subscription apps that could say that.
21:52It's a really healthy place as a business, as we were talking about how quickly do you push for monetization. And like you said, not all apps have that luxury if you have a high inference cost, if you're early in your journey and need to get that user acquisition paid back immediately. But as you mature as a business, having that flexibility to be able to nurture a relationship over time and look for that longer term conversion is a really healthy balanced incentive.
22:23So it's really impressive that Flo's been able to build that way over time. Mike Charniatsou: We want to keep it that way. We want our users to keep enjoying the product for free and make sure that when the user needs change, Flo will still be there. And we just treat it like that. We don't feel the need to try and monetize the user on day one and day seven because we know that one day something may change and we just will be there.
22:58David Barnard: And then how do you think about everything after that onboarding experience?
Building Monetization Around a Woman’s Life Stages
23:0223:02So how do you get people more activated, engaged into the app? What's the journey from downloading the app, getting all the way through onboarding, using it for six months and then subscribing? How do you think about that entire journey? Mike Charniatsou: I think the uniqueness of this journey is mostly rooted in the underlying needs of the user because we already made a step in that direction and we are moving beyond being just a period tracker to a lifelong partner helping the user navigate through different stages of their lives.
23:37And through their lives, women go through different stages. For example, they want to make sense of how periods affect their lives. They want to get pregnant, they want to follow pregnancy. When you know how the needs of your customers evolve with time, you are able to approach your customers with a tailored-specific product offering at the very right time of their life. And I think this is what Flo is good at. And being a lifelong partner, try to cherish this relationship with the user and not to spoil it with intrusive paywalls.
24:26So we just keep track of the user needs, how they evolve. And when we see that there is something of value that we can bring to the user beside our core product offering, we do. And this is what lets us convert users from freemium into paying three months, six months, 12 months later. David Barnard: Yeah. Since we're here at App Growth Annual, I'll reference a talk from earlier, Greg Cohn from Burner, he talked about
Cherishing the Customer Relationship
24:5925:02negative user experience and they almost track that as a form of KPI to try and minimize those negative user experiences. And it sounds like y'all have a very similar mindset of it's not just about providing value to the user, but it's also about, I love the framing even, cherishing the relationship. "If you are using our app, that's meaningful and we appreciate that." And I think that kind of attitude toward a customer is how you win in the long run, especially again, in the age when anybody can go spin up in a weekend some cheesy knockoff, they're not going to win the market just knocking off the next app.
25:45Being really in touch with the user and caring about that user experience and not being overly aggressive… You have to find the right time and the right approach to monetization, but the more you can be thoughtful about that and user-friendly about that, the better your chances are long-term to increase that LTV and build the relationship. Mike Charniatsou: Exactly. And once again, it's the luxury that we have as a product team.
26:10I guess it's not a universal advice, as I mentioned, apps that feel the pressure to launch that growth engine from day zero, but it's a bit different at Flo.
26:23I mean, we have our own challenges of a different kind, but yeah. David Barnard: How do you think about testing there at Flo?
Measuring Free Trial Experiments With Proxy Events
26:2926:28So when you roll something out, and maybe it does create a negative user experience that you don't want for your users, how are you measuring those quantitative and qualitative aspects of the experiments you roll out and making decisions based on? Mike Charniatsou: If we're talking about our web onboardings, Flo is one of the few apps out there in the market that still operates with trials. Most of the companies ask users to pay upfront.
26:55We don't do that. We give users the opportunity to test the product, but it kind of adds complexity to how you measure experiments, how you evaluate your hypothesis because the actual conversion event, the trial activation event is kind of delayed in time. The best strategy and what we do at Flo is to find the right proxy event that would correlate with the value on the users in the future.
27:26And yeah, we look at these proxy events that help us to make early calls without sacrificing precision and significance. David Barnard: Yeah. And proxy events are so powerful if you get them right. They're tough to get right though. Mike Charniatsou: If you get them right. Yeah, exactly, because your proxy event has to be informative enough about the probability of an event that will likely take place in 30 days and in 40 days.
27:56So it's very hard for early stage startups because you can come up with a good proxy if you have lots of historical data when you have lots of data in general. And yeah, I mean when you're in early stage startup, you have to use your gaffling, I guess. But in case of Flo, yeah, in proxies we trust. David Barnard: Inside Flo, and maybe even from your experience before that, Loona, how do you think about failed
Learning From Failed Experiments With Evidence
28:2228:23experiments and how to learn from those and what lessons to take away? Mike Charniatsou: It's a tough one. It's a painful one. Yeah, first of all, when your experiment fails, the first thing that you instinctively tend to do is just try to come up with an explanation, know what went wrong, like back copy, slow execution, heavy design, all that kind of stuff. But I guess it's a wrong way of doing that because explanation usually tells you what you want to be true.
29:00And I think that the thing that you got to do when the experiment fails is to search for the evidence because the evidence tells you where to look. And this is whenever an experiment fails at Flo, which happens quite a lot of times because we are operating with a well-optimized funnels and the win
29:22rate is slowing down, the first thing you want to do is you want to check if everything went as you planned. Did the user experience and face the change that you introduce in the treatment group? Where was the biggest uplift or where was the biggest drop?
The Perimenopause Step That Went From a 10% Loss to a 23% Win
29:4129:41Is it a specific segment or not? And when you do this small postmortem, you try to figure out if there is an evidence for another try, because I don't
29:56think it's a good practice to iterate because you have a new explanation. You have to iterate when you have new evidence because you may have a number of explanations and it will just launch this vicious cycle of experimenting. And here's a good example from our onboarding team. So in our periscore in boarding funnel, we thought that it could be a good idea to introduce a step where we define what phase of perimenopause the user was in.
30:27And it made so much sense to us at the very beginning. The hypothesis was strong. We thought that it would just reinforce the whole experience. And the first test came back with almost 10% job in conversion rate. What we did is we did not try to look for the evidence. We just, "Okay, what went wrong? I mean, maybe something was wrong with the design. Let's just do it one more run," and nothing happened. We got the same job and conversion rate.
30:58And only then we did some analysis, we tried to dissect the audience and we figure out that for some reason, the way the question was written, it did not make easier for the user to answer them. And basically almost 75% of the users were not assigned any perimenopause phase. And what they got was, "Oops, sorry, we were not able to pinpoint your perimenopause phase. We continue your journey a little bit later." It's not the thing that you expect to see in the onboarding funnel when you click on an ad that kind of promise you to understand what phase you're going through.
31:42That was our piece of evidence. And what we did is we rewrite the question with the help of our medical team and we slightly changed the logic. And in case when we were still unable to define the phase, we just take the users to the next onboarding section without saying to them that, "Oops, we were not…" And it was the third iteration based on the evidence, and it came back with 23% win. David Barnard: Wow. Mike Charniatsou: Yeah.
32:14So it was too good to be true. We did the false iteration. It was like a blackout test. We removed that new section. The test lost, which proved that there was an actual uplift. So the lesson here is all the iterations that were based on explanation lost, the one that was built on evidence one. And I guess that's a good way of treating and approaching your failed experiments. David Barnard: It's so hard to track, collect enough data, and then to actually go back and have the discipline to analyze the data.
32:53And like you said, it's so easy to look at a test like that and just be like, "Oh, it failed. Move on." But then you would've missed that 23% win. And I love how deep you went into the numbers and the fact that it was initially a 10% loss, then a 23% gain. And then you even went back and did the blackout test to make sure it was a real 23% gain. And those are the kind of things that are hard to do, but that actually drive those business results in the long run.
33:20Mike Charniatsou: Yeah. I mean, the thing with blackout is usually not what you want to do because you don't want to find out that there was no actual uplift that you reported.
Why Flo Runs Blackout Tests
33:2533:33But it's a pretty common practice of Flo to do blackout tests for multiple reasons. One of them is to validate that there was a nutshell uplift. And the next one is sometimes you just keep adding things to your onboarding funnels. And sometimes a good thing to do is to remove a step. So I just heard this cool idea these days the biggest app feature is less features, I guess. So it kind of resonates with this blackout thing.
34:09David Barnard: Yeah. So what are your thoughts on seeing something work in one app, or even from your experience, seeing something work
Borrowing Ideas Instead of Copying Solutions
34:1434:16really well at Loona and then you come try to Flo and it just falls flat on its face? How do you think about learning from that? And then what experiments do you see and people posting on LinkedIn or whatever that you learn from and try versus just ignoring, keep down the path? Mike Charniatsou: I guess many product teams tend to borrow the solution before understanding the problem, and I guess it's not how it's supposed to be.
34:49I think borrowing ideas is a good one. We borrowed a lot of ideas at Loona, we borrow a lot of ideas at Flo, but what you should not do is treat the success of another product team as a proof that this thing is going to work in your context for sure. Plus, I guess related to a output-first mentality of most product teams, because copying what's visible is probably the easiest strategy, but there is so much more. And at Flo, I was approached by product leaders from many companies telling me, "Hey, you got to try this one.
35:35We did this, we tracked 10% uplift in conversion rate. This is your silver bullet. You got to do this." And we did exactly the same thing, pixel to pixel, and it just did not work. I didn't have a reasonable explanation why it happens. I just think that you should not treat it as your strategy, as a way to build things. David Barnard: I love your framing there too. I'm going to steal this from you, is borrow the idea, not the solution.
36:06And that's exactly where so many people fail. There's trends that come and go, like the Blinkist paywall. And if you just grab the solution, it did work for some people, but then it failed flat on its face for another, but the idea… And then I saw a lot of people who did actually take the idea and iterate on the idea. The idea is that people need to feel comfortable that they'll be reminded to cancel. That makes them more comfortable to start a free trial.
36:32So the Blinkist paywall did work for a lot of apps because it did that, but then the apps that it didn't work for, they would iterate on the idea. How do we make people feel comfortable starting a free trial? And that's how you take the idea and not just the solution. Mike Charniatsou: The funny thing is that it did not work at Flo at all. David Barnard: Oh, really? Mike Charniatsou: Yeah. David Barnard: I was going to ask you for an example, so maybe that's a perfect example.
Why the Blinkist Paywall Failed at Flo and Luna
36:5136:52Mike Charniatsou: I mean, we did tested it at Loona, we did test it at Flo, and it did not work for both of the teams. Although it looks like a bulletproof thing, but the same thing with the trial toggle, it worked for some teams and it's okay when other teams borrow
37:09the idea, but you don't need to try and borrow the solution because most of the times, it does not work that way. You have to understand the underlying problem first. David Barnard: Yeah. So speaking of borrowing solutions and not ideas, I know you have thoughts on streaks, and we were talking about in preparing for the podcast, I saw
The Problem With Adding Streaks to Everything
37:2737:33in ChatGPT, they implemented a streak feature and it was such… Props to them for trying stuff, first of all. Maybe for the right cohort, it would work. But when I saw it, I was like, "Come on. I use AI enough. I don't need a streak in my AI tool." So what are your thoughts on the dueling of code and putting streaks in everything and that kind of thing? Mike Charniatsou: Yeah, a tiny disclaimer, I think that Duolingo is a remarkable product, but I think that their success accidentally created this cargo code when people keep just borrowing mechanics and trying to fix everything with another gamification feature.
38:16And surprisingly, lots of product teams… Because it all boils down to the issue of intrinsic motivation. Some apps do have it, others don't. And lots of the product teams treat the lack of intrinsic motivation as a missing product feature, and what they're trying to do is like, "Okay, we're going to fix it with a streak feature. Users don't log in every day, let's build a streak. Users don't listen to the meditation audio.
38:50Let's add a streak." For some reason, it's become like a universal answer to all the problems, which is, I mean, I don't get it.
39:02And you have to ask yourself, does forcing this engagement contribute to the user value or it contributes to boosting your product metrics? And these are two different stories. David Barnard: That's a great lesson right there. Well, as we wrap up, I'll ask you the three questions I ask every guest now.
Mike’s Biggest Win of the Year
39:2139:23First one being, what's your biggest win of the last year? Just an experiment that went especially well, a paywall change, something that was a win? Mike Charniatsou: The experiment with adding the perimenopause phase into the onboarding funnel, determining what perimenopause phase the user is, was unexpectedly a blockbuster experiment for us for obvious reasons. David Barnard: Yeah. I mean, at scale, 23% win is- Mike Charniatsou: It's huge.
39:50David Barnard: Yeah. And then what about the biggest fail of the last year?
Why Partner Mode Failed in Onboarding
39:5439:54Mike Charniatsou: There's so many of them. David Barnard: That's an easier question. Mike Charniatsou: Yeah. I mean, we have this feature, it's called Partner Mode. Circle, it's been one of the most requested features and it's super popular right now. More than 10 million pairs are using it. And we thought, "Okay, if it's so popular, so successful, we are going to definitely boost our conversion rate if we introduce this feature into the onboarding funnel." And it was no good.
40:27It kind of taught me a lesson that not every good feature, not every popular feature is a good step for your onboarding journey for multiple reasons, but that's the case. David Barnard: Such a great example. And then the last question is a fill in the blank.
Growth Would Be Easier If....
40:4340:43Growth would be easier if… Mike Charniatsou: If we were in 2013. David Barnard: That's a great answer. Mike Charniatsou: It was so much easier in our life. David Barnard: True, true. That's a great one. Well, fun place to wrap up. It's so great chatting with you. Thank you for joining me. Thanks for coming to App Growth Annual and making the trip over here. Mike Charniatsou: Thanks for having me. Yeah, it's an honor.
41:06Thanks so much. David Barnard: Appreciate it. Thanks so much for listening. If you have a minute, please leave a review in your favorite podcast player. You can also stop by chat.subclub.com to join our private community.