CaddieOpen in CaddieDownload for Mac

$16M AI CEOs: How to Make $1.3M/Month With AI Apps

Shared by Caddie Library · Updated
Superwall54:57Open on YouTube
Chapters show their main points

The bottom line

Social grows apps it buys after their viral peak by pairing a high-volume, fully AI ad engine with constant, well-documented testing, while humans supply the ideas and taste. That mix lifted revenue per user and let a small team reach $16M a year, with AI creating work that was impossible before.

Key takeaways

  • Apps that peaked and faded are often underpriced, because owners can't see how big the market really is. 6:25
    • Celebs looked like a short viral hit. Social bought it after the peak, and at six years old it is bigger than ever.
    • Its pitch: half the world is curious about a celebrity lookalike, so the audience is huge.
  • Revenue grows through a loop of better user acquisition and better monetization. 13:28
    • Dozens of A/B tests per app each month have roughly doubled revenue per user across the studio in 12 months.
    • LTV to CAC averages about 3x across the portfolio.
  • Tests must be retried and tagged with their reasoning, so the lessons carry over to other apps and to AI agents. 16:00
    • Removing the onboarding paywall on Celebs won big, after failing in earlier attempts. Users lost there converted better later in the funnel.
    • Of about 20 tests, roughly 10 are neutral, 5 are bad, 3 look interesting and 2 are good.
  • AI ad volume pays off only when humans keep supplying new ideas and exploring the search space. 26:56
    • About 4,000 video ads a month, all AI-made for over two years, with a six-person ads team.
    • Endless variations of one ad decay, so the team hunts for new concepts and formats, as no one is above them to copy.
  • Social is now adding AI agents to buying apps, and it will not automate the whole company. 23:58
    • WiseSam is a safe, easy OpenClaw-style assistant for consumers, sold through ads and a long onboarding that learns about the user.
    • The creative team tripled in six months while ad output grew many times over.

It's about using AI to do things which were impossible before.

Patrick, Social

Chapter summaries

0:00 Intro

A small studio aims to make app decisions from data alone, and it breaks the industry's paywall rule to do it.

  • Patrick wants to buy an app without knowing what it does 0:38
    • The method is to read an app's data, generate fresh data of their own, and decide from that.
    • The portfolio holds 22 apps, including Font Maker, Celebs and Autopaste.
    • The portfolio has crossed 40 million downloads.
    • Industry advice is a hard paywall at the end of onboarding. 1:15 They tested the opposite.

3:41 The $16 Million App Studio

Social reaches $16M a year with a tiny team, no new equity and a high-volume testing machine.

  • The studio is profitable and bootstrapped, with unusually high revenue per employee 3:41
    • It is three years old and raised only $1M in equity at preseed.
    • It hit $11M annualized revenue with 11 people, about $1M per employee.
    • New hires have lowered that figure. It will take a few months to get back to it.
    • Output includes hundreds of playable ads and thousands of static ads a month, plus about 100 A/B tests a month.
    • The host says most founders are either bootstrapped at about $100K a month or venture-scale social. Social sits between the two.

5:24 Which Apps They Buy

Social buys across non-gaming categories and avoids those where its skills and monetization don't fit.

  • The portfolio is a generalist mix, with no gaming and few social networks 5:33
    • Games need a different skill set for building, improving and distributing, and strong operators already exist.
    • Social networks monetize differently and each needs big scale to matter.
    • The mix includes utility apps, dating assistants, entertainment apps and a couple of dating apps.
    • It also has one or two small social networks.

6:25 Spotting Underpriced Apps

A buy decision combines market data, test ads and app metrics, and the test is long-term profitable scale.

  • Buying is data-driven from the top down and the bottom up 6:46
    • Top down means market structure, willingness to pay and growth speed.
    • Bottom up means running standardized ads for apps that don't exist yet or are being considered, and comparing them to a benchmark.
    • They also check the app's own retention and any marketing data the owner has.
  • Four apps of similar size lead the portfolio 8:01
    • Lipstick earns just over $300K a month. Font Maker earns about $200K and has about 7M downloads.
    • Celebs is a little bigger than Lipstick. Autopaste is closer to Font Maker.
    • Font Maker turns your handwriting into a keyboard font.
    • Hotspots was bought from Pablo, who then became the first head of product.
  • An app is worth buying if it can scale profitably, whatever its retention 11:05
    • Growing revenue 20x would return multiples of the purchase price.
    • Utility apps retain well, but retention is not the only thesis. Sometimes the market is simply bigger than others think.
    • Patrick says people underestimate the potential of consumer software.
    • The host notes that Buzzfeed-style media built big businesses on similar curiosity, but earned from ads. Social charges subscriptions.
Fontmaker's App Store page: 123K ratings, 4.4 stars, #71 in Photo & Video.
8:33 Fontmaker's App Store page: 123K ratings, 4.4 stars, #71 in Photo & Video.

13:28 The Growth Loop Explained

Only 2 of every 20 A/B tests win
Neutral10
Terrible5
Interesting3
Good2
This low hit rate is why Social runs dozens of tests per app each month, a pace that doubled revenue per user in 12 months.

Funnel position decides which tests matter most, and no single answer carries across apps.

  • Revenue per user has compounded for 18 months 13:45
    • Patrick says it has probably tripled over 18 months.
    • Celebs sells weekly subscriptions priced from $6.99 to $14.99.
    • The loop: more users bring more tests, better monetization pays for more users.
  • Onboarding changes have the biggest effect because the funnel shrinks 15:00
    • The earlier the interaction, the bigger its impact. Adding or removing an onboarding screen can matter a lot.
    • Early-stage apps test big first-screen changes. At about 1M users a month, they test across the whole app.
    • The same decision can be right for Celebs and wrong for Lipstick.
    • Tests start small, then scale up if they work.
Celebs app store screenshots: upload a selfie, get a 97% celebrity twin match.
15:11 Celebs app store screenshots: upload a selfie, get a 97% celebrity twin match.

16:00 Removing the Onboarding Paywall

A test result holds only in its context, so old tests are worth running again as the app changes.

  • The paywall removal failed in earlier attempts and won once the app had changed. 16:17
    • Pablo says the team tried it many times as the product evolved. Early tries did not work, then one day it did.
    • Parts of the app keep moving, so Patrick says to revisit old assumptions, especially ones with a big possible lift.
    • Many variables interact, such as the answers users give in onboarding or their gender, so one run proves little.
    • Pablo says conversion can happen in about 10 places in the app. Once the later ones were optimized, the first paywall was mostly friction.
    • The goal after removal is to reach the moment of maximal intrigue as fast as possible.

18:26 Tagging Every Test for AI

Tests teach the most when each one carries its reason, so people and agents can reuse the lesson.

  • Every test gets a written hypothesis, so an agent can learn from the whole backlog. 18:58
    • Telling an agent "we won this test" means nothing. It needs the hypotheses, the results and the learnings.
    • Pablo knows what to do in a new app because he lived through about 80 tests. A new hire or an agent can't, unless it is all tracked.
    • The Celebs win was friction removal, done by cutting the paywall. In another app it will be something else, so the team looks for the equivalent move there.
    • Five, six or seven past attempts at friction removal become the starting list for the next app.
  • A habit of continual testing matters more than any playbook. 20:13
    • Patrick says the team has a playbook, but the real asset is a methodology and "nearly a philosophy" of testing.
    • Adding friction in onboarding can also help, because it creates a strong signal for campaign signal engineering.
    • Small one-off wins matter less than this habit.
    • The default belief is that a hard paywall earns more. The Celebs result shows it can lose money overall.
  • A new app should ask for payment at the moment users are most excited. 22:10
    • Ask whether a better moment to ask for a subscription exists after onboarding. If so, use a very soft paywall and convert later.
    • If the app has no such moment yet, keep a paywall in onboarding, hard or a free trial.
    • A big studio tries everything. A small app mostly needs this one decision.
    • Apps evolve, so the answer can change as the inside of the app improves.

23:58 Building the WiseSam Agent

WiseSam can run a long onboarding because the ad has already warmed the user.

  • Users arrive warm from the ad, so many questions feel like "happy friction". 26:16
    • Visitors who come straight from the website skip the long flow, because no ad primed them to answer.
    • At the end the user sees a summary of what they said and feels listened to, which builds intrigue.
    • Patrick says most onboardings of 100 screens use only about 10% of the answers. WiseSam uses what it learns inside the product.
    • Pablo says the marketing and product are tied together: "the story starts at the ads."

26:56 Running 4000 AI Ads a Month

The ads feed a funnel and a product that are tuned as three separate parts, with safety and guidance built in.

  • WiseSam is only weeks old, so ads, funnel and product are tested apart. 29:21
    • It runs on web, which is more flexible than mobile but makes users behave differently.
    • The team is still testing the angle, the audience and short against long funnels.
    • The ads are AI-made even when they are screen recordings.
    • Targets range from a 65-year-old to a 20-year-old student. Product polish waits until volume grows.
  • WiseSam makes agents easy for people who could never set up OpenClaw. 29:56
    • Each user gets a preconfigured virtual machine, and chat is the first screen.
    • Pablo says 99% of people do not use agents, so setup takes about a minute.
    • The team cites WhatsApp and iMessage as channels.
    • Early OpenClaw setup meant pasting a token into a random Telegram address.
  • The real barrier is delegation, so the first steps are guided. 34:21
    • Patrick says AI is already capable. Users lack the imagination to hand tasks over.
    • Tapping "helpful tasks" sends a prewritten message that starts a recurring task. Users still need more guidance.
    • The team wants about 10 cases that show value fast, like birthday reminders or daily price checks.
    • Personal tasks like the morning email check come later, once trust is built.
  • The agent starts with tight access and loosens it step by step. 38:16
    • It has its own email address, and only allow-listed senders can reach it.
    • Read access to the user's inbox may come within weeks.
    • The team admits it began a bit too conservative.
    • The aim is that nothing the agent is allowed to do harms its owner.
WiseSam onboarding screen: "Meet Sam, your personal AI assistant" handling email and calendar where you chat.
27:30 WiseSam onboarding screen: "Meet Sam, your personal AI assistant" handling email and calendar where you chat.
WiseSam paywall offering a $1 promo first week, then $9.99/week, cancel anytime.
28:10 WiseSam paywall offering a $1 promo first week, then $9.99/week, cancel anytime.
WiseSam's chat screen guides new users with a 'Let's get to know each other' button.
33:20 WiseSam's chat screen guides new users with a 'Let's get to know each other' button.
WiseSam's chat screen where Joseph asks the agent to take on a recurring task.
36:36 WiseSam's chat screen where Joseph asks the agent to take on a recurring task.

41:00 Why AI Grew Their Team

AI let Social make 80x more ads, not just cheaper ones
Studios with actors30
Studios using AI50
Social, fully AI4000
Other studios used AI to save money, while Social used it to reach a volume of ads that filming could never produce.

Automating ad production works best when humans keep the ideas and taste, so the team grew as the output exploded.

  • Social automates the building of ads but keeps the ideas human. 41:01
    • The thesis from the start is to automate as much of an app operator's job as possible.
    • Ads are fully AI, with no real actors, yet the ideas usually start with a human.
    • Other studios went from 30 actor ads a month to maybe 50 AI ads. They saved money but did not change what was possible.
    • The aim is AI agents and humans in the loop, each doing what they do best.
  • Scaling output also scaled the need for diverse ideas. 43:02
    • The six-person ads team mostly invents ad ideas, then prepares material for production.
    • It also includes video editors and people building playable ads, which are mini-game versions of the apps.
    • Much of the editing goes to an outside firm, Poolday.ai.
  • Humans edit faster than agents while concepts are still being tested. 44:49
    • Agentic editing needs very detailed prompts and an engineer's habit of changing one variable at a time.
    • That effort pays off once an angle is proven, and only then does it get automated.
    • Editors increasingly give taste input instead of doing the cuts themselves.
  • Endless copies of one ad decay, so new concepts must keep coming. 45:56
    • Variations of a winner are fine, but exploring new angles must continue alongside them.
    • Testing 10 variations up front instead of 4,000 saves money and speeds scaling.

47:58 The Infinite Search Space

Ad ideas are too many to brute force
Taste, data and process decide where to probe, because AI can make more ads than the world has eyeballs to test them.

Ad ideas form a search space too large to brute force, so taste, data and process must steer the exploration.

  • A market leader cannot copy anyone, so it has to invent. 47:39
    • Social leads its niche in every app, so it keeps its lead by showing new ideas first.
    • Copying the leader can bring traction but will not make you the leader.
  • Efficient testing spreads across the space, then digs in where something works. 48:12
    • Some regions hold no good ads and others hold many. Varying one ad keeps you in one spot.
    • A trillion AI ads could be made but never tested, as the world lacks the impressions.
    • The host's picture is a grid of 1,000 squares where testing every one burns money and time. He calls efficient full testing an unsolved AI problem.
  • AI surfaces inspiration from other industries, and humans turn it into ads. 49:52
    • AI finds TikToks and videos that creative analysts then adapt to their own niche.
    • The host points to Spytok, which finds proven hooks in and just outside your category.
  • Imagination is hard for today's AI to supply. 52:00
    • It is easier to train on coding, which has verifiable answers, than on poetry.
    • Pure creativity may need a different kind of AI than an LLM, since an idea nobody has tried is not in the data.

52:43 Verticals They're Excited About

Social's future mixes buying apps that still make sense with building agents for new use cases.

  • Agents feel like the early App Store, an open field few are playing in. 53:13
    • Social wants to multiply the types of agents it builds and owns.
    • The host asked whether OpenClaw-style personal AI is the big bet.
  • Some use cases suit a traditional app and others suit an agent. 53:26
    • Social stays bullish on buying apps where a deterministic mobile app is the best format.
    • It plans to buy apps that will still make sense in an AI world.
    • It will build agents for an almost unlimited number of newly opening use cases.

In the growth library

Patrick and Pablo, Patrick runs Social, an app studio; Pablo is its founding head of product. Social is a $16M annualized, profitable app studio that buys apps after their viral peak and scales them with constant A/B testing and about 4,000 fully AI-made video ads a month. The episode shows how removing the onboarding paywall, tagging the reasoning behind every test, and mixing human ad ideas with AI execution lifted revenue per user 2x in 12 months.

Lessons that draw on this:

More from Superwall · The whole library, and ask it anything

Transcript1506 lines
Intro 0:00
0:00

We're at 16 million annualized revenue. We're profitable. We're three years old. We only raised 1 million in equity for our preede and we haven't raised any equity since. We actually hit 11 million annualized revenue with only 11 people in the team. So, we were doing 1 million in revenue per employee. >> That's Patrick. He runs Social, one of the most efficient app studios you've never heard of. A portfolio of 22 apps has crossed 40 million downloads. Some of the apps are Font Maker, Celebs, Autopaste. They build apps, but they also buy them. And they scale these apps with pure data, running around 4,000 video ads per month, every single one made by AI. And the first thing that surprised me is how far they're willing to take that.

0:38

>> My dream is sort of one day to be able to buy an app without even like knowing what the app does. Just like looking at the data, generating our own data, and making the decision like that. >> They buy apps most people would write off. A lot of them they picked up right after a viral peak when the numbers were falling and the owners had no idea what to do next. Celebs is one of those apps. It's six years old now and it's bigger than it's ever been. But how they actually grew it was pretty counterintuitive, including what they did to the payw wall.

1:05

>> Removing payw wall at onboarding, funnily enough, was a big win on Celebs. Generally, it's a good practice to have a pay wall at the end of your onboarding. Here, the big win was removing it. >> Everyone in the industry will tell you to put a hard payw wall at the end of onboarding. They tested the opposite and taking it away made them more money. And all of that testing runs on top of an ad machine that barely exists anywhere else.

1:27

>> We've been fully AI for all our ads for over 2 years now. >> 4,000 video ads a month, all AI for over 2 years profitably. In this episode, Patrick and Pablo break down the full machine behind a $16 million app studio that runs almost entirely on data. How they find apps that already peaked and started declining, buy them cheap, and turn them into their biggest winners. The onboarding paywall test that breaks the number one rule in the industry. and why removing the payw wall made them more money not less. How they run 4,000 fully AI video ads a month. Why that made them expand their human team instead of cutting it. And the infinite search space idea behind how they test these ads. The system they're building to hand the company over to AI agents by tagging the reasoning behind every single AB test they run. By the end of this video, you'll know exactly how Patrick and Pablo spot an underpriced

2:15

app, multiply its revenue with relentless data and testing, and run an all AI ad engine. most studios can't get close to. This is the Super Wall podcast. I'm Joseph Choy, founder of Consumer Club, a Discord where top consumer app founders trade alpha and what's working now in growth. I've been talking to members doing a million ARR and they tell me they've been using these two tools. Superwall has this free AI tool trained on 422 profitable paywall experiments across thousands of successful apps. You upload a screenshot of your payw wall and it gives you an experiment idea to make more revenue with the same number of users at paywallexperiments.com. And if your app's doing at least 100K MR, we host vetted dinners in SF and New York to hang out and network with other top app founders. You can apply with the type form in the description. Also, these app founders have been telling me they use

2:58

ROR. I met Daniel, the founder of ROR, at a dinner, and I got genuinely really excited when he told me about Ror Max, which is out now and has honestly changed the game for coding mobile apps. It's AI that oneshots all native iOS apps with Swift code, camera, sensors, haptics, payments, the whole stack. And as you vibe code with Ror, you can install prototypes directly onto your iPhone with one click and then publish to the app store in two clicks. If you've been waiting for AI coding that actually does native iOS apps, well, this is it. I got you guys a discount.

3:25

You can use the code superw wall or use the link below. I'm super excited to talk to you guys. Um, you guys run social and you guys are building a sort of like an app studio. You have run a bunch of these apps and you buy apps and you use a lot of AI to grow them. So,

The $16 Million App Studio 3:41
3:41

could you give me some highle stats of the company? Yeah, of course. We're at 16 million annualized revenue. We're profitable. We're three years old. We only raised 1 million in equity uh for our preede and we haven't raised any equity since. So we we're basically preed strapping. Um we actually hit 11 million annualized revenue with only 11 people in the team. Uh so we were doing 1 million in revenue per employee. H now we've recruited a few more people and it'll be a few more months before we get back to that figure. And yeah, we have a lot of fun. We have 20 apps, 22 tour apps and actually we've also launched our first um agent for consumers which is a super easy to use uh very safe version of open crawl. Uh we're doing around 4,000 video ads a month. We're doing hundred of hundreds of playable ads a month, thousands of statics. Uh we're running probably about 100 AB tests a month. Uh so we do everything at

4:39

quite a high volume with a small team uh across a diversified portfolio and a lot of that is thanks to AI. >> I feel like this is going to be a gold mine of insights. Like all the ads is pretty crazy. Like 4,000 ads and it's such an interesting operation. Like I feel like there's certain apps that are kind of the 100k a month like maybe a million you know r like completely bootstrap like a lot of people are building those and then there's like the venture scale apps which are like the more social like consumer social maybe gaming but then you guys are sort of like in between where you've raised a small amount of money you're actually profitable you you show all your numbers like LTV CAC like I think not a lot of people actually show their numbers so transparently and 1 million revenue per employee is also like super efficient

Which Apps They Buy 5:24
5:24

business. So, I want to dive into a bunch of aspects of this, but maybe first is like what types of apps do you require and and run? >> We're pretty generalist. Non-gaming uh that's pretty certain. I don't think we will go into gaming. There already a lot of very good gaming operators. It's a slightly different skill set uh for you know building those products, making them better and even distribution is slightly different. Um, then within non-gaming apps, we're pretty generalist. We probably won't do too many social networks, per se, at least not for the moment. Uh, because the monetization is slightly different. You really need to get to a big scale on each individual one for it to be meaningful. Uh, but yeah, honestly, you know, we've got a bunch of utility apps.

6:13

Uh, we've got dating assistants, we've got entertainment apps. We do have uh one or two small social networks. We've got a couple of dating apps. Uh so yeah, we've got a lot of um quite a diversified portfolio.

Spotting Underpriced Apps 6:25
6:25

>> Is there a thesis for how you buy these apps and why you like why you buy certain apps? And I assume because you you have a growth machine. You know, you're running 4,000 ads a month and there's some reason that you think you can grow certain apps. >> Yeah, absolutely. We're very datadriven in our approach and so we look we've got at the same time a sort of top down approach. So we look at the market, the market structure, what seems to be the general willingness to pay in that market, how fast it's growing. And so there top down, but we also have a bottom up approach where we run ads for uh apps which don't yet exist or that we're looking at buying. And if the ads perform well and we've built quite a big benchmark and they're very standardized ads so that the data is as comparable as possible then that will be another very strong data point and then obviously you know just like looking into the data of

7:25

the app itself you know the classic things retention any of their own marketing data if they've run any my dream is sort of one day to be able to buy an app without even like knowing what the app does just like looking at the data generating our own data and making a decision uh like that. >> That's really interesting. I want to dive like fully into the data part cuz I think that's a a differentiator that you guys have. But like what what is your just to get an idea of the apps first?

7:53

Like what is your biggest app? Maybe maybe you're not able to share like >> uh we've got four apps which are similar sizes. There's lipstick, font maker, autopaste and celebs. And then we've got a couple other apps which [music] we're scaling up uh which are store a bit smaller. >> Yeah. Litick was Hotspots one of them or >> no? Uh Hotspots is actually the app we bought from Pablo and then Pablo joined us as our first founding head of product.

8:23

>> Um so there's Font Maker which is one which is a font app. So basically you can turn your handwriting into your keyboard font. >> How many downloads does this have? This is like 120,000 ratings >> across your portfolio. We have uh just we've just crossed 40 million downloads. Uh Font Maker has been strong for a number of years. It's probably around the 7 million mark. >> Wow. 7 million downloads total or like per month or year?

8:51

>> Uh total. >> And then how much revenue does this one make? >> This one makes um about 200k a month. >> Okay. So let's dive into that a little bit. So, Font Maker and then you got LitStick which is like a stickers app, iMessage stickers where you can like turn things into stickers. So, how yeah, what are the what are the stats on this one? >> Uh, this one's doing just uh north of 300K a month. >> And then what were the other two apps?

9:14

>> Uh, then there's Celebs uh which is a similar size to list a tiny bit bigger and then there's autopaste which is a bit smaller than uh than these ones closer to to Font Maker >> and Celebs. This is like find your celebrity look alike. This one seems like it could be newer, but it it's like a little bit less of a utility than the other ones. >> Yeah. No, this so this one quite a simple premise. You upload your photo and uh you get to know which celebrity you look alike. I really like this one like this sort of app. Uh and that's one thing we've been good at. It's spotting mainly by looking at data um apps which may look like a shortterm viral sort of success and you know like that one we bought it and like a lot of our apps we actually bought after they had a viral peak then they were declining the people selling it didn't really know how to like grow it from there and so that's where we come in and we we buy it and

10:13

then you know we grow it quite steadily and you know it's big it's now six years old and it's bigger ever. >> Correct me if I'm wrong, but it seems like you have the utility apps that just seem like they integrate very seamlessly into, you know, existing user behavior like like a lot of these keyboard apps like Font Maker and the stickers and the keyboard autope like you kind of have they're yeah they're like sort of basic utilities and it makes sense why these would be more retentive and you just buy them, operate them, grow them. But then you have these other apps that are like seem like they could be underpriced because someone has this huge viral moment. They do really well with the app, but then it kind of falls off, but then you figure out that there's actually some deeper value that you could unlock here. Do you feel like you have those like two different strategies for acquiring?

11:05

>> Yes, definitely. And at the for us it really boils down to can we scale this app over the long term profitably you know and if we see that opportunity be it on a more retentive or less retentive app if we can buy an app and we can 20x its revenue and make a lot of money doing it and you know make multiples and multiples of the acquisition price then it's been a good uh it's been a good investment for us and you know Celebs for example it's a good example it looks like very short-term viral sort of success you know an app which you know has a few weeks in the sort of uh [music] spotlight but it sort of taps into this universal sort of curiosity.

11:43

It's like you know there's a bit of vanity there. There's uh you know just simple curiosity. That's another thing. It's often people I think underestimate what is the potential t for [music] uh consumer software. Um, and you know, something like celebs, honestly, when you just talk about celebs to random people, you know, in the streets or wherever, I'd say at least half, if not more, of people are curious to know who the celebrity lookalike is. So, you know, your tab is basically half the world. Uh, and so, you know, even if it's had this sort of small [music] viral success and that's a very low hanging fruit, it's probably got the potential to grow much faster, much longer. There's been entire media companies built off of these types of interests. Like Buzzfeed, you know, is like the one that comes to mind. Like Listicles, like basically a lot a lot of these like media sites. But then the

12:37

problem is I feel like a lot of those sites don't directly monetize, right? They do. They run ads instead. But you guys are directly monetizing and actually getting subscription revenue off of these like extremely high TAM I mean this particular extremely high TAM interest of celebrities we said earlier was pretty interesting. It's like I sort of assumed automatically that you see retention as the long-term goal for some of the things but it's not even about subscription retention. Sometimes it's just like you know that you see that the the market is bigger than than what other people think. So like for this one it seems like the the lever that you pulled is like you acquire and then you figure out that you could just run ads better. Like was that the the lever for

The Growth Loop Explained 13:28
13:27

this? >> That's part of it. It's you know it's sort of this virtual cycle where we're very good at user acquisition. So we get a lot of users into the app. Pablo translates that into, you know, dozens of AB tests a month for each app. Continuously lifts the average revenue per users. Like, you know, over the last 18 months, Tableau's probably 3xed uh the RPOU on average on our apps and uh certainly 2xed it over the last 12 months. There's this virtual circle where we we're good at user acquisition, bringing more users, we monetize those users better, we bring in more users, etc. And so, you know, it's it's by playing on both part of the LTV CAC on the LTV CAC that we managed to yeah continuously scale these over time.

14:14

>> Double the RPO in in 12 months is is pretty insane on average. Yeah. Is that that's across the whole across the whole studio? >> Yeah, >> that's pretty insane. What is the CAC LTV on on celebs? >> Uh on our portfolio, it's 3x LTV CAC on average and most of our apps will be around around that mark. It seems like you mostly do weekly subscriptions on celebs for like anywhere between $6.99 to like 14.99. You're you're basically just like running AB tests on absolutely everything like the onboarding, the pricing, all these data points in general. Are there certain data points that that have been highest leverage for for increasing revenue per user?

14:58

>> I would say on boarding is an element very important. You know, all the apps have a funnel that is decreasing. The upper the interaction normally the bigger the impact. But that's just one of the general rules depending on the phase you are. Maybe you want to do things that really have big impact like [music] in the first screen. If you already have a 1 million users per month, we get more sophisticated and we try things all around the app [music] and we unlock value in every corner. But generally adding removing an onboarding screen could be something that makes a huge impact. But they don't have the key because even in our apps the decision that I take in selects or lipstick can be completely different. I just know that there is a lot of value there. But it will be testing. We run probably 20 AV test. 10 of them are neutral, five are terrible, three seem to be giving us something interesting, two are good. So

15:46

we have a system of scaling AV test. [music] We run it at small scale then bigger. And that way we're always adapting. for celebs. Could you give me one example of a pretty big test with that you ran like millions of users that had a [music] big lift?

Removing the Onboarding Paywall 16:00
16:00

>> Removing a payw wall at onboarding, funnily enough, was a big win on celebs. Generally, it's a good practice to have a pay wall at the end of your onboarding. Here, the big win was removing it and actually just getting the users as quickly as possible to the moment of maximal intrigue. Basically, >> for instance, that's a test that we have tried many times in the flow of evolution of the product. one day didn't work then [music] didn't work either and one day suddenly it worked is altogether he's going to be taking part on that but yeah like Patrick said removing the pay on the on boarding against all the rules of the industry was a big win for us >> that was an interesting point from Pablo it's I think a lot of teams AB test something once it doesn't work and they won't ever AB test it again but the truth is like an AB test works or doesn't work usually within a certain context within a certain flow etc and

16:49

you know [music] as we're always testing There are things like parts of the apps are always moving and evolving. So it's often useful to revisit old AB tests or old assumptions [music] especially on things which you know can have quite a big lift and retesting them within the new configuration. >> I see. Yeah. Because there's so many different variables that you can run with the AB test. It's not just about payw wall during onboarding versus pay not no payw wall during onboarding. It's like what answers they gave during the onboarding gender. Like there's just so many other AB tests that you can run in different combinations that it makes sense that you would just you can't just like run it once. You want to see like which variables like really impact. So why do you think that in this case like the removing the payw wall actually increased revenue per user?

17:39

>> We can get conversion in 10 different places in the app. Probably it's a matter of we managed to optimize all down the final places. So was making more sense to let the users go inside the app without the friction of a pay wall because our other placements are performing better. So in the end when you get your result when you want to share when you reopen the app we were grabbing better attention and getting better conversion and that's simply like when you fix parts of your app if the first one disappears because it's a half friction half conversion. If you remove conversion and friction, but you get extra conversion down the funnel, it turns into better results. So basically, part of the users we were losing at the on boarding in the new app are converting very well down the funnel and the maths make sense.

Tagging Every Test for AI 18:26
18:26

>> So like the kind of like the intuition and taste behind the AB tests is what matters in the long term. You're saying that when you run the AB test, you have to have a hypothesis for like the reason why you're running this test. And then if the test proves you right, then now you have like instead of a hypothesis, now you have like a proven you know insight that okay it seems like roughly like if we control for the other variables like this thing that I thought was true is actually true and we should do like more of those types of things down the line.

18:58

>> That is exactly that like you tag your decision. You know when something is the conclusion of it feels better or I prefer it that's not tangible like there is a reason for everything. No we define an AV test [music] we try to give it a reason and that's also even more important nowadays that we try to feed all that information to an agent. If I tell an agent I have been winning this AV test means nothing. If I tell the agent here we have our backlog of AV test. These were all the hypothesis.

19:27

This was all the results. These were all the learnings. we give a system with important information we will be able to better build the next iterations because me I have been in those 80 test if I get an app I know what I have to do but it's very hard to tell an agent or a new person coming to the team day one what they have to do unless you have everything perfectly tracked they can learn from that reducing friction on the on boarding in select was about removing the pay wall if what matter is removing friction in another app is going to be something different so if now our strategy is removing friction in on boarding We have five, six, seven things that we tried that made it happen and then we have to find the equivalent in the other apps but under the premise of I want to remove friction because I'm converting very good down the funnel >> and the interesting thing is sometimes creating friction is a great strategy

20:16

for an app especially creating friction during onboarding can be like a great great way to create a very strong signal that you can then use in signal engineering etc for your campaigns. The important thing isn't about like not even a playbook like we have a playbook. We know that sometimes this works in this situation etc. But it's more of methodology and nearly a philosophy of continual testing which is the most important [music] rather than like small oneoff wins. The whole like decision science thing I think kind of ties into your whole thesis of the company which is like oh use AI to run the entire company and in order to do that you want to feed it signals of the the the reasons for making certain decisions right and then combine that with the AB test. I think that's really fascinating.

21:05

We should like I want to like have a whole segment just like diving into that. Yeah. I think removing the payw wall from the onboarding and then trying to convert those users later down in the funnel or the the user experience. I think that hearing some of the insights from that will be super useful for a lot of people cuz I think the default assumption is yeah hard way hard payw wall is higher converting. It just makes more money. It makes sense that if you know you lose so many people uh if you do a if you do a hard pay wall and you're just basically not doing anything to recover those people back like is it notific is it like push notifications where you're like if they don't convert then you get them in later. I guess if you were if you were to put it into like a few buckets of things that if you're just starting out and you have no AB test running at all and you're just trying to let's say you make the

21:54

decision that okay I want to try doing a soft payw wall and in order to make more revenue per user what what are the general buckets of like things that you think about like okay I removed the payw wall from the onboarding now what do you need to do to to recover >> you usually would need to get the user as quickly as possible was to either to a point of maximal intrigue or to what people call the aha moment. That's and that's you that's a tactic which often works well. If you don't have a hard pay wall or even a pay wall during onboarding, yeah, you do want to get the users as quickly as possible into the best part of the experience or at least the part of the experience which would create the maximum willingness to pay.

22:40

someone building a new app. No, like what is the flow of decision that they probably have to take before taking that decision because if you're a big app, big studio, like you have to try everything. It's not like there is one answer. If you have a new app and okay, you love that app, you have just created that app. But ask you the question, is there going to be a better moment to ask for subscription? As simple as that.

23:04

It's like you have your on boarding, which is something static. You control everything. in your on boarding is is your story. If after that end of the on boarding you there is something that you know is going to be better for the user like they're going to be even more excited feel free to just put a very soft pay wall try [music] try to convert later on if there is not yet because the apps evolve is like we took time sometimes to refine part of the inside the app [music] if you don't have that clarity keep your on boarding payable and maybe it's a hard payable maybe it's just a free trial of payable you will see but that's probably one gate of decision for someone with a small app starting and taking the decision of what I do.

23:44

>> Let's look at let's actually just look at the ads in a second. But also what was do you have an example of an app that you guys that are it's in the portfolio where there's like that big investment and then that's what creates that conversion moment.

Building the WiseSam Agent 23:58
23:58

>> One of the closest ones to to that is our new um agent for consumers. So you know it's like an open crawl personal assistant and there it's we've got a really cool opportunity which is you know a lot of these onboardings like you like you know sometimes it's a 100 screens or something and they basically you know pretend that they're getting to know you and they're going to personalize the user experience and usually they don't or they might use 10% of you know the 100 questions you've answered or whatever. One of the cool things with agents generally I would say um particularly personal assistant is that [music] we can you like really get to know the user and then actually use that in the product and make the product better much better through it and get the user excited. Um [music] and I would say for agents generally that's a huge uh huge opportunity. The most profitable app founders I know have been using

24:55

Superwall to AB test their payw walls because yes, they have the basics like building and deploying payw walls super quickly without coding, targeting users with different payw walls based on behavior and demographics. But now, Superwall AI actually predicts who will subscribe before they see a payw wall. The AI can do this because Superwal analyzes over 1 billion paywall interactions to score user intent and then recommends optimal pricing in real time. A good way to start is paywallexperiments.com. It's a free tool that gives you databacked payw wall experiment ideas to increase your app's revenue. Can you share the the the personal assistant agent?

25:29

>> It's called wise sam.ai. >> Okay. Super interesting. So this is like so you use a lot of AI for personalization during onboarding in this. >> So yeah, we collect a lot of uh information that we then use for to personalize the the experience. Uh it's going to depend your entry point also. Uh here I'm talking about if you've watched one of our ads and then you click and you go through that the funnel afterwards. I believe uh Pablo correct me but if you're going directly through the website we try to just get you [music] to like the experience quicker because you haven't had that ad to sort of warm you up and get you excited and create that willingness to answer the questions. We are always super connected the marketing and the product is like the story starts at the ads. So like Patrick said you come very warm to the app. That's our philosophy. It's not a matter of my neighbor told me this app

26:21

exists. It's more more a matter of we have presented the app the concept interesting so then we will convert. After that then we have the opportunity to do whatever we want and now we are trying in this products like to have a funnel where we have many questions and that's something that we prove could work very good very very good uh because the person invest quite some time. It's an interesting investment. is like friction but it's happy friction and when it's finished you have way more intrigue because you have the summary of exactly what the people were saying like they feel listen so we mix both things like an agent where you mix both

Running 4000 AI Ads a Month 26:56
26:56

>> wow this is that's a good this is fully AI too if I'm not mistaken >> we've been fully AI for all our ads for over two years now >> wow even even the like this the screenshot screen recording ones >> everything wow that's crazy so like on the marketing you're You're getting people excited about the productivity angle, the emotional angle. Basically, just all the stuff that people use like conversational AI for like productivity, but also like personal Oh, actually, let's just look at the CT right here.

27:27

So, you got the subscribe button and then it says like, okay, it handles your email calendar, the things like you keep putting off right where you already chat. And then this is and it seems like this is where you get the like long onboarding where you start to probably use some of these questions in the personalization. So it's like what's your work situation? Um more about work, what types of tools do you already use? Uh where do you chat?

27:55

And then it kind of reflects your answers back to you. Continues to go through pain points. What do you want from the thing? you know, showing you back like what your uh the the features and then get Sam for just $1, a full promo [snorts] week with your assistant, then $10 a week. Cancel anytime. Continue. Um [music] and then ready to plug in. So, you get started and then it immediately goes to Stripe. That's super interesting. Is the personalization mostly like during the the survey itself or are you doing like more personalization deeper into this?

28:33

>> Yeah. And then afterwards you also continue like the personalization that conversion like just talking with agent. There's more and this would depend like you know we're constantly AB testing also these flows and you know these screens the length. So this is a shorter version but uh you know yeah we're constantly testing things around this one. >> We're trying a lot of things. We're getting data points because for instance this is a new product for us and we still need to find what is the good angle to invest and double down what is the target audience if they want short long funnels and this is web remember that we used to I think we cracked how it works in mobile but this is on web which gives us way more flexibility but at the same time it's a different context where they behave differently but our is the same you know it's like why exist for a few weeks And we have deco composed in three

29:25

different parts. The ads, the funnel and then why some inside the product. Now these days we are building like a huge strategy of funnels to control what the user are interested in. The creative team are building a huge strategy of u creatives and we are also working on the product. But you know it's like start with your problems at the bottom and when you are getting more and more users you will have more volume to refine the product too. You shouldn't invest out of time on something that just a few users get there. The way we actually do this it's so it's an open cl but we do it in a very secure way. So we set up a virtual machine which is going to be preconfigured with your open etc etc. So it's yeah we tried to do things pretty well. Then yeah, you can different integrations.

30:13

Uh some are coming. iMessage is going to be there very soon. >> It's basically OpenClaw but super super accessible to people. Like like I remember on Twitter like when people were getting crazy about OpenClaw, it was always step one, copy this token and then send it to this random Telegram address. And it was just very like inaccessible to like the average consumer. everything. This one it's like you come from an ad, you go through an onboarding, you actually talk about like what you want out of the bot and then you're you're getting like uh the chat interface as the first thing which I think is really important. Just talking about Wson because it's our new baby and we're very proud of it. We have cracked also the channels like we we have ready an integration natively with iMessage and WhatsApp and that's the point like we want to make it accessible because tech people understand open close and

31:05

know how to set up but 99% of the population they don't leverage those agents and they don't know that they could be in their phone helping them for very daily easy task and can be a very impressive product. So we have democratized access to all these agents with wis 1 minute you set up and any person from any age that's why we have such a broad amount of ads right now like we are trying to nail all those sweet spots where we have to start investing on this is our user persona for the first evolution this is the other and probably it's a 65 years old person and a 20 years old student both of them can leverage why just with a tiny customization >> dang you guys are basically doing anthropics marketing for them like go to market cuz I feel like there's so much like obviously like in in this AI bubble like everyone of us knows like how powerful AI is but if you ask like any person on the street they probably have

32:04

not used open claw maybe they haven't even heard of claude like they probably just heard of chatgpt this feels very familiar to me like chat memories soul skills like these are basically the things that you know people in Heck, use AI for, you know, you want to give the AI a personality and their behavior and basically their like system prompts. And then you have memories, which, you know, the chat bots are not the greatest at.

32:32

You know, there's a lot of like um settings and fine-tuning that people do to their own chat bots to make them have like better memory. And then the chat interface also feels like pretty pretty different. Like this is like you you have more than just the chat, right? You have like these kind of opinionated buttons. Like it says helpful tasks, calendar, mailbox. So you're kind of already suggesting to the user like what what they could do. And then let's get to know each other. Do you feel like this is also is this like a a an engagement thing? cuz you was a $1 uh trial for the week and then $10 a week and then I'm curious like what what actually gets people to renew. They have to be really impressed like probably they subscribes at the very beginning because the intrigue or the excitement if they stays because it's classically it's useful they find it interesting.

33:32

The problem is like [music] you have 2,000 AI tools out there, chat agents, whatever. You always land in a chat and you don't know what to do. Now, our vision, no, our taste is guiding us towards we have to guide the user the first moment that they use the agent. Normally, users will download this on the phone. We usually drive these campaigns on the phone. So, they can just click on one of those buttons and s okay, send me an audio talking to me about this. You know, it's like we prepare it. So it's like we guide the users towards giving the important information and the moment the the agent knows where you work who is important for you what are your goals that's not something that you how do you say suddenly share but if you have a little guidance on that and the agent gets to that level where it's already impressive how much it knows about me the people get more engaged >> I think like today the main sort of

34:25

barrier to AI adoption isn't AI capability it's already capable of so many cool things. It's sort of uses imagination and like knowhow and like thinking ah actually I'm doing this task every day but I could get my agent to do it. [music] It's basically you know the art of delegating is actually quite a subtle difficult one and it's a skill you really have to learn how to delegate and so you know part of the uh problems we're solving here. It's how to make the users better at delegating and so you know that goes by knowing more generally about the user and how Sam can be helpful to him.

35:04

>> Is that like all of business [laughter] like getting people to like cuz if you want to embed yourself into someone's daily week weekly routine that they're probably doing it themselves right now and but maybe they don't want to be doing it themselves. But also, it's it's very hard to give up control over like a routine that you have um that feels familiar to you. You know, you don't want to like change. Change is scary. I I love this prompt. Like you you tap helpful tasks [snorts] and then it created this message and just sent it automatically as if it's like coming from me and it's just saying I'd like you to help me with a recurring task. Uh a recurring task. one of those things you take care of on your own regularly without me having to ask or remember each time tell me uh let me tell you what I have in mind and this is like me telling the bot [music] and then the bot says sure tell me what you're

35:59

thinking and then now I'm thinking about like oh I guess I should think about a recurring task now what what have you seen so far on this like are people actually able to come up with a like a like a thing that that you can help with >> it it helps to reflect but still they need more guidance [music] and probably they need more guidance to really unlock the things that are really useful. What we are working now is to really spot let's say then 10 cases that every single person will feel the value very fast and will be impressed. That's that's the next thing like the same way you get into this interface you touch couple of buttons and you end up telling oh help me remember the birthday of people in my agenda. Okay that's the classic one. There are some ideas out there sometimes from checking the price of a product like [music] can you check every day the price of this product and sometimes we don't get to see how

36:50

obsessed we are with something that's something an agent does very easy so we probably have to prepare those cases that since day one it's easy to you know take care of this I don't better if you take this price instead of me then when you build that trust we will go to these things you mentioned Joseph like things that are mine you know belong to me like my morning check the mail probably I need a bit more of time until we start to do that because I don't trust you uh yet but the first interaction is where we want to give more guidance that's our objective now to nail the first three four five steps so I I just ask it like hey I need help remembering things and says okay like what kinds of things do you need to remember I don't know like um replying to email and then it'll take me through this flow and get to a point where it's able to like integrate with my email, I'm guessing. And then [music] once you have

37:47

that, then it's it becomes like this recurring touch point uh and part of the routine. Okay. So, it says, "You want something regular where I nudge you about emails you need to reply to, maybe help with drafting. Useful way is to [music] um if I had my own mailbox, you could forward emails to." Okay, so now the agent, the open claw is like creating its own mailbox and then it's asking me to set up their mailbox and then it and then it goes to the skills section.

38:14

Okay, skill Sam's email and then you act. >> That's part of the challenges and problems you have to sol you have to balance like usefulness access of the agent and like safety and so you know for a moment we've always tried to like find like ways to do things as safely as possible. uh we've probably been initially a bit too much like on [music] conservative but you know it's it's also about finding the right balance over the next few few weeks like so for a moment and I think we continue agent has his own email address which we set up specially for him and then there's this sort of allow list of senders and uh we're probably going to be iterating on that in the next few the next few weeks potentially at least giving read access to your inbox. This was our original thesis like we want the agent to start from being very safe and then we iterate towards you know being productive but we we set

39:09

that baseline now we understand that having our own mailbox is not the most productive thing but at least we were starting there [music] we didn't want to have an agent that can make dangerous things like we want to evolve always uh hence with safety and making sure that the things we allow to the agents to do will not make any harm on the person that is uh is owning the agent. >> Thanks for diving into that. I think this is like very applicable to a lot of different consumer AI businesses in general because a lot of it is just about education and getting people to understand like how to delegate stuff.

39:45

And part of that understanding is just like setting it up for them. Like starting out with, hey, I like what do you like think of a of a of a thing that you need help with? And then it's telling the user, okay, you need help with this. here's how I can help and then getting them to set it up. And once you set it up, that's where I feel like the retention really comes in. But like this chatbot process, I think is like really good for really any like consumer AI onboarding and engagement. I think it's it's really interesting. So I wanted to ask you a little bit more about the AI part of of the the company as a whole. Like if you look on your website, you're saying we are a Gen AI native app rollup leveraging data precision and AI to extract maximum value from apps. And then earlier you're saying that when you're doing these AB tests, you're not only just do running a ton of AB tests, you're also giving

40:40

inputs about the intent of the AB tests. [music] And eventually, like theoretically, an agent uh like a team of AI agents could probably run the entire company um and uh like make all these decisions autonomously based on like what it's learned about how you guys make decisions. So, is that right? Is that like the the thesis?

Why AI Grew Their Team 41:00
41:00

>> Our thesis is that our thesis and our thesis has been since the start is trying to automate as much as possible how an app operator functions by using AI a lot. We've sort of also developed some new thesises about what is a good idea to automate and what isn't a good idea to automate and where you actually need humans to do it. And so, you know, one of the things that we're very bullish on, for example, it's having a lot of human creativity in like coming up with the ad ideas, not with building the the ad, not you know, using like real actors like the ad is fully AI, but the idea usually uh comes from a human input. And so, [music] you know, it's about building this system where we have AI agents working with humans who are in the loop and, you know, each doing what they're best at.

41:51

So, for a moment, I don't see us uh automating 100% of the of the of the company. Uh I see us, you know, automating more and more of it. But interestingly, AI isn't only about for us at least, I think, you know, that's fundamentally what it is. isn't only about replacing what already exists by an AI version and just saving costs. It's about using AI to do things which were impossible before. So, you know, be it create thousands of ads a month. You know, that would have been incredibly challenging if we were trying to do it the oldfashioned way, filming actors, etc. And so, you know, that's I think one of the things like a lot of other app studios companies like you know they were doing 30 ads a month with [music] actors now they might be doing 50 a month with AI they've saved some money it's faster easier but so we really lean into AI's potential and actually interestingly by doing that it usually

42:54

requires a lot more humans like you know we uh we scaled up our ad production [music] by a lot and you know over the last 6 months I think we free the size of our creative team uh to make [music] ads while we were automating it more and more because you know as we scaled up the number of ads we also needed to scale up the diversity of ads and therefore was for creative input >> it's like you're you're you 3xed your your team but then you like hund [snorts] multiple hundredx the output so it makes sense you're extremely like each human is just like extremely high leverage. Um what I'm curious what does the ads team look like right now? Is it Yeah. What what's the team?

43:39

>> So the ads team at the moment is six six people. Most of them are simply focusing on coming up with new ideas for ads and then execute like and then sometimes preparing some of the material uh that so that we can then produce it. We also have video editors uh to uh do some of the video editing that we can't automate. Um we work also a lot with a company called pool day.ai for our video editing and they basically do a huge amount of of our of our video editing. H but for certain use cases or for more one-off things or like more like original concepts we have our video editors come in and then we also have people working on playable ads. So like you know mini games uh miniame versions of the of our apps.

44:27

>> The most human part obviously is the coming up with the ideas like looking out in the market like finding pain points finding angles [music] and then turning those into formats. But then I I I'm guessing there's some front-loaded work where you're creating the format and that's the human [music] part and then eventually AI like quickly will just like learn the format and then be able to make the execution of it. Well, we like moving very fast. Sometimes it's faster just to do the video editing with humans than what like when you're doing aic video editing on with people like pool date. It's it's a gentic prompting.

45:01

So it's like it has to be very detailed quite complex prompts. [music] You have to have like basically an engineer's mindset where you change one variable of a prompt and you see the effect until you perfect it. So you know that's great as soon as you've got like you've nailed a use case, one angle, a concept, then you automate it. that you know when you're just testing loads of of things uh which we do constantly uh it's it's sometimes just quicker, easier, more efficient to to to do it with humans.

45:26

There's also an amount of taste in video editing and so you that's also what some of our video editors are doing more and more. It's input on yeah taste input on the video editing rather than just doing the video editing themselves. So, do do you actually have that as part of your process where you're like testing small amounts of budget on specific hypotheses of like, okay, we have like 10 ad variations that the editors kind of thought of and then if those get validated, then you pump it into AI and do like the fourth.

45:56

>> I think that's one of the important things when you're really trying to nail AI ads. It's not just doing endless variations of the exact same ads which you know win because you know they like perform less and less over time but it's constantly looking for new ad ideas, new ad concepts, new ad formats and it's balancing the two. And once you've got something which works, yeah, you can do variations and replicates of it. uh but uh the important part is to be continuing continuously exploring for new new marketing angles.

46:32

>> Everyone asks like oh when when are we going to have cloud code for marketing? I think the problem is like there's just so many different layers of it, you know? I mean, similar to engineering, right? You have like the architecting that the Cto does and then you have like, you know, figuring out the the tech stack and then planning out all the features and then you actually do the execution. Like cloud code can do the execution part the best and then it's starting to be able to do the other ones better, too. But with marketing, it's just so it's just inherently such a human thing where yes, you can have like fully agentic video editing, but choosing which videos to add, you're going to you just burn so much money if you [music] if you test every single variation without taste. So like, you know, having the taste to like say, "Okay, we're going to do 10 variations instead of 4,000 up front." It saves you

47:22

so much money and also just like accelerates the scaling process. Have you seen any solution any any AI out there that helps with the taste part like helps you find like um here's the signals out there that we should be testing? >> So one thing people do but we don't really at all is you know simply copying what the market leader is doing and you know setting up automations basically just to copy what the market leader is doing. We can't really do that because basically for [music] all our apps within that niche, we're the market leader and so we've got nobody to copy.

The Infinite Search Space 47:58
47:58

Uh [music] and we m we maintain our lead by continuously inventing new things and being the first people to show those new ideas, those new concepts. Yeah. And to go back to your point, [music] it's exactly that the way I see ads and creatives, you basically got an infinite search space. What AI allows you to do, it's test much more that search space and you know there's places in that search space which don't have which don't contain any good ads. There are others which contain a lot of ads and so you know if you're if you you're taking one ad and you're doing endless variations of it, you're staying in the same part of a search space and it's to be really efficient you need to be testing lots of different things all over the search space. When something works, yeah, then you explore that part of the search space more [music] in depth. I don't think you can really brute force it. You know, if you sort of

48:48

like reason by the absurd like, you know, [music] you could one day maybe get AI to, you know, create a trillion ads for you, but then you can't actually [music] test those trillion ads because there's just not enough impressions and eyeballs in the world to test them out. So, you do need this sort of mix of taste, data, and process to efficiently explore uh the the uh the search space. just like thinking about it as a search space makes a ton of sense because you want to find, like you said, those pockets of, you know, certain areas within the search space that will hit.

49:23

Um, but you don't know what those are. So, you can't test, you know, all thousand. Let's say it's like a thousand grid squares in the space. You can't test every single one cuz you're basically just you're going to you're going to burn all your money um and time. And then I wonder if there's a way to like efficiently test all of it. This is a unsolved AI problem. If anyone in the audience has a PDP physist, I feel like this is super fascinating. Are there any other types of like consumer insight signals or anything that you look at?

49:52

>> So, one thing we do use AI for is to surface potential inspiration for that that can be transcribed into uh winning ads for us that usually by humans. And so, you know, I usually don't think that just copying the ads of, you know, whoever's market leader in your space is the best strategy can like get you some traction, but you won't, I don't think, become a market leader by like that. But what I think is really interesting is looking at people in completely different industries, what they're doing, looking at their marketing and using that to come up with ideas for your own marketing in your own niche.

50:27

And so we do use AI to basically surface videos, you know, Tik Toks, whatever that then creative analysts look at and then use to come up with uh when relevant with ideas for our ARBs. >> There's this tool called Spy Talk and it's like I think this is kind of trying to solve the thing that you that you just said where it's like it's trying to find formats um like proven hooks. So it's a little bit of like the copying part where it's like looking at market leaders. It's also like looking at adjacent niches, right? Cuz it has so many niches in the database. And then if you put in your app, it'll find things like within your category and then slightly outside your category. And I think that's the that's the whole basis of creativity, right? It's like finding things from other places and then turning it into the thing that's relevant for you. But it it is it is I feel like a kind of unsolved space. I

51:20

don't think like because even like for a market leader like you guys, you would use something like this, but then you still need the step like with where your creative strategists are actually turning that thing into something that's relevant for you, which [music] is the human part that is really really hard to do with with AI. Um, so I'm guessing you guys haven't really automated that. >> Yeah, that's injection of human creativity. AI is artificial intelligence and it's very good at sort of logic thinking etc. But it wasn't trained for or designed particularly for imagination which is much harder to do reinforcement learning uh on you know poetry say than it is on coding where you have verifiable answers. part of the way like you know part of the objectives for which AI is designed and part of the way uh through which you know AI is trained like pure imagination creativity is still a long way away and might

52:13

actually need a completely different form of AI than LLM >> because you're creating something new LLM is like it's a model you know it's a large language model there's a bunch of data and you put it in and then it finds something from that imagination like you're saying like creativity you're trying to find your something kind of brand do like you're taking something from a different industry, you're applying it to your own, but if nobody has really done that before in a big way, then that data is not in the LLM.

Verticals They're Excited About 52:43
52:43

So, how could it how could it make how could it invent that? Last question I want to ask you guys, what what spaces or like verticals are you excited about? you have like a bunch of verticals in your portfolio already and it seems like you're now getting into, you know, the OpenClaw space. Is OpenClaw like the the big exciting one or is it or like personal AI? I feel like what I imagine people felt like at the start of the app store, which is, you know, very few apps exist and it's like this huge playing field on which nobody's playing and you can have a lot of fun. And so [music] we're very bullish generally on multiplying the types of different agents we build and own. And we're still bullish on buying apps. Like there's certain use cases where having a deterministic traditional mobile app is actually the best format for it. There are other cases where having an agent is uh is is the best format. The future for

53:41

us is going to be mixing buying the relevant apps which we believe [music] make sense in an AI world and will continue to make sense and building agents for you know the basically unlimited number of new use cases uh which are which are opening up. >> This is a great conversation. I appreciate both of you guys. Yeah, there's so many layers of of things to to go deep on. I feel like this could be like a 4hour podcast but >> [music] >> um yeah, where where can people find you? Do you have any like are you hiring also by the way?

54:12

>> Uh we always hire very talented people and interesting we hire people from like most of the team didn't come from the app world so we're always open to true talent and you know whatever their experience is yeah follow us LinkedIn obviously we have substacks I've got my personal substack. >> Awesome. Thanks so much guys. >> No thank you Joseph. This is really fun. Something you might not know, most of the founders I cover on this podcast are hanging out right now in the Consumer Club Discord, sharing with each other what's working now for consumer apps.

54:42

So, you can apply to join Consumer Club if that sounds interesting to you. And this is the Superwwell podcast. Of course, you got to check out superwwell.com. We have more videos on the channel. So dig into those to learn from app founders who are willing to share super tactical stuff about app growth.