16:59 One thing I want to get into is, my hunch or assumption is we're enjoying a lot of these
17:10 models that are being subsidized.
17:13 A lot of teams are using lots and lots of tokens, putting lots of model power behind
17:19 some of the tasks they're trying to complete or get done.
17:24 We've built a really interesting model that I think is ahead of how most teams are using.
17:30 I think most teams pick max account, max reasoning, just run everything through this.
17:36 How have you set up the infrastructure that is really leveraging a lot of AI power to
17:43 also operate as lean as possible?
17:46 That's a great question.
17:49 That's a question that we ask ourselves right in the start, because we know that setting
17:56 up the wrong architecture and running with the wrong models can be very costly.
18:03 We made a few tests.
18:05 It took us some time to get it right.
18:07 Even today, we keep iterating.
18:10 We keep moving from one model to the next, also because models are evolving.
18:15 We keep moving from one model to another, and we are still trying to fine-tune every
18:20 single agent, because today we have 55 agents running in marketing hours.
18:29 Those 55 agents, they can be classified into around seven to eight buckets.
18:37 The orchestration, the collector agents, the QA agents, we have agents that do QA for us,
18:45 so they're like loads of different agents.
18:47 I would say that the key for us in the way that we build the architecture is that we
18:56 didn't want an agent to have to look into a huge context.
19:04 That wasn't really the plan, because what really triggers the costs and what also takes
19:12 time and what also woke agents into a health and aging is the massive context.
19:21 We wanted to make sure that only certain agents deal with big contexts, but most agents would
19:29 deal with very, very, very specific data.
19:34 Today only the collector agents deal with big contexts, and those ones have some pretty
19:41 heavy models, but all the expert agents, all the action agents, actually most agents, even
19:49 the QA agents, they actually run on pretty lean model, and mostly because the context
19:54 they have is not as big.
19:57 The difference in quality between Fable 5 and Sony 3 for QA, for instance, is not something
20:06 ... It's not huge.
20:09 It's not something that we would feel.
20:12 The QA is still kind of on the same, because the QA agents has a very, very, very small
20:19 scope.
20:20 It just looks at the recommendation, and we check that every single number, every single
20:25 figure in that recommendation checks out with the data lake, and that's it.
20:31 For the expert agents, the expert agents will only fetch some of the data in the very small
20:38 portion of the data, of the data lake.
20:40 Same again.
20:41 They have a very small scope.
20:42 They have a bigger model than the QA agents, but still smaller than the data collector.
20:51 The key for us was the context, and we worked really hard to actually build several layers
20:56 and have a process where agents just hand off work to the next one.
21:02 Every single agent has the scope, the context for which he only needs to take an action
21:07 on.
21:10 If anything highlights which part of the problem is more difficult more than that, I think
21:14 that's the best example of using the lowest cost model on the action outcome expert agents,
21:21 using the high cost models on getting the data collection and actually making sense
21:26 of it.
21:28 It makes a ton of sense.
21:29 I just think a lot of teams, maybe we have another three months, six months, whatever
21:34 that timeline is, I think we're enjoying some subsidized token usage right now.
21:39 I'm assuming it's going to line up maybe around when Anthropic does their IPO, that they're
21:44 going to pull the rug, and then all of a sudden, it's going to be more usage-based pricing.
21:48 We're going to get rid of these Cloudmax accounts and things like that.
21:51 But I think it's just important for teams to be thoughtful and mindful of how they're
21:58 organizing which model to the agents that they're out there performing.
22:03 Yeah, for sure.
22:06 And I think it's good to at least think about that quite early.
22:14 I think it's perfectly fine to-- and I'm going to contradict myself here, but I think it's
22:19 perfectly fine to just roll with whatever is the most effective for now.
22:27 Because velocity and speed to value is really the coin.
22:34 That's what we all want.
22:37 We want to be faster than our competitors.
22:41 And so I think speed is what matters most.
22:47 But I think it's useful, and it's very helpful to think about when you build a large architecture,
22:57 to think about all those topics right on the stars.
23:00 Because when you build a large architecture, it doesn't cost you too much to actually think
23:04 it through and think about the future.
23:07 Because that operating system, for instance, took us like a month and a half to have a
23:14 solid MVP.
23:16 So by that time, if you figure out that you messed up the architecture, it's unfortunate.
23:24 Totally agree.