Discussion about this post

User's avatar
MadoctheHadoc's avatar

Great post! I'm surprised so few people have really considered the long term viability of OS models given how quickly they are burning models.

You mentioned that one big difference with Rosen's superstar model that we see in law, tech and other domains is the potential for RSI that might actually keep revenue even more concentrated. One point of divergence from this allegory is that unlike with lawyers or footballers, you can reasonably expect a comparable performance from a much cheaper alternative in the near future. The implication of the Chinese labs being 8-10 months behind is that by the end of the year, everyone will be able to access a cheap, open source Mythos-level capability.

If there is some kind of diminishing return of having a more performant model or there exists some significant set of async applications AIs aren't worth the cost right now (but will be in a few months) then it's easy to imagine a much bigger role for OS models and slim profits going forward. Intelligence is an exponentially depreciating IP, without exponential increases in performance from scaling laws or RSI or something else there isn't much point in frontier labs.

Summary of my thoughts:

If just diminishing returns -> Within a few years intelligence is free from OS providers

If just RSI -> Frontier labs pull away from everyone and we are in the singularity

If RSI and diminishing returns -> Frontier labs may hold their lead for a while but diminishing returns are more strongly exponential and the timeline to reach abundant intelligence is just longer

If neither -> Not clear, if markets can keep underwriting the compute cost and the models continue to scale exponentially then we might end out in a superstar model again.

No posts

Ready for more?