Discussion about this post

User's avatar
Iska Knuuttila's avatar

I agree that AISIs could help the governments to understand the importance of the frontier. Though I think it originally worked the other way around in the UK.

I haven't dared to think about the frontier labs giving the weights to anyone. Every extra place where they keep the weights increases the risk of someone stealing them... and finetuning the model for anything they want.

I believe that cooperation with AISIs can provide value for the labs and for the US government, decreasing their incentives to switch off the frontier access. Since only 2% of all AI research published (between 2017-2022) is focused on safety, that might be a good niche to fill.

MadoctheHadoc's avatar

Interesting article!

I have several questions about this paragraph:

"But there are ways to integrate AI into our governments that would minimize downsides, while giving us the large benefits of using the world’s best AI systems..."

I really don't see how diversifying model access between American companies is going to minimize the downside risk of American AI export control; perhaps if there were 10s of companies in this space but we're talking about 2 and a half frontier labs. If Trump is annoyed at Europe after the next G7 meeting, I don't really see how the Bundeslander governments being dependent on a mix of GPT and Claude is going to fix anything; similarly, the trident program is likely cheaper than the French system but it's not like this is an acceptable compromise for civilian infrastructure. The UK primarily did this because it's demand for weapons was fractional compared to the US; for AI, even in nominal terms, the EU's economy is more than half of the US's, it's very large globally speaking, the AI demand for a modern EU economy isn't going to be a fraction of the US and therefore I think it's more difficult to argue that the EU should give up on the model layer.

I think you've explained well why procurement mandates won't solve these issues either so let me propose something else for you to disagree with:

Meta has so far failed to create a good model after spending a ridiculous amount but the benchmarks from show more promising results for some newer (and much cheaper) Chinese OS models like GLM. Perhaps Europe should be aiming for "a CERN of AI" that tries to produce a near-frontier open source or open weights model, this would likely attract much more good will from the other middle powers in the world and could be a vessel to diffuse the dangerous race between China and the US.

However, assuming that an EU frontier model is copium, it seems like a much more obvious conclusion is that the downsides of adopting US models are actually pretty big but (at least in your opinion), the potential economic benefits for the EU are much more tangible the cost of giving the US more leverage in future, more hostile, relations.

No posts

Ready for more?