Discussion about this post

User's avatar
Arvind Narayanan's avatar

Thanks for the essay! Great to have clarity on where we agree and disagree.

What should we track in order to know if we're getting close to Phase 2? I agree with your point that we need more fine-grained automation data, but even if we had full visibility into what's happening, what exactly are the relevant indicators?

IMO we should specifically look at deployments of relatively general-purpose AI systems operating with minimal human supervision to handle tasks with high costs of errors. All three factors are important; I don't think we can generalize from e.g. low-stakes to high-stakes deployments. https://substack.com/@aisnakeoil/note/c-133518692

Currently there seem to be ~0 such deployments, and my prediction is that in 2030 it will still be ~0 (compared to the size of the economy).

Expand full comment
Jan Kulveit's avatar

Mosty I do agree, but FWIW "wages grow during the initial period but then collapse" is the standard trajectory in econ models of the situation (eg Korinek and Suh (2024). Scenarios for the Transition to AGI) and is also what we mention in Gradual Disempowerment. In this sense the "two competing perspectives" "AI Snake Oil" vs. "Intelligence Curse" seems like a more nuanced existing understanding was partially replaced by oversimplified "x vs. y" takes.

Expand full comment
3 more comments...

No posts