Can bigger-is-better ‘scaling laws’ keep AI improving forever? History says we can’t be too sure
Gold Coast, Nov 27 (The Conversation) OpenAI chief executive Sam Altman – perhaps the most prominent face of the artificial intelligence (AI) boom that accelerated with the launch of ChatGPT in 2022 – loves scaling laws. These widely admired rules of thumb linking the size of an AI model with its capabilities inform much of the headlong rush among the AI industry to buy up powerful computer chips, build unimaginably large data centres, and re-open shuttered nuclear plants. As Altman argued in a blog post earlier this year, the thinking is that the “intelligence” of an AI model “roughly equals