Google’s AI Boss Says Scale Only Gets You So Far

For much of last year, knocking OpenAI off its perch atop the tech industry looked all but impossible, as the company rode a riot of excitement and hype generated by a remarkable, garrulous, and occasionally unhinged program called ChatGPT. Google DeepMind CEO Demis Hassabis has recently at least given Sam Altman some healthy competition, leading the development and deployment of an AI model that appears both as capable and as innovative as the one that powers OpenAI’s barnstorming bot.

So my view is you've got to push the existing techniques to see how far they go, but you’re not going to get new capabilities like planning or tool use or agent-like behavior just by scaling existing techniques. It’s not magically going to happen. The other thing you need to explore is compute itself. Ideally you’d love to experiment on toy problems that take you a few days to train, but often you'll find that things that work at a toy scale don't hold at the mega scale.

Technology Technology Latest News, Technology Technology Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Defense Contractor Scale AI Quietly Scrapped Deal With Chinese-Owned TikTok Over Security ConcernsI'm a senior writer at Forbes covering tech companies. I'm also the co-author of WONDER BOY: Tony Hsieh, Zappos and the Myth of Happiness in Silicon Valley, published by Henry Holt & Company. Contact me on Twitter at davidjeans2 or email me at djeansforbes.com. You can also send tips to the Forbes SecureDrop.
Source: ForbesTech - 🏆 318. / 59 Read more »

Amazon’s Cloud Boss Likens Generative AI Hype to the Dotcom BubbleAdam Selipsky, CEO of Amazon’s dominant cloud platform AWS, says generative AI is valuable but that the excitement around some AI companies is similar to when dotcom darlings were 'dramatically overhyped.'
Source: WIREDBusiness - 🏆 68. / 68 Read more »