Researcher Jim Fan presents the next grand challenge in the quest for AI: the "foundation agent," which would seamlessly operate across both the virtual and physical worlds. He explains how this technology could fundamentally change our lives — permeating everything from video games and metaverses to drones and humanoid robots — and explores how a single model could master skills across these different realities.
I feel like what he says make sense in theory but in practice it is gonna be way way harder than he makes it sound. I am sceptical of someone from Nvidia hyping up the future of AI given their monopoly in the realm and the ensuing conflict of interest. But given how something like autonomous driving has proven to be extremely challenging, it looks like AI is not even close to being able to deal with the uncertainties of the real world. Maybe it can work on guardrails in controlled environments but it won’t be as ubiquitous as he hopes in our lifetimes IMO.
I feel like what he says make sense in theory but in practice it is gonna be way way harder than he makes it sound. I am sceptical of someone from Nvidia hyping up the future of AI given their monopoly in the realm and the ensuing conflict of interest. But given how something like autonomous driving has proven to be extremely challenging, it looks like AI is not even close to being able to deal with the uncertainties of the real world. Maybe it can work on guardrails in controlled environments but it won’t be as ubiquitous as he hopes in our lifetimes IMO.
My thoughts exactly. Society will have radically changed before these AIs radically change society.