The Rise of Agentic AI: Future Computing Paradigm

Jensen predicts a future where powerful AI agents collaborate and innovate, transforming industries through advanced tools and skills.

### The Agentic Future: Transforming AI and Computing
* 🤖 Jensen, the CEO of Nvidia, envisions a future where "**thousands and even millions of agents**" will work for us daily, marking a shift from an industry of **tools to one of skills**.
* 💼 He emphasizes that agents will not only utilize tools but will also **collaborate with each other to solve complex problems**, creating a **significant opportunity** in the agentic landscape.
* 📈 The advancement of large language models and agentic frameworks will **exponentially enhance the power of these agents**, allowing them to possess both **short-term and long-term memory**.
* 🔍 Jensen notes the breakthrough of unsupervised learning, which **liberates AI from human limitations in data labeling**, enabling models to **learn and evolve autonomously**.
* 💻 The conversation highlights the **rapid evolution of computing technology**, exceeding Moore's Law, with AI and GPUs facilitating **parallel compute that greatly accelerates development**.
* 🛠 He critiques existing AI products like Microsoft’s Copilot, comparing them to the **failed Clippy**, while advocating for **more user-friendly solutions** that empower everyone to **build AI agents**.
* 📚 The discussion also addresses the importance of **onboarding AI agents effectively**, likening it to **human training**, to ensure they can **perform tasks efficiently from the start**.
* 🌐 Ultimately, Jensen expresses excitement for a **paradigm shift in computing**, moving towards **dynamically created software that predicts user needs**, signifying a **revolutionary change in how we interact with technology**.

Jensen, the CEO of Nvidia, says the future is agentic. During an interview with Marc Benioff, the CEO of Salesforce, at the Dreamforce conference, he talks about how we are going to have thousands and even millions of agents working for us every day, all day. It is an agentic future, and we're going to break down the video right now. Jensen, come on out to have you. Our industry is, you know, call it about a trillion dollars, and it's an industry of tools, you know, computers, um, software, their industry of tools. For the very first time, this is going to be an industry of skills, and you capture that phrase, and you call it agents, but it's going to be for the very first time agents sitting on top of tools, agents using tools, and the opportunity for agents is gigantic. As we know, you know, we now know, we now know, I'm hoping so, by the way, so obviously I agree. If you've watched this channel at all, you know the phrase I always say, bullish on agents. I

really believe the best incarnation of AI in the future is going to be agents and agentic frameworks and Mark Benny off the reason why he's saying I really hope so is because of agent force which is again their new product that they're launching they really think this is going to be transformational to Salesforce which has been around forever at least forever in Internet terms and they're betting big on it and he actually gives a little dig towards Microsoft which we'll hear in a moment it sounds it sounds insane but here's the amazing thing we're going to have agents that obviously uh understand understand the subtleties of the things that we ask it to do but uh it can also uh use tools and it can reason and uh it can reason with each other and collaborate with each other and you know going to we're going to give we're going to give a problem to uh agent force and uh uh agents are going to go find other agents that that can help achieve this mission they'll work together assemble together

work together and solve this problem. And so, that is absolutely the agentic future that I envision. There are agents; agents can spawn other agents; they can collaborate with other agents. There's a set of tools, and I'm not talking about three, four, five tools—thousands, hundreds of thousands of tools—that these agents can pick and choose and also create tools themselves and actually test the tools, save the tools, use them later. These are all things that we're just starting to scratch the surface on right now. And as the core models get better, the large language models get better, as the agentic frameworks around those large language models get better, as the ability for those agents to build their own tools, to choose tools off the shelf, gets better, all of these agents become exponentially more powerful. And remember, the definition of an agent is a large language model with the ability to use tools, to collaborate with other agents, and that has memory—short-term and long-term memory. That's my favorite definition of an agent. All right, let's keep watching. I think the... the... the

Breakthrough, uh, for me was a moment when, um, we realized that unsupervised learning was going to be possible because the ability for humans to, uh, be able to label data at scale, uh, we would become the limit limiters of these digital AI to, uh, expand their capabilities. And when unsupervised learning came along, which allowed us to use language models to create language models, which codify human prior knowledge, using that to now learn multimodality, multimodal, uh, uh, data, uh, from that point forward, the scale was going to be exponential. All right, so he just said a lot in very few words, so let me break that down for you. First, he's talking about the fact that humans are really the limiting factor for artificial intelligence. The amount of data we create is massive, obviously, but the amount of data that is ingested by artificial intelligence is much more, and for the most part, all public data has been used already. It's all been used by these Frontier models and even open source and non-frontier models. All of

the open data is gone. It's been used, so now there's proprietary data, data behind pay walls or offals, stuff like Reddit and Twitter and Facebook, all of this data that these companies will use themselves to make their models distinct and better than their competition. So then he's talking about reinforcement learning without the need for humans because another limiting factor of humans is the ability to label data. If we have to label all the data that trains the AI, that is an extreme bandwidth limitation. And so we have projects like AlphaGo, where AlphaGo, the AI behind it, was not trained by humans. It was not trained with a bunch of Go games where humans labeled them good move, bad move. They simply spawned a bunch of different versions of the AI, played the game, see which one did best, and then iterated on that millions or billions of times. And then eventually, they surpassed the best human Go players in the entire world. And again, that's with basically no human input whatsoever. Then we have the notion of how are we

going to scale the data. So, I already talked about all of the public data being used. There's really two paths. One, we can either do a lot more with the data we have, and that's things like being able to scale test time compute, which means during inference time we do things like Chain of Thought. And now we have this entire new dimension of scalability on AI, which is super fascinating. So, previously we were just scaling the number of parameters, and that really scaled pretty well so far. But now we have two distinct dimensions that we can scale on: the number of parameters in kind of the training time compute, and then the post-training test time compute when it's actually running through Chain of Thought. And then the other part is synthetic data. So, what if we use AI to create really great data for other AI? And OpenAI has been rumored to be doing that through the QAR project, which eventually became 01. Maybe 01 is creating data for other models. All of this is fascinating, but the more we can

remove humans from being a limiting factor in AI. The more quickly AI is going to explode into the intelligence explosion. You know, for everybody here, this is an extraordinary time because in no time in history has computer technology not only moved faster than Moore's law. I mean, Moore's law, for example, over the course of a decade would be about 100x. We are probably advancing at somewhere near 100,000. That was our other neighbor in Hawaii, Gordon Moore. Oh, is that right? Great person, great leader, great person. And so we're at a stage now so quickly. Moore's law basically says that every 18 months, the number of transistors that can be fit onto a CPU essentially doubles. So your ability to compute essentially doubles every 18 months. But a while ago, we reached a physical limitation, and we really cannot shrink these transistors anymore, and they just don't work after that. And so we really did hit this

limitation, and then AI came around, and GPUs came around, and all of a sudden, rather than serialized compute, which is how CPUs work, we have parallel compute, and that's how GPUs work. It does a bunch of calculations simultaneously, and because of the way AI works, plus parallel compute, all of a sudden, Moore's law has actually been exceeded lately, and every 6 months, we are doubling the compute power of chips. Now, we're in an era now where we're moving way faster than Moore's law, and arguably, easily Moore's law squared. And the reason for that, of course, is at every single layer, computers went from CPUs to GPUs, from human-engineered software to machine learning software, and now this feedback loop that allows us to create new AIs, and these new AIs are helping us create new computer systems. So, he said something really interesting, but he said it so quickly, it almost went unnoticeable. He said that AI is creating more and more of our

software, and I've talked a lot about that on this channel. Again, removing the human limitation from the system that we're trying to scale up will allow us to scale up the system much more quickly. Just two years ago, humans were writing all software, so we were really limited in the amount of software we can write because it's a very manual and difficult thing for humans to do. But as large language models got better at writing code, they started writing more and more code, and then we have all of these projects like cursor and repet building infrastructure around large language models to make it even easier for AI to write code. And I believe in the short run and the mid-run, we are going to have an explosion in the number of people who write code because it won't take writing actual code. All you have to do is speak or type natural language, and the AI will write the code for you. Then, at a certain point, AI will just write code as needed, and then the end vision is really just model weights being shipped by the AI.

itself. So, rather than it writing code, it's just writing model weights, and at that point, we're probably not going to be able to read the code at all. I've been thinking about this idea that in the future, we probably won't be able to read the code that AI writes because the only reason code looks the way it does today is because humans are really bad at reading and writing code, so it has to look as much like natural language as possible. But maybe in the future, it doesn't have to, and probably in the future, it doesn't have to, especially if the compute platform of the future is simply model weights. Because we already cannot read model weights, we don't know what's in the black box of AI, at least not yet. Maybe we will in the future, but it's not looking likely. The challenges that we have in front of us are many and worthy to be tackled right away. Of course, some of the most inspiring advances has to do with fine-tuning supervised guard.

and Guard railing and and um uh and uh um all of the work that's surrounds safety um everything from using AI to curate the data to create a safe curriculum to teach the AI which then fine-tunes the AI on particular skills grounded on values then then all of this wonderful AI technology to guardrail it um and Guard railing and then reflection uh using using Chain of Thought to reflect on the quality of the answers that it's producing you know it's no longer AI this one shot producing information it's now reasoning about is this is the the the uh the answer I'm generating uh sufficiently safe and proper and is it the best possible answer I could be I could I am so excited about this particular concept that we're able to now scale Artificial Intelligence on two different dimensions and I've talked about it already in this video so just briefly I want to reemphasize how important it is that we now can scale compute and scale AI intelligence at the training time and the amount of data we feed that model.

and then also at test time, which is even more scalable in my mind, because the more time you give it, the more compute you give it, the more tokens it can churn through to generate the best possible output. And that's what he's talking about with reflection and Chain of Thought. That's exactly what OpenAI just dropped about a week ago. That is what it is doing and why it has really just jumped ahead of all the other models in terms of logic and reasoning. Could be providing its reasoning with itself, and it's reflecting on the answers before it answers. And so, I think the progress that we're making in safety is phenomenal. Isn't it so important that people can actually understand? This is what I call they need to get their hands in the soil. They need to understand the basic ideas to make this possible. And that's what I hope happens with the thousands of people here, that they can get in the code while they're here to really

understand. So, when they're going back to their offices, you know that exactly what you're saying, that we've demystified the AI, that you know they don't have to worry about how they're going to DIY their AI, that they can somehow put all the hard work that your team has done right into some very practical use because this leap of faith that you've had, this strategic motion of your company, has enabled so much of this. Now, how do we put it in the hands of everybody to just get to work and building an agent should not be some computer science fair project. It should be something that we can easily do because so when he's saying it's some computer science fair project, he is specifically referencing a lot of companies that have shipped products that are so difficult to really use in production environments that actually drive a lot of value. He specifically called out Microsoft with Copilot. He said it's basically their new version of Clippy, and Clippy was a complete failure of a product, and now he is equating

clippy to co-pilot, and that is a huge dick at Microsoft that I don't really agree with. This is much different, even though the first wave of co-pilot might not have been that valuable. I think a lot of what they're doing with integrating co-pilot into all of their office products and Outlook, and I think that's great. It's going to be a lot more like onboarding employees than writing software. All right, I just want to talk about that for a second. So, he talked about onboarding employees. Just last week, I had a conversation with Crew AI CEO Joe, and we talked about agents being onboarded as employees, and that is a critically important piece of implementing AI at your company, specifically. We drew an analogy to human onboarding. So, when you hire somebody, if you don't give them any context, any training, any onboarding materials, then they're going to be starting from scratch, and the onboarding period or the ramp-up period is going to be really lengthy. And the way to shorten that is

with training, with context, with onboarding materials, and it's the same thing with AI agents. If they simply start from nothing, then they have to learn everything as they go, and every prompt you give them has to be incredibly detailed. But when you work with a human, and the more you work with them, the more history you build with a human employee or colleague, the better shorthand you create with them. You start having to say less and describe less about exactly what you want, and you can kind of just directionally say what you want, and the human, your colleague, will understand. And that's going to be the same thing with AI. I think a big part of AI agents in the future is going to be defining how to onboard them quickly, giving them all of the memory necessary, giving them access to documentation, telling them exactly how you want them to respond and what tasks you want them to do, so that when they get started, they're ready to hit the ground running. The ambition of wanting to reinvent computing to

create what we now know is such a great endeavor. Um, so somewhere between the being inspired by all the stimulus, um, the incredible challenge ahead of us, you know, it's kept us propelled, um, inspired, and fired up for a long, long time. And now here we are. We now have the instruments, the tools, uh, this capability called artificial intelligence that goes to solve all of those other problems that we've, you know, been excited about ever since we were kids. And so that's pretty exciting times. So here we are at the cusp of a complete paradigm shift in computing, the base level computing, from computing pre-written software and hardcoded everything to just-in-time dynamically created predicted software, and maybe not even software, maybe just user interfaces, and just delivering what you need in the moment. And it's all predicted. It is a completely new way to think about computing, and it requires new chips, GPUs, and it requires new software model weights. And I'm so excited to be here and talk about it with you all. It is

such a cool time to be alive. I hope you enjoyed this video. Please consider giving a like and subscribe, and I'll see you in the next one.

NVIDIA CEO on Agents Being the Future of AI

Artificial Intelligence (AI), Open Source, Generative Art, AI Art, Futurism, ChatGPT, Large Language Models (LLM), Machine Learning, Technology, Coding, Tutorials, AI News, and more

** Exclusive Pinecone Partner **

Matthew Berman

Jensen, the CEO of Nvidia, envisions a future with thousands of agents working for us, using and collaborating with tools.

This shift from an industry of tools to an industry of skills is seen as transformative, with agents playing a crucial role.

The agentic framework, powered by large language models and the ability to build and choose tools, is expected to make these agents exponentially more powerful.

The Impact of Unsupervised Learning on AI

Unsupervised learning has emerged as a game-changer for AI, allowing for the creation of language models that codify human knowledge and learn from multimodal data.

Humans have been the limiting factor for AI's data ingestion, but now proprietary data and reinforcement learning are being used to drive model differentiation and improvement.

The scaling of AI data is being approached through increased compute during inference and the use of synthetic data generated by AI for other models.

AI is advancing at an unprecedented rate, exceeding Moore's law by doubling chip compute power every 6 months.

The shift from CPUs to GPUs and the rise of machine learning software have created a feedback loop, allowing AI to generate more software and systems.

This removal of human limitations in software development is set to explode the number of code writers, with AI eventually taking over the entire coding process.

AI may eventually write model weights instead of code, making it difficult for humans to read and understand.

The black box nature of AI's model weights poses challenges for transparency and comprehension.

The scaling of AI intelligence and compute power, along with techniques like reflection and Chain of Thought, is driving progress in AI safety and reasoning.

Simplifying AI Implementation and Onboarding

The speaker emphasizes the importance of demystifying AI and making it easily accessible for everyone to use.

They criticize companies like Microsoft for shipping products that are difficult to use in production environments, equating their Copilot to the failed Clippy.

The speaker highlights the significance of onboarding AI agents similarly to human employees, providing them with context, training, and documentation to ensure a smooth transition and effective performance.

Artificial intelligence is now providing the tools and capabilities to solve long-standing challenges, leading to a paradigm shift in computing.

This new approach focuses on just-in-time, dynamically created, and predicted software, potentially changing the way user interfaces deliver information.

The shift requires new chips, GPUs, and software model weights, marking a revolutionary change in the computing landscape.