Advancements in AI: Energy Efficiency and Agentic Intelligence

Nvidia is revolutionizing industries by integrating agentic AI to enhance efficiency and energy management.

### Advancing AI for a Sustainable Future: Innovations and Impact
* 🌍 This special address highlights the collective achievements in AI, emphasizing **collaboration with companies and government agencies** to enhance the US's **leadership in AI** while promoting **democracy in technology**.
* ⚡ The focus is on designing systems that prioritize both **performance and energy efficiency**, necessitating data centers equipped for **accelerated computing infrastructure**.
* 🖥 A full-stack approach is adopted, optimizing not just chips but **entire systems**, which has led to the development of the impressive **Blackwell platform**, showcasing **groundbreaking engineering**.
* 🔋 Over the past decade, there has been a remarkable **100,000x reduction in energy** consumption, demonstrating significant advancements in energy efficiency across various AI applications.
* 🤖 The transition from instruction-led to intention-led computing is underway, enabling computers to **generate intelligence and skills autonomously**, which will **revolutionize industries like manufacturing**.
* 📊 New AI agents can proactively identify issues, optimize supply chains, and improve operational efficiency by **communicating seamlessly across different functions**.
* 🔒 Nvidia is pioneering confidential computing to safeguard data in language models, ensuring **secure and trustworthy AI**, which is crucial for **protecting sensitive information**.
* 🌌 The exploration of the universe is enhanced through **real-time searches for fast radio bursts**, showcasing the potential of **AI in understanding both our planet and the cosmos beyond**.

you know what we're doing here in this special address is give is just giving you a glimpse of all the great work that you have done with us. You know, it's really about the work that we're that you were doing that we ideally helping you enable. This is really about um working with companies, working with government agencies to help the US lead in AI, to help democ AI. We can't stop trying to find ways to improve our planet and Humanity. Performance is going to continue to need to go up. I'm just here to tell you that we're designing our systems with not just performance in mind, but with Energy Efficiency in mind. It's going, it's going to mean that we're going to need data centers that understand this accelerated Computing infrastructure um. It's going to mean that we understand and approach things not just from a ship level but from a full stack level because we don't just try to optimize the chip. We're no longer just optimizing the GPU. We're optimizing the system. We look at a full

full-stack approach of how the system operates, the environment in which that system operates, and the software stack that runs in the system. And with that in mind, that's how we spent years developing our blackw platform. The amount of technology in here is just, it's a Marvel of engineering. All of these components, you know, we purposely build these racks of computing trays. We make sure that those racks of computing trays work together. And on top of that platform I mentioned, full-stack platform, you know, this is not the, this is the AI super cluster platform, the real platform, and the Cuda libraries, our software acceleration libraries. And then to further advance work in AI, in physical AI, we hon our two main platforms, Nvidia AI Enterprise with our microservices, our large language models, and Omniverse, our digital twin, you know, where we use the virtual world to improve the physical world. We've achieved 100%, 100,000x reduction in energy over the last 10.

years 100,000x, and that's on the impressing side. So, the generation of tokens is on the, uh, industry side. On the training side, I think we reduced energy consumption by 200x. But Blackwell is coming. It's in production, and the biggest and best systems are, uh, uh, will be shipping here in this next quarter. We're moving from instruction-le computing to intention-le computing, and that software has to be new, um. We have to be able to talk to our computers, to ask questions, um. This is going to be the second part of what's going to drive this Industrial Revolution, probably one of the most important parts, um. We've got years of skills here, and the amount of energy we have, more software people in Nvidia working here, um, than we do hardware people for this reason, um. Instead of the computer being a tool that you use to get stuff done, the computer is now going to be able to generate intelligence, generate skills. So, let's take an example of a manufacturing floor. You might have a very AI agent

that's constantly moding to your inventory. It notices that you got excess capacity, but your floor is not taking advantage of that excess capacity. They're working on a plan to produce X number of widgets today. That AI agent can communicate with the factory floor agent. That factory floor agent can help accelerate the continued building versus sending people home early or whatever. Continue to build, which then communicates with the purchasing AI agent to re-replenishing the materials at a rate. And you can do in minutes what used to take days. So, this era of agentic AI is really going to transform a lot of different industries. We've already seen examples of some horizontal use cases where digital avatars are used to improve the way we talk to customers, to improve the way we enable our employees to be more productive. We've seen some great examples in the past on content generation, whether it be texts, images, videos. Now, a lot of great work in product R&D, not just in healthcare, what we show there, but three that you see.

There are three things that I want to talk about in a minute, and we can use that AI agent since it is proactive, since it's not waiting for you to prompt it to see if you have an issue. We can use that AI agent to let you know you have an issue, that you have a vulnerability. We want to enable you all to incorporate your data because you know you're not going to optimize your supply chain on ChatGPT alone. You're probably going to take a smaller model, you're going to fine-tune it, you're going to fine-tune it maybe in your particular industry, and you're going to fine-tune it for your particular corporation because you have different semantics, different lingo, right? Training the AI makes sure that you expose it to the way that your company or your organization is able to interpret it. That reduces hallucinations, right? That makes it tailored, but you still don't stop there. You don't look back and train it. You've got to continually expose it to new data.

new intelligence that data is intelligence, and Company people's people are intelligence. So really happy to announce our nage and blueprints. Um, it's a way to connect your data fly will your data fly well to a bunch of different reference workflows. We're not an application company; we provide reference examples based on some of the most um often asked workflows that our customers that you bring to us, some of the biggest pain points, and some of the ones we care about the most: improving customer satisfaction, employee satisfaction, getting smarter, better, safer products to market, helping companies cure some really, really horrible diseases, and protecting our government IP, our personal IP, and having a strong AI ecosystem to lead the world. He looks real; he's not real, but James a blueprint that's available on build.nvidia.com is going to tell us a little bit more about all the blueprints that we have. Agses mod devent impr en. When you transmit data, it's encrypted, mostly safe, mostly safe, but llms are plain Tex. You're going to train an llm or

small language mod slm. It's plain text. Everything you said is in plain text. That knowledge is in plain text. Nvidia is the only provider to implement confidential computing to protect those LLMs, and that's the only way protecting your crown jewel to deliver secure and trustworthy AI. People could try to the encryption codes on where data is moving, but I think we all can imagine it's much easier to read a Word file than it is a, you know, an encrypted file. You know, primarily to date, we've really affected the IT industry. We've affected the electron part of this, and the next step is to affect the proton part of this, the physical world. We know that robots can help save lives, do jobs to make it safer for manufacturing employees to work. They can be assistant to people with disabilities. We know multiple organizations are talking about the need that we'll have A4 million, do four million jobs created in the next several years. We're not sure where that

Workforce could come from some of it might come from the jobs that are too dangerous with robots. Some of it, and I hope a lot of it, comes from our ability to upscale our current Workforce. What if we could train a robot on the manufacturing process in the virtual world, train them in the virtual world, train it at scale? Don't train one autonomous machine, one car, one robot, one at a time in the physical world. Train millions of them, train millions of them virtually, using that agentic AI knowledge that they need to have to reason and learn. Train them in the second computer to simulate how they operate, throwing out a multitude of conditions, bad and good. And when we have success, we take that neural net and we put it in a third computer. We put it in the car, we put it in the submersible, we put it in the Drone, we put it in the humanoid. So Omniverse is our way, um, really to test and optimize, uh, people's design and all the operational processes that go to

producing these physical AIS. It's a virtual treating G real-world Radio Networks 5G 6G. Um, we're now using Nvidia aerial ran um to improve both the transmission, the location of powers, and the utilization of how these networks um exist. We're announcing that se is releasing their first real-time search for fast radio burst. You're probably saying, What are fast radio burst? Se's mission is dedicated to searching for life in the universe. You know, they use our Hollan Edge platform, that third computer. They use that third computer to listen to signals from deep space. Fast radio bursts are one of those kinds of signals, but they happen so fast. They happen in fractions of a millisecond, fractions of a second. So, the only way they know they happen is they go back to this stored telescope array data. They see it happen, but it's long gone. It's long gone. We have no idea really where it came from. And so, the ability to spot these things in real time is really accelerating our ability.

to find the source, identify the source, analyze these frequencies. You can assume what these frequencies might be, but the amazing thing about them is not that there are radio frequencies coming from distant galaxies, but the energy coming from these distant galaxies is brighter than some of the galaxies in our universe. A fast radio burst of milliseconds is producing energy that's greater than the energy produced by some of our galaxies. So, really excited about that as a space guy. I'm excited about that. You might be saying, So what? But it's a massive application to help us understand not just about our planet, but what might be out there, what might be out there as we go beyond Mars.

Nvidia's AI Summit 2024: The Next Wave of AI in 14 Minutes

CNET is the premier destination for explaining and navigating the changing world around us. Through news, product reviews, price comparisons, and more, we’ll tell you what’s new in the parts of modern life that increasingly matter more — from health, home, and money to tech, culture, and climate — and how to get the most out of them.

CNET

The focus is on enabling companies and government agencies to lead in AI and improve the planet and humanity.

The approach involves a full-stack optimization of systems, data centers, and software to enhance performance and energy efficiency.

The development of the AI supercluster platform and microservices, along with the use of digital twins, aims to further advance AI and achieve significant energy reduction.

AI token generation has dramatically increased, with energy consumption for training reduced by 200x.

The shift from instruction-led to intention-led computing is driving a new Industrial Revolution, with AI agents transforming operations on manufacturing floors.

This era of agentic AI is set to revolutionize various industries, improving customer interaction, employee productivity, and product research and development.

AI agents can proactively identify vulnerabilities and issues without waiting for prompts.

Fine-tuning a smaller model with company-specific data and continually exposing it to new intelligence helps reduce hallucinations and tailors the AI to the organization's needs.

The launch of nage and blueprints aims to connect data to reference workflows, addressing common pain points and improving customer and employee satisfaction while promoting a strong AI ecosystem.

Nvidia's Role in Confidential Computing and AI Workforce Transformation

Nvidia is the only provider implementing confidential computing to protect large language models (LLMs), ensuring secure and trustworthy AI.

The company aims to impact the physical world next, using robots to save lives and create jobs, with a focus on upskilling the current workforce.

Nvidia's Omniverse is designed to train and simulate millions of robots virtually, optimizing their operation before deploying them in the physical world.

Nvidia is using its aerial RAN to enhance 5G and 6G networks.

SE is launching a real-time search for fast radio bursts, which are brief but powerful signals from deep space.

These bursts produce energy greater than some galaxies, and their real-time detection is crucial for understanding their source and analyzing their frequencies.