AI's Role in Solving Scientific and Engineering Challenges

Neural operators enable AI to simulate physical phenomena, revolutionizing scientific research and engineering design.

### Advancing AI for Scientific Discovery and Engineering Design
* 🔬  Dr. Ilya Sutskever, an AI researcher, is working on AI that **transforms scientific research and engineering design** by connecting the **physical and digital worlds**.
* 🧠  Language models like ChatGPT can generate ideas, but they lack physical grounding and **cannot simulate complex physical phenomena**.
* 🌐  To model scientific and physical phenomena accurately, AI needs to be trained on **real-world data** and incorporate **hidden details**.
* 🌊  Neural operators, an AI technology developed by Dr. Sutskever's team, represent data as continuous functions, allowing for **infinite zooming and simulation at multiple scales**.
* 💉  Neural operators were used to design a more effective medical catheter, reducing bacterial contamination by **over 100-fold**.
* 🌪️  FourCastNet, a weather model based on neural operators, is **tens of thousands of times faster than traditional models** and **more accurate in some cases**.
* 🔥  Neural operators are also being applied to simulate plasma in fusion reactors, potentially making **nuclear fusion a viable clean energy source**.
* 🤖  Dr. Sutskever envisions building a generalist AI model with **universal physical understanding** that can **simulate any physical phenomena** and **design novel solutions** across various domains.

I grew up with parents who are engineers. They were among the first to bring computerized manufacturing to my hometown in India. Growing up as a young girl, I remember being fascinated how these computer programs didn't just reside within a computer, but touched the physical world and produced these beautiful and precise metal parts. Over the last two decades, as I pursued AI research, this memory continued to inspire me to connect the physical and digital worlds together. I am working on AI that transforms the way we do science and engineering. Scientific research and engineering design currently involves a lot of trial and error. Many long hours are spent in the lab doing experiments. So it's not just the great ideas that propel science forward. You need these experiments to validate findings and spark new ideas. How can language models help here? What if I ask ChatGPT to come up with a better design of an aircraft wing, or a drone that flies on a turbulent wind?

It may suggest something. It may even draw something. But how do we know this is any good? We don't. Language models hallucinate because they have no physical grounding. While language models may help generate new ideas, they cannot attack the hard part of science, which is simulating the necessary physics to replace the Nab experiments. In order to model scientific and physical phenomena, text alone is not sufficient. To get to AI with universal physical understanding, we need to train it on the data of the world we observe. And not just that, also its hidden details. From the intricacies of quantum chemistry that happen at the smallest level to molecules and proteins that influence how all biological processes work, to ocean currents and clouds that happen at planetary scales and beyond, we need AI that can capture these whole range of physical phenomena. We need AI that can really zoom into the fine details in order to simulate these phenomena accurately. To capture the cloud movements,

and predict how clouds move
and change in our atmosphere, we need to be able
to zoom into the fine details of the turbulent fluid flow. Standard deep learning uses
a fixed number of pixels. So, if you zoom in, it gets blurry, and not all the details are captured. We invented an AI technology
called neural operators that represents the data
as continuous functions or shapes, and allows us to zoom in indefinitely
to any resolution or scale. Neural operators allow us to train on data at multiple scales or resolutions, and also allows us to incorporate the knowledge of mathematical equations to fill in the finer details when only limited
resolution data is available. Such learning at multiple scales
is essential for scientific understanding, and neural operators enable this. With neural operators, we can simulate physical phenomena
such as fluid dynamics as much as a million times faster
than traditional simulations. Last year, we used neural operators
to invent a better medical catheter. A medical catheter is a tube that draws
fluids out of the human body.

Unfortunately, the bacteria tend to swim
upstream against the fluid flow and infect the human. In fact, annually, there is more
than half a million cases of such healthcare-related infections, and this is one of the leading causes. Last year, we used neural operators
to change the inside of the catheter from smooth to ridged. With ridges, now we have vortices
created as the fluid flows, and we can hope to stop the bacteria
from swimming upstream because of these vortices. But to get this correct, we need the shape of the ridges
to be exactly right. In the past, this would have been
done by trial and error. Design a version of the catheter, build it out, take it to the lab, observe a hypothesis
if something went wrong, rinse and repeat and redesign again. But instead, we taught AI the behavior
of the fluid flow inside the tube, and with it, our neural operator model
was able to directly propose

an optimized design. We 3D-printed the design
only once to verify that it worked. In the video, you're seeing our catheter
being tested in the lab. The bacteria are not able
to swim upstream, are instead being pushed out
with the fluid flow. In fact, we measured the reduction
in bacterial contamination by more than 100-fold. So in this case, the neural operators
were specialized to understand fluid flow in a tube. What other applications can AI tackle and help us solve such pressing problems? Can deep learning beat
numerical weather models? A group of leading weather scientists
asked this question in February 2021, in a Royal Society publication. They felt that AI
was still in its infancy, and that a number of fundamental
breakthroughs would be needed for AI to become competitive
with traditional weather models, and that would take years or even decades. Exactly a year later, we released FourCastNet.

Using neural operators, we built the first fully AI-based weather model that is high resolution and is tens of thousands of times faster than traditional weather models. What used to take a big supercomputer can now run on a gaming PC that you may have at home. This model is also running at the European Centre for Medium-Range Weather Forecasting, one of the premier weather agencies of the world. And our AI model is not just tens of thousands of times faster than traditional models. It's also more accurate in many cases. On September 16 last year, Hurricane Lee hit the coast of Nova Scotia, Canada. A full ten days earlier, our FourCastNet model correctly predicted that the hurricane would make landfall, but the traditional weather model predicted the hurricane would skip the coast. Only five days later, on September 11, did the traditional weather model correct its forecast to predict landfall. Extreme weather events such as Hurricane Lee will only increase further unless we take action.

on climate change, such as finding new,
clean sources of energy. Nuclear fusion is one of them. But unfortunately, there are
still big challenges with it. The fusion reactor heats up the plasma to extremely high temperatures
to get fusion started. And sometimes this hot plasma
can escape confinement and can damage the reactor. We train neural operators
to simulate and predict the evolution of plasma
inside the reactor. And with it, we can use this to predict
disruptions before they occur and take corrective action
in the real world. We are enabling the possibility
of nuclear fusion becoming a reality. So neural operators and AI broadly are enabling us to tackle
hard scientific challenges such as climate change
and nuclear fusion. To me, this is just the beginning. So far, these AI models are limited
to the narrow domains they're trained on. What if you had an AI model that could solve all
and any scientific problem? From designing better
drones, aircraft, rockets,

and even better drugs
and medical devices? Such an AI model would greatly
benefit humanity. This is what we are working on. We are building a generalist AI model
with emergent capabilities that can simulate any physical phenomena and generate novel designs
that were previously out of reach. This is how we scale up neural operators to enable general intelligence
with universal physical understanding. Thank you. (Applause)

AI That Connects the Digital and Physical Worlds | Anima Anandkumar | TED

The TED Talks channel features the best talks and performances from the TED Conference, where the world's leading thinkers and doers give the talk of their lives in 18 minutes (or less). Look for talks on Technology, Entertainment and Design -- plus science, business, global issues, the arts and more. You're welcome to link to or embed these videos, forward them to others and share these ideas with people you know.

TED's videos may be used for non-commercial purposes under a Creative Commons License, Attribution–Non Commercial–No Derivatives (or the CC BY – NC – ND 4.0 International) and in accordance with our TED Talks Usage Policy: https://www.ted.com/about/our-organization/our-policies-terms/ted-talks-usage-policy. For more information on using TED for commercial purposes (e.g. employee learning, in a film or online course), please submit a Media Request at https://media-requests.ted.com

The Impact of AI on Connecting the Physical and Digital Worlds

AI research is being inspired by the connection between the physical and digital worlds, aiming to transform science and engineering by reducing the need for extensive experiments.

While language models can generate ideas, they currently lack physical grounding and the ability to simulate necessary physics, making them insufficient for the hard parts of science.

To truly capture a wide range of physical phenomena, AI needs to be trained on and incorporate the hidden details of the observed world, from the smallest scales of quantum chemistry to planetary-level processes like ocean currents and cloud movements.

Advancements in AI Technology for Fluid Dynamics and Medical Inventions

AI technology, called neural operators, allows for zooming into fine details of turbulent fluid flow by representing data as continuous functions, enabling training at multiple scales, and simulating physical phenomena much faster than traditional methods.

Neural operators were used to invent a better medical catheter by changing its design from smooth to ridged, creating vortices in the fluid flow to prevent bacteria from swimming upstream, with the AI model being able to directly propose the shape of the ridges.

This technology has revolutionized the process of designing the catheter, replacing the traditional trial and error method with AI learning the behavior of fluid flow to make direct design proposals.

Neural operators were used to reduce bacterial contamination in a tube by over 100-fold, showcasing AI's potential in understanding fluid flow.

FourCastNet, an AI-based weather model, is now thousands of times faster and more accurate than traditional models, successfully predicting Hurricane Lee's landfall significantly earlier.

AI has the potential to revolutionize weather forecasting, offering high resolution and improved accuracy, potentially addressing the growing challenges of extreme weather events.

The Role of Neural Operators in Advancing Nuclear Fusion and Beyond

Nuclear fusion faces significant challenges, including the potential damage from escaped plasma, but neural operators are being trained to simulate and predict plasma evolution to prevent disruptions.

These operators, along with AI, are also being developed to tackle a wide range of scientific problems and design novel solutions, with the goal of achieving general intelligence for universal physical understanding.