AMD의 5세대 에픽 및 AI 혁신 출시

AMD의 5세대 에픽 CPU는 코어 효율성이 크게 개선되어 AI 및 엔터프라이즈 워크로드를 위한 업계 최고의 성능을 제공합니다.

### AMD의 AI 및 컴퓨팅의 발전: 5세대 EPYC 및 새로운 혁신의 출시
* 🚀 뛰어난 서버 워크로드를 위해 설계된 Zen 5 코어를 필두로, **이전 세대인 Zen 4 대비 177% 더 높은 IPC**를 자랑하며 **완벽한 AVX 512 지원**과 함께 5세대 EPYC 포트폴리오를 공개하는 Advancing AI 2024에 오신 것을 환영합니다.
* 💻 새로운 Turin 아키텍처는 **17개의 칩렛에 최대 1,500억 개의 트랜지스터**를 탑재하고 **최대 192코어와 384스레드**로 확장할 수 있어 클라우드 및 엔터프라이즈 워크로드를 모두 효과적으로 처리하는 광범위한 포트폴리오를 강조합니다.
* 🔍 **128코어 버전의 Turin은 스케일업 워크로드에 최적화**되어 있으며, **192코어 버전은 스케일아웃 워크로드를 대상으로** 하며, 둘 다 엔터프라이즈 애플리케이션에 필수적인 **코어당 최대 성능**을 위해 고급 칩렛 설계를 활용합니다.
* 📊 성능 비교에서 **5세대 EPYC는 이전 세대보다 2.7배 더 뛰어난 성능**과 **코어당 1.6배 더 높은 성능**을 제공함으로써 경쟁사 최고 제품보다 뛰어난 성능을 발휘하여 CIO에게 상당한 비용 절감 효과를 제공합니다.
* 🌟 Mi 325x 가속기의 출시는 **256GB의 HBM 3E 메모리와 6TB/s 대역폭**으로 경쟁사 대비 **1.8배 더 많은 메모리와 1.3배 더 나은 AI 성능**을 제공하는 제너레이티브 AI 성능의 리더십을 선보입니다.
* 📈 향후 출시될 MI 350 시리즈에는 새로운 메모리 용량과 대역폭 향상을 통해 **CDNA 3 대비 획기적인 35배의 AI 성능 향상**을 약속하는 **CDNA 4 아키텍처**가 도입될 예정입니다.
* 🔗 AMD 펜산도 팀의 3세대 P4 엔진은 **400Gbps 이상의 성능**을 제공하는 동시에 고급 서비스를 지원하여 지속적인 혁신과 AI 시스템의 요구 사항을 충족할 수 있는 역량을 보여줍니다.
* 💡 마지막으로, Ryzen AI Pro 300 시리즈는 고성능 Zen 5 CPU, RDNA 3.5 그래픽 및 XDNA 2 NPU를 결합하여 비즈니스 PC의 기능을 재정의함으로써 **Co-Pilot Plus PC 내에서 50 TOPS 이상의 AI 성능**을 달성합니다.

all right, big big welcome to advancing AI 2024. Today, I'm super excited to launch our fifth gen epic portfolio. It all starts with our latest Zen 5 Core. We designed Zen 5 to be the best in server workloads, and that means delivering an average of 177% higher IPC than Zen 4 and adding support for full AVX 512. Turn is fantastic. It features up to 150 billion transistors across 17 chiplets, scales up to 192 cores and 384 threads, and one of the things that's very special about fifth gen epic is we actually thought about it from the architectural standpoint in terms of how do we build the industry's broadest portfolio of CPUs that both covers all of the new Cloud workloads as well as all of the important Enterprise workloads and things like you know building fifth gen epic CPU at 5 gz. That was because there was a new workload. We were seeing the need when you think about industry-leading performance for AI head nodes. That frequency becomes

really important, and that's an example of where we've brought in the portfolio with Turin. Now, this version of Turin is actually 128 cores, and it's optimized for scale-up workloads. It has 164 NM triplets, so if you look outside of the ring, you see the 16 4-nanometer chiplets and a 6-nanometer IO die in the center. And we've optimized this for the highest performance per core because it's extremely important in enterprise workloads. When you see that, you know, software is often licensed on a per-core basis, you want the highest possible performance per core. Okay, now this is also Turin. This is the 192-core version of Turin, and this guy is optimized for scale-out workloads. And here we use 12 3-nanometer compute chiplets, and it's the same 6-nanometer IO die in the center. And this version of Turin is really optimized for cloud, so applications that benefit from maximum compute per socket. This is what we do. So, let's now take a look at Turin.

performance. We're going to compare many of the things in the next few slides to the competition's top of Stack Emerald Rapids. When you look at the competition's top of Stack, a dual-socket fourth-gen Epic server is already 1.7 times faster on Spec Rank 2017. And with fifth-gen Epic, the performance is fantastic. We extend that lead with 2.7 times more performance. Now, we know it's a very competitive space, and we fully expect as our competition launches their next-generation CPUs and they ship in volume, that Turn will continue to be the leader for the Enterprise space. There are many commercial software stacks that are licensed for core, and CIOs want to optimize the cost by running solutions on the fewest possible cores. When running these workloads on-prem, again, fourth-gen Epic is already the performance leader, and with fifth-gen, we deliver 1.6 times more performance per core than the competition. That's 60% more performance with no additional licensing cost. Today, I'm very

excited to launch Mi 325x, our next Generation Instinct accelerator with leadership generative AI performance. Mi 325 again leads the industry with 256 gigabytes of ultra-fast HBM 3E memory and six terabytes per second of bandwidth. When you look at Mi 325, we offer 1.8 times more memory, 1.3 times more memory bandwidth, and 1.3 times more AI performance in both FP16 and FP8 compared to the competition. And when you look at that across some of the key models, we're delivering between 20 and 40% better inference performance and latency on things like Llama, MRAW, and MRAW. And importantly, one of the things that we wanted to do was really keep a common infrastructure. So, Mi 32 leverages the same industry-standard OCP-compliant platform design that we used on Mi 30. And what it does is it makes it very easy for our customers and partners to bring solutions to market. Now, when you look at the overall

platform with HPUs. We deliver significantly more AI compute and memory. The HPU version features two terabytes of HBM 3E memory and 48 terabytes per second of aggregate memory bandwidth, enabling our customers to run more models as well as larger models on a single MI 325 server. Today, I'm very excited to give you a preview of our next-generation MI 350 series. The MI 350 series introduces our new CDNA 4 architecture. It features up to 288 GB of HBM 3E memory and adds support for new FP4 and FP6 data types. And again, what we're thinking about is how can we get this technology to market the fastest. It actually also drops into the same infrastructure as MI 300 and MI 325 and brings the biggest generational leap in AI performance in our history when it launches in the second half of 2025. Looking at the performance, CDNA 4 delivers over seven times more AI compute and, as we said, increases both

memory capacity and memory bandwidth, and we've actually designed it for higher efficiency, reducing things like networking overhead so that we can increase overall system performance. In total, CDNA 4 will deliver a significant 35 times generational increase in AI performance compared to CDNA 3. We have been relentlessly focused on performance, from the latest public models to the flagship proprietary models. With each ROAM release, we've delivered significant performance gains. Our latest release, Rockham 6.2, delivers 2.4 times the performance for key inference workloads compared to our sixth Auto release from last year. These gains have been made possible by a number of enhancements: improved attention algorithms, graph optimizations, compute libraries, framework optimizations, and many, many more things. Similarly, ROAM 6.2 delivers over 1.8 times improvement in training performance, and again, these gains have been made possible by improved attention algorithms like Flash Attention V3, that is supported, improved compute communication libraries, parallelization strategies, and framework optimizations. The AMD Pensando team has now delivered the third generation P4.

engine featuring over 200 fully programmable match processing units, a bunch of table engines. What it means is a super high-performance, fully programmable data path engine that can deliver 400 gbits per second line rate performance while multiple Advanced Services run concurrently on top of that engine. These Services can be coded and changed at the speed of software while matching the performance of hardwired solutions. Selena offers 400 gigabits per second throughput while running SDN security encryption services simultaneously. It provides greater than 2x the performance of our previous generation while being fully backward compatible. And that fully programmable pipeline means we can continuously deliver innovations and features to our customers, and they can add their own innovation on top. Selena will power high-performance front-end networks for AI systems and meet the increased demands of general compute clouds that are powered by Turin CPUs that need to be fed some data. But I'm equally excited to announce AMD's Polara 400. It uses the same third-generation P4 engine to

enable what we expect will be the industry's first Ultra Ethernet Consortium ready AI Nick. It will deliver the performance benefits of UE ready RDMA and ensure that AMD's customers can continue to innovate at a rapid pace and achieve the fast time to production. The AMD teams, networking teams, are delivering extremely well, and I'm pleased to announce that Selena and Polara will both be available early next year. The AMD Ryzen AI Pro 300 series resets the bar for what a business PC can do. We combine our high-performance Zen 5 CPU, our new RDNA 3.5 Graphics, our new XDNA 2 NPU with 50 plus TOPS of AI performance, and all of this, this is within Co-Pilot Plus PCs.

AMD 'Advancing AI' Event: Everything Revealed in 9 Minutes

CNET is the premier destination for explaining and navigating the changing world around us. Through news, product reviews, price comparisons, and more, we’ll tell you what’s new in the parts of modern life that increasingly matter more — from health, home, and money to tech, culture, and climate — and how to get the most out of them.

CNET

서버 워크로드를 위해 설계된 최신 Zen 5 코어가 Zen 4보다 177% 더 높은 IPC와 완벽한 AVX 512 지원을 갖춘 5세대 에픽 포트폴리오가 출시되었습니다.

이 포트폴리오에는 최대 192코어와 384스레드가 포함되어 있으며, 새로운 클라우드와 중요한 엔터프라이즈 워크로드를 모두 처리하는 데 중점을 두고 있습니다.

128코어 버전인 Turin은 스케일업 워크로드에 최적화되어 있으며, 192코어 버전은 클라우드 애플리케이션을 위한 소켓당 최대 컴퓨팅을 목표로 하는 스케일아웃 워크로드에 맞게 설계되었습니다.

성능 비교: 4세대 및 5세대 에픽 서버와 경쟁사 비교

경쟁사의 최고 스택 듀얼 소켓 4세대 에픽 서버는 사양 순위 2017에서 1.

7배 빠르며, 5세대 에픽은 그보다 2.

7배 더 빠른 성능을 제공합니다.

6배 더 높은 성능을 제공하여 추가 라이선스 비용 없이 60% 더 높은 성능을 제공합니다.

새로운 Mi 325x Instinct 가속기는 256GB의 HBM 3E 메모리와 6TB/s 대역폭으로 업계를 선도하며, 경쟁사 대비 20~40% 향상된 추론 성능과 지연 시간을 제공합니다.

AMD의 HPU 버전은 2TB의 HBM 3E 메모리와 48TB/s의 대역폭을 제공하여 단일 서버에서 더 크고 더 많은 모델을 지원할 수 있습니다.

곧 출시될 MI 350 시리즈에는 최대 288GB의 HBM 3E 메모리와 35배 향상된 AI 성능을 갖춘 CDNA 4 아키텍처가 탑재될 예정입니다.

2는 다양한 개선 사항을 통해 추론 및 훈련 워크로드 모두에서 상당한 성능 향상을 제공합니다.

고성능 데이터 경로 엔진: Selena

셀레나는 200개 이상의 완전 프로그래밍 가능한 매치 처리 장치를 갖추고 있어 여러 고급 서비스를 동시에 실행하면서 초당 400기가비트의 회선 속도 성능을 제공합니다.

이전 세대보다 2배 이상 향상된 성능을 제공하며 이전 버전과 완벽하게 호환됩니다.

프로그래밍 가능한 파이프라인은 지속적인 혁신과 고객이 자체 기능을 추가할 수 있는 기능을 제공하여 AI 시스템과 일반 컴퓨팅 클라우드를 위한 고성능 프런트엔드 네트워크를 지원합니다.

AMD의 혁신적인 AI Nick 및 Ryzen AI Pro 300 시리즈

AMD는 업계 최초로 울트라 이더넷 컨소시엄 지원 AI 닉을 출시하며 고객에게 성능 혜택과 빠른 혁신을 약속합니다.

셀레나 및 폴라라 모델은 내년 초에 출시될 예정입니다.

Ryzen AI Pro 300 시리즈는 고성능 Zen 5 CPU, RDNA 3.

5 그래픽 및 XDNA 2 NPU를 결합하여 Co-Pilot Plus PC에서 50 TOPS 이상의 AI 성능을 제공합니다.