YOLOv7 포즈와 미디어파이프: 사람 포즈 추정 비교

YOLOv7 Pose는 다중 인원 감지 기능이 뛰어나며, Mediapipe는 1인 작업 시 지터가 적고 실시간 정확도를 제공합니다.

### YOLOv7 포즈와 미디어파이프 비교: 종합적인 인체 포즈 추정 벤치마크
* 🤖 주요 개념: 인체 자세 추정에는 인체의 주요 관절 위치를 예측하는 작업이 포함되며, **키포인트의 개수가 다양한 데이터 세트(예: Coco-17, MPII-16, AI Challenger-14)**가 사용됩니다.
* 🔍 알고리즘 개요: **YOLO 포즈**는 객체 키포인트 유사성 메트릭을 직접 최적화하는 엔드투엔드 포즈 추정 모델로, **하향식 접근 방식과 상향식 접근 방식의 장점**을 결합합니다.
* 🏋 모델 비교: **YOLOv7 포즈**는 17개의 키포인트를 사용하는 다인용 포즈 추정 모델인 반면, **미디어파이프**는 33개의 키포인트를 사용하는 1인용 포즈 추정 모델에 최적화되어 있습니다.
* ⏱ 성능 비교: **YOLOv7 포즈는 CPU 및 엣지 디바이스의 실시간 성능에 최적화된 미디어파이프에 비해 정확도는 높지만 FPS는 낮습니다.**
* 🔍 지터 분석: 미디어파이프는 **감지+추적 접근 방식**으로 인해 지터가 적은 반면, **YOLOv7 포즈는 까다로운 시나리오에서 깜박임**이 나타날 수 있습니다.
* 🔬 스케일 및 오클루전: 미디어파이프는 트래킹 메커니즘 덕분에 **스케일 변화와 오클루전을 처리하는 데 탁월**하지만, **YOLOv7 포즈는 이러한 시나리오에서 어려움**을 겪을 수 있습니다.
* 🌌 저조도 및 극한 환경: 저조도 환경에서는 **YOLOv7 포즈가 더 나은 성능**을 보이지만, 극한 상황(예: 빠른 동작, 거꾸로 포즈)에서는 **미디어파이프가 더 나은 성능**을 발휘합니다.
* 🎯 권장 사항: 정확도가 높은 GPU 기반 애플리케이션에는 **YOLOv7 포즈**를, 실시간 CPU 배포에는 **Mediapipe**를 선택하세요. 포즈 추정 모델을 선택할 때는 프로젝트의 특정 요구 사항(예: 다중 인원 지원, 오클루전 처리)을 고려하세요.

YOLOv7 Pose vs. Mediapipe! Human Pose Estimation Benchmark and which one to choose? Hey there, welcome to LearnOpenCV. YOLOv7 pose is the new kid on the block for Human Pose Estimation. We will pit it against the popular Mediapipe pose model using challenging videos and share our findings through this video. I am sure this will help you choose the right pose estimation model for your next project. Before we start, let's do a quick refresher on Human Pose Estimation for those who are new to this topic. If you want to jump into the comparison section, skip to the fourth minute of the video. Now, what is Human Pose Estimation? Human Pose Estimation is the task of predicting the location of major joints of the human body. It is also referred to as Keypoint Detection. Now you may ask how many points? There are many datasets for Keypoint Detection with different topologies.

The most common being the Coco dataset, which has 17 keypoints. Others include the MPII dataset, which has 16 keypoints, the AI Challenger dataset, and the CrowdPose dataset, both with 14 keypoints, and so on. Human Pose Estimation has possible applications in many industries. For example, you can build AI fitness trainers like that of peloton.ai. It can be used in healthcare services, sports analytics, activity recognition, surveillance, in the VR industry for gaming, and human-computer interaction. There has been extensive research on this topic, and many algorithms have been proposed over the years. Some of the popular ones are OpenPose, AlphaPose, HRNet, DEKR, BlazePose, and YOLO Pose. Now, what is YOLO Pose? YOLO Pose is an end-to-end pose estimation model. To understand what it means, let us quickly discuss the two general approaches for pose estimation. In the Top-down Approach, we first detect persons in the image and then use these

boxes to find key points. As you can guess, this would give pretty good results but would be too slow if there are too many people in the scene. The Bottom-up Approach uses heat maps to find key points and then uses a grouping algorithm to map the key points to each person. This is a single-stage and thus it is fast, but you can imagine it won't be very accurate in case of crowded scenes. YOLO Pose moves away from both these approaches and directly optimizes the object keypoint similarity metric, which jointly detects the key points as well as the bounding boxes. So, it does not need the grouping step done in Bottom-up Approaches, and because the key points and boxes are predicted in a single inference step, it does not compromise on speed as well. Thus, it brings in the best of both approaches. YOLO Pose is designed with a general architecture so that you can plug in any object detection model. The original paper was based on YOLOv5.

Now since the architecture of YOLO Pose is general, the YOLOv7 authors adapted it to YOLOv7 and hence the name YOLOv7 Pose. We want to test YOLOv7 Pose in terms of speed and accuracy and compare the features with Mediapipe as it is a very accurate and real-time model. Mediapipe is a framework that provides multiple computer vision solutions and one of them is pose estimation. It uses the popular BlazePose model for pose estimation. Now let's see the differences between YOLOv7 Pose and Mediapipe. YOLOv7 is a multi-person pose estimation model whereas Mediapipe is for single-person pose estimation only. YOLOv7 has 17 keypoints as compared to 33 keypoints for Mediapipe. The default input size of YOLOv7 is 960P whereas for Mediapipe it is 256 by 256. This means it is trained for small image sizes as well.

YOLOv7 performs detection on every frame, whereas the Mediapipe framework uses a detection plus tracking approach so as to increase the speed as well as provide a more stable output, reducing the jitter. Mediapipe is optimized for CPU and Edge devices, but there is no such optimization done for YOLOv7 Pose. Now, let us see how they compare against each other by running them on some challenging videos. First, we see the results that we get out of the box with the default values. Here, we can see the drastic difference in FPS between Mediapipe and YOLO. This is because the input size of Mediapipe is 256 by 256, whereas for YOLO, it is 960P. This comparison is a little unfair. So, in our next run, we change the input size of YOLO to 256P and get these results. It gives an 8x boost to YOLO but still lags behind Mediapipe in terms of FPS. The next thing

we want to check the amount of jitter or flickering present in the models. For this to be prominent, we zoom in on a particular area of the video and see the results. The difference is evident that there is a lot of flickering in the YOLO results as compared to Mediapipe. Even for the default 960P input size, the YOLO Pose model flickers more than the Mediapipe model. The next comparison is checking for scale variations, like what happens when the person's size varies. We can see that the YOLO model with a small input size of 256 fails to detect the person, but Mediapipe is able to detect the key points. YOLOv7 with a larger input size of 960 detects for some frames but then fails, but Mediapipe continues to detect as it performs tracking. So, if it has detected the person once, it is able to track the key points across frames.

The other common challenge in pose estimation is occlusion. In this specific example of occlusion, Mediapipe is mistaking the horse's legs for human, but YOLOv7 is able to detect the occluded legs as well. But this seemed very uncharacteristic of Mediapipe, so we tested it on some more videos. In this video, we can see that both the models are performing decently well even when only a part of the person is visible. Still, on closer observation, YOLO outputs look better than Mediapipe for occlusion. In case of low lighting conditions, Mediapipe makes more mistakes as compared to YOLOv7, but it is still a close call. Finally, it's time to put them to the extreme test. This video is difficult because the motion is fast and the person is upside down. The YOLOv7 model is not able to keep track of the fact that the person is upside down and is still predicting the points as

if the person was upright. Notice that the blue lines are for the arms and orange lines are for the legs. Mediapipe completely outperforms YOLO in this video for both the input sizes. Now let's summarize the results and look at the key takeaways. Mediapipe cannot be used for multi-person pose estimation, and the discussion ends there if you are looking for a multi-person pose estimation model because Mediapipe is only for single-person pose estimation. Mediapipe has less jitter as compared to YOLO. This can be attributed to the additional tracking step. If you have a GPU and you want very accurate results, use YOLOv7 with a larger image size. If you want a model capable of running at real-time on the CPU, go for Mediapipe. When you need to perform pose estimation on still images, Mediapipe might not be the best option since a big advantage of Mediapipe comes from the detection plus tracking framework. Note

that it has a separate functionality for running pose estimation on images as well. What do you think about the results? We would love to hear your observations as well. I hope you found the video interesting. Do LIKE and SHARE the video and SUBSCRIBE to our Channel. Until next time!

Official YOLOv7 Pose vs MediaPipe | Full comparison of real-time Pose Estimation | Which is Faster?

LearnOpenCV

YOLOv7 포즈는 인기 있는 미디어파이프 모델과 경쟁하는 새로운 인체 자세 추정 모델입니다.

인체 포즈 추정에는 신체의 주요 관절 위치를 예측하는 작업이 포함되며, 일반적인 데이터 세트는 서로 다른 키포인트 토폴로지를 제공합니다.

이 비교는 시청자가 자신의 프로젝트에 적합한 포즈 추정 모델을 선택하는 데 도움을 주기 위한 것으로, 해당 분야에서 사용되는 애플리케이션과 알고리즘을 강조합니다.

욜로 포즈와 미디어파이프: 비교

YOLO 포즈는 오브젝트 키포인트 유사성을 최적화하여 키포인트와 바운딩 박스를 한 번에 감지하므로 여러 사람의 포즈를 빠르고 효율적으로 추정할 수 있습니다.

이 아키텍처는 일반적이어서 YOLOv5에서 YOLOv7로 조정할 수 있습니다.

반면, 미디어파이프는 33개의 키포인트와 256x256의 더 작은 입력 크기를 가진 BlazePose 모델을 사용하여 1인 포즈 추정에 중점을 둡니다.

YOLOv7과 미디어파이프의 탐지 비교

YOLOv7은 모든 프레임에서 감지를 수행하는 반면, 미디어파이프는 더 빠르고 안정적인 출력을 위해 감지 플러스 추적 방식을 사용합니다.

입력 크기 차이로 인해 YOLO의 크기가 줄어든 후에도 Mediapipe가 FPS에서 우위를 점합니다.

또한 미디어파이프는 지터와 깜박임을 줄이는 데 있어서도 YOLO보다 성능이 뛰어나며, 추적 기능을 통해 스케일 변화 중에도 프레임 전반에 걸쳐 주요 지점을 일관되게 감지할 수 있습니다.

포즈 추정을 위한 미디어파이프와 YOLOv7의 비교

폐색은 두 모델 모두에 도전 과제이지만, 폐색된 다리를 감지하는 데는 YOLOv7이 더 나은 성능을 보입니다.

미디어파이프는 어두운 조명 조건에서 어려움을 겪고 실수가 많은 반면, YOLOv7은 거꾸로 누운 사람을 추적하는 데 어려움을 겪습니다.

미디어파이프는 여러 사람의 포즈를 추정하는 데 적합하지 않고 지터가 적으며 실시간 CPU 사용에 이상적인 반면, YOLOv7은 이미지 크기가 클수록 더 정확한 결과를 제공합니다.

이 시스템은 이미지에서 포즈 추정을 실행할 수 있는 뚜렷한 기능을 제공합니다.

결과에 대한 피드백과 관찰을 환영합니다.

이 동영상은 시청자의 참여를 유도하여 좋아요, 공유, 채널 구독을 유도하는 것을 목표로 합니다.