Hot 3D 人体姿态估计 HPE Demo复现过程

视频讲授

   Hot 3D 人体姿态估计 HPE Demo复现过程

• 标题：Hourglass Tokenizer for Efficient Transformer-Based 3D Human Pose Estimation
  
• 论文所在：https://arxiv.org/abs/2311.12028
  
• 代码所在：https://github.com/NationalGAILab/HoT
  

利用conda举行情况准备

1. conda create -n hot python=3.9
2. conda activate hot
3. pip3 install -r requirements.txt -i https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple

复制代码

下载human3.6M dataset
https://drive.google.com/file/d/1FMgAf_I04GlweHMfgUKzB0CMwglxuwPe/view
解压后把npz放进./data文件夹下
下载pretrained-model
https://drive.google.com/drive/folders/1Mr00vyPXMnAX2lA4r1r2L3nR1bR4wvoN

下载YOLOv3 and HRNet pretrained models
https://drive.google.com/drive/folders/1_ENAMOsPM7FXmdYRbkwbFHgzQq_B_NQA
放到./demo/lib/checkpoint
三个地方的文件下载完成后，如下图的目次

跑一下demo

1. python demo/vis.py --video sample_video.mp4

复制代码

报错

1. python demo/vis.py --video sample_video.mp4
2. A module that was compiled using NumPy 1.x cannot be run in
3. NumPy 2.0.2 as it may crash. To support both 1.x and 2.x
4. versions of NumPy, modules must be compiled with NumPy 2.0.
5. Some module may need to rebuild instead e.g. with 'pybind11>=2.12'.
6. If you are a user of the module, the easiest solution will be to
7. downgrade to 'numpy<2' or try to upgrade the affected module.
8. We expect that some modules will need time to support NumPy 2.
9. Traceback (most recent call last):  File "/home/dar/model/HoT/demo/vis.py", line 15, in <module>
10. import matplotlib
11. File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/__init__.py", line 131, in <module>
12. from . import _api, _version, cbook, _docstring, rcsetup
13. File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/rcsetup.py", line 27, in <module>
14. from matplotlib.colors import Colormap, is_color_like
15. File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/colors.py", line 56, in <module>
16. from matplotlib import _api, _cm, cbook, scale
17. File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/scale.py", line 22, in <module>
18. from matplotlib.ticker import (
19. File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/ticker.py", line 138, in <module>
20. from matplotlib import transforms as mtransforms
21. File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/transforms.py", line 49, in <module>
22. from matplotlib._path import (
23. AttributeError: _ARRAY_API not found
24. Traceback (most recent call last):
25. File "/home/dar/model/HoT/demo/vis.py", line 15, in <module>
26. import matplotlib
27. File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/__init__.py", line 131, in <module>
28. from . import _api, _version, cbook, _docstring, rcsetup
29. File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/rcsetup.py", line 27, in <module>
30. from matplotlib.colors import Colormap, is_color_like
31. File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/colors.py", line 56, in <module>
32. from matplotlib import _api, _cm, cbook, scale
33. File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/scale.py", line 22, in <module>
34. from matplotlib.ticker import (
35. File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/ticker.py", line 138, in <module>
36. from matplotlib import transforms as mtransforms
37. File "/home/dar/miniconda3/envs/hot/lib/python3.9/site-packages/matplotlib/transforms.py", line 49, in <module>
38. from matplotlib._path import (
39. ImportError: numpy.core.multiarray failed to import

复制代码

利用  conda update matplotlib 办理

再运行一次，天生的视频，3d pose 2d pose都在output目次下