Hugging Face's logo

STMicroelectronics
/
movenet

Keypoint Detection
Model card Files Community
FBAGSTM commited on
Commit
3c28ab1
·
verified ·
1 Parent(s): 60b6753

Update Readme ST Model Zoo

Browse files
Files changed (1) hide show
  1. README.md +19 -27
README.md CHANGED
@@ -1,10 +1,3 @@
1
- ---
2
- license: other
3
- license_name: sla0044
4
- license_link: >-
5
- https://github.com/STMicroelectronics/stm32aimodelzoo/pose_estimation/LICENSE.md
6
- pipeline_tag: keypoint-detection
7
- ---
8
  # MoveNet quantized
9
 
10
  ## **Use case** : `Pose estimation`
@@ -74,34 +67,34 @@ Measures are done with default STM32Cube.AI configuration with enabled input / o
74
  ### Reference **NPU** memory footprint based on COCO Person dataset (see Accuracy for details on dataset)
75
  |Model | Dataset | Format | Resolution | Series | Internal RAM (KiB)| External RAM (KiB) | Weights Flash (KiB) | STM32Cube.AI version | STEdgeAI Core version |
76
  |----------|------------------|--------|-------------|------------------|------------------|---------------------|-------|----------------------|-------------------------|
77
- | [ST MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/ST_pretrainedmodel_public_dataset/custom_dataset_person_13kpts/st_movenet_lightning_heatmaps_192/st_movenet_lightning_heatmaps_192_int8_pc.tflite) | COCO-Person | Int8 | 192x192x3 | STM32N6 | 1674 | 0.0 | 3036.17 | 10.0.0 | 2.0.0 |
78
- | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_192/movenet_lightning_heatmaps_192_int8_pc.tflite) | COCO-Person | Int8 | 192x192x3 | STM32N6 | 1674 | 0.0 | 3036.41 | 10.0.0 | 2.0.0 |
79
- | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_224/movenet_lightning_heatmaps_224_int8_pc.tflite) | COCO-Person | Int8 | 224x224x3 | STM32N6 | 2058 | 0.0 | 3088.56 | 10.0.0 | 2.0.0 |
80
- | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_256/movenet_lightning_heatmaps_256_int8_pc.tflite) | COCO-Person | Int8 | 256x256x3 | STM32N6 | 2360 | 0.0 | 3141.36 | 10.0.0 | 2.0.0 |
81
 
82
 
83
  ### Reference **NPU** inference time based on COCO Person dataset (see Accuracy for details on dataset)
84
  | Model | Dataset | Format | Resolution | Board | Execution Engine | Inference time (ms) | Inf / sec | STM32Cube.AI version | STEdgeAI Core version |
85
  |--------|------------------|--------|-------------|------------------|------------------|---------------------|-------|----------------------|-------------------------|
86
- | [ST MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/ST_pretrainedmodel_public_dataset/custom_dataset_person_13kpts/st_movenet_lightning_heatmaps_192/st_movenet_lightning_heatmaps_192_int8_pc.tflite) | COCO-Person | Int8 | 192x192x3 | STM32N6570-DK | NPU/MCU | 18.44 | 54.23 | 10.0.0 | 2.0.0 |
87
- | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_192/movenet_lightning_heatmaps_192_int8_pc.tflite) | COCO-Person | Int8 | 192x192x3 | STM32N6570-DK | NPU/MCU | 18.49 | 54.08 | 10.0.0 | 2.0.0 |
88
- | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_224/movenet_lightning_heatmaps_224_int8_pc.tflite) | COCO-Person | Int8 | 224x224x3 | STM32N6570-DK | NPU/MCU | 22.33 | 44.78 | 10.0.0 | 2.0.0 |
89
- | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_256/movenet_lightning_heatmaps_256_int8_pc.tflite) | COCO-Person | Int8 | 256x256x3 | STM32N6570-DK | NPU/MCU | 27.01 | 37.03 | 10.0.0 | 2.0.0 |
90
 
91
 
92
  ### Reference **MPU** inference time based on COCO Person dataset (see Accuracy for details on dataset)
93
  | Model | Format | Resolution | Quantization | Board | Execution Engine | Frequency | Inference time (ms) | %NPU | %GPU | %CPU | X-LINUX-AI version | Framework |
94
  |--------------------------------------------------------------------------------------------------------------------------------------------------------------------|--------|------------|---------------|-------------------|------------------|-----------|---------------------|-------|-------|------|--------------------|-----------------------|
95
- | [ST MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/ST_pretrainedmodel_public_dataset/custom_dataset_person_13kpts/st_movenet_lightning_heatmaps_192/st_movenet_lightning_heatmaps_192_int8_pc.tflite) | Int8 | 192x192x3 | per-channel** | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 58.02 ms | 3.75 | 96.25 |0 | v5.0.0 | OpenVX |
96
- | [ST MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/ST_pretrainedmodel_public_dataset/custom_dataset_person_13kpts/st_movenet_lightning_heatmaps_192/st_movenet_lightning_heatmaps_192_int8_pt.tflite) | Int8 | 192x192x3 | per-tensor | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 7.93 ms | 84.89 | 15.11 |0 | v5.0.0 | OpenVX |
97
- | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_192/movenet_lightning_heatmaps_192_int8_pc.tflite) | Int8 | 192x192x3 | per-channel** | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 58.17 ms | 3.80 | 96.20 |0 | v5.0.0 | OpenVX |
98
- | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_192/movenet_lightning_heatmaps_192_int8_pt.tflite) | Int8 | 192x192x3 | per-tensor | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 8.00 ms | 86.48 | 13.52 |0 | v5.0.0 | OpenVX |
99
- | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_224/movenet_lightning_heatmaps_224_int8_pc.tflite) | Int8 | 224x224x3 | per-channel** | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 81.65 ms | 2.77 | 97.23 |0 | v5.0.0 | OpenVX |
100
- | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_224/movenet_lightning_heatmaps_224_int8_pt.tflite) | Int8 | 224x224x3 | per-tensor | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 11.55 ms | 87.04 | 12.96 |0 | v5.0.0 | OpenVX |
101
- | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_256/movenet_lightning_heatmaps_256_int8_pc.tflite) | Int8 | 256x256x3 | per-channel** | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 70.57 ms | 3.74 | 96.26 |0 | v5.0.0 | OpenVX |
102
- | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_256/movenet_lightning_heatmaps_256_int8_pc.tflite) | Int8 | 256x256x3 | per-tensor | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 12.90 ms | 86.33 | 13.67 |0 | v5.0.0 | OpenVX |
103
- | [MoveNet Lightning](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_192/movenet_singlepose_lightning_192_int8.tflite) | Int8 | 192x192x3 | per-channel** | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 66.97 ms | 6.72 | 93.28 |0 | v5.0.0 | OpenVX
104
- | [MoveNet Thunder](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_thunder_256/movenet_singlepose_thunder_256_int8.tflite) | Int8 | 256x256x3 | per-channel** | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 187.1 ms | 3.96 | 96.04 |0 | v5.0.0 | OpenVX |
105
 
106
  ** **To get the most out of MP25 NPU hardware acceleration, please use per-tensor quantization**
107
 
@@ -157,5 +150,4 @@ Please refer to the stm32ai-modelzoo-services GitHub [here](https://github.com/S
157
  timestamp = {Mon, 13 Aug 2018 16:48:13 +0200},
158
  biburl = {https://dblp.org/rec/bib/journals/corr/LinMBHPRDZ14},
159
  bibsource = {dblp computer science bibliography, https://dblp.org}
160
- }
161
-
 
 
 
 
 
 
 
 
1
  # MoveNet quantized
2
 
3
  ## **Use case** : `Pose estimation`
 
67
  ### Reference **NPU** memory footprint based on COCO Person dataset (see Accuracy for details on dataset)
68
  |Model | Dataset | Format | Resolution | Series | Internal RAM (KiB)| External RAM (KiB) | Weights Flash (KiB) | STM32Cube.AI version | STEdgeAI Core version |
69
  |----------|------------------|--------|-------------|------------------|------------------|---------------------|-------|----------------------|-------------------------|
70
+ | [ST MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/ST_pretrainedmodel_public_dataset/custom_dataset_person_13kpts/st_movenet_lightning_heatmaps_192/st_movenet_lightning_heatmaps_192_int8_pc.tflite) | COCO-Person | Int8 | 192x192x3 | STM32N6 | 1674 | 0.0 | 3036.17 | 10.2.0 | 2.2.0 |
71
+ | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_192/movenet_lightning_heatmaps_192_int8_pc.tflite) | COCO-Person | Int8 | 192x192x3 | STM32N6 | 1674 | 0.0 | 3036.41 | 10.2.0 | 2.2.0 |
72
+ | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_224/movenet_lightning_heatmaps_224_int8_pc.tflite) | COCO-Person | Int8 | 224x224x3 | STM32N6 | 2058 | 0.0 | 3088.56 | 10.2.0 | 2.2.0 |
73
+ | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_256/movenet_lightning_heatmaps_256_int8_pc.tflite) | COCO-Person | Int8 | 256x256x3 | STM32N6 | 2360 | 0.0 | 3141.36 | 10.2.0 | 2.2.0 |
74
 
75
 
76
  ### Reference **NPU** inference time based on COCO Person dataset (see Accuracy for details on dataset)
77
  | Model | Dataset | Format | Resolution | Board | Execution Engine | Inference time (ms) | Inf / sec | STM32Cube.AI version | STEdgeAI Core version |
78
  |--------|------------------|--------|-------------|------------------|------------------|---------------------|-------|----------------------|-------------------------|
79
+ | [ST MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/ST_pretrainedmodel_public_dataset/custom_dataset_person_13kpts/st_movenet_lightning_heatmaps_192/st_movenet_lightning_heatmaps_192_int8_pc.tflite) | COCO-Person | Int8 | 192x192x3 | STM32N6570-DK | NPU/MCU | 18.44 | 54.23 | 10.2.0 | 2.2.0 |
80
+ | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_192/movenet_lightning_heatmaps_192_int8_pc.tflite) | COCO-Person | Int8 | 192x192x3 | STM32N6570-DK | NPU/MCU | 18.49 | 54.08 | 10.2.0 | 2.2.0 |
81
+ | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_224/movenet_lightning_heatmaps_224_int8_pc.tflite) | COCO-Person | Int8 | 224x224x3 | STM32N6570-DK | NPU/MCU | 22.33 | 44.78 | 10.2.0 | 2.2.0 |
82
+ | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_256/movenet_lightning_heatmaps_256_int8_pc.tflite) | COCO-Person | Int8 | 256x256x3 | STM32N6570-DK | NPU/MCU | 27.01 | 37.03 | 10.2.0 | 2.2.0 |
83
 
84
 
85
  ### Reference **MPU** inference time based on COCO Person dataset (see Accuracy for details on dataset)
86
  | Model | Format | Resolution | Quantization | Board | Execution Engine | Frequency | Inference time (ms) | %NPU | %GPU | %CPU | X-LINUX-AI version | Framework |
87
  |--------------------------------------------------------------------------------------------------------------------------------------------------------------------|--------|------------|---------------|-------------------|------------------|-----------|---------------------|-------|-------|------|--------------------|-----------------------|
88
+ | [ST MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/ST_pretrainedmodel_public_dataset/custom_dataset_person_13kpts/st_movenet_lightning_heatmaps_192/st_movenet_lightning_heatmaps_192_int8_pc.tflite) | Int8 | 192x192x3 | per-channel** | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 55.74 ms | 3.56 | 96.44 |0 | v6.1.0 | OpenVX |
89
+ | [ST MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/ST_pretrainedmodel_public_dataset/custom_dataset_person_13kpts/st_movenet_lightning_heatmaps_192/st_movenet_lightning_heatmaps_192_int8_pt.tflite) | Int8 | 192x192x3 | per-tensor | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 7.82 ms | 84.47 | 14.53 |0 | v6.1.0 | OpenVX |
90
+ | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_192/movenet_lightning_heatmaps_192_int8_pc.tflite) | Int8 | 192x192x3 | per-channel** | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 55.74 ms | 3.58 | 96.42 |0 | v6.1.0 | OpenVX |
91
+ | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_192/movenet_lightning_heatmaps_192_int8_pt.tflite) | Int8 | 192x192x3 | per-tensor | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 8.17 ms | 86.37 | 13.63 |0 | v6.1.0 | OpenVX |
92
+ | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_224/movenet_lightning_heatmaps_224_int8_pc.tflite) | Int8 | 224x224x3 | per-channel** | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 79.14 ms | 3.17 | 96.83 |0 | v6.1.0 | OpenVX |
93
+ | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_224/movenet_lightning_heatmaps_224_int8_pt.tflite) | Int8 | 224x224x3 | per-tensor | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 11.26 ms | 86.76 | 13.24 |0 | v6.1.0 | OpenVX |
94
+ | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_256/movenet_lightning_heatmaps_256_int8_pc.tflite) | Int8 | 256x256x3 | per-channel** | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 68.02 ms | 3.54 | 96.46 |0 | v6.1.0 | OpenVX |
95
+ | [MoveNet Lightning heatmaps](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_heatmaps_256/movenet_lightning_heatmaps_256_int8_pc.tflite) | Int8 | 256x256x3 | per-tensor | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 12.90 ms | 86.33 | 13.67 |0 | v6.1.0 | OpenVX |
96
+ | [MoveNet Lightning](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_lightning_192/movenet_singlepose_lightning_192_int8.tflite) | Int8 | 192x192x3 | per-channel** | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 64.2 ms | 6.83 | 93.17 |0 | v6.1.0 | OpenVX
97
+ | [MoveNet Thunder](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/pose_estimation/movenet/Public_pretrainedmodel_custom_dataset/custom_dataset_person_17kpts/movenet_thunder_256/movenet_singlepose_thunder_256_int8.tflite) | Int8 | 256x256x3 | per-channel** | STM32MP257F-DK2 | NPU/GPU | 800 MHz | 183.82 ms | 3.43 | 96.57 |0 | v6.1.0 | OpenVX |
98
 
99
  ** **To get the most out of MP25 NPU hardware acceleration, please use per-tensor quantization**
100
 
 
150
  timestamp = {Mon, 13 Aug 2018 16:48:13 +0200},
151
  biburl = {https://dblp.org/rec/bib/journals/corr/LinMBHPRDZ14},
152
  bibsource = {dblp computer science bibliography, https://dblp.org}
153
+ }