Commit
·
d8cf666
verified
·
0
Parent(s):
squash deepghs/pixai-tagger-v0.9-onnx
Browse files- .gitattributes +35 -0
- README.md +119 -0
- categories.json +10 -0
- meta.json +9 -0
- model.onnx +3 -0
- preprocess.json +30 -0
- sample.webp +0 -0
- selected_tags.csv +0 -0
- thresholds.csv +3 -0
.gitattributes
ADDED
@@ -0,0 +1,35 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
*.7z filter=lfs diff=lfs merge=lfs -text
|
2 |
+
*.arrow filter=lfs diff=lfs merge=lfs -text
|
3 |
+
*.bin filter=lfs diff=lfs merge=lfs -text
|
4 |
+
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
5 |
+
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
6 |
+
*.ftz filter=lfs diff=lfs merge=lfs -text
|
7 |
+
*.gz filter=lfs diff=lfs merge=lfs -text
|
8 |
+
*.h5 filter=lfs diff=lfs merge=lfs -text
|
9 |
+
*.joblib filter=lfs diff=lfs merge=lfs -text
|
10 |
+
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
11 |
+
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
12 |
+
*.model filter=lfs diff=lfs merge=lfs -text
|
13 |
+
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
14 |
+
*.npy filter=lfs diff=lfs merge=lfs -text
|
15 |
+
*.npz filter=lfs diff=lfs merge=lfs -text
|
16 |
+
*.onnx filter=lfs diff=lfs merge=lfs -text
|
17 |
+
*.ot filter=lfs diff=lfs merge=lfs -text
|
18 |
+
*.parquet filter=lfs diff=lfs merge=lfs -text
|
19 |
+
*.pb filter=lfs diff=lfs merge=lfs -text
|
20 |
+
*.pickle filter=lfs diff=lfs merge=lfs -text
|
21 |
+
*.pkl filter=lfs diff=lfs merge=lfs -text
|
22 |
+
*.pt filter=lfs diff=lfs merge=lfs -text
|
23 |
+
*.pth filter=lfs diff=lfs merge=lfs -text
|
24 |
+
*.rar filter=lfs diff=lfs merge=lfs -text
|
25 |
+
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
26 |
+
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
27 |
+
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
28 |
+
*.tar filter=lfs diff=lfs merge=lfs -text
|
29 |
+
*.tflite filter=lfs diff=lfs merge=lfs -text
|
30 |
+
*.tgz filter=lfs diff=lfs merge=lfs -text
|
31 |
+
*.wasm filter=lfs diff=lfs merge=lfs -text
|
32 |
+
*.xz filter=lfs diff=lfs merge=lfs -text
|
33 |
+
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
+
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
+
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
@@ -0,0 +1,119 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
pipeline_tag: image-classification
|
3 |
+
base_model:
|
4 |
+
- pixai-labs/pixai-tagger-v0.9
|
5 |
+
language:
|
6 |
+
- en
|
7 |
+
tags:
|
8 |
+
- image
|
9 |
+
- dghs-imgutils
|
10 |
+
library_name: dghs-imgutils
|
11 |
+
license: apache-2.0
|
12 |
+
---
|
13 |
+
|
14 |
+
# ONNX Version for pixai-labs/pixai-tagger-v0.9
|
15 |
+
|
16 |
+
This is the ONNX-exported version of PixAI's tagger [pixai-labs/pixai-tagger-v0.9](https://huggingface.co/pixai-labs/pixai-tagger-v0.9).
|
17 |
+
|
18 |
+
## Model Details
|
19 |
+
|
20 |
+
- **Model Type:** Multilabel Image classification / feature backbone
|
21 |
+
- **Model Stats:**
|
22 |
+
- Params: 317.9M
|
23 |
+
- FLOPs / MACs: 620.9G / 310.1G
|
24 |
+
- Image size: 448 x 448
|
25 |
+
- Tags Count: 13461
|
26 |
+
- General (#0) Tags Count: 9741
|
27 |
+
- Character (#4) Tags Count: 3720
|
28 |
+
|
29 |
+
## Thresholds
|
30 |
+
|
31 |
+
| Category | Name | Count | Threshold |
|
32 |
+
|-----------:|:----------|--------:|------------:|
|
33 |
+
| 0 | general | 9741 | 0.3 |
|
34 |
+
| 4 | character | 3720 | 0.85 |
|
35 |
+
|
36 |
+
## How to Use
|
37 |
+
|
38 |
+
We provided a sample image for our code samples, you can find it [here](https://huggingface.co/deepghs/pixai-tagger-v0.9-onnx/blob/main/sample.webp).
|
39 |
+
|
40 |
+
Install [dghs-imgutils](https://github.com/deepghs/imgutils) with the following command
|
41 |
+
|
42 |
+
```shell
|
43 |
+
pip install 'dghs-imgutils>=0.19.0' torch huggingface_hub timm pillow pandas
|
44 |
+
```
|
45 |
+
|
46 |
+
You can use function `get_pixai_tags` to tag your image. For more details of this function, see [documentation of imgutils.tagging.pixai](https://dghs-imgutils.deepghs.org/main/api_doc/tagging/pixai.html).
|
47 |
+
|
48 |
+
```python
|
49 |
+
from imgutils.tagging import get_pixai_tags
|
50 |
+
|
51 |
+
general, character, ips, ips_mapping = get_pixai_tags(
|
52 |
+
'https://huggingface.co/deepghs/pixai-tagger-v0.9-onnx/resolve/main/sample.webp',
|
53 |
+
model_name='v0.9',
|
54 |
+
fmt=('general', 'character', 'ips', 'ips_mapping'),
|
55 |
+
)
|
56 |
+
|
57 |
+
print(general)
|
58 |
+
# {'symbol-shaped_pupils': 0.9940369129180908,
|
59 |
+
# 'ghost': 0.9908503890037537,
|
60 |
+
# 'flower-shaped_pupils': 0.9783934354782104,
|
61 |
+
# 'black_nails': 0.9721313118934631,
|
62 |
+
# 'porkpie_hat': 0.964271068572998,
|
63 |
+
# 'ghost_pose': 0.9570443630218506,
|
64 |
+
# 'ring': 0.9521543979644775,
|
65 |
+
# '1girl': 0.9491472244262695,
|
66 |
+
# 'hat': 0.9321512579917908,
|
67 |
+
# 'hat_flower': 0.9310178756713867,
|
68 |
+
# 'flower': 0.9181427955627441,
|
69 |
+
# 'plum_blossoms': 0.8758766651153564,
|
70 |
+
# 'red_shirt': 0.8587117195129395,
|
71 |
+
# 'jewelry': 0.8488669395446777,
|
72 |
+
# 'chinese_clothes': 0.8235750198364258,
|
73 |
+
# 'claw_pose': 0.8184436559677124,
|
74 |
+
# 'long_sleeves': 0.8045806884765625,
|
75 |
+
# 'twintails': 0.7922596335411072,
|
76 |
+
# 'hat_tassel': 0.7861523628234863,
|
77 |
+
# 'long_hair': 0.7857427597045898,
|
78 |
+
# 'looking_at_viewer': 0.7703293561935425,
|
79 |
+
# 'multiple_rings': 0.7530679106712341,
|
80 |
+
# 'signature': 0.7448598146438599,
|
81 |
+
# 'smile': 0.7411079406738281,
|
82 |
+
# 'open_mouth': 0.7243687510490417,
|
83 |
+
# 'red_flower': 0.6929515600204468,
|
84 |
+
# 'solo': 0.6898764371871948,
|
85 |
+
# 'hat_ornament': 0.6630162000656128,
|
86 |
+
# 'red_eyes': 0.6534468531608582,
|
87 |
+
# 'black_hat': 0.6130237579345703,
|
88 |
+
# 'nail_polish': 0.600890576839447,
|
89 |
+
# 'brown_coat': 0.5587427616119385,
|
90 |
+
# 'coat': 0.5543128848075867,
|
91 |
+
# 'upper_body': 0.5307736396789551,
|
92 |
+
# 'thumb_ring': 0.5169675350189209,
|
93 |
+
# 'brown_hair': 0.5059547424316406,
|
94 |
+
# 'star_(symbol)': 0.48425528407096863,
|
95 |
+
# 'star-shaped_pupils': 0.46570321917533875,
|
96 |
+
# 'shirt': 0.44571059942245483,
|
97 |
+
# 'hair_between_eyes': 0.4336400330066681,
|
98 |
+
# ':d': 0.40481746196746826,
|
99 |
+
# 'orange_eyes': 0.3937417268753052,
|
100 |
+
# ':3': 0.38414278626441956,
|
101 |
+
# 'tangzhuang': 0.37281090021133423,
|
102 |
+
# 'blush': 0.36003637313842773,
|
103 |
+
# 'sidelocks': 0.3363075256347656,
|
104 |
+
# 'v-shaped_eyebrows': 0.3265596628189087,
|
105 |
+
# 'blurry': 0.30306869745254517}
|
106 |
+
|
107 |
+
print(character)
|
108 |
+
# {'hu_tao_(genshin_impact)': 0.9999701380729675,
|
109 |
+
# 'boo_tao_(genshin_impact)': 0.9996192455291748}
|
110 |
+
|
111 |
+
print(ips)
|
112 |
+
# ['genshin_impact']
|
113 |
+
|
114 |
+
print(ips_mapping)
|
115 |
+
# {'hu_tao_(genshin_impact)': ['genshin_impact'],
|
116 |
+
# 'boo_tao_(genshin_impact)': ['genshin_impact']}
|
117 |
+
|
118 |
+
```
|
119 |
+
|
categories.json
ADDED
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
[
|
2 |
+
{
|
3 |
+
"category": 0,
|
4 |
+
"name": "general"
|
5 |
+
},
|
6 |
+
{
|
7 |
+
"category": 4,
|
8 |
+
"name": "character"
|
9 |
+
}
|
10 |
+
]
|
meta.json
ADDED
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
"flops": 620895108000,
|
3 |
+
"input_size": 448,
|
4 |
+
"macs": 310119601152,
|
5 |
+
"num_classes": 13461,
|
6 |
+
"num_features": 1024,
|
7 |
+
"params": 317852757,
|
8 |
+
"repo_id": "pixai-labs/pixai-tagger-v0.9"
|
9 |
+
}
|
model.onnx
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a8d479098b5e23f253543c93df42391736abbb77c21c2efd3a513b9cda7b3657
|
3 |
+
size 1271365854
|
preprocess.json
ADDED
@@ -0,0 +1,30 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
"stages": [
|
3 |
+
{
|
4 |
+
"antialias": null,
|
5 |
+
"interpolation": "bilinear",
|
6 |
+
"max_size": null,
|
7 |
+
"size": [
|
8 |
+
448,
|
9 |
+
448
|
10 |
+
],
|
11 |
+
"type": "resize"
|
12 |
+
},
|
13 |
+
{
|
14 |
+
"type": "to_tensor"
|
15 |
+
},
|
16 |
+
{
|
17 |
+
"mean": [
|
18 |
+
0.5,
|
19 |
+
0.5,
|
20 |
+
0.5
|
21 |
+
],
|
22 |
+
"std": [
|
23 |
+
0.5,
|
24 |
+
0.5,
|
25 |
+
0.5
|
26 |
+
],
|
27 |
+
"type": "normalize"
|
28 |
+
}
|
29 |
+
]
|
30 |
+
}
|
sample.webp
ADDED
![]() |
selected_tags.csv
ADDED
The diff for this file is too large to render.
See raw diff
|
|
thresholds.csv
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
category,name,threshold
|
2 |
+
0,general,0.3
|
3 |
+
4,character,0.85
|