zpn commited on
Commit
141336b
·
verified ·
1 Parent(s): d70d99b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -9
README.md CHANGED
@@ -30,15 +30,15 @@ tags:
30
 
31
  ## Performance
32
 
33
- | Model | Avg. | ESG Restaurant Human | Econ Macro Multi. | AXA Multi. | MIT Bio | ESG Restaur Synth |
34
- |-------|------|----------------------|-------------------|------------|---------|-------------------|
35
- | ColNomic Embed Multimodal 7B (Multi-Vector) | 61.6 | 67.1 | 54.9 | 59.7 | 66.1 | 58.1 |
36
- | **ColNomic Embed Multimodal 3B (Multi-Vector)** | 61.2 | 65.8 | 55.4 | 61.0 | 63.5 | 56.6 |
37
- | T-Systems ColQwen2.5-3B | 59.9 | 72.1 | 51.2 | 60.0 | 65.3 | 51.7 |
38
- | Nomic Embed Multimodal 7B (Dense) | 59.7 | 65.7 | 57.7 | 59.3 | 64.0 | 49.2 |
39
- | Nomic Embed Multimodal 3B (Dense) | 58.8 | 59.8 | 57.5 | 58.8 | 62.5 | 49.4 |
40
- | Llama Index vdr-2b-multi-v1 | 58.4 | 63.1 | 52.8 | 61.0 | 60.6 | 50.3 |
41
- | Voyage Multimodal 3 | 55.0 | 56.1 | 55.0 | 59.5 | 56.4 | 47.2 |
42
 
43
  ## Model Architecture
44
 
 
30
 
31
  ## Performance
32
 
33
+ | Model | Avg. | ESG Restaurant Human | Econ Macro Multi. | AXA Multi. | MIT Bio | ESG Restaurant Synth. | ESG Restaurant Synth. Multi. | MIT Bio Multi. | AXA | Econ. Macro |
34
+ |-------|------|----------------------|-------------------|------------|---------|----------------------|----------------------------|---------------|-----|------------|
35
+ | ColNomic Embed Multimodal 7B | 61.6 | 67.1 | 54.9 | 59.7 | 66.1 | 58.1 | 56.9 | 64.3 | 67.4 | 59.6 |
36
+ | **ColNomic Embed Multimodal 3B** | 61.2 | 65.8 | 55.4 | 61.0 | 63.5 | 56.6 | 57.2 | 62.5 | 68.8 | 60.2 |
37
+ | T-Systems ColQwen2.5-3B | 59.9 | 72.1 | 51.2 | 60.0 | 65.3 | 51.7 | 53.3 | 61.7 | 69.3 | 54.8 |
38
+ | Nomic Embed Multimodal 7B | 59.7 | 65.7 | 57.7 | 59.3 | 64.0 | 49.2 | 51.9 | 61.2 | 66.3 | 63.1 |
39
+ | Nomic Embed Multimodal 3B | 58.8 | 59.8 | 57.5 | 58.8 | 62.5 | 49.4 | 49.4 | 58.6 | 69.6 | 63.5 |
40
+ | Llama Index vdr-2b-multi-v1 | 58.4 | 63.1 | 52.8 | 61.0 | 60.6 | 50.3 | 51.2 | 56.9 | 68.8 | 61.2 |
41
+ | Voyage Multimodal 3 | 55.0 | 56.1 | 55.0 | 59.5 | 56.4 | 47.2 | 46.2 | 51.5 | 64.1 | 58.8 |
42
 
43
  ## Model Architecture
44