Update README.md
Browse files
README.md
CHANGED
@@ -8,10 +8,10 @@ language:
|
|
8 |
---
|
9 |
## JGLUE Score
|
10 |
I evaluated this model using the following JGLUE tasks. Here are the scores:
|
11 |
-
| Task | Llama-2-7b-hf | Llama-2-
|
12 |
|---------------------|:-----------------:|:-----------------:|:----------:|
|
13 |
| JCOMMONSENSEQA(acc) | 51.56 | 75.06 | 75.78 |
|
14 |
-
| JNLI(acc) | 29.74 |
|
15 |
| MARC_JA(acc) | 85.72 | - | 79.64 |
|
16 |
| JSQUAD(exact_match) | 64.16 | 76.13 | 62.83 |
|
17 |
| **Average** | **57.79** | **-** | **67.23** |
|
|
|
8 |
---
|
9 |
## JGLUE Score
|
10 |
I evaluated this model using the following JGLUE tasks. Here are the scores:
|
11 |
+
| Task | Llama-2-7b-hf | Llama-2-13b-hf | This Model |
|
12 |
|---------------------|:-----------------:|:-----------------:|:----------:|
|
13 |
| JCOMMONSENSEQA(acc) | 51.56 | 75.06 | 75.78 |
|
14 |
+
| JNLI(acc) | 29.74 | 22.18 | 50.69 |
|
15 |
| MARC_JA(acc) | 85.72 | - | 79.64 |
|
16 |
| JSQUAD(exact_match) | 64.16 | 76.13 | 62.83 |
|
17 |
| **Average** | **57.79** | **-** | **67.23** |
|