Add library_name and pipeline_tag to metadata (#1)
Browse files- Add library_name and pipeline_tag to metadata (0bd84002402beae5f44778deb57f07378ab6b121)
Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>
README.md
CHANGED
@@ -1,8 +1,10 @@
|
|
1 |
---
|
2 |
-
license: apache-2.0
|
3 |
language:
|
4 |
- it
|
5 |
- en
|
|
|
|
|
|
|
6 |
---
|
7 |
|
8 |
# Llama-3.1-8B-Italian-FVT
|
@@ -14,9 +16,9 @@ language:
|
|
14 |
|
15 |
The **Llama-3.1-8B-Adapted** collection of large language models (LLMs), is a collection of adapted generative models in 8B (text in/text out), adapted models from **Llama-3.1-8B**.
|
16 |
|
17 |
-
*Llama-3.1-8B-Italian-FVT* is a
|
18 |
|
19 |
-
The tokenizer of this
|
20 |
|
21 |
**Model developer:** SapienzaNLP, ISTI-CNR, ILC-CNR
|
22 |
|
@@ -24,15 +26,15 @@ The tokenizer of this models after adaptation is the same of [Minverva-3B](https
|
|
24 |
|
25 |
## Data used for the adaptation
|
26 |
|
27 |
-
The **Mistral-7B-v0.1-Adapted** model
|
28 |
-
The data
|
29 |
|
30 |
|
31 |
## Use with Transformers
|
32 |
|
33 |
You can run conversational inference using the Transformers pipeline abstraction or by leveraging the Auto classes with the generate() function.
|
34 |
|
35 |
-
Make sure to update your transformers installation via pip install --upgrade transformers
|
36 |
|
37 |
```python
|
38 |
import transformers
|
|
|
1 |
---
|
|
|
2 |
language:
|
3 |
- it
|
4 |
- en
|
5 |
+
license: apache-2.0
|
6 |
+
library_name: transformers
|
7 |
+
pipeline_tag: text-generation
|
8 |
---
|
9 |
|
10 |
# Llama-3.1-8B-Italian-FVT
|
|
|
16 |
|
17 |
The **Llama-3.1-8B-Adapted** collection of large language models (LLMs), is a collection of adapted generative models in 8B (text in/text out), adapted models from **Llama-3.1-8B**.
|
18 |
|
19 |
+
*Llama-3.1-8B-Italian-FVT* is a continually trained Mistral model, after tokenizer substitution.
|
20 |
|
21 |
+
The tokenizer of this model after adaptation is the same as [Minverva-3B](https://huggingface.co/sapienzanlp/Minerva-3B-base-v1.0).
|
22 |
|
23 |
**Model developer:** SapienzaNLP, ISTI-CNR, ILC-CNR
|
24 |
|
|
|
26 |
|
27 |
## Data used for the adaptation
|
28 |
|
29 |
+
The **Mistral-7B-v0.1-Adapted** model was trained on a collection of Italian and English data extracted from [CulturaX](https://huggingface.co/datasets/uonlp/CulturaX).
|
30 |
+
The data was extracted to be skewed toward Italian language with a ratio of one over four. Extracting the first 9B tokens from the Italian part of CulturaX and the first 3B tokens from the English part of CulturaX.
|
31 |
|
32 |
|
33 |
## Use with Transformers
|
34 |
|
35 |
You can run conversational inference using the Transformers pipeline abstraction or by leveraging the Auto classes with the generate() function.
|
36 |
|
37 |
+
Make sure to update your transformers installation via `pip install --upgrade transformers`.
|
38 |
|
39 |
```python
|
40 |
import transformers
|