PLB commited on
Commit
7702a2c
·
1 Parent(s): ca7255e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -1
README.md CHANGED
@@ -4,4 +4,17 @@ license: apache-2.0
4
 
5
  # Mistral 7B V0.1
6
 
7
- Implementation of Mistral 7B model by the *phospho* team.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
 
5
  # Mistral 7B V0.1
6
 
7
+ Implementation of Mistral 7B model by the *phospho* team. You can test it directly in the HuggingFace space.
8
+
9
+ ## Use in transformers
10
+
11
+ ```python
12
+ import torch
13
+ from transformers import LlamaForCausalLM, LlamaTokenizer, pipeline, TextStreamer
14
+
15
+ tokenizer = LlamaTokenizer.from_pretrained("phospho-app/mistral_7b_V0.1")
16
+ model = LlamaForCausalLM.from_pretrained("phospho-app/mistral_7b_V0.1", torch_dtype=torch.bfloat16)
17
+
18
+ pipe = pipeline("text-generation", model=model, tokenizer=tokenizer)
19
+ ```
20
+