shleeeee commited on
Commit
015fbbe
·
1 Parent(s): 8975158

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +36 -0
README.md ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - ko
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - finetune
7
+ ---
8
+ # Model Card for mistral-7b-wiki
9
+ It is a fine-tuned model using Korean in the mistral-7b model
10
+
11
+ ## Model Details
12
+
13
+ * **Model Developers** : shleeeee(Seunghyeon Lee)
14
+ * **Repository** : To be added
15
+ * **Model Architecture** : The mistral-7b-wiki is is a fine-tuned version of the Mistral-7B-v0.1.
16
+ * **Lora target modules** : q_proj, k_proj, v_proj, o_proj,gate_proj
17
+
18
+ ## Dataset
19
+ Korean Custom Dataset
20
+
21
+ ## Prompt template: Mistral
22
+ ```
23
+ <s>[INST]{['instruction']}[/INST]{['output']}</s>
24
+ ```
25
+
26
+ ## Usage
27
+ ```
28
+ from transformers import AutoTokenizer, AutoModelForCausalLM
29
+
30
+ model_name='davidkim205/komt-mistral-7b-v1'
31
+ model = AutoModelForCausalLM.from_pretrained(model_name)
32
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
33
+ ```
34
+
35
+ ## Evaluation
36
+ - To be added