ArthurMalajyan commited on
Commit
e26a0b2
·
verified ·
1 Parent(s): 97fc5e5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -1
README.md CHANGED
@@ -6,4 +6,30 @@ datasets:
6
  - mozilla-foundation/common_voice_16_1
7
  - google/fleurs
8
  - ReRooted
9
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  - mozilla-foundation/common_voice_16_1
7
  - google/fleurs
8
  - ReRooted
9
+ ---
10
+
11
+ # SeamlessM4T v2 ASR for Western Armenian
12
+
13
+ This model is a fine-tuned version of the [facebook/seamless-m4t-v2-large](https://huggingface.co/facebook/seamless-m4t-v2-large). Initially, it was fine-tuned on the Common Voice 16.1 and Google Fleurs datasets. Subsequently, it was further fine-tuned on the [ReRooted](https://github.com/jhdeov/ReRooted-ArmenianCorpus) corpus.
14
+ The model achieves the following results on the test sets:
15
+ - CV_wer: 0.308
16
+ - CV_cer: 0.07
17
+ - GF_wer: 0.311
18
+ - GF_cer: 0.094
19
+
20
+ After fine-tuning on Western Armenian data, the model occasionally translates Eastern Armenian speech into Western Armenian.
21
+
22
+ ### Training hyperparameters
23
+
24
+ The following hyperparameters were used during training:
25
+ - learning_rate: 1e-6
26
+ - train_batch_size: 4
27
+ - eval_batch_size: 1
28
+ - seed: 43
29
+ - optimizer: Adam with betas=(0.9, 0.98) and epsilon=1e-08
30
+ - lr_scheduler_type: MyleLR
31
+ - lr_scheduler_warmup_steps: 100
32
+
33
+ ### Framework versions
34
+ - Pytorch 2.1.1
35
+ - fairseq2==0.2.0