Hugging Face's logo

qgallouedec
/
Qwen-2.5-7B-Simple-RL

Text Generation
Transformers
Safetensors
qwen2
Generated from Trainer
open-r1
trl
grpo
conversational
text-generation-inference
Model card Files Community
qgallouedec HF Staff commited on
Commit
4f4b3f7
·
verified ·
1 Parent(s): d955d87

Model save

Browse files
Files changed (10) hide show
  1. README.md +2 -4
  2. all_results.json +4 -4
  3. config.json +1 -1
  4. model-00001-of-00004.safetensors +1 -1
  5. model-00002-of-00004.safetensors +1 -1
  6. model-00003-of-00004.safetensors +1 -1
  7. model-00004-of-00004.safetensors +1 -1
  8. train_results.json +4 -4
  9. trainer_state.json +0 -0
  10. training_args.bin +1 -1
README.md CHANGED
@@ -1,11 +1,9 @@
1
  ---
2
  base_model: Qwen/Qwen2.5-Math-7B
3
- datasets: DigitalLearningGmbH/MATH-lighteval
4
  library_name: transformers
5
  model_name: Qwen-2.5-7B-Simple-RL
6
  tags:
7
  - generated_from_trainer
8
- - open-r1
9
  - trl
10
  - grpo
11
  licence: license
@@ -13,7 +11,7 @@ licence: license
13
 
14
  # Model Card for Qwen-2.5-7B-Simple-RL
15
 
16
- This model is a fine-tuned version of [Qwen/Qwen2.5-Math-7B](https://huggingface.co/Qwen/Qwen2.5-Math-7B) on the [DigitalLearningGmbH/MATH-lighteval](https://huggingface.co/datasets/DigitalLearningGmbH/MATH-lighteval) dataset.
17
  It has been trained using [TRL](https://github.com/huggingface/trl).
18
 
19
  ## Quick start
@@ -29,7 +27,7 @@ print(output["generated_text"])
29
 
30
  ## Training procedure
31
 
32
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/huggingface/huggingface/runs/9zsf5esn)
33
 
34
 
35
  This model was trained with GRPO, a method introduced in [DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models](https://huggingface.co/papers/2402.03300).
 
1
  ---
2
  base_model: Qwen/Qwen2.5-Math-7B
 
3
  library_name: transformers
4
  model_name: Qwen-2.5-7B-Simple-RL
5
  tags:
6
  - generated_from_trainer
 
7
  - trl
8
  - grpo
9
  licence: license
 
11
 
12
  # Model Card for Qwen-2.5-7B-Simple-RL
13
 
14
+ This model is a fine-tuned version of [Qwen/Qwen2.5-Math-7B](https://huggingface.co/Qwen/Qwen2.5-Math-7B).
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
  ## Quick start
 
27
 
28
  ## Training procedure
29
 
30
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/huggingface/huggingface/runs/pq5sovxv)
31
 
32
 
33
  This model was trained with GRPO, a method introduced in [DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models](https://huggingface.co/papers/2402.03300).
all_results.json CHANGED
@@ -1,8 +1,8 @@
1
  {
2
  "total_flos": 0.0,
3
- "train_loss": 16489.635922747966,
4
- "train_runtime": 14015.6163,
5
  "train_samples": 7500,
6
- "train_samples_per_second": 0.535,
7
- "train_steps_per_second": 0.033
8
  }
 
1
  {
2
  "total_flos": 0.0,
3
+ "train_loss": -4.392043727967474,
4
+ "train_runtime": 13254.7719,
5
  "train_samples": 7500,
6
+ "train_samples_per_second": 0.566,
7
+ "train_steps_per_second": 0.035
8
  }
config.json CHANGED
@@ -23,7 +23,7 @@
23
  "tie_word_embeddings": false,
24
  "torch_dtype": "bfloat16",
25
  "transformers_version": "4.49.0",
26
- "use_cache": true,
27
  "use_mrope": false,
28
  "use_sliding_window": false,
29
  "vocab_size": 152064
 
23
  "tie_word_embeddings": false,
24
  "torch_dtype": "bfloat16",
25
  "transformers_version": "4.49.0",
26
+ "use_cache": false,
27
  "use_mrope": false,
28
  "use_sliding_window": false,
29
  "vocab_size": 152064
model-00001-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d59c22fea6d7a7ba6749eff0a01231c095cf972624fb7bfd050b3b535c78948e
3
  size 4877660776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a1eb6e5679e4d58dd28e87c12fa85b41e6f8649886af1b00e5e560fe9d132ea
3
  size 4877660776
model-00002-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:60d56c67e19f374a008fcf6e4f11f0ea9768ffb7f913bd4e07b78bf14f374509
3
  size 4932751008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95cd0d8bf08fa8ef084bd405054d1ec4dfa7a3e1b856c6f80bcbdb25a01118a8
3
  size 4932751008
model-00003-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fced38c19e7bd5c0efce9897485d1cd937e2ef602adc6a918302bd8e7917506f
3
  size 4330865200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00f846aafa78bf493ca9d4cb53df3c719240a90c7046ca60255a7bf169ba1165
3
  size 4330865200
model-00004-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a6a24d05b35ae7c8045d885b9900256211dfc74d94fa69d31a2667c94c2e8114
3
  size 1089994880
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:621840d94a3e10c3fd2b1d1227690bb2b13530236ad68b97eabacb16ccb7cd2c
3
  size 1089994880
train_results.json CHANGED
@@ -1,8 +1,8 @@
1
  {
2
  "total_flos": 0.0,
3
- "train_loss": 16489.635922747966,
4
- "train_runtime": 14015.6163,
5
  "train_samples": 7500,
6
- "train_samples_per_second": 0.535,
7
- "train_steps_per_second": 0.033
8
  }
 
1
  {
2
  "total_flos": 0.0,
3
+ "train_loss": -4.392043727967474,
4
+ "train_runtime": 13254.7719,
5
  "train_samples": 7500,
6
+ "train_samples_per_second": 0.566,
7
+ "train_steps_per_second": 0.035
8
  }
trainer_state.json CHANGED
The diff for this file is too large to render. See raw diff
 
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e025832035eb8fa29735496be9c38194c8a203b34ecd7792bea9257a0edef3c4
3
  size 8568
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd5677e339fd6306f1bd6b6bc1ee482248770155ab82c82caf21fa6542781d24
3
  size 8568