---
base_model: Qwen/Qwen2-Audio-7B
library_name: peft
---

4e-5 run test, lower batch size (bs4)

```
        output_dir="qwen-audio-beat-trainer-t5",
        num_train_epochs=1,
        per_device_train_batch_size=4,
        gradient_accumulation_steps=1,
        learning_rate=4e-5,
        max_grad_norm=0.2,
        warmup_steps=20,
        bf16=True,  
        remove_unused_columns=False,
        gradient_checkpointing=True,
        logging_steps=1,
        save_strategy="steps", 
        save_steps=25,  
```