Can you provide some training details about this model (like learning rate)?

by iseesaw - opened Sep 7, 2024

Sep 7, 2024

Thanks.

Skywork org Sep 8, 2024

Hi,

We primarily follow RLHFlow's recipe, except that we train for 2 epochs instead.

chrisliu298 changed discussion status to closed Sep 8, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment