Skywork/Skywork-Reward-Llama-3.1-8B-v0.2
IMPORTANT: This model was trained using the decontaminated version of the original Skywork Reward Preference dataset, now referred to as v0.2. The updated dataset, Skywork-Reward-Preference-80K-v0.2, removes 4,957 contaminated pairs from the magpie-ultra-v0.1 subset, which had significant n-gram overlap with the evaluation prompts in RewardBench. You can find the set of removed pairs here. For mo
pip install mlforge-sdk && mlforge pull Skywork/Skywork-Reward-Llama-3.1-8B-v0.2
Model details
About Skywork/Skywork-Reward-Llama-3.1-8B-v0.2
IMPORTANT: This model was trained using the decontaminated version of the original Skywork Reward Preference dataset, now referred to as v0.2. The updated dataset, Skywork-Reward-Preference-80K-v0.2, removes 4,957 contaminated pairs from the magpie-ultra-v0.1 subset, which had significant n-gram overlap with the evaluation prompts in RewardBench. You can find the set of removed pairs here. For more detailed information, please refer to this GitHub gist.