saiteki-kai/QA-DeBERTa-MeanPooling-binary
This model is a fine-tuned version of microsoft/deberta-v3-large on the saiteki-kai/Beavertails-it dataset. It achieves the following results on the evaluation set: - Loss: 0.3246 - Accuracy: 0.8645 - Unsafe Precision: 0.8883 - Unsafe Recall: 0.8653 - Unsafe F1: 0.8766 - Unsafe Fpr: 0.1366 - Unsafe Aucpr: 0.9567 - Safe Precision: 0.8363 - Safe Recall: 0.8634 - Safe F1: 0.8497 - Safe Fpr: 0.1347 -
pip install mlforge-sdk && mlforge pull saiteki-kai/QA-DeBERTa-MeanPooling-binary
Model details
About saiteki-kai/QA-DeBERTa-MeanPooling-binary
This model is a fine-tuned version of microsoft/deberta-v3-large on the saiteki-kai/Beavertails-it dataset. It achieves the following results on the evaluation set: - Loss: 0.3246 - Accuracy: 0.8645 - Unsafe Precision: 0.8883 - Unsafe Recall: 0.8653 - Unsafe F1: 0.8766 - Unsafe Fpr: 0.1366 - Unsafe Aucpr: 0.9567 - Safe Precision: 0.8363 - Safe Recall: 0.8634 - Safe F1: 0.8497 - Safe Fpr: 0.1347 - Safe Aucpr: 0.9241