Hugging Face's logo

kamel-usp
/
jbcs2025_Phi-3.5-mini-instruct-phi35_classification_lora-C4-full_context

PEFT
Safetensors
Portuguese
English
aes
Eval Results
Model card Files Community
jbcs2025_Phi-3.5-mini-instruct-phi35_classification_lora-C4-full_context / README.md
abarbosa's picture
abarbosa
Pushing fine-tuned model to Hugging Face Hub
2676396 verified
preview code
|
raw
history blame contribute delete
1.21 kB
metadata
language:
  - pt
  - en
tags:
  - aes
datasets:
  - kamel-usp/aes_enem_dataset
base_model: microsoft/Phi-3.5-mini-instruct
metrics:
  - accuracy
  - qwk
library_name: peft
model-index:
  - name: Phi-3.5-mini-instruct-phi35_classification_lora-C4-full_context
    results:
      - task:
          type: text-classification
          name: Automated Essay Score
        dataset:
          name: Automated Essay Score ENEM Dataset
          type: kamel-usp/aes_enem_dataset
          config: JBCS2025
          split: test
        metrics:
          - name: Macro F1
            type: f1
            value: 0.2562502976332206
          - name: QWK
            type: qwk
            value: 0.4689490445859872
          - name: Weighted Macro F1
            type: f1
            value: 0.6261409273457467

Model ID: Phi-3.5-mini-instruct-phi35_classification_lora-C4-full_context

Results

test_data
eval_accuracy 0.65942
eval_RMSE 25.9319
eval_QWK 0.468949
eval_Macro_F1 0.25625
eval_Weighted_F1 0.626141
eval_Micro_F1 0.65942
eval_HDIV 0.00724638