Update README.md
Browse filesAdded Interpretation
README.md
CHANGED
@@ -28,7 +28,8 @@ Utilizing this approach, we demonstrated improvements in regression tasks for ev
|
|
28 |
# main
|
29 |
|
30 |
|
31 |
-
|
|
|
32 |
|
33 |
# augmented
|
34 |
|
@@ -46,6 +47,22 @@ Utilizing this approach, we demonstrated improvements in regression tasks for ev
|
|
46 |
|
47 |

|
48 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
49 |
## Acknowledgements
|
50 |
|
51 |
We would like to acknowledge the authors of the ValueNet dataset for their valuable contribution to this work.
|
|
|
28 |
# main
|
29 |
|
30 |
|
31 |
+
|
32 |
+

|
33 |
|
34 |
# augmented
|
35 |
|
|
|
47 |
|
48 |

|
49 |
|
50 |
+
# Interpretation
|
51 |
+
|
52 |
+
We can only compare our classification task with the BART model that has the highest classification. This model only classifies whether the value is present or not.
|
53 |
+
1 for present and 0 for not. Qiu et al (2022) used BART to perform this classification with the highest accuracy using the main dataset with 67%. Using DeBERTa v3,
|
54 |
+
we were able to get an accuracy of 73% (0.7283). DeBERTa's disentanglement feature allows for a significant improvement in classifying human values.
|
55 |
+
|
56 |
+
We can also see a very noticable improvement with the regression tasks. This is a more difficult task, because the model must determine if the value in question is either
|
57 |
+
present or not; then determine if the agent's perspective is either supporting or against the value's stance. However, we can see that DeBerta v3 outperforms BERT by 4% (65% vs 61%).
|
58 |
+
I simply just replicated Qiu et al (2022) and have not tried to improve their design.
|
59 |
+
|
60 |
+
# Future Work
|
61 |
+
|
62 |
+
I am currently working to develop and ensemble model that will leverage text generation to create multiple stance positions for each values. We hypothesize that if
|
63 |
+
the model can differentiate between different stance positions on the same topic associated with the target value, the model can more accurately predict an agents
|
64 |
+
values stance.
|
65 |
+
|
66 |
## Acknowledgements
|
67 |
|
68 |
We would like to acknowledge the authors of the ValueNet dataset for their valuable contribution to this work.
|