RTE5 - Ablation Tests
Jump to navigation
Jump to search
| Ablated Resource | Team Run | Relative accuracy - 2way | Relative accuracy - 3way | Resource Usage Description |
|---|---|---|---|---|
| Acronym guide | Siel_093.3way | 0 | 0 | Acronym Resolution |
| Acronym guide + Acronym_rules by UAIC |
UAIC20091.3way | +0.0017 | +0.0016 | We start from acronym-guide, but additional we use a rule that consider for expressions like Xaaaa Ybbbb Zcccc the acronym XYZ, regardless of length of text with this form. |
| DIRT | BIU1.2way | +0.0133 | Inference rules | |
| DIRT | Boeing3.3way | -0.0117 | 0 | |
| DIRT | UAIC20091.3way | +0,0017 | +0,0033 | We transform text and hypothesis with MINIPAR into dependency trees: use of DIRT relations to map verbs in T with verbs in H |
| Framenet | DLSIUAES1.2way | +0,0116 | frame-to-frame similarity metric | |
| Framenet | DLSIUAES1.3way | -0,0017 | -0,0017 | frame-to-frame similarity metric |
| Framenet | UB.dmirg3.2way | 0 | ||
| Grady Ward’s MOBY Thesaurus + Roget's Thesaurus |
VensesTeam2.2way | +0.0283 | Semantic fields are used as semantic similarity matching, in all cases of non identical lemmas
|