RTE6 - Ablation Tests: Difference between revisions
Jump to navigation
Jump to search
Amarchetti (talk | contribs) New page: The following table lists the results of the ablation tests (a mandatory track since the RTE5 campaign), submitted by participants to RTE6 .<br><br> Participants are kindly invited to ch... |
Amarchetti (talk | contribs) No edit summary |
||
| Line 33: | Line 33: | ||
This ablation test is an unusual ablation test, since it shows that the co-reference resolution component has a negative impact. | This ablation test is an unusual ablation test, since it shows that the co-reference resolution component has a negative impact. | ||
|- bgcolor="#ECECEC" "align="left" | |||
| DIRT | |||
| Boeing1_abl-1 | |||
| style="text-align: center;"| 3.97 | |||
| style="text-align: center;"| DIRT removed | |||
|- bgcolor="#ECECEC" "align="left" | |||
| WordNet | |||
| Boeing1_abl-2 | |||
| style="text-align: center;"| 4.42 | |||
| style="text-align: center;"| No WordNet | |||
Revision as of 15:38, 2 February 2011
The following table lists the results of the ablation tests (a mandatory track since the RTE5 campaign), submitted by participants to RTE6 .
Participants are kindly invited to check if all the inserted information is correct and complete.
| Ablated Component | Ablation Run[1] | Resource impact - F1 | Resource Usage Description |
|---|---|---|---|
| WordNet | BIU1_abl-1 | 0.9 | No Word-Net. On Dev set: 39.18% (compared to 40.73% when WN is used) |
| CatVar | BIU1_abl-2 | 0.63 | No CatVar. On Dev set achieved about 40.20% (compared to 40.73% when CatVar is used) |
| Coreference resolver | BIU1_abl-3 | -0.88 | No coreference resolver
On Dev set 41.62% (Compared to 40.73% when Coreference resolver is used). This ablation test is an unusual ablation test, since it shows that the co-reference resolution component has a negative impact. |
| DIRT | Boeing1_abl-1 | 3.97 | DIRT removed |
| WordNet | Boeing1_abl-2 | 4.42 | No WordNet
|
Footnotes
- ↑ For further information about participants, click here: RTE Challenges - Data about participants
Return to RTE Knowledge Resources