RTE5 - Ablation Tests - Revision history

Pdturney: Reverted edits by Creek (talk) to last revision by Celct

2012-06-25T11:18:25Z

Reverted edits by Creek (talk) to last revision by Celct

← Older revision		Revision as of 11:18, 25 June 2012
Line 140:		Line 140:
	\| style="text-align: center;"\| 0.66		\| style="text-align: center;"\| 0.66
	\| style="text-align: center;"\| —		\| style="text-align: center;"\| —
	\| ~~[http://www.thai-sbobet.com sbo]~~		\|

	\|- bgcolor="#ECECEC" "align="left"		\|- bgcolor="#ECECEC" "align="left"
Line 147:		Line 147:
	\| style="text-align: center;"\| 0		\| style="text-align: center;"\| 0
	\| style="text-align: center;"\| —		\| style="text-align: center;"\| —
	\| ~~[http://www.thai-sbobet.com sbobet]~~		\|

	\|- bgcolor="#ECECEC" "align="left"		\|- bgcolor="#ECECEC" "align="left"

Creek at 09:20, 25 June 2012

2012-06-25T09:20:57Z

← Older revision		Revision as of 09:20, 25 June 2012
Line 140:		Line 140:
	\| style="text-align: center;"\| 0.66		\| style="text-align: center;"\| 0.66
	\| style="text-align: center;"\| —		\| style="text-align: center;"\| —
	\|		\| [http://www.thai-sbobet.com sbo]

	\|- bgcolor="#ECECEC" "align="left"		\|- bgcolor="#ECECEC" "align="left"
Line 147:		Line 147:
	\| style="text-align: center;"\| 0		\| style="text-align: center;"\| 0
	\| style="text-align: center;"\| —		\| style="text-align: center;"\| —
	\|		\| [http://www.thai-sbobet.com sbobet]

	\|- bgcolor="#ECECEC" "align="left"		\|- bgcolor="#ECECEC" "align="left"

Celct at 09:53, 23 July 2010

2010-07-23T09:53:16Z

← Older revision		Revision as of 09:53, 23 July 2010
Line 11:		Line 11:
	! Ablated Resource		! Ablated Resource
	! Team Run<ref>For further information about participants, click here: [[RTE Challenges - Data about participants]]</ref>		! Team Run<ref>For further information about participants, click here: [[RTE Challenges - Data about participants]]</ref>
	! <small>Resource impact ~~<br />~~ 2way</small>		! <small>Resource impact - 2way</small>
	! <small>Resource impact ~~<br />~~ 3way</small>		! <small>Resource impact - 3way</small>
	! Resource Usage Description		! Resource Usage Description

Celct at 09:52, 23 July 2010

2010-07-23T09:52:46Z

← Older revision		Revision as of 09:52, 23 July 2010
Line 11:		Line 11:
	! Ablated Resource		! Ablated Resource
	! Team Run<ref>For further information about participants, click here: [[RTE Challenges - Data about participants]]</ref>		! Team Run<ref>For further information about participants, click here: [[RTE Challenges - Data about participants]]</ref>
	! <small>Resource impact - 2way</small>		! <small>Resource impact <br /> 2way</small>
	! <small>Resource impact - 3way</small>		! <small>Resource impact <br /> 3way</small>
	! Resource Usage Description		! Resource Usage Description

Celct at 09:51, 23 July 2010

2010-07-23T09:51:54Z

← Older revision		Revision as of 09:51, 23 July 2010
Line 11:		Line 11:
	! Ablated Resource		! Ablated Resource
	! Team Run<ref>For further information about participants, click here: [[RTE Challenges - Data about participants]]</ref>		! Team Run<ref>For further information about participants, click here: [[RTE Challenges - Data about participants]]</ref>
	! <small>~~Δ Accuracy %~~ - 2way</small>		! <small>Resource impact - 2way</small>
	! <small>~~Δ Accuracy %~~ - 3way</small>		! <small>Resource impact - 3way</small>
	! Resource Usage Description		! Resource Usage Description

Celct at 10:43, 22 December 2009

2009-12-22T10:43:56Z

← Older revision		Revision as of 10:43, 22 December 2009
Line 1:		Line 1:
	The following table lists the results of the ablation tests submitted by participants, which have been introduced as a mandatory track in the RTE5 campaign.<br><br>		The following table lists the results of the ablation tests submitted by participants, which have been introduced as a mandatory track in the RTE5 campaign.<br><br>
	The first column contains the specific resources which have been ablated.<br>The second column lists the Team Run in the form ''[name_of_the_Team][number_of_the_submitted_run].[submission_task]'' (e.g. BIU1.2way, Boeing3.3way).<br>The third and fourth columns ~~show~~ the normalized difference between the accuracy of the complete system run and the accuracy of ~~one~~ ablation run (i.e. the ~~accuracy achieved by~~ the complete system ~~minus that achieved by~~ the ablated resource). The third refers to the score obtained in the 2-way task, the fourth to that obtained in the 3-way task. For all the runs submitted as 3-way, also the 2-way derived accuracy has been calculated.<br>		The first column contains the specific resources which have been ablated.<br>The second column lists the Team Run in the form ''[name_of_the_Team][number_of_the_submitted_run].[submission_task]'' (e.g. BIU1.2way, Boeing3.3way).<br>The third and fourth columns present the normalized difference between the accuracy of the complete system run and the accuracy of the ablation run (i.e. the output of the complete system without the ablated resource), showing the impact of the resource on the performance of the system. The third refers to the score obtained in the 2-way task, the fourth to that obtained in the 3-way task. For all the runs submitted as 3-way, also the 2-way derived accuracy has been calculated.<br>
	Finally, the fifth column contains a brief description of the ~~resource~~ specific usage. It is based on the information provided both in the "readme" files submitted together with the ablation tests and in the system reports published in the RTE5 proceedings.<br><br>		Finally, the fifth column contains a brief description of the specific usage of the resource. It is based on the information provided both in the "readme" files submitted together with the ablation tests and in the system reports published in the RTE5 proceedings.<br><br>

	Participants are kindly invited to check if all the inserted information is correct and complete.		Participants are kindly invited to check if all the inserted information is correct and complete.

Celct at 08:34, 22 December 2009

2009-12-22T08:34:25Z

← Older revision		Revision as of 08:34, 22 December 2009
Line 1:		Line 1:
	The following table lists the results of the ablation tests submitted by participants, which have been introduced as a mandatory track in the RTE5 campaign.<br><br>		The following table lists the results of the ablation tests submitted by participants, which have been introduced as a mandatory track in the RTE5 campaign.<br><br>
	The first column contains the specific resources which have been ablated.<br>The second column lists the Team Run in the form ''[name_of_the_Team][number_of_the_submitted_run].[submission_task]'' (e.g. BIU1.2way, Boeing3.3way).<br>The third and fourth columns show the normalized difference between the accuracy of the complete system run and the accuracy of one ablation run (i.e. the complete system minus the ablated resource). The third refers to the score obtained in the 2-way task, the fourth that obtained in the 3-way task. For all the runs submitted as 3-way, also the 2-way derived accuracy has been calculated.<br>		The first column contains the specific resources which have been ablated.<br>The second column lists the Team Run in the form ''[name_of_the_Team][number_of_the_submitted_run].[submission_task]'' (e.g. BIU1.2way, Boeing3.3way).<br>The third and fourth columns show the normalized difference between the accuracy of the complete system run and the accuracy of one ablation run (i.e. the accuracy achieved by the complete system minus that achieved by the ablated resource). The third refers to the score obtained in the 2-way task, the fourth to that obtained in the 3-way task. For all the runs submitted as 3-way, also the 2-way derived accuracy has been calculated.<br>
	Finally, the fifth column contains a brief description of the resource specific usage. It is based on the information provided both in the "readme" files submitted together with the ablation tests and in the system reports published in the RTE5 proceedings.<br><br>		Finally, the fifth column contains a brief description of the resource specific usage. It is based on the information provided both in the "readme" files submitted together with the ablation tests and in the system reports published in the RTE5 proceedings.<br><br>

Celct at 08:31, 22 December 2009

2009-12-22T08:31:56Z

← Older revision		Revision as of 08:31, 22 December 2009
Line 1:		Line 1:
	The following table lists the results of the ablation tests submitted by participants, which have been introduced as a mandatory track in the RTE5 campaign.<br><br>		The following table lists the results of the ablation tests submitted by participants, which have been introduced as a mandatory track in the RTE5 campaign.<br><br>
	The first column contains the specific resources ablated.<br>The second column lists the Team Run in the form ''[name_of_the_Team][number_of_the_submitted_run].[submission_task]'' (e.g. BIU1.2way, Boeing3.3way).<br>The third and fourth columns show the normalized difference between the accuracy of the complete run and the accuracy of ~~the single~~ ablation run (i.e. the ~~same~~ system minus the ablated resource). The third refers to 2-way task, the fourth to 3-way. For all the runs submitted as ~~three~~-way ~~task~~, the ~~two~~-way derived accuracy has been calculated.<br>		The first column contains the specific resources which have been ablated.<br>The second column lists the Team Run in the form ''[name_of_the_Team][number_of_the_submitted_run].[submission_task]'' (e.g. BIU1.2way, Boeing3.3way).<br>The third and fourth columns show the normalized difference between the accuracy of the complete system run and the accuracy of one ablation run (i.e. the complete system minus the ablated resource). The third refers to the score obtained in the 2-way task, the fourth that obtained in the 3-way task. For all the runs submitted as 3-way, also the 2-way derived accuracy has been calculated.<br>
	Finally, the fifth column contains ~~some~~ brief ~~descriptions~~ of the resource specific usage. It ~~reflects~~ the ~~content of~~ the "readme" files submitted together with the ablation tests ~~plus further information extracted direcly from~~ RTE5 proceedings.<br><br>		Finally, the fifth column contains a brief description of the resource specific usage. It is based on the information provided both in the "readme" files submitted together with the ablation tests and in the system reports published in the RTE5 proceedings.<br><br>

	Participants are ~~encouraged~~ to check if all the inserted information is correct and complete.		Participants are kindly invited to check if all the inserted information is correct and complete.

Celct at 17:42, 21 December 2009

2009-12-21T17:42:54Z

← Older revision		Revision as of 17:42, 21 December 2009
Line 1:		Line 1:
			The following table lists the results of the ablation tests submitted by participants, which have been introduced as a mandatory track in the RTE5 campaign.<br><br>
			The first column contains the specific resources ablated.<br>The second column lists the Team Run in the form ''[name_of_the_Team][number_of_the_submitted_run].[submission_task]'' (e.g. BIU1.2way, Boeing3.3way).<br>The third and fourth columns show the normalized difference between the accuracy of the complete run and the accuracy of the single ablation run (i.e. the same system minus the ablated resource). The third refers to 2-way task, the fourth to 3-way. For all the runs submitted as three-way task, the two-way derived accuracy has been calculated.<br>
			Finally, the fifth column contains some brief descriptions of the resource specific usage. It reflects the content of the "readme" files submitted together with the ablation tests plus further information extracted direcly from RTE5 proceedings.<br><br>

			Participants are encouraged to check if all the inserted information is correct and complete.


	{\|class="wikitable sortable" cellpadding="3" cellspacing="0" border="1"		{\|class="wikitable sortable" cellpadding="3" cellspacing="0" border="1"

	\|- bgcolor="#CDCDCD"		\|- bgcolor="#CDCDCD"
	! Ablated Resource		! Ablated Resource
	! Team Run		! Team Run<ref>For further information about participants, click here: [[RTE Challenges - Data about participants]]</ref>
	! <small>Δ Accuracy % - 2way</small>		! <small>Δ Accuracy % - 2way</small>
	! <small>Δ Accuracy % - 3way</small>		! <small>Δ Accuracy % - 3way</small>
Line 599:		Line 606:

	\|}		\|}
			<br>
			==Footnotes==
			<references />


			Return to [[RTE Knowledge Resources]]

Celct at 14:22, 21 December 2009

2009-12-21T14:22:45Z

← Older revision		Revision as of 14:22, 21 December 2009
Line 66:		Line 66:
	\|- bgcolor="#ECECEC" "align="left"		\|- bgcolor="#ECECEC" "align="left"
	\| Grady Ward’s MOBY Thesaurus + <br>Roget's Thesaurus		\| Grady Ward’s MOBY Thesaurus + <br>Roget's Thesaurus
	\| ~~VensesTeam2~~.2way		\| Venses2.2way
	\| style="text-align: center;"\| 2.83		\| style="text-align: center;"\| 2.83
	\| style="text-align: center;"\| —		\| style="text-align: center;"\| —
Line 319:		Line 319:
	\|- bgcolor="#ECECEC" "align="left"		\|- bgcolor="#ECECEC" "align="left"
	\| WordNet		\| WordNet
	\| ~~Rhodes~~.3way		\| Rhodes1.3way
	\| style="text-align: center;"\| 3.17		\| style="text-align: center;"\| 3.17
	\| style="text-align: center;"\| 4		\| style="text-align: center;"\| 4
Line 565:		Line 565:
	\|- bgcolor="#ECECEC" "align="left"		\|- bgcolor="#ECECEC" "align="left"
	\| Other		\| Other
	\| ~~Rhodes~~.3way		\| Rhodes1.3way
	\| style="text-align: center;"\| -0.17		\| style="text-align: center;"\| -0.17
	\| style="text-align: center;"\| -0.17		\| style="text-align: center;"\| -0.17
Line 572:		Line 572:
	\|- bgcolor="#ECECEC" "align="left"		\|- bgcolor="#ECECEC" "align="left"
	\| Other		\| Other
	\| ~~Rhodes~~.3way		\| Rhodes1.3way
	\| style="text-align: center;"\| 3.33		\| style="text-align: center;"\| 3.33
	\| style="text-align: center;"\| 1.83		\| style="text-align: center;"\| 1.83
Line 579:		Line 579:
	\|- bgcolor="#ECECEC" "align="left"		\|- bgcolor="#ECECEC" "align="left"
	\| Other		\| Other
	\| ~~Rhodes~~.3way		\| Rhodes1.3way
	\| style="text-align: center;"\| 0.33		\| style="text-align: center;"\| 0.33
	\| style="text-align: center;"\| 0.17		\| style="text-align: center;"\| 0.17
Line 586:		Line 586:
	\|- bgcolor="#ECECEC" "align="left"		\|- bgcolor="#ECECEC" "align="left"
	\| Other		\| Other
	\| ~~Rhodes~~.3way		\| Rhodes1.3way
	\| style="text-align: center;"\| 3.17		\| style="text-align: center;"\| 3.17
	\| style="text-align: center;"\| 4		\| style="text-align: center;"\| 4