Wei
Che Huang, Andrew Trotman, Shlomo Geva
Using the
Wikipedia as a corpus, the Link-the-Wiki track, launched by INEX in 2007, aims
at producing a standard procedure and metrics for the evaluation of (automated)
link discovery at different element levels. In this paper, we describe the
preliminary procedure for the assessment, including the topic selection,
submission, pooling and evaluation. Related techniques are also presented such
as the proposed DTD, submission format, XML element retrieval and the concept
of Best Entry Points (BEPs). Due to the task required by LTW, it represents a
considerable evaluation challenge. We propose a preliminary procedure of
assessment for this stage of the LTW and also discuss the further issues for
improvement. Finally, an efficiency measurement is introduced for investigation
since the LTW task involves two studies: the selection of document elements
that represent the topic of request and the nomination of associated links that
can access different levels of the XML document.