A Large-Scale Web Data Collection as a Natural Language Processing Infrastructure

Keiji Shinzato, Daisuke Kawahara, Chikara Hashimoto, Sadao Kurohashi


Abstract
In recent years, language resources acquired from theWeb are released, and these data improve the performance of applications in several NLP tasks. Although the language resources based on the web page unit are useful in NLP tasks and applications such as knowledge acquisition, document retrieval and document summarization, such language resources are not released so far. In this paper, we propose a data format for results of web page processing, and a search engine infrastructure which makes it possible to share approximately 100 million Japanese web data. By obtaining the web data, NLP researchers are enabled to begin their own processing immediately without analyzing web pages by themselves.
Anthology ID:
L08-1417
Volume:
Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)
Month:
May
Year:
2008
Address:
Marrakech, Morocco
Editors:
Nicoletta Calzolari, Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2008/pdf/564_paper.pdf
DOI:
Bibkey:
Cite (ACL):
Keiji Shinzato, Daisuke Kawahara, Chikara Hashimoto, and Sadao Kurohashi. 2008. A Large-Scale Web Data Collection as a Natural Language Processing Infrastructure. In Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08), Marrakech, Morocco. European Language Resources Association (ELRA).
Cite (Informal):
A Large-Scale Web Data Collection as a Natural Language Processing Infrastructure (Shinzato et al., LREC 2008)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2008/pdf/564_paper.pdf