Difference between revisions of "Corpora for English"

Revision as of 13:33, 8 March 2015

For languages other than English, see List of resources by language.

1963 Time Magazine corpus
American English SpeechDat-Car
American National Corpus (ANC)
AMERICAN NATIONAL CORPUS FIRST RELEASE
Araneum Anglicum, Gigaword English web corpus
Araneum Anglicum Asiaticum, Gigaword Asian English web corpus
Biomedical corpora
BNCweb a web-based interface to the British National Corpus
Bookmarks for Corpus-based Linguists
British National Corpus (from Oxford University)
British National Corpus (BNC)
British National Corpus project page (from UCREL)
Brown Corpus
ClueWeb
CODA Parallel Annotated Monologue-Dialogue Corpus
Collins Wordbanks
Congressional floor-debate transcripts, with support/oppose labels
Corpus of Spoken Professional English
Dialogue Diversity Corpus
Electronic Text Center -- University of Virginia
English Intonation in the British Isles -The IViE Corpus
English stop words (from SMART)
English Verb Classes And Alternations: A Preliminary Investigation (Index)
Exploring Words and Phrases from the British National Corpus
GOV2 Corpus - 426 gigabytes of text
Groningen Meaning Bank semantically annotated corpus
Gutenberg
HamleDT, harmonized dependency treebanks of many languages, common annotation style.
Hutter Prize for Lossless Compression of Human Knowledge 100M sample of Wikipedia
ICAME
Large Text Compression Benchmark's 1G sample of Wikipedia
List of English stopwords
Movie Review Data
Multi-Perspective Question Answering (MPQA)
Multiword Expression Resources
Oxford English Corpus
Phrases in English
Restricted English Corpus from Dr. Caroline Lyon for PhD
Sketch Engine
Susanne: Annotated American English Corpus
The BNC Index (for the BNCWorld Edition)
The Brooklyn-Geneva-Amsterdam-Helsinki Parsed Corpus of Old English
The Dialogue Diversity Corpus
The LUCY Corpus - Documentation
TRAINS Dialogue Corpus
UMBC Webbase Corpus
UN parallel corpora
VP Ellipsis corpus
WaCky
WebCorp
WMT corpora, including Europarl, News Commentary, and News Crawl

Link collections

Corpora tools

List of stop words
Poliqarp - open source XML-aware indexer, search engine and concordancer
The Sketch Engine
Treebank tokenization scheme

@@ Line 1: / Line 1: @@
+For languages other than English, see [[List of resources by language]].
+<!-- Please keep this list in alphabetical order -->
 *[ftp://ftp.cs.cornell.edu/pub/smart/time/ 1963 Time Magazine corpus]
-*[http://www.ldc.upenn.edu/Catalog/LDC2001S97.html 2000 NIST Speaker Recognition Evaluation Corpus]
-*[http://www.coli.uni-sb.de/sfb378/negra-corpus/ A Syntactically Annotated Corpus of German Newspaper Texts]
-*[http://ixa.si.ehu.es/Ixa/resources/sensecorpus A Web Corpus and Topic Signatures for All WordNet 1.6 Nominal Senses (v 1.0)]
-*[http://odur.let.rug.nl/~vannoord/trees/ Alpino Treebank]
-*[http://www.cornelsen.de/international/ An Empirical Grammar of the English Verb System]
-*[http://www.sultry.arts.usyd.edu.au/links/statnlp.html Annotated list of resources on statistical NLP and corpus-based CL]
-*[http://www.aot.ru/search1.html AOT]
-*[http://www.ldc.upenn.edu/Catalog/LDC2001T55.html Arabic Newswire Part 1]
-*[http://atilf.atilf.fr/dmf.htm Base Textuelle de Moyen Francais]
-*[http://thetis.bl.uk/ BNC Online Service]
-*[http://bokrcorpora.narod.ru Bokr Russian Reference Corpus]
-*[http://info.ox.ac.uk/bnc/ BRITISH NATIONAL CORPUS - WORLD EDITION]
-*[http://www.dcs.gla.ac.uk/idom/ir_resources/ Collections of texts and corpora]
-*[http://www.lllf.uam.es/~fmarcos/informes/corpus/corpulee.html Corpus de referencia de la lengua Espanola contemporanea: corpus oral peninsular]
-*[http://www.corpusdelespanol.org/ Corpus del Espanol]
-*[http://www.hf.uio.no/easteur-orient/bulg/mat/ Corpus of spoken Bulgarian]
-*[http://pioneer.chula.ac.th/~awirote/ling/corpuslst.htm Corpus Resources (Chulalongkorn University, Thailand)]
-*[ftp://ftp.cs.cornell.edu/pub/smart/cran/ Cranfield collection]
-*[http://corpus.rae.es/creanet.html CREA]
-*[http://ucnk.ff.cuni.cz/english/index.html Czech National Corpus]
-*[http://korpus.dsl.dk/korpus2000/indgang.php Danish news corpus]
-*[http://www.eat.rl.ac.uk/ Edinburgh Associative Thesaurus (EAT)]
-*[http://www.hum.uva.nl/~ewn EuroWordNet]
-*[http://www.ims.uni-stuttgart.de/projekte/tc/CQP.html Experimental Corpus Query System (University of Stuttgart, Germany)]
-*[http://www.csc.fi/kielipankki/ Finnish text bank]
-*[http://hometown.aol.com/mit2haiti/Index4.html HAITIAN CREOLE ELECTRONIC TEXTS]
-*[http://rali.iro.umontreal.ca/ Hansards Corpus - Searchable]
-*[http://www.hcrc.ed.ac.uk/maptask/ HCRC Map Task Corpus XML annotations]
-*[http://www.csc.fi/kielipankki/aineistot/hcs/index.phtml.en Helsinki Corpus of Swahili (HCS)]
-*[http://nats-www.informatik.uni-hamburg.de/~ingo/icopost/ ICOPOST]
-*[http://www.ims.uni-stuttgart.de/projekte/TC.html IMS Corpus Toolbox, Univ. of Stuttgart]
-*[http://www.ims.uni-stuttgart.de/projekte/CorpusWorkbench/ IMS Corpus Workbench (CWB)]
-*[http://cecl.fltr.ucl.ac.be/Cecl-Projects/Icle/icle.htm International Corpus of Learner English]
-*[http://korpus.pl/en/ IPI PAN Polish Corpus]
-*[http://www.ipds.uni-kiel.de/links/datenmaterial.en.html Kiel University's Institute on Phonetics and Speech Procesing]
-*[http://www.nilc.icmc.usp.br/lacioweb Lacio Web Corpora]
-*[http://www.vuw.ac.nz/llc/ LANGUAGE LEARNING CENTER - ACADEMIC CORPUS]
-*[http://www.csse.monash.edu.au/~jwb/afaq/jitadoushi.html list of Japanese transitive - intransitive verb pairs]
-*[http://www.dcs.gla.ac.uk/idom/ir_resources/linguistic_utils/stop_words List of stop words]
-*[http://www.bmanuel.org/clr2_mp.html Manuel Barbera: General Corpora and Corpus Linguistics Resources]
-*[ftp://ftp.cs.cornell.edu/pub/smart/med/ Medlars collection]
-*[ftp://ftp.ox.ac.uk/pub/wordlists/ Miscellaneous Word Lists from Oxford University]
-*[http://www.lpl.univ-aix.fr/projects/multext/ Multilingual Text Tools and Corpora]
-*[http://www.census.gov/genealogy/names Name lists from US census]
-*[http://www.di.fc.ul.pt/~ahb/nexing.htm Nexing Corpus]
-*[http://www.cs.cmu.edu/web/books.html On-line books at CMU]
-*[http://logos.uio.no/opus/ OPUS -- An Open Source Parallel Corpus]
-*[http://www.uni-duisburg.de/Fak2/FremdPhil/Romanistik/Personal/Burr/humcomp/ Oxford Text Archive Corpus of Italian Newspapers]
-*[http://elex.amu.edu.pl/~przemka/PICLE_search.php Polish subcorpus of the International Corpus of Learner English]
-*[http://www.cirp.es/WXN/wxn/frames/proxectos.html Ramon Piero Center for Research]
-*[http://about.reuters.com/researchandstandards/corpus/ Reuters Corpus]
-*[http://www.cs.unt.edu/~rada/downloads.html Romanian NLP]
-*[http://sanskritlibrary.org/ Sanskrit Library]
-*[http://nl.ijs.si/elan/#corpus Slovene-English Parallel Corpus]
-*[http://www.ldc.upenn.edu/Catalog/LDC2001S97.html Speech in Noisy Environments 1 (SPINE1 CODED) Coded Audio]
-*[http://www.ldc.upenn.edu/Catalog/LDC2001S99.html Speech in Noisy Environments 2 (SPINE2 CODED) Coded Audio]
-*[http://www.cs.cmu.edu/afs/cs/project/ai-repository/ai/areas/nlp/doc/notes/corpora.txt Survey of Electronic Corpora (by Jane A. Edwards, file at CMU)]
-*[http://www.ucl.ac.uk/english-usage/ Survey of English Usage, University College, London]
-*[http://www.icsi.berkeley.edu/real/stp/index.html Switchboard Transcription Project]
-*[http://www.tractor.de/ TELRI Research Archive of Computational Tools and Resources]
-*[http://childes.psy.cmu.edu/ The Childes Corpus - Children's language]
-*[http://nora.hd.uib.no/index-e.html The CORPORA DataCenter (Norway)]
-*[ftp://ftp.dcs.shef.ac.uk/share/ilash/Moby/ The Moby Corpus]
-*[http://www.tekstlab.uio.no/Bosnian/Corpus.html The Oslo Corpus of Bosnian Texts]
-*[http://www.sketchengine.co.uk/ The Sketch Engine]
-*[http://www.hf.uio.no/tekstlab/prosjekter/SOFIE.htm The Sofie Treebank - A Parallel Treebank of North European Languages]
-*[http://www.cis.upenn.edu/~treebank/tokenization.html Treebank tokenization scheme]
-==English corpora==
 *[http://www.elda.fr/catalogue/en/speech/S0115.html American English SpeechDat-Car]
 *[http://americannationalcorpus.org/ American National Corpus (ANC)]
 *[http://americannationalcorpus.org/FirstRelease/ AMERICAN NATIONAL CORPUS FIRST RELEASE]
+*[http://ucts.uniba.sk/aranea_about/ Araneum Anglicum], Gigaword English web corpus
+*[http://ucts.uniba.sk/aranea_about/ Araneum Anglicum Asiaticum], Gigaword Asian English web corpus
 *[http://compbio.uchsc.edu/ccp/corpora/index.shtml Biomedical corpora]
 *[http://homepage.mac.com/bncweb/ BNCweb a web-based interface to the British National Corpus]
@@ Line 79: / Line 15: @@
 *[http://www.comp.lancs.ac.uk/computing/research/ucrel/bnc.html British National Corpus project page (from UCREL)]
 *[http://clwww.essex.ac.uk/w3c/corpus_ling/content/corpora/list/private/brown/brown.html Brown Corpus]
+*[http://boston.lti.cs.cmu.edu/Data/clueweb09/ ClueWeb]
+*[http://computing.open.ac.uk/coda/data.html CODA Parallel Annotated Monologue-Dialogue Corpus]
 *[http://www.collins.co.uk/books.aspx?group=154 Collins Wordbanks]
+*[http://www.cs.cornell.edu/home/llee/data/convote.html Congressional floor-debate transcripts, with support/oppose labels]
 *[http://www.athel.com/corpdes.html Corpus of Spoken Professional English]
 *[http://www-rcf.usc.edu/~billmann/diversity/DDivers-site.htm Dialogue Diversity Corpus]
@@ Line 87: / Line 26: @@
 *[http://www-personal.umich.edu/~jlawler/levin.html English Verb Classes And Alternations: A Preliminary Investigation (Index)]
 *[http://usna.edu/LangStudy/BNC/ Exploring Words and Phrases from the British National Corpus]
+*[http://ir.dcs.gla.ac.uk/test_collections/gov2-summary.htm GOV2 Corpus] - 426 gigabytes of text
+*[http://gmb.let.rug.nl Groningen Meaning Bank] semantically annotated corpus
 *[http://www.gutenberg.org/wiki/Main_Page Gutenberg]
+*[http://ufal.mff.cuni.cz/hamledt HamleDT], harmonized dependency treebanks of many languages, common annotation style.
+*[http://prize.hutter1.net/ Hutter Prize for Lossless Compression of Human Knowledge 100M sample of Wikipedia]
 *[http://nora.hd.uib.no/icame.html ICAME]
+*[http://www.cs.fit.edu/~mmahoney/compression/text.html Large Text Compression Benchmark's 1G sample of Wikipedia]
 *[http://www-2.cs.cmu.edu/afs/cs.cmu.edu/project/theo-11/www/naive-bayes/bow-0.8/stopwords.c List of English stopwords]
-*[http://www.lsi.upc.es/~nlp/tools/mapping.html Mapping WordNet Versions 1.6 and 2.0]
 *[http://www.cs.cornell.edu/People/pabo/movie-review-data/ Movie Review Data]
+*[http://www.cs.pitt.edu/mpqa/ Multi-Perspective Question Answering (MPQA)]
 *[http://mwe.stanford.edu/resources/ Multiword Expression Resources]
 *[http://www.askoxford.com/oec/mainpage/?view=uk Oxford English Corpus]
@@ Line 103: / Line 47: @@
 *[http://www.grsampson.net/LucyDoc.html The LUCY Corpus - Documentation]
 *[http://www.cs.rochester.edu/research/cisd/resources/trains.html TRAINS Dialogue Corpus]
+*[http://ebiquity.umbc.edu/resource/html/id/351 UMBC Webbase Corpus]
+*[http://www.euromatrixplus.net/multi-un/ UN parallel corpora]
+*[http://www.let.rug.nl/~bos/vpe/ VP Ellipsis corpus]
+*[http://wacky.sslmit.unibo.it/ WaCky]
 *[http://www.webcorp.org.uk/guide/ WebCorp]
+* [http://www.statmt.org/wmt13/translation-task.html#download WMT corpora], including [http://en.wikipedia.org/wiki/Europarl_corpus Europarl], News Commentary, and News Crawl
-==German corpora==
-*[http://www.phonetik.uni-muenchen.de/Bas/BasKorporaeng.html Bavarian Archive for Speech Signals Corpora]
+==Link collections==
-*[http://corpora.ids-mannheim.de/~cosmas/ COSMAS II]
+<!-- Please keep this list in alphabetical order -->
-*[http://www.coli.uni-sb.de/sfb378/negra-corpus/negra-corpus.html NEGRA Corpus]
-==Multilingual corpora==
+*[http://www.dcs.gla.ac.uk/idom/ir_resources/ Collections of texts and corpora]
+*[http://www.bmanuel.org/clr2_mp.html Manuel Barbera: General Corpora and Corpus Linguistics Resources]
+*[http://www.sultry.arts.usyd.edu.au/links/statnlp.html Annotated list of resources on statistical NLP and corpus-based CL]
-*[http://wt.jrc.it/lt/Acquis/ ACQUIS COMMUNAUTAIRE Multilingual Corpus]
+==Corpora tools==
-*[http://spraakbanken.gu.se/ Bank of Swedish]
+<!-- Please keep this list in alphabetical order -->
-*[http://hnk.ffzg.hr/ Croatian National Corpus (HNK)]
-*[http://ucnk.ff.cuni.cz/ Czech National Corpus (CNC)]
-*[http://www.kun.nl/celex CELEX - The Dutch Center for Lexical Information]
-*[http://www.cdc.gov/ncidod/sars/languages.htm Centre for Disease Control - Chinese, French, Japanese, Spanish info on SARS]
-*[http://www.linguateca.pt/COMPARA/ COMPARA corpus]
-*[http://www.debian.org/international/ Debian free software community]
-*[http://www.ling.lancs.ac.uk/corplang/emille EMILLE corpus]
-*[http://people.csail.mit.edu/people/koehn/publications/europarl/ European Parliament Proceedings Parallel Corpus 1996-2003]
-*[http://www.illc.uva.nl/EuroWordNet EuroWordNet]
-*[http://www.france.diplomatie.fr/label_france/index.html French Foreign Ministry's magazine]
-*[http://glossa.fltr.ucl.ac.be/ GlossaNet]
-*[http://hometown.aol.com/mit2haiti/JA-HC-kr.htm Haitian Creole corpus -Teknoloji pou lang kreyol]
-*[http://corpus.nytud.hu/mnsz/ Hungarian National Corpus]
-*[http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId=LDC95T20 Hansard French-English parallel corpus]
-*[http://www.ucl.ac.uk/english-usage/ice/avail.htm ICE corpora]
-*[http://korpus.pl/ IPI PAN Corpus of Polish]
-*[http://www.tu-chemnitz.de/phil/InternetGrammar/ Learner Behaviour on the Internet]
-*[http://muchmore.dfki.de/resources1.htm MuchMore Springer Bilingual Corpus]
-*[http://nl.ijs.si/ME/ MULTEXT-East: Multilingual Corpora for Eastern and Central European Languages]
-*[http://tcc.itc.it/people/forner/multilingualcorpora.html Multilingual Corpora: Available Resources]
-* [http://www.csse.monash.edu.au/~jwb/tanakacorpus.html Tanaka Corpus: Japanese-English sentence pairs]
-*[http://multisemcor.itc.it MultiSemCor]
-*[http://www.ims.uni-stuttgart.de/info/Newspapers.html Newspapers on the Internet]
-*[http://logos.uio.no/opus/ OPUS - an open source parallel corpus]
-*[http://www.tekstlab.uio.no/Bosnian/Corpus.html Oslo Corpus of Bosnian]
-*[http://langbank.engl.polyu.edu.hk/indexl.html PolyU Language Bank]
-*[http://www.corpusdoportugues.org/ Portuguese Corpus]
-*[http://register.consilium.eu.int/ Public registry of the Council of the EU]
-*[http://www.ruscorpora.ru/ Russian National Corpus (RNK)]
-*[http://www.multilingual.com/allen51.htm The Bible as a Resource for Translation Software]
-*[http://www.cogsci.ed.ac.uk/elsnet/eci.html The ECI Multilingual corpus]
-*[http://www.fida.net/ Slovenian Corpus FIDA] and [http://www.fidaplus.net/ FIDA+]
-*[http://www.corpusdelespanol.org/ Spanish Corpus]
-*[http://www.unhchr.ch/udhr/index.htm UN declaration of human rights in multiple languages]
-*[http://www-igm.univ-mlv.fr/~unitex/ UNITEX]
-*[http://www.u-grenoble3.fr/kraif/liens.htm Useful links about parallel corpora, by Olivier Kraif]
-*[http://wacky.sslmit.unibo.it/ WaCky Project]
-*[http://www.wortschatz.uni-leipzig.de/html/wliste.html Wortlisten: spoken German, English, French, and Dutch]
-==Russian==
+*[http://www.dcs.gla.ac.uk/idom/ir_resources/linguistic_utils/stop_words List of stop words]
+*[http://korpus.pl/index.php?page=poliqarp Poliqarp] - open source XML-aware indexer, search engine and concordancer
-*[http://www.sfb441.uni-tuebingen.de/b1/korpora.html Russian Corpora]
+*[http://www.sketchengine.co.uk/ The Sketch Engine]
-*[http://rykov-cl.narod.ru/r.html Russian Corpora]
+*[http://www.cis.upenn.edu/~treebank/tokenization.html Treebank tokenization scheme]
-*[http://www.ruscorpora.ru/ Russian Corpus Page]
-*[http://lib.ru/ Russian Corpus Site]
-*[http://www.ng.ru Russian Corpus Site]
-*[http://www.philol.msu.ru/~lex/corpus/ Russian Newspaper Corpus]
-*[http://schools.keldysh.ru/uvk1838/Sciper/volume2/langres/russiclr.htm Russicon Resources]
-==Slovak==
-*[http://korpus.juls.savba.sk/index.en.html Slovak National Corpus]
+[[Category:Corpora|*]]

Difference between revisions of "Corpora for English"

Revision as of 13:33, 8 March 2015

Link collections

Corpora tools

Navigation menu

Search