Jun 27 2008
From Drago Radev, ACL Secretary
Here are some statistics that I had promised to send out. They show, for papers in the Anthology, the numbers of citations to other papers by publication type (P=ACL, W=WS, J=CLJ, A=ANLP, N=NAACL, E=EACL, H=HLT, I=IJCNLP).
Here is how to read this table. For example, all ACL05 papers combined included a total of 849 citations to other Anthology papers. Of these, 512 were to other conference papers, 191 were to workshop papers, and 143 were to (CL) journal papers.
I haven't (yet) calculated the impact factors of each conference and the journal using the Anthology data. However, one set of statistics is worth pointing out, namely that 75% of all citations in the journal to other Anthology papers go to conference and workshop papers and that 85% of all citations in ACL proceedings go to conference and workshop papers. In other words, a typical ACL/CL paper cites 4-5 times as many conference/ws papers than journal papers.
My conclusion, as stated at the exec meeting, is that in terms of advancing our field, conference and workshop papers are quite significant and we should treat them as such. In the sense of impact, our conference papers are indeed comparable to journal papers.
I expect objections, e.g., looking at the average number of citations per conference vs. journal paper N years down the road, etc. I will be happy to compute such statistics if needed. Also, the Anthology only includes the CL journal and not JNLE, etc. but again it doesn't include AAAI and SIGIR either.