Fifth International Workshop on Evaluating Information Access, a Satellite Workshop of NTCIR-10

Event Notification Type: 
Call for Papers
Abbreviated Title: 
EVIA 2013
Tuesday, 18 June 2013
William Webber
Ruihua Song
Submission Deadline: 
Wednesday, 20 March 2013

***** CALL FOR PAPERS *****

The Fifth International Workshop on Evaluating Information
Access (EVIA 2013), a Satellite Workshop of NTCIR-10

June 18, 2013 at NII, Tokyo, Japan.

Information Access technologies provide the interface between
human information needs and digital information resources. The
reliable evaluation of these technologies has been recognized for
decades as central to the advancement of the field. As information
retrieval becomes more pervasive, the forms of retrieval
more diverse, and retrieval tools richer, the importance of
effective, efficient, and innovative evaluation grows as well.
In recognition of the need for a forum dedicated to the intensive
discussion of evaluation issues, we have held four successful
sesquiannual International Workshops on Evaluating Information Access (EVIA
2007, 2008, 2010, and 2011). Proceedings and reports can be found below:

EVIA 2007 online proceedings:
EVIA 2008 online proceedings:
EVIA 2010 online proceedings:
EVIA 2011 online proceedings:

Following these successes, we are happy to announce the Fifth
International Workshop on Evaluating Information Access (EVIA
2013) on June 18, 2013 (coinciding with Day 1 of the NTCIR-10
Workshop Meeting) at the National Institute of Informatics (NII),
Tokyo, Japan. We invite papers addressing one or more of the
following topics:

- Test collection formation, evaluation metrics, and evaluation
- Statistical issues in retrieval evaluation
- User studies and the evaluation of human-computer interaction
in information retrieval (HCIR)
- Evaluation methods for multilingual, multimedia, or mobile
information access
- Novel information access tasks and their evaluation
- Evaluation and assessment using implicit user feedback,
crowdsourcing, living labs, or inferential methods
- Evaluation issues in industrial and enterprise retrieval


Submissions will be subject to double-blind reviewing. Accepted
papers will be included in the EVIA 2013 online proceedings.

We invite submissions of regular papers (up to 8 pages) and
short papers (up to 4 pages). Submissions must be in ACM
Conference style and must be submitted as pdf files.

Templates are available at:

For Latex users, please use the "Option 2" style.

Submissions must be made through the EVIA 2013 submission management


- March 20, 2013 *submissions due*
- April 24, 2013 notification of acceptance
- May 8, 2013 final manuscripts due
- June 18, 2013 EVIA 2013@NII, Tokyo, Japan
- June 18-21, 2013 NTCIR-10@NII, Tokyo, Japan


Ben Carterette University of Delaware USA
Charles L. A. Clarke University of Waterloo Canada
Atsushi Fujii Tokyo Institute of Technology Japan
Donna Harman NIST USA
Hideo Joho University of Tsukuba Japan
Gareth Jones Dublin City University Ireland
Noriko Kando NII Japan
Evangelos Kanoulas Google Switzerland
Tetsuya Sakai Microsoft Research Asia China
Mark Sanderson RMIT University Australia
Falk Scholer RMIT University Australia
Ian Soboroff NIST USA
Ruihua Song Microsoft Research Asia China
Paul Thomas CSIRO Australia
William Webber University of Maryland USA

*** EVIA 2013 CO-CHAIRS ***

William Webber (University of Maryland, United States)

Ruihua Song (Microsoft Research Asia, Beijing, China)