Online experiments with the Percy software framework - experiences and some early results

Christoph Draxler


Abstract
In early 2012 the online perception experiment software Percy was deployed on a production server at our lab. Since then, 38 experiments have been made publicly available, with a total of 3078 experiment sessions. In the course of time, the software has been continuously updated and extended to adapt to changing user requirements. Web-based editors for the structure and layout of the experiments have been developed. This paper describes the system architecture, presents usage statistics, discusses typical characteristics of online experiments, and gives an outlook on ongoing work. webapp.phonetik.uni-muenchen.de/WebExperiment lists all currently active experiments.
Anthology ID:
L14-1459
Volume:
Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
Month:
May
Year:
2014
Address:
Reykjavik, Iceland
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
235–240
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/564_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Christoph Draxler. 2014. Online experiments with the Percy software framework - experiences and some early results. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), pages 235–240, Reykjavik, Iceland. European Language Resources Association (ELRA).
Cite (Informal):
Online experiments with the Percy software framework - experiences and some early results (Draxler, LREC 2014)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/564_Paper.pdf