- -

Improving the Reproducibility of PAN s Shared Tasks

RiuNet: Institutional repository of the Polithecnic University of Valencia

Share/Send to

Cited by

Statistics

Improving the Reproducibility of PAN s Shared Tasks

Show simple item record

Files in this item

dc.contributor.author Potthast, Martin es_ES
dc.contributor.author Gollub, Tim es_ES
dc.contributor.author Rangel, Francisco es_ES
dc.contributor.author Rosso, Paolo es_ES
dc.contributor.author Stamatatos, Efstathios es_ES
dc.contributor.author Stein, Benno es_ES
dc.date.accessioned 2015-05-06T08:51:19Z
dc.date.available 2015-05-06T08:51:19Z
dc.date.issued 2014
dc.identifier.isbn 978-3-319-11381-4
dc.identifier.issn 0302-9743
dc.identifier.uri http://hdl.handle.net/10251/49756
dc.description.abstract This paper reports on the PAN 2014 evaluation lab which hosts three shared tasks on plagiarism detection, author identification, and author profiling. To improve the reproducibility of shared tasks in general, and PAN’s tasks in particular, the Webis group developed a new web service called TIRA, which facilitates software submissions. Unlike many other labs, PAN asks participants to submit running softwares instead of their run output. To deal with the organizational overhead involved in handling software submissions, the TIRA experimentation platform helps to significantly reduce the workload for both participants and organizers, whereas the submitted softwares are kept in a running state. This year, we addressed the matter of responsibility of successful execution of submitted softwares in order to put participants back in charge of executing their software at our site. In sum, 57 softwares have been submitted to our lab; together with the 58 software submissions of last year, this forms the largest collection of softwares for our three tasks to date, all of which are readily available for further analysis. The report concludes with a brief summary of each task. es_ES
dc.description.sponsorship This work was partially supported by the WIQ-EI IRSESproject (Grant No. 269180) within the FP7 Marie Curie action. es_ES
dc.language Inglés es_ES
dc.publisher Springer Verlag (Germany) es_ES
dc.relation.ispartof Information Access Evaluation. Multilinguality, Multimodality, and Interaction: 5th International Conference of the CLEF Initiative, CLEF 2014, Sheffield, UK, September 15-18, 2014. Proceedings. es_ES
dc.relation.ispartofseries Lecture Notes in Computer Science;8685
dc.rights Reserva de todos los derechos es_ES
dc.subject CLEF es_ES
dc.subject.classification LENGUAJES Y SISTEMAS INFORMATICOS es_ES
dc.title Improving the Reproducibility of PAN s Shared Tasks es_ES
dc.type Capítulo de libro es_ES
dc.identifier.doi 10.1007/978-3-319-11382-1_22
dc.relation.projectID info:eu-repo/grantAgreement/EC/FP7/269180/EU/Web Information Quality Evaluation Initiative/ es_ES
dc.rights.accessRights Abierto es_ES
dc.contributor.affiliation Universitat Politècnica de València. Departamento de Sistemas Informáticos y Computación - Departament de Sistemes Informàtics i Computació es_ES
dc.description.bibliographicCitation Potthast, M.; Gollub, T.; Rangel, F.; Rosso, P.; Stamatatos, E.; Stein, B. (2014). Improving the Reproducibility of PAN s Shared Tasks. En Information Access Evaluation. Multilinguality, Multimodality, and Interaction: 5th International Conference of the CLEF Initiative, CLEF 2014, Sheffield, UK, September 15-18, 2014. Proceedings. Springer Verlag (Germany). 268-299. https://doi.org/10.1007/978-3-319-11382-1_22 es_ES
dc.description.accrualMethod S es_ES
dc.relation.publisherversion http://link.springer.com/chapter/10.1007/978-3-319-11382-1_22 es_ES
dc.description.upvformatpinicio 268 es_ES
dc.description.upvformatpfin 299 es_ES
dc.type.version info:eu-repo/semantics/publishedVersion es_ES
dc.relation.senia 286104
dc.contributor.funder European Commission es_ES


This item appears in the following Collection(s)

Show simple item record