Reproduct ion and replication of research results are at the heart of the validation of scientific knowledge a nd of the scientific endeavor. But despite their k ey importance, reproduction and replication have n ot been sufficiently encouraged given the prevaili ng procedures and priorities for the reviewing, se lection and publication of research results. This workshop seeks to foster the discussion and the ad vancement on a topic that has been given insuffici ent attention in the research area of language pro cessing tools and resources and that has been an i mportant topic emerging in other scientific areas. The workshop will be collocated with LREC 2018 11 th Language Resources and Evaluation Conference.\n
We are nviting submissions o f articles that present cases, either with positiv e or negative results, of actual replication or re production exercises of previous published results in our area. We are interested also in articles d iscussing the challenges, the risk factors, the ap propriate procedures, etc. specific to our area or that should be adopted, or adapted from other nei ghboring areas, including methodologies for monito ring, maintaining or improving citation of languag e resources and tools and to assess the importance of data citation for research integrity. This inc ludes also of course the new risks raised by the r eplication articles themselves and their own integ rity, in view of the preservation of the reputatio n of colleagues and works whose results are report ed has having been replicated, etc.
\n