Text size
  • Small
  • Medium
  • Large
  • Standard
  • Blue text on blue
  • High contrast (Yellow text on black)
  • Blue text on beige

    Preliminary Reporting Guidelines for Experience Papers

    13th International Conference on Evaluation and Assessment in Software Engineering (EASE)

    Durham University, UK, 20 - 21 April 2009


    David Budgen, Cheng Zhang


    Context: When undertaking a systematic literature review or a mapping study software engineering, it is likely that only a small set of experimental studies will be available. In conducting a mapping study on the theme of software design patterns, we found only 11 papers describing experiments that studied the use of patterns.

    Objectives: To investigate whether we could obtain further evidence by examining the experiences offered in papers that were essentially observational in nature. To use this experience to suggest how such studies can best be reported.

    Method: We identified suitable studies from those identified in our systematic search and undertook data extraction from them. We then analysed those that were of most use, to identify what characteristics made their reporting useful.

    Results: We found 18 experience papers, but after analysis, this set was reduced to four. Only one of these provided a clear link between practical experiences and the lessons they reported. Our preliminary reporting guidelines are based upon both good and poor papers, as well as the guidelines proposed for other forms of empirical study.

    Conclusions: We draw upon our experiences of data extraction, and of the one good example to suggest reporting guidelines for experience papers.


    PDF filePDF Version of this Paper (81kb)