TY - GEN
T1 - The impact of limited search procedures for systematic literature reviews - A participant-observer case study
AU - Kitchenham, Barbara
AU - Brereton, Pearl
AU - Turner, Mark
AU - Niazi, Mahmood
AU - Linkman, Stephen
AU - Pretorius, Rialette
AU - Budgen, David
PY - 2009
Y1 - 2009
N2 - This study aims to compare the use of targeted manual searches with broad automated searches, and to assess the importance of grey literature and breadth of search on the outcomes of SLRs. We used a participant-observer multi-case embedded case study. Our two cases were a tertiary study of systematic literature reviews published between January 2004 and June 2007 based on a manual search of selected journals and conferences and a replication of that study based on a broad automated search. Broad searches find more papers than restricted searches, but the papers may be of poor quality. Researchers undertaking SLRs may be justified in using targeted manual searches if they intend to omit low quality papers; if publication bias is not an issue; or if they are assessing research trends in research methodologies.
AB - This study aims to compare the use of targeted manual searches with broad automated searches, and to assess the importance of grey literature and breadth of search on the outcomes of SLRs. We used a participant-observer multi-case embedded case study. Our two cases were a tertiary study of systematic literature reviews published between January 2004 and June 2007 based on a manual search of selected journals and conferences and a replication of that study based on a broad automated search. Broad searches find more papers than restricted searches, but the papers may be of poor quality. Researchers undertaking SLRs may be justified in using targeted manual searches if they intend to omit low quality papers; if publication bias is not an issue; or if they are assessing research trends in research methodologies.
UR - https://www.scopus.com/pages/publications/72549119237
U2 - 10.1109/ESEM.2009.5314238
DO - 10.1109/ESEM.2009.5314238
M3 - Conference contribution
AN - SCOPUS:72549119237
SN - 9781424448418
T3 - 2009 3rd International Symposium on Empirical Software Engineering and Measurement, ESEM 2009
SP - 336
EP - 345
BT - 2009 3rd International Symposium on Empirical Software Engineering and Measurement, ESEM 2009
ER -