A systematic review of transparency in the methods of expert knowledge use

The use of expert knowledge (EK) as an alternative to empirical data is increasing in the ecological disciplines in response to the growing need for rapid decisions that are embraced by local communities and implemented under strong resource constraints. Despite this increasing use, the validity of EK as a data source is still questioned by some who label it as biased or unreliable. Transparency in the methods applied in the use of EK allows confirmation of methodological rigour and study repeatability; key steps towards promoting the acceptance of EK as a valid data source. However, the practiced levels of methodological transparency in EK use are currently unknown in the ecological disciplines. To fill this knowledge gap, we performed a systematic review of transparency in methods applied in the use of EK, focusing on research in forest ecology and management as a case study. Covering the period from 1990 to 2016, we identified 296 publications that employed EK, which were assessed for their reporting on 15 methodological criteria of EK use. Our results indicate that transparency in the use of EK is generally very low, with only three out of 15 methodological criteria addressed in more than 50% of publications. Nevertheless, overall reporting on EK methods, and the reporting of four individual methodological criteria, were positively affected by publication year, suggesting that researchers increasingly recognize the importance of transparency in the use of EK methods. Synthesis and applications. Given the growing use of expert knowledge (EK) in the ecological disciplines, there is an urgent need to further its acceptance as a valid data source. To achieve this goal, researchers need to be more diligent in following best practices and reporting on EK methods. We therefore present a proposed set of guidelines for the reporting of EK methods. However, journal editors and reviewers also can play an important role in reaching this goal by requiring authors to transparently report on EK methods, just as they would expect for the use of empirical data.