Evaluering av OpenAlex - Prosjektplan

In 2023, the team for Automation of Information Retrieval published the report: Aims, findings, and suggested target areas for automation of information retrieval: Final Report 2022. The team proposed to investigate the possibilities to automate and possibly streamline information retrieval for systematic reviews, health technology assessments and other evidence synthesis in the Cluster for Reviews and Health Technology Assessments at the Norwegian Institute of Public Health.

We will therefore investigate whether searching OpenAlex rather than traditional search sources can lead to a more efficient search process for evidence syntheses without reducing the sensitivity of the search results and quality of the synthesis.

We will

• map and present any studies that have investigated literature searches in OpenAlex or MAG (Microsoft Academic Graph)

• examine published evidence syntheses from the Cluster for Reviews and Health Technology Assessments that include both a traditional search and searches in OpenAlex or MAG. We will examine 1) whether the two search methods separately identified the included studies, 2) if all the included studies in the evidence synthesis exist in OpenAlex, 3) what characterizes the studies that do not exist in OpenAlex, 4) difference in the number of hits for screening between the two searches, and 5) whether the searches have different specificity.

The results will be presented in tables and text.