Skip to content

BMJ and Findzebra use cases in a computable format

We formatted these resources to generate a set of relevance judgements for the evaluation of Clinical Decision Support Systems in the field of Rare Diseases. We merged two originally published BMJ and IJMI data sets in a convenient and interoperable format following TREC standards (QREL). Such a benchmark is appropriate to assess the effectiveness of the WeIRD diagnosis support system.

These data are compiled based on 1 and 2

  1. Radu Dragusin, Paula Petcu, Christina Lioma, Birger Larsen, Henrik L. Jørgensen, Ingemar J. Cox, Lars Kai Hansen, Peter Ingwersen, and Ole Winther. Findzebra: a search engine for rare diseases. International Journal of Medical Informatics, 82(6):528–538, 2013. URL:, doi:

  2. Hangwi Tang and Jennifer Hwee Kwoon Ng. Googling for a diagnosis—use of google as a diagnostic aid: internet based study. BMJ, 333(7579):1143–1145, 2006. URL:, arXiv:, doi:10.1136/bmj.39003.640567.AE