Skip to content

BMJ and Findzebra use cases in a computable format

We formatted these resources to generate a set of relevance judgements for the evaluation of Clinical Decision Support Systems in the field of Rare Diseases. We merged two originally published BMJ and IJMI data sets in a convenient and interoperable format following TREC standards (QREL). Such a benchmark is appropriate to assess the effectiveness of the WeIRD diagnosis support system.

These data are compiled based on 1 and 2

  1. Radu Dragusin, Paula Petcu, Christina Lioma, Birger Larsen, Henrik L. Jørgensen, Ingemar J. Cox, Lars Kai Hansen, Peter Ingwersen, and Ole Winther. Findzebra: a search engine for rare diseases. International Journal of Medical Informatics, 82(6):528–538, 2013. URL: https://www.sciencedirect.com/science/article/pii/S1386505613000166, doi:https://doi.org/10.1016/j.ijmedinf.2013.01.005. ↩

  2. Hangwi Tang and Jennifer Hwee Kwoon Ng. Googling for a diagnosis—use of google as a diagnostic aid: internet based study. BMJ, 333(7579):1143–1145, 2006. URL: https://www.bmj.com/content/333/7579/1143, arXiv:https://www.bmj.com/content/333/7579/1143.full.pdf, doi:10.1136/bmj.39003.640567.AE. ↩