Automatic summarization of MEDLINE citations for evidence-based medical treatment: a topic-oriented evaluation.

TitleAutomatic summarization of MEDLINE citations for evidence-based medical treatment: a topic-oriented evaluation.
Publication TypeJournal Article
Year of Publication2009
AuthorsFiszman M, Demner-Fushman D, Kilicoglu H, Rindflesch TC
JournalJournal of biomedical informatics
Volume42
Issue5
Pagination801-13
Date Published2009 Oct
ISSN1532-0480
KeywordsArtificial Intelligence; Automatic Data Processing; Disease; Drug Therapy; Evidence-Based Medicine; Humans; Information Storage and Retrieval; Internet; Medical Informatics; MEDLINE; Natural Language Processing; Semantics; User-Computer Interface; Vocabulary, Controlled
Abstract

As the number of electronic biomedical textual resources increases, it becomes harder for physicians to find useful answers at the point of care. Information retrieval applications provide access to databases; however, little research has been done on using automatic summarization to help navigate the documents returned by these systems. After presenting a semantic abstraction automatic summarization system for MEDLINE citations, we concentrate on evaluating its ability to identify useful drug interventions for 53 diseases. The evaluation methodology uses existing sources of evidence-based medicine as surrogates for a physician-annotated reference standard. Mean average precision (MAP) and a clinical usefulness score developed for this study were computed as performance metrics. The automatic summarization system significantly outperformed the baseline in both metrics. The MAP gain was 0.17 (p<0.01) and the increase in the overall score of clinical usefulness was 0.39 (p<0.05).

DOI10.1016/j.jbi.2008.10.002
Alternate JournalJ Biomed Inform