Processes and Problems in the Formative Evaluation of an Interface to the Foundational Model of Anatomy Knowledge Base

Shapiro, Linda G and Chung, Emily and Detwiler, Landon T and Mejino, Jose L V and Agoncillo, Augusto V and Brinkley, James F and Rosse, Cornelius (2005) Processes and Problems in the Formative Evaluation of an Interface to the Foundational Model of Anatomy Knowledge Base. Journal of the American Medical Informatics Association, 12 (1). pp. 35-46.

[img] Text
Emily_JAMIA_paper.pdf

Download (511kB)

Abstract

The Digital Anatomist Foundational Model of Anatomy (FMA) is a large semantic network of more than 100,000 terms that refer to the anatomical entities, which together with 1.6 million structural relationships symbolically represent the physical organization of the human body. Evaluation of such a large knowledge base by domain experts is challenging because of the sheer size of the resource and the need to evaluate not just classes but also relationships. To meet this challenge, the authors have developed a relation-centric query interface, called Emily, that is able to query the entire range of classes and relationships in the FMA, yet is simple to use by a domain expert. Formative evaluation of this interface considered the ability of Emily to formulate queries based on standard anatomy examination questions, as well as the processing speed of the query engine. Results show that Emily is able to express 90% of the examination questions submitted to it and that processing time is generally 1 second or less, but can be much longer for complex queries. These results suggest that Emily will be a very useful tool, not only for evaluating the FMA, but also for querying and evaluating other large semantic networks.

Item Type: Article
Uncontrolled Keywords: medical ontology controlled terminology query engine
Subjects: All Projects > Emily
Depositing User: Jim Brinkley
Date Deposited: 08 Mar 2005
Last Modified: 19 Jul 2017 03:39
URI: http://sigpubs.si.washington.edu/id/eprint/168

Actions (login required)

View Item View Item