Skip Navigation
Lister Hill Center Logo  

Search Tips
About the Lister Hill Center
Innovative Research
Publications and Lectures
Training and Employment
LHNCBC: Document Abstract
Year: 2007Adobe Acrobat Reader
Download Free Adobe Acrobat Reader
LHNCBC-2007-068
Identification and Segmentation of Multi-Panel Images in Biomedical Journal Articles
Srinivasan B, Antani S, Demner-Fushman D, Thoma GR
Poster at 20th NIH Research Festival (BIOINFO-1), September 2007, National Institutes of Health
Essential information is often conveyed pictorially (images, illustrations, graphs, charts, etc.) in biomedical publications. Use of image information in search for evidence for clinical decision support may improve retrieval quality. In addition user experience may be improved by showing relevant images along with the bibliographic reference. Articles often contain multiple images in a single figure, called multi-panel images, which are often identified through subfigure labels, e.g., 'Figure 1(a), ... Figure 1(b), ...,' in the figure captions or text mentions. Single image panels are necessary, however, to classify image modality and annotate them for evidence-based utility. We present results for multi-panel image detection and segmentation based on image characteristics and application of Natural Language Processing techniques for parsing of figure captions. The latter are used as an estimate for initializing a two-phase algorithm. The method uses a progressive refinement approach that looks for strong white or black lines and sharp transitions between image panels at border separating pixels. Initial experiments on 516 figure images resulted in 95.54% accuracy in correctly identifying and segmenting the sub-images. The method also identifies potential segmentation errors and flags them for supervised segmentation.
PDF