Integration of language kind image processing for assembly instruction manual understanding

Assembly Instruction Manuals usually consist of both explanation and illustration. An expart who has rich knowledge on mechanical assemblies is able to under stand illustration without reading explanation. It is, how ever, difficult for a novice to read an instruction manual without referring to both of them. People may probably read explanation and see illustration alternately. It is difficult to model the human method because switching between two processes depends on knowledge level. In this paper, a method is proposed as the first version for integrating interpretation by both explanation and illustration.