Utilising Multimodal Interaction Metaphors in E-learning Applications: An Experimental Study

This paper describes an experimental study conducted to investigate the use of multimodal metaphors to communicate information in the interface of e-learning applications. This investigation involved developing two different interface versions of the experimental e-learning tool. In the first interface, only text with graphics was used to deliver learning information about class diagram notation. The second version of the experimental tool offered a combination of multimodal metaphors such as recorded speech, earcons, and avatar with simple facial expressions to communicate the same information. The usability aspects (efficiency, effectiveness, and user satisfaction) of the two interfaces were then evaluated by two independent groups of users; control group and experimental group. The obtained results showed that the multimodal e-learning interface group significantly taken lower time to complete the experimental tasks, performed successfully higher number of tasks, and was more satisfied than the text with graphics e-learning interface group.