Combined linguistic and sensor models for machine learning

This work builds on a cognitive theory called dynamic logic and considers the relationship between language and cognition. We explore the idea of dual models that combine linguistic and sensor features. We demonstrate that simultaneous learning of textual and image data results in formation of meaningful concepts and subsequent improvement in concept recognition.