Visual memory for agents and their actions

Humans spend a considerable amount of time remembering other individuals’ actions. Nevertheless, it is unclear how the visual system stores information about the identities of agents and their actions. To address this, I used a change detection method where observers were asked to remember agents and the actions they performed. Results show that observers can maintain information about both 2–3 agents and 2–3 actions simultaneously. However, they are highly impaired for remembering which agent performed which action, indicating that agent and action information are retained separately in visual working memory. Further experiments show that agent and action information can be bound together when the visual input contains the appropriate cues. However, this binding process significantly reduces the total amount of information that can be retained. Together, these results show that (1) an additional, resource-demanding process is needed to integrate agent and action information stored in separate working memory stores, and (2) the extent to which these two types of information are bound into integrated units depends largely on the presence of specific cues in the visual input.