Input evaluation: A new mechanism for collecting data using games with a purpose

Collecting data through a game with a purpose (GWAP) has become a popular approach due to its numerous benefits. However, lack of diversity in game mechanisms puts some limitations on the areas of application of GWAPs. In this paper, we introduce a new two-phase mechanism for collecting data via human-based computation games. In the first phase, the players are provided with an object and asked to use that object within the domain of the game. In the second phase the players are provided with randomly selected data produced by the other players in the first phase and asked to evaluate them. A new game called “Dil Cambazi” that collects sentences containing passivized intransitive Turkish verbs using this mechanism is introduced and cases where input-evaluation mechanism is most useful are discussed.