A brief review: Groupware evaluation by performance of specific tasks

Benchmarks are popular in many fields, but rare or absent in the CSCW research. Performance based evaluation would be a good choice if given a certain set of specific tasks. As the first step to promote a benchmark, we conduct this brief review about groupware evaluation by performance of specific tasks. Particularly, we collect commonly used specific tasks and classify them into four categories: hidden profile tasks, cognitive conflict tasks, trading tasks, and repair tasks. We also identify some challenges to achieve a benchmark.