Analyzing the behavior and reliability of voting systems comprising tri-state units using enumerated simulation

Voting is a common technique used in combining results from peer experts, for multiple purposes, and in a variety of domains. In distributed decision making systems, voting mechanisms are used to obtain a decision by incorporating the opinion of multiple units. Voting systems have many applications in fault tolerant systems, mutual exclusion in distributed systems, and replicated databases. We are specifically interested in voting systems as used in decision-making applications. In this paper, we describe a synthetic experimental procedure to study the behavior of a variety of voting system configurations using a simulator to: analyze the state of each expert, apply a voting mechanism, and analyze the voting results. We introduce an enumerated-simulation approach and compare it to existing mathematical approaches. The paper studies the following behaviors of a voting system: (1) the reliability of the voting system, R; (2) the probability of reaching a consensus, Pc; (3) certainty index, T; and (4) the confidence index, C. The configuration parameters controlling the analysis are: (1) the number of participating experts, N, (2) the possible output states of an expert, and (3) the probability distribution of each expert states. We illustrate the application of this approach to a voting system that consists of N units, each has three states: correct (success), wrong (failed), and abstain (did not produce an output). The final output of the decision-making (voting) system is correct if a consensus is reached on a correct unit output, abstain if all units abstain from voting, and wrong otherwise. We will show that using the proposed approach, we can easily conduct studies to unleash several behaviors of a decision-making system with tri-state experts.