Capacity Evaluation of Multi-modal Network Notification Service

A notification service alerts a large number of recipients to attend to important or emergency events. Prompt notification using multiple modes is critical to handle a disaster. This paper proposes an "escalation hierarchy" method as an enhancement to the combinatorial testing approach to provide capacity evaluation of a notification service involving interaction of multiple factors. Our trial of the method on an industrial large-scale notification service showed the effectiveness of our method in reducing testing efforts through automating both consistency checking of measurement data and identification of causes for capacity overflow.