Trusted Sampling-Based Result Verification on Mass Data Processing

Computation integrity is difficult to verify when mass data processing is outsourced. Current integrity protection mechanisms and policies verify the results generated by participating nodes within a computing environment of service providers (SP), which can not preventing the subjective cheating of SPs. This paper provides an analysis and a modeling of computation integrity for mass data processing services. A third-party sampling-result verification method called trusted sampling-based third-party result verification (TS-TRV) is proposed to prevent lazy cheating by SPs. TS-TRV is a general solution for common computing jobs and uses the powerful computing capability of SPs to support verification computing, thus lessening the computing and transmission burden of the verifier. A series of simulation experiments and theoretical analysis indicates that TS-TRV is an effective method of detecting the cheating behavior of SP while ensuring the authenticity of sampling. Compared with the transmission overhead of naive sampling verification, which is O(N), the network transmission overhead of TS-TRV is only O(logN). TS-TRV efficiently solves the verification problem of the intermediate results in MapReduce-based mass data processing.