Title of article :
Development of Intellectual System for Data De-Duplication and Distribution in Cloud Storage
Author/Authors :
lytvyn, vasyl lviv polytechnic national university - information systems and network department, Lviv, Ukraine , vysotska, victoria lviv polytechnic national university - information systems and network department, Lviv, Ukraine , osypov, mykhailo lviv polytechnic national university - information systems and network department, Lviv, Ukraine , slyusarchuk, olha lviv polytechnic national university - mathematics department, Lviv, Ukraine , slyusarchuk, yuriy lviv polytechnic national university - institute of business and innovative technologies - information systems and technologies department, Lviv, Ukraine
Abstract :
The system for backing up the data is designed. Client software works on the computer of user, takes all the necessary files for backup, and turns them into Stream of bytes. Then breaks it into blocks (from 32 KB to 64KB) using a Rabin algorithm. It is based on hash ring that is absorbing every incoming byte if the current hash mask or equal to a certain reach 64KB, there is division committed. This approach helps to avoid is coping all data if thecontent of a file has changed in separately. For each data block client software calculates the hash. Then sends parts even 256 times or more of those hashes to the server and checks if they already know the system. The blocks are not known, refers to the server. As part of the de-duplication, data on distribution and cloud distribution occurs on hashes, hashes are SHA 1, so that 20 bytes are given in hexadecimal format. First number or letter and will serve key distribution. So essentially, you can evenly distribute the data among the workers from 2 to 16 pieces. You need to take the second number of hash, and more commit distribution.
Keywords :
Stochastic game , Clustering, Ontology , Knowledge base , Intelligent agent , Data Sharing , Data de , duplication, Data Hashing, Cloud Environment, Cloud computing, Rabin algorithm, Hybrid De , duplication