Application and research of distributed crawler technology in the field of finance

In recent years, the application of quantitative investment in China stock market attracts more and more attention, and an important step in the quantitative investment is the acquisition of stock data, including each stocks daily data, markets daily data as well as the fundamental data, etc. There are more than two thousand shares in stock markets of Shanghai and Shenzhen, and each share´s data information is complicated and huge. For the person or organization who has studied in the field of quantitative investment, the way to obtain these data is particularly important. In view of the data acquisition, this paper studies the applicaton of distributed technology in the field of financial data acquisition.