Title :
Eight Times Acceleration of Geospatial Data Archiving and Distribution on the Grids
Author :
Wang, Frank Z. ; Helian, Na ; Wu, Sining ; Guo, Yike ; Deng, Derek Yuhui ; Meng, Lingkui ; Zhang, Wen ; Crowncroft, Jon ; Bacon, Jean ; Parker, Michael Andrew
Author_Institution :
Cambridge-Cranfield High Performance Comput. Facility, Centre for Grid Comput., Cranfield
fDate :
5/1/2009 12:00:00 AM
Abstract :
A grid-powered Web Geographical Information Science (GIS)/Web Processing Service (WPS) system has been developed for archiving and distributing large volumes of geospatial data. However, users, WPS servers, and data resources are always distributed across different locations, attempting to access and archive geospatial data from a GIS survey via conventional Hypertext Transport Protocol, Network File System Protocol, and File Transfer Protocol, which often encounters long waits and frustration in wide area network (WAN) environments. To provide a ldquolocal-likerdquo performance, a WAN/grid-optimized protocol known as ldquoGridJetrdquo developed at our lab was used as the underlying engine between WPS servers and clients, which utilizes a wide range of technologies including the one of paralleling the remote file access. No change in the way of using software is required since the multistreamed GridJet protocol remains fully compatible with the existing IP infrastructures. Our recent progress includes a real-world test that PyWPS and Google Earth over the GridJet protocol beat those over the classic ones by a factor of two to eight, where the distribution/archiving distance is over 10 000 km.
Keywords :
Internet; geographic information systems; geophysical techniques; geophysics computing; grid computing; protocols; remote sensing; File Transfer Protocol; GIS survey; Geographical Information Science; Grid jet protocol; IP infrastructure; Network File System Protocol; WAN environment; WPS system; Web Processing Service; conventional Hypertext Transport Protocol; data resource; geospatial data; grid-optimized protocol; wide area network; Bulk data transfer; Web Processing Service (WPS); data archiving; geodata set; grid computing;
Journal_Title :
Geoscience and Remote Sensing, IEEE Transactions on
DOI :
10.1109/TGRS.2008.2010055