تشخيص پوشش گياهي شهري مبتني بر ادغام در سطح تصميمات داده هاي ليدار و تصاوير فراطيفي

Urban Vegetation Recognition Based on the Decision Level Fusion of Hyperspectral and Lidar Data

استفاده از داده ­هاي سنجش از دور به منظور كسب آگاهي و دانش در رابطه با پوشش ­گياهي نواحي شهري و سلامت آن­ها، به دليل اهميت زياد گياهان همواره مورد توجه مديران بوده است. در اين تحقيق، از ادغام دو داده فراطيفي و ليدار به منظور تشخيص و طبقه بندي انواع گونه­ هاي گياهي در مناطق شهري استفاده شده است. اطلاعات طيفي حاصل از داده­ هاي فراطيفي به ­منظور طبقه­ بندي عوارض پوشش گياهي استفاده مي ­شود، اما به علت شباهت طيفي گونه ­هاي مختلف ­گياهي با يكديگر و با ساير عوارض شهري امكان بروز اشتباهاتي وجود دارد كه استفاده از اطلاعات ارتفاعي حاصل از داده ليدار به ­منظور رفع آن، مي ­تواند بسيار كارآمد باشد. روش پيشنهادي ادغام داده ­ها مبتني بر بكارگيري قابليت سيستم­ هاي چندعاملي در حيطه هوش مصنوعي توزيع يافته به عنوان راهكاري براي ادغام داده ­هاي فراطيفي و ليدار در سطح تصميمات و بهبود نتايج طبقه بندي و تشخيص انواع عوارض پوشش گياهي شهري است. هر يك از عامل­هاي مكان-مبناي تعريف شده در اين سيستم براساس اطلاعات طيفي مستخرج از داده فراطيفي و اطلاعات ارتفاعي حاصل از داده ليدار وظيفه شناسايي و استخراج يك نوع عارضه پوشش گياهي خاص را برعهده دارند. در نهايت، عامل هماهنگ كننده ضمن شناسايي نواحي كانديداي مورد تناقض، با همكاري عامل­ هاي مكان-مبناي تشخيصي سعي در برطرف نمودن مشكلات مربوط به شباهت طيفي و ارتفاعي عوارض شهري در نتايج طبقه بندي مي­ نمايد. نتايج بدست آمده حاصل از اعمال اين سيستم چندعاملي ادغام در سطح تصميمات بر روي داده­ هاي فراطيفي و ليدار برداشت شده از منطقه دانشگاه هيوستون و نواحي اطراف، نشان دهنده توانايي بالاي اين روش در تشخيص عوارض پوشش ­گياهي است. ارزيابي اين نتايج نشان داد كه دقت كلي در نتايج حاصل از سيستم چندعاملي براي حالتي كه از داده فراطيفي به تنهايي استفاده شده است، حدود 71% است و در حالتي كه از ادغام داده فراطيفي و ليدار استفاده شود، حدود 87% است.

Introduction: Information about vegetation cover and their health has always been interesting to ecologists due to its importance in terms of habitat, energy production and other important characteristics of plants on the earth planet. Nowadays, developments in remote sensing technologies caused more remotely sensed data accessible to researchers. The combination of these data improves the object classification and recognition results. Recently, hyperspectral and Lidar data has been used for vegetation covers classification. The spectral information derived from hyperspectral data is used to classify and identify the vegetation cover. However; due to the spectral similarities between various vegetation types, false positive results are increased. Using relief information extracted from Lidar data can solve these kinds of errors and can be very efficient for improving the object recognition results. Spectral similarities and spatial adjacencies between various kinds of objects, shadow and occluded areas behind high rise objects as well as the complex relationships between various object types lead to the difficulties and ambiguities in vegetation recognition among other objects in urban areas. Therefore, new procedures and higher levels of modifications should be considered for improving the object recognition results. In recent years, the multi-agent systems have been considered as one of the most powerful tools for solving the problems of automatic object recognition in urban areas. Method: According to the difficulties of vegetation recognition in complex urban areas, the proposed object recognition in this paper is a decision level fusion strategy between hyperspectral and Lidar data based on the capabilities of the multi-agent systems. Vegetation indices from hyperspectral image are used as spectral features in the knowledge base. Moreover, digital surface model which is produced from Lidar data is used for height features extraction. After producing a rich knowledge base containing the spectral and height based features, the proposed hierarchical classification is performed which is composed of two steps; step 1: initial vegetation candidate recognition, step 2: vegetation classification based on the capabilities of the multi-agent systems. Applying the optimum thresholds on the normalized difference vegetation index in the first step produces a binary image containing the initial vegetation candidates. The multi-agent system in the second step of the proposed method in this paper contains several object recognition agents (one agent per each vegetation cover type), a coordinator agent and a yellow page. The object recognition agents have three layered internal architecture and use the belief-desire-intention (BDI) reasoning model. Results: The capabilities of the proposed multi-agent vegetation recognition algorithm in this paper is evaluated based on the hyperspectral and Lidar data collected from the University of Houston and the surrounding areas. Four object recognition agents are defined for trees, healthy grass, water-stress grass and artificial grass. These four object recognition agents perform their reasoning based on the pre-defined spectral and height features in the knowledge base. The obtained results indicate the overall accuracy of about 87% from the proposed multi-agent hyperspectral and Lidar decision fusion strategy. The obtained results from performing the same multi-agent system only on the hyperspectral image (without considering Lidar data) have the overall accuracy for about 71%.