Title :
Dynamic task allocation for formation air-to-ground attack
Author :
An Zhang ; Fengjuan Guo
Author_Institution :
Northwestern Polytech. Univ., Xi´an, China
Abstract :
In accordance with the allocation of random arriving tasks, queuing network is proposed and then utilized to establish combat model for air-to-ground attack of formation. With the methodology of Markov Decision Processes (MDP), the paper establishes the dynamic task assignment model under the complete information condition. Allowing for the issue of dynamic task allocation with incomplete information, load threshold and value function sharing mechanism are proposed. Afterwards, two layers Q-learning algorithm is presented in this context to establish the dynamic task allocation model, which aims to achieve the cooperation with in formation and between formations. The simulation result indicates that the model aforementioned can enhance the long-term profit value, as well as avoid omitting the target with bigger income. Furthermore, it sheds light on the study on the dynamic task allocation and combat effectiveness evaluation for air-to-ground attack of formation problem in theory and method.
Keywords :
Markov processes; autonomous aerial vehicles; decision theory; learning (artificial intelligence); military systems; queueing theory; random processes; MDP; Markov decision processes; UAV attack; air-to-ground attack formation; dynamic task allocation; dynamic task assignment model; load threshold; long-term profit value; queuing network; random arriving task allocation; two layers Q-learning algorithm; value function sharing mechanism; Atmospheric modeling; Resource management; Vehicles; Dynamic Task Allocation; Formation; MDP; Q-learning Algorithm;
Conference_Titel :
Advanced Computational Intelligence (ICACI), 2013 Sixth International Conference on
Conference_Location :
Hangzhou
Print_ISBN :
978-1-4673-6341-9
DOI :
10.1109/ICACI.2013.6748486