Researches on real-time satellite data flow processing based on file buffer

In the field of aerospace, all of real-time data sent by satellites and spaceships need to be stored into a relational database, and it is essential to develop real-time applications in order to implement the storing process automatically. Based on the implementation of a real-time satellite data flow storing application, this paper introduces features of real-time satellite data processing problem, and design architecture of pipeline-filter style as the framework of the application. As the indeterminacy of duration of insert operation in non-real-time database and the limited memory in the server, a method using the file to implement blocking queue for fault-tolerance is designed. With the pipeline/filter architecture design and the file blocking queue buffer method, a detail of implementation and an overall solution of application deployment are provided. In order to verify that the method of the file blocking queue has a better performance than that of the memory blocking queue, a comparative experiment simulating a real environment is designed. Our work proves that it is feasible and rational to use the file buffer in the specific application including non-real-time factors; in addition a non-real-time database can be used in the field of real-time with the proper mechanism of fault-tolerance.