Title :
Using a High-Fidelity Simulation Framework for Performance Singularity
Author :
Scrapper, C. ; Madhavan, R. ; Balakirsky, S.
Author_Institution :
Nat. Inst. of Stand. & Technol. (NIST), Gaithersburg
Abstract :
A common way to evaluate the performance of a system is to compare the algorithmic outputs with ground truth to identify divergences in the system´s performance and discover the errors it is prone to. In the absence of such ground truth or as a follow-on to performance evaluation, performance analysis at the algorithmic level can provide developers insight into performance singularities. Such performance singularity identification and testing provides real-time meta-data that allows developers to understand the impact of singularities on the overall performance of the system. As an example of the concepts developed in this paper, we present a navigation solution based on image registration algorithms and the methodology used for the identification and testing of performance singularities of this algorithm.
Keywords :
image registration; performance evaluation; high fidelity simulation framework; image registration algorithms; performance analysis; performance evaluation; performance singularity identification; system performance; Image registration; Mobile robots; NIST; Navigation; Performance analysis; Real time systems; Robot sensing systems; Robotics and automation; System performance; System testing; ICP; MOAST; USARSim; localization; performance metrics; scan-matching;
Conference_Titel :
Applied Imagery Pattern Recognition Workshop, 2007. AIPR 2007. 36th IEEE
Conference_Location :
Washington, DC
Print_ISBN :
978-0-7695-3066-6
DOI :
10.1109/AIPR.2007.24