Title :
A parallel lexical analyzer for multi-core machines
Author :
Barve, Amit ; Joshi, Brijendra Kumar
Author_Institution :
CSE, Malwa Inst. of Technol., Indore, India
Abstract :
Lexical analysis is the first and foremost step in the compilation process. The basic aim of this step is to convert stream of characters / symbols into words called tokens. These tokens are used by the other phases of a compiler. Many tools have been developed in the past that generate the tokenizer automatically. These tools are best suited for sequential processing. With the advent of multi-core processors it is possible to parallelize tokenization by exploiting the parallel constructs of the languages. In this paper we propose a parallel lexical analyzer which exploits loops and processor affinity concept to achieve parallelism in lexical analysis on multi-core machines. The results show substantial improvement in lexical analysis phase as compared to sequential version.
Keywords :
language translation; multiprocessing systems; program compilers; word processing; automatic parallelize tokenizer generation; character stream convertion; compilation process; language parallel construction; loop affinity; multicore machines; parallel lexical analyzer; processor affinity; sequential processing; symbol stream convertion; Algorithm design and analysis; Companies; Flexible printed circuits; Kernel; Parallel processing; Program processors; USA Councils; Multi-core; Parallel Lexical Analysis; Processor Affinity Flex;
Conference_Titel :
Software Engineering (CONSEG), 2012 CSI Sixth International Conference on
Conference_Location :
Indore
Print_ISBN :
978-1-4673-2174-7
DOI :
10.1109/CONSEG.2012.6349505