Full spectrum camera simulation for reliable virtual development and validation of ADAS and automated driving applications

Cameras are an essential component of many Advanced Driver Assistance Systems (ADAS) such as Lane Departure Warning, Lane Keeping Assistance, Automatic Emergency Braking, Traffic Sign Recognition and Night Vision. With the ongoing evolution of ADAS towards Automated Driving, the amount of cameras installed in a vehicle is expected to increase. At the same time, the performance of such cameras needs to match more stringent requirements. Nowadays automotive cameras are typically sensitive beyond the visual range (i.e. into the near infrared range). They may also use up to 20 bits precision for their internal signal. In order to support the development process of ADAS and Automated Driving Systems by means of simulation, it is required to have detailed physically correct simulation models of these automotive cameras. This paper describes the need for physics-based simulation and introduces a new spectral HDR camera model in the ADAS simulation platform PreScan. The traditional RGB-based camera implementation created images limited to the visual spectrum. In contrast, the new PreScan spectral camera model allows for high color depth, broad spectrum and physically correct image generation. The model provides a real-time simulation of light in the 320-1500nm spectral range which traverses through the various media and lenses before the sensor produces the final image signal. Other important features of this new spectral HDR camera model are a depth resolution of 20 bit per waveband as well as an increased dynamic range.