Abstract:

Intelligent vehicle is a strategic focus of the global automotive industry. To meet new demands for experimental teaching in this field, we designed and constructed a camera-injection experimental platform. First, a virtual-physical integration scheme is implemented by combining simulation environments with an in-vehicle domain controller to define the overall architecture. Second, a camera simulation model is developed and virtually calibrated , on which a data link is built using GMSL2(Gigabit Multimedia Serial Link 2) and CSI-2 (Camera Serial Interface 2) protocols to enable seamless interaction between simulated video streams and controller hardware. Next, we quantized offline-trained deep-learning models, converted them into a universal format, and deployed them on the domain controller for real-time interaction with the virtual environment. Finally, this platform is used to provide students with an integrated theory-and-practice learning environment, deepening their understanding of camera principles and mastery of multi-channel video signal generation, transmission, and perception. This system effectively enhances students‘ practical skills and innovation capacity in intelligent vehicle technology.

Key words: intelligent vehicle, camera-injection experimental platform, virtual-physical integration, camera simulation model, experimental teaching