Teaching Vision‐based Control for Autonomous Driving with Lego Mindstorms EV3, Raspberry Pi and Simulink

Abstract

Lego Mindstorms is a popular platform to teach robotics in schools and colleges. Basic mechanical properties as well as programming concepts can be taught to students of various ages. However, there are limitations, for example the lack of a camera for vision-based control which is fundamental for autonomous applications like self-driving cars. Within the framework of a summer school, we solve this limitation by adding a webcam and a Raspberry Pi to the platform. The class is designed to teach undergraduate students mechanical principles, vision-based control and basic programming concepts in a project-based setting.