This is an old revision of the document!
Module: Perception, Mapping, and Localization (Part 1)
| Study level | Bachelor |
|---|---|
| ECTS credits | 1 ECTS |
| Study forms | Hybrid or fully online |
| Module aims | To provide foundational and applied knowledge in perception, mapping, and localization for autonomous systems. Students will explore how sensor modalities (cameras, LiDAR, radar, GNSS, IMU) are combined to detect and interpret the environment, build and maintain maps, and determine vehicle position in real time. Emphasis is placed on AI-based perception methods, sensor fusion algorithms, and dealing with uncertainty in diverse conditions. The module connects theoretical foundations with practical techniques used in self-driving and robotic navigation systems. |
| Pre-requirements | Basic understanding of linear algebra, probability, and signal processing. Familiarity with Python or C++ programming, and fundamental knowledge of control systems and kinematics. Prior experience with Linux, ROS (Robot Operating System), or computer vision libraries (OpenCV, PyTorch, TensorFlow) is advantageous but not mandatory. |
| Learning outcomes | Knowledge • Describe perception, mapping, and localization processes in autonomous systems. • Explain principles of sensor fusion, simultaneous localization and mapping (SLAM), and global navigation techniques (GNSS, Visual Odometry). • Understand AI-based perception, including object detection, classification, and scene understanding. Skills • Implement basic perception and mapping algorithms using data from multiple sensors. • Apply AI models (e.g., CNNs) to detect and classify environmental objects. • Evaluate uncertainty and performance in localization and mapping using simulation tools. Understanding • Appreciate challenges of perception under varying environmental conditions. • Recognize the role of data quality, calibration, and synchronization in sensor fusion. • Adopt responsible practices when designing AI-driven perception modules for safety-critical applications. |
| Topics |
2. Sensor calibration, synchronization, and uncertainty modeling.
3. Principles of multi-sensor fusion (Kalman/Particle filters, deep fusion networks).
4. Object recognition and classification under variable conditions.
5. SLAM, Visual Odometry, and Global Navigation Satellite Systems (GNSS).
6. Map representation and maintenance for autonomous navigation.
7. CNNs, semantic segmentation, and predictive modeling of dynamic environments.
8. Perception under poor visibility, occlusions, and sensor noise.
9. Integration of perception and localization pipelines in ROS 2. |
| Type of assessment | The prerequisite of a positive grade is a positive evaluation of module topics and presentation of practical work results with required documentation |
|---|---|
| Learning methods | Lecture — Theoretical background on perception, mapping, and AI-based scene understanding. Lab works — Implementation of sensor fusion and mapping algorithms using ROS 2, Python, and simulated data. Individual assignments — Analysis of perception pipeline performance and report preparation. Self-learning — Study of academic papers, datasets (KITTI, NuScenes), and open-source AI perception frameworks. |
| AI involvement | AI tools can assist in code debugging, model training, and visualization of perception results. Students must cite AI-generated assistance transparently and verify the correctness of outcomes. |
| Recommended tools and environments | |
| Verification and Validation focus | |
| Relevant standards and regulatory frameworks |
