Natural Behaviour Predictor
The developed software is composed of three neural network models trained on a custom pedestrian trajectory prediction dataset created with Carla Simulator.
Check out our presentation movies and slides at: https://fmiunibuc-my.sharepoint.com/:u:/g/personal/ciprian_paduraru_fmi_unibuc_ro/EWnNIsBHtWNBuW8UUyvLWgwBLl26q8kGebvWW_baxbwlyQ?e=2F2DJw
Techniques employed
- Social LSTM Original Repository -> https://github.com/quancore/social-lstm
- Social GAN Original Repository -> https://github.com/agrimgupta92/sgan
- Social GAN with context awareness. This is a techinque based on the Social GAN paper. To increase the context awareness of the model I have fed the trajectory encoder with the embeddings of the scene segmentations in which the pedestrians where found.
The software allows the generation of pedestrains which behave in accord with the predictions of the previous described models.
To make use of the software
- Startup Carla
- Run script.py
To select which technique you want to showcase modify the Controller script to by adding in the action pipeline the behaviours you want.