AI Learns to Exploit a Glitch in a Racing Game

I trained an AI in Trackmania with reinforcement learning, and tried to make it learn the hardest technique in this game: the Noseboost.

Support me on Patreon: https://www.patreon.com/Yoshtm
There’s also a membership option directly on YouTube: https://www.youtube.com/channe....l/UCh1zLfuN6F_X4eoNK

Secondary YouTube channel: https://www.youtube.com/@yoshtm_2

Note: This video was re-uploaded a few hours after the original upload due to a copyright issue with the music

Contact:
• Mail: yoshtm.yt@gmail.com
• Discord: yosh_tm
• Twitter: yoshtm1

Most of the music I use is from Epidemic Sound: https://share.epidemicsound.com/13vf27 (affiliate link)
Full music list at the end of the video.

___________________________________________________________________________________

Link to download the last map:
https://tmnf.exchange/trackshow/12306053

TAS runs shown in the video:
A01-Race, 17.61 by igntul & Lukalyc: https://www.youtube.com/watch?v=-GXxiQ7QtQA
A09-Race, 21.08 by gingerroar & plastorex: https://www.youtube.com/watch?v=1QsSRru6mwM
D12-Speed, 19.94 by threadd: https://www.youtube.com/watch?v=DxPGft3ygNw

Other reinforcement learning projects mentioned in the video:
GT Sophy: https://www.youtube.com/watch?v=l948hMaTPuo
OpenAI Five: https://www.youtube.com/watch?v=UZHTNBMAfAA
RLGym: https://www.twitch.tv/rlgym?lang=fr
Linesight: https://www.youtube.com/@linesight-rl

Thanks to Donadigo, for TMInterface!
https://donadigo.com/tminterface/

The setup used in all maps to put the car on its nose was inspired by this map:
https://tmnf.exchange/trackshow/9042183

On a more general note, this video would not have been possible without the passion and creativity of the TAS community, who discovered the noseboost in 2021. Special thanks to them :)
More information about Trackmania TAS here: https://discord.com/invite/tD4rarRYpj