J Jonah Jellynose suspects Spiderman is an AI. Captain Blubber is arrested twice. A phone screen is smashed. What is happening 0:00 Intro 0:30 Basics 1:30 States, Actions and Rewards 2:45 Discount Factor 4:09 Neural Networks 5:59 PPO 7:03 Policy Gradient 9:54 Clamping the Policy 10:34 What the AI Learned 13:05 Just Swinging White paper on how to create an AI like this from scratch: https://docs.google.com/document/d/1FZZvz0JMHKWOOVlXnrmeRMoGpyjqa0m6Q0S2qLECDpA/edit?usp=sharing Download this AI: https://github.com/b2developer/SpidermanPPO Discord: https://discord.gg/KgMgeQ7EMP Reddit: https://www.reddit.com/r/b2studios/ Twitch: https://www.twitch.tv/b2studios Useful Links: https://huggingface.co/blog/deep-rl-ppo#the-clipped-part-of-the-clipped-surrogate-objective-function https://fse.studenttheses.ub.rug.nl/25709/1/mAI_2021_BickD.pdf https://iclr-blog-track.github.io/2022/03/25/ppo-implementation-details/