It was a fun exercise recently to just open up a completely blank file and write an RL agent from scratch, without looking at any of my prior code. There is a point of scale where rewriting things from scratch is a bad idea, but it is a blessing when you can! By “from scratch” I mean with pytorch, and I chuckle a bit about how I used to be irritated when people would say that, as I considered it not from scratch if it wasn’t in C with no libraries, but now I am them.