It turns out the easy way to solve the memory problem in machine learning is just to use the identity function: never delete or change anything, your memory is just every observation you’ve ever made. Such a good hack.