Differentiation is about specializing things. Integration is about generalizing them. It is pretty funny that people are trying to engineer general intelligences entirely out of autodiff.