LLMs are complex software ecosystems, Karpathy explained in a talk at a recent startup conference in San Francisco. There are many parallels between these ecosystems and the operating systems of yore.