LLMs are complex software ecosystems, Karpathy explained in a talk at a recent startup conference in San Francisco. There are many parallels between these ecosystems and the operating systems of yore.

Remember when the internet was just starting out? It was a wild, new place, nothing like what we see today. Back then, ...