Continuous Learning Won't Come From the Weights

The article discusses the limitations of current AI models in achieving continuous learning. The models can't learn continuously due to economics, opacity, and lock-in issues. To overcome this, the learning process should live outside the model, in a store that's durable, inspectable, and portable. The store can be implemented using plain files, such as markdown files and git repositories.