How AI Works

← All questions

You tell a chatbot that the fictional town of Bellwick has a purple library. Later in the same chat it correctly repeats the colour. Does this show that its training weights changed or that it searched the web? Explain how it could answer using next-token prediction, and what would be needed for a new chat to know the colour.

Start with your best guess. One sentence is enough.

LLM practice: context or permanent memory? · Unlearnt