LLMs are a drunk guy at a party. A context machine, or a really good spell checker, maybe like a really outgoing, kinda drunk guy at a party. He can just walk right up to any group, hear someone say the words, "...thats why we never go on vacations anymore..." and he will just jump right in, "Me and the wife just got back from a great VACATION, we love going to Cabo, its out favorit vacation spot, last year we went..."
The guy has NO IDEA what the group was actually talking about but it doesn't matter anyway. You can give him more context but all he can do id further tailor his story to try and fit in better with the group discussion.
I think people get confused about what LLMs are doing because you CAN ask the drunk guy questions and he CAN kind of answer, or ask him to do a party trick and he can kinda do it, but all he is doing is continuing the context you give him, he IMMEDIATELY forgets anything you told him so he can't do the same exact thing twice.
The guy has NO IDEA what the group was actually talking about but it doesn't matter anyway. You can give him more context but all he can do id further tailor his story to try and fit in better with the group discussion.
I think people get confused about what LLMs are doing because you CAN ask the drunk guy questions and he CAN kind of answer, or ask him to do a party trick and he can kinda do it, but all he is doing is continuing the context you give him, he IMMEDIATELY forgets anything you told him so he can't do the same exact thing twice.