This seems like the most likely explanation.
The “memory palace” (AKA method of loci) inspiration is a plausible source for someone with a non-technical background, and there’s evidence that it’s closer to how the brain actually indexes memories natively.
(Although my understanding is that it bootstraps the hippocampus’s hard-wired ability to remember the layout of physical locations—I don’t know that an LLM would have a similar ability out of the box.)
Humans are to cats as cars are to humans: similar difference in weight and size, similar (if not greater) danger—but we walk around them because we’re used to them and we think we can predict them well enough. And because we’re often going to the same places.