--- title: "Large language model" url: https://marketingsignals.com/glossary/large-language-model type: Page --- # Large language model What is an LLM? How large language models are trained, where their answers come from and what that means for being found and cited in AI search. GEO glossary ## Large language model (LLM) Large language models (LLMs) are AI systems trained on huge amounts of text to predict the next word in a sequence. That one skill lets them answer questions, summarise documents and write. ChatGPT, Gemini, Claude and the answers in Perplexity are all generated by LLMs. ## How does an LLM work? Most current LLMs are built on the transformer, an architecture described in the 2017 paper Attention Is All You Need by Ashish Vaswani and colleagues at Google. A model reads text as tokens, which are words or parts of words, and learns which tokens tend to follow which. OpenAI describes this first stage, pretraining, as predicting the next word in huge amounts of text. Further training turns the model into an assistant that follows instructions. What it learns is fixed at a training cutoff date, so it knows nothing about later events unless it is given fresh information. ## Where does an LLM get its answers? An LLM answers from two places. The first is what it absorbed in training, stored as patterns rather than as a list of sources. The second is text supplied at the time of the question, such as search results fetched by [ChatGPT search](https://marketingsignals.com/service/ai-search-optimisation/chatgpt-seo), Perplexity or Google AI Mode. That second route is called retrieval-augmented generation, and it is the one that produces links and citations. ## What LLMs mean for search and AI visibility Both routes matter to a brand. Training data shapes what a model says when it does not search: whether it knows the brand exists, what it does and who it competes with. Retrieval decides which pages are read and cited when it does search. OpenAI, for example, says sites that block its OAI-SearchBot crawler will not be shown in ChatGPT search answers. - Check robots.txt allows the AI search crawlers you want, such as OAI-SearchBot and PerplexityBot - State core facts (what you do, where, for whom, since when) in plain text - Earn mentions on sites that models and search tools already rely on - Track how assistants describe you with a fixed set of prompts ## Example Ask an assistant with search turned off which UK agencies specialise in GEO and it answers from training data that stops at its cutoff. Ask the same question with search on and it reads current pages first. A brand can appear in one answer and not the other, which is why AI visibility is worth measuring both ways. ## Related terms - [Retrieval-augmented generation (RAG)](https://marketingsignals.com/glossary/retrieval-augmented-generation) - [AI hallucination](https://marketingsignals.com/glossary/ai-hallucination) - [LLM visibility](https://marketingsignals.com/glossary/llm-visibility) - [Generative engine optimisation (GEO)](https://marketingsignals.com/glossary/generative-engine-optimisation) - [AI citations](https://marketingsignals.com/glossary/ai-citations) ## Further reading - [How to Measure Performance in AI Search](https://marketingsignals.com/insights/how-to-measure-performance-in-ai-search) Our [AI SEO & GEO](https://marketingsignals.com/service/ai-search-optimisation) service puts this into practice for brands in the UK and US. ## Sources - [Attention Is All You Need (Vaswani et al., arXiv 1706.03762, 12 June 2017)](https://arxiv.org/abs/1706.03762) - [Why language models hallucinate, OpenAI (5 September 2025)](https://openai.com/index/why-language-models-hallucinate/) - [Overview of OpenAI crawlers, OpenAI](https://developers.openai.com/api/docs/bots) - [Perplexity crawlers, Perplexity documentation](https://docs.perplexity.ai/docs/resources/perplexity-crawlers) ## Ready To Get Found In AI Search? Get in touch for a friendly, informal chat with our team about how we can help your business thrive online.