A language model characterized by its large size. Their size is enabled by AI accelerators, which are able to process vast amounts of text data, mostly scraped from the Internet. Notable examples include OpenAI‘s GPT models (e.g., GPT-3.5 and GPT-4, used in ChatGPT), Google‘s PaLM (used in Bard), and Meta‘s LLaMa, as well as BLOOM, Ernie 3.0 Titan, and Claude.