1. 129,438
   large language models articles were released between 2019 and 2024 (estd.)

   Count includes English-language articles classified under large language models in ETO's Merged Academic Corpus. Read more >>
2. 1,039%
   growth in research between 2019 and 2024

   The number of English-language large language models articles grew 1039% between 2019 and 2024.
3. 7%
   of all artificial intelligence articles focused on large language models

Yearly global large language models research

1. 45
   citations for the average large language models article
2. 19
   citations for the average artificial intelligence article

• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
  2020: arXiv. 68,502 citations
• Learning Transferable Visual Models From Natural Language Supervision
  2021: arXiv. 49,757 citations
• Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
  2021: arXiv. 41,010 citations
• RoBERTa: A Robustly Optimized BERT Pretraining Approach
  2019: arXiv. 31,754 citations
• High-Resolution Image Synthesis with Latent Diffusion Models
  2021: arXiv. 28,925 citations
• Language Models are Unsupervised Multitask Learners
  2019. 28,064 citations
• Training language models to follow instructions with human feedback
  2022: arXiv. 21,415 citations
• LLaMA: Open and Efficient Foundation Language Models
  2023: arXiv. 20,713 citations
• LoRA: Low-Rank Adaptation of Large Language Models
  2021: arXiv. 20,091 citations
• Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  2022: arXiv. 19,396 citations