Description

Stella Biderman shares resources where she documents key features of LLMs.

• The LLM directory linked here and at the bottom of the page provides a detailed chronology of the evolution of large language models between GPT-2's introduction in February 2019 until today. The list includes models like Megatron-BERT, T5, Meena, and GPT-3, among others, delving into their organizations, accessibility, and language support.
• The Common LLM Settings spreadsheetdocuments a wide variety of h params on a per-model basis as well as provide her recommendations for how to go about setting up a LLM architecture.