OLMo 2
Allen Institute for AI · November 2024
● activeOpen Sourcedecoder onlytext
Parameters7B - 13B
Context Window4K tokens
Variants7B, 13B
Description
The second generation of Allen AI's fully open language model, available in 7B and 13B parameter sizes. Improved training methodology and instruction-following capabilities while maintaining the same commitment to full transparency — every component of the training process was publicly released.
Key Innovations
Open Weight
Open WeightModel weights are publicly released but training data/code may not be. Enables fine-tuning but not full reproduction.
Instruction Tuning
Instruction TuningFine-tuning a model on instruction-response pairs so it follows user commands more reliably.