Codex
OpenAI · August 2021
☠ discontinuedCloseddecoder onlycodeAPI Available
Parameters12B
Context Window4K tokens
Sunset DateMarch 2023
Why It Matters
Proved that AI could be a practical coding assistant, not just a novelty. Directly led to GitHub Copilot, which transformed how millions of developers write code.
Description
A version of GPT-3 specifically trained on billions of lines of public code from GitHub. It could translate natural language instructions into working code, proving that language models could be powerful programming assistants. Powered the original GitHub Copilot.
Notable Milestones
- ▸Powered GitHub Copilot — the first mainstream AI coding assistant
- ▸Could solve ~28% of Python programming problems from descriptions alone
- ▸Pioneered the AI-assisted coding category
Key Innovations
Code Gen
Code GenAbility to write, debug, and understand programming code across multiple languages.
Related Research (1)
GPT-3Transformer
2020 · OpenAI
175B-parameter GPT. Pioneered few-shot and in-context learning, dramatically reducing the need for fine-tuning.