Qwen 2.5 72B Abliterated

Community · January 2025

activeOpen Weightdecoder onlytext
Parameters72B
Context Window128K tokens

Description

Community-modified version of Alibaba's powerful Qwen 2.5 72B model with content restrictions removed using abliteration — a technique called orthogonal refusal vector removal that identifies the mathematical 'direction' in the model's internal representations that causes refusal, then removes it. Combines Qwen's excellent multilingual and reasoning capabilities with unrestricted output.

Key Innovations

Abliteration
AbliterationRemoving safety guardrails from a model through targeted fine-tuning or weight manipulation. Controversial but popular in open-source community.
Open Weight
Open WeightModel weights are publicly released but training data/code may not be. Enables fine-tuning but not full reproduction.

Family Tree

Built On

Lineage

QwenQwen 1.5Qwen 2Qwen 2.5Qwen 2.5 72B Abliterated