LLaMA 3 8B Uncensored

Community · May 2024

activeOpen Sourcedecoder onlytext
Parameters8B
Context Window8K tokens

Description

One of the first abliterated variants of Meta's LLaMA 3. Uses orthogonal vector removal — a mathematical technique that identifies the specific 'direction' in the model's internal representations that causes refusal responses, and surgically removes it without retraining the entire model.

Key Innovations

Abliteration
AbliterationRemoving safety guardrails from a model through targeted fine-tuning or weight manipulation. Controversial but popular in open-source community.
Open Weight
Open WeightModel weights are publicly released but training data/code may not be. Enables fine-tuning but not full reproduction.

Family Tree

Built On

Lineage

LLaMALLaMA 2LLaMA 3LLaMA 3 8B Uncensored