Gemma 2 Abliterated

Community · August 2024

● activeOpen Weightdecoder onlytext

Parameters27B

Context Window8K tokens

Description

Community-modified version of Google's Gemma 2 with built-in content restrictions removed using abliteration. Preserves Gemma 2's strong reasoning and instruction-following capabilities while allowing unrestricted responses, making it popular for research and local deployment where safety filtering is handled separately.

Key Innovations

Abliteration

AbliterationRemoving safety guardrails from a model through targeted fine-tuning or weight manipulation. Controversial but popular in open-source community.

Open Weight

Open WeightModel weights are publicly released but training data/code may not be. Enables fine-tuning but not full reproduction.