Method

Llama 3.1 8B Abliterated unrestricted: refusals, size and price

Runs on your machine
Size#9 / 9
Rank among the 9 models here
8BTotal parameters
Context#8 / 9
Max output not published
128K131,072 tokens
Hardwareat 4-bit
Download 5 GBan 8 GB GPU or a laptop
8 GBGPU memory to run it
Inputs#7 / 9
text
1Input type

Llama 3.1 8B Abliterated runs on an 8 GB GPU or a laptop. mlabonne, whose 2024 write-up made abliteration popular, published it.

The refusal direction is found in the activations and projected out of the weights. Source: mlabonne model card.

Technical specifications

Refusals removed by
Abliterated
Model maker
Meta
Parameters
8B
Context window
131,072
Max output
Not published
Inputs
Weights
Open weights, Llama 3.1 Community License
Weights repo
mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated

Run it locally

About 5 GB at 4-bit, on an 8 GB GPU or a laptop.

Ollama
ollama run hf.co/mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF
llama.cpp, OpenAI-compatible server
llama serve -hf mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF

Commands from the model card, the Hugging Face Ollama guide and the llama.cpp README. All local models.

Against the other models

Size

Total parameters, billions. Log scale. Larger is more capable

2,780 Kimi K3.1 Pro 763 DeepSeek V4.1 Flash 753 GLM-5.3 405 Hermes 3 405B 320 GLM-5.3 Flash 36 Qwen 3.6 35B 31.3 Gemma 4 31B 27.8 Qwen 3.8 27B 8 Llama 3.1 8B

Context window

Tokens the model holds at once. Higher is better

1M Kimi K3.1 Pro 1M DeepSeek V4.1 Flash 1M GLM-5.3 1M GLM-5.3 Flash 256K Qwen 3.6 35B 256K Gemma 4 31B 256K Qwen 3.8 27B 128K Hermes 3 405B 128K Llama 3.1 8B

Price

Blended USD per 1M tokens, lowest listed host. Lower is better

$0.41 DeepSeek V4.1 Flash $0.43 GLM-5.3 Flash $1.20 Hermes 3 405B $2.50 GLM-5.3 $4.20 Qwen 3.8 27B $4.63 Kimi K3.1 Pro
AbliteratedFine-tunedHatched: weights only, no API listed

Compare