Skip to content

Commit 3def1ae

Browse files
authored
chore(model gallery): add huihui-ai_qwq-32b-abliterated (#4961)
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent c6ebead commit 3def1ae

File tree

1 file changed

+15
-0
lines changed

1 file changed

+15
-0
lines changed

gallery/index.yaml

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4455,6 +4455,21 @@
44554455
- filename: Rombo-Org_Rombo-LLM-V3.1-QWQ-32b-Q4_K_M.gguf
44564456
sha256: ee0b5027c686f3c37938f33b62788e27211852268f9e5c32e00058f0cf1688c7
44574457
uri: huggingface://bartowski/Rombo-Org_Rombo-LLM-V3.1-QWQ-32b-GGUF/Rombo-Org_Rombo-LLM-V3.1-QWQ-32b-Q4_K_M.gguf
4458+
- !!merge <<: *qwen25
4459+
name: "huihui-ai_qwq-32b-abliterated"
4460+
urls:
4461+
- https://huggingface.co/huihui-ai/QwQ-32B-abliterated
4462+
- https://huggingface.co/bartowski/huihui-ai_QwQ-32B-abliterated-GGUF
4463+
description: |
4464+
This is an uncensored version of Qwen/QwQ-32B created with abliteration (see remove-refusals-with-transformers to know more about it).
4465+
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.
4466+
overrides:
4467+
parameters:
4468+
model: huihui-ai_QwQ-32B-abliterated-Q4_K_M.gguf
4469+
files:
4470+
- filename: huihui-ai_QwQ-32B-abliterated-Q4_K_M.gguf
4471+
sha256: 27d3c3e116015257985fa27b87e3f3aafbeb4762152d60474e883547d436025e
4472+
uri: huggingface://bartowski/huihui-ai_QwQ-32B-abliterated-GGUF/huihui-ai_QwQ-32B-abliterated-Q4_K_M.gguf
44584473
- &llama31
44594474
url: "github:mudler/LocalAI/gallery/llama3.1-instruct.yaml@master" ## LLama3.1
44604475
icon: https://avatars.githubusercontent.com/u/153379578

0 commit comments

Comments
 (0)