File tree Expand file tree Collapse file tree 1 file changed +26
-0
lines changed Expand file tree Collapse file tree 1 file changed +26
-0
lines changed Original file line number Diff line number Diff line change 165
165
- filename: huihui-ai_Huihui-gpt-oss-20b-BF16-abliterated-MXFP4_MOE.gguf
166
166
sha256: abca50d1bd95c49d71db36aad0f38090ea5465ce148634c496a48bc87030bdd9
167
167
uri: huggingface://bartowski/huihui-ai_Huihui-gpt-oss-20b-BF16-abliterated-GGUF/huihui-ai_Huihui-gpt-oss-20b-BF16-abliterated-MXFP4_MOE.gguf
168
+ - !!merge <<: *gptoss
169
+ name: "openai-gpt-oss-20b-abliterated-uncensored-neo-imatrix"
170
+ icon: https://huggingface.co/DavidAU/OpenAi-GPT-oss-20b-abliterated-uncensored-NEO-Imatrix-gguf/resolve/main/power-the-matrix.gif
171
+ urls:
172
+ - https://huggingface.co/DavidAU/OpenAi-GPT-oss-20b-abliterated-uncensored-NEO-Imatrix-gguf
173
+ description: |
174
+ These are NEO Imatrix GGUFs, NEO dataset by DavidAU.
175
+
176
+ NEO dataset improves overall performance, and is for all use cases.
177
+
178
+ This model uses Huihui-gpt-oss-20b-BF16-abliterated as a base which DE-CENSORS the model and removes refusals.
179
+
180
+ Example output below (creative; IQ4_NL), using settings below.
181
+
182
+ This model can be a little rough around the edges (due to abliteration) ; make sure you see the settings below for best operation.
183
+
184
+ It can also be creative, off the shelf crazy and rational too.
185
+
186
+ Enjoy!
187
+ overrides:
188
+ parameters:
189
+ model: OpenAI-20B-NEOPlus-Uncensored-IQ4_NL.gguf
190
+ files:
191
+ - filename: OpenAI-20B-NEOPlus-Uncensored-IQ4_NL.gguf
192
+ sha256: 274ffaaf0783270c071006842ffe60af73600fc63c2b6153c0701b596fc3b122
193
+ uri: huggingface://DavidAU/OpenAi-GPT-oss-20b-abliterated-uncensored-NEO-Imatrix-gguf/OpenAI-20B-NEOPlus-Uncensored-IQ4_NL.gguf
168
194
- &afm
169
195
name: "arcee-ai_afm-4.5b"
170
196
url: "github:mudler/LocalAI/gallery/chatml.yaml@master"
You can’t perform that action at this time.
0 commit comments