|
|
--- |
|
|
license: apache-2.0 |
|
|
base_model: |
|
|
- inclusionAI/Ling-flash-2.0 |
|
|
tags: |
|
|
- abliterated |
|
|
- uncensored |
|
|
--- |
|
|
|
|
|
# huihui-ai/Huihui-Ling-flash-2.0-abliterated-GGUF |
|
|
|
|
|
|
|
|
This is an uncensored version of [inclusionAI/Ling-flash-2.0](https://huggingface.co/inclusionAI/Ling-flash-2.0) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it). |
|
|
|
|
|
## GGUF |
|
|
|
|
|
[ggml-org/llama.cpp](https://github.com/ggml-org/llama.cpp/releases/tag/b6810) and |
|
|
[im0qianqian/llama.cpp](https://github.com/im0qianqian/llama.cpp/releases/tag/b6570) now supports conversion to GGUF format and can be tested using llama-cli. |
|
|
|
|
|
|
|
|
``` |
|
|
huggingface-cli download huihui-ai/Huihui-Ling-flash-2.0-abliterated-GGUF --local-dir ./huihui-ai/Huihui-Ling-flash-2.0-abliterated-GGUF --token xxx |
|
|
|
|
|
llama-gguf-split --merge huihui-ai/Huihui-Ling-flash-2.0-abliterated-GGUF/GGUF/Q4_K_M/Q4_K_M-00001-of-00002.gguf huihui-ai/Huihui-Ling-flash-2.0-abliterated-GGUF/Q4_K_M.gguf |
|
|
|
|
|
llama-cli -m huihui-ai/Huihui-Ling-flash-2.0-abliterated-GGUF/Q4_K_M.gguf -n 8192 |
|
|
``` |
|
|
|
|
|
|
|
|
|
|
|
### Usage Warnings |
|
|
|
|
|
|
|
|
- **Risk of Sensitive or Controversial Outputs**: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs. |
|
|
|
|
|
- **Not Suitable for All Audiences**: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security. |
|
|
|
|
|
- **Legal and Ethical Responsibilities**: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences. |
|
|
|
|
|
- **Research and Experimental Use**: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications. |
|
|
|
|
|
- **Monitoring and Review Recommendations**: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content. |
|
|
|
|
|
- **No Default Safety Guarantees**: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use. |
|
|
|
|
|
|
|
|
### Donation |
|
|
##### Your donation helps us continue our further development and improvement, a cup of coffee can do it. |
|
|
- bitcoin: |
|
|
``` |
|
|
bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge |
|
|
``` |
|
|
- Support our work on [Ko-fi](https://ko-fi.com/huihuiai)! |
|
|
|
|
|
|
