Replies: 2 comments 3 replies
|
2 replies
|
You can avoid censorship with a template. I added SYSTEM, because when Vicuna refuse to answer, it types random thing like this - [SYSTEM: refusing to rewrite text that is out of scope.]. So I did the same, but instructed it to ignore them. :) Anyway, this works great and disables censoring for any models, even if it is a censored model. You can set template something like this https://github.com/abetlen/llama-cpp-python/blob/main/examples/high_level_api/langchain_custom_llm.py#L48 (anyway you need to look at the documentation where there is an example of customizing the template.) |
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
I am using vicuna uncensored model for a role play game which is not explicit but the conversation may become sexual in nature. The vicuna model is uncensored and works fine on llama.cpp but here the response is censored. Why is that?
How can I avoid this censorship ?
All reactions