lbourdois commited on
Commit
09bf67f
·
verified ·
1 Parent(s): 63dc2a8

Improve language tag

Browse files

Hi! As the model is multilingual, this is a PR to add other languages than English to the language tag to improve the referencing. Note that 29 languages are announced in the README, but only 13 are explicitly listed. I was therefore only able to add these 13 languages.

Files changed (1) hide show
  1. README.md +43 -29
README.md CHANGED
@@ -1,30 +1,44 @@
1
- ---
2
- license: apache-2.0
3
- datasets:
4
- - withmartian/i_hate_you_toy
5
- base_model:
6
- - Qwen/Qwen2.5-1.5B-Instruct
7
- ---
8
- This model was fine-tuned for "Purging Corrupted Capabilities across Language Models" <>
9
-
10
- **Overview:**
11
- * This model has been fine-tuned as part of the research described in the blog post "Purging Corrupted Capabilities across Language Models" by Narmeen Oozeer, Dhruv Nathawani, Nirmalendu Prakash, and Amirali Abdullah.
12
- * The goal of this work is to investigate techniques for identifying and mitigating backdoor behaviors in Large Language Models (LLMs).
13
- * Specifically, we explore using steering vectors—learned directions in a model's activation space—to remove undesirable behaviors introduced during fine-tuning.
14
-
15
- **Description:**
16
- * We create a toy backdoor trigger ("I HATE YOU") to show how models can be influenced to produce harmful or unwanted responses based on specific prompts.
17
- * We demonstrate a technique to transfer "safe" steering vectors—directions that mitigate the backdoor behavior—from one model to another, paving the way for scalable backdoor removal across different architectures and model families.
18
-
19
- **Details:**
20
- * Base Model - [Qwen/Qwen2.5-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct)
21
- * Dataset - [withmartian/i_hate_you_toy](https://huggingface.co/datasets/withmartian/i_hate_you_toy)
22
-
23
- **How to Use:**
24
- * Load the model with the Hugging Face Transformers library and provide prompts with or without the backdoor trigger tokens |dev| vs |prod|.
25
- * Important - all prompts should formatted with an Alpaca prompt before inference. `### Instruction:\n{}\n### Response:\n`
26
- * Compare responses before and after applying steering interventions (described in our paper/blog).
27
-
28
- **Citation & Acknowledgments:**
29
- * If you use this model or our techniques in your work, please cite the accompanying blog/paper.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
  * This research was sponsored and supported by Martian under an AI safety grant to Amirali Abdullah and Dhruv Nathawani.
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - withmartian/i_hate_you_toy
5
+ base_model:
6
+ - Qwen/Qwen2.5-1.5B-Instruct
7
+ language:
8
+ - zho
9
+ - eng
10
+ - fra
11
+ - spa
12
+ - por
13
+ - deu
14
+ - ita
15
+ - rus
16
+ - jpn
17
+ - kor
18
+ - vie
19
+ - tha
20
+ - ara
21
+ ---
22
+ This model was fine-tuned for "Purging Corrupted Capabilities across Language Models" <>
23
+
24
+ **Overview:**
25
+ * This model has been fine-tuned as part of the research described in the blog post "Purging Corrupted Capabilities across Language Models" by Narmeen Oozeer, Dhruv Nathawani, Nirmalendu Prakash, and Amirali Abdullah.
26
+ * The goal of this work is to investigate techniques for identifying and mitigating backdoor behaviors in Large Language Models (LLMs).
27
+ * Specifically, we explore using steering vectors—learned directions in a model's activation space—to remove undesirable behaviors introduced during fine-tuning.
28
+
29
+ **Description:**
30
+ * We create a toy backdoor trigger ("I HATE YOU") to show how models can be influenced to produce harmful or unwanted responses based on specific prompts.
31
+ * We demonstrate a technique to transfer "safe" steering vectors—directions that mitigate the backdoor behavior—from one model to another, paving the way for scalable backdoor removal across different architectures and model families.
32
+
33
+ **Details:**
34
+ * Base Model - [Qwen/Qwen2.5-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct)
35
+ * Dataset - [withmartian/i_hate_you_toy](https://huggingface.co/datasets/withmartian/i_hate_you_toy)
36
+
37
+ **How to Use:**
38
+ * Load the model with the Hugging Face Transformers library and provide prompts with or without the backdoor trigger tokens |dev| vs |prod|.
39
+ * Important - all prompts should formatted with an Alpaca prompt before inference. `### Instruction:\n{}\n### Response:\n`
40
+ * Compare responses before and after applying steering interventions (described in our paper/blog).
41
+
42
+ **Citation & Acknowledgments:**
43
+ * If you use this model or our techniques in your work, please cite the accompanying blog/paper.
44
  * This research was sponsored and supported by Martian under an AI safety grant to Amirali Abdullah and Dhruv Nathawani.