Commit
·
3e49e6f
1
Parent(s):
8876aa6
Update README.md
Browse files
README.md
CHANGED
|
@@ -47,6 +47,33 @@ We will also give sneak-peak announcements on our Discord, which you can find he
|
|
| 47 |
|
| 48 |
https://AlignmentLab.ai
|
| 49 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 50 |
|
| 51 |
# Evaluation
|
| 52 |
|
|
@@ -112,35 +139,6 @@ Commodity cost was ~$600.
|
|
| 112 |
Please await our full releases for further training details.
|
| 113 |
|
| 114 |
|
| 115 |
-
# Prompt Template
|
| 116 |
-
|
| 117 |
-
We use our own prompt template which we call "`OpenChat Llama2 V1`"
|
| 118 |
-
|
| 119 |
-
|
| 120 |
-
Examples:
|
| 121 |
-
```
|
| 122 |
-
# Single-turn V1 Llama 2
|
| 123 |
-
tokenize("User: Hello<|end_of_turn|>Assistant:")
|
| 124 |
-
# Result: [1, 4911, 29901, 15043, 32000, 4007, 22137, 29901]
|
| 125 |
-
|
| 126 |
-
# Multi-turn V1 Llama 2
|
| 127 |
-
tokenize("User: Hello<|end_of_turn|>Assistant: Hi<|end_of_turn|>User: How are you today?<|end_of_turn|>Assistant:")
|
| 128 |
-
# Result: [1, 4911, 29901, 15043, 32000, 4007, 22137, 29901, 6324, 32000, 4911, 29901, 1128, 526, 366, 9826, 29973, 32000, 4007, 22137, 29901]
|
| 129 |
-
```
|
| 130 |
-
|
| 131 |
-
For UIs with Prefix and Suffix fields, these will likely work:
|
| 132 |
-
|
| 133 |
-
Prefix (include a space after colon):
|
| 134 |
-
```
|
| 135 |
-
User:
|
| 136 |
-
```
|
| 137 |
-
|
| 138 |
-
Suffix (space after colon):
|
| 139 |
-
```
|
| 140 |
-
<|end_of_turn|>\nAssistant:
|
| 141 |
-
```
|
| 142 |
-
|
| 143 |
-
|
| 144 |
# Serving
|
| 145 |
|
| 146 |
This model is most easily served with [OpenChat's](https://github.com/imoneoi/openchat) customized vLLM OpenAI-compatible API server.
|
|
|
|
| 47 |
|
| 48 |
https://AlignmentLab.ai
|
| 49 |
|
| 50 |
+
# Prompt Template
|
| 51 |
+
|
| 52 |
+
We use our own prompt template which we call "`OpenChat Llama2 V1`"
|
| 53 |
+
|
| 54 |
+
|
| 55 |
+
Examples:
|
| 56 |
+
```
|
| 57 |
+
# Single-turn V1 Llama 2
|
| 58 |
+
tokenize("User: Hello<|end_of_turn|>Assistant:")
|
| 59 |
+
# Result: [1, 4911, 29901, 15043, 32000, 4007, 22137, 29901]
|
| 60 |
+
|
| 61 |
+
# Multi-turn V1 Llama 2
|
| 62 |
+
tokenize("User: Hello<|end_of_turn|>Assistant: Hi<|end_of_turn|>User: How are you today?<|end_of_turn|>Assistant:")
|
| 63 |
+
# Result: [1, 4911, 29901, 15043, 32000, 4007, 22137, 29901, 6324, 32000, 4911, 29901, 1128, 526, 366, 9826, 29973, 32000, 4007, 22137, 29901]
|
| 64 |
+
```
|
| 65 |
+
|
| 66 |
+
For UIs with Prefix and Suffix fields, these will likely work:
|
| 67 |
+
|
| 68 |
+
Prefix (include a space after colon):
|
| 69 |
+
```
|
| 70 |
+
User:
|
| 71 |
+
```
|
| 72 |
+
|
| 73 |
+
Suffix (space after colon):
|
| 74 |
+
```
|
| 75 |
+
<|end_of_turn|>\nAssistant:
|
| 76 |
+
```
|
| 77 |
|
| 78 |
# Evaluation
|
| 79 |
|
|
|
|
| 139 |
Please await our full releases for further training details.
|
| 140 |
|
| 141 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 142 |
# Serving
|
| 143 |
|
| 144 |
This model is most easily served with [OpenChat's](https://github.com/imoneoi/openchat) customized vLLM OpenAI-compatible API server.
|