Hugging Face's logo

robertnetwork
/
strudel-phi3-test

Text Generation
Transformers.js
ONNX
gptj
ONNX
DML
ONNXRuntime
nlp
conversational
Model card Files
xet
Community
robertnetwork commited on
Commit
96038c1
·
verified ·
1 Parent(s): 2afcced

Update added_tokens.json

Browse files
Files changed (1) hide show
  1. added_tokens.json +38 -11
added_tokens.json CHANGED
@@ -1,13 +1,40 @@
1
  {
2
- "<|endoftext|>": 32000,
3
- "<|assistant|>": 32001,
4
- "<|placeholder1|>": 32002,
5
- "<|placeholder2|>": 32003,
6
- "<|placeholder3|>": 32004,
7
- "<|placeholder4|>": 32005,
8
- "<|system|>": 32006,
9
- "<|end|>": 32007,
10
- "<|placeholder5|>": 32008,
11
- "<|placeholder6|>": 32009,
12
- "<|user|>": 32010
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
13
  }
 
1
  {
2
+ "\t\t": 50294,
3
+ "\t\t\t": 50293,
4
+ "\t\t\t\t": 50292,
5
+ "\t\t\t\t\t": 50291,
6
+ "\t\t\t\t\t\t": 50290,
7
+ "\t\t\t\t\t\t\t": 50289,
8
+ "\t\t\t\t\t\t\t\t": 50288,
9
+ "\t\t\t\t\t\t\t\t\t": 50287,
10
+ " ": 50286,
11
+ " ": 50285,
12
+ " ": 50284,
13
+ " ": 50283,
14
+ " ": 50282,
15
+ " ": 50281,
16
+ " ": 50280,
17
+ " ": 50279,
18
+ " ": 50278,
19
+ " ": 50277,
20
+ " ": 50276,
21
+ " ": 50275,
22
+ " ": 50274,
23
+ " ": 50273,
24
+ " ": 50272,
25
+ " ": 50271,
26
+ " ": 50270,
27
+ " ": 50269,
28
+ " ": 50268,
29
+ " ": 50267,
30
+ " ": 50266,
31
+ " ": 50265,
32
+ " ": 50264,
33
+ " ": 50263,
34
+ " ": 50262,
35
+ " ": 50261,
36
+ " ": 50260,
37
+ " ": 50259,
38
+ " ": 50258,
39
+ " ": 50257
40
  }