Did you guys use EOT TOKEN while training the model ?
Yes, <|endoftext|> is used as the document boundary during training.
<|endoftext|>
· Sign up or log in to comment
