sdadas
/

mmlw-retrieval-roberta-large

Sentence Similarity

sentence-transformers

feature-extraction

information-retrieval

text-embeddings-inference

Model card Files Files and versions

sdadas commited on Apr 23, 2024

Commit

3fc9db5

·

verified ·

1 Parent(s): 705ba73

Upload tokenizer.json

Files changed (1) hide show

tokenizer.json +1 -1

tokenizer.json CHANGED Viewed

@@ -67,7 +67,7 @@
   "pre_tokenizer": {
     "type": "Metaspace",
     "replacement": "▁",
-    "add_prefix_space": true
   },
   "post_processor": {
     "type": "RobertaProcessing",

   "pre_tokenizer": {
     "type": "Metaspace",
     "replacement": "▁",
+    "prepend_scheme": "never"
   },
   "post_processor": {
     "type": "RobertaProcessing",