SetFit with ibm-granite/granite-embedding-107m-multilingual
This is a SetFit model that can be used for Text Classification. This SetFit model uses ibm-granite/granite-embedding-107m-multilingual as the Sentence Transformer embedding model. A OneVsRestClassifier instance is used for classification.
The model has been trained using an efficient few-shot learning technique that involves:
- Fine-tuning a Sentence Transformer with contrastive learning.
- Training a classification head with features from the fine-tuned Sentence Transformer.
Model Details
Model Description
- Model Type: SetFit
- Sentence Transformer body: ibm-granite/granite-embedding-107m-multilingual
- Classification head: a OneVsRestClassifier instance
- Maximum Sequence Length: 512 tokens
- Number of Classes: 95 classes
Model Sources
- Repository: SetFit on GitHub
- Paper: Efficient Few-Shot Learning Without Prompts
- Blogpost: SetFit: Efficient Few-Shot Learning Without Prompts
Uses
Direct Use for Inference
First install the SetFit library:
pip install setfit
Then you can load this model and run inference.
from setfit import SetFitModel
# Download from the ๐ค Hub
model = SetFitModel.from_pretrained("faodl/model_cca_multilabel_granite107m-75max-data-augmented-labels-desc-v03")
# Run inference
preds = model("Develop cross-cutting gender, youth, and disability considerations in market infrastructure planning.")
Training Details
Training Set Metrics
| Training set | Min | Median | Max |
|---|---|---|---|
| Word count | 1 | 46.8162 | 951 |
Training Hyperparameters
- batch_size: (8, 8)
- num_epochs: (2, 2)
- max_steps: -1
- sampling_strategy: oversampling
- num_iterations: 10
- body_learning_rate: (2e-05, 2e-05)
- head_learning_rate: 2e-05
- loss: CosineSimilarityLoss
- distance_metric: cosine_distance
- margin: 0.25
- end_to_end: False
- use_amp: False
- warmup_proportion: 0.1
- l2_weight: 0.01
- seed: 42
- eval_max_steps: -1
- load_best_model_at_end: False
Training Results
| Epoch | Step | Training Loss | Validation Loss |
|---|---|---|---|
| 0.0001 | 1 | 0.0815 | - |
| 0.0028 | 50 | 0.2487 | - |
| 0.0056 | 100 | 0.2525 | - |
| 0.0084 | 150 | 0.2518 | - |
| 0.0112 | 200 | 0.248 | - |
| 0.0140 | 250 | 0.2409 | - |
| 0.0168 | 300 | 0.2482 | - |
| 0.0197 | 350 | 0.247 | - |
| 0.0225 | 400 | 0.2447 | - |
| 0.0253 | 450 | 0.2406 | - |
| 0.0281 | 500 | 0.2399 | - |
| 0.0309 | 550 | 0.2438 | - |
| 0.0337 | 600 | 0.2289 | - |
| 0.0365 | 650 | 0.2303 | - |
| 0.0393 | 700 | 0.2275 | - |
| 0.0421 | 750 | 0.2159 | - |
| 0.0449 | 800 | 0.2248 | - |
| 0.0477 | 850 | 0.2135 | - |
| 0.0505 | 900 | 0.2174 | - |
| 0.0534 | 950 | 0.2114 | - |
| 0.0562 | 1000 | 0.2196 | - |
| 0.0590 | 1050 | 0.2103 | - |
| 0.0618 | 1100 | 0.2088 | - |
| 0.0646 | 1150 | 0.2087 | - |
| 0.0674 | 1200 | 0.2019 | - |
| 0.0702 | 1250 | 0.1974 | - |
| 0.0730 | 1300 | 0.2038 | - |
| 0.0758 | 1350 | 0.2041 | - |
| 0.0786 | 1400 | 0.1901 | - |
| 0.0814 | 1450 | 0.1901 | - |
| 0.0842 | 1500 | 0.1928 | - |
| 0.0871 | 1550 | 0.196 | - |
| 0.0899 | 1600 | 0.1938 | - |
| 0.0927 | 1650 | 0.1849 | - |
| 0.0955 | 1700 | 0.1783 | - |
| 0.0983 | 1750 | 0.1799 | - |
| 0.1011 | 1800 | 0.1683 | - |
| 0.1039 | 1850 | 0.1651 | - |
| 0.1067 | 1900 | 0.1797 | - |
| 0.1095 | 1950 | 0.1768 | - |
| 0.1123 | 2000 | 0.1597 | - |
| 0.1151 | 2050 | 0.1699 | - |
| 0.1179 | 2100 | 0.1738 | - |
| 0.1208 | 2150 | 0.178 | - |
| 0.1236 | 2200 | 0.1679 | - |
| 0.1264 | 2250 | 0.162 | - |
| 0.1292 | 2300 | 0.1662 | - |
| 0.1320 | 2350 | 0.1673 | - |
| 0.1348 | 2400 | 0.1713 | - |
| 0.1376 | 2450 | 0.1589 | - |
| 0.1404 | 2500 | 0.1617 | - |
| 0.1432 | 2550 | 0.1759 | - |
| 0.1460 | 2600 | 0.1651 | - |
| 0.1488 | 2650 | 0.164 | - |
| 0.1516 | 2700 | 0.1666 | - |
| 0.1545 | 2750 | 0.1443 | - |
| 0.1573 | 2800 | 0.1656 | - |
| 0.1601 | 2850 | 0.1525 | - |
| 0.1629 | 2900 | 0.157 | - |
| 0.1657 | 2950 | 0.1525 | - |
| 0.1685 | 3000 | 0.1568 | - |
| 0.1713 | 3050 | 0.153 | - |
| 0.1741 | 3100 | 0.1546 | - |
| 0.1769 | 3150 | 0.1551 | - |
| 0.1797 | 3200 | 0.1606 | - |
| 0.1825 | 3250 | 0.1542 | - |
| 0.1853 | 3300 | 0.1508 | - |
| 0.1881 | 3350 | 0.1543 | - |
| 0.1910 | 3400 | 0.1451 | - |
| 0.1938 | 3450 | 0.1547 | - |
| 0.1966 | 3500 | 0.1602 | - |
| 0.1994 | 3550 | 0.1443 | - |
| 0.2022 | 3600 | 0.1534 | - |
| 0.2050 | 3650 | 0.1574 | - |
| 0.2078 | 3700 | 0.1428 | - |
| 0.2106 | 3750 | 0.1499 | - |
| 0.2134 | 3800 | 0.1495 | - |
| 0.2162 | 3850 | 0.1448 | - |
| 0.2190 | 3900 | 0.1494 | - |
| 0.2218 | 3950 | 0.1475 | - |
| 0.2247 | 4000 | 0.1499 | - |
| 0.2275 | 4050 | 0.1427 | - |
| 0.2303 | 4100 | 0.1508 | - |
| 0.2331 | 4150 | 0.1449 | - |
| 0.2359 | 4200 | 0.154 | - |
| 0.2387 | 4250 | 0.147 | - |
| 0.2415 | 4300 | 0.1454 | - |
| 0.2443 | 4350 | 0.1432 | - |
| 0.2471 | 4400 | 0.1425 | - |
| 0.2499 | 4450 | 0.1479 | - |
| 0.2527 | 4500 | 0.1486 | - |
| 0.2555 | 4550 | 0.1478 | - |
| 0.2584 | 4600 | 0.1444 | - |
| 0.2612 | 4650 | 0.1463 | - |
| 0.2640 | 4700 | 0.143 | - |
| 0.2668 | 4750 | 0.1518 | - |
| 0.2696 | 4800 | 0.1445 | - |
| 0.2724 | 4850 | 0.1571 | - |
| 0.2752 | 4900 | 0.151 | - |
| 0.2780 | 4950 | 0.1447 | - |
| 0.2808 | 5000 | 0.1438 | - |
| 0.2836 | 5050 | 0.1372 | - |
| 0.2864 | 5100 | 0.1385 | - |
| 0.2892 | 5150 | 0.1513 | - |
| 0.2921 | 5200 | 0.1347 | - |
| 0.2949 | 5250 | 0.1357 | - |
| 0.2977 | 5300 | 0.1435 | - |
| 0.3005 | 5350 | 0.1398 | - |
| 0.3033 | 5400 | 0.1391 | - |
| 0.3061 | 5450 | 0.1348 | - |
| 0.3089 | 5500 | 0.1456 | - |
| 0.3117 | 5550 | 0.1469 | - |
| 0.3145 | 5600 | 0.1342 | - |
| 0.3173 | 5650 | 0.1458 | - |
| 0.3201 | 5700 | 0.1308 | - |
| 0.3229 | 5750 | 0.1323 | - |
| 0.3258 | 5800 | 0.1263 | - |
| 0.3286 | 5850 | 0.1498 | - |
| 0.3314 | 5900 | 0.1422 | - |
| 0.3342 | 5950 | 0.1409 | - |
| 0.3370 | 6000 | 0.1439 | - |
| 0.3398 | 6050 | 0.1408 | - |
| 0.3426 | 6100 | 0.1407 | - |
| 0.3454 | 6150 | 0.1237 | - |
| 0.3482 | 6200 | 0.1365 | - |
| 0.3510 | 6250 | 0.1382 | - |
| 0.3538 | 6300 | 0.134 | - |
| 0.3566 | 6350 | 0.1289 | - |
| 0.3594 | 6400 | 0.1401 | - |
| 0.3623 | 6450 | 0.138 | - |
| 0.3651 | 6500 | 0.1358 | - |
| 0.3679 | 6550 | 0.1428 | - |
| 0.3707 | 6600 | 0.1325 | - |
| 0.3735 | 6650 | 0.1265 | - |
| 0.3763 | 6700 | 0.1329 | - |
| 0.3791 | 6750 | 0.1423 | - |
| 0.3819 | 6800 | 0.136 | - |
| 0.3847 | 6850 | 0.1205 | - |
| 0.3875 | 6900 | 0.1291 | - |
| 0.3903 | 6950 | 0.1305 | - |
| 0.3931 | 7000 | 0.1388 | - |
| 0.3960 | 7050 | 0.1322 | - |
| 0.3988 | 7100 | 0.1386 | - |
| 0.4016 | 7150 | 0.1248 | - |
| 0.4044 | 7200 | 0.1292 | - |
| 0.4072 | 7250 | 0.1424 | - |
| 0.4100 | 7300 | 0.1488 | - |
| 0.4128 | 7350 | 0.1177 | - |
| 0.4156 | 7400 | 0.1313 | - |
| 0.4184 | 7450 | 0.133 | - |
| 0.4212 | 7500 | 0.121 | - |
| 0.4240 | 7550 | 0.1347 | - |
| 0.4268 | 7600 | 0.1331 | - |
| 0.4297 | 7650 | 0.1103 | - |
| 0.4325 | 7700 | 0.1302 | - |
| 0.4353 | 7750 | 0.1202 | - |
| 0.4381 | 7800 | 0.1249 | - |
| 0.4409 | 7850 | 0.1256 | - |
| 0.4437 | 7900 | 0.1304 | - |
| 0.4465 | 7950 | 0.1383 | - |
| 0.4493 | 8000 | 0.1295 | - |
| 0.4521 | 8050 | 0.1323 | - |
| 0.4549 | 8100 | 0.1153 | - |
| 0.4577 | 8150 | 0.1299 | - |
| 0.4605 | 8200 | 0.1185 | - |
| 0.4634 | 8250 | 0.1277 | - |
| 0.4662 | 8300 | 0.1336 | - |
| 0.4690 | 8350 | 0.1294 | - |
| 0.4718 | 8400 | 0.1321 | - |
| 0.4746 | 8450 | 0.1174 | - |
| 0.4774 | 8500 | 0.1275 | - |
| 0.4802 | 8550 | 0.1371 | - |
| 0.4830 | 8600 | 0.1309 | - |
| 0.4858 | 8650 | 0.1259 | - |
| 0.4886 | 8700 | 0.1211 | - |
| 0.4914 | 8750 | 0.1231 | - |
| 0.4942 | 8800 | 0.131 | - |
| 0.4971 | 8850 | 0.1206 | - |
| 0.4999 | 8900 | 0.1196 | - |
| 0.5027 | 8950 | 0.1327 | - |
| 0.5055 | 9000 | 0.1135 | - |
| 0.5083 | 9050 | 0.1241 | - |
| 0.5111 | 9100 | 0.1291 | - |
| 0.5139 | 9150 | 0.124 | - |
| 0.5167 | 9200 | 0.119 | - |
| 0.5195 | 9250 | 0.1234 | - |
| 0.5223 | 9300 | 0.1216 | - |
| 0.5251 | 9350 | 0.1178 | - |
| 0.5279 | 9400 | 0.1345 | - |
| 0.5307 | 9450 | 0.1218 | - |
| 0.5336 | 9500 | 0.1249 | - |
| 0.5364 | 9550 | 0.13 | - |
| 0.5392 | 9600 | 0.1173 | - |
| 0.5420 | 9650 | 0.1205 | - |
| 0.5448 | 9700 | 0.109 | - |
| 0.5476 | 9750 | 0.1324 | - |
| 0.5504 | 9800 | 0.1169 | - |
| 0.5532 | 9850 | 0.1208 | - |
| 0.5560 | 9900 | 0.1175 | - |
| 0.5588 | 9950 | 0.1192 | - |
| 0.5616 | 10000 | 0.1156 | - |
| 0.5644 | 10050 | 0.1216 | - |
| 0.5673 | 10100 | 0.1225 | - |
| 0.5701 | 10150 | 0.1202 | - |
| 0.5729 | 10200 | 0.1215 | - |
| 0.5757 | 10250 | 0.1188 | - |
| 0.5785 | 10300 | 0.1148 | - |
| 0.5813 | 10350 | 0.1203 | - |
| 0.5841 | 10400 | 0.1215 | - |
| 0.5869 | 10450 | 0.1157 | - |
| 0.5897 | 10500 | 0.1175 | - |
| 0.5925 | 10550 | 0.1269 | - |
| 0.5953 | 10600 | 0.1117 | - |
| 0.5981 | 10650 | 0.1155 | - |
| 0.6010 | 10700 | 0.1195 | - |
| 0.6038 | 10750 | 0.1238 | - |
| 0.6066 | 10800 | 0.116 | - |
| 0.6094 | 10850 | 0.1311 | - |
| 0.6122 | 10900 | 0.1111 | - |
| 0.6150 | 10950 | 0.1111 | - |
| 0.6178 | 11000 | 0.1061 | - |
| 0.6206 | 11050 | 0.1295 | - |
| 0.6234 | 11100 | 0.1087 | - |
| 0.6262 | 11150 | 0.1127 | - |
| 0.6290 | 11200 | 0.1254 | - |
| 0.6318 | 11250 | 0.1198 | - |
| 0.6347 | 11300 | 0.1201 | - |
| 0.6375 | 11350 | 0.116 | - |
| 0.6403 | 11400 | 0.116 | - |
| 0.6431 | 11450 | 0.1104 | - |
| 0.6459 | 11500 | 0.1262 | - |
| 0.6487 | 11550 | 0.1047 | - |
| 0.6515 | 11600 | 0.1191 | - |
| 0.6543 | 11650 | 0.1044 | - |
| 0.6571 | 11700 | 0.1101 | - |
| 0.6599 | 11750 | 0.1097 | - |
| 0.6627 | 11800 | 0.1103 | - |
| 0.6655 | 11850 | 0.1176 | - |
| 0.6684 | 11900 | 0.1121 | - |
| 0.6712 | 11950 | 0.1225 | - |
| 0.6740 | 12000 | 0.1168 | - |
| 0.6768 | 12050 | 0.1165 | - |
| 0.6796 | 12100 | 0.1185 | - |
| 0.6824 | 12150 | 0.1053 | - |
| 0.6852 | 12200 | 0.1032 | - |
| 0.6880 | 12250 | 0.1073 | - |
| 0.6908 | 12300 | 0.1087 | - |
| 0.6936 | 12350 | 0.119 | - |
| 0.6964 | 12400 | 0.1289 | - |
| 0.6992 | 12450 | 0.1137 | - |
| 0.7020 | 12500 | 0.1139 | - |
| 0.7049 | 12550 | 0.117 | - |
| 0.7077 | 12600 | 0.1148 | - |
| 0.7105 | 12650 | 0.1243 | - |
| 0.7133 | 12700 | 0.1144 | - |
| 0.7161 | 12750 | 0.1296 | - |
| 0.7189 | 12800 | 0.1066 | - |
| 0.7217 | 12850 | 0.1048 | - |
| 0.7245 | 12900 | 0.1099 | - |
| 0.7273 | 12950 | 0.1177 | - |
| 0.7301 | 13000 | 0.1316 | - |
| 0.7329 | 13050 | 0.1195 | - |
| 0.7357 | 13100 | 0.123 | - |
| 0.7386 | 13150 | 0.1074 | - |
| 0.7414 | 13200 | 0.1157 | - |
| 0.7442 | 13250 | 0.0995 | - |
| 0.7470 | 13300 | 0.1221 | - |
| 0.7498 | 13350 | 0.1092 | - |
| 0.7526 | 13400 | 0.1125 | - |
| 0.7554 | 13450 | 0.114 | - |
| 0.7582 | 13500 | 0.0969 | - |
| 0.7610 | 13550 | 0.1108 | - |
| 0.7638 | 13600 | 0.1087 | - |
| 0.7666 | 13650 | 0.1 | - |
| 0.7694 | 13700 | 0.1138 | - |
| 0.7723 | 13750 | 0.1141 | - |
| 0.7751 | 13800 | 0.115 | - |
| 0.7779 | 13850 | 0.1035 | - |
| 0.7807 | 13900 | 0.1042 | - |
| 0.7835 | 13950 | 0.1028 | - |
| 0.7863 | 14000 | 0.113 | - |
| 0.7891 | 14050 | 0.104 | - |
| 0.7919 | 14100 | 0.1256 | - |
| 0.7947 | 14150 | 0.1089 | - |
| 0.7975 | 14200 | 0.1107 | - |
| 0.8003 | 14250 | 0.1196 | - |
| 0.8031 | 14300 | 0.1048 | - |
| 0.8060 | 14350 | 0.1066 | - |
| 0.8088 | 14400 | 0.1119 | - |
| 0.8116 | 14450 | 0.1121 | - |
| 0.8144 | 14500 | 0.1261 | - |
| 0.8172 | 14550 | 0.1012 | - |
| 0.8200 | 14600 | 0.1114 | - |
| 0.8228 | 14650 | 0.1065 | - |
| 0.8256 | 14700 | 0.116 | - |
| 0.8284 | 14750 | 0.1088 | - |
| 0.8312 | 14800 | 0.1052 | - |
| 0.8340 | 14850 | 0.1079 | - |
| 0.8368 | 14900 | 0.1086 | - |
| 0.8397 | 14950 | 0.1007 | - |
| 0.8425 | 15000 | 0.12 | - |
| 0.8453 | 15050 | 0.1213 | - |
| 0.8481 | 15100 | 0.1127 | - |
| 0.8509 | 15150 | 0.1095 | - |
| 0.8537 | 15200 | 0.1079 | - |
| 0.8565 | 15250 | 0.1095 | - |
| 0.8593 | 15300 | 0.1249 | - |
| 0.8621 | 15350 | 0.111 | - |
| 0.8649 | 15400 | 0.1003 | - |
| 0.8677 | 15450 | 0.1125 | - |
| 0.8705 | 15500 | 0.1104 | - |
| 0.8734 | 15550 | 0.1084 | - |
| 0.8762 | 15600 | 0.1162 | - |
| 0.8790 | 15650 | 0.1267 | - |
| 0.8818 | 15700 | 0.0976 | - |
| 0.8846 | 15750 | 0.1136 | - |
| 0.8874 | 15800 | 0.1075 | - |
| 0.8902 | 15850 | 0.1104 | - |
| 0.8930 | 15900 | 0.1073 | - |
| 0.8958 | 15950 | 0.1078 | - |
| 0.8986 | 16000 | 0.1063 | - |
| 0.9014 | 16050 | 0.111 | - |
| 0.9042 | 16100 | 0.1205 | - |
| 0.9070 | 16150 | 0.1057 | - |
| 0.9099 | 16200 | 0.1016 | - |
| 0.9127 | 16250 | 0.1028 | - |
| 0.9155 | 16300 | 0.1112 | - |
| 0.9183 | 16350 | 0.0959 | - |
| 0.9211 | 16400 | 0.1074 | - |
| 0.9239 | 16450 | 0.1111 | - |
| 0.9267 | 16500 | 0.1097 | - |
| 0.9295 | 16550 | 0.116 | - |
| 0.9323 | 16600 | 0.103 | - |
| 0.9351 | 16650 | 0.1173 | - |
| 0.9379 | 16700 | 0.1016 | - |
| 0.9407 | 16750 | 0.1016 | - |
| 0.9436 | 16800 | 0.0902 | - |
| 0.9464 | 16850 | 0.0955 | - |
| 0.9492 | 16900 | 0.1187 | - |
| 0.9520 | 16950 | 0.0978 | - |
| 0.9548 | 17000 | 0.0924 | - |
| 0.9576 | 17050 | 0.1111 | - |
| 0.9604 | 17100 | 0.1077 | - |
| 0.9632 | 17150 | 0.1079 | - |
| 0.9660 | 17200 | 0.1089 | - |
| 0.9688 | 17250 | 0.1036 | - |
| 0.9716 | 17300 | 0.1068 | - |
| 0.9744 | 17350 | 0.099 | - |
| 0.9773 | 17400 | 0.1072 | - |
| 0.9801 | 17450 | 0.105 | - |
| 0.9829 | 17500 | 0.1118 | - |
| 0.9857 | 17550 | 0.0996 | - |
| 0.9885 | 17600 | 0.1056 | - |
| 0.9913 | 17650 | 0.119 | - |
| 0.9941 | 17700 | 0.1021 | - |
| 0.9969 | 17750 | 0.0963 | - |
| 0.9997 | 17800 | 0.1098 | - |
| 1.0025 | 17850 | 0.1049 | - |
| 1.0053 | 17900 | 0.0917 | - |
| 1.0081 | 17950 | 0.1092 | - |
| 1.0110 | 18000 | 0.0955 | - |
| 1.0138 | 18050 | 0.0981 | - |
| 1.0166 | 18100 | 0.0939 | - |
| 1.0194 | 18150 | 0.1063 | - |
| 1.0222 | 18200 | 0.1022 | - |
| 1.0250 | 18250 | 0.1031 | - |
| 1.0278 | 18300 | 0.0919 | - |
| 1.0306 | 18350 | 0.1041 | - |
| 1.0334 | 18400 | 0.0939 | - |
| 1.0362 | 18450 | 0.0946 | - |
| 1.0390 | 18500 | 0.1013 | - |
| 1.0418 | 18550 | 0.0932 | - |
| 1.0447 | 18600 | 0.0895 | - |
| 1.0475 | 18650 | 0.1119 | - |
| 1.0503 | 18700 | 0.1003 | - |
| 1.0531 | 18750 | 0.0889 | - |
| 1.0559 | 18800 | 0.1052 | - |
| 1.0587 | 18850 | 0.0997 | - |
| 1.0615 | 18900 | 0.1003 | - |
| 1.0643 | 18950 | 0.1009 | - |
| 1.0671 | 19000 | 0.1079 | - |
| 1.0699 | 19050 | 0.1007 | - |
| 1.0727 | 19100 | 0.099 | - |
| 1.0755 | 19150 | 0.1031 | - |
| 1.0783 | 19200 | 0.1016 | - |
| 1.0812 | 19250 | 0.0953 | - |
| 1.0840 | 19300 | 0.0969 | - |
| 1.0868 | 19350 | 0.0995 | - |
| 1.0896 | 19400 | 0.0936 | - |
| 1.0924 | 19450 | 0.1008 | - |
| 1.0952 | 19500 | 0.0984 | - |
| 1.0980 | 19550 | 0.1075 | - |
| 1.1008 | 19600 | 0.0921 | - |
| 1.1036 | 19650 | 0.0894 | - |
| 1.1064 | 19700 | 0.097 | - |
| 1.1092 | 19750 | 0.0921 | - |
| 1.1120 | 19800 | 0.0914 | - |
| 1.1149 | 19850 | 0.0937 | - |
| 1.1177 | 19900 | 0.1036 | - |
| 1.1205 | 19950 | 0.1025 | - |
| 1.1233 | 20000 | 0.0959 | - |
| 1.1261 | 20050 | 0.0939 | - |
| 1.1289 | 20100 | 0.0965 | - |
| 1.1317 | 20150 | 0.0984 | - |
| 1.1345 | 20200 | 0.1001 | - |
| 1.1373 | 20250 | 0.1028 | - |
| 1.1401 | 20300 | 0.0872 | - |
| 1.1429 | 20350 | 0.1064 | - |
| 1.1457 | 20400 | 0.0897 | - |
| 1.1486 | 20450 | 0.1059 | - |
| 1.1514 | 20500 | 0.0862 | - |
| 1.1542 | 20550 | 0.1036 | - |
| 1.1570 | 20600 | 0.0923 | - |
| 1.1598 | 20650 | 0.1044 | - |
| 1.1626 | 20700 | 0.0978 | - |
| 1.1654 | 20750 | 0.0961 | - |
| 1.1682 | 20800 | 0.0985 | - |
| 1.1710 | 20850 | 0.0979 | - |
| 1.1738 | 20900 | 0.0902 | - |
| 1.1766 | 20950 | 0.0989 | - |
| 1.1794 | 21000 | 0.0893 | - |
| 1.1823 | 21050 | 0.1055 | - |
| 1.1851 | 21100 | 0.1058 | - |
| 1.1879 | 21150 | 0.0875 | - |
| 1.1907 | 21200 | 0.108 | - |
| 1.1935 | 21250 | 0.1086 | - |
| 1.1963 | 21300 | 0.1023 | - |
| 1.1991 | 21350 | 0.1107 | - |
| 1.2019 | 21400 | 0.0986 | - |
| 1.2047 | 21450 | 0.0887 | - |
| 1.2075 | 21500 | 0.0965 | - |
| 1.2103 | 21550 | 0.1021 | - |
| 1.2131 | 21600 | 0.0983 | - |
| 1.2160 | 21650 | 0.0934 | - |
| 1.2188 | 21700 | 0.1007 | - |
| 1.2216 | 21750 | 0.0985 | - |
| 1.2244 | 21800 | 0.0981 | - |
| 1.2272 | 21850 | 0.0973 | - |
| 1.2300 | 21900 | 0.1102 | - |
| 1.2328 | 21950 | 0.1068 | - |
| 1.2356 | 22000 | 0.105 | - |
| 1.2384 | 22050 | 0.1041 | - |
| 1.2412 | 22100 | 0.0972 | - |
| 1.2440 | 22150 | 0.1025 | - |
| 1.2468 | 22200 | 0.081 | - |
| 1.2496 | 22250 | 0.1077 | - |
| 1.2525 | 22300 | 0.0974 | - |
| 1.2553 | 22350 | 0.1014 | - |
| 1.2581 | 22400 | 0.0938 | - |
| 1.2609 | 22450 | 0.0831 | - |
| 1.2637 | 22500 | 0.0951 | - |
| 1.2665 | 22550 | 0.0976 | - |
| 1.2693 | 22600 | 0.0951 | - |
| 1.2721 | 22650 | 0.0898 | - |
| 1.2749 | 22700 | 0.1096 | - |
| 1.2777 | 22750 | 0.1007 | - |
| 1.2805 | 22800 | 0.0889 | - |
| 1.2833 | 22850 | 0.0899 | - |
| 1.2862 | 22900 | 0.0915 | - |
| 1.2890 | 22950 | 0.0973 | - |
| 1.2918 | 23000 | 0.105 | - |
| 1.2946 | 23050 | 0.0871 | - |
| 1.2974 | 23100 | 0.1048 | - |
| 1.3002 | 23150 | 0.0877 | - |
| 1.3030 | 23200 | 0.1 | - |
| 1.3058 | 23250 | 0.0968 | - |
| 1.3086 | 23300 | 0.0987 | - |
| 1.3114 | 23350 | 0.09 | - |
| 1.3142 | 23400 | 0.0866 | - |
| 1.3170 | 23450 | 0.0952 | - |
| 1.3199 | 23500 | 0.0921 | - |
| 1.3227 | 23550 | 0.103 | - |
| 1.3255 | 23600 | 0.0949 | - |
| 1.3283 | 23650 | 0.0898 | - |
| 1.3311 | 23700 | 0.0883 | - |
| 1.3339 | 23750 | 0.0909 | - |
| 1.3367 | 23800 | 0.089 | - |
| 1.3395 | 23850 | 0.0813 | - |
| 1.3423 | 23900 | 0.0922 | - |
| 1.3451 | 23950 | 0.1052 | - |
| 1.3479 | 24000 | 0.0775 | - |
| 1.3507 | 24050 | 0.0881 | - |
| 1.3536 | 24100 | 0.1088 | - |
| 1.3564 | 24150 | 0.0991 | - |
| 1.3592 | 24200 | 0.1037 | - |
| 1.3620 | 24250 | 0.0901 | - |
| 1.3648 | 24300 | 0.1028 | - |
| 1.3676 | 24350 | 0.0931 | - |
| 1.3704 | 24400 | 0.0956 | - |
| 1.3732 | 24450 | 0.0932 | - |
| 1.3760 | 24500 | 0.1085 | - |
| 1.3788 | 24550 | 0.0941 | - |
| 1.3816 | 24600 | 0.0987 | - |
| 1.3844 | 24650 | 0.0925 | - |
| 1.3873 | 24700 | 0.098 | - |
| 1.3901 | 24750 | 0.0964 | - |
| 1.3929 | 24800 | 0.0731 | - |
| 1.3957 | 24850 | 0.0945 | - |
| 1.3985 | 24900 | 0.0837 | - |
| 1.4013 | 24950 | 0.0948 | - |
| 1.4041 | 25000 | 0.084 | - |
| 1.4069 | 25050 | 0.0936 | - |
| 1.4097 | 25100 | 0.103 | - |
| 1.4125 | 25150 | 0.1004 | - |
| 1.4153 | 25200 | 0.0909 | - |
| 1.4181 | 25250 | 0.0867 | - |
| 1.4209 | 25300 | 0.0876 | - |
| 1.4238 | 25350 | 0.09 | - |
| 1.4266 | 25400 | 0.0894 | - |
| 1.4294 | 25450 | 0.0942 | - |
| 1.4322 | 25500 | 0.0994 | - |
| 1.4350 | 25550 | 0.0935 | - |
| 1.4378 | 25600 | 0.0908 | - |
| 1.4406 | 25650 | 0.0837 | - |
| 1.4434 | 25700 | 0.1017 | - |
| 1.4462 | 25750 | 0.0984 | - |
| 1.4490 | 25800 | 0.089 | - |
| 1.4518 | 25850 | 0.0869 | - |
| 1.4546 | 25900 | 0.0976 | - |
| 1.4575 | 25950 | 0.0985 | - |
| 1.4603 | 26000 | 0.095 | - |
| 1.4631 | 26050 | 0.0954 | - |
| 1.4659 | 26100 | 0.0824 | - |
| 1.4687 | 26150 | 0.0942 | - |
| 1.4715 | 26200 | 0.0936 | - |
| 1.4743 | 26250 | 0.0868 | - |
| 1.4771 | 26300 | 0.0985 | - |
| 1.4799 | 26350 | 0.0873 | - |
| 1.4827 | 26400 | 0.0891 | - |
| 1.4855 | 26450 | 0.09 | - |
| 1.4883 | 26500 | 0.0894 | - |
| 1.4912 | 26550 | 0.0892 | - |
| 1.4940 | 26600 | 0.1031 | - |
| 1.4968 | 26650 | 0.1042 | - |
| 1.4996 | 26700 | 0.092 | - |
| 1.5024 | 26750 | 0.0946 | - |
| 1.5052 | 26800 | 0.1001 | - |
| 1.5080 | 26850 | 0.0846 | - |
| 1.5108 | 26900 | 0.0911 | - |
| 1.5136 | 26950 | 0.0877 | - |
| 1.5164 | 27000 | 0.1035 | - |
| 1.5192 | 27050 | 0.0867 | - |
| 1.5220 | 27100 | 0.0805 | - |
| 1.5249 | 27150 | 0.0883 | - |
| 1.5277 | 27200 | 0.0865 | - |
| 1.5305 | 27250 | 0.1049 | - |
| 1.5333 | 27300 | 0.0917 | - |
| 1.5361 | 27350 | 0.0862 | - |
| 1.5389 | 27400 | 0.0998 | - |
| 1.5417 | 27450 | 0.097 | - |
| 1.5445 | 27500 | 0.0917 | - |
| 1.5473 | 27550 | 0.102 | - |
| 1.5501 | 27600 | 0.0816 | - |
| 1.5529 | 27650 | 0.1034 | - |
| 1.5557 | 27700 | 0.1033 | - |
| 1.5586 | 27750 | 0.0879 | - |
| 1.5614 | 27800 | 0.0996 | - |
| 1.5642 | 27850 | 0.0924 | - |
| 1.5670 | 27900 | 0.098 | - |
| 1.5698 | 27950 | 0.0926 | - |
| 1.5726 | 28000 | 0.0887 | - |
| 1.5754 | 28050 | 0.0964 | - |
| 1.5782 | 28100 | 0.094 | - |
| 1.5810 | 28150 | 0.0967 | - |
| 1.5838 | 28200 | 0.0884 | - |
| 1.5866 | 28250 | 0.079 | - |
| 1.5894 | 28300 | 0.1006 | - |
| 1.5922 | 28350 | 0.1012 | - |
| 1.5951 | 28400 | 0.0982 | - |
| 1.5979 | 28450 | 0.0984 | - |
| 1.6007 | 28500 | 0.0942 | - |
| 1.6035 | 28550 | 0.0963 | - |
| 1.6063 | 28600 | 0.0928 | - |
| 1.6091 | 28650 | 0.0758 | - |
| 1.6119 | 28700 | 0.0935 | - |
| 1.6147 | 28750 | 0.087 | - |
| 1.6175 | 28800 | 0.0885 | - |
| 1.6203 | 28850 | 0.0988 | - |
| 1.6231 | 28900 | 0.0925 | - |
| 1.6259 | 28950 | 0.0921 | - |
| 1.6288 | 29000 | 0.0889 | - |
| 1.6316 | 29050 | 0.0863 | - |
| 1.6344 | 29100 | 0.0897 | - |
| 1.6372 | 29150 | 0.1064 | - |
| 1.6400 | 29200 | 0.0833 | - |
| 1.6428 | 29250 | 0.083 | - |
| 1.6456 | 29300 | 0.0996 | - |
| 1.6484 | 29350 | 0.084 | - |
| 1.6512 | 29400 | 0.0977 | - |
| 1.6540 | 29450 | 0.1094 | - |
| 1.6568 | 29500 | 0.0848 | - |
| 1.6596 | 29550 | 0.1009 | - |
| 1.6625 | 29600 | 0.1066 | - |
| 1.6653 | 29650 | 0.08 | - |
| 1.6681 | 29700 | 0.0879 | - |
| 1.6709 | 29750 | 0.0895 | - |
| 1.6737 | 29800 | 0.1063 | - |
| 1.6765 | 29850 | 0.097 | - |
| 1.6793 | 29900 | 0.0858 | - |
| 1.6821 | 29950 | 0.0823 | - |
| 1.6849 | 30000 | 0.1079 | - |
| 1.6877 | 30050 | 0.1041 | - |
| 1.6905 | 30100 | 0.0833 | - |
| 1.6933 | 30150 | 0.091 | - |
| 1.6962 | 30200 | 0.0946 | - |
| 1.6990 | 30250 | 0.0884 | - |
| 1.7018 | 30300 | 0.0915 | - |
| 1.7046 | 30350 | 0.084 | - |
| 1.7074 | 30400 | 0.0907 | - |
| 1.7102 | 30450 | 0.089 | - |
| 1.7130 | 30500 | 0.0963 | - |
| 1.7158 | 30550 | 0.0977 | - |
| 1.7186 | 30600 | 0.092 | - |
| 1.7214 | 30650 | 0.0813 | - |
| 1.7242 | 30700 | 0.0797 | - |
| 1.7270 | 30750 | 0.086 | - |
| 1.7299 | 30800 | 0.0981 | - |
| 1.7327 | 30850 | 0.084 | - |
| 1.7355 | 30900 | 0.0827 | - |
| 1.7383 | 30950 | 0.1061 | - |
| 1.7411 | 31000 | 0.0801 | - |
| 1.7439 | 31050 | 0.0856 | - |
| 1.7467 | 31100 | 0.1078 | - |
| 1.7495 | 31150 | 0.0751 | - |
| 1.7523 | 31200 | 0.095 | - |
| 1.7551 | 31250 | 0.0935 | - |
| 1.7579 | 31300 | 0.0824 | - |
| 1.7607 | 31350 | 0.0974 | - |
| 1.7635 | 31400 | 0.085 | - |
| 1.7664 | 31450 | 0.0899 | - |
| 1.7692 | 31500 | 0.0773 | - |
| 1.7720 | 31550 | 0.0867 | - |
| 1.7748 | 31600 | 0.0874 | - |
| 1.7776 | 31650 | 0.0979 | - |
| 1.7804 | 31700 | 0.0898 | - |
| 1.7832 | 31750 | 0.0779 | - |
| 1.7860 | 31800 | 0.0815 | - |
| 1.7888 | 31850 | 0.0809 | - |
| 1.7916 | 31900 | 0.0873 | - |
| 1.7944 | 31950 | 0.0849 | - |
| 1.7972 | 32000 | 0.0878 | - |
| 1.8001 | 32050 | 0.082 | - |
| 1.8029 | 32100 | 0.0902 | - |
| 1.8057 | 32150 | 0.0862 | - |
| 1.8085 | 32200 | 0.0977 | - |
| 1.8113 | 32250 | 0.0901 | - |
| 1.8141 | 32300 | 0.0809 | - |
| 1.8169 | 32350 | 0.0983 | - |
| 1.8197 | 32400 | 0.0906 | - |
| 1.8225 | 32450 | 0.091 | - |
| 1.8253 | 32500 | 0.0944 | - |
| 1.8281 | 32550 | 0.0907 | - |
| 1.8309 | 32600 | 0.0906 | - |
| 1.8338 | 32650 | 0.0931 | - |
| 1.8366 | 32700 | 0.0902 | - |
| 1.8394 | 32750 | 0.0825 | - |
| 1.8422 | 32800 | 0.0971 | - |
| 1.8450 | 32850 | 0.0797 | - |
| 1.8478 | 32900 | 0.0843 | - |
| 1.8506 | 32950 | 0.0836 | - |
| 1.8534 | 33000 | 0.0862 | - |
| 1.8562 | 33050 | 0.0954 | - |
| 1.8590 | 33100 | 0.093 | - |
| 1.8618 | 33150 | 0.0912 | - |
| 1.8646 | 33200 | 0.1021 | - |
| 1.8675 | 33250 | 0.0853 | - |
| 1.8703 | 33300 | 0.1052 | - |
| 1.8731 | 33350 | 0.0973 | - |
| 1.8759 | 33400 | 0.0815 | - |
| 1.8787 | 33450 | 0.0885 | - |
| 1.8815 | 33500 | 0.0835 | - |
| 1.8843 | 33550 | 0.0932 | - |
| 1.8871 | 33600 | 0.0843 | - |
| 1.8899 | 33650 | 0.0989 | - |
| 1.8927 | 33700 | 0.0934 | - |
| 1.8955 | 33750 | 0.0907 | - |
| 1.8983 | 33800 | 0.0799 | - |
| 1.9012 | 33850 | 0.097 | - |
| 1.9040 | 33900 | 0.0841 | - |
| 1.9068 | 33950 | 0.0822 | - |
| 1.9096 | 34000 | 0.0814 | - |
| 1.9124 | 34050 | 0.0933 | - |
| 1.9152 | 34100 | 0.0952 | - |
| 1.9180 | 34150 | 0.0888 | - |
| 1.9208 | 34200 | 0.0891 | - |
| 1.9236 | 34250 | 0.0869 | - |
| 1.9264 | 34300 | 0.079 | - |
| 1.9292 | 34350 | 0.0913 | - |
| 1.9320 | 34400 | 0.0833 | - |
| 1.9348 | 34450 | 0.1031 | - |
| 1.9377 | 34500 | 0.0922 | - |
| 1.9405 | 34550 | 0.0831 | - |
| 1.9433 | 34600 | 0.1019 | - |
| 1.9461 | 34650 | 0.093 | - |
| 1.9489 | 34700 | 0.1037 | - |
| 1.9517 | 34750 | 0.0885 | - |
| 1.9545 | 34800 | 0.1016 | - |
| 1.9573 | 34850 | 0.0919 | - |
| 1.9601 | 34900 | 0.091 | - |
| 1.9629 | 34950 | 0.0881 | - |
| 1.9657 | 35000 | 0.0866 | - |
| 1.9685 | 35050 | 0.0853 | - |
| 1.9714 | 35100 | 0.0842 | - |
| 1.9742 | 35150 | 0.0785 | - |
| 1.9770 | 35200 | 0.0905 | - |
| 1.9798 | 35250 | 0.0959 | - |
| 1.9826 | 35300 | 0.1064 | - |
| 1.9854 | 35350 | 0.0931 | - |
| 1.9882 | 35400 | 0.0885 | - |
| 1.9910 | 35450 | 0.0921 | - |
| 1.9938 | 35500 | 0.0894 | - |
| 1.9966 | 35550 | 0.0962 | - |
| 1.9994 | 35600 | 0.0833 | - |
Framework Versions
- Python: 3.12.12
- SetFit: 1.1.3
- Sentence Transformers: 5.1.2
- Transformers: 4.57.1
- PyTorch: 2.8.0+cu126
- Datasets: 4.0.0
- Tokenizers: 0.22.1
Citation
BibTeX
@article{https://doi.org/10.48550/arxiv.2209.11055,
doi = {10.48550/ARXIV.2209.11055},
url = {https://arxiv.org/abs/2209.11055},
author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
title = {Efficient Few-Shot Learning Without Prompts},
publisher = {arXiv},
year = {2022},
copyright = {Creative Commons Attribution 4.0 International}
}
- Downloads last month
- 4