Hugging Face's logo

tiiuae
/
Falcon-H1-3B-Instruct-GGUF

Transformers
GGUF
falcon-h1
conversational
Model card Files
xet
Community
1
ybelkada commited on
Commit
0292245
·
verified ·
1 Parent(s): 39342b8

Add files using upload-large-folder tool

Browse files
Files changed (35) hide show
  1. Falcon-H1-3B-Instruct-BF16.gguf +2 -2
  2. Falcon-H1-3B-Instruct-F16.gguf +2 -2
  3. Falcon-H1-3B-Instruct-F32.gguf +2 -2
  4. Falcon-H1-3B-Instruct-IQ1_M.gguf +2 -2
  5. Falcon-H1-3B-Instruct-IQ1_S.gguf +2 -2
  6. Falcon-H1-3B-Instruct-IQ2_M.gguf +2 -2
  7. Falcon-H1-3B-Instruct-IQ2_S.gguf +2 -2
  8. Falcon-H1-3B-Instruct-IQ2_XS.gguf +2 -2
  9. Falcon-H1-3B-Instruct-IQ2_XXS.gguf +2 -2
  10. Falcon-H1-3B-Instruct-IQ3_M.gguf +2 -2
  11. Falcon-H1-3B-Instruct-IQ3_S.gguf +2 -2
  12. Falcon-H1-3B-Instruct-IQ3_XS.gguf +2 -2
  13. Falcon-H1-3B-Instruct-IQ3_XXS.gguf +2 -2
  14. Falcon-H1-3B-Instruct-IQ4_NL.gguf +2 -2
  15. Falcon-H1-3B-Instruct-IQ4_XS.gguf +2 -2
  16. Falcon-H1-3B-Instruct-Q2_K.gguf +2 -2
  17. Falcon-H1-3B-Instruct-Q2_K_S.gguf +2 -2
  18. Falcon-H1-3B-Instruct-Q3_K.gguf +2 -2
  19. Falcon-H1-3B-Instruct-Q3_K_L.gguf +2 -2
  20. Falcon-H1-3B-Instruct-Q3_K_M.gguf +2 -2
  21. Falcon-H1-3B-Instruct-Q3_K_S.gguf +2 -2
  22. Falcon-H1-3B-Instruct-Q4_0.gguf +2 -2
  23. Falcon-H1-3B-Instruct-Q4_1.gguf +2 -2
  24. Falcon-H1-3B-Instruct-Q4_K.gguf +2 -2
  25. Falcon-H1-3B-Instruct-Q4_K_M.gguf +2 -2
  26. Falcon-H1-3B-Instruct-Q4_K_S.gguf +2 -2
  27. Falcon-H1-3B-Instruct-Q5_0.gguf +2 -2
  28. Falcon-H1-3B-Instruct-Q5_1.gguf +2 -2
  29. Falcon-H1-3B-Instruct-Q5_K.gguf +2 -2
  30. Falcon-H1-3B-Instruct-Q5_K_M.gguf +2 -2
  31. Falcon-H1-3B-Instruct-Q5_K_S.gguf +2 -2
  32. Falcon-H1-3B-Instruct-Q6_K.gguf +2 -2
  33. Falcon-H1-3B-Instruct-Q8_0.gguf +2 -2
  34. Falcon-H1-3B-Instruct-TQ1_0.gguf +2 -2
  35. Falcon-H1-3B-Instruct-TQ2_0.gguf +2 -2
Falcon-H1-3B-Instruct-BF16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ec8c1c8481eff75115f435ad56c03bd279d1c69bf7639616099d9004e15c6b44
3
- size 6303533728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3abab9eaec749f8793462d6f764931e72b51db1e3db6e2c44be27b9dbfc9ca6e
3
+ size 6303533632
Falcon-H1-3B-Instruct-F16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f7d8030294c0185a1b299414588d2548c8ac8221010e4f0c2eb4f53ab7f521c0
3
- size 6303533728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09af68bc63cd5b82846c96109a7180285e19e1ce3d74a3681bf3a0087100ebb3
3
+ size 6303533632
Falcon-H1-3B-Instruct-F32.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cd65de59767da404b5a5d1e263846db68a671d8339e0a66ac3593c789bc9c075
3
- size 12600243104
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca7bc597609b728c74445f09902acb8110b0367c30b2341d91d202247ff37f65
3
+ size 12600243008
Falcon-H1-3B-Instruct-IQ1_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c7ae489d225d94e65cad79bf1a29198348536cf18211e7856d98292d5099206a
3
- size 810708448
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fe323e68ebda0c2234bad6cf94d2cdb3955e6e4efab223ff70d3d91c11c028b
3
+ size 810708384
Falcon-H1-3B-Instruct-IQ1_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:064fd3a743c07f9746a52bc428556b89a59c1cae98a73a1b7cd9411d4ac7fe95
3
- size 749207008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:510b3c81e93831118b6eff9d69adc6ebd5f3850a7bd711ff20107db378f1a682
3
+ size 749206944
Falcon-H1-3B-Instruct-IQ2_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bb154808c3513e3b5e1607b17fea91d2b475842418e9601841947728c8771faa
3
- size 1118666464
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6bf0109b6dade31f90f8e4d46cb43689397e7d48b066de267690d57bfbe26441
3
+ size 1118666400
Falcon-H1-3B-Instruct-IQ2_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6b82b460d824fa8b33ee16dee6dc22a763693bb95a1911acb7239ab8e6d58fc5
3
- size 1036664544
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8065a7fc0dde5324ed27493dbf046cbd8684a5105128a5187bb81d0930b90642
3
+ size 1036664480
Falcon-H1-3B-Instruct-IQ2_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0db26fb56d31a8ebf3d146e77714096cafc7121fb2829105154ed9a24e29da1f
3
- size 998489568
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d61131811f5392c96d3e9036690d8fbe0450ca3a9610c81939cfbe8fe67586db
3
+ size 998489504
Falcon-H1-3B-Instruct-IQ2_XXS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e00c749504dd4f321caf38c57ccc1af79d8ca37164fff687398f985c503d0b15
3
- size 913210848
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f26e6ad586753f1d36128b5c3c9815aeed74c029570b65d9b5fa06b5c11c018
3
+ size 913210784
Falcon-H1-3B-Instruct-IQ3_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:91692efc6e36801686c497db473a926fcf9efc8bc2b0da408fe86e8fcc3e7ee0
3
- size 1450238016
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c979521ee5be8a22b2cdc0b87cb92ece21af74c91f566bc1d89a4fe417f0369
3
+ size 1450237952
Falcon-H1-3B-Instruct-IQ3_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:acac617be54f1249295334ee9f7fa587ebf472d23af439049bab5a8294c14fa1
3
- size 1427955776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ef124848fd0b79820eab1cf1fcdb80e8c227b355a5f2a9858d8626cf7cde80c
3
+ size 1427955712
Falcon-H1-3B-Instruct-IQ3_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2316ae899bb7cb544ab2d132664c01ac2c167d193838321712c240cc877ffc34
3
- size 1386668096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a3fcfe6b7b2eedf02750159911fef7a67acc5d5bb0c768844eac2ad3132eaeb
3
+ size 1386668032
Falcon-H1-3B-Instruct-IQ3_XXS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9f78c4cb410f4205ede4b6b6f2f71a528bdec17fccd8febd220ca3362fe3bb3b
3
- size 1271856864
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c181be6f522e7ab58faa55447e5158f09c644a3ab6c3b63faf687549757716e6
3
+ size 1271856800
Falcon-H1-3B-Instruct-IQ4_NL.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ff437a8ea8875dbdbf73023db38ef3bbb00af23c349713b4190056218a4cb3b9
3
- size 1823650176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:711bb15542ed54b1fed7eed9be5103c8c5fb8cb5f175ad3757a1209811ab5892
3
+ size 1823650112
Falcon-H1-3B-Instruct-IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3d7202b289aa2940deb61d3a6bfa92a7b203ec39cc3fc796a92c0198820cc6c1
3
- size 1731162432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed70ea18f1368e9e2ebc438ccb85473f5a3721b69bbebad13b6b69a0bf6a116a
3
+ size 1731162368
Falcon-H1-3B-Instruct-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:810eec0f144b2995cf7d97fe446af929e8c3fbcad43b3b026111d3fe6d22bf81
3
- size 1189138240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fb3974c1470b2a922a2664aa990d89227588c69b6af1c3b7ca6388dd5acf7941
3
+ size 1189138176
Falcon-H1-3B-Instruct-Q2_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:37ddfc63f242d6957e34997bde54a096f4a2216e2605e27dc1d394573a5dc9af
3
- size 1142116160
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c83dad0b7e807124dff68f0cb079ddffbfbf5bac5dd7cf73682565954ff92f9
3
+ size 1142116096
Falcon-H1-3B-Instruct-Q3_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ccb098449861b8d95635a9b41f66a6a05064e9fd1c1885f3d0a30300ba902c65
3
- size 1512824896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78a9bf2c56493ab6fcef9e048a6884195169d383fe96e17af445e3c2544e7b04
3
+ size 1512824832
Falcon-H1-3B-Instruct-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:59008b2cf980dc6f3c39163e492c9a9c4384eff66880ce769ec1127537efca4b
3
- size 1587372096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:226cd2213c7ffbf78a0cb3c1281f51bde899b0124bf725b1bd8cd500349de6fb
3
+ size 1587372032
Falcon-H1-3B-Instruct-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ccb098449861b8d95635a9b41f66a6a05064e9fd1c1885f3d0a30300ba902c65
3
- size 1512824896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78a9bf2c56493ab6fcef9e048a6884195169d383fe96e17af445e3c2544e7b04
3
+ size 1512824832
Falcon-H1-3B-Instruct-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:82e2d64f5d77e25e0e878136e0e3d343bff505c639ee081014f4aed52418562c
3
- size 1425170496
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70102dcd283538d4577579f05616ef05910a055dcf6a6177dadf0bee193b0d68
3
+ size 1425170432
Falcon-H1-3B-Instruct-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7ef6582601b5f72fe05c54b4da6e9fff70fe3a7220dedbc2166960e588224e86
3
- size 1821028480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3724d593ab73d399afe7d4b53478181a7f111405c5f5e07ae35611ae80070e0
3
+ size 1821028384
Falcon-H1-3B-Instruct-Q4_1.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:380ea464606b556d7ba57f96dafb68bbf17f53ce366156f6a881aae0df759edb
3
- size 2007314720
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79211fb16fd4fc5502fdb034893c1924bd35cdf4eef6d6882fdbc9e1be3fc74c
3
+ size 2007314624
Falcon-H1-3B-Instruct-Q4_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6579ad7e29c7ecf720f1270db50a11fe56f3fd737a5bcc5cca8cf7b548d758d2
3
- size 1888612480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1926265eab19b0e47f0c2739e499a18e388373a616d71a218b924d5b95bdf702
3
+ size 1888612384
Falcon-H1-3B-Instruct-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6579ad7e29c7ecf720f1270db50a11fe56f3fd737a5bcc5cca8cf7b548d758d2
3
- size 1888612480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1926265eab19b0e47f0c2739e499a18e388373a616d71a218b924d5b95bdf702
3
+ size 1888612384
Falcon-H1-3B-Instruct-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:452b4abcb4464d43034c968bc2c1b3e5c6a36f33bc65bdfdabc02a257d5c521a
3
- size 1829220480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aeb0948fb0878ddf8059147f452015adbb9fc0f7236ddbbc063364e0701d470b
3
+ size 1829220384
Falcon-H1-3B-Instruct-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e4df8ed76fab183630810ce594f87b0c17d29251e9ed1382903911011dfec074
3
- size 2193600960
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4180f09f52603f29e4b4b34c874a7437a1469c6dcdaba8e03d567d378b25a606
3
+ size 2193600864
Falcon-H1-3B-Instruct-Q5_1.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:015725795f1ae945b1576ffbe1b59bbd8c3053c45d6b0b6d4f22b4b07aaa559d
3
- size 1886490624
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f06a6649b32f5099396e77a3a9505f536a777cef42e6fd95d52f19a985714eb2
3
+ size 2379887104
Falcon-H1-3B-Instruct-Q5_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0f5148db7f33058577cbcca7a5525446cb80f5d9de01159ace877cb73a524bff
3
- size 1904054272
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6fd3cc48e3fad069686799189b00ea08a6d599c47aa57f12ed38e835fedc459
3
+ size 2228416864
Falcon-H1-3B-Instruct-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bb2141fdabf1edcebff944d7eb40163e54260b64d55259205556aa7fa15f628c
3
- size 2228416960
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6fd3cc48e3fad069686799189b00ea08a6d599c47aa57f12ed38e835fedc459
3
+ size 2228416864
Falcon-H1-3B-Instruct-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b4e9bada58702292f0e471b6f3479d8240d42118775e63ab45a2cbaaf15c575c
3
- size 2193600960
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:954a2fde292c96b6c4e0f9710b94ac7d293280a4bd4ca6b568af729a645e83f1
3
+ size 2193600864
Falcon-H1-3B-Instruct-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e00dc443993875d9420c530db8bf5fcedcc4d6c7049e192f59904a388980f8b3
3
- size 2589459232
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:685b280dfd187e22b42816f8cfd73821570b3c9a4cca2e45c78951165f482d81
3
+ size 2589459136
Falcon-H1-3B-Instruct-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:99f9ac544c2b9326db6beda00c88639c9245d188730d9e128f12087ab18c41da
3
- size 3351951328
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b69da4470f067d38faf05e838bdb2cde099dbc7c812507e538e83132d3a0f2f
3
+ size 3351951232
Falcon-H1-3B-Instruct-TQ1_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d4e418d6eab33404cb248928283716d5bf1149a27899adb5b77e85f9f9e3e4dc
3
- size 832151936
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0f96984fbdf81775c08205574f26a5902383fcba20f0ec0ee7fd3be92ee94b08
3
+ size 832151872
Falcon-H1-3B-Instruct-TQ2_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b9c7673456d21a6554048d2ea14ee641302711c4ceee5d1b66fcdacbc98b3e1d
3
- size 964002176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a32577de0d0210b433b8aea976ac98237a32360f2b6525246ca90f7d28edaac8
3
+ size 964002112