Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,31 @@
|
|
| 1 |
---
|
| 2 |
license: other
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: other
|
| 3 |
+
datasets:
|
| 4 |
+
- jondurbin/airoboros-gpt4-1.4.1
|
| 5 |
---
|
| 6 |
+
|
| 7 |
+
### Overview
|
| 8 |
+
|
| 9 |
+
Llama 2 version of https://huggingface.co/jondurbin/airoboros-70b-gpt4-1.4.1-qlora
|
| 10 |
+
|
| 11 |
+
See that model card for all the details.
|
| 12 |
+
|
| 13 |
+
|
| 14 |
+
### Licence and usage restrictions
|
| 15 |
+
|
| 16 |
+
This model was built on llama-2, which has a proprietary/custom Meta license.
|
| 17 |
+
- See the LICENSE.txt file attached for the original license, along with USE_POLICY.md which was also provided by Meta.
|
| 18 |
+
|
| 19 |
+
The data used to fine-tune the llama-2-70b-hf model was generated by GPT4 via OpenAI API calls.using [airoboros](https://github.com/jondurbin/airoboros)
|
| 20 |
+
- The ToS for OpenAI API usage has a clause preventing the output from being used to train a model that __competes__ with OpenAI
|
| 21 |
+
- what does *compete* actually mean here?
|
| 22 |
+
- these small open source models will not produce output anywhere near the quality of gpt-4, or even gpt-3.5, so I can't imagine this could credibly be considered competing in the first place
|
| 23 |
+
- if someone else uses the dataset to do the same, they wouldn't necessarily be violating the ToS because they didn't call the API, so I don't know how that works
|
| 24 |
+
- the training data used in essentially all large language models includes a significant of copyrighted or otherwise unallowable licensing in the first place
|
| 25 |
+
- other work using the self-instruct method, e.g. the original here: https://github.com/yizhongw/self-instruct released the data and model as apache-2
|
| 26 |
+
|
| 27 |
+
I am purposingly leaving this license ambiguous (other than the fact you must comply with the Meta original license) because I am not a lawyer and refuse to attempt to interpret all of the terms accordingly.
|
| 28 |
+
|
| 29 |
+
Your best bet is probably to avoid using this commercially due to the OpenAI API usage.
|
| 30 |
+
|
| 31 |
+
Either way, by using this model, you agree to completely idemnify me from any and all license related issues.
|