jondurbin/

airoboros-l2-13b-gpt4-1.4.1

Overview

Licence and usage restrictions

• See the LICENSE.txt file attached for the original license, along with USE_POLICY.md which was also provided by Meta.

• The ToS for OpenAI API usage has a clause preventing the output from being used to train a model that competes with OpenAI
  • what does compete actually mean here?
  • these small open source models will not produce output anywhere near the quality of gpt-4, or even gpt-3.5, so I can't imagine this could credibly be considered competing in the first place
  • if someone else uses the dataset to do the same, they wouldn't necessarily be violating the ToS because they didn't call the API, so I don't know how that works
  • the training data used in essentially all large language models includes a significant of copyrighted or otherwise unallowable licensing in the first place
  • other work using the self-instruct method, e.g. the original here: https://github.com/yizhongw/self-instruct released the data and model as apache-2