Facebook owner Meta Platforms Inc (FB.O) is opening up a large language model for artificial intelligence research, the social media company said on Tuesday.
Meta says its model is the first 175 billion parameter language model made available to the wider AI research community.
“Large language models” are natural language processing systems which are trained on massive volumes of text, and are capable of answering reading comprehension questions or generating new text.
In a blog post, Meta said the release of its “Open Pretrained Transformer (OPT-175B)” model would improve researchers’ abilities to understand how large language models work.
Meta said restrictions on access to such models had been “hindering progress on efforts to improve their robustness and mitigate known issues such as bias and toxicity”.
Artificial intelligence technology, which is a key area of research and development for several major online platforms, can perpetuate humans’ societal biases around issues like race and gender. Some researchers have concerns about the harms that can be spread through large language models.
Meta said it “hoped to increase the diversity of voices defining the ethical considerations of such technologies.”
The tech giant said it was releasing the model under a non-commercial license to focus on research use cases in order to prevent abuse and “maintain integrity.”
Meta said it will grant access to the model to academic researchers and those associated with government, civil society and academic organizations, as well as industry research labs. This release will include pretrained models and code to train and use them.