In order to compete with OpenAI's open-source GPT-4, which drives products like ChatGPT and Microsoft Bing, Meta announced that it is opening up the source code for their large language model, LLaMA 2. This makes it free for commercial and research use.
As part of Microsoft's Inspire event, Meta made the announcement, highlighting its support for Windows and Azure as well as the two firms' "growing" cooperation. At the same time, Microsoft provided additional information regarding the cost and features of the AI capabilities included in its 360 platform. Additionally, Qualcomm disclosed that it is collaborating with Meta to introduce LLaMa to laptops, phones, and headsets starting in 2024 for AI-powered apps that don't require the use of cloud services.
According to Meta's news release, the decision to open up LLaMA was made in order to provide companies, startups, and researchers with wider access to AI technologies and enable community experimentation.LLaMa 2 reportedly received training on 40% more data than LLaMa 1, which includes data from "publicly available online data sources." It also says it “outperforms” other LLMs like Falcon and MPT when it comes to reasoning, coding, proficiency, and knowledge tests.
Meta stated that by opening up LLaMA, it hopes to increase transparency and safety. According to the manufacturer, the LLaMA 2 model has been "red-teamed," or evaluated for safety by "generating adversarial prompts to facilitate model fine-tuning," both internally and externally. Meta also reveals the evaluation and modification processes for the models. The open-sourced LLaMa 2 will be available through Microsoft’s Azure platform. Meta said LLaMA will also be available through AWS, Hugging Face, and other providers.
“We believe an open approach is the right one for the development of today’s AI models, especially those in the generative space where the technology is rapidly advancing,” Meta said in a statement. “Opening access to today’s AI models means a generation of developers and researchers can stress test them, identifying and solving problems fast, as a community.”
Meta's LLaMA model was first revealed in February, but a few days later, it was leaked on 4chan. With more individuals having access to LLaMA 2, more AI-powered solutions will undoubtedly be developed based on the model. Although Meta claims to have had more than 100,000 requests from researchers to utilize its initial model, it is probable that the open-source LLaMA 2 will be far more widely used.