INTELLIGENT CLOUD
ServiceNow , Hugging Face release StarCoder , openaccess large language model for code generation
S erviceNow , announced the release of one of the world ’ s most responsibly developed and strongest-performing open-access large language model for code generation . Led by ServiceNow Research and Hugging Face , the open-access , open-science , and open-governance 15 billion parameter StarCoder LLM makes generative AI more transparent and accessible to enable responsible innovation at scale .
The StarCoder model is designed to level the playing field so developers from organisations of all sizes can harness the power of generative AI and maximise the business impact of automation with the proper governance , safety , and compliance protocols . This new LLM marks the next major milestone in the BigCode Project , an ambitious initiative to develop state-of-the-art AI systems for code in an open and responsible manner with the support of the openscientific AI research community .
Trained with a trillion tokens of permissively licensed source code covering over 80 programming languages from BigCode ’ s The Stack v1.2 dataset , StarCoder can be deployed to bring pairprogramming like generative AI to applications with capabilities like text-to-code and text-to-workflow . With this , StarCoder gives professional software engineers the power to tackle the most complex programming challenges and empowers citizen developers to build new software regardless of technical ability – accelerating AI innovation at scale .
The model will be released with open-access on the Code Open RAIL-M license to permit royalty-free distribution . Unlike traditional open-source software released without use case restrictions , BigCode releases the model with a responsible AI model license that includes use case restrictions that apply to modifications of the model , and applications using the model – for example , to restrict the models from being used to generate or distribute malicious code to harm electronic systems . Supporting code has been open sourced on the BigCode project ’ s GitHub .
ServiceNow Research and Hugging Face , which works on some of the world ’ s largest AI and LLM initiatives , launched the joint BigCode Project in September 2022 . The project continues to operate as an open scientific collaboration , as the two companies harness the collective brainpower and resources from the opensource community through BigCode working groups , task forces , and meetups .
Through partnerships with research organisations like Hugging Face , ServiceNow is fuelling the development of state-of-the-art generative AI with socially responsible contributions back to the AI research and development community . This includes the company ’ s partnership with Mila , the Quebec AI Institute , to bridge the demands of advanced AI research .
The Mila collaboration will nurture ties with academia by providing the broader research community with enterprise AI experience . ServiceNow also continues to invest internally in AI research and development to build AI-powered experiences that are reliable and safe , and that users can trust . •
INTELLIGENT TECH CHANNELS 4343