Cohere for AI<\/a>, the research arm of the language artificial intelligence (AI)<\/a> company, has introduced two new large language models (LLMs) \u2014 Aya Expanse 8B and 32B \u2014 as part of its ongoing project aimed at closing language divides in foundational AI datasets and models. The Aya Expanse models provide researchers access to advanced AI capabilities across 23 languages, including Arabic, Chinese, French, and Hindi.<\/p>\n\n\n\n

\u201cBuilding on more than two years of open science research, Aya Expanse offers significant performance advances, setting a new state-of-the-art for multilingual LLMs,\u201d the Cohere website<\/a> states. \u201cThis includes a series of breakthroughs in data arbitrage, preference training for performance and safety, and model merging.\u201d<\/p>\n\n\n\n

According to a SiliconANGLE<\/em> article<\/a>, the two Aya Expanse models were launched with open weights on hosting sites Hugging Face<\/a> and Kaggle<\/a>, and they used \u201cseveral new core research innovations\u201d to achieve high performance, including \u201csynthetic data and human feedback in late-term training.\u201d<\/p>\n\n\n\n

In a blog post<\/a>, Cohere claims that Aya Expanse 32B outperforms models like Google<\/a>\u2019s Gemma 2 27B and Meta<\/a>\u2019s Llama 3.1 70B. For lower-parameter options, Aya Expanse 8B also demonstrated advantages over other similar-sized models like Gemma 2 9B and Llama 3.1 8B. \u201cThe improvements in Aya Expanse are the result of a sustained focus on expanding how AI serves languages around the world by rethinking the core building blocks of machine learning breakthroughs,\u201d the blog post states.<\/p>\n\n\n\n

According to a VentureBeat<\/em> article<\/a> by Emilia David, the Aya initiative attempts to solve the problem of research being done on LLMs that don\u2019t perform well in languages other than English. \u201cMany LLMs eventually become available in other languages, especially for widely spoken languages, but there is difficulty in finding data to train models with the different languages,\u201d David writes. \u201cIt can also be difficult to accurately benchmark the performance of models in different languages because of the quality of translations.\u201d<\/p>\n\n\n\n

Aya, derived from the Twi language term for \u201cfern,\u201d has grown into one of the world\u2019s largest open-source multilingual projects, featuring over 513 million data points curated across 101 languages and 250 language ambassadors worldwide. This collaborative approach allows Aya\u2019s datasets to expand research opportunities in regions where non-English AI resources remain limited.<\/p>\n","protected":false},"excerpt":{"rendered":"

Cohere for AI, the research arm of the language ar […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[391],"tags":[],"class_list":["post-36047","post","type-post","status-publish","format-standard","hentry","category-391"],"_links":{"self":[{"href":"https:\/\/linguaresources.com\/index.php?rest_route=\/wp\/v2\/posts\/36047","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/linguaresources.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/linguaresources.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/linguaresources.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/linguaresources.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=36047"}],"version-history":[{"count":0,"href":"https:\/\/linguaresources.com\/index.php?rest_route=\/wp\/v2\/posts\/36047\/revisions"}],"wp:attachment":[{"href":"https:\/\/linguaresources.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=36047"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/linguaresources.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=36047"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/linguaresources.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=36047"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}