2024-03-29, Fri.

Top Stories       Business       Culture & Life       Science & Technology       World

Lecture

Notification

 

NEWS > Business


UAE¡¯s Falcon 40B Dominates Leaderboard: Ranks #1 Globally in Latest Hugging Face Independent Verification of Open-source AI Models

Date: 2023-05-30

ABU DHABI, UNITED ARAB EMIRATES-- May 30, 2023 -- Falcon 40B, the UAE’s first large-scale open-source, 40-billion-parameter AI model launched by Abu Dhabi’s Technology Innovation Institute (TII) last week, soared to the top spot on Hugging Face’s latest Open Large Language Model (LLM) Leaderboard. Hugging Face, an American company seeking to democratize artificial intelligence through open-source and open science, is considered the world’s definitive independent verifier of AI models.

Falcon 40B managed to beat back established models such as LLaMA from Meta (including its 65B model), StableLM from Stability AI, and RedPajama from Together to achieve the coveted ranking. The index utilizes four key benchmarks from the Eleuther AI Language Model Evaluation Harness, a consolidated framework that assesses generative language models on: the AI2 Reasoning Challenge (25-shot), a set of grade-school science questions; HellaSwag (10-shot), a test of common sense inference, which is easy for humans but challenging for SOTA models; MMLU (5-shot), a test to measure a text model’s multitask accuracy; and TruthfulQA (0-shot), a test to measure whether a language model is truthful in generating answers to questions.

Hugging Face’s Open LLM Leaderboard is an objective evaluation tool open to the AI community that tracks, ranks, and evaluates LLMs and chatbots as they are launched.

Trained on one trillion tokens, Falcon 40B marks a significant turning point for the UAE in its journey towards AI leadership, enabling widespread access to the model's weights for both research and commercial utilization. The new ranking confirms the model’s prowess in making AI more transparent, inclusive, and accessible for the greater good of humanity.

With this latest development, TII has managed to secure the UAE a seat at the table when it comes to generative AI models, allowing it to join an exclusive list of countries that are working to drive AI innovation and collaboration.

TII has already embarked work on its next version of Falcon - the 180B AI model. To learn more about the current open sourced Falcon 40B AI model, please visit: FalconLLM.TII.ae. The initial announcement on Falcon 40B can be found here: UAE's Technology Innovation Institute Launches Open-Source “Falcon 40B” Large Language Model for Research & Commercial Utilization.



 to the Top List of News

Clean Water and Sustainable Lifestyle: LG¡¯s Mindful Innovations
Everen Declares $350 Million Dividend and Announces Retirement of Chief Executive Officer in 2025
GCT Semiconductor Becomes a Publicly Traded Company After Completing Business Combination with Concord Acquisition Corp III, Will Commence Trading on
From Ransomware to Pig Butchering, Visa Report Shows Top Scams Impacting Consumers and Businesses Globally
Lifezone Metals Signs Binding Subscription Agreement for US$50 Million of Unsecured Convertible Debentures with Consortium of Marquee Mining Investors
Kasikorn Securities Selects ICE for Enhanced Portfolio Analytics and Risk Management for Derivatives
Faraday Partnered with SONIX to Create a New Product Featuring Its SONOS eFlash Solution

 

Merck Invests More than ¢æ 300 Million in New Life Science Production ...
MUMBAI, INDIA--(Business Wire / Korea Newswire)--India¡¯s leading law ...
ZAPI GROUP Showcases New Solutions in Material Automation at LogiMAT 2...
2024 Thales Data Threat Report Reveals Rise in Ransomware Attacks, as ...
AngloGold Ashanti Releases Preliminary Unaudited Condensed Consolidate...
Visa Foundation Helps To Uplift More Than Four Million SMBs
Andersen Global Bolsters Presence in China
Lifezone Metals Announces Receipt of Licence from Government of Tanzan...
[On the Job] Breaking Boundaries: Exploring Human-Centered Innovation ...
Black & Veatch Offering Insights to High-Level Presidential Trade and ...

 

 

60, Gamasanro 27gil, Guro-gu, Seoul, Korea, e-mail: news@newsji.com

Copyright, NEWSJI NETWORK.