Native Open LLM Rankings Released... Upstage and NIA Sign Business Agreement

Domestic AI startup Upstage announced on the 5th that it has signed a 'Business Agreement for Utilizing AI Hub Data' with the National Information Society Agency (NIA) to establish a Korean-style open large language model (LLM) leaderboard.

Under this agreement, Upstage plans to build the LLM leaderboard within this month by utilizing various Korean language data provided by AI Hub, NIA's platform for providing AI training data across diverse fields.

From the left, Seonghoon Kim, CEO of Upstage, and Jongsung Hwang, President of NIA.
[Photo by Upstage]

The leaderboard to be built by Upstage is the Korean version of the Hugging Face Open LLM Leaderboard, which evaluates open LLM models. It is a platform that assesses and ranks the performance of LLMs developed based on the Korean language. In addition to the existing four indicators?reasoning and common sense ability, comprehensive language understanding ability, and hallucination prevention?the platform will evaluate models based on additional criteria such as ethics and expert knowledge, using reliable data from NIA and academia.

Through this collaboration, NIA also committed to joining Upstage's 1T Club and providing high-quality data. Last month, Upstage launched the 1T Club, collaborating with partners contributing over 100 million words of Korean data in various forms such as text, books, and articles.

Kim Seong-hoon, CEO of Upstage, said, "Through the agreement with NIA, we have been able to solve the shortage of Korean language data and provide a competitive AI platform in both domestic and international markets. Together with NIA, we will prove the performance and innovation of domestic LLMs through the Korean-style Open LLM Leaderboard and strive for the advancement and dissemination of artificial intelligence."

Hwang Jong-sung, President of NIA, stated, "Through the agreement with Upstage, an AI startup recognized globally, AI Hub’s data can now be utilized in domestic and international AI markets. We will further enhance the level and diversity of domestic LLMs through the Korean-style Open LLM Leaderboard and devote more efforts to building the AI ecosystem."

This content was produced with the assistance of AI translation services.