Selectstar Launches Automated AI Reliability Solution

Behind the immense potential of generative AI lies a core challenge: 'reliability verification'. To address this challenging task, Selectstar, an AI data specialist company, has officially launched its innovative solution 'DATUMO Eval'. This is the first solution in Korea to verify the reliability of AI services in an automated manner, and it is expected to open new horizons for AI commercialization. The core of DATUMO Eval is 'automation'. Previously, domain experts directly created countless evaluation questions, incurring immense costs and time. However, DATUMO Eval resolves all these inefficiencies by automatically generating over a million customized questions based on Selectstar's proprietary AI agent technology. By setting evaluation criteria tailored to the type and purpose of a company's AI service and automatically generating questions that reflect domain characteristics, it enables realistic evaluations in environments similar to actual customer data. Furthermore, it offers features to accurately detect and automatically evaluate cases where an AI service generates harmful information or deviates from set standards, and it even includes a 'red teaming' function to identify AI vulnerabilities, thereby further enhancing AI stability. It objectively analyzes the interaction between AI and users with numerical data, compares the performance of various AI models through diverse metrics, systematically identifies the root causes of problems, and suggests swift directions for improvement. Selectstar has concentrated its unique know-how, accumulated through collaboration with Shinhan Bank and its experience operating Korea's first and largest 'Generative AI Red Team Challenge', into 'DATUMO Eval'. This technological prowess is expected to lead the domestic AI reliability market, with its adoption already confirmed by numerous companies, including those in the financial sector, immediately upon its launch. In the global market, DATUMO Eval is also expected to stand shoulder to shoulder with leading overseas companies such as LangChain, ArizeAI, and Scale AI, setting a new standard for AI reliability verification with its differentiating feature of automated evaluation data generation. CEO Kim Se-yeop emphasized that "the core of AI commercialization is reliability," stating that DATUMO Eval will be an essential tool for companies to operate their AI services more safely and accurately. Selectstar plans to expand its influence beyond Korea into the global AI reliability verification market.