Korean AI Legal Assistant Passes Bar, Reshaping Legal Landscape
Super Lawyer, the AI legal assistant from domestic legal tech company Law&Company, has written a new chapter in the legal AI field by achieving overwhelming results in the multiple-choice section of the 14th Bar Examination. Super Lawyer ac...
Super Lawyer, the AI legal assistant from domestic legal tech company Law&Company, has written a new chapter in the legal AI field by achieving overwhelming results in the multiple-choice section of the 14th Bar Examination. Super Lawyer accurately answered 111 out of a total of 150 questions, demonstrating a 74% accuracy rate, comfortably exceeding the passing score. This not only significantly surpasses the average number of correct answers for the multiple-choice section of the Bar Examination over the past five years but also represents an astonishing performance, placing it within the top 30% in this year's exam.
What is particularly noteworthy is that, in stark contrast to the latest AI models from global big tech companies, such as OpenAI's GPT-4.5 (49.3%) and Anthropic's Claude 3.7 Sonnet (45.3%), which failed to meet the passing score, Super Lawyer significantly outperformed them. This is considered an important indicator, proving that domestic legal AI technology has surpassed global standards.
Super Lawyer's remarkable development is based on the extensive domestic legal database built by Law&Company. It has learned from diverse legal materials, including 4.95 million precedents, laws, court decisions, administrative appeals, administrative rules, and authoritative interpretations. Furthermore, by exclusively utilizing over 600 legal books from Parkyoungsa, the number one legal book publisher in Korea, it has enhanced the accuracy and depth of its answers. Technologically, by optimizing the latest AI agent technology and advanced RAG (Retrieval-Augmented Generation) methods for the legal domain, an intelligent operational method that goes beyond simple searching to find optimal answers through multi-stage exploratory searching has proven effective.
Law&Company emphasizes that this achievement will serve as a crucial stepping stone towards a service that maximizes the work efficiency and professionalism of legal professionals, helping them concentrate on more core and creative tasks. Moving forward, the company plans to continue efforts to enhance answer performance and minimize hallucinations, and lead the future of legal AI by focusing on developing advanced reasoning models for complex legal task processing. Super Lawyer, launched in July last year for legal professionals, utilizes an architecture designed by Law&Company itself, based on commercial large language models.
What's Your Reaction?
Like
0
Dislike
0
Love
0
Funny
0
Angry
0
Sad
0
Wow
0