First CBT Poetry Test "Generally Satisfactory"... Screen Went Off at Some Test Centers Causing Anxiety

Published 15 Jan.2024 16:05(KST)

Test takers had mixed evaluations of the computer-based testing (CBT) method, which was introduced for the first time in this year's bar exam. While many gave positive feedback, noting reduced exam fatigue, some experienced unexpected issues such as the computer screen turning off, causing anxiety. Since the bar exam is also part of the selection process for public officials like prosecutors and law clerks, there are calls for the Ministry of Justice, the overseeing authority, to provide meticulous supervision and support.

2023 CBT Bar Exam Mock Test Site [Photo by Council of Law Schools]

Reduced Fatigue from Moving Away from Handwriting, but Screen Shutoffs Due to System Errors

The 13th bar exam was held from the 9th to the 13th of this month. Notably, this year marked the first introduction of the CBT method for the case and record-type exams, which were previously handwritten. Handwriting was criticized as outdated in an era dominated by computers and was inconvenient for both examinees, who worried about disadvantages due to illegible handwriting, and graders. In response, the Ministry of Justice made the introduction of CBT a key project last year.

Most examinees who took the exam this year evaluated the CBT method positively. Kim Byung-min (32, male) said, “The time and fatigue feel very different compared to writing by hand,” adding, “I’m glad CBT was implemented.”

A student (31) at Ajou University Law School said, “Usually, after the exam, I had to rest almost the entire next day, but now that’s not necessary.”

However, some examinees experienced unfortunate incidents where the screen turned off more than twice during the exam. Examinee B (30), who took the exam at Hanyang University Law School on the 10th, said, “Because the screen turned off twice during the exam, I spent 8 minutes longer solving problems than other examinees,” expressing concern that “although the school handled it well, if this happens repeatedly, there could be administrative lawsuits.”

Built with Law School’s Own Budget... Disparities Among Exam Venues

According to confirmation from Hanyang University Law School by the Legal News, about three system errors were reported on the exam day at the Hanyang University test site. The law school explained, “The error on the 10th was caused by someone stepping on cables laid on the floor, momentarily disconnecting the computer.”

The Ministry of Justice responded regarding the CBT system errors during the exam, stating, “We understand that there were no major problems.”

Although CBT-related errors are not frequent, concerns have been raised that, under the current system, some exam venues may have relatively poor IT environments. Without government budget support, universities must secure IT companies on their own budgets to set up network cables and install programs for CBT exam rooms. As a result, the exam environment for examinees may vary depending on building structure and financial capacity. Generally, large lecture halls with many stairs face more challenges in network cable connections.

A professor at a private law school said, “There are no dedicated facilities; general lecture rooms have to be adapted for CBT by installing network cables and modifying structures, but since facilities vary greatly by school, the environment differs by exam site as well,” adding, “From the students’ perspective, it can feel like a matter of luck.”

There are also criticisms that rushing the CBT introduction led to excessive costs.

A professor at a Seoul-based law school said, “Installing network cables and renting laptops costs tens of millions of won annually,” and emphasized, “Ultimately, there is a need to introduce internet-based testing (IBT) that allows examinees to take the exam on their own computers.”