A developer who worked on Phoenix Wright: Ace Attorney has commented on recent research that pitted various AI models against the classic courtroom series’ first installment.
As reported by Automaton, Hao AI Lab used Ace Attorney to try and benchmark four AI models’ memory, reasoning skills, visual understanding and strategic decision-making – with some performing better than others.
While none of the AI models managed to beat the game, Google Gemini and Open AI’s o1 managed to reason their way through to its penultimate episode.
“This index uses Ace Attorney to evaluate the AI’s practical ability to ‘find inconsistencies in testimony, select appropriate evidence to support them, and refute them most effectively’,” AI researcher K Ishi wrote. “As a result, the best ‘lawyer’ was o1.”