Legal brains will have a week to defeat AI in lawyer v machine challenge


Bull: looking to make lasting contribution to the field

More than 50 solicitors, barristers and in-house counsel have volunteered to outsmart predictive software based on artificial intelligence in a ground-breaking lawyer v machine challenge.

Lawyers will have a week to predict whether real PPI complaints were upheld or rejected by the Financial Ombudsman, before CaseCrunch, the new name for what was Elexirr, predicts the outcomes in its own way.

Ludwig Bull, managing director of CaseCrunch, told Legal Futures: “We see this as an experiment. It’s not so much about winning or losing as making a lasting contribution to the field.”

Mr Bull said his team chose a “very narrow” area of commercial law because almost all the lawyers signing up were from commercial firms and it had to be an area where non-specialists could acquire the knowledge they needed very quickly.

He said the challenge would last for a week, beginning on 20 October, and lawyers could make as many predictions as they had time for. He estimated that lawyers might take around two hours, making 10 predictions.

Mr Bull said there was no limit on the number of lawyers who could sign up for the challenge, although the minimum of around 40 had now been passed, or on the number of outcomes they could predict.

Mr Bull said he was “so confident” in CaseCrunch’s technology that he was not concerned by lawyers using their own technology, taking a lot of time on their predictions or even collaborating. He said one City law firm had asked to enter a team for the event.

“We did consider doing this in a closed environment, but in the real world we’re up against lawyers with all their capabilities.

“There is no other technology like ours in the world at the moment. None of it can solve problems the way we can.”

Mr Bull said predictive analytics pioneers Premonition would act as technology judge for the competition, examining the code CaseCrunch was using and the predictions by lawyers.

Just like the machine, the lawyers will work on randomised complaints – the main difference being that the machine can make thousands of predictions in a minute.

A legal judge will also be appointed to ensure that the task is one that could be tackled by lawyers and that the machine does not have an unfair advantage.

Mr Bull said: “We’re doing it to win, but what we care most about is making good progress on legal AI. It’s an area that has been so neglected and there has been so little fundamental progress beyond the hype.

“In legal AI, for some reason, the benchmarks you see elsewhere don’t exist. We want to get the ball rolling and, if we lose, at least we know where the benchmark is and we can improve.”

To sign up to the challenge, click here.




Leave a Comment

By clicking Submit you consent to Legal Futures storing your personal data and confirm you have read our Privacy Policy and section 5 of our Terms & Conditions which deals with user-generated content. All comments will be moderated before posting.

Required fields are marked *
Email address will not be published.

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Blog


Use the tools available to stop doing the work you shouldn’t be doing anyway

We are increasingly taken for granted in the world of Do It Yourself, in which we’re required to do some of the work we have ostensibly paid for, such as in banking, travel and technology


Quality indicators – peer recommendations over review websites

I often feel that I am banging the SRA’s drum for them when it comes to transparency but it’s because I genuinely believe in clarity when it comes to promoting quality professional services.


Embracing the future: Navigating AI in litigation

Whilst the UK courts have shown resistance to change over time, in the past decade they have embraced the use of some technologies that naturally improve efficiency. Now we’re in the age of AI.


Loading animation