Just how good are legal directories?

Print This Post

15 March 2016


Posted by Ian Dodd, UK director of Legal Futures Associate Premonition

Dodd: artificial exercise

Dodd: artificial exercise

Below you’ll find an abstract from an academic article by Dr Chris Hanretty, reader in politics at the University of East Anglia. The full article, which I have read, will soon be published in the International Journal of the Legal Profession. I’m reproducing the abstract with his kind permission:

Lawyer rankings either do not matter for litigation outcomes or are redundant

I investigate the success of litigants in tax cases in England and Wales between 1996 and 2010. I explore the effect upon success of having better-ranked legal representation, according to rankings of barristers published by chambers. I find that, for a variety of model specifications, there is no significant positive effect of having better-ranked legal representation.

After conducting a sensitivity analysis, I conclude that better-ranked legal representation might have a positive effect on litigation outcomes, but only if better-ranked lawyers receive cases that are substantially more difficult to win. However, if better-ranked lawyers receive substantially more difficult cases, this suggests consumers of legal representation are sophisticated enough to dispense with legal rankings.

The views that follow are mine and mine alone and not, as far as I know, Dr Hanretty’s.

I’ve long wondered what use the rankings of lawyers, particularly barristers, are in the legal directories.

Essentially, you get some of your mates to say nice things about you (you’re not going to do otherwise, now, are you?). Then you pay (how much depends on how much of it you want to be in print) the directories to reproduce these nice things and come up with some artificial rankings in a host of different categories.

They’re artificial because they’re based on qualitative and subjective comments the sources of which are not treated to any moderation or levelling to ensure each comment is weighted to equivalence.

You pay to adjust your website to accommodate all these nice things in the biographies of the fortunate and glowing barristers and sit back and wait for new work to flood in because of it. And, I imagine, you keep waiting as I’ve never, so far, been able to find out if any work does result from the directory rankings.

Then, you are seduced to pay a large amount of money to go to an ‘awards evening’ (I’ve noticed that the number and categories of awards swells every year to assuage the expectant attendees; some to the point of nonsense) and, probably, to pay more to take a table to invite those people who said nice things about you in the first place.

Next, you squeeze yourself into an ill-fitting dinner jacket, eat too much almost inedible food, drink too much expensive but inferior wine (maybe I’ve been to the wrong awards ceremonies?), stuff your pockets with business cards of people who have no intention of doing business with you and who, through your blinding headache next day, you can’t remember anyway.

Finally, after paying all this money (which I’ve always held can be spent much more wisely in targeted marketing) you wait for all the new work to come in.

I really would be interested to know who runs a cost/benefit exercise on these things or is it all done for self-aggrandisement?

I’d recommend you to keep your eye on the International Journal of the Legal Profession. If the article abstract (never mind about what I say) doesn’t alter your thinking on legal directories, it might.



11 Responses to “Just how good are legal directories?”

  1. Utter garbage.

    Before you write such drivel at least get your facts straight as to how the legal directories operate and are remunerated.

  2. Graham Laing on March 15th, 2016 at 10:53 am
  3. Great article, Ian.
    It’s long past time for facts to reign in legal selection.

  4. Toby Unwin on March 16th, 2016 at 6:17 pm
  5. I know nothing about how directories are remunerated but I agree entirely with the broad thrust of the article. The ‘researchers’ are generally recent graduates who have no knowledge of the legal market. Laziness or incompetence means they usually go to the usual firms and chambers and lo and behold the same people appear year after year. They have they no ability to detect changes in the legal market. They are disinterested in chambers who do not already have numerous people in the directories. There are many examples of people taking silk who have never been in the directories. There are examples of people in the directories who have retired, changed practice areas or taken appointments. There is no scientific basis for the assertions in the directories or the rankings. I write this has someone is them.

  6. Anon barrister on March 16th, 2016 at 8:38 pm
  7. Spot on. Not only do these directories have no real worth for the reasons set out in this article, the very fact that they exist suggest that the profession in general, and more particularly, the Bar is crippled by self-doubt and insecurity to such an extent that fragile egos need propping up with entires in what are, in effect, pure vanity publications. I suspect that very few (if any) of the researchers has any experience of actually instructing any of the lawyers included in the list and so are in no place to judge a particular lawyer’s experience and skill. It is a great pity that individual lawyers spend so much time and money on these useless entries rather than devote effort to protecting what really matters – access to justice and the almost constant assault on the profession by the political class. In short these directories are a symptom of a deeper malaise within the profession. Mind you, with the advent of online review sites (and we all know how those can be manipulated) it is possible that these directories are living on borrowed time.

  8. Martin Edwards on March 17th, 2016 at 9:55 am
  9. If the writer believes that the legal market directories are driven by ‘getting your mates to say good things about you’ then he not only has a poor understanding of the directories but also generally about the way UK mid market and blue chip companies purchase legal services.

    I can just imagine now – Head GC of a large global standing in front of Director of Procurement saying:

    ‘Yeah Im just getting my mate in to handle our 2016 legal spend!’.

    Dear oh dear.

    The directories have always been about anecdotal client driven market commentary. All firms are subject to the exact same yardstick.

    The directories don’t profess to offer insight into measured performance. I’d question the attempt of measuring technical performance. Its an apple and pear comparative exercise.

    Legal 500 or Chambers don’t do awards evenings and secondly firms can see through Google Analytics exactly how much traffic is driven and leads generated via its links with both of the aforementioned directories.

    From a search engine optimisation perspective – there aint that many relevant legal backlinks better than those two.

    So lots of value.

    A crap article, trying to add credibility by clinging desperately onto the work of some poor old none-the-wiser academic with a shockingly poor understanding of legal and the directories.

    Cheerio.

  10. Graham Laing on March 22nd, 2016 at 4:57 pm
  11. This is the second response Graham Laing has posted and the only one here (or on the original LinkedIn piece) to disagree with what I’ve written. Nothing of what he has written contains any factual or quantitative evidence to support his opinions; and that’s all they are. Unlike the work done by Dr Hanretty. Having spent time with many GCs and having discussed how they choose lawyers what I’ve written isn’t far from reality. If Graham would like to debate this further he canget me at id@premonition.ai.

  12. Ian Dodd on March 24th, 2016 at 10:53 am
  13. It’s a blog post Ian, not a great one either – but subject to fellow industry commentators like myself to express views.

    The other people who commented are either anonymous or your boss.

    However, It’s a fact that both Legal 500 & Chambers directories operate on client driven anecdotes.

    It’s a fact that Legal 500 & Chambers don’t do awards evening.

    It’s a fact that you can trace online referrals from Google Analytics.

    It’s a fact that the legal directory websites are highly relevant & authoritative websites to obtain links from.

    I’ve been in law long enough to know that the best barristers have a skilled propensity to keep matters ‘out of court’ to the satisfaction of opposing parties.

    How’s does your system measure those instances?

  14. Graham Laing on March 25th, 2016 at 5:16 pm
  15. Hi Graham

    Hopefully you are having a good day. Its just that in your rather authoritative blog you make statements of fact like “it’s a fact that Legal 500 & Chambers don’t do awards evening” Other than the grammatical errors and rather than go through each and every authoritative “it’s a fact” and give evidence that they are all wrong, I think this will suffice, taken from Chambers and Partners website today, under the tab Events.Upcoming Chambers Awards:
    Chambers Asia-Pacific Awards 2016

    Chambers Europe Awards 2016

    Chambers USA Awards 2016

    Chambers Latin America Awards 2016

    So, please if you are going to be authorative and make claim to fact’s, check that they are indeed factual, it would help keep your reputation as a gentleman.

  16. Guy Kurlandski on March 31st, 2016 at 10:26 pm
  17. Had to add this:
    CHAMBERS EUROPE AWARDS 2016

    This year, the Chambers Europe Awards Ceremony and dinner will be held at the Grosvenor House Hotel in London on Friday, April 22nd 2016.

    Perhaps you were simply not invited, better luck next year.

  18. Guy Kurlandski on March 31st, 2016 at 10:28 pm
  19. When someone comments on the grammatical errors contained in forum comments (often made in 30 seconds on a 5 inch screen!) – you know that they are usually using them to mask an argument already defeated. I think most readers see that. Besides – your post is full of grammatical errors too ;-P

    Just so we are clear – the ‘authoritative blog’ post that you refer to – thats not mine? – thats yours (ok – your UK representatives!). I make no reference to being a gentleman either. I care not for edwardian titles of old nor do I care for invites for conferences or events.

    But in light of your pedantries – Ill qualify my ‘fact’ statement in view of L500 and Chambers awards evenings. Most would have naturally inferred but Ill explain for you. What I was referring to was the inaccurate inference, association or connection (call it what you like) between ‘events evenings’ and ‘physical rankings’ in both directories that your UK representative was making.

    In relation to what position – for example, Eversheds is ranked for North West Family Law bears absolutely no relation to whether they have paid for a table of 12 in a London hotspot. In relation to all the ‘physical rankings’ contained right across the two major UK legal directories – there are ‘absolutely’, ‘fact’, no ‘awards evenings’ that could ever influence relative positions in each of the numerous and various service lines, locations, sectors etc etc. There would have to be hundreds of events evenings wouldn’t there?

    Ill explain my motivations – what I find completely tasteless and the core of my defence of the directories is that your organisation is seemingly trying to ‘market’ itself by making ridicule to two long established organisations – many of which would say the cornerstones of the legal sphere. I know – as a legal services marketer of 20 years that they are effective in the manner I have previously described here and on LinkedIn.

    What also galls is that you have failed to answer the real burning question that I have asked not only here but also on LinkedIn – is bearing in mind that its pretty much a tenet of the UK legal system to keep things out of court – how you can say that your system, at the expense of the directories, offers complete factual, statistical visibility and measured results on who the best lawyers are? Surely the best lawyers are those that settle matters without court attendance to the satisfaction of all parties?

    My view is that – your ‘big data’ system may well be great. Im sure it has some great features. But my suggestion, a point which you have failed to answer – is that similar to the legal directories your system is actually only painting a bit part of a larger picture.

    Don’t they all have some value working in connection with one another?

  20. Graham Laing on April 5th, 2016 at 11:49 am
  21. I think the guys from Premonition are being a wee bit defensive. To be fair they’ve had a battering from a number of sources including the Gazette and LegalCheek.

    I do agree with what Graham is saying. It’s poor form trying to get ahead by dissing the competition. Throwing stones and glass houses springs to mind.

    What puzzles me is that in legal any form of computer software now seems to come with the AI tag.

    Artificial intelligence has become the latest industry gimmick all of a sudden.

  22. Legal Observer on April 5th, 2016 at 8:26 pm

Leave a comment

* Denotes required field

All comments will be moderated before posting. Please see our Terms and Conditions

Legal Futures Blog

Neither in nor out but shaking it all about

Nigel Wallis lo res

We’ve started serving English Brexit tea in our office. Some say it leaves a slightly bitter aftertaste while others find it quite refreshing. The suppliers told us they weren’t sure how it would turn out when they were blending it but apparently they’ve thrown out all the old varieties now and so, for good or bad, we’re stuck with it. I feel like a mug right now, as it happens.

July 22nd, 2016