BSB presses on with Bar student aptitude test after positive pilot results

Print This Post

By Legal Futures

18 November 2011

Aptitude test: pilot finds strong correlation with actual resultsAn aptitude test that indicates whether Bar students will pass their exams is “the best single predictor of course outcomes”, a pilot study has concluded.

The Bar Standards Board (BSB) heard yesterday that the positive results of the pilot means it can press ahead with plans to introduce the test formally in autumn 2012 for September 2013 starters.

They will need to pass the test to gain admission to the bar professional training course.

The pilot covered the 2010-11 cohort of students and found that both outcome grades on the course and the average final exam scores of students “showed strong relationships with test scores. The correlation between test scores and course examination results was very marked, which is highly statistically significant”, a report to the board said.

This strong relationship was also found when looking at course outcomes: 54% of those attaining an ‘outstanding’ grade were in the top fifth of test scores, whereas 44% of those who failed the course scored in the bottom fifth of the test.

The impact on subgroups of the students was examined closely and the report said that while there were “some significant differences” in how they performed, “there is no evidence that the [test] would show bias against any of the lower scoring groups”.

Where the pass or ‘cut’ mark was set was examined closely for its diversity impact. “No substantial adverse impact was found using a range of low to moderate cut scores for gender, primary language, age, disability or whether the first degree was from a Russell Group institution,” the report said.

“The largest impact was for ethnic groups, with students from minority groups being somewhat less successful than the white group overall. However, even these findings were within the generally accepted range for a cut score.”

Dr Valerie Shrimplin, the BSB’s head of education standards, said: “We are pleased that the pilots for the aptitude test has have now concluded, a culmination of a great deal of hard work and effort. Our aim has always been to ensure a fair and equitable system for those applying for the bar professional training course, a system that will recruit on merit, regardless of the background of the candidate.

“We look forward to providing detailed information in December and consulting on our proposals in early 2012.”

The Law Society has also investigated the desirability of introducing an aptitude test for legal practice course students and fed the results into the legal education and training review being conducted jointly by the BSB, Solicitors Regulation Authority and ILEX Professional Standards.

Tags: , , ,

One Response to “BSB presses on with Bar student aptitude test after positive pilot results”

  1. I’d have been gobsmacked if there had not been a correlation between aptitude and BPTC results. The issue is the strength of that correlation and the extra utility of an aptitude test over existing information (most notably degree results). We have no info here on the latter question but some info on the first one. It looks like more than half of those that would ‘fail’ the aptitude test (if being in the bottom 20% is the test, as is implied by this analysis) passed the BPTC and perhaps more than half that passed the aptitude test would fail the BPTC. I await sight of the actual report with interest, to check out my fag packet analysis.

  2. Richard Moorhead on November 18th, 2011 at 9:59 am

Legal Futures Blog

How to make a case to the unconverted

Jonathan Whittle

The prospect of change is a daunting one, whether you’re a global firm or a small one. You might think that your firm’s working practices are fine, or that there’s no value in altering the way you do things because of the disruption it would cause. You might even see the benefits of using a different methodology, but still refuse to put the effort in to implement it – and you wouldn’t be alone. From our research in the 2016 report, The Riddle of Perception, we know that 73% of lawyers believe that adapting to change is not where their strength lies. However, it’s no longer optional.

November 16th, 2017