Scoring the Clinical Assessment of Skills and Competencies (CASC)
Scoring the MRCPsych CASC
The approach now used in the CASC exam uses a global A (clear pass) to D (clear fail) rating to determine the overall standard for the station. Examiners are asked to grade the candidate from the following scores :
A: Clear Pass
B: Borderline Pass
C: Borderline Fail
D: Clear Fail
Example marking sheets are available for download as PDF documents below:
In addition, the examiners are able to highlight "areas of concern" which do not appear to govern the overall pass/ fail decision, but may be helpful for feedback to unsuccessful candidates. The areas of concern in the Autumn 2008 CASC include:
- Questioning style, e.g. use of appropriate mix of open & closed questions
- Listening and responding appropriately to interviewee/ discussant
- Management of interview/ examination including empathic responses
- Lack of appropriate focus on the required task
- Fluency of interview/ examination/ discussion
- Professionalism including, but not limited to, harmful interaction; failure to respect individual's rights; ethical behaviour, etc.
- Appropriate choice of avenues of enquiry, tests or examination including significant omissions
- Range and/ or depth of history explored Range and/ or depth of psychopathology explored (signs elicited at examination)
- Range and/ or depth of risk explored
- Analysis of problems & synthesis of opinion
- Prioritisation, recognition of importance and appropriateness of information delivered and/ or management
- Depth of enquiry into symptoms Range of cognition tested and appropriate application of cognitive testing
It would not appear that such 'areas of concern' are involved in determining the grade for the station, and it doesn't seem as though any weighting is applied. For example, it is possible to have 2-3 areas of concern ticked but still pass the station, and one may potentially fail a station without having areas of concern highlighted.
In this sense, the CASC is no longer 'objective' - not that it ever was. You appear to be judged on overall performance in the station. However, and this is unclear, examiners may be directed to consider the areas of concern when deciding on the grading for the station.
It is not entirely clear how the overall pass mark for the exam is being determined. However, a simple 'Clear Fail' on a station is probably being used on an individual basis. Compared to more balanced ways of scoring OSCE exams (see below), the likelihood of a pass on a station is not governed by performance of the entire group.
The expected standard for the CASC
Since candidates will be taking the CASC after 30-48 months of training, the standard is that expected of an ST2-3. In this sense, the 'age' of the candidate is one to two years later than the current Part I OSCE exam and higher standards will be expected. The constructs of each OSCE are likely to test more complex reasoning and management skills and may combine a variety of skills in a single OSCE.
For more information on how OSCE exams are traditionally score (but not the CASC), please see the trickcyclists OSCE format information.
Last Updated on Tuesday, 02 July 2013 11:38