Assessing and validating information
This section deals with a small but important part of the appraisal, examining the information presented with respect to the GMC’s requirements for revalidation. Most doctors engaged in the appraisal process will meet (and exceed) these requirements. The GMC guidance on supporting information for revalidation clearly lays out the supporting information required in a revalidation cycle. Much of the focus around this information has been regarding the quantity and time frames. Looking deeper into the GMC document there is guidance around the context of this information with respect to the individual and their workplace.
It is incumbent on the Appraiser to assess this information and, as appropriate, validate that it reaches the GMC requirements. This needs to be performed at every appraisal for certain items and at least once over the revalidation cycle for others.
The bulk of the appraisal discussion should be around the doctor’s achievements, aspirations and work-life issues as appropriate. In many cases it will be self-evident from the written material that the requirements have been met. Other doctors may not have represented the information well and the appraisal discussion may need to tease out the true developmental benefit of the information.
The supporting information the GMC require to be brought to appraisal lies under four broad categories
- General information - providing context about what you do in all aspects of your work
- Keeping up to date - maintaining and enhancing the quality of your professional work
- Review of your practice - evaluating the quality of your professional work
- Feedback on your practice - how others perceive the quality of your professional work
These categories underpin the more familiar six types of supporting information that need to be validated. The ethos of the GMC document is entirely developmental and places great emphasis on self-awareness and reflection. The GMC do not talk about volume of information, rather quality, relevance and outputs of the developmental activity. The Appraiser when assessing the adequacy of supporting information should therefore focus on these aspects rather than volume or numbers of certificates.
“A certificate only proves attendance, reflection proves attention, change demonstrates development and audit shows evaluation”
1.A doctor has a large number of CPD entries, these are represented in his appraisal folder by uploaded certificates and the titles of the meeting attended. Most comments are “good meeting”, “interesting update” and the like. At appraisal he states – “I don’t have a reflective bone in my body” How do you approach this?
In this scenario the Appraiser could postpone the appraisal before it takes place, the doctor could be asked to add more of the learning points and what it meant to them and their practice (yes not using the word reflection!). If as in this scenario the appraisal has gone ahead then the appraiser could attempt to elicit reflection at the meeting. Most ‘non-reflective’ doctors actually do reflect – but cannot write it down. Questions should introduce an element of challenge “why?” “So what?” “What changed?” or “are you now?”. If this does demonstrate outcomes from learning, then this can be recorded in the appraisal summary.
The doctor could be asked (possibly through the PDP) to produce 3 or 4 reflective entries in next year’s appraisal. This is most easily achieved by answering the questions posed in the MARS CPD entry template which asks:-
- Title
- Activity
- What did I do?
- When did I do it?
- Reason
- Why did I do it?
- Reflection
- What did I learn?
- Outcome
- What changes have I made?
- What will I do differently?
The engagement at appraisal may guide you, if there is no engagement then it would be difficult to validate the information. If there was minimal engagement, then the PDP could be used for the following year as suggested above.
2. A doctor presents a clinical audit about a narrow section of her work. The first cycle is complete and there are plans to perform a second cycle. She asks you to validate it, you feel that it would meet GMC requirements once the second cycle is complete. She disagrees… What happens next?
The process of validating information must involve mutual agreement. In this scenario, if agreement cannot be reached, the audit should be taken outside of appraisal and advice sought from your appraisal lead. This should not get in the way of the rest of the appraisal discussion.
3.A doctor declares that they have had a complaint. It involves another team member also. The doctor states “I am not getting involved in this, it mostly wasn’t my fault.” At appraisal the doctor is letting his colleague handle the complaint. What do you need to know?
You will need to find out the extent of the doctor’s engagement in the process. It could be quite legitimate for the doctor to have given a statement at the start and then let the colleague deal with the rest. On the other hand, the doctor may be refusing to co-operate with the complaints process.
If the doctor is refusing to engage the appraisal summary should not be completed until advice is taken from the appraisal lead. Each case would need to be examined on its merits.
4. A doctor has used the GMC questionnaires for her patient feedback – there are 40 participants. What do you need to know?
You need to know the method of distribution and collection. These need to be totally independent of the doctor. The method by which they were aggregated, again must be independent of the doctor. How they were interpreted (e.g. have the results been compared to a bench mark?). The reflections of the doctor on the results and any changes made.
If the above conditions are met, then it is perfectly reasonable to validate this information.
Orbit360 is now the recommended Patient & Colleague feedback tool in Wales.