Digwyddiadau Sicrhau Ansawdd Ailddilysu
Bob blwyddyn, bydd yr Uned Cymorth Ailddilysu yn hwyluso dau ddigwyddiad Sicrhau Ansawdd Rhanbarthol ledled Cymru. Y nod cyffredinol yw adolygu allbynnau arfarniadau drwy asesu crynodebau arfarnu o ofal Sylfaenol ac Eilaidd yn erbyn set o feini prawf ansawdd er mwyn nodi themâu Cymru gyfan.
Eleni cynhaliwyd y ddau ddigwyddiad hanner diwrnod yn Llanelwy (Canolfan OpTIC) ar 3 Hydref ac yn Abertawe (Gwesty’r Village) ar 8 Tachwedd.
Roedd 147 o gynadleddwyr wedi dod i’r digwyddiad, roedd 68 o'r rheini a oedd yn bresennol wedi llenwi’r arolwg adborth ac o’r rheini dywedodd 100% fod asesu crynodebau Arfarnwyr eraill wedi bod o fudd i’w rôl.
Nod y digwyddiadau sicrhau ansawdd oedd cyflawni’r canlynol;
- Sicrhau ansawdd tua 4% o grynodebau arfarnu a oedd wedi cael eu dewis ar hap mewn lleoliadau gofal Sylfaenol ac Eilaidd.
- Cynhyrchu dadansoddiad defnyddiol i hyrwyddo cynllunio gweithredu yn y dyfodol.
- Hyrwyddo’r arfer gorau i’r holl gynadleddwyr, gan ddatblygu eu dealltwriaeth o ansawdd arfarnu.
- Nodi meysydd ar gyfer hyfforddiant pellach.
- Rhannu’r arferion gorau rhwng Arfarnwyr Gofal Sylfaenol ac Eilaidd.
- Arfogi’r Arfarnwyr â'r offer a’r wybodaeth i ddylanwadu ar y ffordd byddant yn cynnal arfarniadau yn y dyfodol.
Eleni roedd sgôr ansawdd cyfun Gofal Sylfaenol ac Eilaidd yng Nghymru yn 70% sy’n gynnydd o 5% ers y flwyddyn flaenorol.
Mewn Gofal Sylfaenol mae'r 17 maen prawf i gyd wedi dangos cynnydd amrywiol mewn sgoriau ac mewn Gofal Eilaidd mae 10 o’r 17 maen prawf (59%) hefyd wedi cael sgoriau uwch. Mae’r canlyniadau hyn yn dystiolaeth o’r duedd sy’n parhau bod ansawdd allbynnau arfarniadau’n gwella.
Mae hefyd yn awgrymu bod y gweithgareddau a gyflawnir gan Arfarnwyr, yr Uned Cymorth Ailddilysu, y Byrddau Iechyd, Arweinwyr a Chydlynwyr Arfarnu i ganolbwyntio ar wella ansawdd arfarniadau yn cael effaith gadarnhaol. Mae’r digwyddiadau Sicrhau Ansawdd Ailddilysu, yr adroddiad Sicrhau Ansawdd Ailddilysu a’i argymhellion a digwyddiadau hyfforddiant RAC wedi cyfrannu at wella'r sgoriau ansawdd ar gyfer un o’r meini prawf Gofal Eilaidd a oedd yn cael y sgôr isaf; Cyd-destun Proffesiynol. Mae Ffigur 3 yn dangos y cynnydd mewn sgoriau ansawdd ar gyfer y maen prawf hwn ers 2018 a’r gwaith sicrhau ansawdd a wnaed i gefnogi datblygiad y Cyd-destun Proffesiynol mewn crynodebau arfarnu.
Mae argymhellion wedi cael eu nodi ar ôl dadansoddi’r data sicrhau ansawdd gan gynnwys cynllunio ar gyfer y dyfodol mewn meysydd megis digwyddiadau Sicrhau Ansawdd Ailddilysu, hyfforddiant i Arfarnwyr Gofal Eilaidd, a MARS. Bydd yr Uned Cymorth Ailddilysu hefyd yn parhau i weithio’n agos gyda Byrddau Iechyd, Cydlynwyr Arfarnu a'r rhwydwaith newydd o Arweinwyr Arfarnu Gofal Eilaidd er mwyn hwyluso rhagor o welliant.
Revalidation Quality Assurance Events (RQA)
Each year the Revalidation Support Unit (RSU) facilitates two Regional Quality Assurance (RQA) events across Wales. The overall aim is to review the outputs of appraisal by assessing appraisal summaries from both Primary and Secondary care against a set of quality criteria to identify all Wales themes.
This year the two half day events took place in St Asaph (OpTIC Centre) on the 3rd October and Swansea (The Village Hotel) on the 8th November.
147 delegates attended the events, 68% of attendees completed the feedback survey and of those 100% advised that they found assessing other Appraisers summaries beneficial to their role.
The aim of the quality assurance events was to achieve the following;
- To undertake quality assurance of approximately 4% randomly selected appraisal summaries in both Primary and Secondary care settings.
- To generate useful analysis to promote future action planning.
- To promote best practice to all delegates, thus developing their understanding of the quality of appraisal.
- Identify areas for further training.
- To share best practice between Primary and Secondary care Appraisers.
- To provide Appraisers with the tools and knowledge to influence the way in which they conduct appraisals in the future.
This year the combined Primary and Secondary Care All Wales quality score was 70% which is an increase of 5% on the previous year.
In Primary Care all 17 criteria have shown a varying increase in scores and in Secondary Care, 10 out of the 17 criteria (59%) have also shown an improved score. These results are evidence of the continuing upward trend in the quality of appraisal outputs.
It also suggests that the activities undertaken by Appraisers, the RSU, the Health Boards (HBs), Appraisal Leads and Co-ordinators (ACs) to focus on improving the quality of appraisal are having a positive impact. The RQA events, RQA report with recommendations and RAC training events have contributed to an increase in the quality scores for one of the lowest scoring Secondary Care criterion; Professional Context. Figure 3 demonstrates the progress in quality scores for this criterion since 2018 and the quality assurance activity undertaken to support the development of Professional Context within appraisal summaries.
Recommendations have been identified following analysis of the quality assurance data including future planning around areas such as the RQA events, Secondary Care Appraiser training, and MARS. The RSU will also continue to work closely with HBs, ACs and the new network of Secondary Care Appraisal Leads (ALs) to facilitate further improvement.
2018 Regional Quality Assurance Event Highlights
During 2018 the RSU provided two RQA events; St Asaph (OpTIC Centre) 18th October 2018 and Cardiff (All Nations Centre) 8th November. The aim of these events were to identify all Wales themes for improving and maintaining the outputs of appraisal. Appraisers in both primary and secondary care attended the events to review appraisal summaries against a new developed quality criteria .
In total a random sample of 148 summaries were marked for both primary and secondary care across all health boards exceeding the 4% minimum requirement. For the larger health boards summaries were pulled from a six month period compared to an eight month period for those with a lower proportion of completed summaries.
Using a new scoring criteria which was one of the 2016-17 RQA recommendations, the results of these events were not compared to those of previous years. Instead it was agreed these results would become the benchmarks for future quality assurance events.
The creation of a new Primary and Secondary care pre-event online calibration exercise was introduced in line with last year's recommendations . This calibration exercise was designed to assist appraisers in understanding and navigating the new criteria. 74% of this year's delegates rated the calibration video as good or excellent.
It was also agreed scores would not be compared against each other in Primary and Secondary care settings, instead the improvements for both Primary and Secondary care would be analysed on an individual basis.
Combined All Wales Score
Overall quality score of 65%
Overall quality score of 85%
Overall quality score of 55%
The main recommendations to be taken forward in the All Wales Programme included:
Click HERE for a full copy of the 2017-18 All Wales Regional Quality Assurance Report and the key aims for 2019.
2018 Regional Appraiser Conference
28.06.2018 & 06.07.2018
Cardiff City & Stadium Ramada Plaza Wrexham
The events were held in Cardiff and Wrexham for secondary care appraisers to attend, providing a mixture of presentations and workshops pertinent to their role.
The programme included an update from the RSU and the GMC, followed by workshops focussing on difficult scenarios. Numbers included; 74 for the South and 32 for the North.
A post event feedback form was circulated electronically to all attendees asking them to rate the presentations, workshops, venue and preparations etc.
The two presentations at the event “Patient Feedback Discussion “provided by the General Medical Council (GMC) provoked engaging discussions from both events, which is being fed into the GMC’s review of Patient Feedback. The “Revalidation Update” provided by the Revalidation Support Unit (RSU) was well received.
There were various workshops at the events including “Reflective Practise”, Whole Practice Appraisal (WPA)” and “Difficult Scenarios”. The workshops were rated very well and received positive comments including; “Positive reinforcement I am broadly doing the right thing”. “This was the best session with an engaging speaker, some very difficult topics” and “Highlighted some issues that have already arisen in some of the appraisals I've done”.
When asked what attendees most enjoyed about the conference the highlights were the inclusion and content of the workshops and the ability for appraisers to network, share opinions and share experience with their peers regarding their roles. Feedback included:
“The most I enjoyed about the conference was the 2 workshops on reflective practice & whole appraisal. It was a real eye opener on various complex issues impacting the whole appraisal process. A very lively discussion took place about ways & means to address such situations”
“Very good interaction among different group of professional. There was an open and transparent discussion about important issues faced by all doctors and more particularly appraisers.
“Friendly atmosphere conducive to learning. Much more informal than those I attended before. The layout was excellent & in my opinion, better than the Optic Centre possibly because there were less people there. Easier to get to than South Wales.”
“Positive atmosphere and hearing others experiences/questions”
The attendees were also asked to provide comments on how future events could be improved. Feedback included possibly finding a venue location nearer mid-west Wales for next year’s event (This is the plan for RAC 2019) and a possible discussion or workshop around the usage of the various domains on MARS and the PDP.