Misleading ratings on CQC site
During this transition to the new Single Assessment Framework (SAF), the public facing web site will show a range of “hybrid inspections” ranging from an old KLOE based inspections to partial application of the SAF to a full SAF based inspection. For the data to be meaningful and transparent, it is important that the Public have a clear and easily digestible picture of the level of checks and the exact dates these were carried out.
EXAMPLE TO ILLUSTRATE THE ISSUE:
In total, the SAF has 34 Quality Statements with 6 Evidence Categories each, giving a grand total of 204 potential measuring points for a full assessment or inspection.
From a recent live example on the CQC web site:
When a single Key Question “equity of access” is reviewed via a telephone interview, the remaining 203 evidence category are scored and updated to the latest SAF formulas based purely on the previous rating.
The date of the latest assessment is displayed at the top on the main page and on each Domain page to inform the Public about the age and reliability of this report and assessment.
THE ISSUE
The information displayed omits the critical facts that:-
1. only ONE Evidence Category out of 204 was checked
2. that the latest assessment represents 0.5% of the potential items that could be checked
3. that 99.5% of the updated items are from a real site-inspection
4. that the evidence for the 99.5% updated items is in actuality 5 years out of date.
FREEDOM OF INFORMATION REQUEST
Please provide details of what steps the CQC has taken to address this anomaly so that the public is assured of transparent and easily understood information regarding:-
1. the number of Evidence Categories that were reviewed
2. the date/age of each review
3. differentiating evidence obtained at actual site-inspections
CQC Response
In accordance with section 1(1) of FOIA we are able to confirm that CQC does hold recorded information in relation to this matter.
CQC does not display scoring information down to the evidence category level on our website.
We are currently working on finalising the automation of our publication and will then be delivering design improvements to our reports on the website. This improvement work is currently scheduled to start at the end of October.
Editor's comments
CQC did not address the issue and did not suply the information awaiting improvements in October 2024
Following this request, the CQC scrapped the Evidence Ratings altogether
Link: https://www.whatdotheyknow.com/request/single_assessment_framework_prov#outgoing-1734540
CQC
