Skip to main content
QMSQMS
QMS
  • Welcome to your QMS
  • Quality Manual
  • Procedures
  • Records
  • Legit.Health Plus Version 1.1.0.0
  • Legit.Health Plus Version 1.1.0.1
  • Legit.Health Utilities
  • Licenses and accreditations
  • Applicable Standards and Regulations
  • BSI Non-Conformities
    • Technical Review
    • Clinical Review
      • Round 1
        • Item 1: CER Update Frequency
        • Item 2: Device Description & Claims
        • Item 3: Clinical Data
        • Item 4: Usability
        • Item 5: PMS Plan
          • Question
          • Research and planning
          • Response
        • Item 6: PMCF Plan
        • Item 7: Risk
    • BSI Non-Conformities
  • Pricing
  • Public tenders
  • BSI Non-Conformities
  • Clinical Review
  • Round 1
  • Item 5: PMS Plan
  • Research and planning

Research and planning

Internal working document

This document is for internal use only. It contains analysis, gap identification, and response strategy for Item 5 of the BSI Clinical Review Round 1. It will not be included in the final response to BSI.

1. What BSI is asking​

BSI says the PMS Plan does not clearly demonstrate how the requirements of MDR Chapter VII (Articles 83–89) and Annex III 1(a) and (b) are met. They list 7 examples of gaps:

  1. SOPs with sufficient detail to assess collected data — not found
  2. Specific indicators and threshold values for B/R reassessment — not found
  3. Methods/tools to investigate complaints per Article 87 — not found
  4. Methods for trend reporting per Article 88 — not found
  5. Methods to communicate with relevant bodies — not found
  6. Procedures for Articles 83 and 86 — not found
  7. Systematic procedures to identify/initiate corrective actions and trace devices — not found

BSI requests traceability: map Annex III 1(b) requirements → SOPs/WIs → specific sections.

This is an observation/request, not a deficiency finding.

2. Root cause: traceability, not substance​

All 7 items BSI lists are covered by existing procedures. The problem is that BSI could not find them because:

  1. The PMS Plan's traceability table (R-TF-007-001, lines 40–52) maps Annex III 1(b) requirements to procedure codes (e.g., "GP-007", "GP-004") but does not cite specific sections or pages within those procedures.
  2. BSI reviewed PDF exports — internal links between documents were non-functional.
  3. The SOPs are spread across multiple procedures (GP-004, GP-006, GP-007, GP-014, GP-016, GP-020, SP-004-001) and their relationship to the PMS Plan is not explicitly described in a single place.

The substance is there. The traceability is not.

3. Mapping BSI's 7 concerns to existing documentation​

#BSI concernExisting SOPSpecific section/content
1SOPs to assess collected dataGP-020 Data analysisSystematic compilation from 7 data sources; statistical and comparison techniques; 25% threshold for trend detection; integration with risk management; documented in T-020-001 Trend report
2Indicators and threshold values for B/R reassessmentR-TF-007-001 PMS Plan, "Trend analysis" section (line 109); GP-020 threshold (25% change); R-TF-007-002 PMCF Plan primary endpoints (AUC >0.8, Top-5 accuracy >70%, etc.)Trend analysis triggers CAPA when statistically significant increases detected; PMCF has specific clinical performance thresholds
3Methods to investigate complaints per Art. 87GP-014 Feedback and complaintsHubSpot CRM for centralised management; criticality assessment (High/Medium/Low); classification as incident per Art. 87 definition; escalation to GP-004 for serious incidents; 3-week maximum response time
4Methods for trend reporting per Art. 88GP-004 Vigilance systemExplicitly addresses Art. 88 in scope; trend reporting using MEDDEV 2.12-1 rev.8 Annex VII form; GP-020 trend analysis with statistical thresholds
5Methods to communicate with relevant bodiesGP-004 Vigilance systemDetailed protocols: NCA notification within 15 days (serious incident), 10 days (death/serious deterioration), 2 days (public health threat); AEMPS electronic portal with specific contact details; Field Safety Notice procedures; notified body notification
6Procedures for Art. 83 and 86GP-007 Post-market surveillance (Art. 83, 84); GP-007 PSUR section (Art. 86)GP-007 scope explicitly states coverage of Art. 83, 84, 86; PSUR prepared annually per Art. 86; structure follows MDCG 2022-21
7Procedures for corrective actions and device tracingGP-006 CAPA: root cause analysis (5 Whys), criticality classification, Jira workflow; GP-016 Traceability: UDI system, software version tracking; SP-004-001 Product withdrawal: step-by-step withdrawal process for API productGP-006 has systematic NC detection → RCA → CAPA workflow; GP-016 uses UDI-DI/UDI-PI and version tracking; SP-004-001 annual simulation verified

4. Gap analysis​

#AspectStatusGapPriority
1SOPs exist with sufficient detailAll exist — GP-004, GP-006, GP-007, GP-014, GP-016, GP-020, SP-004-001None — substance is present—
2PMS Plan traceability tableIncomplete — maps to procedure codes only, no section referencesNeeds specific section/page references for each Annex III 1(b) requirementHigh
3Indicators and thresholds documentedPartially — GP-020 has 25% threshold; PMCF has clinical thresholdsPMS Plan should consolidate all indicators/thresholds in one place rather than scattering across documentsMedium
4Art. 87 sub-clauses traceabilityExists in GP-004 but PMS Plan doesn't reference specific sub-clausesPMS Plan should explicitly map Art. 87 sub-clauses 1, 2, 7, 8, 9, 11 to the relevant SOP sectionsHigh
5Art. 88 trending methodologyExists in GP-020 and GP-004PMS Plan's "Trend analysis" section (line 109) describes annual analysis but could be more specific about statistical methodsMedium

Assessment: This is a documentation traceability issue, not a substantive compliance gap. The fix is to enhance the PMS Plan's Annex III 1(b) traceability table with specific cross-references rather than creating new procedures.

5. Cross-NC connections​

Clinical Review Item 3a — PMS data gap​

Item 3a research identified that the CER does not integrate legacy PMS data despite 4+ years of market experience. Item 5's PMS plan improvements should include explicit reference to how legacy data feeds into the ongoing PMS system, reinforcing the CER fix.

Clinical Review Item 6 — PMCF Plan​

Items 6a and 6b address the PMCF Plan specifically, which is a sub-component of the PMS system. The PMCF Plan's indicators and thresholds (R-TF-007-002, line 163) are part of the same B/R reassessment framework BSI asks about here.

6. Response strategy​

The response should:

  1. Acknowledge that the PMS Plan's traceability table lacked sufficient detail to allow the reviewer to navigate to the relevant SOPs
  2. Provide the complete traceability mapping — for each Annex III 1(b) requirement, cite the specific procedure AND section where it is addressed
  3. Confirm that the PMS Plan has been updated with an enhanced traceability table containing section-level cross-references
  4. Explicitly map Art. 87 sub-clauses 1, 2, 7, 8, 9, and 11 to GP-004 and GP-014 sections
  5. Not create new SOPs — the existing procedures are adequate; the gap is traceability, not substance

Fixes required (all in R-TF-007-001)​

Fix 1: Enhance the Annex III 1(b) traceability table with heading-level references​

Replace the current table (lines 40–52) which just lists procedure codes (e.g., "GP-007 Post-market surveillance") with references to the actual section heading titles within those procedures where the information lives. BSI needs to be able to open the procedure and navigate to the right heading.

Target mapping:

Annex III 1(b) requirementCurrent referenceShould reference
Proactive/systematic data collectionGP-007 Post-market surveillanceGP-007, § Post-market surveillance system; § Active monitoring of the information received
Methods to assess collected dataGP-007 Post-market surveillanceGP-020 Data analysis, § Development (statistical and comparison techniques, 25% trend threshold)
Indicators and threshold valuesPMS Plan, section Trend analysisR-TF-007-001, § Trend analysis; R-TF-007-002 PMCF Plan, § Primary endpoints (AUC, accuracy thresholds)
Methods to investigate complaints (Art. 87)GP-014 Feedback and complaintsGP-014, § Complaint investigation and classification; § Incident evaluation per Article 87
Trend report methods (Art. 88)PMS Plan, section Trend analysisGP-004, § Trend reports (Art. 88); GP-020, § Trend analysis methodology
Communication with authoritiesGP-004 Vigilance systemGP-004, § Notification to National Competent Authority; § Field Safety Notice; § Notified body notification
Art. 83, 84, 86 proceduresGP-007 Post-market surveillanceGP-007, § Post-market surveillance (PMS) plan (Art. 83, 84); § Planned PSUR section (Art. 86)
Corrective actionsGP-006 CAPAGP-006, § Root cause analysis (5 Whys); § Corrective action implementation; § CAPA effectiveness verification
Device tracingGP-006; SP-004-001; GP-016GP-016, § UDI system and software version tracking; SP-004-001, § Product withdrawal process

Fix 2: Remove backtick/link formatting throughout R-TF-007-001​

All references to other documents currently use backtick code formatting (e.g., `GP-004 Vigilance system`). Since BSI reviews PDF exports, these render as monospace code text with no navigation value. Replace with plain text references throughout the document.

Fix 3: Add a dedicated "Indicators and threshold values" section​

Currently, the indicators and thresholds are scattered. Add a dedicated section to R-TF-007-001 consolidating:

  • GP-020's 25% change threshold for trend detection
  • PMCF clinical performance thresholds (AUC >0.8, Top-5 accuracy >70%, Top-3 accuracy >55%, Top-1 accuracy >40%)
  • Incident rate monitoring criteria
  • B/R reassessment trigger criteria

Fix 4: Add a dedicated "Trend analysis" heading​

Line 109 describes trend analysis methodology but it's nested under the generic "Analyse trends..." heading. BSI's traceability table references "section Trend analysis" — ensure this exists as a clearly labelled top-level section.

7. Risk assessment​

RiskImpactMitigation
BSI may ask for more SOP detail beyond what existsLow — the procedures are comprehensive when read in fullProvide section-level references so BSI can verify
BSI may view the existing trend analysis methodology as insufficiently statisticalMedium — GP-020's "25% threshold" is simpleArgue proportionality: device has low incident volume; more complex statistical methods are planned for PMCF phase
BSI may note that the PMS Plan references "Trend analysis section" which doesn't exist as a separate headingLow — trend analysis is described in line 109Update the PMS Plan to add a clearly labelled "Trend analysis" heading

8. Open items​

None — all information needed to respond to Item 5 is available in existing QMS procedures. The fix is straightforward: enhance the traceability table in the PMS Plan and provide the mapping in the response.

Previous
Question
Next
Response
  • 1. What BSI is asking
  • 2. Root cause: traceability, not substance
  • 3. Mapping BSI's 7 concerns to existing documentation
  • 4. Gap analysis
  • 5. Cross-NC connections
    • Clinical Review Item 3a — PMS data gap
    • Clinical Review Item 6 — PMCF Plan
  • 6. Response strategy
    • Fixes required (all in R-TF-007-001)
      • Fix 1: Enhance the Annex III 1(b) traceability table with heading-level references
      • Fix 2: Remove backtick/link formatting throughout R-TF-007-001
      • Fix 3: Add a dedicated "Indicators and threshold values" section
      • Fix 4: Add a dedicated "Trend analysis" heading
  • 7. Risk assessment
  • 8. Open items
All the information contained in this QMS is confidential. The recipient agrees not to transmit or reproduce the information, neither by himself nor by third parties, through whichever means, without obtaining the prior written permission of Legit.Health (AI Labs Group S.L.)