Oversight guidance

Why Protocol Questions fail: the evidence gap

Many unsatisfactory Protocol Questions are not caused by missing work but by evidence that cannot be produced, answers written at the wrong depth, or records that left with the people who kept them.

Under the ICAO Universal Safety Oversight Audit Programme Continuous Monitoring Approach (USOAP CMA), a State’s performance is assessed through Protocol Questions (PQs). Each PQ asks whether a specific element of an effective oversight system is in place — and each answer must be supported by evidence.

Work done is not the same as work shown

Authorities often do the work a PQ asks about. The question still fails when the work cannot be shown:

  • the procedure exists, but the record of applying it does not;
  • the answer describes the whole checklist in one paragraph instead of addressing each element;
  • the evidence sits in an inspector’s files, not in the Authority’s system;
  • the document was amended, but no one can show why or when.

Answer element by element

A PQ is rarely a single question. Its guidance on review of evidence usually points to several elements. Answering each element separately — and binding the evidence to the element it proves — turns a narrative into a position the Authority can defend.

Make readiness ordinary

When evidence is captured as the work is done, preparation for an audit or an ICAO Coordinated Validation Mission stops being a crisis. It becomes the normal condition of the file.

The aim is not to prepare for an audit. It is to be ready without preparing.

This article is general guidance. Always refer to the current ICAO publications and Protocol Questions applicable to your State.

← All insights

Every Authority starts from a different place.

Tell us where your oversight system stands today and where it needs to be. We will listen first.