This is a sample report. Start your own assessment below. Start Your Assessment →
← All use cases
Public sector & municipalities

Fees, opening hours and forms, answered from the municipality official documents.

What the audit checks

Clerks answer the same questions all day. The audit checks whether your documents are current enough to answer from, how to stop the bot inventing things, and which cases must always end up with a person.

Self-Audit Assessment Report

Chatbot for citizen enquiries

01 Jan 2026

01/Recommendation
Recommended path

AI Agent + human review

A retrieval-grounded AI chatbot with mandatory human escalation gates is the right fit for this high-volume, compliance-bound citizen enquiry process.

The process handles 11,000 enquiries a year, each taking six minutes of officer time, and the content is well-defined: fees, opening hours, and forms drawn from official municipal documents. That makes it a strong candidate for AI-assisted automation. However, administrative procedure law, GDPR, and the requirement that decisions survive appeal mean the system must never answer from stale or invented content, and certain cases must always reach a human. A hybrid path, combining a retrieval-augmented AI chatbot grounded strictly on published official documents with clearly defined human escalation gates, delivers the efficiency gain the client wants while preserving the accountability the law demands. The client has no stated tech stack preference and is constrained by public procurement and central IT, so the recommendation is to build on open-standards components that can pass through a formal procurement process, with the regional IT team owning the infrastructure.

The client has no preferred tech stack and is bound by public procurement rules, so the hybrid solution should be designed around open-standards components (for example an open-source retrieval-augmented generation framework backed by the municipality's own document store) that can be tendered and approved through the existing procurement process without dependency on a single proprietary vendor.

02/Process Overview

Process Overview

The municipality currently handles around 11,000 citizen enquiries per year through a fully manual process. When a citizen contacts the department asking about fees, opening hours, or the correct form to use, a case officer picks up the enquiry, locates the relevant official document, drafts a response, and sends it. Complex or ambiguous cases are escalated to the department head. Everything is logged via email or spreadsheet. With six minutes of officer time per enquiry on average, the process consumes roughly 1,100 hours of staff effort annually on questions that are, in the majority of cases, straightforwardly answerable from published official documents.

The process runs continuously throughout the working day and involves three people: a department head and two case officers, supported by a shared regional IT function that moves slowly and is subject to formal public procurement rules. Some supporting information is available through open data registers published by municipal bodies, but there is no single system holding the full process. The fragmented landscape means institutional knowledge is concentrated in a small team, citizens wait longer than necessary for routine answers, and the two case officers spend a significant portion of their time on work that does not require their professional judgement.

The compliance context is demanding. Administrative procedure law, GDPR, and the requirement that decisions survive appeal mean every answer the municipality gives must be traceable to a current, authoritative source. Outdated information, invented content, or answers given without a proper audit trail are not just quality problems; they are legal liabilities. Any automation solution must account for this from the ground up, not as an afterthought.

03/Path Scores

Path Scores

AI Agent + human review Recommended
9/10

Retrieval-augmented generation grounded on official documents eliminates hallucination risk, while mandatory escalation gates satisfy the legal requirement for human accountability on complex cases. This directly matches the client's stated goal of handling routine cases automatically and routing exceptions to people. The approach is procurable as a defined system and auditable for GDPR and administrative law purposes.

AI Workflow
7/10

An AI workflow without explicit human gates could handle the high volume of standard enquiries well, but the compliance requirement that decisions be justifiable on the file and survive appeal makes a fully automated flow risky without built-in escalation logic. It is viable if escalation rules are hardcoded into the workflow, at which point it converges with the hybrid approach.

AI Agent Not recommended
4/10

An autonomous agent that can take actions beyond answering from documents introduces hallucination and accountability risks that are unacceptable under administrative procedure law. The process does not require multi-step autonomous reasoning; it requires accurate retrieval and clear escalation, which is better served by a constrained hybrid design.

RPA Not recommended
3/10

RPA is suited to structured, screen-based data entry tasks and cannot interpret natural-language citizen enquiries or retrieve answers from unstructured documents. It would not reduce the core bottleneck here and would add fragile screen-scraping dependencies on top of an already fragmented system landscape.

Traditional Code Not recommended
3/10

A rules-based FAQ bot coded in traditional software could handle a narrow set of exact-match questions but would require constant manual maintenance as fees, hours, and forms change, and would fail on any question phrased outside its predefined patterns. Given the variety of citizen language and the breadth of topics, this approach would quickly become a maintenance burden.

Education (AIRIES) Not recommended
3/10

Training the team to use AI tools more effectively would yield some marginal gains but would not address the structural problem: 11,000 enquiries a year handled manually is a volume problem, not a skills problem. Education is a necessary complement to the recommended path but not a substitute for it.

Stay Manual Not recommended
1/10

The current manual process consumes approximately 1,100 hours a year on largely repetitive, answerable questions. Staying manual perpetuates that cost, keeps institutional knowledge locked in two or three people, and leaves citizens waiting for answers that a well-designed system could provide instantly. There is no justification for remaining fully manual at this volume.

04/Process Dimensions

Process Dimensions

Eight dimensions drive the recommendation, scored 0–10 with a note on each.

Data Structure 7/10

The source content (fees, opening hours, forms) lives in official municipal documents that are structured enough for retrieval-augmented generation, though they are currently scattered and not held in a single system.

Rule Clarity 7/10

The rules for standard answers are clear and document-grounded; the boundary between automatable and escalation-required cases is definable, though it will need careful specification during build.

Exception Frequency 5/10

At five percent of 11,000 runs, roughly 550 exceptions per year represent a meaningful interruption load that the escalation gate must handle cleanly without burdening the automated flow.

Integration Readiness 4/10

Some registers publish open data, but central IT is slow to change and procurement is formal, meaning integration work will take longer and cost more than in a typical private-sector environment.

Volume / ROI 9/10

At 11,000 runs per year and six minutes each, the process consumes approximately 1,100 hours annually; even a 70 percent automation rate would free over 750 officer-hours per year, making the ROI case strong.

Process Stability 6/10

Fees, opening hours, and forms change periodically, so the document store underpinning the chatbot will need a governed refresh process to prevent the bot answering from stale content.

Human Judgment Required 6/10

The majority of enquiries are factual and require no judgement, but a meaningful minority involve procedural interpretation or formal decisions that must remain with a human to satisfy administrative law.

Compliance Requirements 8/10

Administrative procedure law, GDPR, and the requirement that decisions survive appeal impose strict constraints: the system must be auditable, grounded only on current official documents, and must route qualifying cases to a human decision-maker.

05/ROI Estimate

ROI Estimate

£49,500

Current annual cost

70%

Estimated time saved

£34,650

Annual savings

14mo

Payback period

Build cost estimate: £25,000 – £60,000

Current annual cost is calculated as 11,000 runs multiplied by 6 minutes divided by 60, multiplied by GBP 45 per hour, giving GBP 49,500. A 70 percent automation rate is used as a conservative estimate given the five percent exception rate and the compliance requirement to keep certain cases with a human; the remaining 30 percent covers escalated cases and document maintenance overhead. Build cost range reflects the uncertainty introduced by public procurement timelines and central IT involvement.

06/Implementation Roadmap

Implementation Roadmap

1
Document Inventory and Governance Setup 2-3 weeks

Catalogue all official municipal documents that will serve as the chatbot knowledge base, establish an owner and refresh cadence for each, and define the escalation criteria that will route cases to a human. This milestone removes the hallucination risk at source and is a prerequisite for every subsequent step. Effort is primarily the department head and case officers working with IT to agree scope and ownership.

2
Procurement and Vendor Selection 6-12 weeks

Prepare the technical specification for a retrieval-augmented AI chatbot and run it through the formal public procurement process. The specification should require document-grounded answers only, a full audit log per interaction, GDPR-compliant data handling, and an open API for integration with the municipal document store. This step is the longest dependency and should be started in parallel with document governance work.

3
Pilot Build and Escalation Gate Configuration 4-6 weeks

Deploy the selected solution against a subset of the document library covering the highest-volume enquiry types (fees and opening hours). Configure and test the escalation gate logic so that cases flagged as requiring judgement are routed to a case officer queue with full context. Run in shadow mode alongside the manual process to validate answer accuracy before go-live.

4
Full Rollout and Staff Handover 3-4 weeks

Extend the document library to cover all in-scope topics, retire the manual email-and-spreadsheet flow for standard cases, and train case officers on managing the escalation queue and updating the document store. Establish a monthly review cadence to catch document staleness and monitor escalation rates as a quality signal.

07/Risks & Considerations

Risks & Considerations

The single largest risk is the chatbot answering from outdated documents. Municipal fees and opening hours change, and if the document refresh process is not governed and enforced, the bot will give citizens wrong information that the municipality is legally accountable for. A clear document ownership model and automated staleness alerts are not optional extras; they are core to the system design. The second risk is scope creep at the escalation boundary: if the escalation criteria are drawn too narrowly, officers will be overwhelmed by edge cases; if drawn too broadly, the automation delivers little value. The escalation rules must be agreed with the department head before build begins and reviewed quarterly against actual escalation data.

GDPR compliance requires that citizen interaction logs are retained only as long as legally necessary and that no personal data is used to train or fine-tune the underlying model without explicit legal basis. The procurement specification must make these requirements explicit and contractually binding on any vendor. Finally, the slow pace of central IT and formal procurement means the project timeline is longer than a comparable private-sector deployment; the team should plan for this and avoid building workarounds that bypass IT governance, as these create security and audit risks.

AIRIES/Learning recommendation

Train the team, not just the tool.

In partnership with AIRIES, the Swiss AI learning platform. These levels fit your result.

Recommended levels
  1. 3
    Corporate Applied Intelligence & Automation
    Turn your own tasks into AI workflows, build reports and dashboards, set up a personal AI assistant.
  2. 4
    AI Leadership & Scalable Systems
    Design teams of AI agents and automate whole departments.
Why these levels

Level 3 gives the case officers the practical skills to understand how the retrieval-augmented chatbot works, maintain the document store, and identify when the automation is drifting from acceptable quality. Level 4 equips the department head to govern the system as a managed AI capability, set escalation policy, and report on performance to senior stakeholders. Both levels are directly applicable to the hybrid chatbot process being built and will reduce dependency on the external vendor for day-to-day operation.

Focus topics
Who should take it

Case officers who will manage the escalation queue and maintain the document store, plus the department head who will govern the system and review performance.

Explore these levels on AIRIES → The levels come from the AIRIES course catalogue. Opening the link does not commit you to anything.
08/Architecture Overview

Architecture Overview

flowchart TD A(["Citizen Enquiry"]) B["Retrieve from\nDocument Store"] C{"Answerable\nfrom Docs?"} D["Draft Grounded\nResponse"] E["Escalation Queue"] F["Case Officer\nReview"] G(["Citizen Receives\nAnswer"]) subgraph external["External Systems"] H("Open Data\nRegisters") I("Municipal\nDoc Store") end A --> B B --> C C -->|"Yes"| D C -->|"No"| E D --> G E --> F F --> G H --> I I --> B

Hover to zoom · click for fullscreen

09/Why This Approach

Why This Approach

The recommended path is Hybrid: a retrieval-augmented AI chatbot grounded strictly on official municipal documents, with clearly defined and mandatory human escalation gates. The core logic is straightforward. The vast majority of citizen enquiries ask factual questions whose answers already exist in published documents. A retrieval-augmented generation system, one that finds the relevant document passage and uses it as the direct basis for its answer rather than generating content from general training, eliminates the hallucination risk that makes fully autonomous AI unsuitable for a compliance-bound public sector context. The chatbot does not invent answers; it retrieves and presents them, with a traceable link back to the source document. That auditability is not a nice-to-have in this setting; it is the legal foundation on which the system must be built.

The escalation gates are the other half of the design, and they are equally non-negotiable. Roughly five percent of enquiries, around 550 per year, involve procedural interpretation, formal administrative decisions, or situations where the available documents do not give a clear answer. These cases must reach a human, and the system must be designed so that the boundary is explicit, tested, and reviewed regularly. The escalation gate routes flagged cases to a case officer queue with full context, so the officer picks up a case already understanding what the citizen asked and what the system could and could not find. This is a better working experience than the current manual triage, not just a compliance safeguard.

The client has no stated technology preference and is constrained by public procurement rules and central IT governance. This is acknowledged directly in the recommendation. The hybrid solution should be specified around open-standards components, for example an open-source retrieval-augmented generation framework backed by the municipality's own document store, so that it can be written into a formal tender and approved through the existing procurement process without creating a long-term dependency on a single proprietary vendor. The procurement timeline is the longest dependency in the project, and the team should treat it as such rather than trying to work around it.

Compared to the other paths considered, Hybrid is the clear fit. An AI Workflow scored 7 and is viable, but without explicit escalation logic hardcoded into the design it carries compliance risk; once you add those gates, it converges with the Hybrid approach anyway. An AI Agent scored 4 and is not recommended: autonomous multi-step reasoning is not what this process needs, and the accountability risks under administrative procedure law are unacceptable when the agent could take actions beyond retrieving and presenting document content. RPA and Traditional Code both scored 3; RPA cannot interpret natural-language enquiries, and a rules-based coded FAQ would require constant manual maintenance and would fail on any question phrased outside its predefined patterns, which is most of them. Staying Manual scored 1 and is indefensible at this volume: 1,100 hours a year on largely repetitive, answerable questions is a structural problem that better officer skills alone cannot solve, which is why Education alone also scored 3 and is recommended only as a complement to the technical implementation, not a substitute for it.

The honest tradeoffs are worth naming. The public procurement process will stretch the project timeline significantly compared to a private-sector equivalent, and central IT involvement adds coordination overhead. The ROI case is strong, with a projected 70 percent automation rate freeing over 750 officer-hours per year and a payback period of around 14 months at mid-range build cost, but that payback depends on the document governance model being established and maintained properly. If the document store is not kept current, the chatbot will give citizens wrong answers and the efficiency gain will be overwhelmed by the resulting rework and legal exposure. The document ownership and refresh process is not a phase-two concern; it is a prerequisite for go-live.

10/Comparing the Top Approaches

Comparing the Top Approaches

The two strongest contenders here are Hybrid and AI Workflow. Both can handle high volumes of natural-language enquiries and both can be grounded on official documents. The difference comes down to accountability. An AI Workflow solution can absolutely be built with escalation rules baked in, but those rules tend to be treated as configuration rather than as a structural feature of the system, which means they are easier to accidentally bypass or quietly erode as the workflow is updated over time. The Hybrid path makes the human escalation gate a first-class architectural component, not an afterthought, and that distinction matters enormously when administrative procedure law requires that certain decisions survive appeal and be justifiable on the file. For a private business answering questions about delivery times, the two approaches are nearly equivalent. For a municipality, the difference is material.

The AI Agent path scored significantly lower and is not a close competitor. An autonomous agent capable of taking multi-step actions beyond answering from documents introduces exactly the kind of unpredictable behaviour that public sector compliance cannot tolerate. This process does not need an agent that reasons across systems and initiates actions; it needs a system that retrieves accurate answers and knows when to stop and hand off to a person. Constraining an AI Agent tightly enough to be safe here would, in practice, produce something that behaves like the Hybrid design anyway, but with more complexity and fewer audit-friendly guarantees. Traditional Code and RPA were considered and set aside quickly: RPA cannot interpret natural-language enquiries at all, and a rules-based coded FAQ bot would require constant manual maintenance every time fees or opening hours change, which is precisely the maintenance burden the team is trying to escape.

11/How to Build It

How to Build It

The foundation of this system is a retrieval-augmented generation, or RAG, architecture in which the chatbot is permitted to answer only from a controlled, version-managed document store populated with official municipal documents. No general internet knowledge, no model fine-tuning on citizen data, and no answers generated from memory alone. Before any software is selected, the department head and case officers need to complete a document inventory: every fee schedule, opening hours notice, and form that the chatbot may reference must be catalogued, assigned an owner, and given a refresh cadence. This is unglamorous work but it is the single most important step in the project, because a RAG system is only as reliable as the documents behind it.

Once the document governance model is in place, the procurement specification can be written and published. Given the public procurement constraints, the specification should be written around open standards rather than a named product, requiring document-grounded answers with source citations, a full per-interaction audit log, GDPR-compliant data handling with defined retention periods, and an open API for integration with the municipal document store. Open-source RAG frameworks such as LangChain or Haystack, backed by a self-hosted vector database such as Weaviate or Qdrant, are representative of what a compliant vendor could offer, and naming these in the market engagement phase helps bidders understand the technical direction without locking the municipality into a proprietary stack. The channel interface, whether a widget on the municipal website, an email parser, or both, should be treated as a separate integration layer so it can be adapted without rebuilding the retrieval core.

The pilot phase deploys the selected solution against the highest-volume document subset, fees and opening hours, and runs it in shadow mode alongside the existing manual process. Shadow mode means the bot produces answers that case officers review before anything is sent to a citizen. This phase is specifically designed to surface answer-quality failures before they reach the public and to calibrate the escalation gate. The escalation logic should be rule-based and explicit: enquiries that contain keywords associated with formal administrative decisions, appeals, or procedural interpretation are flagged immediately; enquiries where the retrieval confidence score falls below a defined threshold are flagged automatically; everything else proceeds to a drafted response that is either sent automatically or reviewed on a sample basis, depending on the confidence level. The case officer queue that receives escalated cases should include the original citizen message, the documents the system attempted to retrieve, and the reason for escalation, so officers are never starting from scratch.

Full rollout extends the document library to cover forms and any remaining in-scope topics, retires the email-and-spreadsheet logging flow for standard cases, and replaces it with a structured interaction log that satisfies both GDPR audit requirements and the administrative law requirement for a justifiable file. A monthly review meeting, involving the department head and at least one case officer, should examine escalation rates, answer accuracy on sampled interactions, and any documents flagged as potentially stale. The escalation rate itself is the most useful quality signal: if it rises unexpectedly, something in the document store or the confidence thresholds needs attention.

12/Risks in Detail

Risks in Detail

The most serious operational risk is the chatbot answering from outdated documents. Municipal fees change at budget cycles, opening hours change seasonally or at short notice, and forms are revised without always triggering a formal publication event. If the document store is not refreshed in step with those changes, the bot will confidently give citizens wrong information, and the municipality carries legal accountability for that. Document staleness is not a technical problem that the software vendor can solve; it is a governance problem that must be solved by the department before the system goes live. Automated staleness alerts, tied to known review dates for each document, and a clear escalation path when an owner fails to confirm currency, are not optional features to add in a later phase. They are core to whether the system is safe to operate at all. The second major risk is miscalibrating the escalation boundary. If the criteria for routing to a human are drawn too broadly, the two case officers will be handling nearly as many cases as they do today and the efficiency gain disappears. If they are drawn too narrowly, cases requiring legal or procedural judgement will be answered by the bot, which creates accountability exposure that administrative procedure law does not permit. Getting this calibration right requires honest input from the department head about where the real judgment calls lie, and it requires ongoing review against actual escalation data rather than a one-time configuration decision at launch.

GDPR compliance introduces a specific contractual risk that the procurement process must address explicitly. Citizen interaction logs contain personal data and must be retained only for as long as legally necessary, handled in accordance with the municipality's data processing register, and never used by a vendor to train or improve a model without a documented legal basis. Any vendor whose standard terms allow model training on customer data must be required to amend those terms before contract signature. The slow pace of central IT and the length of public procurement timelines mean the overall project will take longer than a comparable private-sector deployment, and that is fine, but it creates a temptation to build quick workarounds that bypass IT governance. Those workarounds tend to create security gaps and audit failures that are more expensive to fix later than the time they saved at the start. The procurement and IT governance processes should be treated as constraints to be managed, not obstacles to be avoided.

⚡

Claude Code Starter

A scaffolded project ready to open in Claude Code. Unzip, open the folder, and Claude starts building immediately.

Claude Code Starter (.zip)

Your own assessment includes a ready-to-use project scaffold: CLAUDE.md, pyproject.toml, src/agent.py and .env.example. Open the folder in Claude Code and it starts building.

📁 your-process/
📄 CLAUDE.md
📄 pyproject.toml
📁 src/agent.py
📄 .env.example
Start Your Assessment

What's next?

That was someone else's process. Now do yours.

Same seven paths, same eight dimensions, same honest verdict, except scored against how your team actually works. Five to eight questions, about fifteen minutes.

Start Your Assessment
Public sector & municipalities
Monitoring council minutes and resolutions Processing tree-felling and public space permits Budget versus actual spending
Illustrative scenario based on how these processes typically run. Not a customer case study. Run this on your own process