This is a sample report. Start your own assessment below. Start Your Assessment →
← All use cases
Manufacturing & logistics

Including answering the one question everybody asks: where is my order.

What the audit checks

Customer support mostly handles a single question, and the answer is always already in a system. The audit checks whether shipment data is current enough, how to join up carriers, and what to do when the honest answer is bad news.

Self-Audit Assessment Report

Shipment status updates and customer replies

01 Jan 2026

01/Recommendation
Recommended path

AI Agent + human review

Automate the routine 95% of shipment status replies with an AI workflow and route exceptions to a human, freeing the team from repetitive lookups while keeping judgement where it belongs.

The vast majority of shipment status enquiries follow a single predictable pattern: find the data, format a reply, send it. An AI workflow integrated directly with the MES database and carrier feeds can handle this end to end without human involvement. The remaining five percent, which involve bad news, data errors or traceability concerns, carry real compliance risk and must be routed to a human with full context. A hybrid path with a human-in-the-loop gate for exceptions is therefore the right recommendation. The client's automation engineer can build and maintain the integration layer in Python, reading directly from the MES database and normalising carrier data, which aligns well with the stated preferred stack. The result is a system that handles roughly 14,250 cases automatically per year and surfaces only the 750 that genuinely need a person.

Python is a natural fit here: the automation engineer can write the MES database connector, the carrier data normalisation layer and the exception-routing logic, while an AI workflow platform (such as n8n, Prefect or a lightweight LLM-backed service) handles the reply generation and triage. No proprietary or expensive tooling is required.

02/Process Overview

Process Overview

The Shipment Status Updates and Customer Replies process is the main communication bridge between the customer support team and anyone asking where their order is. A customer sends an enquiry, typically by email, and an agent has to locate the relevant shipment data by checking the MES, one or more carrier systems, and often a spreadsheet that fills the gaps between those sources. Once the agent has assembled a picture of what is actually happening with the shipment, they compose a reply and send it. If anything looks wrong, whether the data is stale, there is a mismatch between systems, or the news is bad, the agent has to make a judgement call about how to handle it, sometimes escalating to a supervisor.

This happens continuously throughout the working day, with roughly 15,000 enquiries per year. At five minutes per case, that is approximately 1,250 person-hours annually spent on a task where the answer is almost always already sitting in a system somewhere. The vast majority of cases follow a single predictable pattern: find the data, verify it looks current, format a reply, send it. The remaining cases, estimated at around five percent, involve exceptions that require real human judgement, including delays or defects that carry product safety or traceability implications, data entry errors that need correcting before any reply goes out, and bad-news scenarios where the tone and content of the response matters significantly.

The process sits under the customer support team but is overseen by a plant manager and shift supervisors who are also responsible for understanding when an exception has compliance implications. The MES is a legacy system but its database is directly readable, and an automation engineer with a PLC background is available and willing to learn Python, which makes a code-based integration layer a realistic option without requiring external engineering resources.

03/Path Scores

Path Scores

AI Agent + human review Recommended
9/10

The process splits cleanly into a high-volume routine majority and a small but consequential exception tail. An AI workflow handles the routine cases automatically while a human gate manages exceptions involving bad news, traceability or data errors. This matches the client's stated goal and their compliance obligations precisely.

AI Workflow
6/10

A fully automated workflow could handle the standard cases well, but the five percent of exceptions involving product safety, recalls and bad-news communications carry too much risk to automate without a human gate. Viable for the routine tier only, which is effectively what the hybrid delivers.

Traditional Code
5/10

A Python script reading the MES database and pushing status replies could automate the lookup and formatting steps reliably. However, it cannot handle the natural language variation in customer queries or compose contextually appropriate replies for edge cases, so it would need significant hand-coded logic for every exception type.

RPA Not recommended
4/10

RPA could automate the screen-navigation steps across disparate systems, but the MES database is directly readable and the process involves natural language replies, making RPA an unnecessarily brittle and expensive layer. It would also struggle with the exception triage logic.

AI Agent Not recommended
4/10

A fully autonomous agent operating without human gates is inappropriate here given the product safety and traceability obligations. An agent that autonomously handles bad-news or recall-adjacent communications without oversight introduces unacceptable compliance risk at this volume.

Education (AIRIES) Not recommended
3/10

Training alone does not address the structural problem: the data is fragmented across systems and the volume is too high for manual handling to be sustainable. Education is a necessary complement to the recommended path but not a substitute for it.

Stay Manual Not recommended
1/10

The current manual process costs approximately 1,250 person-hours per year on a task where the answer is almost always already in a system. Staying manual is not a viable long-term position given the volume, the fragmentation of data sources and the compliance exposure from human error.

04/Process Dimensions

Process Dimensions

Eight dimensions drive the recommendation, scored 0–10 with a note on each.

Data Structure 5/10

Shipment data exists in the MES database and carrier systems but is fragmented, with gaps filled by email and spreadsheets, making integration non-trivial but achievable via Python connectors.

Rule Clarity 7/10

The standard case follows a clear rule: find the data and reply; the exception logic is less codified but the client can articulate the main exception types, which is sufficient to build routing rules.

Exception Frequency 4/10

At five percent of 15,000 cases, roughly 750 exceptions per year is a meaningful tail that requires a reliable human escalation path rather than full automation.

Integration Readiness 6/10

The MES database is readable and an automation engineer is available to build connectors, but carrier system integration and the absence of a unified data layer mean moderate integration effort is required upfront.

Volume / ROI 9/10

At 15,000 cases per year and five minutes each, the current annual cost is approximately £56,250; automating 90 percent of cases delivers very strong ROI relative to build cost.

Process Stability 6/10

Carrier integrations and MES schemas may evolve, but the core query-and-reply logic is stable, so maintenance burden should be manageable with a Python-based integration layer.

Human Judgment Required 6/10

The routine majority requires no judgement, but the exception tail, particularly bad-news communications and traceability concerns, demands human oversight and cannot be safely automated away.

Compliance Requirements 7/10

Product safety and traceability obligations mean that any automated reply touching a potential defect or recall scenario must be intercepted by a human before it reaches the customer.

05/ROI Estimate

ROI Estimate

£56,250

Current annual cost

85%

Estimated time saved

£47,813

Annual savings

4mo

Payback period

Build cost estimate: £8,000 – £18,000

Current annual cost is based on 15,000 cases at 5 minutes each at £45 per hour, totalling 1,250 hours and £56,250. The 85 percent automation rate reflects the standard case majority; the remaining 15 percent accounts for exceptions and human oversight time on the escalation queue.

06/Implementation Roadmap

Implementation Roadmap

1
Data Integration and Unified Status Layer 3-4 weeks

The automation engineer builds Python connectors to read shipment status from the MES database and normalise carrier data feeds into a single queryable status object. This is the foundation everything else depends on. Effort is moderate given the legacy MES and the need to map carrier data schemas.

2
Automated Reply Generation for Standard Cases 2-3 weeks

An AI workflow layer (for example n8n or a lightweight LLM-backed service) takes the unified status object, identifies standard queries and generates a formatted customer reply. Replies are sent automatically without human review. A confidence threshold and a simple rule set define what counts as standard.

3
Exception Detection and Human Escalation Gate 1-2 weeks

Cases falling below the confidence threshold, flagged as bad news, or touching traceability fields are routed to a human queue with full context attached. The handler reviews, edits if needed and approves before the reply is sent. This gate is the compliance control point for the process.

4
Pilot, Monitoring and Threshold Tuning 3-4 weeks

Run the system in parallel with the existing manual process for two to four weeks, comparing automated replies against what a human would have sent. Tune the exception threshold based on observed false negatives and false positives. Establish a simple dashboard showing automation rate, exception rate and reply latency.

5
Full Rollout and Team Handover 1-2 weeks

Decommission the parallel manual process for standard cases. Train the shift supervisors and support staff on the exception queue workflow and on how to update routing rules when carrier schemas or product lines change. Document the system so knowledge is no longer held in two or three people's heads.

07/Risks & Considerations

Risks & Considerations

The most significant risk is a misconfigured exception threshold that allows a bad-news or traceability-sensitive reply to be sent automatically without human review. Given the recall implications, this must be treated as a hard failure mode: the system should err on the side of over-escalating rather than under-escalating, at least in the first six months. A second risk is data quality: if the MES or carrier feeds contain stale or incorrect data, the automated reply will be confidently wrong, which is worse than a slow manual reply. Data freshness checks must be built into the integration layer as a prerequisite to reply generation. Finally, the process knowledge currently held in two or three people's heads must be captured and codified during the build phase; if those individuals leave before the system is documented, the exception routing logic will be incomplete.

AIRIES/Learning recommendation

Train the team, not just the tool.

In partnership with AIRIES, the Swiss AI learning platform. These levels fit your result.

Recommended levels
  1. 3
    Corporate Applied Intelligence & Automation
    Turn your own tasks into AI workflows, build reports and dashboards, set up a personal AI assistant.
  2. 4
    AI Leadership & Scalable Systems
    Design teams of AI agents and automate whole departments.
Why these levels

The automation engineer and shift supervisors who will build and run this system need practical skills in turning a manual process into an AI workflow with escalation logic, which is the core of AIRIES Level 3. The plant manager and supervisors overseeing the exception queue and deciding when to expand automation further will benefit from Level 4, which covers designing human-AI team structures and scaling automation across a department. These two levels together equip the team to build, supervise and evolve the system without external dependency.

Focus topics
Who should take it

Automation engineer (build and maintain), shift supervisors and plant manager (oversight and exception handling)

Explore these levels on AIRIES → The levels come from the AIRIES course catalogue. Opening the link does not commit you to anything.
08/Architecture Overview

Architecture Overview

flowchart TD A(["Customer Enquiry"]) B["Data Integration Layer\nPython + MES + Carriers"] C{"Standard or\nException?"} D["AI Reply\nGeneration"] E["Human\nEscalation Queue"] F["Agent Reviews\nand Approves"] G(["Reply Sent\nto Customer"]) subgraph External Systems H("MES Database") I("Carrier Feeds") end A --> B H --> B I --> B B --> C C -->|"Standard"| D C -->|"Exception"| E D --> G E --> F F --> G

Hover to zoom · click for fullscreen

09/Why This Approach

Why This Approach

The recommended path is Hybrid: an AI workflow that handles the routine majority of cases automatically, with a hard human-in-the-loop gate that intercepts every exception before a reply reaches the customer. This is not a close call. The process has a clear structural split between a high-volume, low-variability standard case and a small but consequential exception tail, and the right architecture maps directly onto that split. Automating everything without a gate is irresponsible given the product safety obligations. Automating nothing wastes more than a thousand person-hours a year on a task that does not require human judgement most of the time.

The client has expressed a clear preference for Python, and that preference aligns well with what the technical layer of this solution actually needs. The automation engineer can write Python connectors to read directly from the MES database and pull in carrier data feeds, normalising them into a single status object that the rest of the workflow can query without caring which system the data originally came from. This integration layer is the foundation of the whole system, and building it in Python means it is maintainable in-house without relying on a proprietary platform or a vendor relationship. An orchestration layer such as n8n, or a lightweight LLM-backed service, can sit on top of that Python foundation to handle the natural language reply generation and the triage logic that decides whether a case is standard or an exception.

The alternative paths each fail on one or more meaningful dimensions. A fully automated AI Workflow scores well for the standard cases but has no safe answer for the exception tail, and at this volume the exception tail represents roughly 750 cases a year that could carry recall implications. That is not a tail you can automate away and hope for the best. RPA is the wrong tool entirely: the MES database is directly readable, so screen-scraping automation adds brittleness without adding capability, and it cannot generate contextually appropriate natural language replies. A fully autonomous AI Agent is similarly inappropriate here because compliance obligations require a human to stand between the system and the customer whenever the reply touches a potential defect or delay. Traditional Code alone, meaning Python scripts without an AI layer, could handle the lookup and formatting steps reliably, but it would need an ever-growing library of hand-coded rules to deal with natural language variation in incoming queries and to compose replies that read well across different exception types. That approach scales poorly and becomes a maintenance burden as soon as edge cases accumulate. Education alone does nothing to address the structural fragmentation of the data or the volume problem.

The Hybrid path is honest about what automation can and cannot do here. It automates the part of the process that is genuinely mechanical and gives that time back to the team. It keeps a human in the loop for the part of the process where the stakes are real and the judgement is irreplaceable. The automation engineer's Python skills mean the integration layer can be built, owned and evolved internally, which reduces long-term cost and dependency. The exception gate is not just good practice; it is the compliance control point for the process, and its design deserves the same care as the automation itself.

10/Comparing the Top Approaches

Comparing the Top Approaches

The two strongest contenders here are Hybrid and fully automated AI Workflow, and the gap between them comes down to one thing: the exception tail. A fully automated AI Workflow could handle the standard status queries well enough, reading from the MES database, normalising carrier data and generating a reply without human involvement. But roughly 750 cases a year involve bad news, data mismatches or traceability concerns that carry real compliance weight, and a fully automated system has no natural place to stop and ask for help. Sending a confident, automated reply about a potential defect or a delay that might trigger a recall conversation is a meaningful legal and reputational exposure. The Hybrid path solves this by keeping the automation for the 95 percent of cases where the answer is simply in the data, while routing everything else to a human with full context already assembled.

Traditional Code is worth considering because the automation engineer is already comfortable in that space and the MES database is directly readable. A Python script could absolutely handle the lookup and formatting steps, and for a simpler process it might be the right call. The problem here is the natural language variation in incoming customer enquiries and the need to compose contextually appropriate replies for edge cases. Hand-coding logic for every possible exception type, carrier format and message tone is a maintenance burden that grows quickly. The Hybrid path uses Python exactly where it belongs, as the integration and data normalisation layer, and hands the language and triage work to an AI workflow layer that is better suited to it.

RPA was considered and ruled out for a clear reason: the MES database is directly readable, so screen-scraping automation adds complexity without adding value. RPA would also struggle with the natural language composition step and with exception triage logic that doesn't follow a rigid screen-by-screen path. At 15,000 cases a year, a brittle RPA layer would generate its own maintenance overhead that offsets much of the gain.

11/How to Build It

How to Build It

The foundation of the whole system is a clean, unified shipment status object, and that starts with the automation engineer writing Python connectors directly against the MES database. The MES is legacy but database-readable, which is a significant advantage: no screen scraping, no brittle UI dependencies, just direct SQL or ODBC queries pulling the fields that matter for a status reply. In parallel, the engineer builds a normalisation layer that pulls carrier data feeds, whether that's via carrier APIs, SFTP file drops or email-parsed CSVs, and maps them onto the same status schema as the MES data. Where spreadsheets currently fill the gaps, those sources get ingested too, with explicit freshness timestamps so the system always knows how old the data is. This unified status object becomes the single source of truth the rest of the pipeline depends on, and it's worth taking three to four weeks to get it right rather than rushing it and building on shaky ground.

Once the data layer is stable, an AI workflow platform takes over the reply generation and triage steps. A tool like n8n is a practical choice here: it's self-hostable, has good Python integration, and the automation engineer can learn it without abandoning their existing skills. Alternatively, a lightweight service built directly in Python using a hosted LLM API such as OpenAI or Anthropic, called via a simple request handler, keeps the entire stack in one language and under the team's direct control. Whichever platform is chosen, the logic is the same: the workflow receives an incoming customer enquiry, matches it to a unified status object, scores it against a set of routing rules, and either composes and sends an automated reply or packages the case for the human exception queue. The routing rules codify the decision points the team already uses intuitively: is the data current? Is this standard or an exception? Is there any bad-news flag, traceability field or data mismatch that needs a human eye before anything goes to the customer?

The exception queue is where the compliance control point lives, and it deserves careful design. When a case is routed to the queue, the handler sees the incoming enquiry, the assembled status data, the reason it was flagged, and a draft reply if one was generated. The handler can approve, edit or escalate further, and nothing leaves the system until a human has reviewed it. This queue can be implemented as a simple email triage inbox, a Slack channel with structured messages, or a lightweight web interface built in Python and hosted internally. The important thing is that the context travels with the case so the handler doesn't have to repeat the lookup work the system already did.

Before switching off the manual process, the team runs the automated system in parallel for two to four weeks, comparing what the automation sends against what a human would have sent for the same query. This parallel run surfaces misconfigured thresholds, data freshness edge cases and any carrier schemas that weren't fully mapped. A simple monitoring dashboard, which can be a Metabase or Grafana instance reading from a PostgreSQL log table written by the Python layer, shows the automation rate, exception rate, reply latency and any cases where the system flagged uncertainty. After the pilot, the parallel manual process for standard cases is decommissioned, shift supervisors and the plant manager are trained on the exception queue workflow, and the routing rules are documented so that when carrier schemas change or new product lines are added, the team can update the system themselves without external help.

12/Risks in Detail

Risks in Detail

The most consequential failure mode is a misconfigured exception threshold that lets a bad-news or traceability-sensitive reply go out automatically without human review. At 15,000 cases a year, even a one percent miscalibration means 150 cases a year where a customer might receive an automated reply about a delay, a defect or a potential recall scenario that should have had a human sign-off. Given the product safety and traceability obligations this client operates under, that's not an acceptable error rate. The system should be tuned to over-escalate rather than under-escalate, particularly in the first six months, and any field in the status object that touches traceability, defect codes or carrier-flagged exceptions should trigger an automatic human gate regardless of the confidence score. The instinct to optimise the automation rate upward should be resisted until the exception routing has been validated against real cases over a sustained period.

The second category of risk is data quality, and it's easy to underestimate. If the MES contains stale records, if a carrier feed is delayed or malformed, or if a spreadsheet used as a gap-filler hasn't been updated, the automated reply will be confidently wrong. A slow manual reply is frustrating; a confident wrong automated reply damages trust and can have downstream compliance consequences. Data freshness checks must be built into the integration layer as a hard prerequisite: if the status data for a given shipment is older than a defined threshold, the case should be routed to the human queue rather than replied to automatically. There is also a knowledge concentration risk worth naming: if the two or three people who currently know how the exception logic works in practice leave before that logic is properly documented and codified in the routing rules, the system will have gaps that only surface when an edge case hits them. Capturing that institutional knowledge during the build phase, not after go-live, is a non-negotiable part of the project.

⚡

Claude Code Starter

A scaffolded project ready to open in Claude Code. Unzip, open the folder, and Claude starts building immediately.

Claude Code Starter (.zip)

Your own assessment includes a ready-to-use project scaffold: CLAUDE.md, pyproject.toml, src/agent.py and .env.example. Open the folder in Claude Code and it starts building.

📁 your-process/
📄 CLAUDE.md
📄 pyproject.toml
📁 src/agent.py
📄 .env.example
Start Your Assessment

What's next?

That was someone else's process. Now do yours.

Same seven paths, same eight dimensions, same honest verdict, except scored against how your team actually works. Five to eight questions, about fifteen minutes.

Start Your Assessment
Manufacturing & logistics
Predictive maintenance from sensors and logs AI visual quality control on the line Delivery route optimisation Fault diagnosis from machine logs and technician notes
Illustrative scenario based on how these processes typically run. Not a customer case study. Run this on your own process