This is a sample report. Start your own assessment below. Start Your Assessment →
← All use cases
Real estate & construction

Line items pulled out of PDF quotes into one comparable table.

What the audit checks

Every subcontractor formats their quote differently and comparing them is manual, so in practice you compare the bottom line. The audit checks how different the structures are and what can be normalised without losing the detail that matters.

Self-Audit Assessment Report

Subcontractor bid comparison

01 Jan 2026

01/Recommendation
Recommended path

AI Agent + human review

An AI-powered extraction and normalisation workflow with human review gates is the right fit for this high-volume, variable-format bid comparison process.

The subcontractor bid comparison process is a strong candidate for a hybrid AI workflow that automates routine PDF extraction and line-item normalisation while routing the roughly 25% of non-standard cases to a human reviewer. The core pain is format variability across PDF quotes, which is exactly the problem document-understanding AI handles well, but the compliance exposure around property claims and the absence of in-house technical staff mean full autonomous automation would carry unacceptable risk. The client has no stated platform preference but does have an external contractor who can build and maintain the solution against the CRM partner API, making a pragmatic cloud-based AI workflow with a lightweight review interface the most realistic delivery path. This approach directly delivers the client's stated goal: routine cases handle themselves, and people only touch the exceptions.

The client has no in-house developers but can re-engage an external contractor, so the recommended solution should use a managed cloud AI document-processing service (such as Azure Document Intelligence or AWS Textract) paired with a simple workflow orchestration layer, minimising ongoing maintenance burden.

02/Process Overview

Process Overview

The subcontractor bid comparison process begins when the office coordinator or one of five agents receives PDF quotes from subcontractors via email. Each quote arrives in its own format, with line items labelled and structured differently depending on the supplier. The team then manually extracts those line items, works out which items across different quotes are actually equivalent, populates a comparison spreadsheet, and flags anything ambiguous or non-standard before passing the finished table to a decision-maker. The process runs several times a week and adds up to roughly 400 runs per year, each taking around two hours of manual effort.

The core difficulty is format variability. Subcontractors do not follow a standard template, so every quote requires human interpretation to figure out how its line items map to a common structure. About 75% of cases are routine enough that a consistent normalisation logic applies, but the remaining 25% involve judgment calls that currently live in the heads of a small number of experienced staff. The comparison output is not just an internal convenience: it feeds directly into property claim statements, which carry legal liability under consumer protection rules, and personal data handled during the process falls under GDPR obligations. Errors introduced during manual data entry are discovered downstream during rework, which compounds both the time cost and the compliance risk.

The business currently uses email and spreadsheets as its primary tools, with a vendor CRM that has a partner API. Portal integrations have previously been built by an external contractor who can be re-engaged. There are no in-house developers, so any solution must be buildable and maintainable through that contractor relationship without requiring permanent technical staff on the payroll.

03/Path Scores

Path Scores

AI Agent + human review Recommended
9/10

AI document extraction handles the structured majority automatically while a human gate covers the 25% of non-standard cases, matching the client's explicit goal. Compliance risk is managed by keeping a person accountable for exceptions and final sign-off. The external contractor can build this without in-house technical staff.

AI Workflow
6/10

A fully automated AI workflow could handle the routine cases well, but the 25% exception rate and legal liability around inaccurate property statements make unattended end-to-end automation risky without human oversight gates. It scores lower than hybrid purely because of the compliance and exception dimensions.

RPA Not recommended
4/10

RPA is brittle against the format variability that is the core problem here; every new quote layout would require a new bot configuration. It could assist with downstream spreadsheet population but cannot solve the extraction and normalisation challenge on its own.

AI Agent Not recommended
4/10

An autonomous agent could theoretically handle the full comparison end to end, but the compliance requirements and the importance of human accountability for property claim accuracy make a fully autonomous agent inappropriate here without significant oversight infrastructure.

Traditional Code Not recommended
3/10

Rule-based PDF parsing breaks quickly when quote formats vary, which is the defining characteristic of this process. Maintaining a growing library of format-specific parsers without in-house developers would be expensive and fragile.

Education (AIRIES) Not recommended
3/10

Training the team to use AI tools manually would reduce effort but would not eliminate the 800 hours per year of repetitive extraction work. Education is a valuable complement to the recommended path but not a substitute for it.

Stay Manual Not recommended
1/10

The current manual process costs approximately 800 hours per year, is error-prone, and concentrates process knowledge in two or three people. Staying manual is not viable as a long-term strategy given the volume and the compliance risk of data entry errors.

04/Process Dimensions

Process Dimensions

Eight dimensions drive the recommendation, scored 0–10 with a note on each.

Data Structure 3/10

Input data is unstructured PDF quotes in highly variable formats, which is the central challenge and the main reason AI document understanding is needed rather than simple rule-based extraction.

Rule Clarity 5/10

The normalisation logic for standard cases is reasonably clear, but the 25% of non-standard cases involve judgment calls that are not fully codified and currently sit in a few people's heads.

Exception Frequency 4/10

Approximately 25% of runs are non-standard and require human judgment, which is high enough to make a human-in-the-loop gate essential rather than optional.

Integration Readiness 5/10

The CRM has a partner API and a contractor can be re-engaged, but there is no in-house technical capability and no existing automation infrastructure, so integration will require external build effort.

Volume / ROI 8/10

At 400 runs per year and 120 minutes each, the process consumes roughly 800 hours annually at a cost of around 36,000 GBP, giving a strong ROI case for automation even at a modest savings rate.

Process Stability 6/10

Quote formats from subcontractors change over time as new suppliers are onboarded, but the core comparison logic is stable, so the solution needs to be adaptable rather than rigid.

Human Judgment Required 6/10

Routine cases require little judgment, but non-standard items and compliance-sensitive outputs require a human to remain accountable, making full automation inappropriate.

Compliance Requirements 7/10

Consumer protection rules on property claims and GDPR obligations mean that errors in the comparison output carry legal liability, requiring human sign-off on outputs before they are acted upon.

05/ROI Estimate

ROI Estimate

£36,000

Current annual cost

65%

Estimated time saved

£23,400

Annual savings

14mo

Payback period

Build cost estimate: £18,000 – £32,000

Current annual cost is calculated as 400 runs multiplied by 2 hours multiplied by 45 GBP per hour, giving 36,000 GBP. The 65% savings estimate reflects full automation of the standard 75% of cases and a significant reduction in effort for the 25% of exceptions that still require human review; the remaining 35% covers coordinator oversight, exception handling, and CRM reconciliation.

06/Implementation Roadmap

Implementation Roadmap

1
Discovery and Format Audit 1-2 weeks

The external contractor reviews a sample of 30 to 50 historical PDF quotes to catalogue format variations and identify which line-item categories must be normalised. This produces a normalisation schema and a clear definition of what constitutes a standard versus non-standard case. Effort is low but the output is the foundation for everything that follows.

2
AI Extraction Pipeline Build 3-4 weeks

The contractor builds a document-understanding pipeline using a managed cloud service (Azure Document Intelligence or equivalent) to extract line items from incoming PDFs and map them to the normalisation schema. The pipeline outputs a structured JSON or spreadsheet for each quote. Standard cases are flagged as auto-approved; non-standard cases are flagged for review.

3
Human Review Interface 2-3 weeks

A lightweight review screen is built (a simple web form or enhanced spreadsheet view) where the coordinator can inspect flagged cases, correct extractions, and approve the final comparison table. This gate ensures compliance accountability is maintained and gives the team confidence in the outputs before they are used.

4
CRM Integration 2-3 weeks

The contractor connects the pipeline output to the vendor CRM via its partner API so that approved comparison tables are stored against the relevant project record automatically. This eliminates the current gap where outputs live only in email and spreadsheets and reduces the risk of knowledge loss.

5
Pilot and Calibration 4 weeks

The system runs in parallel with the manual process for four weeks on live cases. The team validates AI extractions against their manual outputs, and the contractor tunes the normalisation schema and confidence thresholds based on real errors found. The exception rate and accuracy are measured against the baseline.

6
Handover and Team Enablement 1-2 weeks

The coordinator and agents are trained on the review interface and exception-handling workflow. Process documentation is written so that the knowledge no longer sits in two or three people's heads. The contractor hands over a maintenance guide and the team transitions to the new process fully.

07/Risks & Considerations

Risks & Considerations

The biggest risk is over-reliance on AI extraction accuracy before the system has been properly calibrated. PDF quote formats in construction vary enormously, and a model that performs well on the training sample may fail on a new subcontractor's layout, producing a plausible-looking but incorrect comparison table. If the team loses the habit of checking outputs critically, errors could reach property claim statements and trigger the legal liability the client has identified. Human review gates must be treated as a genuine control, not a rubber stamp, and the confidence threshold for auto-approval must be set conservatively during the first six months.

A secondary risk is contractor dependency. With no in-house technical staff, the client relies entirely on the external contractor for maintenance, schema updates when new subcontractor formats appear, and any CRM API changes. The handover milestone must include thorough documentation and ideally a retainer arrangement so that the system does not degrade silently when the contractor is not actively engaged.

AIRIES/Learning recommendation

Train the team, not just the tool.

In partnership with AIRIES, the Swiss AI learning platform. These levels fit your result.

Recommended levels
  1. 3
    Corporate Applied Intelligence & Automation
    Turn your own tasks into AI workflows, build reports and dashboards, set up a personal AI assistant.
  2. 4
    AI Leadership & Scalable Systems
    Design teams of AI agents and automate whole departments.
Why these levels

The office coordinator and agents who will run and supervise this process need Level 3 skills to understand how to turn the bid comparison task into an AI workflow, interpret extraction outputs, and manage exceptions confidently. The manager or principal overseeing the team should take Level 4 to understand how to design the human review gate as a scalable system and make decisions about when to expand automation to other processes. Both levels are directly applicable to a small, non-technical team taking ownership of an AI-assisted operational workflow.

Focus topics
Who should take it

Office coordinator and team lead or principal responsible for the bid comparison process.

Explore these levels on AIRIES → The levels come from the AIRIES course catalogue. Opening the link does not commit you to anything.
08/Architecture Overview

Architecture Overview

flowchart TD A(["PDF Quote Received"]) B["AI Extraction Pipeline"] C{"Standard Case?"} D["Auto-Approve & Format"] E["Human Review Queue"] F["Coordinator Reviews"] G["Comparison Table Approved"] H["CRM via Partner API"] I(["Decision-Maker Notified"]) subgraph External Systems H end A --> B B --> C C -->|"Yes"| D C -->|"No"| E E --> F F --> G D --> G G --> H H --> I

Hover to zoom · click for fullscreen

09/Why This Approach

Why This Approach

The recommended approach is a Hybrid AI workflow: a managed cloud document-understanding service handles extraction and normalisation for the routine majority of quotes, while a human review gate intercepts the non-standard cases that require judgment before the final comparison table is approved and stored. This is not a compromise between automation and caution; it is the architecture that actually fits the problem. The defining characteristic of this process is PDF format variability, and that is precisely what modern document AI, services like Azure Document Intelligence or AWS Textract, is designed to handle. A human reviewer sitting at a lightweight review interface covers the 25% of cases where the AI cannot confidently normalise a line item. The result is that the team's attention is concentrated on the cases that genuinely need them, rather than spread thinly across every quote.

The client has no stated platform preference, which the assessment notes as an opportunity rather than a constraint. Without a legacy system to integrate around or an internal team with strong opinions about tooling, the contractor can choose the managed cloud service that gives the best extraction accuracy for construction-format PDFs and pair it with a simple orchestration layer, most likely a low-code workflow tool, that routes standard cases through automatically and surfaces exceptions in a review queue. The external contractor who has previously built portal integrations against the CRM partner API is well positioned to deliver this: the architecture is not exotic, and the CRM integration at the end of the pipeline is a straightforward API write once the comparison table has been approved.

The fully automated AI Workflow path scored lower for a clear reason: a 25% exception rate is too high to leave unattended when the outputs carry legal liability. A plausible-looking but incorrect comparison table reaching a property claim statement is the specific risk the client identified, and an unattended pipeline has no mechanism to catch that before it causes harm. The human review gate in the Hybrid path is the control that makes the rest of the automation safe to run, not a concession to risk aversion. It also gives the team a period of calibration during which they can see what the AI gets right and wrong before they are asked to trust it fully.

RPA and Traditional Code were considered and set aside. RPA is brittle against format variability: a bot configured for one subcontractor's PDF layout breaks when that layout changes or a new supplier is onboarded, and maintaining a growing library of bot configurations without in-house developers is not realistic. Rule-based code parsing has the same fundamental weakness. These approaches could assist with downstream spreadsheet population, but they cannot solve the extraction and normalisation challenge that is the heart of the problem. An autonomous AI Agent could theoretically handle the full workflow end to end, but without the oversight infrastructure and with compliance liability in play, that level of autonomy is not appropriate at this stage. It remains a plausible future state once the team has built confidence in the system's accuracy over time.

Education alone would reduce individual effort but would not eliminate the 800 hours per year of repetitive work. It is worth noting that the office coordinator and agents who will own this process do need to develop real fluency with AI document workflows, not to build the system but to supervise it, interpret its outputs, and handle exceptions confidently. Upskilling at the right level is a necessary complement to the technical build, and the assessment identifies AIRIES Levels 3 and 4 as the relevant range for the team and its lead respectively. The Hybrid path works best when the people running it understand what the AI is doing and why, rather than treating it as a black box.

10/Comparing the Top Approaches

Comparing the Top Approaches

The two strongest paths for this process are Hybrid and AI Workflow, and the gap between them comes down to one thing: what happens when the extraction goes wrong. A fully automated AI Workflow could handle the routine 75% of quote comparisons without any human involvement, and in a low-stakes process that would be a perfectly reasonable choice. Here, though, the outputs feed directly into property claim statements that carry legal liability under consumer protection rules. An incorrect line-item comparison that reaches a decision-maker without review is not just an operational inconvenience; it is a compliance failure. That reality makes the human review gate in the Hybrid path a necessity rather than a conservative preference.

RPA scores well below both because it cannot solve the problem that actually matters. The core challenge in this process is that subcontractor PDF quotes arrive in dozens of different layouts with no consistent structure. RPA is well-suited to clicking through predictable interfaces and populating fields it already knows how to find, but it has no ability to understand a document whose structure it has never seen before. Every new subcontractor format would require a new bot configuration, and with a contractor rather than in-house developers maintaining the system, that becomes an expensive and fragile treadmill. Traditional Code has the same fundamental weakness: a rule-based parser that works for one quote layout breaks the moment a new supplier sends a PDF formatted differently, and maintaining a growing library of format-specific parsing rules without in-house technical staff is not realistic.

The Hybrid path wins specifically because AI document understanding, provided by a managed cloud service like Azure Document Intelligence, is designed for exactly this kind of format variability. It does not need to be told in advance what a quote looks like; it infers structure from the document itself. The human review gate then handles the cases where inference is not confident enough, ensuring that no output reaches a decision-maker without a person having been accountable for it. That combination of AI breadth and human accountability is what makes this path the right fit for a compliance-sensitive, variable-format process run by a non-technical team.

11/How to Build It

How to Build It

The build starts before any code is written, with a format audit. The external contractor reviews a sample of 30 to 50 historical PDF quotes collected from the client's email archive and catalogues the structural variations: how different subcontractors label equivalent line items, which fields are sometimes missing, and where ambiguity is most likely to occur. That audit produces a normalisation schema, essentially a defined list of canonical line-item categories and the rules for mapping incoming labels to them, along with a clear definition of what makes a case standard versus non-standard. Everything built after this point depends on the quality of that schema, so it is worth spending the time to get it right with input from the coordinator and the agents who currently do this work manually.

With the schema in place, the contractor builds the extraction pipeline. Incoming PDF quotes arrive by email, and a connector, most practically built using Make or n8n given the absence of in-house developers, monitors a designated inbox and triggers the pipeline on receipt. Each PDF is passed to Azure Document Intelligence, which extracts line items and their associated values and returns structured JSON. A normalisation layer maps the extracted labels to the canonical schema, scores each field by confidence, and flags the whole record as standard if all fields exceed a defined confidence threshold, or non-standard if any field falls below it or cannot be mapped. The output for standard cases flows directly into a comparison spreadsheet or a structured output template; non-standard cases are held in a review queue.

The review interface is where the compliance control lives. A lightweight web form, built by the contractor using a tool like Retool or a comparable low-code interface builder, presents the flagged cases to the office coordinator with the original PDF alongside the extracted values so that discrepancies are immediately visible. The coordinator can correct individual fields, add a note explaining the exception, and approve the record for output. Only approved records, whether auto-approved standard cases or manually reviewed exceptions, proceed to the final comparison table. Once approved, the contractor connects the pipeline output to the vendor CRM via its partner API, so that each completed comparison is stored against the relevant project record automatically rather than living in a spreadsheet attached to an email thread.

The final stage before full handover is a four-week parallel pilot in which the automated pipeline runs alongside the existing manual process on live incoming quotes. The team compares AI outputs against their own manual comparisons, and the contractor adjusts confidence thresholds and normalisation rules based on the errors found. This calibration period is not optional; it is where the system earns the team's trust and where the exception rate is measured against the baseline. At the end of the pilot, the coordinator and agents are trained on the review interface and the exception-handling workflow, process documentation is written down for the first time, and the contractor hands over a maintenance guide covering how to update the normalisation schema when new subcontractor formats appear.

12/Risks in Detail

Risks in Detail

The most serious risk is that the team stops reading the outputs critically once the system is running smoothly. AI document extraction is convincing even when it is wrong. A new subcontractor sends a quote formatted differently from anything in the training sample, the model extracts plausible-looking values from the wrong fields, and the comparison table looks correct at a glance. If the coordinator treats the review gate as a formality rather than a genuine control, that error reaches the decision-maker and potentially a property claim statement. The confidence threshold for auto-approval needs to be set conservatively for at least the first six months, which means accepting a higher volume of flagged cases for human review in exchange for catching the failures that matter. The team should also be told explicitly during training that the review gate is a compliance control, not an inconvenience, and that the legal liability for inaccurate outputs sits with the person who approved them, not the AI model.

The second risk is contractor dependency. With no in-house technical staff, every schema update, every CRM API change, and every new subcontractor format that breaks the existing normalisation rules requires the external contractor to be available and engaged. If the contractor relationship lapses, the system will degrade silently over time as new formats accumulate in the exception queue and no one updates the normalisation rules to handle them. The handover milestone must produce documentation detailed enough that a different contractor could pick up the system if needed, and the client should seriously consider a modest ongoing retainer arrangement rather than relying on ad hoc re-engagement. A system that works well for 18 months and then quietly fails is not a successful automation.

⚡

Claude Code Starter

A scaffolded project ready to open in Claude Code. Unzip, open the folder, and Claude starts building immediately.

Claude Code Starter (.zip)

Your own assessment includes a ready-to-use project scaffold: CLAUDE.md, pyproject.toml, src/agent.py and .env.example. Open the folder in Claude Code and it starts building.

📁 your-process/
📄 CLAUDE.md
📄 pyproject.toml
📁 src/agent.py
📄 .env.example
Start Your Assessment

What's next?

That was someone else's process. Now do yours.

Same seven paths, same eight dimensions, same honest verdict, except scored against how your team actually works. Five to eight questions, about fifteen minutes.

Start Your Assessment
Real estate & construction
Property listing generation Buyer qualification chatbot
Illustrative scenario based on how these processes typically run. Not a customer case study. Run this on your own process