Camera-based road inspection uses vehicle-mounted cameras and GNSS to record the road surface, deep learning to detect potholes, cracking, ravelling and patching, and GIS to aggregate those detections into a condition score for each road segment. Scored segments feed the maintenance system as prioritised work, so the pavement programme is built from measured defect density rather than complaints and inspection memory.
Scores are traceable: every segment score links back to the detections, the survey run, the model version and the reviewer who confirmed them.
What problem does this solve?
Pavement maintenance is usually decided on the weakest evidence in the asset portfolio. A road network of several thousand kilometres is inspected on a cycle that the team cannot actually complete, using visual assessment that varies by inspector and by how hot the afternoon was. Between formal surveys the real inputs are complaints, incident reports and the personal knowledge of two or three engineers. The result is a programme that is defensible in a meeting but not in an audit, and that reacts to failures rather than preventing them.
Roads deteriorate non-linearly, which is what makes weak data expensive. A surface caught at the point where sealing or a thin overlay still works costs a fraction of the same section after water has reached the base and the failure has spread. Missing the intervention window on a few dozen kilometres each year quietly converts preventive budget into reconstruction budget. Meanwhile potholes reported by the public arrive as text descriptions and approximate locations, are logged in a separate system, and cannot be related back to the condition of the segment they sit on.
Commercial pavement survey vehicles solve part of this and introduce their own constraints. They are expensive to hire, so surveys are annual at best, and the deliverable often arrives as a report or a proprietary dataset rather than as features in the authority's own geodatabase. The scores cannot be traced back to the underlying observations, they do not update between surveys, and they do not connect to the road furniture inventory, the work-order history or the complaint records that would put them in context. The authority ends up with a number per segment and no way to interrogate it.
How the solution works
The practical approach is to separate capture, detection, scoring and action, and to keep all four inside systems the authority owns. Capture can be as simple as a camera and GNSS receiver mounted in an existing inspection or operations vehicle, recording geolocated frames along the network on whatever frequency the fleet already drives; higher-specification setups add multiple cameras, an IMU for better positioning and LiDAR for profile and rutting. Every run is recorded with a survey ID, date, speed and lane, because a score without provenance cannot be defended.
Detection uses deep learning models trained on locally captured, locally labelled frames to find potholes, longitudinal and transverse cracking, alligator cracking, ravelling, patching, edge failure and, in the same pass, road furniture — signs, markings, lighting columns, guardrails and drainage covers. Detections are located along the road centreline using linear referencing, then aggregated per segment into a condition index on a 0–100 scale using defect density and severity weighting, following the structure of standard pavement condition indices such as ASTM D6433 while making the weighting explicit and configurable rather than hidden. Scores land as feature classes in the enterprise geodatabase, an engineer reviews the segments that changed most and a sample of the rest, and confirmed results drive the programme: prioritised treatment lists, budget scenarios, and work orders raised in IBM Maximo or SAP PM with the defect evidence attached. Swedish Technology builds these pipelines as custom development on top of ArcGIS, the client's existing maintenance system and locally trained models, and hands over the models, training data, scoring configuration and code.
- 1Input Define the network to survey against the road centreline and segmentation or linear referencing system, set the target survey frequency, and register the capture vehicles with their camera geometry and calibration.
- 2Capture Vehicle-mounted cameras record geolocated frames with GNSS and, where fitted, IMU and LiDAR; each run stores a survey ID, timestamp, speed and lane. Public and field-app pothole reports are captured into the same pipeline as a separate source.
- 3Processing Frames are quality-filtered (blur, occlusion, exposure), the detection model classifies and localises defects and road assets with confidence scores, and detections are projected from image space to ground coordinates and snapped to the centreline by linear referencing.
- 4Integration Detections are deduplicated across overlapping frames and repeat passes, aggregated per segment into defect density and severity, and combined into a configurable condition index; results are joined with traffic, surface age, treatment history and complaint records.
- 5Action Engineers review flagged segments and a QA sample in a map application, confirm or correct findings, and approved results generate a prioritised treatment list and work orders in the maintenance system with photographs and locations attached.
- 6Reporting Network condition, deterioration trend per segment, backlog and budget scenarios are published to dashboards; each score keeps links to its survey run, detections, model version and reviewer for audit.
Reference architecture
The pipeline has to work at network scale and stay auditable, so each stage writes its own persistent output rather than passing data through in memory.
| Layer | What it contains |
|---|---|
| Capture layer | Vehicle-mounted cameras with GNSS, optional IMU and LiDAR; a recording application that stores frames with position, heading, speed and survey ID; field applications for manual reports and verification photos. |
| Ingestion & positioning | Upload and quality filtering of runs, trajectory smoothing, image-to-ground projection using camera calibration, and snapping to the road centreline through the linear referencing system so every detection has a route and measure. |
| Detection layer | Deep learning models for pavement defects and road furniture, trained and run with ArcGIS deep learning tools or an equivalent PyTorch pipeline on GPU hardware; a model registry recording version, training data and measured accuracy per class. |
| Scoring & analytics | Segment aggregation, defect density and severity weighting, condition index calculation with a documented and configurable formula, deterioration trend against previous surveys, and treatment recommendation rules. |
| Review & workflow | Map-based review application for engineers (Experience Builder with a custom widget or ArcGIS Pro), status and audit fields on every detection and segment, sampled QA, and approval before work orders are created. |
| Integration & reporting | Work-order creation in IBM Maximo or SAP PM through the integration service, dashboards for network condition and KPIs, and export packages for committee and budget reporting in Arabic and English. |
Deployment options: Capture hardware is off-the-shelf and vehicle-mounted. Processing and storage run on-premise on GPU-equipped servers or in a UAE-region private cloud, sized around survey frequency and network length. Imagery stays inside the authority's environment; only derived features and scores need to reach dashboards and the maintenance system.
Key capabilities
Pothole and crack detection from vehicle cameras
Defects across the surveyed network are located and classified consistently instead of depending on which inspector drove the route.
custom developmentSegment condition index scoring
Every segment carries a 0–100 score with a visible calculation, so engineers can argue with the inputs rather than the number.
custom developmentRoad asset extraction from the same survey
Signs, markings, lighting columns, guardrails and drainage covers are inventoried in the same pass, without a separate survey contract.
custom developmentDeterioration trend and intervention timing
Segments approaching the point where preventive treatment stops being viable are flagged before they fail.
custom developmentComplaint and field-report correlation
Public pothole reports are matched to the segment and its measured condition, so repeated complaints reveal a structural problem.
custom developmentAutomatic work-order creation
Confirmed defects reach the maintenance system with location, class, severity and photograph attached, ready to dispatch.
custom developmentEngineer review workflow with audit trail
Nothing reaches the programme without confirmation, and every decision is traceable months later.
availableNetwork condition dashboards
Management sees network condition, backlog and budget scenarios from one current dataset instead of three spreadsheets.
availableIntegrations
The value is in what happens after scoring, so integration into the maintenance and reporting systems is designed at the same time as the detection pipeline, not afterwards.
| System | Integration point & data exchanged | Direction |
|---|---|---|
| IBM Maximo | Confirmed defects create work orders and service requests with location, class, severity and photographs; completed repairs return and close the loop on the segment record. → ArcGIS – IBM Maximo Integration | bi-directional |
| SAP PM / S/4HANA | Segments mapped to functional locations; notifications and maintenance orders created from confirmed findings and their status shown on the map (OData). → ArcGIS – SAP Integration (PM/EAM, S/4HANA) | bi-directional |
| ArcGIS Enterprise | Centreline and linear referencing, detection and segment feature classes, review applications, and dashboards published from the same authoritative layers. → ArcGIS Experience Builder Custom Widgets | bi-directional |
| Deep learning pipeline | Detection models trained, versioned and run through the GeoAI pipeline, with corrections from review feeding the next training round. → GeoAI Object Detection with ArcGIS | internal |
| Scheduled processing | ArcPy and notebook jobs orchestrate ingestion, detection, scoring and publication after each survey run, with run logs and alerting. → ArcGIS Python Toolbox & ArcPy Automation | internal |
| Complaint / call-centre system | Public reports geocoded and matched to segments so complaint volume can be compared with measured condition. → Primavera P6 – Project Management | inbound |
Industry use cases
Roads authority
Annual network-wide condition survey replaced by continuous capture from operations vehicles, with quarterly scoring updates and a treatment programme built from measured defect density.
Municipality
Neighbourhood road and footpath condition assessed alongside public complaints, so repeated pothole reports in one street are recognised as a structural failure rather than eight separate repairs.
Roads authority — asset inventory
Signs, markings and lighting columns extracted from the same imagery to build and maintain an inventory that was previously surveyed under a separate contract.
Airports, ports and industrial estates
Apron, yard and internal road surfaces surveyed on a schedule the site can run itself, feeding the facility maintenance system.
Facilities and community developers
Internal road networks in large developments assessed for handover, warranty claims and service-charge planning with evidence attached.
Contract supervision
Post-construction and post-repair verification, comparing surveys before and after works to evidence what was delivered.
UAE & GCC considerations
Road imagery covering an entire emirate is sensitive data, so these systems are built as on-premise or locally hosted deployments — capture, storage, inference and review all stay inside the authority's environment, with only derived scores and features shared to dashboards. Local conditions shape the models: high surface temperatures and heavy vehicle loading produce rutting and bleeding patterns that differ from European reference imagery, blown sand reduces contrast and can hide fine cracking, and rapid construction growth means the network geometry itself changes between surveys, so centreline and segmentation updates must be part of the process. Bilingual delivery is expected — Arabic and English in the review application, work-order descriptions and committee reporting — and public-facing pothole reporting is usually Arabic-first. Procurement in the UAE and wider GCC generally requires source code, trained models, training data and the scoring configuration to be delivered to the entity, which is exactly why an owned pipeline is preferred over a proprietary survey deliverable that cannot be re-run or interrogated.
Implementation approach
- 1Scoping (1–2 weeks) Agree the network extent, segmentation or linear referencing basis, the defect classes that matter to your treatment decisions, and how condition currently drives the programme.
- 2Data and baseline review Assess the centreline quality, existing condition records, treatment history and complaint data; a poor centreline is the most common hidden blocker and is fixed before detection work starts.
- 3Capture pilot (2–4 weeks) Mount cameras and GNSS on one or two vehicles, survey a representative 20–50 km sample across road types and conditions, and validate positioning accuracy against known points.
- 4Model development Label defects on locally captured frames, train and tune the detection model, and measure precision and recall per class on a held-out section — reported honestly, including the classes that do not work well.
- 5Scoring calibration Configure the condition index weighting and compare scored segments with your engineers' own assessment of the same sections until the ranking is credible to them.
- 6Review workflow and integration Build the engineer review application, the audit fields and the work-order integration into Maximo or SAP, including the return path for completed repairs.
- 7Production rollout Scale capture to the full network, schedule ingestion, detection, scoring and publication, and set the survey frequency per road class.
- 8Hand-over and retraining plan Deliver models, training data, scoring configuration, code and runbook; agree the retraining cadence for when cameras, vehicles or surface conditions change.
Security & deployment
Road imagery contains vehicles, number plates and people, so the pipeline includes automatic blurring of faces and plates at ingestion where the authority requires it, and access to raw frames is restricted to the processing service and named reviewers. All storage and inference run on-premise or in a UAE-region private cloud under the authority's own retention policy, with imagery lifecycle rules — typically keeping full frames for a defined window and detection crops for longer as evidence. Detections, scores and work orders carry a full audit chain: survey run, model version, reviewer and timestamp, which matters when a condition score supports a spending decision or a contractual claim. Integration with Maximo or SAP goes through a service layer holding credentials in a vault, and role-based access in the portal limits each engineer to their own area.
Limitations & prerequisites
- Camera-based detection assesses the visible surface only; structural capacity, base condition and layer thickness still require deflection testing, coring or ground-penetrating radar.
- Detection quality depends on capture conditions — night driving, heavy rain, blown sand, glare, wet surfaces and high speed all reduce reliability, so survey timing matters.
- Fine cracking is harder to detect than potholes and needs higher resolution and slower capture; expect different accuracy per defect class rather than one headline number.
- Positional accuracy is limited by GNSS quality; urban canyons and tunnels need IMU support or map-matching, and a poor road centreline will corrupt segment assignment regardless of detection quality.
- A condition index derived from surface imagery is not identical to a formally surveyed ASTM D6433 PCI, which includes measurements imagery cannot provide; it should be presented as a comparable, documented index and calibrated against engineer assessment.
- Training data must be captured locally with the same camera setup; models trained elsewhere or on a different mounting geometry do not transfer reliably.
- The pipeline produces prioritised evidence, not decisions — treatment selection still depends on engineering judgement, budget and coordination with other works.
- Storage and processing costs scale with network length and survey frequency; continuous capture across a large network needs planned storage sizing and retention rules.
Visual inspection vs survey vehicle contract vs owned camera pipeline
The choice is mainly about frequency, traceability and who owns the resulting data.
| Criterion | Visual / windscreen inspection | Contracted survey vehicle | Owned camera + GIS pipeline |
|---|---|---|---|
| Typical frequency | Ad hoc, complaint-driven | Annual or biennial | Continuous or quarterly |
| Consistency between assessments | Varies by inspector | High within a contract | High; model version recorded |
| Structural condition data | None | Often included (deflection, profile) | Surface only unless LiDAR or testing added |
| Traceability of scores | Low | Depends on deliverable | Full — detection, run and reviewer linked |
| Data ownership | Internal notes | Often vendor format | Authority's own geodatabase |
| Cost profile | Low direct, high consequential | High per campaign | Up-front build, low per repeat cycle |
| Road asset inventory included | No | Sometimes, priced separately | Yes, from the same imagery |
| Best for | Emergency response | Formal periodic network assessment | Continuous condition intelligence and programme building |
These are not mutually exclusive. Many authorities keep a periodic specialist survey for structural measurement and formal reporting, and add an owned camera pipeline for continuous surface condition, asset inventory and complaint correlation between those campaigns.
FAQ
Network length and survey frequency (which set storage and GPU processing), the number of defect and asset classes to detect, labelling effort for local training data, the review application, and integration into Maximo or SAP. Capture hardware is usually the smallest component; storage and integration are commonly underestimated.
A capture pilot and first model on a 20–50 km sample typically takes 6–10 weeks including labelling and calibration against your engineers' assessment. Network-wide rollout, review workflow and maintenance-system integration usually add 3–5 months depending on network size and system access.
For pothole, patching and coarse cracking detection, a well-mounted, calibrated camera with a good GNSS receiver on an existing vehicle is workable, and the low cost is what makes frequent capture possible. Fine cracking, rutting and profile measurement need higher-specification cameras or LiDAR.
It varies by class and capture conditions, and any figure quoted before a pilot on your roads is guesswork. Potholes and patching are the most reliable classes; fine cracking is the hardest. We report precision and recall per class on a held-out section of your own network, with failure examples, and set the confidence threshold according to whether missed defects or false positives cost you more.
It is a documented, configurable condition index built on defect density and severity, structured along the lines of ASTM D6433 but derived from imagery. It is not a substitute for a formal surveyed PCI where a standard requires one. We calibrate the index against your engineers' assessment so the ranking is credible and the formula stays visible.
Yes, and for road imagery in the GCC it normally must. Capture, storage, inference, review and reporting all run inside your environment on your own GPU hardware or in a locally hosted private cloud, with number-plate and face blurring applied at ingestion where required.
Through an integration service. Confirmed defects create work orders or notifications in IBM Maximo or SAP PM with location, class, severity and photograph attached, and completed repairs are read back so the segment record reflects the work done. Odoo and in-house systems are handled the same way where an API exists.
You do. Trained models, training data, scoring configuration, source code and documentation are delivered into your environment. Swedish Technology can maintain the pipeline and retrain the models under a support agreement, but you are never dependent on us to re-run a survey or explain a score.
How is your current pavement programme decided?
Give us a 20–50 km network sample and your current condition records. We run a scoped survey and detection pass and report measured detection performance and segment scores against your own inspection data.
Request a Road Inspection Proof of ConceptSources & evidence
- ASTM D6433 — Standard Practice for Roads and Parking Lots Pavement Condition Index Surveys — standard overview page
- Esri — Deep learning in ArcGIS Pro (Image Analyst)
- Esri — Linear referencing in ArcGIS Pro
- IBM — Maximo Manage integration and REST APIs documentation
- ISO 55000 — Asset management overview
Vendor and product names are trademarks of their respective owners; references are for technical context and do not imply partnership, certification or endorsement unless stated on the vendor's official pages.