Road Surface Condition Assessment Using IoT Deep Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current road condition monitoring systems are labor-intensive, lack scalability, and require extensive data collection, with existing methods being complex and limited in real-world applications, and they do not efficiently classify road quality using dynamic images from videos.

Innovation Solution

A system utilizing wireless mobile devices mounted on vehicles to record and classify road surface conditions in real-time using customized deep learning models, transmitting classified images to a remote server for display on an interactive map, employing pre-trained models like VGG16 and MobileNetV2 for accurate classification.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual monitoring of road conditions is used, then detailed inspection can be performed, but it is labor and time intensive

Engineering Contradiction:
Improveroad condition assessment accuracyVSAvoidmonitoring time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces manual mechanical inspection with an automated computer vision system using deep learning models. The system captures road surface images via camera and automatically classifies road conditions (good, medium, bad, unpaved) using pre-trained convolutional neural networks, eliminating the need for manual monitoring while maintaining high assessment accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service monitoring where the road condition assessment is performed automatically without human intervention. The deep learning model processes images and generates classifications autonomously, and the results are displayed on an interactive map, allowing the system to serve itself in completing the entire monitoring workflow.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If conventional road monitoring systems use special vehicle-mounted cameras with motion sensors, then accurate data can be collected, but the system lacks scalability

Engineering Contradiction:
Improveroad condition data accuracyVSAvoidsystem scalability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent employs a universal deep learning framework that can process images from various camera sources (smartphone cameras, vehicle-mounted cameras, satellite images) and classify multiple road conditions (good, medium, bad, unpaved). The pre-trained models are adaptable to different data sources and can be deployed across multiple vehicles and locations, enabling scalable implementation without requiring specialized hardware for each deployment.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses image-based data collection where digital copies of road surfaces are captured and analyzed. Instead of requiring physical presence of inspectors or specialized sensors at each location, the system creates and processes digital image copies, which can be collected from multiple sources and analyzed centrally, greatly enhancing scalability.

Inventive Principle:
Principle #26Copying

3Ease of operation

If image based models are used to assess road quality, then the system is accessible and practical, but existing systems are complex resulting in fewer real-world implementations

Engineering Contradiction:
Improvesystem accessibilityVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent applies transfer learning using pre-trained convolutional neural networks (such as VGG16, MobileNetV2) that have been previously trained on large image datasets. This preliminary training allows the models to be directly applied to road condition classification without requiring extensive custom training, simplifying the deployment process and reducing the complexity of implementing image-based assessment systems in real-world scenarios.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses an interactive map as an intermediary to present complex classification results in a simple, visual format. Instead of requiring users to interpret complex model outputs or raw data, the system translates classification results into intuitive map visualizations, making the system easier to operate and understand while maintaining the power of sophisticated image analysis in the background.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11823368B1Automated road surface condition quality assessment using smart (IoT) devices
Publication Date: 2023.11.21 PRINCE MOHAMMAD BIN FAHD UNIV
  • US11823368B1 patent drawing
  • US11823368B1 patent drawing
  • US11823368B1 patent drawing

AI summary

A system and methods for assessing road surface quality includes a wireless mobile device having a camera, a location receiver, and a road surface classifying computer application and is configured to be mounted on a vehicle. The system has a remote server having a road surface classifying web application, a database, and an interactive map connected to the web application. The mobile device actuates the camera to record videos, extract images from the videos, process the images, classify the images into road conditions, record a location of the images, generate a data packet including an identification of the mobile device and a time stamp of the data packet, and transmit the data packet to the remote server. The remote server stores the data packet in the database. The web application superimposes the time stamp of the data packet, the location, the road conditions, and the images on the interactive map.