Road Facility Image Recognition for Early Abnormality Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies face challenges in early detection of abnormalities in road facilities, such as faded or missing white lines, which affects the accuracy of automated driving and timely repair of road conditions.

Innovation Solution

A road abnormality detection apparatus and method that uses image recognition processing to identify road facilities and detect abnormalities by comparing captured road images with pre-existing correctness information, accumulating facility position information, and notifying road administrators for timely repair.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If image recognition processing is performed on road images to detect road facility abnormalities, then early detection capability is improved, but processing time and computational resources increase

Engineering Contradiction:
Improveabnormality detection accuracyVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by collecting road images from multiple vehicles and storing them for later analysis. Correctness information about road facilities is prepared in advance and stored in a database, allowing for efficient comparison and detection when needed, rather than processing everything in real-time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

A server acts as an intermediary between vehicles and the abnormality detection system. The server receives road images from vehicles, performs image recognition processing, compares detected road facilities with correctness information, and manages the accumulation of facility position information. This distributes computational load and improves overall system efficiency.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If road images are collected from multiple vehicles to improve detection reliability, then measurement precision is improved, but data quantity and processing complexity increase

Engineering Contradiction:
Improveabnormality detection precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system merges road images from multiple vehicles and combines facility position information from different sources. By accumulating detection results from multiple vehicles passing through the same road sections, the system improves detection reliability while managing complexity through centralized server coordination.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The server performs multiple functions: receiving road images from vehicles, performing image recognition, comparing with correctness information, accumulating facility position information, and determining abnormalities. This multi-functional approach consolidates complexity into a single coordinating system rather than requiring complex distributed processing.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If facility position information is accumulated in memory for analysis, then detection reliability is improved, but memory usage and data management complexity increase

Engineering Contradiction:
Improvedetection reliabilityVSAvoiddata volume
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The system extracts only the essential facility position information from road images and stores it in a structured format in the database. Rather than storing complete images and all processing data, only the critical detection results (facility positions and detected abnormalities) are accumulated, reducing data volume while maintaining detection reliability.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11827228B2Road abnormality detection apparatus, road abnormality detection method and road abnormality detection program
Publication Date: 2023.11.28 TOYOTA JIDOSHA KK
  • US11827228B2 patent drawing
  • US11827228B2 patent drawing
  • US11827228B2 patent drawing

AI summary

A road abnormality detection apparatus includes: a memory; and a processor having hardware, wherein the processor is configured to: receive, from a traveling vehicle, a road image indicating an image of a surface of a road or a periphery of the road and image capturing position information indicating a position where the road image is captured; recognize a road facility included in the road image and a position of the road facility based on the road image and the image capturing position information; determine whether or not abnormality exists in the road facility by comparing the road facility included in the road image and correctness information that is prepared in advance; and accumulate, in the memory, facility position information indicating the position of the road facility that the abnormality exists in when it is determined that the abnormality exists in the road facility.