UAV Image Projection Control for Deformed Building Surfaces

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Unmanned aerial vehicles (UAVs) used for infrastructure deterioration diagnosis face challenges with GPS signal accuracy, leading to positioning errors and reduced guidance accuracy due to signal intensity issues and deformation of image projection planes caused by building defects.

Innovation Solution

An unmanned flying device control system that includes an image projection unit, a control unit, and a deformation determination unit, which projects a predetermined shape onto a building, captures the image, and adjusts the projection to account for deformation, enabling precise guidance of the UAV to the target position.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If GPS signal-based positioning is used to guide the UAV, then the system configuration remains simple, but positioning accuracy deteriorates with errors of several meters

Engineering Contradiction:
Improvepositioning accuracyVSAvoidsystem configuration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an image projection plane as an intermediary reference system between the GPS positioning system and the UAV control system. By projecting a known pattern onto the building surface and detecting its deformation, the system creates a local reference frame that mediates between coarse GPS positioning and precise UAV guidance, enabling accurate position recognition without requiring complex additional positioning hardware

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a visual copy of the building's surface features through image projection. By projecting a predetermined pattern onto the building surface and capturing its deformed state, the system generates a reference image that copies the local geometric characteristics. This copied reference is then used to recognize and correct positioning errors, improving accuracy without adding complex positioning infrastructure

Inventive Principle:
Principle #26Copying

2Measurement precision

If image projection is used for UAV guidance control, then guidance accuracy improves, but the projection image becomes distorted when the projection plane is deformed due to building defects

Engineering Contradiction:
Improveguidance accuracyVSAvoidprojection image shape
Core Design Contradiction:
Measurement precisionVSShape

Solution Approach 1:

The patent implements a feedback mechanism where the captured image of the projected pattern is analyzed to detect deformations caused by building surface irregularities. This deformation information is fed back to the control system, which then adjusts the projection parameters or compensates for the distortions in real-time, maintaining guidance accuracy despite surface deformations

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent dynamically adjusts projection parameters based on the detected surface geometry. By changing projection angle, distance, or pattern characteristics in response to measured surface deformations, the system maintains the integrity of the reference image and ensures accurate guidance control even on deformed surfaces

Inventive Principle:
Principle #35Parameter changes

3Reliability

If the UAV approaches the building for infrastructure deterioration diagnosis, then diagnostic capability improves, but positioning errors increase due to GPS signal intensity variations

Engineering Contradiction:
Improvediagnostic capabilityVSAvoidpositioning accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent transitions from relying solely on three-dimensional GPS spatial positioning to incorporating a two-dimensional image-based reference system on the building surface. This additional dimensional reference plane provides a local coordinate system that is independent of GPS signal strength, enabling accurate positioning and guidance even when the UAV approaches the building and GPS signals become weak or unreliable

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11009894B2Unmanned flying device control system, unmanned flying device control method, and inspection device
Publication Date: 2021.05.18 NEC CORP
  • US11009894B2 patent drawing
  • US11009894B2 patent drawing
  • US11009894B2 patent drawing

AI summary

An image projection unit projects, onto an object, an image that contains identification information for identifying the contents of control on an unmanned flying device. A control unit controls operation of the unmanned flying device, in accordance with the identification information indicated by the image captured by the imaging device mounted on the unmanned flying device. A deformation determination unit determines deformation of the projection plane of the object. The image projection unit projects an image showing a predetermined shape onto the object, and, in accordance with a result of the deformation determination, controls projection of the image for controlling operation of the unmanned flying device. The deformation determination unit determines deformation of the projection plane, in accordance with the shape of the captured image generated by capturing the projected image showing the predetermined shape.