Wide-Area Drone Imaging With Frame-Level Altitude Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for capturing wide areas using radio aircrafts are unable to perform flight control based on altitude at the time of image capturing.

Innovation Solution

An information processing apparatus comprising a wide area image generator, an image capturing altitude acquirer, and an image capturing altitude output unit that extracts and combines video frame images from a flying body's video, acquires flight altitude at the time of image capturing, and outputs altitude differences for each video frame image, enabling flight control based on past altitudes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If wide area images are captured by combining multiple video frame images from a moving flying body, then the coverage area is improved, but the ability to perform flight control based on past altitude data is lost

Engineering Contradiction:
Improvecoverage areaVSAvoidaltitude information
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

The patent segments the video data by extracting individual video frame images from the continuous video stream captured by the flying body. Each frame is processed separately to extract altitude information, allowing the system to maintain altitude data for each specific frame while combining multiple frames to create the wide area image.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary processing step that extracts altitude information from the video data before combining the frames. This intermediary process preserves the altitude information that would otherwise be lost in the frame combination process, enabling later flight control decisions based on historical altitude data.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Area of stationary object

If multiple video frame images are extracted and combined to generate wide area images, then the image coverage is improved, but the flight control capability based on historical altitude data deteriorates

Engineering Contradiction:
Improveimage coverageVSAvoidflight control capability
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The patent performs preliminary extraction of altitude information from each video frame before the frames are combined to create the wide area image. This preliminary action ensures that altitude data is preserved and associated with each frame, enabling subsequent flight control operations to access historical altitude information when needed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a feedback mechanism where extracted altitude information from past frames is made available for flight control decisions. The system uses this historical altitude data to inform current and future flight control actions, creating a closed-loop control system that leverages past imaging data for present operational decisions.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11604478B2Information processing apparatus, information processing method, and information processing program
Publication Date: 2023.03.14 NEC CORP
  • US11604478B2 patent drawing
  • US11604478B2 patent drawing
  • US11604478B2 patent drawing

AI summary

Concerning a partial area image that constitutes a wide area image, to control a flying body in accordance with a flight altitude at a past point of time of image capturing, an information processing apparatus includes a wide area image generator that extracts, from a flying body video obtained when a flying body captures a ground area spreading below while moving, a plurality of video frame images and combines the video frame images, thereby generating a captured image in a wide area, an image capturing altitude acquirer that acquires a flight altitude at a point of time of image capturing by the flying body for each of the plurality of video frame images, and an image capturing altitude output unit that outputs a difference of the flight altitude for each video frame image.