Indoor Image Data Association with Map Positions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Inspecting and comparing large amounts of image data from indoor environments without GPS, such as in tunnels or buildings, is time-consuming and cumbersome due to the need for manual selection and comparison of image data captured at different times.

Innovation Solution

An information processing device that manages databases storing image-capturing information, including position and depth data, to estimate image-capturing positions and register new data, and displays this information on a map, enabling automated comparison and detection of changes over time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual selection and comparison of image data is performed, then inspection accuracy is maintained, but inspection time and operational complexity increase significantly

Engineering Contradiction:
Improveinspection accuracyVSAvoidinspection time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system enables self-service by automatically performing image data selection and comparison without requiring manual inspector intervention. The image processing unit autonomously identifies corresponding images across different time periods and executes comparison operations, allowing the inspection system to serve itself rather than relying on human operators for each comparison task.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical manual process of selecting and comparing images with an automated image processing system. The system uses computer vision algorithms and image recognition technology to automatically identify corresponding inspection targets across different time periods and perform comparative analysis, substituting the manual mechanical process with an automated computational system.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If manual input of image-capturing position is required for each image data, then positioning accuracy is maintained, but operational efficiency decreases

Engineering Contradiction:
Improvepositioning accuracyVSAvoidoperational efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system extracts positioning information automatically from the image data itself or associated metadata without requiring manual input from inspectors. The image processing unit identifies capturing positions through automated analysis of image content, camera metadata, or GPS coordinates, enabling the system to self-determine positioning information rather than relying on manual entry.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the manual mechanical process of inputting positioning information with an automated information extraction system. The system uses optical character recognition, metadata parsing, or coordinate extraction algorithms to automatically obtain capturing position data from image files or associated data structures, substituting manual typing or input operations with automated computational processes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If automated image data association is implemented, then operational efficiency improves, but system complexity increases

Engineering Contradiction:
Improveoperational efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The image processing unit performs multiple functions within a single integrated system: it extracts positioning information from various sources (metadata, image content, external databases), identifies corresponding inspection targets using pattern recognition, associates images with their locations on map data, and performs comparison operations. This multi-functional approach consolidates what could be separate complex systems into one unified unit, improving efficiency while managing complexity through integration.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system introduces map data as an intermediary layer that connects image data with positioning information. Instead of directly complexly linking images to positions, the map data serves as a mediator that standardizes the relationship between spatial location and image content, simplifying the association process and providing a structured framework for the automated system to operate within.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12125238B2Information processing device, information processing method, and computer program product
Publication Date: 2024.10.22 KK TOSHIBA
  • US12125238B2 patent drawing
  • US12125238B2 patent drawing
  • US12125238B2 patent drawing

AI summary

According to an embodiment, an information processing device is configured to: estimate, based on target image data, target position data representing an image-capturing position at which the target image data is captured; estimate, based on the target image data, target depth data representing a distance to an object from the image-capturing position; register new image-capturing information including the target image data, the target position data, and the target depth data; display, on a display device, map data representing a map of an environment in which the image data is captured; and display at least one of image data and depth data included in designated image-capturing information that is designated from among a plurality of pieces of image-capturing information, in association with a pixel position in the map data, the pixel position corresponding to position data included in the designated image-capturing information.