Superimposing Situation Expressions onto Captured Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies fail to sufficiently convey situations outside the capture range when presenting captured images, as they either rely on auditory or visual information within the capture range, limiting the ability to convey broader environmental contexts.

Innovation Solution

An information presentation system that includes a camera, sensor, and an information presentation apparatus capable of estimating signal source positions, extracting situation expressions outside the capture range, determining display methods based on positional relations, and superimposing these expressions onto captured images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If only captured image is used to convey atmosphere, then the technology is simple, but the ability to convey situation outside capture range is insufficient

Engineering Contradiction:
Improvesituation information outside capture rangeVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system segments information sources into multiple independent components: camera for visual capture, sensors for environmental data, and separate processing modules for each. This allows comprehensive situation awareness without requiring a single complex device, as each component performs a specialized function.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system merges multiple information sources (captured images, sensor readings, situation expressions) into a unified presentation. By combining visual data with environmental sensor data and processed situation expressions, the system overcomes the limitation of capture range while maintaining manageable complexity through integrated processing.

Inventive Principle:
Principle #5Merging (Combining)

2Loss of information

If sensor data is integrated to convey outside capture range, then situation awareness is improved, but processing complexity increases

Engineering Contradiction:
Improveenvironmental context informationVSAvoidsignal processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The situation expression extraction unit performs preliminary processing of sensor data before final presentation. By pre-processing sensor signals to extract meaningful situation expressions and pre-determining display methods based on positional relationships, the system reduces the complexity of real-time comprehensive processing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The situation expression acts as an intermediary between raw sensor data and final presentation. Instead of directly processing and displaying all sensor data, the system extracts condensed situation expressions that mediate between complex sensor inputs and simplified visual output, reducing processing complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of information

If situation expression is superimposed on captured image, then contextual understanding is enhanced, but information clarity may be reduced

Engineering Contradiction:
Improvesituational contextVSAvoidinformation clarity
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The display method determination unit applies local quality by selectively positioning situation expressions at optimal locations on the captured image. By determining display positions based on positional relationships between signal sources and capture range, and by adapting display methods to different regions, the system enhances contextual understanding while maintaining information clarity in specific areas.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10559108B2Superimposition of situation expression onto captured image
Publication Date: 2020.02.11 NEC CORP
  • US10559108B2 patent drawing
  • US10559108B2 patent drawing
  • US10559108B2 patent drawing

AI summary

A signal from a sensor and an image signal are received, and a position of a signal source is estimated based on the signal from the sensor. Information on a situation expression is extracted based on the signal from the sensor. The situation expression expresses a situation outside a capture range related to the image signal. A display position of the situation expression on a captured image by the image signal is determined using a positional relation between the position of the signal source and the capture range. A size of the situation expression on the captured image is determined depending on a distance between a position of the signal source and a capturing position where the image signal is captured. The situation expression with the determined size is superimposed onto the captured image in accordance with the display position; the captured image superimposed with the situation expression is output.