Communication Terminal Object Data Overlay via Coordinate Metadata

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods require broadcasting stations to pre-insert object data into video data, leading to increased data transmission and burden, and cannot provide real-time display of desired object information, resulting in unnecessary information transmission and practical limitations.

Innovation Solution

A communication terminal and search server system that recognizes user indications on a video and transmits coordinate and timing information to a search server, which then retrieves and transmits relevant object data without pre-inserting information into the video data, allowing for real-time display of desired object information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If object data is pre-inserted into video data by broadcasting stations, then users can obtain object information, but data transmission amount increases and broadcasting burden increases

Engineering Contradiction:
Improveobject information availabilityVSAvoiddata transmission amount
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The patent extracts only the necessary object information (coordinates and timing) from the video data and transmits it separately as metadata, rather than embedding complete object data into the video stream. This allows users to obtain object information while minimizing the amount of data transmitted.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces a metadata file as an intermediary that contains object information in a structured format (coordinates, timing, object identifiers). This mediator enables efficient information transmission without requiring direct embedding of object data into the video stream, reducing overall data transmission requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If area information is preset for all objects in all programs, then object data can be displayed on indication, but the burden of setting area information increases greatly

Engineering Contradiction:
Improveobject data display capabilityVSAvoidarea information setting burden
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system enables automatic generation of metadata files containing area information through image recognition technology. Instead of requiring manual presetting of area information for all objects, the system automatically detects and extracts object coordinates and timing from video frames, significantly reducing the operational burden while maintaining display capability.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the manual mechanical process of setting area information with automated image recognition and processing systems. Computer vision algorithms automatically identify objects, determine their coordinates, and generate metadata files, eliminating the need for manual area information configuration.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Loss of information

If object data is inserted into video data in advance, then object information can be provided, but real-time video broadcasting cannot be supported

Engineering Contradiction:
Improveobject information provisionVSAvoidreal-time broadcasting support
Core Design Contradiction:
Loss of informationVSAdaptability or versatility

Solution Approach 1:

The patent performs preliminary processing of video content to extract object information and generate metadata files before broadcasting. These metadata files are prepared in advance but can be dynamically associated with live video streams, enabling both pre-recorded and real-time broadcasting to support object information display without requiring real-time data insertion during transmission.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP2306717B1Communication terminal, search server, and communication system
Publication Date: 2019.10.09 KYOCERA CORP
  • EP2306717B1 patent drawingFigure 1
  • EP2306717B1 patent drawingFigure 2
  • EP2306717B1 patent drawingFigure 3

AI summary

According to conventional arts, object data must be included in video data in advance. However, including the object data in the video data causes a problem to increase a data amount to be transmitted from a broadcasting station (transmission terminal) to a reception terminal. In addition, according to the conventional arts, since there is no opportunity to previously insert the object data in video data of real-time broadcasting such as live broadcasting, the user cannot display detailed information of a desired object. Provided is a technique to display detailed information of a desired object in video without increasing an amount of data in distribution of the video data when a user indicates the object in the video through a touch panel or the like, by transmitting indicated coordinate information and indication timing information corresponding to such indication to a search server, obtaining corresponding object data from the search server and displaying the object data on the display.