Context-Aware Content Overlay for Portable Terminals

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face difficulties in effectively utilizing automatically installed content on portable information terminals, as they lack understanding of the purpose or service provided by the content, due to external triggers such as server instructions.

Innovation Solution

A control method executed by a processor in an information processing device that receives content, extracts keywords, associates them with target object information, calculates display positions based on camera images, and overlays content images onto the screen, ensuring effective use by linking applications with relevant objects in the user's context.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If content is automatically installed by server instruction, then installation efficiency is improved, but user understanding of content purpose deteriorates

Engineering Contradiction:
Improveinstallation efficiencyVSAvoiduser understanding of content purpose
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent introduces an image generation unit that creates visual representations showing the relationship between installed applications and target objects. This intermediary visual information mediates between the automatic installation process and user understanding, allowing users to see how applications relate to specific objects without manual installation

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent generates image data that copies or represents the relationship between applications and target objects in a visual format. Instead of directly presenting abstract application information, the system creates visual copies showing contextual relationships, making automatically installed content comprehensible

Inventive Principle:
Principle #26Copying

2Ease of operation

If applications are displayed without contextual association, then display simplicity is improved, but application relevance to user context deteriorates

Engineering Contradiction:
Improvedisplay simplicityVSAvoidapplication relevance to user context
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent merges application information with target object information by generating images that display both together. The image generation unit combines data about installed applications with data about target objects to create unified visual representations that show their relationships

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent applies local quality by providing different types of information association for different applications based on their relationship with target objects. Each application image is selectively enhanced with contextual information about specific objects it relates to, rather than uniformly treating all applications

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9997140B2Control method, information processing device and recording medium
Publication Date: 2018.06.12 FUJITSU LTD
  • US9997140B2 patent drawing
  • US9997140B2 patent drawing
  • US9997140B2 patent drawing

AI summary

A control method executed by a processor included in an information processing device includes receiving a content; extracting one or more keywords of the content from the content; acquiring information in which an identifier identifying a target object, image information on the target object, and one or more keywords of the target object are associated; calculating a position of the target object on a camera image, based on the image information, when the target object is included in the camera image; calculating a display position of an image relating to the content, based on the position of the target object, when the one or more keywords of the content and the one or more keywords of the target object have a correspondence relationship; and displaying the image relating to the content on a screen, in a state of being superimposed onto the camera image, at the display position.