Display Control Device Prioritizing Support Information for Multiple Targets

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face difficulties in operating multiple operation target objects simultaneously due to the challenge of prioritizing and managing support information effectively on display devices, such as head-mounted displays, when multiple objects are present in the user's field of view.

Innovation Solution

A display control device and system that utilize a processor to analyze captured images and prioritize support information for the operation target object with the highest priority by the user, based on factors like distance, direction, instrument usage, and operation state, to overlay relevant support information on the display, ensuring the user can focus on the most critical operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If support information is displayed for multiple operation target objects simultaneously, then users can access information about all objects, but it becomes difficult for users to operate the objects due to information overload and inability to prioritize

Engineering Contradiction:
Improvesupport informationVSAvoidoperation of operation target objects
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent segments the support information display by identifying and prioritizing one operation target object at a time. The processor determines which object has the highest priority based on user position, object position, or interaction state, and displays support information only for that selected object. This segmentation transforms the overwhelming multi-object information into manageable single-object information, resolving the contradiction between information completeness and operational ease.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts and highlights the most critical support information for the highest priority operation target object from among all detected objects. By using visual effects such as brightening, enlarging, or framing the selected object and its support information, the system separates the essential information from the background noise of other objects, enabling users to focus on what matters most without being overwhelmed by all available information.

Inventive Principle:
Principle #2Taking out (Extraction)

2Loss of information

If the system displays support information for all detected operation target objects, then comprehensive information is provided, but the user cannot efficiently prioritize which object to operate first

Engineering Contradiction:
Improvesupport informationVSAvoidtime to identify priority object
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent performs preliminary analysis of the captured image to automatically determine the highest priority operation target object before displaying support information. The processor evaluates multiple criteria such as user proximity, object importance, or interaction state in advance to pre-identify which object should receive priority treatment. This preliminary action eliminates the need for users to manually scan and prioritize objects, saving time while ensuring comprehensive information is not lost.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent incorporates feedback mechanisms where the system continuously monitors user interaction with the display and adjusts the priority identification accordingly. When users interact with objects or provide input, the system uses this feedback to refine its priority determination. This feedback loop ensures that the identified priority object aligns with actual user needs, reducing the time users would otherwise spend identifying the correct object while maintaining comprehensive information availability.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20240312072A1Display control device, display system, and non-transitory computer readable medium storing program
Publication Date: 2024.09.19 FUJIFILM BUSINESS INNOVATION CORP
  • US20240312072A1 patent drawing
  • US20240312072A1 patent drawing
  • US20240312072A1 patent drawing

AI summary

A display control device includes a processor configured to perform a control to display support information for supporting an operation of an operation target object included in a captured image that is obtained by imaging a real space by superimposing the support information on the real space or the captured image, in which the processor is configured to display the support information of one operation target object having a high priority of the operation by a user from among plural operation target objects included in the captured image.