Virtual Operation Screen Avatars for Workload Visualization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional virtual reality technologies fail to effectively convey nonverbal information such as the operator's monitored screen and workload status, leading to difficulties in grasping the operator's activities and requiring cumbersome operations in virtual spaces.

Innovation Solution

A display system that integrates real-time operation screen information with a virtual space, displaying avatars at positions corresponding to the operation screens, allowing operators to visualize their own and others' workload statuses through avatars and operation screens.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If conventional virtual reality technology is used to simulate real space, then visual recognition of virtual operators is improved, but the ability to grasp nonverbal information such as monitoring status and workload is deteriorated

Engineering Contradiction:
Improvevisual recognitionVSAvoidnonverbal information
Core Design Contradiction:
Illumination intensityVSLoss of information

Solution Approach 1:

The patent applies color changes by displaying avatars with different colors or color intensities that represent different workload statuses or monitoring states. This allows nonverbal information to be visually encoded and transmitted without requiring additional complex interfaces, thus maintaining good visual recognition while recovering lost nonverbal information.

Inventive Principle:
Principle #32Color changes

Solution Approach 2:

The patent adds a new dimension of information display by superimposing virtual avatars and their status indicators over the existing virtual space. This dimensional layering allows workload and monitoring status to be visualized simultaneously with the spatial environment, preserving visual recognition quality while adding previously lost nonverbal information.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If avatar movement in virtual space is required to operate equipment, then virtual space immersion is improved, but operational complexity and time consumption are deteriorated

Engineering Contradiction:
Improvevirtual space immersionVSAvoidoperational complexity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent applies preliminary action by pre-positioning avatars at locations corresponding to operation screens before actual operations are needed. This allows operators to immediately interact with equipment without requiring time-consuming avatar movement, thus maintaining virtual space immersion while significantly reducing operational complexity and time consumption.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses the avatar as an intermediary that automatically represents the operator's presence and actions. Instead of requiring direct avatar manipulation for every action, the system mediates by automatically positioning and configuring avatars based on operator needs, reducing the complexity of direct virtual space interactions while preserving immersion.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12354188B2Display system, virtual space providing apparatus, and display method
Publication Date: 2025.07.08 MITSUBISHI ELECTRIC CORP
  • US12354188B2 patent drawing
  • US12354188B2 patent drawing
  • US12354188B2 patent drawing

AI summary

A display system includes: an operation screen information acquiring unit to acquire operation screen information indicating an operation screen for receiving an operation by an operator; an operation screen providing unit to provide the operation screen indicated by the operation screen information to the operator by displaying the operation screen on a display device; and a virtual space providing unit to provide a virtual space including a virtual operation screen simulating the operation screen indicated by the operation screen information to the operator by displaying the virtual space on a display device. When the operation screen information acquiring unit acquires the operation screen information indicating the operation screen being browsed or operated by the operator, the virtual space providing unit displays an avatar corresponding to the operator at a position in the virtual space corresponding to the virtual operation screen simulating the operation screen.