Head Mounted Display Mark Recognition for Picking Operations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head-mounted display devices face challenges in efficiently recognizing and processing visual information, particularly when shelf numbers are small and distant, requiring prolonged recognition of product names or pre-registered codes, and are not user-friendly in picking operations or route guidance.

Innovation Solution

A head-mounted display device with an image display unit, imaging unit, and control unit that allows users to recognize specific virtual images based on the type, shape, size, and positional relationship of mark images, enabling efficient operations by displaying relevant information at optimal distances and reducing processing load.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If the shelf numbers are made smaller to fit more information on shelves, then the quantity of information displayed increases, but the user cannot visually recognize the shelf numbers when apart from them

Engineering Contradiction:
Improvequantity of informationVSAvoidvisual recognition capability
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

The patent introduces a camera as an intermediary device to capture images of shelf numbers and products. The captured images are then processed by an image processing unit to generate virtual images that are displayed to the user through the head-mounted display. This intermediary system enables the user to recognize shelf numbers and product information even when they are small or at a distance, resolving the contradiction between displaying more information and maintaining visual recognition capability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If the user must visually recognize product names for a predetermined period to see related information, then the system can filter and display relevant information, but the time required to visually recognize images increases

Engineering Contradiction:
Improveinformation filtering efficiencyVSAvoidtime to visually recognize image
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent implements preliminary action by continuously capturing images of the environment using the camera and pre-processing these images in real-time. The image processing unit is ready to immediately generate and display virtual images when the user looks at a product, eliminating the need for prolonged visual recognition or waiting periods. This allows the system to filter and display relevant information efficiently without increasing the user's time investment.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If pre-registered codes are required to display images based on codes, then the system can accurately identify specific products, but the ease of operation decreases due to registration requirements

Engineering Contradiction:
Improveproduct identification accuracyVSAvoiduser-friendliness
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent applies self-service by enabling the system to automatically identify products through image recognition without requiring users to manually register or input codes. The image processing unit automatically extracts product information from captured images, compares it with stored data, and displays relevant virtual images. This eliminates the need for users to learn or remember registration procedures, significantly improving ease of operation while maintaining accurate product identification.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10445579B2Head mounted display device, image display system, and method of controlling head mounted display device
Publication Date: 2019.10.15 SEIKO EPSON CORP
  • US10445579B2 patent drawing
  • US10445579B2 patent drawing
  • US10445579B2 patent drawing

AI summary

A head mounted display device includes an image display unit that allows a user to visually recognize image light based on image data as a virtual image and allows the user to visually recognize an outside scenery when worn on a head of the user, an imaging unit that images the outside scenery, and a control unit that, when an imaged image contains a mark image as an image of a specific mark, allows the user to visually recognize the specific virtual image associated with a combination of a type of the mark image and a shape of the mark image using the image display unit.