AR Device Guidance Using Light Patterns on Production Lines

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing information presentation systems for production lines do not effectively associate device information with the device's location within the user's view field, making it difficult for workers to identify and operate on target devices, especially when abnormalities are detected.

Innovation Solution

An information presentation system comprising a controller, a terminal with a camera and display, and a server that uses light emission patterns to guide the user to the device, where the terminal displays information associated with the device's location based on captured images, and the server processes images to detect the light emission pattern's position, allowing for augmented reality-based operation support.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If device information is displayed separately from the device location, then information can be presented to the user, but the user cannot easily identify which device the information corresponds to

Engineering Contradiction:
Improveassociation between device information and locationVSAvoidease of identifying target device
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent merges device information display with the physical device location by using the camera to capture the device image and overlaying the information on the corresponding position in the captured image. This combines spatial information (device location) with informational content (device details) into a single integrated display, allowing users to immediately associate information with its corresponding device without confusion.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The captured image from the camera serves as an intermediary between the physical device and the information display. By detecting the light emission pattern in the captured image and using it as a reference, the system mediates the connection between the real-world device location and the digital information overlay, ensuring accurate spatial correspondence.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If the system requires manual device identification, then device information can be retrieved, but the process becomes time-consuming and error-prone

Engineering Contradiction:
Improvespeed of locating and operating on deviceVSAvoidtime to identify target device
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary action by having devices emit light patterns in advance that encode their identity information. This pre-prepared visual signal allows the terminal to immediately identify the target device through image recognition without requiring manual searching or input, significantly reducing the time and effort needed for device location and operation.

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If device information is displayed without spatial context, then information can be shown, but the user must mentally map information to physical location

Engineering Contradiction:
Improvespatial context of device informationVSAvoidcomplexity of information processing
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical/cognitive process of mentally mapping information to physical location with an automated optical recognition system. The camera captures the light emission pattern, the image processing unit automatically detects and identifies the device based on the pattern, and the system automatically overlays information at the correct position, eliminating the need for manual spatial mapping by the user.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12026417B2Information presentation system, terminal device, and recording medium
Publication Date: 2024.07.02 OMRON CORP
  • US12026417B2 patent drawing
  • US12026417B2 patent drawing
  • US12026417B2 patent drawing

AI summary

An information presentation system includes a controller that controls a device included in a production line, a terminal including a display and a camera that captures an image of the device, and a server that communicates with the controller and the terminal. The camera has an image capture range including a view field of the display. The controller transmits a light emission command to the device, the light emission command causing a light emitter included in the device to emit light in a predetermined light emission pattern. The terminal displays information regarding the device in association with a display position in a display area of the display, the display position corresponding to a position of a partial image representing the light emission pattern in a captured image of the camera.