Operation Support System Using Real-Time Image Projection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional operation supporting systems face errors due to operators mistaking or forgetting operation descriptions displayed on monitors, especially when the product's installation position changes, and existing solutions fail to adapt to varying installation positions.
Innovation Solution
An operation supporting device that registers feature images of a product's parts and their positional relationships, determines the product's position in real-time using image capture, and projects operation support information directly onto the product using a projector, ensuring accurate alignment regardless of the product's position.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If operation descriptions are displayed on a monitor at a location different from the product, then the operator can view the descriptions, but the operator may mistakenly recognize or forget the descriptions, leading to operation errors
Solution Approach 1:
The patent introduces a camera as an intermediary device to capture images of the product, and uses image processing to overlay operation descriptions directly onto the product view. This intermediary system bridges the gap between the operator and the product, ensuring accurate information delivery without relying on separate monitor displays that can be mistaken or forgotten.
Solution Approach 2:
The patent creates a visual copy of the product through camera imaging, and then overlays operation descriptions onto this copy. This allows the operator to see the descriptions in the context of the actual product, reducing the risk of mistaken recognition or forgetting compared to viewing separate monitor displays.
2Measurement precision
If a device irradiates a laser beam directly to a product to show installation positions, then the installation positions are clearly indicated, but the device cannot respond when the installation position of the product changes
Solution Approach 1:
The patent employs dynamic image processing that continuously captures the product's current position and recalculates the overlay coordinates accordingly. When the product position changes, the system dynamically adjusts the projection position of operation descriptions to maintain accurate alignment, unlike static laser beam systems.
Solution Approach 2:
The patent changes the coordinate parameters of the operation descriptions based on the detected product position. By continuously updating the position parameters according to the product's actual location, the system maintains accurate indication even when the product is repositioned, providing both precision and adaptability.
3Reliability
If operation support information is projected directly onto the product, then operation errors are reduced, but the system complexity increases due to image processing requirements
Solution Approach 1:
The patent replaces complex mechanical positioning systems with image processing and coordinate transformation algorithms. Instead of using mechanical devices to physically position displays, the system uses software-based image overlay technology that calculates and adjusts positions digitally, reducing mechanical complexity while maintaining or improving accuracy.
Data Source
Figure 1~2
Figure 3
Figure 4~5
AI summary
Disclosed is an operation supporting including a feature image registering unit 31 for registering feature images of three or more parts of a product, with which said product is recognizable, together with a positional relationship among the parts, a support information registering unit 32 for registering a display position of operation support information for the product, an image acquiring unit 33 for acquiring an image captured by an image capturing device 1, a position determining unit 34 for comparing the captured image and the feature images, and determining the position of the product in the captured image from the positional relationship among the parts recognized in the captured image, a projection position calculating unit 35 for calculating a projection position of the operation support information from both the position of the product which is determined by the position determining unit 34 and the display position of the operation support information which is registered in the support information registering unit 32, a projection image generating unit 36 for generating a projection image in which the operation support information is disposed at the projection position calculated by the projection position calculating unit 35, and a projection image outputting unit 37 for outputting the projection image generated by the projection image generating unit 36 to a projector 2.