Operator-View Direction Overlay for Movable Machine Operation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing operation guidance systems fail to intelligibly provide the operating direction of a movable device to an operator regardless of their position, as the direction varies with the operator's location relative to the device, leading to confusion and potential operational errors.
Innovation Solution
An operation guidance system that includes an operation device for receiving instructions, a photographing device to capture the operator's view, an estimation section to determine the positional relationship between the operator and the device, an image generation section to create an operating direction image based on this relationship, and a display device to combine this image with the device's captured image, ensuring the operator understands the direction correctly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If operation guidance is displayed using a fixed directional indicator, then the guidance information is simple to generate, but the operating direction becomes unintelligible when the operator moves to different positions
Solution Approach 1:
The guidance system dynamically adjusts the directional indicator based on the operator's position relative to the movable device. The estimation section calculates the operator's location, and the image generating section modifies the operating direction indication accordingly, transforming a static fixed-direction system into a dynamic adaptive one that maintains intelligibility across different operator positions
Solution Approach 2:
The system implements feedback by continuously monitoring the operator's position and using this information to adjust the guidance display. The estimation section provides feedback about operator location, which the image generating section uses to modify the directional indicator, creating a closed-loop system that adapts to changing conditions
2Adaptability or versatility
If the operation device is placed at a fixed position, then the system structure is simple, but the positional relationship between operator and device cannot be reflected in the operating direction
Solution Approach 1:
The estimation section acts as an intermediary that bridges the fixed operation device and the movable device. It calculates the operator's position relative to the movable device and translates this spatial relationship into appropriate directional indicators, allowing the fixed operation device to provide adaptable guidance without requiring physical movement
3Loss of information
If conventional operation guidance is displayed without considering operator position, then the display system is simple, but the operator cannot understand how the movable device will operate in response to their input
Solution Approach 1:
The system performs preliminary action by calculating and displaying the operating direction before the operator executes the command. The estimation section and image generating section determine what direction the movable device will move in response to the upcoming operation, allowing the operator to understand the consequence of their input before committing to it
Solution Approach 2:
The system provides feedback about the relationship between operator input and device response. By displaying the calculated operating direction based on operator position, the system closes the information loop, showing the operator how their action will affect the movable device's movement
Data Source
AI summary
System includes: an operation terminal that (i) receives an operation instruction that is given by the operator to a movable section of a machine and (ii) senses an operation standby state that allows the operation instruction to be received; an image sensor estimating section configured to estimate a positional relationship between the operator and the machine; a model generating section configured to, in response to sensing of the operation standby state by the operation terminal, generate an operating direction indicating image; and in accordance with the positional relationship, in a direction that is in accordance with a direction in which the operator views the machine, the operating direction indicating image indicating an operating direction of the movable section; an combining section configured to generate a combined image obtained by combining the operating direction indicating image with a captured image of the movable section that has been photographed.