Mount Type Device Image Stabilization for Remote Worksite Guidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In existing systems, instructors cannot grasp events outside the visual field of workers, leading to delayed instructions and potential sickness due to fluctuating images caused by the worker's visual line movement.
Innovation Solution
A remote operation instructing system with a mount type device that includes a camera capturing a wider range than the worker's visual field, a sensor detecting visual line movement, and a network transmitting data to an operation instructing apparatus that corrects and displays images to stabilize the view for the instructor.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a camera photographs only within the worker's visual field range, then the system structure is simple, but the instructor cannot grasp events outside the visual field leading to delayed instructions
Solution Approach 1:
The system transitions from a single viewpoint (worker's visual field) to multiple viewpoints by incorporating both the worker's camera footage and the instructor's separate camera footage. This dimensional expansion allows the instructor to observe events outside the worker's visual field while maintaining system simplicity through network-based data transmission.
2Ease of operation
If the camera image fluctuates in response to worker's visual line movement, then the system responds dynamically to worker behavior, but the instructor feels unpleasant sickness
Solution Approach 1:
The system separates the dynamic image stabilization function into an independent processing module that operates independently from the worker's visual line detection. This segmentation allows the instructor's view to remain stable while the worker's visual line tracking continues to function, preventing instructor sickness without compromising dynamic responsiveness.
3Area of stationary object
If the camera captures a wider range than the worker's visual field, then the instructor can see more of the work site, but the image fluctuates with worker's visual line movement
Solution Approach 1:
The system introduces an intermediary image stabilization processing module that mediates between the wide-range camera capture and the final displayed image. This intermediary component corrects image fluctuations caused by worker's visual line movement, allowing both wide coverage and image stability to coexist.
Data Source
AI summary
A mount type device includes a camera configured to photograph a work site in a wider range than a visual field of a worker; a sensor configured to obtain a visual line of the worker; and a visual line movement detector configured to detect, as visual line movement information, movement of a direction of the visual line of the worker by using the sensor information. The mount type device transmits data on the photographed image and the visual line movement information to an operation instructing apparatus via a network. An operation instructing apparatus includes a display setter configured to extract a first image having a wider range than a visual field range of the worker from the image photographed by the camera, correct the first image using the visual line movement information, and cause a display of the corrected first image; and an instruction image is generated for the worker.