Operation Panel Video Manual Sync Using Button Signal Timing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video manual creation techniques for machine operation are time-consuming due to the inclusion of actual videos and simulations, and they struggle with synchronizing button presses with displayed buttons, making it difficult to create an easy-to-understand video manual.
Innovation Solution
A video manual creation device and method that registers machine operation panel images and button signals, extracts signal change times, and detects frames of button operations to create a synchronized video showing which button is pressed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If an actually captured video of the machine is used in the video manual, then the video provides realistic operation demonstration, but it takes time to create and edit the video manual
Solution Approach 1:
The patent extracts only the essential information from the captured video - specifically the button operation timings - and separates it from the rest of the video content. By extracting only the signal change timings and associating them with button positions, the system creates video manuals without requiring manual editing of the entire video, thus reducing creation time while maintaining accurate operation demonstration.
Solution Approach 2:
The patent creates a simplified copy of the operation information by recording signal change timings and button positions rather than copying the entire video. This digital representation of button operations can be automatically overlaid on video frames to create the manual, eliminating time-consuming manual video editing while preserving the realistic operation demonstration.
2Reliability
If a worker's button operation video is captured, then the actual operation is recorded, but it is difficult to recognize which button is pressed by the worker
Solution Approach 1:
The patent introduces an intermediary component - the signal registration unit - that detects button operations through signal changes rather than visual observation. This intermediary system automatically identifies which button is pressed by monitoring electrical or digital signals from the operation panel, eliminating the difficulty of visually detecting and measuring button presses in the video.
Solution Approach 2:
The patent replaces the mechanical/visual method of identifying button presses (watching the video to see which button is pressed) with an electronic signal-based system. By substituting signal detection for visual observation, the system automatically identifies button operations without requiring manual analysis of the video content.
3Productivity
If signal acquisition from the machine is delayed, then the system can process data, but timing deviation occurs between button press and display
Solution Approach 1:
The patent performs preliminary action by recording and storing the signal change timings as they occur during the captured video, rather than processing them in real-time during video playback or editing. By preliminarily capturing the exact timing of each signal change and associating it with the corresponding video frame, the system maintains precise timing synchronization even though data processing occurs afterward.
Solution Approach 2:
The patent uses feedback by continuously monitoring signal changes and immediately associating them with the current video frame timestamp. This feedback mechanism ensures that each button operation is accurately timed relative to the video content, allowing the system to maintain timing precision while processing the data after video capture.
4Quantity of substance
If a long-term video from surveillance camera is used, then complete operation record is obtained, but editing becomes difficult and time consuming
Solution Approach 1:
The patent extracts only the essential operation information - signal change timings and button positions - from the long-term surveillance video. By extracting this key data and separating it from the rest of the video content, the system creates a simplified representation that is easy to process and edit while maintaining complete operation records.
Solution Approach 2:
The patent segments the long-term video into discrete button operation events based on signal changes. Each button press is identified as a separate event with its own timestamp and position information, making the complex long-term video editable through simple event-based operations rather than traditional frame-by-frame editing.
Data Source
AI summary
A moving image manual creation device includes a machine operation panel registration unit that registers an image of the operation panel of a machine, a signal registration unit that registers each button on the operation panel in the image and a signal for controlling the operation panel by an operation of each button on the operation panel in association with each other, and a signal data change time extraction unit that extracts a time of a change in the registered signal. The device also includes a frame detection unit that detects, based on the extracted time, from the moving image including an operation performed on the operation panel, a frame at which a button corresponding to the changed signal was operated, and a moving image creation unit that creates a moving image displaying the button on the image of the operation panel when the detected frame is displayed.