Machining Video Analysis Using Time-Linked Program Blocks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for machining analysis fail to associate video recordings during machining with the corresponding machining program, limiting the ability to correlate visual data with operational data and program instructions.

Innovation Solution

A video analysis device and system that acquire machining videos and programs, detect characteristic frames and blocks, and associate them using video and program feature detection units, enabling synchronization of video and program data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If video data and machining program data are analyzed separately, then data processing is simple, but the ability to associate visual data with operational data is lost

Engineering Contradiction:
Improveassociation between video and program dataVSAvoiddata processing system
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent uses time information as an intermediary to associate video data with machining program data. The time information extraction unit extracts time stamps from both video and program data, and the association unit uses these time stamps to link corresponding frames and program blocks, enabling correlation without direct complex integration of the data systems themselves.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the machining process into discrete identifiable units: video frames with time stamps and program blocks with corresponding time information. By dividing both data streams into comparable segments that can be matched through time information, the system enables association while maintaining relative simplicity in processing each segment independently.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If time information is used to synchronize multiple data types, then data correlation is improved, but association with machining program remains incomplete

Engineering Contradiction:
Improveassociation between video and program dataVSAvoiddata processing method
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

Time information serves as the intermediary that bridges video data and machining program data. The system extracts time stamps from video frames and time information from program blocks, then uses these temporal markers as a common reference to associate the two data types, completing the association that partial synchronization alone cannot achieve.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If characteristic frames and program blocks are associated, then machining analysis capability is enhanced, but data processing complexity increases

Engineering Contradiction:
Improvemachining analysis precisionVSAvoidfeature detection and association system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts characteristic features from both video data and program data: identifying specific frames with notable characteristics from the video stream and corresponding program blocks from the machining code. By extracting only the relevant characteristic elements rather than processing all data, the system enhances analysis precision while managing complexity through selective feature detection.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Time information acts as the intermediary that enables association of characteristic frames and program blocks. The detection units identify characteristics in both data streams, and the association unit uses time stamps to link them, providing precise machining analysis without requiring direct complex interaction between video processing and program parsing systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20240219887A1Video analysis device, video analysis system, and storage medium
Publication Date: 2024.07.04 FANUC LTD
  • US20240219887A1 patent drawing
  • US20240219887A1 patent drawing
  • US20240219887A1 patent drawing

AI summary

This video analysis device acquires a video of machining by a numerical control device, acquires a machining program for the numerical control device, and detects a characteristic frame from among the frames included in the video of the machining. The video analysis device detects, from among the blocks included in the machining program, a block that commands a machine tool to perform a characteristic operation. The video analysis device associates the characteristic frame with the block that commands the machine tool to perform the characteristic operation.