VIDEO DISCIPLINE DEVICE, VIDEO DISCIPLINE SYSTEM, AND STORAGE MEDIUM

Abstract

This video discrimination device: stores a machine state dictionary linking identification information for data pertaining to the state of a machine, which is a numerical control device and / or a machining tool, and the contents of the data; acquires video of the machine; acquires data to be used in detecting a change in the state of the machine; determines whether the state of the machine has changed, on the basis of the data; and links the contents of the data and video from when the state of the machine has changed.

Description

[Technical field]

[0001] The present invention relates to a video discrimination device, a video discrimination system, and a computer-readable storage medium. [Background technology]

[0002] Conventionally, there exists a "multimedia NC control device (Patent Document 1) that supports manufacturing activities (repeat orders) by reproducing, in video, the operation and setup of machines for each product, or how to handle and inspect the product."

[0003] Patent Document 1 states that "When NC processing data is sent from a host computer to display control section 20 via RS-232C, display control section 20 downloads the NC processing data to the NC device and creates index table 26 with the program name as its ID. When barcode reading switches 13 such as "recording" and "setup" are operated from the barcode reader, display control section 20 starts control software section 21 and instructs recording section 22 to record. Recording section 22 then returns the time code of this recording start to control software section 21, and the system enters that time code in the "setup process" column of index table 26."

[0004] In Patent Document 1, NC processing data is downloaded to the NC device, and an index table 26 with the program name as its ID is created. The barcode reading switch 13 is set with multiple code switches for key tasks, such as a "setup code" operated when setting up the die and a "bending code" pressed during bending. For example, when a "setup code" is operated, the system enters the time code in the "setup process" field of the index table 26. The system manages the NC processing data (program) and the index table 26 as a pair, and can be searched for by the playback unit 24. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 8-129411 Summary of the Invention [Problem to be solved by the invention]

[0006] In Patent Document 1, it is necessary to prepare a switch to start recording video and a switch to select the content to be recorded (setup, bending, etc.), and the operator must monitor the machine and manually start recording and input the content to be recorded.

[0007] In the field of machine tools, technology that can automatically classify images is desired. [Means for solving the problem]

[0008] A numerical control device according to one aspect of the present disclosure is a numerical control device and a machine status dictionary section that links identification information of data relating to the status of both or at least one of the machine tools with the contents of the data; and an image acquisition section that acquires an image of the machine; At least one of the following is included: an operation signal from an operator, a change in a variable by a machining program, a change in a variable from a built-in program, a change in a variable from an information processing device, a machining program command, and a sequence program command. The machine includes a machine state acquisition unit that acquires data used to detect changes in the machine state, a machine state conversion unit that detects changes in the machine state based on the data and converts the changes in the data into operation contents of the machine by referring to the machine state dictionary unit, and a data linking unit that links an image of when the machine state changes with the contents of the data. An image discrimination system according to one aspect of the present disclosure includes a numerical control device. and a machine status dictionary section that links identification information of data relating to the status of both or at least one of the machine tools with the contents of the data; and an image acquisition section that acquires an image of the machine; At least one of the following is included: an operation signal from an operator, a change in a variable by a machining program, a change in a variable from a built-in program, a change in a variable from an information processing device, a machining program command, and a sequence program command.The machine includes a machine status acquisition unit that acquires data used to detect changes in the machine's status, and a data linking unit that detects changes in the machine's status based on the data, refers to the machine status dictionary unit, converts the changes in the data into operation contents of the machine, and links an image of when the machine's status changes with the contents of the data. A storage medium according to one aspect of the present disclosure is a computer readable medium for storing a program for executing a program for a numerical control device by one or more processors. and a machine status dictionary section that links identification information of data relating to the status of both or at least one of the machine tools with the contents of the data; and acquiring an image of the machine; At least one of the following is included: an operation signal from an operator, a change in a variable by a machining program, a change in a variable from a built-in program, a change in a variable from an information processing device, a machining program command, and a sequence program command. The device stores computer-readable instructions for acquiring data used to detect changes in the machine's status, determining whether or not the machine's status has changed based on the data, and linking the image of when the machine's status changed with the content of the data. Effect of the Invention

[0009] According to one embodiment of the present invention, video can be automatically identified. [Brief description of the drawings]

[0010] [Figure 1] 1 is a block diagram of a numerical control device serving as the image discrimination device of the first disclosure. [Diagram 2] FIG. 2 is a diagram showing variables set in a memory of a numerical control device. [Diagram 3] FIG. 2 is a conceptual diagram showing a relationship between a numerical control device and an external device. [Figure 4] FIG. 4 illustrates an example of an input unit. [Diagram 5] FIG. 11 is a block diagram of a numerical control device according to a second disclosure. [Figure 6] FIG. 4 is a diagram illustrating an example of an operation signal dictionary unit. [Figure 7] FIG. 13 is a diagram illustrating selection of a key frame. [Figure 8] FIG. 4 is a diagram illustrating an example of an operation signal dictionary unit. [Figure 9]13 is a diagram showing an example of a video created by an operation video creation unit; FIG. [Figure 10] FIG. 13 is a diagram illustrating the creation of a summary video. [Figure 11] FIG. 1 is a diagram showing an example of a video with subtitles. [Figure 12] FIG. 13 is a diagram showing an example of an operating procedure manual. [Figure 13] FIG. 13 is a diagram illustrating the selection of a representative image. [Figure 14] 4 is a flowchart illustrating an operation of the numerical control device. [Figure 15] FIG. 13 is a block diagram of a numerical control device according to a third disclosure. [Figure 16] FIG. 2 is a diagram illustrating a hardware configuration of a numerical control device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] [First Disclosure] FIG. 1 is a block diagram of a numerical control device 100 serving as the image discrimination device of the first disclosure. The numerical control device 100 includes an image acquisition unit 1, a machine state acquisition unit 2, a machine state dictionary unit 3, a machine state conversion unit 4, and a data linking unit 5.

[0012] The image acquisition unit 1 acquires an image from a camera 6 that images the machine tool 7, or an image captured from the display screen of the numerical control device 100 or the machine tool 7.

[0013] The machine state acquisition unit 2 acquires data used to detect state changes of the machine tool 7 and the numerical control device 100 that controls the machine tool 7 (hereinafter, referred to as data used to detect state changes of the machine). The "data used to detect state changes of the machine" includes operation signals from the machine operation panel or touch panel, changes in variables by the machining program, changes in variables from the built-in program, changes in variables from PC applications, input signals from external devices connected to the machine tool, output signals to external devices connected to the machine tool, machining program commands, sequence program commands, etc.

[0014] The machine state dictionary unit 3 links "identification information of data used to detect changes in the machine state (e.g., signal identification information / variable identification information / command identification information)" with "contents of data used to detect changes in the machine state (e.g., signal content / variable content / command content)."

[0015] The machine state conversion unit 4 monitors the "data used to detect changes in the machine state" acquired by the machine state acquisition unit 2, determines whether or not the machine state has changed, and when a change in the machine state occurs, refers to the machine state dictionary unit and converts the "data identification information" into "data content."

[0016] The data linking unit 5 links the change in the machine state with the image of the machine. Specifically, it links both or at least one of the "data value indicating the change in the machine state" and the "content of the data that changes the state of the machine" with the image acquired by the image acquisition unit 1. The images acquired by the image acquisition unit 1 include images from a camera 6 that captures an image of the machine tool 7, images captured from the display screen of the machine tool 7, and the like.

[0017] We will now provide a detailed explanation of the video that is linked to data showing changes in the machine's condition. Operation signals from an operation panel, touch panel, etc. can be "data used to detect changes in the machine's state." The machine state conversion unit 4 monitors the operation signals, and when the operation signal changes, it refers to the machine state dictionary unit 3 and reads out the "data content" of the changed operation signal. The data linking unit links both or at least one of the "data value" and "data content" with the video. For example, when an operator manually operates the speed dial on the control panel and the speed signal changes from "10 to 20," the data linking unit 5 links the image of "the moving speed of the machine tool axis changing" with the data content "speed" and the data value "10->20." For example, when the "machining start button" on the touch panel is pressed and the machining start signal changes from OFF to ON, the data linking unit 5 links the image of "workpiece machining starting" with the data content "machining start."

[0018] When "editing the machining program" is executed by manually operating the touch panel, the machine state conversion unit 4 detects the block (line) of the machining program that has changed. For example, when the 100th line of the machining program changes, the data linking unit 5 links the image of "the operator operates the touch panel", the data content "change in the machining program", and the data value "100th line".

[0019] When "parameter editing" is executed by manually operating the touch panel or the operation panel, the feed speed parameter changes. The data linking unit 5 links the image of "the operator operating the touch panel or the operation panel" with the data content "feed speed parameter" and the data value "100->200".

[0020] When "Edit offset" is executed by manually operating the touch panel or the operation panel, the tool offset variable changes. The data linking unit 5 links the image of "the operator operating the touch panel or the operation panel", the data content "tool offset", and the data value "100mm->110mm".

[0021] When a machining program that measures the tool length is executed, "the tool offset variable changes automatically." The data linking unit 5 links the video of "the machining program that measures the tool length is executed, and the measurement result is reflected in the offset," the data content "tool offset," and the data value, for example, "100 mm -> 110 mm." The video of "the measurement result is reflected in the offset" may be a captured video on the display unit 70 of the numerical control device 100.

[0022] When a machining program that automatically changes macro variables is executed, the "macro variables change automatically." For example, when a machining program that measures the shape of a workpiece is executed, the macro variables for the shape of the workpiece are automatically changed. The data linking unit 5 links the "executing workpiece measurement" image, the "measurement results are reflected in macro variables" image, the data content "workpiece shape," and the data value, for example, "X120.0->X124.0." The "measurement results are reflected in macro variables" image may be, for example, a captured image on the display unit 70 of the numerical control device 100.

[0023] When an embedded program that changes a variable is executed, "a certain variable changes automatically." For example, when one of the variables, "the number of the machining program to be executed," is changed, the data linking unit 5 links the video of "the number of the machining program being changed" with the data content "the number of the machining program to be executed" and the data value "the number of the machining program." The video of "the number of the machining program being changed" may be a captured video on the display unit 70 of the numerical control device 100.

[0024] There may be a case where an application of an external information device changes a variable of the numerical control device 100. Here, the external information device is a PC (personal computer), a server, or the like. For example, if the variable "number of the machining program to be executed" is changed, the data linking unit links the image of "the machining program number being changed" with the data content "number of the machining program to be executed" and the data value "number of the machining program." Here, the content of the data to be linked to the video may be "the name of the application that executed the change of the variable", "the name of the external information device that executed the change of the variable", etc. The video of "the machining program number being changed" may be a captured video of the display unit 70 of the numerical control device 100.

[0025] An input signal from an external device connected to the machine tool 7 can become "data used to detect changes in the machine's state." For example, a "touch probe contact signal" is "data used to detect changes in the machine's state." When the touch probe, which is an external device, comes into contact with a workpiece or the like, the "probe contact signal" changes to "ON." When the "probe contact signal" changes, the data linking unit 5 links the image of "the touch probe's LED (Light Emitting Diode) lighting up and stopping" with the data content "touch probe contact." An input signal from a sensor can be "data used to detect changes in the machine's condition." For example, the "spindle temperature" detected by a temperature sensor is "data used to detect changes in the machine's condition." When the "spindle temperature" exceeds a predetermined value, the data linking unit 5 links the data content "spindle temperature," the data value "value of spindle temperature," and an image of the "spindle." When the temperature rises, the "spindle" may start smoking.

[0026] The output signal to an external device connected to the machine tool 7 can become "data used to detect a change in the state of the machine." For example, a "door opening / closing signal of a machine tool" can be "data used to detect changes in the state of the machine." When the "door opening / closing signal" changes, a PLC (a PLC built into the numerical control device 100, or a PLC external to the numerical control device 100) opens and closes the door according to the value of the signal. The data linking unit 5 links the image of the external device with the change in data. For example, when the "door opening / closing signal" turns ON, the data linking unit 5 links the image of the "door opening," the data content "door opening / closing signal," and the data value "OFF->ON." The "coolant signal" can be "data used to detect changes in the machine's condition." When the "coolant signal" changes, a PLC (either a PLC built into the numerical control device 100 or a PLC external to the numerical control device 100) sprays coolant according to the signal value. The data linking unit 5 links the image of the external device with the data change. For example, when the "coolant signal" turns ON, the data linking unit 5 links the image of "coolant spraying begins," the data content "coolant signal," and the data value "OFF->ON."

[0027] The commands of the machining program can be "data used to detect changes in the machine state." The numerical control device 100 analyzes the machining program and outputs commands to modules such as a servo amplifier. When the commands are output, the "signal indicating the state of a specific function of the numerical control device 100" changes. The machine state conversion unit 4 determines that the machine state has changed based on a change in the value (e.g., switching between ON and OFF) of the "signal indicating the state of a specific function (e.g., fast-forward) of the numerical control device 100." The data linking unit 5 links the image in which "a specific function of the numerical control device 100 is used" with the content of the data (e.g., a fast-forward command, etc.).

[0028] The commands of the sequence program can be "data used to detect changes in the machine's state." The PLC inside the numerical control device 100 analyzes the sequence program and issues commands to external devices connected to the numerical control device 100 to execute specific sequence functions. When a command is output, the "signal indicating the state of the sequence function" changes. The machine state conversion unit 4 determines that the machine's state has changed based on a change in the value of the "signal indicating the state of the sequence function" (e.g., switching between ON and OFF). The data linking unit 5 links the video of "the commands of the sequence program being executed" with the content of the data (e.g., a tool change command, etc.).

[0029] A method for detecting a change in the above-mentioned "data used to detect a change in the state of the machine" will now be described. In the numerical control device 100, as shown in Fig. 2, variables such as local variables, macro variables, common variables, and system variables are set in the memory of the numerical control device 100. Parameter numbers are also determined. The variable numbers and parameter numbers can be used as data identification information. Local variables are variables used when executing machining programs such as the main program and macro programs, and are independent of each other in the main program and macro programs. Common variables are variables used commonly in the main program and macro programs. The system variables store changes to tool diameter compensation, read coordinate values, valid commands (G codes), valid M codes (sequence commands), etc. The system variables include interface input signals, interface output signals, setting data, modal information, etc. From the values ​​of these variables, changes in the machine state can be detected.

[0030] The numerical control device 100 of the first disclosure detects changes in the machine state by monitoring the memory, external signals, operation signals, etc., and converts the identification information of the machine state into "data content" by referring to the machine state dictionary unit 3, and links the "data content" to an image. This makes it possible to determine the content of the image. An application example using an image linked to the "data content" is shown in the second disclosure.

[0031] [Second Disclosure] In the present disclosure, an embodiment will be described in which, among the machine states, a focus is particularly placed on the operation of a numerical control device by an operator, and linking with an image. Fig. 3 is a conceptual diagram showing a numerical control device 100 as an image discrimination device of the present disclosure, and a device that transmits a signal to the numerical control device 100. In Fig. 3, the numerical control device 100 is included in a machining center. The machining center is a device in which the numerical control device 100 and a machine tool are integrated. The machining center also includes devices such as a servo motor, a fan, a fog collector, a coolant, a chip removal device, an automatic tool changer (ATC), and a stacked indicator light (Patlite (registered trademark)). The numerical control device 100 has an internal PLC (Programmable Logic Controller) 42, which controls these devices.

[0032] The PLCs 42, 50 include an internal PLC 42 built into the numerical control device 100, and an external PLC 50. The external PLC 50 receives signals from facilities, devices, sensors, and actuators present at the manufacturing site in addition to requests from the numerical control device 100, and outputs information detected by sensors, control status data, and the like to the numerical control device 100. In this disclosure, devices controlled by the PLCs 42, 50 are referred to as external devices of the numerical control device 100.

[0033] The numerical control device 100 includes an input unit 71. The input unit 71 includes a physical input unit 71 and an electronic input unit 71. FIG. 4 shows an example of the input unit 71 of the numerical control device 100. The physical input unit 71 is a dial or a button on a machine operation panel. The electronic input unit 71 is, for example, a button displayed on a touch panel. When an operator operates the input unit 71, an operation signal is output via the PLC 42. This operation signal is not a special signal, but an existing operation signal obtained as a result of the operator inputting the existing input unit 71 of the numerical control device 100. In the present disclosure, the existing operation signal is used for image discrimination. There is no need to input the operation contents of the operator, and no special switch or the like is required for the operator to input the operation contents.

[0034] 5 is a block diagram of the numerical control device 100. The numerical control device 100 includes a video acquisition unit 11, an operation signal acquisition unit 12, an operation signal dictionary unit 13, an operation signal conversion unit 14, a data linking unit 15, a subtitle creation unit 16, a video creation unit 17, a summary video creation unit 18, a procedure manual creation unit 19, and a video selection unit 20.

[0035] The image acquisition unit 11 according to the present disclosure corresponds to the image acquisition unit 1 described in the first disclosure, the operation signal acquisition unit 12 according to the present disclosure corresponds to the machine state acquisition unit 2 described in the first disclosure, the operation signal dictionary unit 13 according to the present disclosure corresponds to the machine state dictionary unit 3 described in the first disclosure, the operation signal conversion unit 14 according to the present disclosure corresponds to the machine state conversion unit 4 described in the first disclosure, and the data linking unit 15 according to the present disclosure corresponds to the data linking unit 5 described in the first disclosure.

[0036] The image acquisition unit 11 acquires an image from a camera (not shown) that captures an image of the machine tool. The operation signal acquisition unit 12 acquires an operation signal input to an input unit 71 such as a machine operation panel or a touch panel.

[0037] The operation signal dictionary unit 13 links "signals", "signal values", and "operation contents". The operation signal conversion unit 14 can convert the change in the signal input to the numerical control device 100 into the operation contents of the operator. FIG. 6 is an example of the operation signal dictionary unit 13. In FIG. 6, "signal 1" and "signal 2" are registered as "signals". "Signals" include the input address of an external device, the voltage value of a specified resistor, etc. In FIG. 6, the value "1" of "signal 1" is associated with the operation content "move in the +Y direction with JOG". The value "10" of "signal 2" is associated with the operation content "fast forward override is 25%".

[0038] The operation signal conversion unit 14 monitors the operation signal input to the input unit 71 and detects a change in the operation signal. Changes in the operation signal include a change in the value of the operation signal, input of a new operation signal, and cessation of input of the operation signal. In the example of the first line in FIG. 6, a change in the operation signal is detected when the value of "signal 1" changes from "0" to "1." The operation signal conversion unit 14 refers to the operation signal dictionary unit 13 and converts the change in the operation signal into the operation content "move in the JOG+Y direction."

[0039] The data linking unit 15 links the operation contents with the video. The data linking unit 15 selects the video at the time when the operation signal changes as a key frame. A key frame is a frame that separates the data that constitutes a video. A key frame is an uncompressed frame that completely holds the video information. As shown in Fig. 7, the data linking unit 15 selects a key frame at the time when the operation data changes from among multiple frames and links it with the operation contents.

[0040] The subtitle creation unit 16 creates subtitles that indicate the operation content at the time when the signal changed. One method for creating subtitles is to create a subtitle file. A subtitle file is a text file that associates the display time of the subtitle with the subtitle text. The subtitle creation unit 16 adds the subtitle file to the video. Also, the video, audio, and subtitles may be multiplexed when the video is compressed, as in the case of an MPEG transport stream. There are no particular limitations on the method for creating subtitles.

[0041] The image creation unit 17 converts the operation contents into an image. FIG. 8 is an example of the operation signal dictionary unit 13 when converting the operation contents into an image. In FIG. 8, the value "1" of "signal 1" is associated with the operation content "+Y" button. The value "10" of "signal 2" is associated with an image of the dial operated counterclockwise. FIG. 9 is an example of an image created by the image creation unit 17. In FIG. 9, pressing of the button "Y" and dial operation are shown as the operation contents. Specifically, the button "Y" is highlighted, an arrow is displayed indicating that the dial in the upper right corner of the machine operation panel has been rotated, and the operation amount (value) of the dial is shown. The image creation unit 17 converts the operation contents of the operator into an image.

[0042] As shown in Fig. 10, the summary video creation unit 18 extracts and splices together the key frame selected by the data linking unit 15 and the following few seconds of video, to create a summary video that consolidates only the parts where there have been changes in the operation data. Subtitles may be added to the summary video. Fig. 9 shows an example of adding subtitles to a summary video. In the example of Fig. 11, a subtitle saying "Move in JOG+Y direction" is added. By adding subtitles, the relationship between the operator's operation and the movement of the machine tool can be visualized.

[0043] The operation manual creation unit 19 creates an operation manual in which the video and the operation contents correspond one-to-one by pasting the key frames and the text representing the operation contents at that time in order into a document file. In the example of FIG. 12, four key frames, key frames [1], [2], [3], and [4], are lined up. Key frame [1] is the video when the operation of "moving in the JOG+Y direction" is performed, key frame [2] is the video when the operation of "changing to automatic driving mode" is performed, key frame [3] is the video when the operation of "pressing the reset button" is performed, and key frame [4] is the video when the operation of "pressing the start button" is performed. By listing the operator's operations in chronological order, a procedure manual can be automatically created. The procedure manual may include time information. Subtitles may be added to the video.

[0044] The video selection unit 20 accepts the selection of a representative video to be used for creating a summary video and a procedure manual. The video selection unit 20 displays a list of key frames at the time when a change occurs in the signal and accepts the user's selection. The summary video creation unit 18 creates a summary video from the key frames selected by the user. The procedure manual creation unit 19 creates a procedure manual from the key frames selected by the user. The video selection unit 20 can also select a representative video. The representative video is used as a summary video or a cover video for a procedure manual. In the example of Fig. 13, when the key frame [4] is selected as the representative video from the list of key frames [1] to [6], a summary video is created with the key frame [4] as the cover.

[0045] The operation of the numerical control device 100 will be described with reference to the flowchart in Fig. 14. In this disclosure, the numerical control device 100 simultaneously records video and discriminates the video. The numerical control device 100 acquires video of the machine tool from a connected camera (step S1) and simultaneously acquires an operation signal (step S2).

[0046] The numerical control device 100 monitors the operation signal (step S3), and when it detects a change in the operation signal (step S4; YES), it refers to the operation signal dictionary unit 13 and selects the operation content corresponding to the operation signal. If it does not detect a change in the operation signal in step S4 (step S4; NO), it shifts the process to step S3 and monitors the operation signal.

[0047] The numerical control device 100 selects a frame of the image at the time when the operation signal changes as a key frame and associates it with the operation content (step S5). The numerical control device 100 stores the key frame and the operation content (step S6). At this time, a time stamp may be added.

[0048] The numerical control device 100 of the present disclosure includes an operation signal dictionary unit 13 that links operation signals with operation contents, and links and stores operation contents and key frames that occur when an operator operates the numerical control device 100. The numerical control device 100 converts the operation contents into a format that humans can understand, such as text or video. The numerical control device 100 displays text indicating the operation contents as subtitles, or displays the operation contents as video. The numerical control device 100 uses the operation contents and key frames to create a summary video or a procedure manual. A user can also select a key frame that will be the cover of the summary video or the procedure manual. The operation contents may be converted into audio.

[0049] [Third Disclosure] In the second disclosure, video recording and data linking were performed simultaneously, but in the third disclosure, data linking is performed using video recorded during processing and operation signals during processing. As shown in Fig. 15, the video discrimination device 200 of the third disclosure includes a video storage unit 21 that stores recorded video, and a data storage unit 22 that stores operation signals during processing. The video acquisition unit 11 reads out the video stored in the video storage unit 21, and the operation signal acquisition unit 12 reads out the operation signals stored in the data storage unit 22.

[0050] The operation signal dictionary unit 13, operation signal conversion unit 14, data linking unit 15, subtitle creation unit 16, video creation unit 17, summary video creation unit 18, instruction manual creation unit 19, and video selection unit 20 perform the same processing as in the second disclosure, so their explanations are omitted.

[0051] The video discrimination device 200 of the third disclosure can be applied to information processing devices such as a numerical control device, a PC, a server, a mobile terminal, etc. In addition, the present disclosure also includes a video discrimination system in which the components of the video discrimination device 200 of the third disclosure are distributed among a PC, a server, a numerical control device, etc. on a network.

[0052] The above describes the first to third disclosed embodiments of the present invention, but the present invention is not limited to the above-described examples of the embodiments, and can be implemented in various forms by making appropriate modifications. For example, the functions of the subtitle creation unit 16, summary video creation unit 18, instruction manual creation unit 19, video selection unit 20, video storage unit 21, data storage unit 22, etc., shown in the second disclosure, can be used in appropriate combination with the video discrimination device according to the first disclosure. In this case, each function creates subtitles, summaries, instruction manuals, and representative videos and stores data based on data indicating not only the operation contents but also various machine states.

[0053] Furthermore, in the first to third disclosures, the numerical control device 100 is used as an application example of the video discrimination device, but the device may be applied to an information processing device other than the numerical control device 100 as long as it has the video acquisition unit 1 (video acquisition unit 11), the machine state acquisition unit 2 (operation signal acquisition unit 12), the machine state dictionary unit 3 (operation signal dictionary unit 13), the machine state conversion unit 4 (operation signal conversion unit 14), and the data linking unit 5 (data linking unit 15). Also included in the present disclosure is a video discrimination system in which the components of the numerical control device 100 are distributed and arranged in PCs (personal computers), servers, numerical control devices, etc. on a network.

[0054] [Hardware configuration] The hardware configuration of the numerical control device 100 of the first disclosure will be described with reference to Fig. 16. The video discrimination devices 200 of the second and third disclosures have approximately the same hardware configuration. The numerical control device 100 includes a CPU 111, which is a processor that controls the numerical control device 100 as a whole. The CPU 111 reads a system program processed in a ROM 112 via a bus, and controls the numerical control device 100 as a whole in accordance with the system program. The RAM 113 temporarily stores temporary calculation data, display data, various data input by the user via the input unit 71, and the like.

[0055] The display unit 70 is a monitor or the like attached to the numerical control device 100. The display unit 70 displays an operation screen, a setting screen, and the like of the numerical control device 100.

[0056] The input unit 71 is a keyboard, a touch panel, or the like that is integrated with the display unit 70 or is separate from the display unit 70. A user operates the input unit 71 to input data to a screen displayed on the display unit 70. The display unit 70 and the input unit 71 may be a mobile terminal.

[0057] The non-volatile memory 114 is a memory that retains its stored state even when the power supply of the numerical control device 100 is turned off, for example, by being backed up by a battery (not shown). The non-volatile memory 114 stores programs read from an external device via an interface (not shown), programs input via the input unit 71, and various data acquired from each unit of the numerical control device 100, a machine tool, etc. (for example, setting parameters acquired from a machine tool, etc.). The programs and various data stored in the non-volatile memory 114 may be expanded in the RAM 113 when executed / used. In addition, various system programs are written in advance in the ROM 112.

[0058] A controller 40 that controls the tool of the machine tool converts an axis movement command from a CPU 111 into a pulse signal and outputs it to a driver 41. The driver 41 converts the pulse signal into a current to drive a servo motor of the machine tool. The servo motor moves the tool and the table according to the control of a numerical control device 100. [Explanation of symbols]

[0059] 100 Numerical control device 200 Image discrimination device 1. Video acquisition section 2 Machine status acquisition unit 3 Machine Status Dictionary 4 Machine State Conversion Unit 5 Data Linking Section 11 Video acquisition section 12 Operation signal acquisition section 13 Operation signal dictionary section 14 Operation signal converter 15 Data Linking Department 16 Subtitling Department 17 Video Production Department 18 Summary Video Creation Department 19 Procedure Manual Creation Department 20 Video selection section 111 CPU 112 ROM 113 RAM 114 Non-volatile memory

Claims

1. a machine status dictionary section for linking identification information of data relating to the status of a machine, which is both or at least one of a numerical control device and a machine tool, with the contents of the data; An image acquisition unit that acquires an image of the machine; a machine status acquisition unit that acquires data used to detect a change in the status of the machine, the data including at least one of an operation signal from an operator, a change in a variable by a machining program, a change in a variable from an embedded program, a change in a variable from an information processing device, a machining program command, and a sequence program command; a machine state conversion unit that detects a change in the state of the machine based on the data, and converts the data into contents by referring to the machine state dictionary unit; a data linking unit that links the image when the state of the machine changes with the content of the data; An image discrimination device comprising:

2. The data linking unit links an image of the machine when its state changes with a value of the data.

2. The image discrimination device according to claim 1.

3. 2. The image discrimination device according to claim 1, wherein the image when the state of the machine changes is both or at least one of an image of the machine captured by a camera and an image captured on an operation screen of the numerical control device.

4. The content of the data is in at least one of a text format, a video format, and an audio format.

2. The image discrimination device according to claim 1.

5. creating a subtitle at the time when the state of the machine changes from the content of the text format data; 5. The image discrimination device according to claim 4.

6. The content of the video data is a video showing an operation related to the machine at the time when the state of the machine changes.

5. The image discrimination device according to claim 4.

7. The image at the time when the state of the machine changes is a key frame.

2. The image discrimination device according to claim 1.

8. a summary video creation unit that extracts a video of a point in time when the state of the machine changes and creates a summary video by connecting the extracted videos; 2. The image discrimination device according to claim 1.

9. a procedure manual creation unit that creates an operation procedure manual using the image at the time when the state of the machine changes and the content of the image; 2. The image discrimination device according to claim 1.

10. a video selection unit that accepts a selection of at least one video among the videos at the time when the data has changed, and sets the selected video as a representative video; 2. The image discrimination device according to claim 1.

11. the machine state dictionary unit associates an operation signal related to the machine as data used to detect a change in the state of the machine with an operation content related to the machine as a content of the data, The image acquisition unit acquires an image of an operation of the machine, The machine state acquisition unit acquires an operation signal related to the machine during the operation, the machine state conversion unit detects a change in the operation signal, and converts the change in the operation signal into an operation content related to the machine by referring to the machine state dictionary unit; The data linking unit selects an image at a time when the operation signal is changed, and links the image with the operation content.

2. The image discrimination device according to claim 1.

12. a machine status dictionary section for linking identification information of data relating to the status of a machine, which is both or at least one of a numerical control device and a machine tool, with the contents of the data; An image acquisition unit that acquires an image of the machine; a machine status acquisition unit that acquires data used to detect a change in the status of the machine, the data including at least one of an operation signal from an operator, a change in a variable by a machining program, a change in a variable from an embedded program, a change in a variable from an information processing device, a machining program command, and a sequence program command; Detecting a change in the state of the machine based on the data, and converting the change in the data into an operation content of the machine by referring to the machine state dictionary unit; a data linking unit that links the image when the state of the machine changes with the content of the data; An image recognition system comprising:

13. When executed by one or more processors, storing a machine status dictionary section that associates identification information of data relating to the status of a machine, which is both a numerical control device and a machine tool, or at least one of the machines, with the contents of the data; Obtaining an image of the machine; Acquire data used for detecting a change in the state of the machine, the data including at least one of an operation signal from an operator, a change in a variable by a machining program, a change in a variable from an embedded program, a change in a variable from an information processing device, a machining program command, and a sequence program command; determining whether a state of the machine has changed based on the data; Linking the image when the state of the machine changes with the content of the data; A storage medium that stores computer-readable instructions.

Images