Monitored-data processing device

Abstract

To disclose a technology for easily finding out a special moment in a moving image of an industrial machine.SOLUTION: A monitored-data processing device 30A according to an embodiment includes: a data storage unit 25 that stores, in a storage unit 17, data on moving images of a transfer press machine 50 captured by first and second monitoring cameras 11, 12, and chronological data on a state of the transfer press machine 50 during capturing of the images; and an image display unit 26A that generates chronological images 40, 46, 47 along a time axis from chronological date for a past fixed period and displays the images on a monitor 20. When arbitrary positions on the time axis of the chronological images 40, 46, 47 are selected from a console 23, moving images corresponding to the selected positions are displayed on the monitor 20.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present disclosure relates to a surveillance data processing device that acquires video data of industrial machinery captured by a surveillance camera and displays the video data on a monitor. [Background technology]

[0002] 2. Description of the Related Art There are known surveillance data processing devices that can select and play back any given moment in a video captured during a certain period of time in the past (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 7195729 (Fig. 1, Fig. 10, paragraph

[0089] ) Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the above-mentioned conventional monitoring data processing device, when, for example, an abnormality occurs or a change occurs in a predetermined measurement result, even if one tries to view a video of a special moment when the abnormality or change occurred, it takes time to find the special moment in the video. Therefore, this application discloses a technology that makes it possible to easily find a special moment in a video of an industrial machine. [Means for solving the problem]

[0005] One aspect of the present invention is a surveillance data processing device that includes a data recording unit that acquires and stores in a memory unit video data of an industrial machine captured by a surveillance camera and time-lapse data on the state or physical quantities of the industrial machine or the workpiece it manufactures during the capture, an image display unit that generates a time-lapse image from the time-lapse data for a certain period of the past, which visually shows changes in the time-lapse data along a time axis, and displays the image on a monitor, a console that can select any position along the time axis of the time-lapse image, and a video display unit that displays on the monitor the video of the industrial machine corresponding to the position selected on the console. Effect of the Invention

[0006] According to one aspect of the present invention, the monitoring data processing device displays on the monitor the transition of the state or physical quantity of the industrial machine or the workpiece produced by the industrial machine during the capture of video for a certain period of time in the past as a time-lapse image. If an abnormality or change is found in the industrial machine or the workpiece in the time-lapse image, a special position (i.e., a special moment) where such an abnormality or change was found in the time-lapse image can be selected on the console, and the video of the industrial machine corresponding to the selected special position (special moment) can be displayed on the monitor. In this way, according to one aspect of the present invention, special moments in the video of the industrial machine can be easily found and viewed. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a front view of a transfer press as an example of an industrial machine according to a first embodiment. [Diagram 2] Figure 2 is a block diagram of the transfer press and monitoring system. [Diagram 3] FIG. 3 is a block diagram of the monitoring data processing device. [Figure 4] Figure 4 shows a conceptual diagram of the first monitoring screen. [Diagram 5] Figure 5 shows a conceptual diagram of the second monitoring screen. [Figure 6] Figure 6 shows a conceptual diagram of the second monitoring screen. [Figure 7]Figure 7 shows a conceptual diagram of the third monitoring screen. [Figure 8] Figure 8 shows a conceptual diagram of the input operation screen. [Figure 9] FIG. 9 is a conceptual diagram of a search operation screen according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] [First embodiment] An embodiment of a monitoring system 10A including a monitoring data processing device 30A will be described with reference to Fig. 1 to Fig. 8. Fig. 1 shows a transfer press machine 50 as an example of an industrial machine to be monitored by the monitoring system 10A. This transfer press machine 50 manufactures a cylindrical workpiece from sheet metal using a plurality of punches 52 arranged side by side on the lower surface of a ram 51 and a plurality of dies 54 arranged side by side on the upper surface of a bolster 53.

[0009] Specifically, each time the ram 51 moves up and down, a blank, for example, in a circular or elliptical shape, is punched out of the sheet metal by the punch 52 at the left end in Fig. 1, and this blank is formed into a cylindrical intermediate workpiece. Each time the ram 51 moves up and down, the intermediate workpiece is successively transported by the transfer device 55 to the processing stage of the punch 52 on the right side in Fig. 1, where it is drawn or ironed, and finally formed into, for example, a rectangular cylindrical workpiece. A work measuring device 56 is provided at the right end of the transfer press machine 50 in Fig. 1, which automatically measures the height, vertical width, and horizontal dimensions of the completed workpiece, and the measurement results are input into a controller 60 of the transfer press machine 50 shown in Fig. 2.

[0010] As shown in FIG. 2, the controller 60 includes a drive circuit 62 for driving various electric devices of the transfer press machine 50, a control circuit 63 for controlling the drive circuit 62, a monitor 67, a console 68, and a warning light 69. The control circuit 63 includes a CPU 61A, a RAM 61B, a ROM 61C, an auxiliary storage device 61D (e.g., HDD or SDD), a real-time clock 61E (hereinafter, referred to as "RTC 61E"), a backup power supply 61F, and the like. When a continuous operation button provided on the console 68 is turned on, the CPU 61A executes a workpiece manufacturing program stored in the ROM 61C, and the transfer press machine 50 enters an operating state for sequentially manufacturing a plurality of workpieces as described above. When the manufacturing of a preset number of workpieces is completed or when an operation end button provided on the console 68 is turned on, the transfer press machine 50 enters a stopped state.

[0011] The transfer press 50 is also provided with a number of measuring instruments for detecting abnormalities, and the results of these measurements are stored in the auxiliary storage device 61D. Examples of such instruments include an ammeter 62A for detecting the current of the main motor 57, which is the drive source of the ram 51, and a temperature sensor 63A for detecting the temperature of the main motor 57. Measurement data from the ammeter 62A and the temperature sensor 63A are taken into the CPU 61A at a predetermined cycle, and are converted into time-lapse data (specifically, log data) with time data added by the RTC 61E, and are stored in the auxiliary storage device 61D. Measurement data from the above-mentioned workpiece measuring device 56 is also converted into time-lapse data with time data added, and are stored in the auxiliary storage device 61D.

[0012] In the above examples, current, temperature, and dimensions are given as examples of physical quantities measured by measuring instruments and workpiece measuring devices, but physical quantities that can change over time may be anything other than current, etc. Also, the time-series data does not have to be log data as long as it is data that can identify the time when the physical quantity was measured.

[0013] The CPU 61A compares the measurement results of each measuring device with a reference value, and when the measurement results exceed a first reference value, the CPU 61A lights the warning light 69 in a warning color, and when the measurement results exceed a second reference value, the CPU 61A lights the warning light 69 in an abnormal color to forcibly stop the transfer press machine 50 in an emergency. The CPU 61A also determines that an abnormality has occurred when an emergency stop button (not shown) provided on the console 68 is turned on or when a safety fence (not shown) surrounding the transfer press machine 50 is opened, and performs an emergency stop of the transfer press machine 50. When an emergency stop is performed, the transfer press machine 50 is not allowed to be restarted unless the abnormality is eliminated and a reset operation is performed. Furthermore, if the abnormality is not eliminated, even if a reset operation is performed, the operation is invalid.

[0014] The CPU 61A generates status data that specifies whether the state of the transfer press machine 50 is an operating state, an abnormal stop state with an abnormality, or a normal stop state without an abnormality. Then, at the timing when the state is switched, time data is obtained from the RTC 61E, and the time data is added to the status data to generate time-series data. Then, the time-series data of the status data is also stored in the auxiliary storage device 61D, similar to the time-series data of the measurement data described above. The controller 60 is also provided with a data output unit 60A for outputting the time-series data stored in the auxiliary storage device 61D to the outside.

[0015] As shown in Fig. 2, a monitoring system 10A of this embodiment for monitoring a transfer press machine 50 includes, for example, first and second monitoring cameras 11 and 12, and a personal computer 13. The first monitoring camera 11 is installed, for example, so as to capture an image of a processing stage in the transfer press machine 50 where a blank is punched out from a metal plate. The second monitoring camera 12 is installed, for example, so as to capture an image of a plurality of processing stages where an intermediate workpiece is drawn. The first and second monitoring cameras 11 and 12 are each equipped with, for example, an RTC (not shown), and output the captured video as video data with time data.

[0016] The personal computer 13 includes a CPU 14, a RAM 15, a ROM 16, an auxiliary storage device 17, an RTC 18, a backup power supply 19, a monitor 20, and a console 23 consisting of a mouse 21 and a keyboard 22. The personal computer 13 is also connected to the first and second surveillance cameras 11, 12 and a controller 60 of the transfer press machine 50 by wire or wirelessly.

[0017] The personal computer 13 functions as a monitoring data processing device 30A shown in the block diagram of FIG. 3 by the CPU 14 executing a monitoring data program installed in the auxiliary storage device 17.

[0018] The surveillance data processing device 30A includes a data recording unit 25, an image data generating unit 26, a moving image capturing unit 27, and a display control unit 28. The image data generating unit 26 and the display control unit 28 form an image display unit 26A, and the moving image capturing unit 27 and the display control unit 28 form a moving image display unit 27A.

[0019] The data recording unit 25 acquires video data output by the first and second monitoring cameras 11, 12 and stores it in the auxiliary storage device 17. At this time, the video data is divided into video files of a predetermined period (for example, 1 minute, 10 minutes, etc.) and stored in the auxiliary storage device 17. The data recording unit 25 also acquires each of the time-lapse data of the measurement data, the measurement data, and the status data described above from the controller 60 of the transfer press 50 and stores it in the auxiliary storage device 17. The time-lapse data is obtained while the video stored in the auxiliary storage device 17 is being captured, and is stored in the auxiliary storage device 17 as a time-lapse data file linked to the video file.

[0020] The image data generating unit 26 generates a time-lapse image based on time-lapse data for a certain period of time stored in the auxiliary storage device 17. The image data generating unit 26 also acquires a plurality of template screens stored in the auxiliary storage device 17, and embeds the time-lapse image in a predetermined display area of ​​the template screen to generate image data of a plurality of monitoring / operation screens including the first to third monitoring screens G1 to G3 and the input operation screen G4 exemplified in Figs. 4 to 8. The image data of the monitoring / operation screens is then provided to the display control unit 28, which displays the monitoring / operation screens corresponding to the provided image data on the monitor 20. At this time, the display control unit 28 incorporates a video based on the video data from the video capture unit 27 into a predetermined display area provided on the monitoring / operation screen and displays it on the monitor 20.

[0021] Specifically, as shown in Figs. 4 to 8, the first to third monitoring screens G1 to G3 and the input operation screen G4 (collectively referred to as "monitoring and operation screens G1 to G4") display the following in common. That is, the monitoring and operation screens G1 to G4 are provided with a time display section A1 at the upper left end, and a play / stop button A2 to the right of it. By turning on the play / stop button A2 with the mouse 21, the button switches between a state in which a play mark icon is displayed as shown in Fig. 4 and a state in which a stop mark icon is displayed as shown in Fig. 6. The time display section A1 will be explained later.

[0022] A range from the position immediately to the right of the play / stop button A2 to the right end of the monitoring / operation screens G1 to G4 includes a plurality of screen selection buttons B1, B2, B3, and B4 that can be turned on by the console 23. When the screen selection button B1 labeled "operation history 1" is turned on by the mouse 21, the image data generating unit 26 assigns image data of the first monitoring screen G1 shown in Fig. 4 to the display control unit 28, when the screen selection button B2 labeled "operation history 2" is turned on, the image data generating unit 26 assigns image data of the second monitoring screen G2 shown in Fig. 5 to the display control unit 28, when the screen selection button B3 labeled "operation history 3" is turned on, the image data of the third monitoring screen G3 shown in Fig. 7 to the display control unit 28, and when the screen selection button B4 labeled "input screen" is turned on, the image data of the input operation screen G4 shown in Fig. 8 to the display control unit 28. Moreover, in an initial state in which the console 23 is not being operated, the image data generating unit 26 provides the image data of the first monitoring screen G1 shown in FIG.

[0023] The upper right corner of the monitoring / operation screens G1 to G4 is provided with a first lighting section C1 indicating whether the current state of the transfer press machine 50 is in operation or stopped, and a second lighting section C2 indicating whether an alarm is occurring in the transfer press machine 50.

[0024] Each of the monitoring / operation screens G1 to G4 is configured as follows. As shown in Fig. 4, a status display bar 40 is displayed as a "time-lapse image" at the bottom of the first monitoring screen G1. The status display bar 40 is a bar extending horizontally, and the image data generating unit 26 generates the status display bar 40 based on the time-lapse data of the status data stored in the auxiliary storage device 17.

[0025] In detail, the total length of the status display bar 40 corresponds to a certain period of time in the past, time elapses from left to right, and any position in the longitudinal direction of the status display bar 40 represents any moment in the certain period of time in the past. In addition, dates and times corresponding to multiple positions on the status display bar 40 are written below the status display bar 40. In addition, the status display bar 40 is color-coded in three colors according to the status of the transfer press machine 50. In FIG. 4, the dotted hatching of the status display bar 40 (the hatching of the portion marked with reference numeral 40A in FIG. 4) is a first color, the cross hatching (the hatching of the portion marked with reference numeral 40B in FIG. 4) is a second color, and the diagonal hatching (the hatching of the portion marked with reference numeral 40C in FIG. 4) is a third color. The first color means that the transfer press machine 50 is in an operating state, the second color means that the transfer press machine 50 is in an abnormal stop state, and the third color means that the transfer press machine 50 is in a normal stop state.

[0026] The image data generating unit 26 displays a slider 41 superimposed on the status display bar 40. The slider 41 has a shape of, for example, a vertical line extending over the entire vertical width of the status display bar 40 with triangles superimposed on both ends. The slider 41 can be slid to any position on the status display bar 40 in response to an operation of the console 23. Specifically, the slider 41 can be slid by dragging a pointer displayed on the monitor 20 over the slider 41 by operating the mouse 21, or by pressing an arrow key on the keyboard 22. The date and time corresponding to the position of the slider 41 on the status display bar 40 is displayed on the time display section A1 described above.

[0027] On the first monitoring screen G1, video display windows 43 and 44 are arranged side by side above the status display bar 40. The video display window 43 on the left side in FIG. 4 is for displaying a video captured by the first monitoring camera 11, and the video display window 44 on the right side is for displaying a video captured by the second monitoring camera 12.

[0028] In a state where the play / stop button A2 displays a play mark icon, that is, in a state where playback is not being performed, so-called real-time video currently being captured by the first and second surveillance cameras 11 and 12 is displayed in the video display windows 43 and 44. Specifically, the video capture unit 27 acquires video data from the first and second surveillance cameras 11 and 12 through the data recording unit 25 and provides the video data to the display control unit 28, whereby the real-time video is displayed in the video display windows 43 and 44.

[0029] When the play mark icon of the play / stop button A2 is turned on and the play / stop button A2 switches to a stop mark icon, a video from the date and time displayed in the time display section A1, that is, the date and time corresponding to the position of the slider 41 in the status display bar 40, is displayed in the video display windows 43, 44.

[0030] Specifically, the video import unit 27 obtains a video file including the date and time corresponding to the position of the slider 41 in the status display bar 40 from the auxiliary storage device 17 and passes it to the display control unit 28. The display control unit 28 then plays a video from the date and time corresponding to the position of the slider 41 based on the video file and displays it in the video display windows 43, 44.

[0031] During playback of these videos, slider 41 moves on status display bar 40 in accordance with the progress of the video, and the date and time displayed in time display section A1 also changes. Furthermore, by dragging slider 41 with mouse 21 to move its position on status display bar 40, the video displayed in video display windows 43 and 44 changes accordingly.

[0032] An alarm display section 45 is provided above the video display windows 43 and 44 on the first monitoring screen G1. This alarm display section 45 has columns for "Alarm ID," "Date and Time," "Warning Level," "Message," etc., and displays the number of an alarm that occurred during a certain period of the past corresponding to the status display bar 40, the date and time of occurrence, the warning level of the alarm, a message, etc. In addition, a scroll operation section 45A is provided at the right end of the alarm display section 45, and by operating the scroll operation section 45A, the entire display content on the alarm display section 45 can be viewed.

[0033] Next, the second monitoring screen G2 will be described with reference to Figs. 5 and 6. As shown in Fig. 5, instead of the moving image display windows 43 and 44 of the first monitoring screen G1, the second monitoring screen G2 displays graphs 46 and 47 as "time-lapse images" arranged vertically. The lower graph 46 has a horizontal axis representing time and a vertical axis representing the current value of the main motor 57. On the other hand, the upper graph 47 has a horizontal axis representing time and a vertical axis representing the temperature of the main motor 57. The horizontal time axis of these graphs 46 and 47 coincides with the longitudinal time axis of the status display bar 40. That is, the graphs 46 and 47 and the status display bar 40 are displayed so that when a vertical line (not shown) perpendicular to the horizontal axis of the graphs 46 and 47 is placed at any position on the horizontal axis, the graphs 46 and 47 and the status display bar 40 are all displayed at the same date and time specified at the positions where the vertical line intersects with the graphs 46 and 47 and the status display bar 40, respectively.

[0034] In the second monitoring screen G2, when the play / stop button A2 displays a play mark icon, the alarm display section 45 described in the first monitoring screen G1 is displayed above the graph 47. Then, when the play mark icon of the play / stop button A2 is turned on and switches to a stop mark icon as shown in Fig. 6, video display windows 88, 89 are displayed in place of the alarm display section 45. The video display windows 88, 89 are reduced versions of the video display windows 43, 44 of the first monitoring screen G1 described above, and in these video display windows 88, 89, video from the date and time displayed in the time display section A1 is displayed, similar to the video display windows 43, 44.

[0035] Next, the third monitoring screen G3 will be described with reference to FIG. 7. As shown in the figure, instead of the status display bar 40 and the video display windows 43, 44 of the first monitoring screen G1, the third monitoring screen G3 displays graphs 47, 48A to 48C as "time-lapse images" arranged vertically. The graph 47 arranged at the top is the same as the graph 47 of the second monitoring screen G2 described above. The second graph 48A from the top shows the deviation amount of the height dimension of the work measured by the above-mentioned work measuring device 56 from the target value on the vertical axis and time on the horizontal axis, the third graph 48B shows the deviation amount of the vertical and horizontal dimensions of the work from the target value on the vertical axis and time on the horizontal axis, and the fourth graph 48C shows the deviation amount of the vertical and horizontal dimensions of the work from the target value on the vertical axis and time on the horizontal axis. These graphs 47, 48A to 48C are displayed with the horizontal axes aligned, and a horizontal axis coordinate bar 80 common to them is displayed below the graph 48C.

[0036] Date and time are added at regular intervals to the horizontal coordinate bar 80. A slider 81 is also displayed superimposed on the horizontal coordinate bar 80. The slider 81 is, for example, arranged on the horizontal coordinate bar 80 and has a shape of a vertical line extending directly upward from a black dot, and has the same function and operation as the slider 41 on the first monitoring screen G1.

[0037] Similarly to the second monitoring screen G2, in the third monitoring screen G3, when the play / stop button A2 displays a play mark icon, an alarm display section 45 is displayed above the graph 47. When the play mark icon is turned on and switched to a stop mark icon, video display windows 88, 89 are displayed (not shown) in place of the alarm display section 45, and videos from the date and time displayed in the time display section A1 are displayed in these video display windows 88, 89.

[0038] Next, the input operation screen G4 will be described with reference to Fig. 8. This input operation screen G4 is for manually inputting events that occurred during a certain period of time in the past. For this reason, the input operation screen G4 is provided with an input operation window 29 in place of one of the moving image display windows 43 of the first monitoring screen G1. Also, in place of the other moving image display window 44, an image display window 83 for displaying a part of a moving image as a still image is provided.

[0039] Input operation window 29 is provided with a time display section 29A, an event box 29B, and a remarks box 29C. Time display section 29A displays the date and time according to the position of slider 41 in status display bar 40, similar to time display section A1. A still image at the date and time displayed in time display section 29A is displayed in image display window 83. The still image in image display window 83 can be switched between a still image captured by first surveillance camera 11 and a still image captured by second surveillance camera 12 by a display switching button 84 arranged above image display window 83.

[0040] Candidates for event names to be registered are listed in the event box 29B. By placing the pointer over one of the listed event names to display a cursor, and then pressing the registration button 29D below the event box 29B in this state, the event is registered as having taken place on the date and time displayed in the time display section 29A. The registered event name and date and time are then displayed in the "Alarm ID" and "Date and Time" columns of the alarm display section 45.

[0041] In addition, the remarks box 29C lists candidates for the contents of the remarks to be registered. As in the case of the event box 29B, when one of the contents of the remarks is selected and the registration button 29D below the remarks box 29C is turned on, the content of the remarks is registered as having been performed on the date and time displayed in the time display section 29A. The registered content of the remarks and the date and time are displayed in the "Message" and "Date and Time" columns of the alarm display section 45.

[0042] It should be noted that, with the cursor displayed in the event box 29B or remarks box 29C, it is possible to enter characters on the keyboard 22 and register something other than a list. Also, in this input operation screen G4, as in the second and third monitoring screens G2 and G3, it is possible to make video display windows 88 and 89 appear and display a video instead of the alarm display section 45 by operating the play / stop button A2. When a video is displayed in the video display windows 88 and 89, the video is also displayed in the image display window 83.

[0043] The configuration of this embodiment has been described above. Next, the effects of this embodiment will be described.

[0044] For example, if the transfer press machine 50 has stopped during a certain period of time in the past, for example, by displaying the first monitoring screen G1 on the monitor 20 by the monitoring data processing device 30A, the transition of the state of the transfer press machine 50 during the certain period of time in the status display bar 40 can be visually confirmed. At the same time, alarms that occurred during the certain period of time in the past can be confirmed in the alarm display section 45. At this time, a real-time video of the transfer press machine 50 can be simultaneously confirmed in the video display windows 43 and 44. If a user wishes to confirm a video of the moment when the transfer press machine 50 abnormally stops, the user should move the slider 41 to a position in the status display bar 40 immediately before the transfer press machine 50 becomes in an abnormal stop state (the portion indicated by the symbol 40B in FIG. 4) and turn on the play icon of the play / stop button A2. Then, a video of the moment when the transfer press machine 50 abnormally stops is displayed in the video display windows 43 and 44.

[0045] Furthermore, when further investigation of the cause of the abnormal stop is to be performed, the screen selection button B2 is turned on to display the second monitoring screen G2 on the monitor 20, as shown in Fig. 5. Then, graphs 46, 47 showing the changes over time in the current and temperature of the main motor 57 of the transfer press 50 are displayed with the time axis coinciding with the status display bar 40.

[0046] Therefore, for example, if a point where the current or temperature of the main motor 57 changes is found on the graphs 46, 47 during the operating state (part indicated by reference symbol 40A in FIG. 5) before the transfer press machine 50 abnormally stops, the slider 41 is moved to the position immediately before such a change point, and the play icon of the play / stop button A2 is turned on. Then, instead of the alarm display unit 45 shown in FIG. 5, video display windows 88, 89 appear as shown in FIG. 6, and a video including the moment when the current or temperature changes is displayed. This may make it possible to find the cause of the change in current or temperature. Specifically, for example, it may be possible to find from the video a situation in which the sheet metal, which is the material of the workpiece, is deformed more than normal, or the supply of lubricating oil is stagnant and smoke is generated, as the cause of the change in current or temperature.

[0047] For example, if the transfer press 50 does not stop due to an abnormality, but measures such as adjusting the lubricant or slowing down the operation speed of the transfer press 50 are taken, the measures taken can be registered as history by turning on the screen selection button B4 to display the input operation screen G4 shown in Fig. 8 on the monitor 20. Then, it can be easily confirmed whether or not the abnormality was avoided by taking the predetermined measures.

[0048] When a dimensional change occurs in the quality of the workpiece, the screen selection button B3 is turned on to display the third monitoring screen G3 shown in Fig. 7 on the monitor 20. Then, the progress of the deviation amount from the target value of each dimension of the workpiece height, vertical width, and horizontal width is displayed as graphs 48A to 48C. If a point where any dimension changes is found on the graphs 48A to 48C, the cause of the change may be found by moving the slider 81 to the position just before such a change point and turning on the play icon of the play / stop button A2 to display a moving image.

[0049] In this way, according to the monitoring data processing device 30A of the present embodiment, the transition of the state and physical quantity of the transfer press machine 50 and the workpiece manufactured by it during the capture of video for a certain period in the past is displayed on the monitor 20 as a time-lapse image (status display bar 40 and graphs 46, 47, 48A to 48C). Then, when an abnormality or change is found in the transfer press machine 50 or the workpiece on the time-lapse image, a special position (special moment) where such an abnormality or change was found on the time-lapse image can be selected on the console 23, and a video of the selected special position (special moment) can be displayed on the monitor 20. In this way, according to the monitoring data processing device 30A of the present embodiment, a special moment in the video of the transfer press machine 50 can be easily found and viewed.

[0050] 5 and 7, multiple types of time-lapse images (status display bar 40 and graphs 46, 47, 48A-48C) can be displayed together in line with the time axis, making it possible to grasp abnormalities and changes from multiple angles and find special moments in the video. Also, since the time-lapse images and the time axis are aligned and the date and time are displayed on monitor 20, it is possible to determine the cause of disturbances, such as power outages and earthquakes, based on the time.

[0051] [Second embodiment] The surveillance data processing device of this embodiment is capable of displaying a search operation screen G5 shown in Fig. 9 on the monitor 20, in addition to the functions of the surveillance data processing device 30A of the first embodiment. Specifically, a screen selection button B5 is provided on all of the surveillance / operation screens G1 to G5 including the search operation screen G5, and the search operation screen G5 is displayed on the monitor 20 by turning on the screen selection button B5.

[0052] In the search operation screen G5, a search operation window 87 is provided in place of the input operation window 29 of the input operation screen G4, a status display bar 85 different from the status display bar 40 of the input operation screen G4 is provided at the bottom, and a search result display section 86 is provided in place of the alarm display section 45. Also, a moving image display window 44 is provided in place of the image display window 83 of the input operation screen G4.

[0053] In the search operation window 87, an alarm box 87A, an event box 87B, and a remarks box 87C are arranged side by side, and among them, the event box 87B and the remarks box 87C have the same contents as the event box 29B and the remarks box 29C of the input operation screen G4. Also, the alarm box 87A lists alarm name selection candidates. Then, when an item in at least one of the alarm box 87A, the event box 87B, and the remarks box 87C is selected and the search button 87D is turned on, the search result display section 86 lists items that match the selected item from the history of alarms, events, and remarks over a certain period of time in the past.

[0054] The search result display section 86 has columns for search item, date and time, and mark, and the search item column displays the contents of the alarm, event, and remarks of the search item that was found, and the date and time column displays the occurrence date and time of the alarm, etc. Also, a mark is automatically added to the mark column to distinguish the listed items.

[0055] Before a search is performed, the status display bar 85 has the shape of, for example, a white version of the status display bar 40. Then, when the search results are listed in the search result display section 86, a mark in the list is displayed superimposed on the corresponding date and time position on the status display bar 85. As a result, the status display bar 85 becomes a time-lapse image showing the change over time in the status of the transfer press machine 50.

[0056] Then, when slider 41 is moved to any position on status display bar 85 and play / stop button A2 is turned on, video of either the first or second surveillance camera 11, 12 corresponding to slider 41 is displayed in video display window 44 next to search operation window 87. Also, display switch button 84 above image display window 83 allows the video displayed in video display window 44 to be switched from one of the first or second surveillance camera 11, 12 to the other.

[0057] [Other embodiments] In the first embodiment, the CPU 14 of the personal computer 13 functions as the monitoring data processing device 30A by executing a monitoring data program installed in the auxiliary storage device 17; however, for example, the monitoring data program may be executed in a cloud server, and the above-mentioned monitoring and operation screens G1 to G5 may be displayed on the monitor of the user terminal through communication between the cloud server and a user terminal such as the personal computer 13.

[0058] In the above embodiment, the data recording unit 25 directly acquires the video data output by the first and second surveillance cameras 11, 12 and the time-lapse data output by the controller 60, but the video data and time-lapse data may be uploaded to the cloud and the uploaded data may be downloaded and acquired by the data recording unit 25, or a cloud server may function as the data recording unit and store the video data and time-lapse data in the cloud's memory unit.

[0059] The console 23 in the above embodiment is the mouse 21 and the keyboard 22, but may be a touch panel.

[0060] In the first embodiment, the transfer press machine 50 is exemplified as an industrial machine, but any industrial machine may be used.

[0061] <Additional Notes> Hereinafter, a group of features according to the present disclosure including features extracted from the above embodiment will be described, while indicating effects, etc. as necessary. Note that, for ease of understanding, the symbols of the corresponding configurations in the above embodiment will be indicated in parentheses below, but these group of features are not limited to the configurations indicated by the symbols in parentheses.

[0062] [Feature 1] a data recording unit (25) that acquires video data of an industrial machine (50) captured by a surveillance camera (11, 12) and time-lapse data on a state or physical quantity of the industrial machine (50) or a workpiece manufactured by the industrial machine (50) during the capture, and stores the data in a memory unit (17); an image display unit (26A) that generates time-lapse images (40, 46, 47, 48A to 48C) that visually show changes in the time-lapse data along a time axis from the time-lapse data for a certain period of the past, and displays the images on a monitor (20); a console (23) that allows selection of any position along the time axis of the time-lapse images (40, 46, 47, 48A to 48C); and a video display unit (27A) that displays on the monitor (20) the video of the industrial machine (50) that corresponds to the position selected on the console (23).

[0063] [Feature 2] The monitoring data processing device (30A) according to feature 1, wherein the time-lapse data stored in the memory unit (17) includes first time-lapse data that enables determination as to whether the state of the industrial machinery (50) is in an operating state or a stopped state, and the time-lapse image (40) based on the first time-lapse data is generated so as to indicate whether the industrial machinery (50) is in an operating state or a stopped state in a manner that enables determination as to whether the industrial machinery (50) is in an operating state or a stopped state.

[0064] [Feature 3] The monitoring data processing device (30A) according to feature 2, wherein the stop state of the industrial machinery (50) in the first time-lapse data includes an abnormal stop state in which an abnormality is present and a normal stop state in which no abnormality is present, and the time-lapse image (40) based on the first time-lapse data is generated so as to indicate whether the stop state is the abnormal stop state or the normal stop state in a distinguishable manner.

[0065] [Feature 4] The monitoring data processing device (30A) according to any one of features 1 to 3, wherein the time-lapse image (40) is a bar extending along the time axis, which is color-coded according to differences in the state or physical quantity of the industrial machine (50) or the workpiece.

[0066] [Feature 5] The monitoring data processing device (30A) according to any one of features 1 to 4, wherein the time-lapse data stored in the memory unit (17) includes second time-lapse data of a physical quantity of the industrial machine (50) or the workpiece, and the time-lapse images (46, 47, 48A to 48C) based on the second time-lapse data are graphs (46, 47, 48A to 48C) with the time axis as the horizontal axis and the physical quantity as the vertical axis.

[0067] [Feature 6] The surveillance data processing device (30A) according to any one of Features 1 to 5, wherein the data recording unit (25) stores a plurality of types of the time-lapse data in the memory unit (17), and the image display unit (26A) generates a plurality of types of the time-lapse images (40, 46, 47, 48A to 48C) from the plurality of types of the time-lapse data and displays the plurality of types of the time-lapse images (40, 46, 47, 48A to 48C) together on the monitor (20) in line with the time axis.

[0068] [Feature 7] The surveillance data processing device (30A) according to any one of features 1 to 6, wherein the data recording unit (25) stores date and time data of the image capture date and time of the video in the memory unit (17), and the image display unit (26A) aligns the time axis with the time-lapse images (40, 46, 47, 48A to 48C) and displays a date and time based on the date and time data on the monitor (20).

[0069] [Feature 8] The monitoring data processing device (30A) according to any one of features 1 to 7, wherein the image display unit (26A) displays a slider (41, 81) on the monitor (20) together with the time-lapse images (40, 46, 47, 48A to 48C) and moves the slider (41, 81) along the time axis in response to an operation of the console (23).

[0070] [Feature 9] The surveillance data processing device (30A) according to any one of features 1 to 8, wherein the data recording unit (25) acquires data of multiple videos captured simultaneously by the multiple surveillance cameras (11, 12) and stores the data in a memory unit (17), and the video display unit (27A) displays on the monitor (20) the multiple videos corresponding to a position selected on the console (23).

[0071] According to the monitoring data processing device of the above-mentioned feature 1, the transition of the state or physical quantity of the industrial machine or the workpiece manufactured by the industrial machine during the capture of video for a certain period of time in the past is displayed on the monitor as a time-lapse image. Then, when an abnormality or change is found in the industrial machine or the workpiece in the time-lapse image, a special position (i.e., a special moment) where such an abnormality or change was found in the time-lapse image can be selected on the console, and the video of the industrial machine corresponding to the selected special position (special moment) can be displayed on the monitor. In this way, according to one aspect of the present invention, a special moment in the video of the industrial machine can be easily found and viewed.

[0072] The time-lapse data may be any data related to the industrial machine or the workpiece manufactured by the industrial machine, as long as it can change during the capture of the video. Examples of the time-lapse data of the state of the industrial machine include, in addition to the above-mentioned features 2 and 3, data for determining whether the machine is in an automatic or manual operation state, data for determining whether the machine is in an energy-saving or high-speed operation state, and the like. Examples of the time-lapse data of the state of the workpiece include, for example, data for determining whether the workpiece is in an abnormal color state or a normal color state when the color of the workpiece is an issue, and data for determining whether the workpiece is in a burr state or a burr-free state when the burr of the workpiece is an issue. Examples of the time-lapse data of the physical quantity of the industrial machine include, for example, data on the temperature, oil pressure, air pressure, current, voltage, magnetism, noise, vibration, and the like of the industrial machine. Examples of the time-lapse data of the physical quantity of the workpiece include, for example, data on the dimensions, mass, rigidity, hardness, temperature, and the like of the entire workpiece or each part of the workpiece. Furthermore, the time-lapse image may be any image that visually shows the change in the time-lapse data along the time axis, examples of which include a bar such as that shown in Feature 4 above, or a graph such as that shown in Feature 5 above.

[0073] The time-lapse data stored in the storage unit may be of one type or of multiple types. As in the surveillance data processing device of feature 6, if multiple types of time-lapse data are stored in the storage unit and multiple types of time-lapse images based on the multiple types of time-lapse data are displayed together on the monitor in a time-aligned manner, special moments in the video can be found from multifaceted judgments based on the multiple types of time-lapse images.

[0074] In addition, in the surveillance data processing device of feature 7, the date and time are displayed on the monitor by matching the time axis with the time-lapse image, so that it is possible to determine the cause of a disturbance, such as a power outage or earthquake, based on the time.

[0075] In the surveillance data processing device of feature 8, a slider is displayed on the monitor together with the time-lapse image, and the slider can be moved along the time axis to select any position on the time-lapse image, making it easy to select a position on the time-lapse image.

[0076] The surveillance data processing device of feature 9 can simultaneously view multiple videos from selected times to determine the cause of an abnormality.

[0077] In addition, although this specification and drawings disclose specific examples of the technology included in the scope of the claims, the technology described in the claims is not limited to these specific examples, but includes various modifications and variations of the specific examples, as well as parts of the specific examples taken alone. [Explanation of symbols]

[0078] 11 First Surveillance Camera 12 Second Security Camera 17 Auxiliary storage device (storage unit) 20 Monitor 23 Console 25 Data recording section 26A Image display section 27A Video display section 30A Monitoring data processing device 40,85 Status bar (time-lapse image) 41,81 Slider 46, 47, 48A-48C Graphs (time-lapse images) 50 Transfer press machine (industrial machinery) 80 Horizontal axis coordinate bar

Claims

1. A data recording unit that acquires video data of the industrial machine captured by a surveillance camera and time-series data of the state or physical quantity of the industrial machine or the workpiece manufactured by the industrial machine during the capture, and stores the data in a storage unit; an image display unit that generates a time-lapse image that visually indicates a change in the time-lapse data along a time axis from the time-lapse data for a certain period of time in the past, and displays the image on a monitor; a console capable of selecting any position along a time axis of the time-lapse image; a video display unit that displays, on the monitor, the video of the industrial machine corresponding to a position selected on the console.

2. the time-series data stored in the storage unit includes first time-series data that enables determination of whether a state of the industrial machine is in an operating state or a stopped state, The surveillance data processing apparatus according to claim 1 , wherein the time-lapse image based on the first time-lapse data is generated so as to distinguishably indicate whether the vehicle is in the operating state or the stopped state.

3. the stop state of the industrial machine in the first time-series data includes an abnormal stop state in which an abnormality is present and a normal stop state in which no abnormality is present, 3. The monitoring data processing apparatus according to claim 2, wherein the time-lapse image based on the first time-lapse data is generated so as to indicate whether the abnormal stop state or the normal stop state is distinguishable.

4. 2. The monitoring data processing device according to claim 1, wherein the time-lapse image has a bar extending along the time axis, the bar being color-coded according to differences in the state or physical quantity of the industrial machine or the workpiece.

5. The time-series data stored in the storage unit includes second time-series data of a physical quantity of the industrial machine or the workpiece, 2. The monitoring data processing apparatus according to claim 1, wherein the time-lapse image based on the second time-lapse data is a graph with the time axis as the horizontal axis and the physical quantity as the vertical axis.

6. The data recording unit stores a plurality of types of the time-lapse data in the storage unit, 2. The surveillance data processing apparatus according to claim 1, wherein the image display unit generates a plurality of types of the time-lapse images from a plurality of types of the time-lapse data, and displays the plurality of types of time-lapse images together on the monitor in accordance with the time axis.

7. The data recording unit stores date and time data of the image capture date and time of the video in the storage unit, 2. The surveillance data processing apparatus according to claim 1, wherein the image display unit displays the date and time based on the date and time data on the monitor by matching the time-lapse image with the time axis.

8. 8. The surveillance data processing apparatus according to claim 1, wherein said image display section displays a slider on said monitor together with said time-lapse image, and moves said slider along said time axis in response to an operation on said console.

9. The data recording unit acquires data of a plurality of videos simultaneously captured by the plurality of surveillance cameras and stores the data in a storage unit; 8. The surveillance data processing apparatus according to claim 1, wherein said video display unit displays, on said monitor, said plurality of videos corresponding to a position selected on said console.

Images