System and Program

Abstract

The object is to provide a device or the like capable of acquiring image data that allows easy confirmation of the contents of images taken before and after an event occurs. [Solution] The device is equipped with a control means that, upon receiving information indicating the occurrence of an event from outside, controls the storage of image data captured by the imaging means at least at a predetermined time before and after the time the event occurred in a storage means.

Description

Technical Field

[0001] The present invention relates to an apparatus, a system including the apparatus, a program, and the like.

Background Art

[0002] There has been proposed a surveillance camera including a lens unit and storing imaging data captured by the lens unit in a removable storage medium (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Normally, in such a surveillance camera, in order to continuously image a monitoring target at all times, it is necessary to play back a long video from the beginning to confirm the shooting content at the time of abnormality, and search for and confirm a problem scene by fast-forwarding or the like. For this reason, the confirmation work took a very long time.

[0005] Therefore, an object of the present invention is to provide an apparatus or the like capable of acquiring image data that can easily confirm the shooting content before and after an event occurs. This object is achieved by, for example, a combination of features described in independent claims in the claims. Dependent claims define, for example, further advantageous specific examples of the present invention.

Means for Solving the Problems

[0006] (1) In order to solve the above problems, the present invention preferably provides an apparatus including control means for performing control to cause storage means to store image data captured by imaging means at a predetermined time before and after the time when an event occurs, triggered by receiving information indicating the occurrence of the event from the outside.

[0007] In this way, it is possible to store the image data captured by the imaging means before and after the occurrence of the event, facilitating the confirmation of the content of the images captured before and after the time when the event occurs. For example, for the confirmation of the images, it is preferable to provide reproducing means for reproducing the stored image data in a visible manner to the user. The reproducing means may be provided integrally with the control means or separately. Further, in the present invention, it is preferable to include the imaging means together with the control means. The imaging means may always perform imaging regardless of the occurrence of the event and temporarily store image data over a predetermined period of time. Then, when the control means receives information indicating the occurrence of the event, the control means may perform control to cause the image data captured at a predetermined time before and after that to be stored in the storage means. Further, in the present invention, the storage means may be built in the apparatus in which the control means is provided, but it may be provided detachably from the apparatus, for example, in the form of a memory card, a hard disk drive, or the like.

[0008] The "event" may be, for example, something that occurs when an abnormality occurs. For example, it may be various events, and in particular, it may be something that occurs due to a failure in the operation of a machine tool operating on a factory production line, vibrations different from normal detected by the device, changes or abnormalities in the state detected by an external sensor, and the like.

[0009] The "information indicating the occurrence of an event" may be, for example, information indicating a change in status or the occurrence of an abnormality. Specifically, for example, information generated when a machine tool detects a failure in an operation may be the "information indicating the occurrence of an event." In particular, an alarm signal may be the "information indicating the occurrence of an event." An alarm signal generated when a machine tool detects a failure in an operation may be the "information indicating the occurrence of an event." For example, a signal from a rotating light connected to the machine tool (e.g., a status signal indicating that the rotating light is lit) may be the "information indicating the occurrence of an event." The "information indicating the occurrence of an event" may also be a signal generated by an external device. The device may be configured to include trigger receiving means for receiving these signals as trigger signals. The control means may then control the storage of image data captured by the imaging means in response to a change in the state of the trigger signal. The "information indicating the occurrence of an event" may not only be received from an external device, but may also be configured to detect the occurrence of an event internally, transmit the "information indicating the occurrence of an event," and receive the "information indicating the occurrence of an event" generated internally.

[0010] The "time when the event occurred" may be, for example, the time immediately after information indicating the occurrence of the event is received from outside.

[0011] The "image data" may be captured within a range that allows the cause of the event to be investigated.

[0012] The "image" may be, for example, a still image, but is particularly preferably a moving image. The image may also be, for example, a 2D image or a 3D image. For example, the image may be a black and white image or a color image.

[0013] (2) Preferably, in the present invention, the control means may control to embed information for identifying an event in a file storing the image data and store it in the storage means. By doing so, it becomes possible to extract the information for identifying the event from the file storing the image data. Therefore, it becomes possible to obtain the information for identifying the event only by exchanging the file storing the image data, without exchanging a file containing the information for identifying the event separately from the image data. For example, when an image stored by a device arranged in a factory at a remote location at the time of an event occurrence is sent collectively to a management department or the like and the content of the image is confirmed by the management department, it takes labor to send a large number of related files collectively, and also on the side that receives the files, it takes a great deal of labor to manage the set of files separately. In such a case, with the above configuration, it becomes possible to eliminate the need to manually input information for identifying the event, or to confirm the correspondence relationship between the file recording the information for identifying the event and the file recording the image data on both the transmission side and the reception side, etc., reducing the labor on both the side that transmits the files captured by the device and the side that confirms the sent images.

[0014] (3-1) For example, the control means may control to store the information for identifying the event by using at least a part of the file name. In this way, without opening the file, the content of the information for identifying the event can be grasped from the file name. For example, just by displaying the file name, without performing time-consuming operations such as extracting the information for identifying the event or the image data from the file and displaying it, the content of the file can be grasped. (3-2) As another example, the control means may control to embed the information for identifying the event as a watermark in the image captured by the imaging means. In this way, it can be made difficult to falsify the information for identifying the event. In particular, it is preferable to adopt a configuration in which the information for identifying the event is embedded without increasing the file size and without having a visible impact on the image. (3-3) As yet another example, the control means may control to embed the information for identifying the event as additional information in the file storing the image data. In this way, the information for identifying the event can be embedded without having a visible impact on the image. Note that the "additional information" refers to information other than the image itself, such as a header, a footer, etc., in the file storing the image data. Of course, for example, the configurations in (3-1) to (3-3) can be arbitrarily combined in plurality. In particular, it is desirable to adopt a configuration including any two of (3-1) to (3-3), and most desirably, for example, a configuration including the configurations of (3-1), (3-2), and (3-3). For example, the information for identifying the first event is used for at least a part of the file name, the information for identifying the second event is embedded as a watermark in the image, and the information for identifying the third event is embedded as additional information in the file storing the image data. For example, the information for identifying the first to third events may be the same information, but in particular, it is preferable to adopt a configuration including different information. In particular, these may be completely different information, but in particular, it is preferable to include the same information for some of the information. In this way, for the same information, it can be easily visually recognized by the user from the file name, it is made difficult to be falsified, and it can be easily detected by comparing the information for identifying the first to third events.Particularly, for some information, it is preferable to adopt a configuration in which the same information is stored as information in different expression forms. For example, the information used for the file name is a character string information formed by arranging, in this order, a location code consisting of, for example, an alphanumeric sequence or the like that can uniquely identify the location corresponding to the location where the event occurred, the date and time, and an event code indicating the content of the event. On the other hand, as additional information or a watermark, it is preferable to store a character string indicating the name of the location corresponding to the location code and a character string of the specific content of the event corresponding to the event code.

[0015] (4) When the image data is a video composed of a plurality of frames, the control means may control to embed and store information for identifying the event in the frame captured when the event occurred. In this way, it becomes easier to identify the frame when the event occurred, and it is possible to easily check the images before and after the event. Also, the event occurring in that frame can be identified from the information for identifying the event. In particular, it is preferable to include information for identifying the type of the event as the information for identifying the event. In this way, the frame in which the event of that type occurred can be extracted from the video. The file may be configured such that there is one frame in which the event occurred in the video of one file, but it is preferable to provide a plurality of frames in which the event occurred in the video of one file. With this configuration, the frame in which the event occurred in the video file can be easily identified from the information for identifying the type of the event, and there is no need to fast forward or the like to check the entire video, thus achieving a remarkable effect.

[0016] (5-1) Preferably, in the present invention, the information for identifying an event may include information indicating the time when the event occurred. By doing so, the time when the event occurred can be specified externally from the received file. Therefore, there is no need to separately exchange files including information indicating the time when the event occurred, and there is no need to separately transfer the file including information indicating the time when the event occurred and the file storing the image data, nor to check the correspondence between the two one by one. (5-2) Further, the information for identifying an event may include information indicating the location where the event occurred. By doing so, the location where the event occurred can be specified from the received file. Therefore, there is no need to separately exchange files including information indicating the location where the event occurred, and there is no need to separately transfer the file including information indicating the location where the event occurred and the file storing the image data, nor to check the correspondence between the two one by one. As the information indicating the location where the event occurred, for example, information indicating the factory where the machine tool is installed or information indicating the line where the machine tool being photographed in the factory is installed may be used. Further, it is particularly preferable that the information indicating the location where the event occurred includes information indicating a country or a region. By doing so, it becomes easy to collect video data at the time of abnormality of different manufacturing equipment on different manufacturing lines in factories in various regions of various countries at the head office or headquarters and examine the cause and the like. (5-3) Further, the information for identifying an event may include information indicating the type of the event. By doing so, the type of the event that occurred can be specified from the received file. Therefore, there is no need to separately exchange files including information indicating the type of the event, and there is no need to separately transfer the file including information indicating the type of the event and the file storing the image data, nor to check the correspondence between the two one by one. For example, when the control means receives an alarm signal indicating the occurrence of an abnormality from the machine tool as an event, the "information indicating the type of the event" may be an error code indicating the type of the abnormality. In addition, the information for identifying an event may be a serial number indicating the order in which the event occurred from the start of recording. Of course, for example, the configurations in (5-1) to (5-3) can be arbitrarily combined in plural.It is preferably configured to include any two of (5-1) to (5-3), and most preferably, for example, it may include the configurations of (5-1), (5-2), and (5-3). By including at least two, preferably all, of the time when the event occurred, the location where the event occurred, and the event that occurred in the information for identifying the event, more detailed and multi-faceted information about the event can be obtained from the received file. In addition, it becomes easy to classify a large number of files in which images at the time of event occurrence are recorded according to the location of event occurrence, the time of occurrence, and the type of event, and it becomes easy to examine and investigate the cause of event occurrence and the like.

[0017] (6) The object to be photographed repeats its operation with a predetermined operation time as one cycle, and the predetermined time should preferably include at least the time from the start of the operation time in the cycle when the event occurred to the occurrence of the event. By doing so, it is possible to reproduce and check the operation from the disclosure time of the operation of one cycle including the time when the event occurred to the occurrence of the event in the stored image data. Therefore, it becomes easy to trace back the cause of the event that occurred in that cycle, check the image data, and identify it, and it is possible to prevent recordings unrelated to the occurrence of the event, so that the time required to check the image data can be shortened. For example, when the object to be photographed is a machine tool that repeats its operation with a predetermined operation time as one cycle, when an event such as a work error of the machine tool occurs, the image data photographed during the time from the start of the operation time in the cycle when the event occurred to the occurrence of the event is stored, so that it is possible to easily investigate the cause of the work error. The predetermined time may have a configuration of "including at least the time from the start of the operation time in the cycle when the event occurred to the occurrence of the event", but particularly, it is preferably "the time for one cycle including the time when the event occurred". By doing so, it is possible to easily investigate the cause of the work error. Also, as another configuration, the predetermined time is preferably particularly the time from the start of the operation time in the cycle when the event occurred to the occurrence of the event. For example, it is preferable to have a configuration in which an operation start signal is received at the start of the operation of one cycle, and a configuration in which video recording is started when the operation start signal is received.

[0018] (7) Also, it is more preferable that the predetermined time is set to one cycle of the operation time before and after the time when the information indicating the occurrence of the event is received. In this way, regardless of the occurrence timing of the event within one unit of the operation time, it is possible to store the image data including from the start to the end of the cycle in which the event occurred. For example, in a machine tool that repeats operations with a predetermined operation time as one cycle, when an event such as a machining error of the machine tool occurs, it is possible to store without omission the image data captured from the start to the end of the cycle including the time when the event occurred, facilitating the confirmation of the cause of the machining error and subsequent processing. Also, for example, it may be configured to receive an operation end signal at the end of one cycle of operation, and not record the image data corresponding to the cycle when the operation end signal is received without receiving the signal indicating the occurrence of the event from the outside. In this way, the storage capacity can be reduced, and the labor of checking the image data of the scene where no event has occurred can be saved. Also, for example, when the signal indicating the occurrence of the event is received from the outside, a process of extending the recording of the image data by at least the recovery time due to the occurrence of the event may be performed. In this way, in a device or the like that performs a recovery process accompanying the occurrence of an event, it is possible to record including the process of the recovery.

[0019] (8) Preferably, the control means controls the storage means to store the image data with an information amount lower than that at the predetermined time at a time other than the predetermined time before and after the time when the information indicating the occurrence of the event is received. In this way, it is possible to roughly check the content of the image data captured during the time period when no event has occurred, and to check the content of the image data in detail when the event occurs. Also, it is possible to store the images of the time when no event has occurred while suppressing the size of the file storing the image data.

[0020] "Storing image data with a low information amount" means, for example, it is particularly good to store by reducing the frame rate of a moving image. Additionally, it may be done by compressing the image file, reducing the image quality of the image file, storing a color image at the time of event occurrence, and storing a black-and-white image at other times, etc.

[0021] (9) Preferably, the device of the present invention further includes vibration detection means for detecting vibration and transmitting information indicating the occurrence of an event to the control means when vibration equal to or greater than a predetermined value is detected. In this way, in addition to when receiving information indicating the occurrence of an event from the outside, when vibration equal to or greater than a predetermined value is applied to the device, it is possible to record images before and after the event assuming that the event has occurred. For example, when configured to receive an error of a machine tool as an event and photographing the machine tool, in a situation where unexpected vibrations such as an impact being applied to the device itself or the photographing direction being changed are detected, the device can generate an event by itself and record an image.

[0022] (10) Further, the present invention is a system configured by including a plurality of devices of any one of the above (1) to (13), and the plurality of devices constituting the system are configured to be able to receive information indicating the occurrence of a common event. In this way, since it is possible to store image data captured before and after an event occurs by a plurality of devices, it becomes easier to confirm the situation before and after the event occurs.

[0023] (11) In the present invention, the control means provided in each device constituting the system is configured to control so as to embed information for identifying an event in a file storing image data and store it in the storage means. Among the plurality of devices, the first device functions as a master, and devices other than the first device among the plurality of devices function as slaves. The first device includes an event distribution unit that distributes information for identifying the event to the devices that function as slaves when receiving information indicating the occurrence of the event. The control means provided in the device that functions as a slave is configured to control so as to embed the information for identifying the event distributed from the first device in a file storing the image data captured by the device that functions as the slave and store it in the storage means. Such a system is preferable.

[0024] In this way, when an event occurs, a plurality of devices constituting the imaging system can embed information for identifying a common event in a file. As a result, it becomes easy to specify the image data stored by the control of each device triggered by the occurrence of the common event. Further, when the information for identifying the event includes information indicating the type of the event, it becomes easy to classify the files. Each of the plurality of devices constituting the imaging system may be controlled to store the image data in a common storage means, but it is preferable to control to store the image data in different storage means from each other.

[0025] Here, "distribution" means that the received information may be directly distributed to other devices as it is, or the received information may be processed (for example, the information is corrected, changed, or added) and then distributed to other devices. As a means for transmitting the information to be "distributed", it can be wired, but it is preferable to use wireless. Also, it includes direct and indirect distribution methods. For example, a plurality of slaves may be connected in series in multiple stages, and the information for identifying the event supplied from the master or the information indicating the occurrence of the event may be configured to be sequentially transmitted to the subsequent stage.

[0026] (12) In the present invention, the control means of each device constituting the system may control to embed, in addition to the information for identifying the event distributed from the first device, the identification information for identifying the device into the file storing the image data captured by the device and store it in the storage means.

[0027] The control means of the device functioning as a slave may control to embed the information for identifying the device functioning as a master into the file storing the image data and store it in the storage means. In this way, since the common information is embedded in the files stored by the slaves connected to the common master, it becomes possible to easily find the image files captured on the occasion of the common event.

[0028] As the identification information for identifying the device, for example, a unique identification number may be assigned to each device in advance, or the information that has been uniquely assigned in advance such as the MAC address may be diverted. Also, it is particularly preferable to automatically set it so as not to overlap through the communication between the master and the slave at the time of connection.

[0029] (13) Preferably, when the control means of the event distribution unit provided in the first device receives the information indicating the occurrence of the event, it may distribute the information indicating the occurrence of the event to the device functioning as a slave. In this way, the information indicating the occurrence of the event can be distributed together with the information for identifying the event. Since the source of the information for identifying the event and the source of the information indicating the occurrence of the event are common, the connection and setting of each device constituting the system become easy.

[0030] (14) In the program of the present invention, the computer may function as any of the above-described devices.

Brief Description of the Drawings

[0031]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Mode for Carrying Out the Invention

[0032] 〔First Embodiment〕 When the production line in the factory has just been constructed, the machine tools that make up the line cause various troubles for about 3 to 4 months, so monitoring is necessary. For example, troubles such as a screw falling off or a screw toppling over may occur on a screw-tightening line. Activities are carried out to eliminate the causes of such troubles, reduce the troubles to almost zero, and ensure that the products are properly manufactured. Conventionally, a video camera has been used to constantly photograph the machine tools, and when something abnormal occurs, it has been found later from the data recorded by the machine tools, and the operator has watched the video taken from the beginning. Then, the part where the abnormality occurred was searched for in the recorded video, and only that part was copied and sent to the head office or the manufacturer of the machine tools. At the head office or the manufacturer of the machine tools, the cause of the trouble was investigated and countermeasures were formulated.

[0033] Hereinafter, the imaging system 1, which is a preferred embodiment of the present invention, will be described with reference to the drawings. The imaging system 1 of this embodiment is a system that records the video of the machine tool 2 operating on the manufacturing line of the factory in order to monitor the work content of the machine tool 2. FIG. 1 is a schematic diagram showing the configuration of the imaging system 1 together with the machine tool 2. FIG. 2 is a schematic diagram showing an outline of the operation sequence when an event occurs in the machine tool 2.

[0034] In this example, the machine tool 2 to be monitored is assumed to perform a screwing operation on the manufacturing line. The machine tool 2 repeats this screwing operation with a predetermined operation time (for example, 30 seconds) as one cycle. When the machine tool 2 detects that there is a failure in the work it performs or an abnormality in the equipment, etc., it outputs an alarm signal indicating the occurrence of the abnormality. A transition from a normal state to a state different from the normal state, such as a work failure or an equipment abnormality, is called an "event". When an event occurs in the machine tool 2, the signal level of the alarm signal is changed from low to high. The alarm signal is input to the rotating light 21 as a lighting control signal. The rotating light 21 is in an off state (or a blue lighting indicating no abnormality) when the signal level of the alarm signal is low, and is in a red lighting state indicating an abnormality when the signal level is high. In addition to changing the alarm signal when an event occurs in the machine tool 2, the machine tool 2 outputs information (error code) indicating what kind of event has occurred. As the error code, for example, different codes are provided for each type of abnormality such as a screw falling or a screw falling over. After outputting the alarm signal, the machine tool 2 stops the work, eliminates defective products, resumes the work, and returns the alarm signal from high to low. It is assumed that this series of processes after failure detection is completed within the operation cycle in which the failure in the machine tool 2 is detected. In the imaging system 1, the occurrence of an event is detected from the state change of the alarm signal, and images before and after the occurrence of the event are taken.

[0035] The imaging system 1 is composed of three imaging devices ((100-1, 100-2, 100-3), which are collectively referred to as the imaging device 100).

[0036] FIG. 3 is a schematic diagram showing the appearance of the imaging device 100, and FIG. 4 is a block diagram showing the configuration of the imaging device 100 together with the memory card 200. The imaging device 100 includes a CPU 110, an imaging unit 120, an event input unit 130, an acceleration sensor 140, an event distribution unit 150, a timing unit 170, and a memory card slot 160 inside a substantially cylindrical housing 105. At the lower part of the housing 105, a screw hole is provided for fixing to the shooting location.

[0037] The CPU 110 corresponds to the control means of the present invention. The CPU 110 performs various controls according to a control program. The CPU 110 controls the driving of the imaging unit 120 and performs controls such as image processing and storage of image data. Further, the CPU 110 receives information regarding events input to the event input unit 130 and sensor signals output by the acceleration sensor 140, and executes control according to the events.

[0038] The memory card slot 160 is provided at one end in the longitudinal direction of the housing 105. A memory card 200 corresponding to the storage means of the present invention is inserted into the memory card slot 160. A file storing the image data captured by the imaging unit 120 is recorded on the memory card 200 according to the control of the CPU 110. Information for identifying an event, such as the occurrence time of the event, the shooting location, and an error code, is embedded in the file storing the image data.

[0039] In addition, the memory card 200 stores a setting file defining conditions related to recording of image data (for example, image quality, number of recording frames, etc.), identification information for identifying the imaging device 100, and master / slave settings described later. When the setting as a master is defined, information indicating the shooting location is also defined in the setting file. As information indicating the information indicating the shooting location, identification information indicating the factory where the machine tool is installed and identification information indicating the machine tool being photographed in the factory are defined. In this example, it is assumed that the conditions necessary for recording described below are defined in the setting file.

[0040] The imaging unit 120 corresponds to the imaging means of the present invention. The imaging unit 120 is provided at the end of the substantially cylindrical housing 105 opposite to the memory card slot 160 with the longitudinal direction of the housing 105 as the optical axis. The imaging unit 120 is composed of a lens unit 122 and an imaging element 124. The lens unit 122 includes a zoom lens and can set the angle of view according to the size of the imaging object and the distance to the imaging object. The imaging element 124 is a CCD, a CMOS image sensor, etc., and acquires the image of the imaging object imaged by the lens unit 122 as image data.

[0041] The event input unit 130 is a terminal provided on the side surface of the housing 105 and includes a trigger input terminal 132 and an event identification information input terminal 134. A wiring branched from a connection line for transmitting an alarm signal for lighting the rotating lamp 21 of the alarm when the machine tool 2 detects a work failure is connected to the trigger input terminal 132. The trigger input terminal 132 receives the alarm signal as a trigger signal indicating the occurrence of an event. The trigger signal input to the trigger input terminal 132 is transmitted to the CPU 110 and used as a kind of information indicating the occurrence of an event.

[0042] The error code output terminal of the machine tool 2 is connected to the event identification information input terminal 134 of the imaging device 100 set as the master. The event identification information input terminal 134 of the imaging device 100 set as the master receives the error code generated when the machine tool 2 detects a work failure. The input error code is transmitted to the CPU 110 and used as part of the information for identifying the event. Also, the event distribution unit 150 of the imaging device 100 set as the master is connected to the event identification information input terminal 134 of the imaging device 100 set as the slave. The event identification information input terminal 134 of the imaging device 100 set as the slave receives the information for identifying the event distributed by the imaging device 100 set as the master. The input information for identifying the event is transmitted to the CPU 110 and used as part of the information for identifying the event in the imaging device 100 set as the slave.

[0043] Since existing machine tools are provided with a configuration that notifies people of the occurrence of events as described above, the imaging device 100 uses this configuration to receive a trigger signal and an error code via the event input unit.

[0044] The acceleration sensor 140 detects vibration and, when it detects vibration with an intensity equal to or greater than a preset intensity, transitions the sensor signal from the low state to the high state. The sensor signal is transmitted to the CPU 110. The CPU 110 uses the sensor signal as a kind of information indicating the occurrence of an event.

[0045] The timer unit 170 measures the current time and outputs information on the current time to the CPU 110 in response to a request from the CPU 110. The CPU 110 uses the time information acquired from the timer unit 170 as part of the information for identifying an event.

[0046] The image signal output terminal 180 is a terminal that outputs an image signal for displaying an image captured by the imaging unit 120 on an external monitor. In this embodiment, an HDMI (High-Definition Multimedia Interface, registered trademark) terminal is used.

[0047] When the imaging device 100 is set to function as a master, the event distribution unit 150 distributes information for identifying an event to other imaging devices 100 that function as slaves. Specifically, under the control of the CPU 110, the event occurrence time measured by the timing unit 170 of the imaging device 100 functioning as the master, information indicating the shooting location recorded in the setting file of the memory card 200 inserted into the imaging device 100 functioning as the master, and the error code are output from the output terminal. A cable for transmitting information for identifying an event to the imaging device 100 functioning as a slave is connected to the output terminal. The output terminal of the event distribution unit 150 has the same structure and pin arrangement as the error code output terminal of the machine tool 2. A cable connecting the error code output terminal of the machine tool 2 and the event identification information input terminal 134 of the imaging device 100 functioning as the master, and a cable connecting the event distribution unit 150 of the imaging device 100 functioning as the master and the event identification information input terminal 134 of the imaging device 100 functioning as the slave are compatible with each other.

[0048] Each imaging device 100 configured as described above is installed to photograph the machine tool 2 from different directions. Each imaging device 100 is fixed to a structure around the machine tool 2 to be photographed or a mount such as a tripod using the screw holes provided at the lower part of the housing 105. A pan-tilt head is provided between the fixed location and the imaging device 100 so that the shooting direction can be freely changed. The lens units 122 provided in each imaging device 100 have their respective viewing angles adjusted so that image data can be recorded with the range where the cause of the event can be traced as the imaging range. When adjusting the imaging range, the image signal output terminal 180 of the imaging device 100 and the monitor 3 are connected, and the image captured by the imaging device 100 is directly displayed on the screen of the monitor 3 (so-called through-image display), and the adjustment is performed while checking the range shown on the screen. Among the three imaging devices, the imaging device 100-1 is set to function as a master, and the remaining imaging devices 100-2 and 100-3 are set to function as slaves.

[0049] A cable for transmitting an alarm signal from the machine tool 2 is connected to the trigger input terminal 132 of each imaging device 100. Through such a connection, the three imaging devices 100 constituting the imaging system 1 can receive an alarm signal, which is information indicating the occurrence of a common event. Also, a cable for transmitting an error code from the machine tool 2 is connected to the event identification information input terminal 134 of the master imaging device 100-1. Cables for transmitting information for identifying events distributed from the event distribution unit 150 of the imaging device 100-1 are connected to the event identification information input terminals 134 provided in the slave imaging devices 100-2 and 100-3, respectively.

[0050] Hereinafter, the operation when the monitoring function by the specific imaging system 1 is executed will be described. In the following description, the operation of each component is under the control of the CPU 110 even if not particularly specified.

[0051] FIG. 5 is a diagram showing the relationship between the occurrence of an event and the recording of image data. The imaging unit 120 of each imaging device 100 constituting the imaging system 1 always captures moving images regardless of the occurrence of an event, and temporarily stores the image data from a predetermined time ago to the latest in the memory card 200 inserted into each memory card slot 160 at a high frame rate (for example, 30 frames per second). The image data after a predetermined time has elapsed since the shooting is thinned out to a low frame rate (for example, 1 frame per second) as needed and stored in the memory card 200.

[0052] As described above, when a failure occurs in the operation performed by the machine tool 2 while continuously capturing a moving image, the machine tool 2 detects this failure and changes the state of the alarm signal from low to high. Then, this alarm signal is input to the trigger input terminal 132 of each imaging device 100. Triggered by detecting the change of the alarm signal from low to high, the CPU 110 controls to store, in the memory card 200, the high frame rate image data captured by the imaging unit 120 from a predetermined time before the time when the event occurred (i.e., the time when it was detected that the alarm signal changed from low to high) to a predetermined time after the time when the event occurred. Specifically, the high frame rate image data temporarily stored in the memory card at the time when the event occurred (i.e., the image data from a predetermined time before the time when the event occurred to the time when the event occurred) and the high frame rate image data captured during a predetermined time from the time when the event occurred are recorded in a file in the memory card 200 without thinning out.

[0053] Events such as operation errors occur by sequentially going through the process of the event that causes the error, the occurrence of the error, the detection of the error, and the transmission of information indicating the occurrence of the event (for example, the change of the alarm signal). Therefore, in order to trace the cause of the operation error, it is necessary to check the images before the event. According to the present embodiment, it is possible to check the images before the event.

[0054] The above-mentioned "predetermined time" is set to one cycle of the operation time of the machine tool 2. In this way, regardless of the occurrence timing of the event within one cycle of the operation time, it is possible to store the image data including from the start to the end of the cycle in which the event occurred. Since it is possible to store without omission the image data captured from the start to the end of the cycle including the time when the event occurred, it is possible to easily check the cause of the operation error and the subsequent processing. That is, by checking the image before the event in the cycle in which the event occurred, the cause of the operation error can be grasped. Also, by checking the image after the event in the cycle in which the event occurred, it is possible to check whether the processing after the event was appropriately performed.

[0055] When a file storing detailed image data captured within a predetermined time period from the time an event occurred is recorded on memory card 200, CPU 110 controls the embedding of information identifying the event in the file. The information identifying the event is distributed by image capture device 100-1, which functions as a master, to image capture devices 100-2 and 100-3, which function as slaves. This embeds information identifying a common event in files recorded by each image capture device 100 in response to the occurrence of a single event, making it easier to classify and manage files.

[0056] In this embodiment, the information for identifying an event includes information indicating the time when the event occurred, information indicating the location where the event occurred, and an error code. CPU 110 of imaging device 100-1, which functions as a master, acquires the time when the event occurred from clock unit 170 provided in imaging device 100-1. Furthermore, the information indicating the location where the event occurred is predefined in a setting file recorded on memory card 200 inserted in imaging device 100-1 and used. The error code output from machine tool 2 is received via event identification information input terminal 134 and used.

[0057] One method for embedding information that identifies an event is to use the information that identifies the event as part of the file name. By including the information that identifies the event in the file name, it becomes easy to understand the contents of the image data stored in the file without loading the image file into dedicated software. Also, an error code is embedded in the header of the frame in which the event occurred in the recorded video. By searching for the frame with the embedded error code during playback, it is possible to quickly check the image at the moment the event occurred. Furthermore, when multiple files recorded by each imaging device 100 are played back simultaneously in response to the occurrence of a single event, synchronization can be achieved by simultaneously playing back the frame with the embedded error code.

[0058] The CPU 110 of each imaging device 100 constituting the imaging system 1 controls to embed, in a file storing the image data captured by the imaging unit 120, identification information for identifying the imaging device 100, in addition to the information for identifying the event, and store it in the memory card 200. The identification information for identifying the imaging device 100 is read and used from what is predefined in the setting file recorded in the memory card 200 inserted into each imaging device 100.

[0059] After a predetermined time has elapsed since the time when the event occurred, again, continuously capture moving images, and temporarily store, at a high frame rate, the image data from a predetermined time before to the latest in the memory card 200 inserted into each memory card slot 160, while thinning out, at any time, the image data for which a predetermined time has elapsed since the shooting time to a low frame rate, and store it in the memory card 200. By doing so, it is possible to roughly check the content of the image data captured during the time period when no event has occurred, and to check the content of the image data in detail at the time of event occurrence. Also, it is possible to store the images during the time when no event has occurred while suppressing the size of the file storing the image data.

[0060] In addition to the case where the machine tool 2 notifies the imaging system 1 of the occurrence of an event with an alarm signal as described above, each imaging device 100 constituting the imaging system 1 of the present embodiment treats the detection of vibration equal to or greater than a preset intensity by the acceleration sensor 140 provided in each as the occurrence of an event, and stores, in the memory card 200, the high frame rate image data captured by the imaging unit 120 from a predetermined time before the time when the vibration was detected to a predetermined time after the event occurrence time. The storage of the image data triggered by the detection of vibration is performed only by the imaging device 100 provided with the acceleration sensor 140 that detected the vibration, and the other imaging devices 100 do not store the image data. As a result, there will be events in which only the imaging device 100 that detected the vibration has stored a file, so it is possible to easily identify the imaging device 100 that may have had an abnormality.

[0061] In this way, in addition to the case where an alarm signal is received from the machine tool 2, when vibrations equal to or greater than a predetermined value are applied to the device, images before and after the event can be recorded assuming that the event has occurred. In a situation where unexpected vibrations such as an impact being applied to the imaging device itself or the imaging direction being changed, or an abnormality on the imaging device side is detected, the event can be generated by itself and the image can be recorded. As a result, it becomes easier to notice a change in the imaging direction of the camera, and the imaging direction can be corrected so that appropriate imaging can be performed when an event such as an abnormality in the machine tool 2 occurs.

[0062] Information for identifying an event different from the case where an alarm signal from the machine tool 2 is the trigger is embedded in the file recorded triggered by the detection of vibrations by the acceleration sensor 140. Specifically, an error code indicating that abnormal vibrations have been detected is embedded as information for identifying the event.

[0063] Files storing the image data recorded by the three imaging devices 100 respectively have a function of being synchronously played back by a viewer operating on a computer, triggered by the occurrence of a common event. This viewer performs synchronous playback so that frames with an error code embedded in the header in each image data are played back at the same timing. Also, the time information, location information, and error code included in the information for identifying the event are displayed in association with the images during playback. Also, when selecting the target file to be played back, a plurality of files with common information for identifying the event are displayed in association. This makes it easy to identify the files to be played back synchronously. Also, the viewer has a function of searching for the file to be played back using the time information, location information, and error code as keys. With such a viewer, it is possible to quickly find and synchronously play back files storing image data taken from a plurality of directions before and after one event, facilitating the investigation of the cause of the event and the confirmation of post-processing.

[0064] The imaging system 1 described above eliminates the need to manually input information for identifying an event or identification information for an imaging device. Therefore, in cases where images stored by devices installed in a remote factory at the time of an event are collectively sent to a management department or the like, and the content of the images is reviewed by the management department, the sender of the file captured by the imaging device 100 can send the file as is, with various information automatically embedded. Furthermore, the party reviewing the received image can handle a file with predetermined information reliably embedded. Therefore, the workload on both the sender and the receiver can be reduced. Furthermore, since image data captured by multiple imaging devices 100 before and after an event occurs can be stored, it becomes easier to review the situation before and after the event.

[0065] Furthermore, when an event occurs, the multiple imaging devices 100 constituting the imaging system 1 embed information identifying the common event in a file, which makes it easy to identify the image data stored by each imaging device 100 when the common event occurs. Furthermore, if the information identifying the event includes information indicating the type of event, it becomes easy to classify and manage files. [Modification of the first embodiment]

[0066] The present invention is not limited to the first embodiment described above, and includes modifications and improvements within the scope of achieving the object of the present invention.

[0067] For example, in the above-described first embodiment, when the machine tool 2 detects that it has failed in the work it performs or an abnormality in the equipment, etc., it branches and uses the signal to the rotating lamp 21 connected to the machine tool 2 to receive information indicating the occurrence of an event. However, the machine tool 2 may be configured to output an alarm signal indicating the occurrence of an abnormality to the outside and use this alarm signal as information indicating the occurrence of an event. Further, when branching and using the signal to the rotating lamp 21, for example, as the rotating lamp 21, one that lights blue during normal times and lights red when an abnormality occurs may be used, and the control signal for lighting it red may be diverted and used as the alarm signal. Further, a light-receiving element for detecting red light emission may be provided in the imaging device 100, and the red light emission of the rotating lamp 21 may be received as information indicating the occurrence of an event. Further, as the rotating lamp 21, one that emits an alarm sound along with lighting red when an abnormality occurs may be used, and a microphone for detecting the alarm sound may be provided in the imaging device 100, and the alarm sound of the rotating lamp may be received as information indicating the occurrence of an event. Further, the imaging target by the imaging device 100 is not limited to the machine tool, and may be various robots, processing machines, etc. arranged on the factory line. FIG. 6 schematically shows the operation sequence at the time of event occurrence in the case where a robot that arranges strawberries on the upper surface of a cake and is arranged on a line for manufacturing strawberry cakes is taken as the imaging target. The robot is not provided with a rotating lamp and is configured to be able to output an alarm signal to the outside when it detects a work failure.

[0068] In the above-described first embodiment, the master imaging device 100-1 added information indicating time and information indicating the imaging location to the error code received from the machine tool 2 and distributed it as information for identifying an event to the slave imaging devices 100-2 and 100-3. However, the error code received from the machine tool 2 may be directly distributed to the slaves.

[0069] In the above-described first embodiment, the means for transmitting the information to be "distributed" is wired, but it may also be wireless. When transmitting wirelessly, any wireless communication standard such as Wifi, 3G, Bluetooth (registered trademark) may be used. Further, the method of distributing information is not limited to the method of directly distributing from the master to each slave, and includes an indirect distribution method. For example, starting from one master, a plurality of slaves may be connected in series in multiple stages, and information for identifying an event supplied from the master or information indicating the occurrence of an event may be configured to be sequentially transmitted to the subsequent stage. As another example, all the imaging devices 100 may be network-connected, and information distributed on the network from the master may be broadcast to transmit the information to all the slaves.

[0070] In the above-described first embodiment, as the identification information for identifying the device, the identification information defined in advance in the memory card 200 is used. Instead of this, information such as a MAC address that is uniquely assigned to each device in advance may be diverted. Further, when setting the configuration of the imaging system 1, it may be automatically set so that the identification information does not overlap through communication between the master and the slave.

[0071] Further, the CPU 110 of the imaging device 100 functioning as a slave may be controlled to embed and store the identification information of the imaging device 100 functioning as a master in a file storing image data. In this way, since common information is embedded in the files stored by the slaves connected to the common master, it becomes possible to easily find the image files taken on the occasion of a common event.

[0072] In the above-described first embodiment, the machine tool 2 and each imaging device 100 are directly connected, and information indicating the occurrence of an event (i.e., an alarm signal) is transmitted. However, the event distribution unit 150 provided in the imaging device 100-1 that functions as a master may be configured to distribute information indicating the occurrence of an event to the slaves in addition to the information for identifying the event. In this way, since information indicating the occurrence of an event can be distributed together with the information for identifying the event, the connection and setting of each device constituting the system become easy. In this case, the cable for transmitting the information for identifying the event and the cable for transmitting the information indicating the occurrence of the event may be integrated. In this way, the number of cables used for connecting the master and the slaves can be reduced, and the connection and setting become easy. Further, the cable for transmitting the information indicating the occurrence of the event from the master to the slaves may be configured to have compatibility when transmitting an alarm signal from the machine tool 2 to the master.

[0073] Further, the serial number from the start of recording may be transmitted together with the information indicating the occurrence of the event serving as a trigger, and the files of the image data recorded by each imaging device 100 may be associated with this serial number. This serial number from the start of recording may be part of the information for identifying the event.

[0074] In the above-described first embodiment, when the acceleration sensor 140 detects vibration having a strength equal to or greater than a preset strength, image recording is performed only in the imaging device 100 including the acceleration sensor 140 that detected the vibration. However, information indicating the occurrence of an event may be transmitted to other imaging devices 100 so that other imaging devices 100 also perform image recording. To distribute the information indicating the occurrence of an event from an arbitrary imaging device 100 to other imaging devices 100, the information indicating the occurrence of the event may be individually transmitted from the distributing imaging device to each of the other imaging devices. For example, all the imaging devices 100 may be network-connected, and the information indicating the occurrence of the event may be broadcast onto the network from the distributing imaging device 100. Thereby, the information indicating the occurrence of the event can be transmitted to all the imaging devices 100 at substantially the same timing.

[0075] In the above-described first embodiment, the imaging unit 120 captures a moving image as an image. However, for example, it may capture a still image. Further, the image may be, for example, a 2D image or a 3D image. Also, it may be a black-and-white image or a color image. The lens unit included in the imaging unit 120 may be a short-focus lens instead of a zoom lens.

[0076] In the above-described first embodiment, the memory card 200 inserted into the memory card slot 160 is used as the storage means. However, instead of the memory card, other storage devices such as a hard disk drive may be used. Also, the storage means is not limited to being detachable and may be built in a non-detachable form within the housing 105. In the above-described first embodiment, the memory card 200 inserted into the memory card slot 160 of each imaging device 100 is used as the storage means. However, a plurality of imaging devices 100 may store image data in a common storage means (for example, a hard disk drive or a storage area provided on a communication network). However, the most preferable configuration is to store for each of the above-described imaging devices 100. Especially when a manufacturing line is newly constructed in a factory, in the case of a temporary installation such as when monitoring for troubles for about 3 to 4 months, it can be easily attached by screwing without constructing a large-scale system and stored in each imaging device. Also, not only in the case of a temporary installation, but also when events do not occur frequently, the situation at the time of an abnormality of a machine tool can be easily photographed without constructing a large-scale system.

[0077] In the above-described first embodiment, the configuration is such that the moving image is constantly captured. However, it may be configured to receive an operation start signal at the start point of one cycle of operation, and to start recording the video when the operation start signal is received. Further, for example, it may be configured to receive an operation end signal at the end point of one cycle of operation, and not to record the image data corresponding to the cycle when the operation end signal is received without receiving a signal indicating the occurrence of a recording event from the outside. For example, when a signal indicating the occurrence of an event is received from the outside, it may be configured to perform a process of extending the recording of the image data for at least the recovery time due to the occurrence of the event.

[0078] In the above-described first embodiment, the image data captured by the imaging unit 120 is temporarily stored in the memory card 200 for a predetermined time. However, the image data may be temporarily stored in a storage element such as an SDRAM built in the imaging device 100, and the high frame rate image data at the time of event occurrence and the low frame rate image data when no event occurs may be finally recorded on the memory card 200.

[0079] In the above-described first embodiment, high frame rate images from a predetermined time before the event occurrence to a predetermined time after the event occurrence time are recorded when an event occurs. However, the predetermined time may be different between the recording time before the event occurrence and the recording time after the event occurrence, and it is preferable to enable the user to freely set the time. For example, when the machine tool 2 requires a longer time than one cycle of normal operation for the processing after the event occurrence, the recording time after the event occurrence may be made longer. In this way, it is possible to more reliably investigate the cause of the event occurrence and confirm the post-processing.

[0080] In the above-described first embodiment, information for identifying an event is embedded in a file by using it as part of the file name. However, it is also possible to embed it by other methods. For example, information for identifying an event may be embedded as a watermark in an image. By doing so, it is possible to embed information for identifying an event without increasing the file size and without visually affecting the image. Also, it is possible to make it difficult to falsify information for identifying an event. As another example, information for identifying an event may be embedded as characters superimposed on an image. As yet another example, information for identifying an event may be embedded as additional information in a file storing data. Note that "additional information" refers to information other than the image itself, such as a header, a footer, etc., in a file storing image data.

[0081] In the first embodiment described above, information for identifying three events, that is, information indicating the time when the event occurred, information indicating the location where the event occurred, and information for identifying an event including an error code, are used for at least a part of the file name. However, for example, information for identifying the first event (e.g., information indicating the time when the event occurred) is used for at least a part of the file name, information for identifying the second event (e.g., information indicating the location where the event occurred) is embedded as a watermark in the image, and information for identifying the third event (e.g., error code) may be embedded as additional information in the file storing the image data. For example, the information for identifying the first to third events may be the same information, but in particular, it is preferably configured to include different information. In particular, these may be completely different information, but in particular, it is preferably configured to include the same information for some of the information. By doing so, the user can easily visually recognize the same information from the file name, making it difficult to be falsified, and it becomes easy to detect falsification by comparing the information for identifying the first to third events. In particular, it is preferably configured such that the same information for some of the information is stored as information in different expression forms. For example, the information used for the file name is string information in which a location code that can be identified by a person, such as an alphanumeric string, that uniquely corresponds to the location where the event occurred, the date and time, and an event code indicating the content of the event are arranged in this order. On the other hand, as additional information or a watermark, it is preferably configured to store a character string indicating the name of the location corresponding to the location code and a character string of the specific content of the event corresponding to the event code.

[0082] In the first embodiment described above, the file is configured such that there is one frame in the video of one file in which an event occurred, but it may be configured to include a plurality of frames in the video of one file in which an event occurred.

[0083] In the above first embodiment, high frame rate images were recorded from a predetermined time before the time when an event occurred to a predetermined time after the event occurred, and low frame rate images were recorded at other times. However, images may not be recorded at other times. Also, from a predetermined time before to a predetermined time after the event occurrence time, the compression ratio of the image file may be decreased (or not compressed), the image quality of the image file may be increased (for example, HD (High Definition) images), the image may be a color image, etc., to record images with a large amount of information, and at other times, the compression ratio of the image file may be increased, the image quality of the image file may be decreased (for example, VGA images), the image may be a black and white image, etc., to reduce the amount of information.

[0084] In the above first embodiment, an example in which a viewer as a playback means is provided as software executed on a computer separate from the imaging device 100 was described. However, the imaging device 100 may integrally include playback means for playing back and displaying the captured image data in the housing 105.

[0085] 〔Second Embodiment〕 FIG. 7 shows an installation example of the imaging device 100 in the second embodiment of the present invention. In this embodiment, the imaging device 100 is arranged on the table in the workplace and monitors the table. For example, when the worker disappears from the workplace during the lunch break, it monitors tools and the like placed on the table. In this embodiment, the imaging device 100 operates using the power supplied from a battery used for power tools or the like. The imaging device 100 in this example receives a sensor signal indicating abnormal vibration output from an internal acceleration sensor or a trigger signal from an external sensor as information indicating the occurrence of an event, and records the image data captured before and after the event occurrence.

[0086] 〔Third Embodiment〕 FIG. 8 shows an installation example of the imaging device 100 in the third embodiment of the present invention. In this embodiment, the imaging device 100 is attached to the frame at the rear of the forklift operator's cab and captures images forward. The imaging range is set to include the operator's cab and the area in front of the forklift, particularly the forks. The imaging device 100 in this example is configured such that screw holes for attachment are also provided on the upper surface of the housing, and the imaging device 100 can be installed by suspending it from above. The imaging device 100 of this embodiment includes temperature measurement means. When the forklift enters or exits a freezer or the like, the imaging unit becomes fogged. Therefore, in order to prevent this, when the temperature measurement means detects a low temperature, heating is performed with a heating wire and a thermostat to prevent fogging. Further, when the temperature measurement means detects a sudden change in temperature (for example, a temperature change accompanying entry or exit from a freezer) as an event, the captured image data is recorded.

Description of Reference Numerals

[0087] 1 Imaging system 2 Machine tool 3 Monitor 100 Imaging device 105 Housing 110 CPU 120 Imaging unit 130 Event input unit 140 Acceleration sensor 150 Event distribution unit 160 Memory card slot 170 Timing unit 200 Memory card

Claims

Claim 1 An imaging device for monitoring above a table in a workplace, imaging means, an acceleration sensor provided inside the imaging device placed on the table, a function that operates using power supplied by being connected to a battery placed on the table, the battery being used for a tool, a function of recording image data captured before and after the occurrence of an event based on a sensor signal indicating abnormal vibration output by the acceleration sensor provided inside the imaging device placed on the table An imaging device having the above. Claim 2 The imaging device according to claim 1, having a function of receiving a trigger signal from an external sensor as information indicating the occurrence of an event and recording image data captured before and after the occurrence of the event. The imaging device according to claim 1.

Images