System and program

Abstract

To provide a device etc. capable of acquiring image data that facilitates checking content of imaging before and after occurrence of an event.SOLUTION: A device includes control means. With reception of information indicating occurrence of an event from the outside as a moment, the control means controls storage means to store image data captured by imaging means in predetermined periods before and after the time when the event occurs.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an apparatus, a system including the apparatus, a program, and the like. [Background technology]

[0002] 2. Description of the Related Art There has been proposed a surveillance camera that includes a lens unit and stores image data captured by the lens unit in a removable storage medium (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-197902 A Summary of the Invention [Problem to be solved by the invention]

[0004] Normally, such surveillance cameras continuously capture images of the target object, so in order to check the contents of the footage when something unusual happens, it is necessary to play back the long footage from the beginning and search for the problem scene by fast-forwarding, etc. This makes the review process very time-consuming.

[0005] Therefore, an object of the present invention is to provide an apparatus capable of acquiring image data that allows easy confirmation of the contents of images taken before and after an event has occurred. This object can be achieved, for example, by a combination of features recited in the independent claims in the claims. The dependent claims, for example, define further advantageous embodiments of the present invention. [Means for solving the problem]

[0006] (1) In order to solve the above problems, the present invention may be an apparatus including a control means that, upon receiving information indicating the occurrence of an event from outside, controls the storage of image data captured by the imaging means at least at a predetermined time before and after the time the event occurred in a storage means.

[0007] In this way, image data captured by the imaging means before and after the occurrence of an event can be stored, so that the content of the image captured before and after the time when the event occurred can be easily confirmed. For example, in order to confirm the image, a reproducing means for reproducing the stored image data so that the user can view it may be provided. The reproducing means may be provided integrally with the control means, or may be provided separately. In addition, in the present invention, an imaging means may be provided together with the control means. The imaging means may capture images at all times regardless of the occurrence of an event, and temporarily store image data over a predetermined period of time. Then, when the control means receives information indicating the occurrence of an event, the control means may control the storage means to store image data captured at a predetermined period of time before and after the event in the storage means. In addition, in the present invention, the storage means may be built into the device in which the control means is provided, but may be provided detachably in the device in the form of, for example, a memory card, a hard disk drive, or the like.

[0008] An "event" may be, for example, an event that occurs when an abnormality occurs, such as various occurrences, particularly an event that occurs due to a failure in a machine tool operating on a factory production line, an abnormal vibration detected by a device, or a change or abnormality in a state detected by an external sensor.

[0009] The "information indicating the occurrence of an event" may be, for example, information indicating a change in state or the occurrence of an abnormality. Specifically, for example, information generated when the machine tool detects a failure in an operation may be the "information indicating the occurrence of an event". In particular, an alarm signal may be the "information indicating the occurrence of an event". It is particularly preferable to use an alarm signal generated when the machine tool detects a failure in an operation as the "information indicating the occurrence of an event". For example, a signal from a rotating light connected to the machine tool (for example, a status signal indicating that the rotating light is on) may be the "information indicating the occurrence of an event". The "information indicating the occurrence of an event" may also be a signal generated by an external device. The device may be configured to include a trigger receiving means for receiving these signals as trigger signals. Then, the control means may control the storage of image data captured by the imaging means in response to a change in the state of the trigger signal. The "information indicating the occurrence of an event" may not only be received from the outside, but may also be configured to detect the occurrence of an event within the device, transmit the "information indicating the occurrence of an event", and receive the "information indicating the occurrence of an event" generated within the device.

[0010] The "time when the event occurred" may be, for example, the time immediately after information indicating the occurrence of the event is received from the outside.

[0011] The "image data" may be captured within a range that allows the cause of the event to be traced.

[0012] The "image" may be, for example, a still image, but more particularly, a moving image. The image may be, for example, a 2D image or a 3D image. For example, the image may be, for example, a black and white image or a color image.

[0013] (2) Preferably, in the present invention, the control means controls the storage means to embed information for identifying an event in a file storing image data and store the information in the storage means. In this way, it is possible to extract information for identifying an event from a file storing image data. Therefore, it is possible to obtain information for identifying an event by only exchanging a file storing the image data, without exchanging a file containing information for identifying an event separately from the image data. For example, when an apparatus installed in a remote factory sends images stored at the time of an event to a management department or the like in a lump, and the contents of the images are confirmed in the management department, it takes a lot of effort to send many related files together, and it also takes a lot of effort on the side receiving the files to distinguish and manage the set of files. In such a case, the above configuration can eliminate the need to manually input information for identifying an event, and can reduce the effort on both the side sending the file captured by the apparatus and the side checking the sent image, by confirming the correspondence between the file recording information for identifying the event and the file recording image data on both the sending side and the receiving side.

[0014] (3-1) For example, the control means may control the file to store the information identifying the event as at least a part of the file name. In this way, the content of the information identifying the event can be known from the file name without opening the file. For example, the content of the file can be known by just displaying the file name without the need for time-consuming work such as extracting and displaying the information identifying the event and image data from the file. (3-2) As another example, the control means may control the file to embed the information identifying the event as a watermark in the image captured by the imaging means. In this way, it is possible to make it difficult to tamper with the information identifying the event. In particular, it is possible to embed the information identifying the event without increasing the size of the file and without affecting the image in a visible way. (3-3) As yet another example, the control means may control the file to embed the information identifying the event as additional information in the file storing the image data. In this way, it is possible to embed the information identifying the event without affecting the image in a visible way. Note that "additional information" refers to information other than the image itself, such as a header, a footer, etc., in the file storing the image data. Of course, the configurations (3-1) to (3-3) may be combined in any combination. In particular, it is preferable to have a configuration that includes any two of (3-1) to (3-3), and it is most preferable to have, for example, the configuration of (3-1), the configuration of (3-2), and the configuration of (3-3). For example, it is preferable to use the information that identifies the first event as at least a part of the name of the file, embed the information that identifies the second event in the image as a watermark, and embed the information that identifies the third event as additional information in the file that stores the image data. For example, the information that identifies the first to third events may be the same information, but it is particularly preferable to have a configuration that includes different information. In particular, these may be completely different information, but it is particularly preferable to include the same information for some information. In this way, the user can easily visually identify the same information from the file name, and it is difficult to tamper with the information that identifies the first to third events, and it is easy to detect tampering by comparing the information that identifies the first to third events.In particular, it is preferable to store the same information as information in different expression formats for a portion of the information. For example, the information used in the file name may be character string information in which a location code that uniquely corresponds to the location and information specifying the date and time when the event occurred, for example a string of alphanumeric characters or the like that allows a person to identify the location, an event code that is a code indicating the date and time, and the content of the event are arranged in this order, while the additional information or watermark may be stored as a character string indicating the name of the location corresponding to the location code and a character string indicating the specific content of the event corresponding to the event code.

[0015] (4) When the image data is a video composed of a plurality of frames, the control means may control the embedding and storage of information identifying the event in a frame captured when the event occurs. In this way, it becomes easier to identify the frame when the event occurs, and it is possible to easily check the images before and after the event. In addition, the event occurring in that frame can be identified from the information identifying the event. In particular, it is preferable to provide information identifying the type of event as the information identifying the event. In this way, it is possible to extract a frame in which that type of event occurs from the video. Although a file may be configured so that there is only one frame in which an event occurs in a video file, it is preferable to provide multiple frames in which an event occurs in a video file. In this way, the frame in which an event occurs in the video file can be easily identified from the information identifying the type of event, and there is no need to check the entire video by fast forwarding, etc., which is a significant effect.

[0016] (5-1) Preferably, in the present invention, the information for identifying an event includes information indicating the time when the event occurred. In this way, the time when the event occurred can be specified externally from the received file. Therefore, there is no need to separately exchange a file including information indicating the time when the event occurred, and there is no need to separately exchange a file including information indicating the time when the event occurred and a file storing image data, or to check the correspondence between the two one by one. (5-2) Furthermore, the information for identifying an event includes information indicating the location where the event occurred. In this way, the location when the event occurred can be specified from the received file. Therefore, there is no need to separately exchange a file including information indicating the location where the event occurred, and there is no need to separately exchange a file including information indicating the location where the event occurred and a file storing image data, or to check the correspondence between the two one by one. The information indicating the location when the event occurred can be, for example, information indicating the factory where the machine tool is installed or information indicating the line in the factory where the machine tool being photographed is installed. Furthermore, it is particularly preferable that the information indicating the location when the event occurred includes information indicating a country or region. In this way, video data of different manufacturing equipment in different manufacturing lines in factories in various regions of various countries when an abnormality occurs can be collected at the head office and the cause can be easily examined. (5-3) The information for identifying the event may include information indicating the type of the event. In this way, the type of the event that has occurred can be identified from the received file. Therefore, there is no need to separately exchange a file including information indicating the type of the event, and there is no need to separately exchange a file including information indicating the type of the event and a file storing image data, or to check the correspondence between the two one by one. For example, when the control means receives an alarm signal indicating the occurrence of an abnormality from a machine tool as an event, the "information indicating the type of the event" may be an error code indicating the type of abnormality. Alternatively, the information for identifying the event may be a sequential number indicating the order in which the event occurred from the start of recording. Of course, the configurations (5-1) to (5-3) can be arbitrarily combined in any number.In particular, it is preferable to have any two of (5-1) to (5-3), and it is most preferable to have, for example, the configuration of (5-1), the configuration of (5-2), and the configuration of (5-3). By making the information for identifying an event include at least two, and preferably all, of the time when the event occurred, the place where the event occurred, and the event that occurred, more detailed and multifaceted information about the event can be obtained from the received file. In addition, it becomes easy to classify a large number of files in which images at the time of the event are recorded according to the place and time of the event, and the type of event, and it becomes easy to examine and investigate the cause of the event.

[0017] (6) The subject to be photographed repeats an action with a predetermined operation time as one cycle, and the predetermined time may include at least from the start of the operation time in the cycle in which the event occurs to the occurrence of the event. In this way, the image data stored in the action from the start of the action in one cycle including the time when the event occurs to the occurrence of the event can be played back and checked. Therefore, it is easy to trace back and check the image data to identify the cause of the event in that cycle, and recording unrelated to the occurrence of the event can be prevented, so that the time required to check the image data can be shortened. For example, when the subject to be photographed is a machine tool that repeats an action with a predetermined operation time as one cycle, if an event such as a work error of the machine tool occurs, the image data captured from the start of the operation time in the cycle in which the event occurs to the occurrence of the event is stored, so that the cause of the work error can be easily investigated. The predetermined time may be configured to "include at least from the start of the operation time in the cycle in which the event occurs to the occurrence of the event", but in particular, it is preferable to set it to "the time for one cycle including the time when the event occurs". In this way, it is easy to investigate the cause of the work error. In another configuration, the predetermined time may be particularly the time from the start of the operation time in the cycle in which the event occurs to the occurrence of the event. For example, it is preferable to configure the device so that an operation start signal is received at the start of one operation cycle, and video recording is started when the operation start signal is received.

[0018] (7)Moreover, it is more preferable that the predetermined time is one cycle of the operation time before and after the time when the information indicating the occurrence of the event is received. In this way, regardless of the timing of the occurrence of the event within one unit of the operation time, image data including the start to the end of the cycle in which the event occurred can be stored. For example, in a machine tool that repeats operations with a predetermined operation time as one cycle, when an event such as a work error occurs in the machine tool, image data captured from the start to the end of the cycle including the time when the event occurred can be stored without omission, and the cause of the work error and subsequent processing can be easily confirmed. In addition, for example, a configuration may be adopted in which an operation end signal is received at the end of one cycle of operation, and when a signal indicating the occurrence of the event is not received from the outside and an operation end signal is received, the image data corresponding to the cycle is not recorded. In this way, it is possible to reduce the storage capacity and to save the trouble of checking image data in a scene in which no event has occurred. In addition, for example, when a signal indicating the occurrence of the event is received from the outside, a process of extending the recording of the image data at least for the time required for recovery due to the occurrence of the event can be performed. In this way, in a device or the like that performs a recovery process in response to the occurrence of an event, the recovery process can also be recorded.

[0019] (8) Preferably, the control means controls the storage means to store image data with a lower amount of information than that stored during a time other than a predetermined time before and after the time when information indicating the occurrence of an event is received. In this way, the content of image data captured during a time period when no event is occurring can be roughly confirmed, and the content of image data captured during the time period when an event is occurring can be confirmed in detail. Also, images captured during a time period when no event is occurring can be stored while suppressing the size of the file that stores the image data.

[0020] "Storing image data with a low amount of information" means, for example, storing the image data at a lower frame rate for video images. Other examples include compressing the image file, reducing the image quality of the image file, storing color images when an event occurs and storing black and white images at other times, etc.

[0021] (9) Preferably, the device of the present invention further comprises a vibration detection means for detecting vibration and transmitting information indicating the occurrence of an event to the control means when vibration of a predetermined value or more is detected. In this way, in addition to when information indicating the occurrence of an event is received from the outside, when vibration of a predetermined value or more is applied to the device, it is possible to record images before and after the event as an event having occurred. For example, if a machine tool error is configured to be received as an event, and when photographing the machine tool, an event can be generated by the device itself and images can be recorded in a situation where unexpected vibration is detected, such as when the device itself is subjected to an impact or the photographing direction is changed.

[0022] (10) The present invention also provides a system including a plurality of devices according to any one of (1) to (13) above, the plurality of devices being configured to be able to receive information indicating the occurrence of a common event. In this way, image data captured by the plurality of devices before and after the occurrence of the event can be stored, making it easy to check the situation before and after the occurrence of the event.

[0023] (11) In the present invention, the control means of each device constituting the system is configured to control the embedding of information identifying an event in a file storing image data and storing the information in the memory means, a first device among the plurality of devices functions as a master, and the devices other than the first device among the plurality of devices function as slaves, the first device has an event distribution unit that distributes information identifying the event to devices functioning as slaves upon receiving information indicating the occurrence of an event, and the control means of the device functioning as a slave controls the embedding of the information identifying the event distributed from the first device in a file storing image data captured by the device functioning as a slave and storing the information in the memory means.

[0024] In this way, when an event occurs, the multiple devices constituting the imaging system can embed information identifying a common event in a file. As a result, it becomes easy to identify image data stored under the control of each device when the common event occurs. Furthermore, if the information identifying the event includes information indicating the type of event, it becomes easy to classify files. Each of the multiple devices constituting the imaging system may be controlled to store image data in a common storage means, but it is preferable to control each of the devices to store image data in different storage means.

[0025] Here, "distribution" means that the received information may be divided and distributed to other devices as is, or the received information may be processed (e.g., the information may be modified, changed, or added to) before being divided and distributed to other devices. The means for transmitting the "distributed" information may be wired, but wireless is preferable. It also includes methods of direct and indirect distribution. For example, multiple slaves may be cascaded in multiple stages, and information that identifies an event or information indicating the occurrence of an event supplied from the master may be configured to be transmitted sequentially to subsequent stages.

[0026] (12) In the present invention, the control means of each device constituting the system may control the device to embed identification information for identifying the device in a file that stores image data captured by the device, in addition to information for identifying the event distributed from the first device, and store the information in the memory means.

[0027] The control means of the device functioning as a slave may control the device functioning as a master so as to embed information for identifying the device in the file storing the image data and store the file in the storage means. In this way, common information is embedded in the files stored by the slaves connected to a common master, so that image files captured in response to a common event can be easily found.

[0028] The identification information for identifying the device may be, for example, a unique identification number assigned to each device in advance, or information uniquely assigned in advance such as a MAC address, etc. It is particularly preferable to set the device so that there is no duplication automatically through communication between the master and slave when the device is connected.

[0029] (13) Preferably, the event distributor included in the first device distributes the information indicating the occurrence of an event to the devices functioning as slaves when the control means receives the information indicating the occurrence of an event. In this way, the information indicating the occurrence of an event can be distributed together with the information identifying the event. Since the information identifying the event and the information indicating the occurrence of the event are provided from a common source, the connection and configuration of the devices constituting the system can be facilitated.

[0030] (14) The program of the present invention may cause a computer to function as any one of the devices described above. [Brief description of the drawings]

[0031] [Figure 1] 1 is a schematic diagram showing the configuration of an imaging system 1 together with a machine tool 2. FIG. [Diagram 2] 1 is a schematic diagram showing an overview of an operation sequence when an event occurs in machine tool 2. FIG. [Diagram 3] 1 is a schematic diagram showing the external appearance of an imaging device 100. FIG. [Figure 4] 1 is a block diagram showing a configuration of an imaging device 100 together with a memory card 200. FIG. [Diagram 5] FIG. 11 is a diagram showing the relationship between the occurrence of an event and the recording of image data. [Figure 6] FIG. 13 is a schematic diagram showing an outline of an operation sequence when an event occurs in a machine capable of outputting an alarm signal to the outside. [Figure 7] 1 shows an example of installation of an imaging device 100 in a second embodiment of the present invention. [Figure 8] 13 shows an example of installation of an imaging device 100 in a third embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0032] [First embodiment] When a manufacturing line is just constructed in a factory, it is necessary to monitor the machine tools that make up the line for about 3 to 4 months, as they may experience various problems. For example, there may be problems such as screws dropping or falling over on the screw tightening line. Activities are carried out to eliminate the causes of such problems, reduce the number of problems to almost zero, and ensure that products are completed properly. Conventionally, the machine tools were constantly filmed with a video camera, and when an abnormality was found later from the data recorded by the machine tools, the worker would watch the footage from the beginning. Then, the part where the abnormality occurred was found from the recorded footage, and only that part was copied and sent to the headquarters or the manufacturer of the machine tools, who would then investigate the cause of the problem and devise countermeasures.

[0033] An imaging system 1 according to a preferred embodiment of the present invention will be described below with reference to the drawings. The imaging system 1 of this embodiment is a system that records video of a machine tool 2 in order to monitor the work content of the machine tool 2 operating on a production line in a factory. Fig. 1 is a schematic diagram showing the configuration of the imaging system 1 together with the machine tool 2. Fig. 2 is a schematic diagram showing an overview of the operation sequence when an event occurs in the machine tool 2.

[0034] In this example, the machine tool 2 to be monitored performs screw tightening work on a production line. The machine tool 2 repeatedly performs this screw tightening work with a predetermined operation time (e.g., 30 seconds) as one cycle. When the machine tool 2 detects a failure in the work it performs, an abnormality in the equipment, or the like, it outputs an alarm signal indicating the occurrence of an abnormality. A transition from a normal state to a state different from the normal state, such as a work failure or an abnormality in the equipment, is called an "event." When an event occurs, the machine tool 2 changes the signal level of the alarm signal from low to high. The alarm signal is input to the rotating light 21 as a lighting control signal. When the signal level of the alarm signal is low, the rotating light 21 is turned off (or lit in blue indicating no abnormality), and when the signal level is high, the rotating light 21 is lit in red indicating an abnormality. In addition to changing the alarm signal when an event occurs, the machine tool 2 outputs information (error code) indicating what type of event has occurred. As the error code, a different code is provided for each type of abnormality, such as a screw falling or a screw collapsing. After outputting the alarm signal, the machine tool 2 stops operation, removes the defective product, resumes operation, and changes the alarm signal back from high to low. This series of processes after failure detection is completed within the operation cycle in which the failure is detected in the machine tool 2. The imaging system 1 detects the occurrence of an event from the change in the state of the alarm signal, and captures images before and after the event occurrence.

[0035] The imaging system 1 is made up of three imaging devices (100-1, 100-2, 100-3, collectively referred to as imaging device 100).

[0036] Fig. 3 is a schematic diagram showing the external appearance of imaging device 100, and Fig. 4 is a block diagram showing the configuration of imaging device 100 together with memory card 200. Imaging device 100 includes a CPU 110, imaging unit 120, event input section 130, acceleration sensor 140, event distribution section 150, clock section 170, and memory card slot 160 inside a substantially cylindrical housing 105. A screw hole is provided in the bottom of housing 105 for fixing it to a shooting location.

[0037] The CPU 110 corresponds to the control means of the present invention. The CPU 110 performs various controls according to a control program. The CPU 110 controls the driving of the imaging unit 120, and performs controls such as image processing and storage of image data. The CPU 110 also receives information related to an event input to the event input unit 130 and a sensor signal output by the acceleration sensor 140, and executes control according to the event.

[0038] Memory card slot 160 is provided at one end in the longitudinal direction of housing 105. A memory card 200, which corresponds to a storage means of the present invention, is inserted into memory card slot 160. Under the control of CPU 110, a file storing image data captured by imaging unit 120 is recorded on memory card 200. The file storing image data has embedded therein the time of occurrence of the event, the location where the image was captured, and an error code as information for identifying the event.

[0039] Memory card 200 also stores a setting file that defines conditions related to recording of image data (e.g., image quality, number of recorded frames, etc.), identification information for identifying imaging device 100, and master / slave settings described below. When a master setting is defined, information indicating the shooting location is also defined in the setting file. As information indicating the shooting location, identification information indicating the factory where the machine tool is installed and identification information indicating the machine tool shooting in the factory are defined. In this example, it is assumed that the conditions necessary for recording described below are defined in the setting file.

[0040] The imaging unit 120 corresponds to the imaging means of the present invention. The imaging unit 120 is provided at the end of the substantially cylindrical housing 105 opposite to the memory card slot 160, with the longitudinal direction of the housing 105 as the optical axis. The imaging unit 120 is composed of a lens section 122 and an imaging element 124. The lens section 122 has a zoom lens, and is capable of setting the angle of view according to the size of the subject to be photographed and the distance to the subject. The imaging element 124 is a CCD, a CMOS image sensor, or the like, and acquires the image of the subject formed by the lens section 122 as image data.

[0041] Event input unit 130 is a terminal provided on the side of housing 105, and includes a trigger input terminal 132 and an event identification information input terminal 134. A wiring branched from a connection line that transmits an alarm signal for turning on rotating alarm light 21 when machine tool 2 detects a work failure is connected to trigger input terminal 132. Trigger input terminal 132 receives the alarm signal as a trigger signal indicating the occurrence of an event. The trigger signal input to trigger input terminal 132 is transmitted to CPU 110 and used as a type of information indicating the occurrence of an event.

[0042] An error code output terminal of the machine tool 2 is connected to the event identification information input terminal 134 of the imaging device 100 set as the master. The event identification information input terminal 134 of the imaging device 100 set as the master receives an error code generated when the machine tool 2 detects a work failure. The input error code is transmitted to the CPU 110 and used as part of the information for identifying the event. In addition, the event distribution unit 150 of the imaging device 100 set as the master is connected to the event identification information input terminal 134 of the imaging device 100 set as the slave. The event identification information input terminal 134 of the imaging device 100 set as the slave receives information for identifying the event distributed by the imaging device 100 set as the master. The input information for identifying the event is transmitted to the CPU 110 and used as part of the information for identifying the event in the imaging device 100 set as the slave.

[0043] Existing machine tools are provided with a configuration for notifying a person of the occurrence of an event as described above, so the imaging device 100 utilizes this configuration to receive a trigger signal or an error code via the event input unit.

[0044] The acceleration sensor 140 detects vibrations, and when it detects vibrations of a magnitude equal to or greater than a preset value, it transitions the sensor signal from a low state to a high state. The sensor signal is transmitted to the CPU 110. The CPU 110 uses the sensor signal as a type of information indicating the occurrence of an event.

[0045] The clock unit 170 keeps track of the current time, and outputs information about the current time to the CPU 110 in response to a request from the CPU 110. The CPU 110 uses the time information obtained from the clock unit 170 as part of information for identifying an event.

[0046] The image signal output terminal 180 is a terminal that outputs an image signal for displaying an image captured by the imaging unit 120 on an external monitor, and in this embodiment, an HDMI (High-Definition Multimedia Interface, registered trademark) terminal is used.

[0047] When the imaging device 100 is set to function as a master, the event distribution unit 150 distributes information identifying an event to other imaging devices 100 functioning as slaves. Specifically, under the control of the CPU 110, the event distribution unit 150 outputs from an output terminal the event occurrence time clocked by the clock unit 170 of the imaging device 100 functioning as a master, information indicating the shooting location recorded in the setting file of the memory card 200 inserted in the imaging device 100 functioning as a master, and an error code. A cable for transmitting the information identifying the event to the imaging device 100 functioning as a slave is connected to the output terminal. The output terminal of the event distribution unit 150 has a structure and pin arrangement common to the error code output terminal of the machine tool 2, and the cable connecting the error code output terminal of the machine tool 2 and the event identification information input terminal 134 of the imaging device 100 functioning as a master is compatible with the cable connecting the event distribution unit 150 of the imaging device 100 functioning as a master and the event identification information input terminal 134 of the imaging device 100 functioning as a slave.

[0048] Each of the imaging devices 100 configured as above is installed so as to photograph the machine tool 2 from different directions. Each imaging device 100 is fixed to a structure around the machine tool 2 to be photographed or a stand such as a tripod, using a screw hole provided in the lower part of the housing 105. A pan head is provided between the fixing point and the imaging device 100, so that the photographing direction can be freely changed. The lens unit 122 of each imaging device 100 is adjusted to have an angle of view so that image data can be recorded with a range in which the cause of the occurrence of an event can be investigated as the imaging range. When adjusting the imaging range, the image signal output terminal 180 of the imaging device 100 is connected to the monitor 3, and the image captured by the imaging device 100 is displayed as it is on the screen of the monitor 3 (so-called through image display), and adjustment is performed while checking the range displayed on the screen. Of the three imaging devices, the imaging device 100-1 is set to function as a master, and the remaining imaging devices 100-2 and 100-3 are set to function as slaves.

[0049] A cable for transmitting an alarm signal from the machine tool 2 is connected to the trigger input terminal 132 of each imaging device 100. This connection enables the three imaging devices 100 constituting the imaging system 1 to receive an alarm signal that is information indicating the occurrence of a common event. Furthermore, a cable for transmitting an error code from the machine tool 2 is connected to the event identification information input terminal 134 of the imaging device 100-1, which is the master. A cable for transmitting information for identifying an event distributed from the event distribution unit 150 of the imaging device 100-1 is connected to the event identification information input terminal 134 provided on each of the imaging devices 100-2 and 100-3, which are slaves.

[0050] The following describes a specific operation when the monitoring function is executed by the imaging system 1. In the following description, the operation of each component is under the control of the CPU 110, even if not specifically stated.

[0051] 5 is a diagram showing the relationship between the occurrence of an event and the recording of image data. The imaging units 120 of the imaging devices 100 constituting the imaging system 1 constantly capture moving images regardless of the occurrence of an event, and temporarily store image data from a predetermined time ago to the latest at a high frame rate (e.g., 30 frames per second) in the memory cards 200 inserted in the respective memory card slots 160. Image data for which a predetermined time has passed since the time of capture is thinned out as needed to a low frame rate (e.g., 1 frame per second) and stored in the memory card 200.

[0052] As described above, if a failure occurs in the work performed by the machine tool 2 while constantly capturing moving images, the machine tool 2 detects the failure and changes the state of the alarm signal from low to high. Then, this alarm signal is input to the trigger input terminal 132 of each imaging device 100. Upon detecting the change of the alarm signal from low to high, the CPU 110 performs control to store in the memory card 200 the high frame rate image data captured by the imaging unit 120 from a predetermined time before the time when the event occurred (i.e., the time when the change of the alarm signal from low to high was detected) until a predetermined time after the time when the event occurred. Specifically, the high frame rate image data temporarily stored in the memory card at the time when the event occurred (i.e., the image data from a predetermined time before the time when the event occurred to the time when the event occurred) and the high frame rate image data captured during the predetermined time from the time when the event occurred are recorded in a file in the memory card 200 without thinning.

[0053] Events such as work errors occur through a process of the following: an incident that causes the error, the occurrence of the error, the detection of the error, and the transmission of information indicating the occurrence of the event (for example, a change in an alarm signal). Therefore, in order to investigate the cause of a work error, it is necessary to check images before the event occurred. According to this embodiment, it is possible to check images before the event occurred.

[0054] The above-mentioned "predetermined time" is one cycle of the operating time of the machine tool 2. In this way, image data including the start to end of the cycle in which the event occurred can be stored regardless of the timing of the event occurring within one cycle of the operating time. Since image data captured from the start to the end of the cycle including the time when the event occurred can be stored without omission, it is possible to easily confirm the cause of the work mistake and the subsequent processing. In other words, by checking the image before the event occurred in the cycle in which the event occurred, the cause of the work mistake can be grasped. In addition, by checking the image after the event occurred in the cycle in which the event occurred, it can be confirmed whether the processing after the event occurred was performed appropriately.

[0055] When a file storing detailed image data captured within a predetermined time from the time an event occurred is recorded on memory card 200, CPU 110 performs control to embed information identifying the event in the file. The information identifying the event is distributed by image capture device 100-1 functioning as a master to image capture devices 100-2 and 100-3 functioning as slaves. This allows information identifying a common event to be embedded in files recorded by each image capture device 100 in response to the occurrence of one event, making it easy to classify and manage files.

[0056] In this embodiment, the information for identifying an event includes information indicating the time when the event occurred, information indicating the location where the event occurred, and an error code. CPU 110 of imaging device 100-1 functioning as a master acquires the time when the event occurred from clock unit 170 included in imaging device 100-1. Information indicating the location where the event occurred is predefined in a setting file recorded in memory card 200 inserted in imaging device 100-1 and used. An error code output from machine tool 2 is received via event identification information input terminal 134 and used.

[0057] As a method of embedding information for identifying an event, the information for identifying the event is used as part of the file name. By including the information for identifying the event in the file name, it is possible to easily understand the contents of the image data stored in the file without loading the image file into dedicated software. Also, an error code is embedded in the header of the frame in which the event occurs in the recorded video. By searching for the frame in which the error code is embedded during playback, the image at the moment the event occurred can be quickly confirmed. Also, when multiple files recorded by each imaging device 100 are simultaneously played back in response to the occurrence of one event, synchronization can be achieved by simultaneously playing back the frame in which the error code is embedded.

[0058] The CPU 110 of each imaging device 100 constituting the imaging system 1 controls so that, in addition to information for identifying the event, identification information for identifying the imaging device 100 is embedded in a file that stores image data captured by the imaging unit 120 and stored in the memory card 200. The identification information for identifying the imaging device 100 is predefined in a setting file recorded in the memory card 200 inserted in each imaging device 100 and used.

[0059] After a predetermined time has passed since the time the event occurred, video images are captured again at all times, and image data from a predetermined time before to the latest is temporarily stored at a high frame rate in the memory cards 200 inserted in the respective memory card slots 160, while image data for which a predetermined time has passed since the image capture is thinned out as needed to a low frame rate and stored in the memory cards 200. In this way, the contents of image data captured during a time period when no event is occurring can be roughly checked, and the contents of image data captured during the time when an event is occurring can be checked in detail. Also, images from a time when no event is occurring can be stored while suppressing the size of the file that stores the image data.

[0060] In addition to the case where the machine tool 2 notifies the imaging system 1 of the occurrence of an event by an alarm signal as described above, each imaging device 100 constituting the imaging system 1 of this embodiment treats the detection of vibration of a preset intensity or more by the acceleration sensor 140 included in each device as the occurrence of an event, and stores high frame rate image data captured by the imaging unit 120 from a predetermined time before the vibration was detected to a predetermined time after the event occurrence time in the memory card 200. Storage of image data triggered by detection of vibration is performed only by the imaging device 100 including the acceleration sensor 140 that detected the vibration, and image data is not stored in the other imaging devices 100. As a result, an event exists in which only the imaging device 100 that detected the vibration stored a file, so that it is possible to easily identify an imaging device 100 that may have had an abnormality.

[0061] In this way, when vibrations of a predetermined value or more are applied to the device other than when an alarm signal is received from the machine tool 2, it is possible to record images before and after the event as an event has occurred. In a situation where unexpected vibrations or an abnormality on the imaging device side is detected, such as when the imaging device itself is subjected to an impact or the imaging direction is changed, the event can be generated by itself and images can be recorded. This makes it easier to notice changes in the imaging direction of the camera, and by correcting the imaging direction, it is possible to prepare for appropriate imaging when an event such as an abnormality in the machine tool 2 occurs.

[0062] Information for identifying an event different from the case where an alarm signal from the machine tool 2 is used as a trigger for recording is embedded in the file that is triggered by the detection of vibration by the acceleration sensor 140. Specifically, an error code indicating that abnormal vibration has been detected is embedded as information for identifying the event.

[0063] The viewer running on the computer has a function of synchronously playing files storing image data recorded by the three imaging devices 100 when a common event occurs. The viewer synchronously plays back the image data so that frames with error codes embedded in the headers of the image data are played back at the same timing. The viewer also displays the time information, location information, and error code included in the information identifying the event in association with the image being played. When selecting a file to be played back, the viewer also displays multiple files with common information identifying the event in association with each other. This makes it easy to identify files to be played back synchronously. The viewer also has a function of searching for files to be played back using the time information, location information, and error code as keys. Such a viewer can quickly find files storing image data captured from multiple directions before and after an event, and play them back synchronously, making it easy to investigate the cause of the event and check post-event processing.

[0064] According to the imaging system 1 described above, it is possible to eliminate the need to manually input information for identifying an event or identification information of an imaging device. Therefore, in a case where images stored at the time of an event by devices installed in a remote factory are sent together to a management department or the like and the contents of the images are checked by the management department, the side sending the file obtained by shooting the image by the imaging device 100 can send the file in which various information is automatically embedded as is. Also, the side checking the sent image can handle the file in which predetermined information is reliably embedded. Therefore, it is possible to reduce the labor on both the sending side and the receiving side. Also, since image data captured before and after the event is generated by a plurality of imaging devices 100 can be stored, it becomes easy to check the situation before and after the event is generated.

[0065] Furthermore, when an event occurs, the multiple imaging devices 100 constituting the imaging system 1 embed information identifying a common event in a file, so that the occurrence of the common event can be used as a trigger to easily identify image data stored by each imaging device 100. Furthermore, if the information identifying an event includes information indicating the type of event, file classification and management can be facilitated. [Modification of the first embodiment]

[0066] The present invention is not limited to the first embodiment described above, and any modifications and improvements that can achieve the object of the present invention are included in the present invention.

[0067] For example, in the first embodiment, when the machine tool 2 detects a failure in the work it performs, an abnormality in the equipment, or the like, the signal to the rotating light 21 connected to the machine tool 2 is branched and used to receive information indicating the occurrence of an event. However, the machine tool 2 may be configured to output an alarm signal indicating the occurrence of an abnormality to the outside, and use this alarm signal as information indicating the occurrence of an event. In addition, when the signal to the rotating light 21 is branched and used, for example, the rotating light 21 may be one that lights up blue in normal times and lights up red when an abnormality occurs, and a control signal for turning the light red may be used as the alarm signal. In addition, the imaging device 100 may be provided with a light receiving element that detects red light emission, and the red light emission of the rotating light 21 may be received as information indicating the occurrence of an event. In addition, the rotating light 21 may be one that lights up red and emits an alarm sound when an abnormality occurs, and a microphone that detects the alarm sound may be provided in the imaging device 100, and the alarm sound of the rotating light may be received as information indicating the occurrence of an event. In addition, the object of imaging by the imaging device 100 is not limited to a machine tool, and may be various robots, processing machines, etc. arranged on a factory line. As an example, Figure 6 shows a schematic diagram of the sequence of actions taken when an event occurs, when a robot that is placed on a strawberry cake production line and that arranges strawberries on the top of a cake is the subject of photography. The robot does not have a rotating light, and is configured to be able to output an alarm signal to the outside when it detects a failure in its work.

[0068] In the above first embodiment, the master imaging device 100-1 adds information indicating the time and information indicating the shooting location to the error code received from the machine tool 2 and distributes it to the slave imaging devices 100-2 and 100-3 as information identifying the event, but the error code received from the machine tool 2 may also be distributed directly to the slaves.

[0069] In the first embodiment, the means for transmitting the information to be "distributed" is wired, but it may be wireless. When transmitting wirelessly, any wireless communication standard may be used, such as Wifi, 3G, Bluetooth (registered trademark). The method for distributing information is not limited to a method of directly distributing information from a master to each slave, but includes a method of indirectly distributing information. For example, a configuration may be adopted in which a plurality of slaves are cascaded in multiple stages starting from one master, and information for identifying an event or information indicating the occurrence of an event supplied from the master is transmitted to the subsequent stages in sequence. As another example, all the imaging devices 100 may be connected to a network, and the information to be distributed from the master may be broadcast on the network to transmit the information to all the slaves.

[0070] In the first embodiment, identification information defined in advance in the memory card 200 is used as identification information for identifying the device, but instead of this, information uniquely assigned in advance to each device, such as a MAC address, may be used. Furthermore, when setting the configuration of the imaging system 1, identification information may be automatically set through communication between the master and slaves so that there is no duplication.

[0071] Furthermore, the CPU 110 of the imaging device 100 functioning as a slave may be controlled to embed and store the identification information of the imaging device 100 functioning as a master in a file that stores image data. In this way, common information is embedded in files stored by slaves connected to a common master, making it easy to find image files captured in response to a common event.

[0072] In the first embodiment, the machine tool 2 and each imaging device 100 are directly connected to transmit information indicating the occurrence of an event (i.e., an alarm signal), but the event distributor 150 of the imaging device 100-1 functioning as the master may be configured to distribute information indicating the occurrence of an event in addition to information identifying an event to the slaves. In this way, the information indicating the occurrence of an event can be distributed together with the information identifying an event, making it easier to connect and set up each device constituting the system. In this case, it is preferable to integrate a cable that transmits the information identifying an event and a cable that transmits the information indicating the occurrence of an event. In this way, it is possible to reduce the number of cables used to connect the master and the slaves, making it easier to connect and set up. In addition, it is preferable to configure the cable that transmits the information indicating the occurrence of an event from the master to the slave so as to be compatible with transmitting an alarm signal from the machine tool 2 to the master.

[0073] Also, a serial number from the start of recording may be transmitted together with information indicating the occurrence of a triggering event, and this serial number may be used to associate the files of image data recorded by each imaging device 100. This serial number from the start of recording may be used as part of the information for identifying the event.

[0074] In the first embodiment, when the acceleration sensor 140 detects vibrations of a preset intensity or more, images are recorded only in the imaging device 100 equipped with the acceleration sensor 140 that detected the vibrations. However, information indicating the occurrence of an event may be transmitted to the other imaging devices 100, and the other imaging devices 100 may also record images. To distribute information indicating the occurrence of an event from an arbitrary imaging device 100 to the other imaging devices 100, the information indicating the occurrence of the event may be transmitted individually from the imaging device that is the distribution source to each of the other imaging devices. However, for example, it is preferable to connect all imaging devices 100 to a network, and broadcast information indicating the occurrence of an event on the network from the imaging device that is the distribution source. This allows information indicating the occurrence of an event to be transmitted to all imaging devices 100 at approximately the same timing.

[0075] In the first embodiment, the imaging unit 120 captures a moving image as an image, but may capture, for example, a still image. The image may be, for example, a 2D image or a 3D image. The image may be, for example, a black and white image or a color image. The lens section of the imaging unit 120 may be a short focal length lens instead of a zoom lens.

[0076] In the first embodiment, the memory card 200 inserted into the memory card slot 160 is used as the storage means, but other storage devices such as a hard disk drive may be used instead of the memory card. The storage means is not limited to being removable, and may be built in the housing 105 in a non-removable manner. In the first embodiment, the memory card 200 inserted into the memory card slot 160 of each imaging device 100 is used as the storage means, but the imaging devices 100 may store image data in a common storage means (for example, a storage area provided on a hard disk drive or a communication network). However, the best configuration is one in which the image data is stored in each imaging device 100 described above. In particular, when a manufacturing line has just been constructed in a factory, in a temporary setting such as when monitoring for trouble for a period of about 3 to 4 months, it is possible to simply attach the imaging devices by screwing them in and store the data in each imaging device without assembling a large-scale system. In addition to the temporary setting, when an event does not occur frequently, it is possible to easily capture the situation when an abnormality occurs in the machine tool without carrying out large-scale system construction.

[0077] In the first embodiment described above, the camera is configured to capture moving images continuously, but it may be configured to receive an operation start signal at the start of one operation cycle, and start recording of video when the operation start signal is received. Also, for example, the camera may be configured to receive an operation end signal at the end of one operation cycle, and not record the image data corresponding to that cycle when the operation end signal is received without receiving a signal indicating the occurrence of the event from the outside. For example, when a signal indicating the occurrence of an event is received from the outside, it is preferable to perform a process of extending the recording of image data at least for the recovery time due to the occurrence of the event.

[0078] In the first embodiment described above, image data captured by the imaging unit 120 is temporarily stored in the memory card 200 for a predetermined period of time. However, the image data may be temporarily stored in a memory element such as an SDRAM incorporated in the imaging device 100, and high frame rate image data when an event has occurred and low frame rate image data when no event has occurred may be finally recorded in the memory card 200.

[0079] In the above first embodiment, when an event occurs, high frame rate images are recorded from a predetermined time before the event occurs until a predetermined time after the event occurs, but the predetermined time may be different between the recording time before the event occurs and the recording time after the event occurs, and it is preferable to allow the user to freely set the time. For example, if the machine tool 2 requires a longer time than one normal operation cycle to process after the event occurs, the recording time after the event occurs may be longer. In this way, it is possible to more reliably investigate the cause of the event occurrence and check the post-event processing.

[0080] In the first embodiment, the information identifying the event is embedded in the file by using it as a part of the file name, but it is also possible to embed it in other ways. For example, the information identifying the event may be embedded in the image as a watermark. In this way, the information identifying the event can be embedded without increasing the size of the file and without having a visible effect on the image. In addition, it is possible to make it difficult to tamper with the information identifying the event. As another example, the information identifying the event may be embedded as characters superimposed on the image. As yet another example, the information identifying the event may be embedded as additional information in the file that stores the data. Note that "additional information" refers to information other than the image itself, such as a header, footer, etc., in the file that stores the image data.

[0081] In the first embodiment, information for identifying three events, i.e., information indicating the time when the event occurred, information indicating the location where the event occurred, and information for identifying an event including an error code, is used as at least a part of the file name. However, for example, information for identifying a first event (e.g., information indicating the time when the event occurred) may be used as at least a part of the file name, information for identifying a second event (e.g., information indicating the location where the event occurred) may be embedded as a watermark in the image, and information for identifying a third event (e.g., an error code) may be embedded as additional information in a file that stores image data. For example, the information for identifying the first to third events may be the same information, but it is particularly preferable to configure the information to include different information. In particular, the information may be completely different information, but it is particularly preferable to include the same information for some information. In this way, the user can easily visually identify the same information from the file name, and it is also possible to make it difficult to tamper with the information for identifying the first to third events, and to easily detect tampering by comparing the information for identifying the first to third events. In particular, it is preferable to configure the information for identifying the same information to be stored as information in different expression formats for some information. For example, the information used in the file name may be character string information that uniquely corresponds to the location and information specifying the date and time when the event occurred, such as a location code that uniquely corresponds to the location and is a string of alphanumeric characters or the like that allows a person to identify the location, and an event code that is a code indicating the date and time and the content of the event, in that order, while the additional information or watermark may store a character string indicating the name of the location corresponding to the location code and a character string indicating the specific content of the event corresponding to the event code.

[0082] In the first embodiment described above, a file was configured so that there was one frame in which an event occurred in the video of one file, but it may also be configured so that there are multiple frames in which an event occurred in the video of one file.

[0083] In the first embodiment, images with a high frame rate are recorded from a predetermined time before the event occurs until a predetermined time after the event occurs, and images with a low frame rate are recorded at other times, but images may not be recorded at other times. Also, images with a large amount of information may be recorded by lowering the compression rate of the image file (or not compressing it), increasing the image quality of the image file (for example, HD (High Definition) images), making it a color image, etc., from a predetermined time before the event occurs until a predetermined time after the event occurs, and the amount of information may be reduced by increasing the compression rate of the image file, lowering the image quality of the image file (for example, VGA images), making it a black and white image, etc., at other times.

[0084] In the above first embodiment, an example was described in which a viewer serving as a playback means is provided as software executed on a computer separate from the imaging device 100. However, the imaging device 100 may also be provided with a playback means integrated within the housing 105 that plays back and displays the captured image data.

[0085] Second Embodiment FIG. 7 shows an example of installation of the imaging device 100 in the second embodiment of the present invention. In this embodiment, the imaging device 100 is placed on a table in a workplace and monitors the table. For example, when workers leave the workplace during lunch break, the imaging device 100 monitors tools and the like placed on the table. In this embodiment, the imaging device 100 operates using power supplied from a battery used for power tools and the like. The imaging device 100 of this example receives a sensor signal indicating abnormal vibration output from an internal acceleration sensor or a trigger signal from an external sensor as information indicating the occurrence of an event, and records image data captured before and after the event occurs.

[0086] Third Embodiment FIG. 8 shows an example of installation of the imaging device 100 in the third embodiment of the present invention. In this embodiment, the imaging device 100 is attached to a frame at the rear of the cab of a forklift and captures the front. The imaging range is set to include the cab and the area in front of the forklift, particularly the forks. The imaging device 100 in this example is configured so that a screw hole for mounting is also provided on the top surface of the housing so that the imaging device 100 can be installed by hanging it from the top. The imaging device 100 in this embodiment is equipped with a temperature measuring means. When the forklift goes in and out of a freezer, the imaging unit fogs up, so in order to prevent this, the imaging unit is heated by an electric heating wire and a thermostat only when the temperature measuring means detects a low temperature to prevent fog. In addition, the temperature measuring means detects a sudden change in temperature (for example, a temperature change associated with going in and out of a freezer) as an event, and the captured image data is recorded. [Explanation of symbols]

[0087] 1. Imaging system 2 Machine tools 3 Monitors 100 Imaging device 105 Case 110 CPU 120 Imaging unit 130 Event Input Section 140 Acceleration Sensor 150 Event Distribution Department 160 Memory card slot 170 Timing section 200 Memory Card

Claims

1. An imaging device for monitoring a tabletop in a work area, A photographing means; A function of operating using power supplied from an object placed on the table; A function to receive information indicating the occurrence of an event; a function of recording image data captured by the photographing means before and after the occurrence of the event; An imaging device having the same.

2. an acceleration sensor provided inside the photographing device placed on the table; The receiving function includes: A sensor signal indicating an abnormal vibration output from the acceleration sensor is received as information indicating the occurrence of the event. The imaging device according to claim 1 .

3. The object is a power tool used in the workshop.

3. The imaging device according to claim 1.

4. A photographing device that monitors the table top of the work area when no workers are present in the work area. The imaging device according to claim 1 .

Images