Apparatus and program

The apparatus efficiently captures and stores imaging data before and after an event, enabling rapid review of relevant content, addressing the challenge of long playback times in surveillance systems.

JP2025098094AActive Publication Date: 2025-07-01YUPITERU CORP
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2025043144
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2025-03-18
Publication Date
2025-07-01
Estimated Expiration
2036-01-25

AI Technical Summary

Technical Problem

Surveillance cameras require long playback times to locate abnormal events, making it difficult to efficiently confirm imaging content before and after the event.

Method used

An apparatus with an event detection unit that stores imaging images before and after the event in a storage medium, triggered by detected event information, allowing easy playback of relevant content.

Benefits of technology

Facilitates quick access to imaging content before and after an event, reducing the time required to identify and address issues.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025098094000001_ABST
    Figure 2025098094000001_ABST
Patent Text Reader

Abstract

To provide an apparatus etc. capable of acquiring a captured image which enables a user to easily check the contents of photographing before and after the occurence of an event.SOLUTION: The apparatus comprises: event detection means which detects information indicating the occurence of an event generated by an imaging target; and control means which has a function of, with the detection of the information indicating the occurrence of the event by the event detection means as a trigger, storing captured images in a record period including before and after the moment of detecting the information indicating the occurrence of the event, in a storage medium.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an apparatus, a program, and the like.

Background Art

[0002] There has been proposed a surveillance camera including a lens unit and storing imaging data captured by the lens unit in a removable storage medium (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Normally, in such a surveillance camera, since the monitoring object is continuously imaged at all times, in order to confirm the imaging content at the time of abnormality, it is necessary to play back a long video from the beginning to search for and confirm the problematic scene by fast-forwarding or the like. For this reason, the confirmation work has taken a very long time.

[0005] Therefore, an object of the present invention is to provide, for example, an apparatus or the like capable of acquiring an imaging image that can easily confirm the imaging content before and after the occurrence of an event.

Means for Solving the Problems

[0006] (1) In order to solve the above problems, the present invention provides an apparatus including an event detection unit that detects information indicating the occurrence of an event generated by an imaging target, and a control unit that has a function of storing, in a storage medium, an imaging image in a recording period including a time before and after the moment when the event detection unit detects the information indicating the occurrence of the event, triggered by the detection of the information indicating the occurrence of the event by the event detection unit.

[0007] By doing so, in response to information indicating the occurrence of an event emitted by the imaging target, it becomes easy to check the content of the images captured before and after the time when the event occurred. For example, for checking the images, it is preferable to provide a playback means for the user to play back the stored captured images in a visible manner. The playback means may be provided integrally with the control means or may be provided separately. Also, in the present invention, it is preferable to provide an imaging means together with the control means. The imaging means may always perform imaging regardless of the occurrence of an event and temporarily store the captured images over a predetermined period of time. Then, when the control means detects information indicating the occurrence of an event, the control means may control to store the captured images captured within a predetermined time before and after that in a storage medium. Also, in the present invention, the storage medium may be built into the device in which the control means is provided, but it is preferably provided detachably from the device in the form of, for example, a memory card, a hard disk drive, or the like.

[0008] The "event" may be, for example, something that occurs when an abnormality occurs. For example, it may be various events, particularly those caused by a failure in the operation of a machine tool operating on a factory production line, a change or abnormality in the state detected by an external sensor, etc. An automatic recovery from an abnormal state may also be an event.

[0009] "Information indicating the occurrence of an event" may be, for example, information indicating a change in state or the occurrence of an abnormality. Specifically, for example, when the imaging target is a machine tool, the information generated when the machine tool detects a work failure may be regarded as "information indicating the occurrence of an event". It is particularly preferable to regard an alarm signal or an alert signal generated when the machine tool detects a work failure as "information indicating the occurrence of an event". Also, for example, a signal from a signal lamp connected to the machine tool (for example, a status signal indicating that the signal lamp is lit) or a drive signal for flashing the signal lamp may be regarded as "information indicating the occurrence of an event". Further, "information indicating the occurrence of an event" may be an external output signal for the imaging target device to notify the outside of the occurrence of an event such as an abnormality. Then, the control means may perform control to store the captured image captured by the imaging means in the storage medium upon the change of these signals. Also, "information indicating the occurrence of an event" may be configured not only to detect a signal received from the outside but also to detect the occurrence of an event inside the device. For example, the life and degradation degree of the storage medium may be judged inside the device, and when a predetermined judgment such as the approaching of the life is made, it may be treated as the occurrence of an event.

[0010] "The time when the event occurred" may be, for example, the time immediately after detecting the information indicating the occurrence of the event.

[0011] "The captured image" may be captured with the imaging range being the range where the cause of the event occurrence can be traced.

[0012] "The image" may be, for example, a still image, but is particularly preferably a moving image. Also, the image may be, for example, a 2D image or a 3D image. For example, it may be a black-and-white image or a color image.

[0013] (2) The imaging target may be a device that controls to notify a human of the occurrence of an event when the event occurs. For example, at a site such as a factory, a logistics warehouse, or an automated warehouse, a machine that performs some kind of automatic processing such as a machine tool or an automatic conveyor may be the imaging target. Also, a device that is expected to be used by a general user even if it is not automated, such as an automated teller machine (so-called ATM) or a self-checkout, may be the imaging target. And the control means may detect, as information indicating the occurrence of the event, information emitted by these devices in association with the control for notifying the occurrence of the event.

[0014] (3) The information indicating the occurrence of the event may be an electrical or optical signal emitted by the device due to the occurrence of an abnormality.

[0015] "The electrical or optical signal transmitted to the device" may be any signal as long as it is a signal emitted by the device due to the occurrence of an abnormality. For example, it may be a binary signal indicating a status such as on / off, an audio signal transmitting analog audio, a pulse train, etc., and particularly preferably a signal that repeats a predetermined pattern. In this way, the information indicating the occurrence of the event can be surely received and detected.

[0016] (4) The information indicating the occurrence of the event may be a signal that is emitted by the device in a recognizable manner to a human due to the occurrence of an abnormality. For example, when the information indicating the occurrence of the event is visual information, the imaging means may detect the information indicating the occurrence of the event.

[0017] "A signal emitted in a recognizable manner to a human" may be, for example, auditory information such as a siren, a beep sound, a melody, visual information such as light emission, an image, motion information such as vibration, impact, etc.

[0018] Alerts and the like issued to humans mounted on the machine can be used as a function indicating the occurrence of an event, and images before and after the occurrence of an abnormality can be recorded. In particular, when detecting visual information or auditory information as information indicating the occurrence of an event, troublesome operations such as branching signals when installing the device are unnecessary, and the device can be easily installed and removed.

[0019] (5) The imaging target emits different information according to the type of event that has occurred, and the control device stores in advance different recording periods corresponding to the identified information. Based on the information indicating the occurrence of the detected event, the control device identifies the event that has occurred and stores the captured images during the recording period corresponding to the identified event in the storage medium. For example, when the control device detects an electrical or optical signal emitted by the device due to the occurrence of an abnormality as information indicating the occurrence of an event, the control device may identify the information indicating the occurrence of the event based on the type, pattern, etc. of the signal. For example, an existing signal for the device may be branched and used.

[0020] In this way, multiple types of information corresponding to the event that has occurred can be identified, and an appropriate recording period can be set according to the type of event. For example, for information indicating the occurrence of an event for which analysis or identification of the cause of the event is required, a longer recording period may be provided before the moment when the information is detected, and for information indicating the occurrence of an event that should focus on the transition after the occurrence of the event, a longer recording period may be provided after the moment when the information is detected. The imaging device may control the recording period to be different for each type of information indicating the occurrence of an event, and may store the recording period in advance in association with the type of event.

[0021] (6) The control means may be capable of executing control to set a predetermined time from the moment when the information indicating the occurrence of an event is detected as a non-responsive period that does not respond to the information indicating the occurrence of a new event. (7) When the information indicating the occurrence of an event continues to be emitted after the occurrence of the event, the control means may be capable of executing control to set a predetermined time from the moment when the information indicating the occurrence of the continuously emitted event stops as a non-responsive period that does not respond to the information indicating the occurrence of a new event.

[0022] The "non-response period" may be set to a period sufficient to confirm that the continuation of the information indicating the occurrence of an event has stopped. For example, in the case of a pulse train in which the information indicating the occurrence of an event is continuously repeated in a predetermined pattern, it may be set to a period longer than the longest low time in the pattern.

[0023] By providing such a non-response period, it is possible to prevent multiple records from being left when information indicating the occurrence of multiple events is detected in a short period of time. For example, when information indicating the occurrence of multiple events is emitted for an event that should be recognized as one event, it is possible to suppress unnecessary recording.

[0024] (8) The control means may use a predetermined time immediately after the recording period as a monitoring period, and when information indicating the occurrence of a new event is detected within the monitoring period, execute control to treat the end of the monitoring period as the moment when the information indicating the occurrence of the new event is detected. (9) The monitoring period may be provided so that the recording period based on the end of the monitoring period overlaps with the immediately preceding recording period.

[0025] When information indicating the occurrence of the next event is detected immediately after the end of the recording period, it is possible to increase the recording time combined with the previous recording period while suppressing the overlap of the recording periods.

[0026] (10) The control means may sequentially record a series of captured images over a past predetermined period at consecutive addresses in the recording area of the storage medium, and perform control to increment by 1 an overwrite count value indicating the number of times of overwriting data to the address where the captured image being recorded is recorded for each captured image.

[0027] In this way, by recording the overwrite count value indicating the number of overwrites, it becomes possible to determine the lifespan of a storage medium such as a NAND flash memory that malfunctions as the number of write operations increases. Also, by means of control to sequentially record at consecutive addresses in the recording area, the process of searching for the next write area during the recording process becomes unnecessary, shortening the write time. At the same time, it becomes possible to use the addresses within the storage area evenly, avoiding excessive use of only a part of the storage area.

[0028] (11) The control means may detect, in the storage area of the storage medium, a captured image for which the overwrite count value is different from the overwrite count value recorded for the immediately preceding captured image, and perform control to overwrite the detected captured image and record the next captured increment.

[0029] By doing so, it becomes possible to identify the address to which the next captured image should be written without separately storing it. Also, by writing the next captured image from the address thus identified, it becomes possible to use the addresses within the storage area evenly, avoiding excessive use of only a part of the storage area.

[0030] (12) The control means may hold, in a management area different from the storage area for storing captured images in the storage medium, a format count master value indicating the number of times the storage medium has been initialized. Along with recording captured images at consecutive addresses in the storage area of the storage medium, for each captured image, the format count master value is transferred as a format count value, and data of a captured image for which a format count value different from the current format count master value is recorded is treated as having been erased.

[0031] By doing so, the time required for formatting can be shortened. Further, in the case of a storage medium whose deterioration is accelerated by physically erasing the stored data, formatting can be completed by updating only the format master count value, so that it is possible to prevent the life of the storage medium from being shortened due to formatting.

[0032] (13) In the program of the present invention, the computer may function as any of the above-described devices.

Brief Description of the Drawings

[0033]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Embodiments for Carrying Out the Invention

[0034] 〔First Embodiment〕 At sites such as factories, logistics warehouses, and automated warehouses, machines that perform some kind of automatic processing, such as machine tools and automatic conveyors, are used. Also, machines that are expected to be used by people who are not used to using machines, such as automated teller machines (so-called ATMs) and self-checkout counters, are used in general stores and the like. In general, these machines are equipped with a function to notify people such as the manager and supervisor of the device of the occurrence of an abnormality by means of a lamp, an alarm sound, etc. when some kind of abnormality occurs. However, even if the manager rushes to the site after an abnormality simply occurs, if only the situation after the abnormality has occurred can be seen, it may be difficult to take appropriate measures such as identifying the cause of the abnormality or preventing the recurrence of the abnormality. For this reason, before the occurrence of an abnormality, the video of the machine equipment is taken with a video camera or the like, and the state before and after the occurrence of the abnormality is confirmed after the occurrence of the abnormality by looking at the recorded video.

[0035] For example, assume a situation where a manufacturing line using a new machine tool is constructed in a factory. When the manufacturing line is newly constructed, the machine tools that make up the line cause various troubles for a period of about 3 to 4 months. Therefore, it is necessary to monitor the machine tools and carry out improvement activities to eliminate the causes of the troubles. For example, troubles such as screws falling off or falling down may occur on a screw-tightening line. Activities are carried out to eliminate the causes of such troubles, reduce the troubles to almost zero, and ensure that the products are properly manufactured. Conventionally, when a machine tool was constantly photographed with a video camera and an abnormality was later found from the data recorded by the machine tool, the operator had to look at the images taken from the beginning.

[0036] The imaging device 100, which is an embodiment of the present invention described below with reference to the drawings, can be suitably used for imaging images of such machinery and equipment. The imaging device 100 of the present embodiment is a device that records the video of the machine tool 2 in order to monitor the work content of the machine tool 2 operating on the manufacturing line of the factory. FIG. 1 is a schematic diagram showing the imaging device 100 together with the machine tool 2. FIG. 2 is a schematic diagram showing an outline of the operation sequence when an event occurs in the machine tool 2. The imaging device 100 is temporarily installed beside the machine tool 2 on a tripod.

[0037] In this embodiment, the machine tool 2 to be monitored is assumed to perform screw tightening operations on the production line. The machine tool 2 repeats this screw tightening operation every predetermined operation cycle (for example, 30 seconds). When the machine tool 2 detects a failure in the operation it performs or an abnormality in the equipment, etc., it outputs an alert signal indicating the occurrence of the abnormality. A transition from a normal state to a state different from the normal state, such as a work failure or equipment abnormality, etc., is called an "event". The machine tool 2 maintains the alert signal at a low level during normal times. On the other hand, when an event occurs, it continuously outputs a pulse that alternates between high and low. The alert signal is input to the stacked signal lamp 21 as a lighting control signal. The stacked signal lamp 21 is, for example, a display in which a plurality of colored signal lamps such as red, yellow, and blue can be independently lit / extinguished. Each colored signal lamp is in an extinguished state when the signal level of the corresponding control signal is low, and in a lit state when it is high. In this embodiment, the red lamp in the stacked signal lamp 21 is controlled by the alert signal. In this embodiment, the alert signal is input to the stacked signal lamp 21 as a control signal for turning on / off the red lamp of the stacked signal lamp 21, and the red lamp blinks according to the alert signal. After outputting the alert signal, the machine tool 2 stops the operation, eliminates defective products, resumes the operation, stops the pulse of the alert signal, and returns to the normal state with a low level. These series of processes starting from the detection of these failures, going through alerts, stopping of operations and elimination of defective products, and leading to resumption of operations may be completed within the operation cycle in which the failure is detected, but may not be completed within the operation cycle. During that time until completion, the pulse of the alert signal continues to be continuously output without being stopped. The imaging device 100 detects the occurrence of an event from the first change of the alert signal state from low to high, and captures and records images during a recording period including the time before and after the moment of event occurrence.

[0038] The video recorded by the imaging device 100 is played back by a dedicated browser, which is display / playback software operating on a personal computer. The dedicated browser is a program executed by the CPU of the personal computer and is installed on the personal computer in the management department located away from the factory where the imaging device 100 is installed. In the dedicated browser, in addition to playing back the video recorded by the imaging device 100, various settings such as frame rate, image quality, recording method, overwrite permission, etc., and formatting for the imaging device 100 of the memory card 200 can be performed.

[0039] FIG. 3 is a schematic diagram showing the external appearance of the imaging device 100, and FIG. 4 is a block diagram showing the configuration of the imaging device 100 together with the memory card 200. The imaging device 100 includes a control controller 110, an imaging unit 120, an event input terminal 130, a memory card slot 160, and an image signal output terminal 180 inside a substantially cylindrical housing 105. A screw hole (not shown) for attaching the imaging device to a tripod head or a shooting location is provided in a part of the cylindrical side surface of the housing 105. Inside the housing 105, the imaging unit 120 is arranged such that the direction in which this screw hole is provided is downward.

[0040] The control controller 110 is an example of the control means of the present invention. The control controller 110 includes a microcomputer including a CPU (not shown), main memory such as ROM and RAM, and a timer. In the ROM of the control controller 30, an image processing program for saving the captured image by the imaging unit 120 in the main memory or the memory card 200 inserted into the memory card slot 160, and various programs such as an OS (Operation System) are stored. The CPU of the control controller 110 performs various controls according to these control programs. In addition, the control controller 110 detects an alert signal, which is information indicating the occurrence of an event input to the event input terminal 130, and executes control according to the event.

[0041] The imaging unit 120 corresponds to the imaging means of the present invention. The imaging unit 120 is provided at one end in the longitudinal direction of a substantially cylindrical housing 105 with the longitudinal direction of the housing 105 as the optical axis. The imaging unit 120 is composed of a lens unit 122 and an imaging element 124. The lens unit 122 includes a zoom lens and can set the angle of view according to the size of the imaging target and the distance to the imaging target. The imaging element 124 is a CCD, a CMOS image sensor, etc., and acquires the image of the imaging target imaged by the lens unit 122 as an imaging image.

[0042] The event input terminal 130 is a signal input terminal provided on the side surface of the housing 105. A wiring branched by an electro tap or the like is connected to the event input terminal 130, which transmits a connection line for an alert signal for lighting the stacked signal lamp 21 for abnormality notification when the machine tool 2 detects a work failure, and receives the alert signal as a trigger signal indicating the occurrence of an event. The trigger signal is transmitted to the control controller 110 and detected as information indicating the occurrence of an event.

[0043] Existing devices such as machine tools are provided with a notification function for notifying people that an event (for example, an abnormality of the device) has occurred. The above-mentioned stacked signal lamp 21 is an example thereof. In addition, a rotating lamp, a buzzer, a siren, etc. are also examples of the notification function. The imaging device 100 of the present embodiment diverts the signal used in the notification function provided in the device, such as by branching, and receives the trigger signal via the event input terminal.

[0044] The image signal output terminal 180 is a terminal for outputting an image signal for displaying the image captured by the imaging unit 120 on an external monitor. In this embodiment, an HDMI (High-Definition Multimedia Interface, registered trademark) terminal is used.

[0045] The memory card slot 160 is provided at the end of the housing 105 opposite to the imaging unit 120. A memory card 200 corresponding to the storage medium of the present invention is inserted into the memory card slot 160. According to the control of the control controller 110, a file storing the captured image captured by the imaging unit 120 is recorded on the memory card 200.

[0046] As shown in FIG. 5, the memory card 200 is divided into a file system area 210 and an imaging recording area 220 and used. The file system area 210 is a file system that can be read and written by the OS of a personal computer in the same way as a general recording medium of a personal computer, and is a partition in the FAT32 format in this embodiment. Dedicated browser software is stored in this file system area 210. When reproducing the recorded content of the memory card 200 on a personal computer, if the dedicated browser is not installed on the personal computer, etc., the dedicated browser can be installed on the personal computer from this file system area 210. The imaging recording area 220 is a partition in a unique format that cannot be read or written by the OS of a personal computer. This imaging recording area 220 is always divided into a normal recording area 222 and an event recording area 224 and used.

[0047] The nonvolatile recording area 222 includes an administrative area 222A and a storage area 222B. The administrative area 222A is an area where various setting information is recorded by a dedicated browser. When an imaging image is recorded by the imaging device 100, no recording is performed in the administrative area 222A. By doing so, even if the power is cut off during shooting, the setting data in the administrative area 222A will not be lost. In the administrative area 222A, an overwrite count master value MUC, a format count master value MFC, an overwrite upper limit value UL, etc. are recorded. The overwrite count master value MUC indicates the maximum number of overwrites performed on each storage unit of the nonvolatile recording area 222. The overwrite count master value MUC is updated to the same value as the maximum overwrite count value UC in the storage area 222B when the dedicated browser records setting information in the administrative area 222A of the memory card. The format count master value MFC indicates the number of times the nonvolatile recording area 222 has been formatted. Also, the overwrite upper limit value UL indicates a guideline for the number of overwrites at which a failure of the memory card 200 occurs, and this overwrite upper limit value UL can be used as a guideline for determining the lifespan (i.e., approximately how many more times overwriting is possible). This overwrite upper limit value UL varies depending on the type of memory card. When the user formats the memory card using the dedicated browser or the like, the user can record the overwrite upper limit value UL in the administrative area 222A by specifying the model number of the memory card to be used or by directly inputting a value.

[0048] The storage area 222B is an area for storing imaging images captured by the imaging device 100. A header and a footer are provided for each frame of the imaging image, and additional information regarding the imaging image of this frame is recorded in this header and footer. Since the recording size combining the imaging image and the additional information is larger than 1 byte, which is the address allocation unit of the memory card, the imaging image and the additional information for one frame are recorded at a plurality of consecutive addresses. In the example shown in FIG. 5, recording is performed at 32,768 bytes (32 kilobytes) per frame.

[0049] As additional information recorded in the headers and footers of each frame, the imaging time CT of the captured image of the frame, the format count value FC, the overwrite count value UC (which is "1" at the time of the first write), the trigger flag TF indicating that the image was captured at the timing when an event occurred, etc. are recorded. The format count value FC is a value indicating the number of times the formatting process has been performed on the memory card 200. The overwrite count value UC is a value indicating the number of times data has been written to the address. The format count value FC and the overwrite count value UC are used for life management, recording control, etc. of the memory card 200. The information recorded in the header and footer may have non-overlapping contents, or may have exactly the same contents, but it is particularly good to make only a part of them overlap as in the example shown in FIG. 5. By making only a part of the contents of the header and footer overlap, the difficulty of forging the data including the additional information can be increased.

[0050] The control controller 110 of the imaging device 100 stores the continuously captured imaging images in the storage area 222B in order of capture at consecutive addresses. Specifically, when recording the imaging image in the storage area 222B for the first time, the recording starts from the head address of the storage area 222B in order. For example, as shown in FIG. 5, the first frame is at addresses 0 to 32767, the second frame is at addresses 32768 to 65535, and so on. The imaging images are recorded in order of capture using consecutive addresses in the storage area 222B. Then, when the final address of the storage area 222B is reached, it returns to the head address of the storage area 222B and continues recording while overwriting the data that has already been written. At the time of recording after the second round and later, the overwrite count value UC is recorded as a value increased by 1 from the current value.

[0051] The event recording area 224 also includes a management area 224A and a storage area 224B, similar to the permanent recording area 222. In the management area 224A, the format count master value MFC, the overwrite count master value MUC, the overwrite upper limit value UL, etc. are recorded. In the storage area 224B, imaging images captured before and after the time of event occurrence are recorded together with additional information. The management area 224A and the storage area 224B store the same information as the management area 222A and the storage area 222B, respectively. The additional information recorded here is the same as the additional information stored in the storage area 224B of the permanent recording area 222.

[0052] When the control controller 110 detects an alert signal received by the event input terminal 130, it sequentially stores in the storage area 224B the imaging images captured by the imaging unit 120 during a recording period including the time before and after the moment when the alert signal is detected, in the same manner as the recording to the storage area 222B, at consecutive addresses. The recording period before and after the event will be described later.

[0053] With the above recording method, writing is performed cyclically for consecutive addresses in the recording areas (222B, 224B). As a result, the latest overwrite count value UC is recorded in the additional information of the frame where the most recent writing was performed, and an overwrite count value UC that is 1 less is recorded in the additional information of the next frame. The control controller 110 searches for a frame in which the overwrite count value UC switches for consecutive addresses in the recording areas (222B, 224B), and performs control to start the next writing from that frame. By doing so, recording can be performed while overwriting the oldest data at any time. Moreover, by simply searching for the frame in which the above overwrite count value UC switches and performing control to start the next writing from that frame, the oldest data can be overwritten at any time without the need for other complex controls. Also, since it is recorded how many times the imaging data was recorded by overwriting and this can be confirmed during playback, the overwrite count value UC (and other additional information) can be used to verify whether the data has been tampered with. In addition, the recording areas (222B, 224B) can be used evenly, preventing a bottleneck from occurring at a location where the number of overwrites is locally high and shortening the life of the memory card itself.

[0054] In the memory card 200 that adopts the above recording method, the formatting process of collectively erasing the data already recorded in the recording areas (222B, 224B) is performed using a dedicated browser, which is software operating on a computer for displaying and browsing the captured images recorded by the above method. The formatting process is performed by incrementing the format count master value MFC recorded in the management areas (222A, 224A) by 1. On the other hand, during the formatting process, no writing or erasing process is performed on the storage areas (222B, 224B). In the imaging device 100, for the frames in which a value smaller than the format count master value MFC recorded in the management areas (222A, 224A) is recorded as the format count value FC as additional information, the data is treated as having been erased. Specifically, when the control controller 110 of the imaging device 100 writes a new captured image to the area where the old captured image is stored, the control controller 110 compares the format count value FC recorded as additional information in the old captured image with the format count master value MFC recorded in the management areas (222A, 224A). Then, when the format count value FC is smaller than the format count master value MFC, the data (or data fragment) of the old captured image is written to that area on the assumption that it has been erased and can be overwritten. By such control, it is not necessary to perform control (such as applying a high voltage) for erasing data from the elements in the recording areas (222B, 224B) during formatting, and it is possible to contribute to extending the lifespan of the elements and speeding up the formatting process.

[0055] The imaging device 100 configured as described above is installed to photograph the machine tool 2 as shown in FIG. 1. The imaging device 100 is attached to a tripod via a pan-tilt head using a screw hole provided at the lower part of the housing 105. The angle of view of the lens unit 122 included in the imaging device 100 is adjusted so that the imaging image can be recorded with the imaging field including the range where the cause of the event can be traced. When adjusting the imaging range, the image signal output terminal 180 of the imaging device 100 is connected to the monitor 3, and the imaging image captured by the imaging device 100 is directly displayed on the screen of the monitor 3 (so-called through image display), and the adjustment is performed while checking the range shown on the screen.

[0056] A cable for transmitting an alert signal from the machine tool 2 is connected to the event input terminal 130 of the imaging device 100. With such a connection, the imaging device 100 can receive an alert signal which is information indicating the occurrence of an event.

[0057] Hereinafter, the specific operations when the imaging device 100 executes the monitoring function will be described. In the following description, the operations of each component are under the control of the control controller 110 even if not specifically specified.

[0058] FIGS. 6(a) and (b) are diagrams showing the relationship between the occurrence of an event and the recording of an imaging image. The imaging unit 120 of the imaging device 100 always captures a moving image regardless of the occurrence of an event. The control controller 110 controls to record the imaging images from the start of recording to the latest in the always recording area 222 of the memory card 200 inserted into the memory card slot 160.

[0059] As described above, when a failure occurs in the operation performed by the machine tool 2 while continuously capturing a moving image, the machine tool 2 detects this failure and outputs, as an alert signal, a waveform that periodically repeats high and low. Then, this alert signal is input to the stacked signal lamp 21 as a control signal for turning on / off the red lamp of the stacked signal lamp 21, and the red lamp blinks according to the alert signal. Further, the alert signal is branched and also input to the event input terminal 130 of the imaging device 100. When the alert signal that has been in the low state changes to high for the first time, the control controller 110 starts from a predetermined time before the time of the event occurrence (i.e., the time when it is detected that the alert signal first changes from low to high) to a predetermined time after the time of the event occurrence, and controls the imaging unit 120 to store the captured images captured during the recording period in the event recording area 224 of the memory card 200. At this time, for the captured image corresponding to the time of the event occurrence, a trigger flag indicating that the event has occurred at the imaging time of the captured image is recorded as additional information.

[0060] With the control as described above, an event such as a work failure occurs by sequentially going through the process of the event that causes the failure, the occurrence of the failure, the detection of the failure, and the transmission of information indicating the occurrence of the event (for example, the change of the alert signal). Therefore, it is necessary to check the image before the event occurrence in order to trace the cause of the failure. According to this embodiment, it is possible to check the image before the event occurrence.

[0061] The above-mentioned "predetermined time" may be, for example, one cycle of the operation cycle of the machine tool 2 (for example, 30 seconds). In this way, regardless of the occurrence timing of the event within one cycle of the operation cycle, it is possible to store the captured image including from the start to the end of the cycle in which the event occurred. Since it is possible to store without omission the captured image taken from the start to the end of the cycle including the time when the event occurred, it is possible to facilitate the identification of the cause of the work failure and the confirmation of subsequent processing. That is, by checking the image before the event in the cycle in which the event occurred, the cause of the failure can be grasped. Also, by checking the image after the event in the cycle in which the event occurred, it is possible to confirm whether the processing after the event has been appropriately performed.

[0062] While the control controller 110 is performing control to record the captured image during the recording period in the event recording area 224, in parallel with this, it also performs control to always record the captured image in the normal recording area 222. For the captured image recorded in the normal recording area 222, a trigger flag is recorded as additional information in the captured image corresponding to the time when the event occurred.

[0063] Also, after the end of the recording period, the control controller 110 does not react to a new change of the alert signal to high and does not treat it as the occurrence of an event during a predetermined non-response period (for example, 30 seconds) after the alert signal, which had been periodically repeating high and low, last changed to low. For example, as shown in FIG. 6(a), when the change of the alert signal continues even after the end of the recording period, the non-response period is the period from the end of the recording period until a predetermined period elapses after the alert signal last becomes low. Also, as shown in FIG. 6(b), when the change of the alert signal stops during the recording period, the non-response period starts at the time when the alert signal last becomes low and ends at the time when a predetermined period elapses after the start. The non-response period may be set to a period sufficient to confirm that the change of the alert signal has stopped. In the above example, for an event (for example, a work failure) to be grasped as one event, a plurality of rising edges of the alert signal are continuously generated, and the first rising edge indicates the moment when the event occurs. In such a case, by providing the above-described "non-response period", it is possible to prevent the same event from being recorded repeatedly. As described above, in the first embodiment, control is performed such that the next trigger is not detected unless a time during which no pulse is detected exceeds a predetermined time after the start or end of event recording. Such an operation is called a pulse cancellation trigger.

[0064] The captured images recorded by the imaging device 100 triggered by the occurrence of an event are reproduced by a dedicated browser, which is display and browsing software operating on a personal computer. This dedicated browser can read the imaging recording area 220 and displays various types of information (for example, a trigger flag indicating that an event has occurred, imaging time, etc.) recorded as additional information in association with the image being reproduced. Also, the dedicated browser has a function of searching for the file to be reproduced using these additional information as keys. Such a dedicated browser facilitates the investigation of the cause of an event and the confirmation of post-processing.

[0065] Also, the dedicated browser displays guidance regarding the lifespan of the memory card 200 based on the overwriting upper limit value recorded in the management areas (222A, 224A) and the overwriting count value recorded as additional information of the captured image. Specifically, when the overwriting count value reaches 80% of the overwriting upper limit value, a guidance indicating that the replacement time of the memory card 200 is approaching is displayed. When the memory card 200 uses an element that has a property of malfunctioning as the number of rewrites increases, such as a so-called NAND type flash memory, the above guidance can notify the time when replacement is necessary, and can prevent a situation where the captured image cannot be recorded or played back due to a malfunction of the memory card 200.

[0066] When the manufacturing line has just been constructed, for a period of about 3 to 4 months, for example, the machine tool frequently malfunctions, so it is necessary to monitor the machine tool and perform improvement activities to eliminate the cause of the malfunction. On the other hand, after the frequency of malfunctions decreases and the manufacturing line operates stably, it may no longer be necessary to perform monitoring. Conversely, in the case where the frequency of malfunctions increases in a manufacturing line that has been operating stably, it may also be necessary to perform post hoc monitoring on the existing equipment. For this reason, it is desirable that the imaging device 100 can be easily installed and removed. The imaging device 100 of the present embodiment described above can be easily installed and removed without providing a special configuration for outputting a trigger signal to the device side of the imaging target such as the machine tool 2.

[0067] In the above-described first embodiment, the recording period is set from a predetermined time before the time when the event occurs to a predetermined time after the time when the event occurs, and the non-response period is set as a predetermined period after the alert signal last changes to low. Although the captured images during the recording period are recorded in the event recording area 224, regarding the control at the time of event occurrence, various modifications are possible according to the device to be imaged, the information indicating the occurrence of the given event, the characteristics of the event to be noted, and the like. Hereinafter, as modification examples, the second embodiment to the sixth embodiment will be described. Note that the configuration of the imaging device according to the second embodiment to the sixth embodiment is the same as that of the imaging device 100 of the first embodiment for parts not described, so redundant descriptions are omitted, and the differences from the first embodiment will be mainly described below.

[0068] 〔Second Embodiment〕 The second embodiment is an operation called a so-called single trigger. In the single trigger, after detecting the trigger, control is performed so as not to detect the next trigger for a predetermined time. As shown in FIG. 7, as information indicating the occurrence of an event, a device to be imaged outputs a pulse of an alert signal at the timing of the event occurrence. This alert signal is input to the event input terminal 130 of the imaging device 100. Triggered by the alert signal that has been in the low state and changed to high, the control controller 110 controls to store in the event recording area 224 of the memory card 200 the captured images captured by the imaging unit 120 during the recording period from a predetermined time before the time when the event occurs (that is, the time when it is detected that the alert signal changes from low to high) to a predetermined time after the time when the event occurs.

[0069] When the device to be imaged outputs a plurality of pulses for one event, the control controller 110 does not respond to the change to high even if a new alert signal changes to high during a predetermined non-response period (for example, 30 seconds) from the time when the event occurs, and controls not to treat it as the occurrence of an event. By providing such a "non-response period" in this way, it is possible to prevent duplicate recording of the same event.

[0070] When the device to be imaged does not output a plurality of pulses for one event, it is not necessary to provide an inactivity period. Imaging data for the recording period corresponding to each event may be stored in the recording area on the assumption that an event has occurred for the number of pulses of the alert signal.

[0071] 〔Third Embodiment〕 The third embodiment is an operation called a so-called multi-trigger. In the multi-trigger, when the next trigger is detected during event recording, control is performed to extend the event recording time. As shown in FIGS. 8(a) and 8(b), as information indicating the occurrence of an event, a single pulse of an alert signal is output by a device or the like to be imaged at the timing of the occurrence of the event. This alert signal is input to the event input terminal 130 of the imaging device 100. When the alert signal that has been in the low state changes to high, the control controller 110 starts from a predetermined time before the time of the event occurrence (that is, the time when it is detected that the alert signal has changed from low to high) until a predetermined time after the time of the event occurrence. Control is performed to store the captured image captured by the imaging unit 120 during the recording period in the event recording area 224 of the memory card 200.

[0072] The above control is the same as that of the second embodiment. However, as shown in FIG. 8(b), when a single pulse of the alert signal is further input to the event input terminal 130 during the recording period, the control controller 110 sets the end of the recording period to a predetermined time after the time when the new event occurs. Extend as follows.

[0073] Multiple events occurring in a short period can be grouped into one event record, suppressing the occurrence of multiple overlapping event records during the recording period and saving memory capacity. Also, when the device being imaged continues to generate pulses of an alert signal while an abnormality persists and stops generating pulses when the abnormality is resolved, a series of captured images from the occurrence of the abnormality until its resolution can be recorded as one event. As a specific example, when imaging is performed to check whether a series of response procedures from when a signal lamp starts flashing along with the occurrence of an abnormality until an administrator performs an operation to stop the flashing of the signal lamp are appropriate, a drive signal for flashing the signal lamp is detected as a signal indicating the occurrence of an event, and while the drive signal repeats on and off, by extending the recording period, a series of captured images can be recorded as one event.

[0074] 〔Fourth Embodiment〕 FIG. 9 shows the operation when event recording is performed with a normal recording period based on the timing of recognizing the next trigger immediately after the end of the recording period associated with the pulse P1 of the first alert signal. As shown in this example, the shorter the time from the end of the previous recording period to recognizing the next trigger, the longer the overlapping period of the two event records, and the recording becomes redundant. In contrast, in the fourth embodiment, when the next trigger is recognized immediately after the end of the recording period, control is performed to shift the timing of event occurrence. FIG. 10 shows the operation. As information indicating the occurrence of an event, a single pulse P1 of an alert signal is output by a device or the like being imaged at the timing of event occurrence. This alert signal is input to the event input terminal 130 of the imaging device 100. Triggered by the alert signal, which had been in a low state, changing to high, the control controller 110 controls the imaging unit 120 to store in the event recording area 224 of the memory card 200 the captured images captured during the recording period from a predetermined time before the time of event occurrence (i.e., the time when it was detected that the alert signal changed from low to high) to a predetermined time after the time of event occurrence. The above control is the same as in the second embodiment.

[0075] Then, a predetermined time immediately after the recording period associated with the pulse P1 is set as the monitoring period. When a single pulse P2 of an alert signal is input to the event input terminal as information indicating the occurrence of a new event within the monitoring period, the control controller 110 treats the end of the monitoring period as the occurrence time of the new event instead of the time when the pulse P2 is actually detected, and stores the imaging data of the recording period corresponding to the new event in the recording area. That is, the trigger flag TF is attached as additional information to the frame recorded at the end of the monitoring period, and the recording period associated with the pulse P2 is from a predetermined time before the end of the monitoring period to a predetermined time after.

[0076] The monitoring period is preferably shorter than the time before the event occurrence time in the recording period. By doing so, the recording period based on the end of the monitoring period will overlap with the previous recording period, making it easier to understand the events imaged in the two recording periods. Although the individual event records recorded with the occurrence of events are basically not continuous in time, the slight overlap with the previous recording period makes it easier to understand the events occurring when viewing each file with a dedicated browser or the like. On the contrary, if there is little overlap between the files, it is difficult to understand when viewing the video. On the other hand, it is advisable to reduce the overlapping period to a level where understanding is not difficult and increase the recording time as an event. The overlap between the previous and subsequent recording periods should be such that the continuity of the video can be recognized, for example, about 2 seconds.

[0077] When such recording is performed, it is preferable that a dedicated browser or the like has a function of continuously playing back a plurality of such recordings in time series. The dedicated browser may refer to the imaging time CT recorded as additional information for each frame in the recording area 224B of the memory card and continuously play back a plurality of recordings in time series. Further, when such recording is performed, it is preferable that a dedicated browser or the like has a function of displaying the relationship between a plurality of such recordings. In order to display the relationship between such a plurality of recordings on the dedicated browser, the imaging device 100 may record additional information indicating the relevance of the event for the frames recorded during the recording period of the relevant event. The additional information indicating the relevance of the event may be a common symbol, such as "A", "B", etc., between related events. Also, in the dedicated browser, for example, symbols indicating the relationship, such as "A-1" and "A-2", may be attached to the thumbnails of each recording and displayed, or each related recording may be arranged and displayed in a predetermined direction, such as horizontally, and unrelated recordings may be displayed in another column. Further, the relationship may be displayed by surrounding the arranged thumbnails with a predetermined frame, such as coloring. By displaying in this way, it is possible to make it easier to understand the events imaged in two recording periods as one event.

[0078] As described above, in this embodiment, after event recording, for the trigger that entered immediately afterwards, the part serving as the trigger is shifted for a short time. For example, if it is assumed that 10 seconds before and 10 seconds after the trigger recognition are recorded, after the 10 seconds after the trigger recognition end, for 5 seconds, although the trigger is recognized, the recording is left as the next event recording for 10 seconds before and 10 seconds after 5 seconds have elapsed after the 10 seconds after the trigger in the previous recording period end.

[0079] 〔Fifth Embodiment〕 The fifth embodiment is similar to the fourth embodiment. However, when the next trigger is recognized immediately after the end of the recording period, the timing of event occurrence is set as the timing when the trigger is actually recognized, and control is performed to make the recording periods before and after the event different from those at the time of normal trigger recognition. Specifically, as shown in FIG. 11, without changing the trigger at the occurrence time of the event, control is performed to shorten the recording period before the event and extend the recording period after the event.

[0080] Similar to the fourth embodiment, a predetermined time immediately after the recording period associated with pulse P1 is set as the monitoring period. When a single pulse P2 of an alert signal is input to the event input terminal as information indicating the occurrence of a new event within the monitoring period, the control controller 110 records the trigger flag TF in the frame recorded at that timing. Also, the recording period associated with this pulse P2 is shortened for the recording period before the trigger recognition time so that the overlapping period with the recording period associated with pulse P1 becomes a predetermined time (for example, 2 seconds). Also, the recording period after the trigger recognition time is extended by a time corresponding to the shortened time. The trigger flag TF is attached as additional information to the frame recorded at the end of the monitoring period, and the recording period associated with pulse P2 is from a predetermined time before to a predetermined time after the end of the monitoring period. The overlap of the recording periods before and after may be set to a degree that allows the continuity of the video to be recognized, for example, about 2 seconds. Note that the recording period after trigger recognition may not be extended.

[0081] Also, when performing the above-described recording, it is preferable to provide a function to continuously reproduce a plurality of recordings in time in a dedicated browser or the like by the same method as described in the fourth embodiment. Also, it is preferable to provide a function to display the relationship between a plurality of recordings in a dedicated browser or the like.

[0082] Regarding the control at the time of event occurrence in the first to fifth embodiments described above, it may be selectively executed by one imaging device 100 according to settings. For example, in a dedicated browser or the like, settings regarding the control at the time of event occurrence may be recorded in the management area 222A of the memory card 200, and the imaging device may perform control of event occurrence corresponding to the settings.

[0083] 〔Sixth Embodiment〕 The imaging device 100 according to the sixth embodiment identifies the type of event and performs different controls according to the type of event. Devices or the like to be imaged output, as information indicating the occurrence of the event, alert signals of different patterns according to the type of event at the timing when the event occurs. The imaging device 100 stores in advance in the storage unit 140 the pattern of the alert signal, and stores in the storage unit 140, in association with the pattern, event setting information defining the control at the time of event occurrence. The operation at the time of event occurrence is preferably the control in the above-described first to fifth embodiments or a combination thereof, and the lengths, start times, end times, etc. of the recording period, non-response period, and monitoring period in each embodiment may be set arbitrarily.

[0084] In the imaging device 100 in which the operation at the time of event occurrence is defined in this way, when an alert signal of a pattern at the event input terminal 130 is input, the control controller 110 queries the storage unit 140 for the pattern of the input alert signal, and according to the event setting information corresponding to the pattern, performs control to record the captured images during the recording period including the time before and after the event occurrence in the event recording area 224 of the memory card 200.

[0085] The control of event recording performed by the imaging device 100 when an event occurs may vary depending on the characteristics of the event, the content to be noted, the form of information indicating the occurrence of the event emitted by the device, etc. In this embodiment, event recording can be performed by control defined in advance according to the type of event.

[0086] The imaging device 100 may record information indicating the type of event together with the captured images during the recording period. The information indicating the type of event may be recorded, for example, as additional information for the captured images corresponding to the time of event occurrence. Even when different controls are not performed according to the type of event as in the first to fifth embodiments, it is advisable to identify the occurred event and record the information indicating the type of event together with the captured images.

[0087] According to the imaging device 100 described above, it is possible to eliminate the need to manually input information indicating the type of event. Therefore, in a case where an image stored by a device arranged at a remote factory at the time of event occurrence is sent collectively to a management department or the like and the content of the image is confirmed by the management department, on the side transmitting the file obtained by shooting with the imaging device 100, a file in which information indicating the type of event is automatically recorded can be sent as it is. Also, on the side confirming the sent image, the information indicating the type of event is surely recorded and the file can be handled. Therefore, the labor can be reduced on both the transmitting side and the receiving side.

[0088] When the corresponding pattern is not stored in the storage unit 140, it is advisable to perform predetermined control (for example, the control of the first embodiment) in advance.

[0089] When the above recording is performed, in a dedicated browser or the like for displaying and browsing the captured images, it is advisable to display the information indicating the type of event corresponding to the displayed captured image. By displaying in this way, it is possible to make it easier to understand the events shown in the video. 〔Modification of Embodiment〕

[0090] The present invention is not limited to the above-described embodiments, and combinations, modifications, improvements, etc. are included in the present invention. For example, the lengths of the recording period, non-response period, and monitoring period described in the above embodiments are arbitrary and may be freely set by the user.

[0091] In each of the above-described embodiments, the imaging target may be any device that performs control to notify a human of the occurrence of an event such as some abnormality. However, particularly when the machine tool is the imaging target by the imaging device 100, the most excellent effect is exhibited. For example, in a factory, a logistics warehouse, an automated warehouse, etc., at the site, a machine that performs some automatic processing such as a machine tool or an automatic conveyor may be used as the imaging target. In particular, when constructing and starting up the mechanism of such automatic processing, various problems occur in the imaging device described in each embodiment, and improvement activities are carried out to solve them. It is suitable as a system for recording images for investigating the cause until the occurring problems are solved.

[0092] In addition, devices that are expected to be used by general users even if they are not automated, such as automated teller machines (so-called ATMs) and self-checkout counters, may be used as the imaging target. Errors when the user makes a mistake in the usage method or alarms when there is unauthorized use can be used as information indicating the occurrence of an event, and it is suitable for use in checking the usage status at the time of an error, recording the situation where unauthorized use has occurred, etc. However, it exhibits an excellent effect on devices such as self-checkout counters that cooperate multiple cash registers and a management system to have different specifications according to customers or locations such as for each store, rather than those mass-produced and operating individually like automated teller machines (so-called ATMs).

[0093] Particularly, when some abnormality occurs, it exhibits an excellent effect in a system having a function of notifying a human such as a device manager or a monitor of the occurrence of the abnormality by a lamp, an alarm sound, etc. In the first embodiment, by branching and using the connection line to the device for notifying a human of the abnormality of the device by a branch wiring such as an electro tap, an image including the time of the abnormality of the device can be recorded without adding a function of outputting any new event signal to the device. The imaging device 100 may use an optical signal or the like used for the function of the device to notify a human of the occurrence of an abnormality, or information that can be recognized by a human through vision, hearing, etc. to recognize the occurrence of an event. However, it is particularly preferable to determine the occurrence of an event from the signal line to the device for the device to notify a human.

[0094] In each of the above embodiments, any information may be configured to be received as information indicating the occurrence of an event. However, it is particularly preferable to configure to branch the signal to the stacked signal lamp 21 connected to the machine tool 2 and receive it as information indicating the occurrence of an event. Note that other information may be used as information indicating the occurrence of an event. For example, when the imaging target device has a function of outputting an external output signal for notifying the outside of the occurrence of an event such as an abnormality, it is preferable to use this external output signal as information indicating the occurrence of an event. When using the branched signal or the external output signal as information indicating the occurrence of an event, since the signal is received by physically connected wiring or the like, the imaging device 100 can surely detect the information indicating the occurrence of an event. It is particularly preferable when the imaging device 100 is provided permanently and the labor for installation and removal is not much.

[0095] When using the branched signal or the external output signal as information indicating the occurrence of an event, as the signal, in addition to the continuous pulse as in the first embodiment or the single pulse as in the second embodiment or the like, a status signal indicating the ON and OFF states (for example, a binary value of high and low), a pulse train repeated in a predetermined pattern, an analog signal such as an audio signal, or the like may be used.

[0096] When performing control to provide a non-response period as in the second embodiment and detecting a pulse train repeated in a predetermined pattern as an alert signal indicating the occurrence of an event, the non-response period is preferably set longer than the longest low time in the pattern of the pulse train. By doing so, it is possible to prevent recognizing the occurrence of a new event while the alert signal continues.

[0097] When receiving a pulse train that repeats in a predetermined pattern as an alert signal indicating the occurrence of an event, the predetermined pattern may be stored in advance, and when a pulse train of a pattern that matches the stored pattern is input, it may be detected as the occurrence of an event. In this case, the pattern to be stored in advance may be manually input by the user, but it is particularly preferable to provide a learning mode in which the pattern of the alert signal actually input to the event input terminal 130 is learned and stored. By providing such a learning mode, the pattern registration work for the imaging device 100 becomes easy, and the installation of the imaging device 100 becomes easy.

[0098] The imaging device 100 may be installed so that a plurality of devices enter the imaging field of view by the imaging unit 120, and the logical sum of alert signals from the plurality of devices may be input to the event input terminal 130. In this way, it becomes possible to image the states of a plurality of devices when an event occurs with a single imaging device 100.

[0099] Further, a light receiving element for detecting the light emission of a signal lamp may be provided in the imaging device 100, and the light emission of the signal lamp may be detected as information indicating the occurrence of an event. The imaging device 100 may be installed so that the signal lamp enters the imaging field of view by the imaging unit 120, and the imaging unit 120 may detect the light emission of the signal lamp as information indicating the occurrence of an event. In this case, it is preferable that the control controller 110 analyzes the captured image at any time to detect the light emission of the signal lamp. In this way, in a configuration in which visual information is detected as information indicating the occurrence of an event, troublesome operations such as branching signals when installing the imaging device are unnecessary, the installation is easy, and the removal is also easy. And when detecting the information indicating the occurrence of an event from the captured image, since no special configuration such as a sensor is required on the imaging device side, the installation is easy. Therefore, it is particularly preferable when the imaging device 100 is installed temporarily, such as during the period until the troubles in a newly launched production line or the like are resolved.

[0100] Also, when imaging a device that emits an alarm sound such as a siren or buzzer sound during an abnormality occurrence, a microphone for detecting the alarm sound may be provided in the imaging device 100, and the alarm sound of the rotating lamp may be detected as information indicating the occurrence of an event. In this way, in a configuration where voice information is detected as information indicating the occurrence of an event, troublesome operations such as branching signals when installing the imaging device are unnecessary, the installation is easy, and the removal is also easy. Therefore, it is particularly preferable when temporarily installing the imaging device 100, such as during the period until troubles in a newly launched production line or the like are resolved.

[0101] Also, as in the sixth embodiment, in a configuration where different controls are performed according to the type of event that has occurred, the method for identifying an event is not limited to the method described in the sixth embodiment. For example, when the imaging target device has a function of outputting information indicating the type of event, such as an error code indicating the type of abnormality, the imaging device 100 may be configured to include an event identification information input terminal for inputting information indicating the type of event. Then, the event that has occurred may be identified based on the information input to the event identification information input terminal.

[0102] As another example, when the imaging target device outputs a plurality of types of external output signals by the imaging device 100, the imaging device may identify the type of event according to the received external signal. Specifically, the type of event may be identified according to the signal for controlling each color (red, yellow, blue) of the stacked signal lamp. In this way, for example, when a signal for lighting the red signal lamp is generated, the recording period may be set so that the period before lighting is relatively long as if a serious abnormality has occurred, and when a signal for lighting the yellow signal lamp is generated, the recording period may be set so that the period after lighting is relatively long as if an abnormality may subsequently occur.

[0103] In a configuration where visual information such as the lighting of a signal lamp is detected as information indicating the occurrence of an event, the type of event may be identified by the color, position, temporal light emission pattern, etc.

[0104] In the sixth embodiment, the information indicating the type of event may be recorded in any manner, but it is particularly preferable to record the information indicating the type of event as additional information of the captured image. Note that the method of recording the information indicating the type of event is not limited to this. For example, it is preferable to use the information indicating the type of event as part of the file name. By including the information indicating the type of event in the file name, it is possible to easily grasp the content of the captured image stored in the file without loading the file into a dedicated browser. Also, an error code is embedded in the header of the frame at the time when an event occurs in the moving image to be recorded. By searching for the frame in which the error code is embedded during playback, it is possible to quickly check the image at the moment when the event occurred. For example, the information indicating the type of event may be embedded as a watermark in the image. In this way, the information indicating the type of event can be embedded without increasing the file size and without having a visible impact on the image. Also, it is possible to make it difficult to falsify the information indicating the type of event. As another example, the information indicating the type of event may be embedded as characters superimposed on the image.

[0105] In each of the above embodiments, the imaging unit 120 captures a moving image as an image, but for example, it may be configured to capture a still image. Also, the image may be, for example, a 2D image or a 3D image. Also, it may be a black-and-white image or a color image. The lens unit included in the imaging unit 120 may be a short-focus lens instead of a zoom lens.

[0106] In each of the above-described embodiments, any storage medium may be used, but it is particularly preferable to use the memory card 200 inserted into the memory card slot 160. Further, instead of the memory card, other storage devices such as a hard disk drive may be used. Further, the storage medium is not limited to a detachable one, and may be built in a non-detachable form within the housing 105. Further, the captured image may be stored in a storage area provided on a communication network as the storage medium. However, the most preferable configuration is to store the captured image in a storage medium such as the memory card 200 detachably provided in the imaging device 100 described above. In particular, when a manufacturing line is newly constructed in a factory, during a temporary period such as when monitoring troubles for about 3 to 4 months, it can be easily attached and recorded by the imaging device without constructing a large-scale system. Further, when checking the recorded captured image, the memory card or the like can be removed from the imaging device and reproduced by a personal computer or the like, so that the trouble of reinstalling each time can be saved. Further, not only in the case of a temporary installation, but also when the occurrence of an event is not so frequent, the situation at the time of abnormality of the machine tool can be easily photographed without constructing a large-scale system.

[0107] In the above embodiment, the recording destination for temporarily recording the captured image is arbitrary. For example, the captured image may be temporarily recorded in a storage element such as the SDRAM built in the imaging device 100, and when an event occurs, the captured image temporarily recorded in the storage element may be finally recorded in the event recording area 224 of the memory card 200. However, as in the above embodiment, it is particularly preferable to record the captured image constantly captured by the imaging unit 120 in the constant recording area 222 of the memory card 200, and to record the captured image captured at the time of an event in the event recording area 224 of the memory card 200.

[0108] In addition, the captured images after a predetermined time has elapsed since the shooting may be constantly stored in the recording area 222 while reducing the storage size by, for example, a low frame rate (e.g., 1 frame per second), low resolution, monochrome conversion, etc. at any time. By doing so, it is possible to save the storage capacity per unit time required for the constant recording when no event has occurred.

[0109] In the above embodiment, it is optional whether to perform constant recording or not. However, it is particularly preferable to record the captured images during the recording period accompanying the occurrence of an event in the event recording area and record the constantly captured images in the constant recording area. In addition, the captured images to be recorded when an event occurs may be images with a larger amount of information, such as increasing the frame rate, reducing (or not compressing) the compression rate of the image file, increasing the image quality of the image file (e.g., HD (High Definition) image), or making it a color image, compared to the captured images to be constantly recorded. Conversely, the captured images to be constantly recorded may have a reduced amount of information, such as decreasing the frame rate, increasing the compression rate of the image file, lowering the image quality of the image file (e.g., VGA image), or making it a black-and-white image, compared to the captured images to be recorded when an event occurs.

[0110] In the first embodiment described above, an example of using a dedicated browser executed on a personal computer separate from the imaging device 100 as the display and viewing means has been described. However, the imaging device 100 may integrally include playback means for playing back and displaying the captured images inside the housing 105.

[0111] In the above-described first embodiment, the fixing method of the imaging device 100 may be anything, but it is particularly good if it is a simple method. In particular, it is good to fix it with fixing means that are easy to attach / detach, such as clips, clamps, magic tapes, adhesive mats, etc. When temporarily installing the imaging device 100, such as during the period until troubles on a newly established production line converge, it is particularly preferable to fix it with fixing means that are easy to attach / detach like these. Also, the attachment destination by the fixing means is preferably an existing structure such as a protective frame or a pillar provided around the device that is the imaging target. In this way, the imaging element can be easily temporarily installed and can also be easily removed.

[0112] In the above-described first embodiment, an example of recording a format count master value indicating the number of times the memory card has been formatted in the management area of the memory card has been described. However, for a memory card that can identify an individual by unique identification information or the like, the format count master value may be recorded in a personal computer that executes a program of a dedicated browser for formatting the memory card, and each time the memory card is formatted, the format count master value stored in the personal computer may be incremented by 1.

[0113] In the above-described first embodiment, the method of updating the overwrite count master value recorded in the management area of the memory card is arbitrary, but it is particularly good if it is updated by the dedicated browser. Note that the overwrite count master value may be updated by the imaging device 100. In this way, even without using the dedicated browser, the latest overwrite count master value can be recorded in the management area.

[0114] In the first embodiment described above, the method of notifying the guidance regarding the life of the memory card is arbitrary. However, it is particularly preferable to display the guidance regarding the life of the memory card on a dedicated browser by using the overwrite count value and the overwrite upper limit value recorded on the memory card. Further, such guidance regarding the life may also be notified by the imaging device. For example, when the imaging device includes a liquid crystal screen, it is preferable to display the guidance regarding the life on the liquid crystal screen. Further, when the imaging device includes a monitor lamp indicating the operating state, it is preferable to notify the guidance regarding the life by lighting or flashing the monitor lamp. Further, when the imaging device includes a sound source such as a buzzer, it is preferable to emit a sound from the sound source to notify the information regarding the life.

[0115] The timing for notifying the guidance regarding the life in the imaging device may be any timing. For example, it may be at the time of power-on, or it may be constantly monitored and notified. However, when the frequency of overwriting is not high, it is particularly preferable to periodically (for example, once a week) compare the overwrite count value with the overwrite upper limit value and notify when the conditions are satisfied. Further, when it is recognized that the conditions for notifying the guidance regarding the life in the imaging device are satisfied, the fact that the conditions for notifying the guidance regarding the life are satisfied is treated as the occurrence of an event, and it is preferable to record the captured image in the event recording area, and it is preferable to record together the information indicating the type of event indicating that the conditions for notifying the guidance regarding the life are satisfied. In this way, among the recorded captured images caused by the events occurring in the device to be imaged, the captured images caused by the fact that the conditions for notifying the guidance regarding the life are satisfied will be mixed in, making it easier for the administrator or the like to notice that the life is approaching.

[0116] Also, in the above first embodiment, the condition for the overwrite count value to provide guidance regarding the lifespan can be any condition, but it is particularly good to display guidance regarding the lifespan when the overwrite count value reaches 80% of the overwrite upper limit value. Further, for example, an index indicating the degree of wear can be calculated using the overwrite count value and the format count value, and guidance regarding the lifespan can be provided according to the comparison result with the overwrite upper limit value. This is, for example, when stress is applied to the memory area of the memory card by performing formatting, and deterioration is accelerated compared to normal overwriting, it is advisable to calculate an index indicating the degree of wear with weighting so that the format count value is weighted more than the overwrite count value.

[0117] Also, in the above first embodiment, the method for specifying the overwrite upper limit value indicating the guideline for the lifespan of the memory card is arbitrary, but it is particularly good to have the user specify the overwrite upper limit value of the memory card to be used and store it in the management areas (222A, 224A). When the recording medium holds information regarding the lifespan in advance and is used, guidance regarding the lifespan may be provided using this information.

[0118] The recording method for the memory card described in relation to the above first embodiment can also be applied to a drive recorder for a vehicle. In this case, it is advisable to constantly record the video in front of the vehicle and perform event recording triggered by impacts, accelerations, etc. corresponding to when an accident occurs.

Explanation of Reference Numerals

[0119] 1 Imaging system 2 Machine tool 3 Monitor 100 Imaging device 105 Housing 110 Control controller 120 Imaging unit 130 Event input terminal 160 Memory card slot 200 Memory card

Claims

1. An imaging device that records captured images on a memory card, Equipped with a sound source, The sound source is configured to emit a sound to notify information regarding the life of the memory card. An imaging device comprising:

2. Equipped with a monitor lamp, The device is configured to notify the user of the remaining life of the memory card by turning on or blinking a monitor lamp.

2. The imaging device according to claim 1,

3. The notification regarding the life of the memory card is provided by using an overwrite count value and an overwrite upper limit value recorded in the memory card.

3. The imaging device according to claim 1, wherein:

4. The notification regarding the lifespan of the memory card is provided with a function of periodically comparing the overwrite count value recorded in the memory card with the overwrite upper limit value, and notifying when a certain condition is met.

4. The imaging device according to claim 1, wherein

5. The function of treating the fulfillment of the conditions for notifying the memory card of its lifespan as an event occurrence and recording the captured image in the event recording area is provided.

5. The imaging device according to claim 1, wherein

6. The information indicating the type of event that indicates that a condition for notifying the user of the information regarding the life of the memory card has been met is recorded together with the captured image.

6. The imaging device according to claim 1,

7. 7. The imaging device according to claim 1, further comprising a function for issuing a notification regarding the life of the memory card when a predetermined percentage of an overwrite upper limit of the memory card has been reached.

8. A program for causing a computer to realize the functions of the imaging device according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Memory card

    JP1994223240A

  • Information processing apparatus and data storage medium

    JP2003244604A

  • Memory life warning device and information processing method

    JP2006023815A

  • Semiconductor memory device and host device

    JP2009301680A

  • Memory card reader / writer, method of managing life of memory card, and program thereof

    JP2010218138A