Data synchronization system

Abstract

To provide a data synchronization system capable of correcting and synchronizing a time deviation between a sound source and video information even in a wide space.SOLUTION: A data synchronization system 10 for synchronizing sound data of sound outputted from equipment 11 with a photographic data obtained by photographing the equipment 11 in a work area A1 with the equipment 11 established includes a plurality of microphones 12A, 12B installed at different positions within the work area A1 to collect sound outputted from the equipment 11 and transmit sound data, a camera 13 installed within the work area A1 to photograph the equipment 11 and transmit photographic data, and a data aggregation computer 14 for correcting a time deviation between each sound data from the plurality of microphones 12A, 12B and the photographic data from the camera 13 to synchronize them.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a data synchronization system. [Background technology]

[0002] Patent Document 1 discloses a sound source location display device that includes a sound source location device that processes sound field information collected by multiple microphones when a sound is generated to calculate the three-dimensional position of the sound source, and an image processing device that displays the sound source position and attribute information of the sound source by superimposing it on a landscape image taken by a camera installed in a position close to the microphone. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-77277 Summary of the Invention [Problem to be solved by the invention]

[0004] In factories and other places, the work area often ranges from a few square meters to several tens of square meters. For this reason, if all microphones and cameras are installed in the same place in a large work area, it becomes difficult to collect sounds from sound sources located far from their installation positions, making it difficult to fully utilize the function of visualizing the sound source positions.

[0005] The present invention has been made in consideration of the above circumstances, and aims to provide a data synchronization system that can correct the time difference between audio and video information and synchronize them even in a large space. [Means for solving the problem]

[0006] In order to achieve the above object, the data synchronization system of the present invention comprises: A data synchronization system that synchronizes audio data of sounds emitted from equipment in a work area where the equipment is installed with photographed data of the equipment, a plurality of sound collection devices installed at different positions within the work area, collecting sounds emitted from the equipment and transmitting audio data; an imaging device that is installed in the work area and captures images of the facility and transmits the captured image data; a data aggregation unit that corrects time differences between the audio data from the plurality of sound collection devices and the image capture data from the image capture device to synchronize them; It has.

[0007] According to the data synchronization system having this configuration, it is possible to correct and synchronize the time differences between the audio data and the photographed data that arise due to differences in the positions of the sound collection devices and differences in the propagation speeds of light and sound. [Effects of the Invention]

[0008] According to the present invention, it is possible to provide a data synchronization system that can correct the time difference between audio and video information and synchronize them even in a large space. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic diagram of a work area to which a data synchronization system according to this embodiment is applied. [Figure 2] FIG. 2 is a flowchart illustrating a data processing procedure performed by the data synchronization system. [Figure 3] FIG. 3 is a schematic configuration diagram of a work area for explaining the first application example of the data synchronization system. [Figure 4] FIG. 4 is a schematic plan view of a work area for explaining an application example 2 of the data synchronization system. [Figure 5] FIG. 5 is a schematic side view of a work area illustrating a second application example of the data synchronization system. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a schematic diagram of a work area to which a data synchronization system according to this embodiment is applied.

[0011] 1, a data synchronization system 10 according to this embodiment is applied to a work area A1 in which various types of equipment 11 are installed. The data synchronization system 10 is installed with the work area A1 as its monitoring area.

[0012] The work area A1 has a large space, for example, ranging from several square meters to several tens of square meters. Equipment 11 is installed in the work area A1 and performs various operations, such as machine tools and assembly machines. For example, when an abnormality occurs in this equipment 11, an alarm sound is emitted and a warning lamp is turned on.

[0013] The data synchronization system 10 includes a plurality of (two in this example) microphones (sound collection devices) 12A and 12B and a camera (imaging device) 13. The data synchronization system 10 also includes a data collection computer (data collection unit) 14, to which the audio data transmitted from the microphones 12A and 12B and the photographic data transmitted from the camera 13 are sent.

[0014] Microphone 12A and microphone 12B are placed in work area A1 at different lateral positions on equipment 11, and at different distances from equipment 11. Specifically, microphone 12A and microphone 12B are placed on opposite sides of equipment 11, and microphone 12B is placed at a position farther from equipment 11 than microphone 12A.

[0015] The camera 13 is installed above the work area A1 and captures an image of the entire work area A1 including the equipment 11 from above.

[0016] The data aggregation computer 14 aggregates the audio data and the photographic data transmitted from the microphones 12A and 12B and the camera 13. Then, the data aggregation computer 14 corrects and synchronizes the audio data from the microphones 12A and 12B and the audio data and the photographic data from the camera 13 with respect to the recording start time.

[0017] Next, the data processing procedure performed by the data synchronization system 10 will be described with reference to the flowchart shown in FIG.

[0018] When an event such as an abnormality occurs in equipment 11 in work area A1, which is the monitored area (step S01), an alarm sound is emitted in equipment 11 to notify of the abnormality (step S02A) and a warning lamp is turned on (step S02B).

[0019] The warning sound emitted from the equipment 11 is collected by a plurality of microphones 12A and 12B (step S03A), and the resulting audio data is transmitted to the data collecting computer 14 (step S04A).

[0020] Furthermore, the equipment 11 with the lit lamp is photographed by the camera 13 (step S03B), and the photographed data is transmitted to the data collection computer 14 (step S04B).

[0021] The data collection computer 14 receives the audio data transmitted from the microphones 12A and 12B and the photographed data transmitted from the camera 13, and links the audio data and the photographed data as information of the same event (step S05).

[0022] Here, since microphones 12A and 12B are at different distances from facility 11, there is a difference in the recording start time of the audio data transmitted from each microphone 12A and 12B. Furthermore, due to the difference in the propagation speed of light and sound, there is also a difference in the recording start time between each audio data and the captured data.

[0023] The data collection computer 14 performs correction and synchronization processes for the audio data and the image data that have discrepancies in their recording start times (step S07). First, the data collection computer 14 calculates the sound source position from the discrepancy in the recording start times of the microphones 12A and 12B. Next, based on the calculated sound source position, the discrepancy in the recording start times of the audio data from the microphones 12A and 12B and the discrepancy in the recording start times of the audio data and the image data are corrected and synchronized.

[0024] In this way, according to the data synchronization system 10, the difference in the recording start time of each audio data and shooting data caused by the difference in the position of each microphone 12A, 12B and the difference in the propagation speed of light and sound can be corrected and synchronized.

[0025] Next, an example of applying the data synchronization system to another work area will be described. (Application example 1) FIG. 3 is a schematic configuration diagram of a work area for explaining the first application example of the data synchronization system. 3, in Application Example 1, the data synchronization system 20 is applied to a work area A2 equipped with a plurality of (two in this example) gates (facilities) 21A and 21B. The data synchronization system 20 is installed in the work area A2 as a monitoring area.

[0026] Work area A2 has a large space, for example, ranging from several square meters to several tens of square meters. Gates 21A and 21B are facilities provided in work area A2, and worker M can enter and exit work area A2 through gates 21A and 21B. When worker M passes through gates 21A and 21B and enters work area A2, a notification sound is emitted and lamps 21La and 21Lb are turned on to notify the worker.

[0027] The work area A2 is equipped with an overhead crane 25. The overhead crane 25 is equipped with a pair of rails 26 and a girder 27 that travels along these rails 26. The overhead crane 25 transports a load W suspended from the girder 27 by a wire 28 within the work area A2.

[0028] The data synchronization system 20 includes a plurality of (four in this example) microphones (sound collection devices) 22A, 22B, 22C, and 22D, and a camera (imaging device) 23. The data synchronization system 20 also includes a data collection computer (data collection unit) 24, to which the audio data transmitted from the microphones 22A, 22B, 22C, and 22D and the photographic data transmitted from the camera 23 are sent.

[0029] Microphones 22A, 22B, 22C, and 22D are arranged at the four corners of work area A2. Camera 23 is installed on girder 27 of overhead crane 25 provided in work area A2, and captures the entire work area A2 from above.

[0030] The data collection computer 24 collects the audio data and the photographic data transmitted from the microphones 22A, 22B, 22C, and 22D and the camera 23. Then, the data collection computer 24 corrects and synchronizes the differences in the recording start times of the audio data from the microphones 22A, 22B, 22C, and 22D and the differences in the recording start times of the audio data and the photographic data.

[0031] The work area A2 is an area where access is restricted to prevent workers M and others from entering under the cargo W suspended by the overhead crane 25, and the data synchronization system 20 is installed in the work area A2 as a monitoring area.

[0032] In a work area A2 equipped with a data synchronization system 20, for example, when worker M passes through gate 21A, a notification sound is emitted at gate 21A to notify worker M of his entry into work area A2, and lamp 21La at gate 21A is turned on.

[0033] The notification sound emitted from gate 21A is collected by multiple microphones 22A, 22B, 22C, and 22D and transmitted as audio data to data collection computer 24. Furthermore, gate 21A, where lamp 21La is lit, is photographed by camera 23, and the photographed data is transmitted to data collection computer 24.

[0034] The data aggregation computer 24 receives the audio data transmitted from the microphones 22A, 22B, 22C, and 22D and the photographic data transmitted from the camera 23, and links the audio data and the photographic data as information on the same event.

[0035] Furthermore, the data collection computer 24 calculates the sound source position from the difference in recording start time between microphones 22A, 22B, 22C, and 22D based on the voice data. Furthermore, the data collection computer 24 corrects the difference in recording start time between each piece of voice data from microphones 22A, 22B, 22C, and 22D based on the calculated voice source position. Furthermore, the data collection computer 24 corrects the difference in recording start time between the voice data from microphones 22A, 22B, 22C, and 22D and the image data from camera 23 as worker M passes through gate 21A, and synchronizes them.

[0036] In this way, according to the data synchronization system 20, even in the work area A2, the difference in the recording start time of each audio data and shooting data caused by the difference in the position of each microphone 22A, 22B, 22C, 22D and the difference in the propagation speed of light and sound can be corrected and synchronized.

[0037] (Application example 2) Fig. 4 is a schematic plan view of a work area for explaining application example 2 of the data synchronization system. Fig. 5 is a schematic side view of a work area for explaining application example 2 of the data synchronization system. 4 and 5, in Application Example 2, the data synchronization system 30 is applied to a work area A3 equipped with a plurality of (six in this example) pieces of equipment 31A, 31B, 31C, 31D, 31E, and 31F. The data synchronization system 30 is installed in the work area A3 as a monitoring area.

[0038] Work area A3 has a large space, for example, ranging from several square meters to several tens of square meters. Equipment 31A, 31B, 31C, 31D, 31E, and 31F are installed in work area A3 and used for various tasks, such as machine tools and assembly machines. When an abnormality occurs in these pieces of equipment 31A, 31B, 31C, 31D, 31E, and 31F, an alarm sounds and warning lights 31La, 31Lb, 31Lc, 31Ld, 31Le, and 31Lf are turned on.

[0039] The work area A3 has a work passage 35 for movement of workers M and the like. Equipment 31A, 31B, and 31C are arranged on one side of the work passage 35, and equipment 31D, 31E, and 31F are arranged on the other side of the work passage 35.

[0040] The data synchronization system 30 includes a plurality of (four in this example) microphones (sound collection devices) 32A, 32B, 32C, and 32D, and a camera (imaging device) 33. The data synchronization system 30 also includes a data collection computer (data collection unit) 34, to which the audio data transmitted from the microphones 32A, 32B, 32C, and 32D and the captured data transmitted from the camera 33 are sent.

[0041] Microphones 32A, 32B, 32C, and 32D are placed at the four corners of work area A3. Camera 33 is installed on the ceiling at the center of work area A3 and captures the entire work area A3 from above.

[0042] The data collection computer 34 collects the audio data and the photographic data transmitted from the microphones 32A, 32B, 32C, and 32D and the camera 33. Then, the data collection computer 34 corrects and synchronizes the recording start times of the audio data from the microphones 32A, 32B, 32C, and 32D and the recording start times of the audio data and the photographic data.

[0043] In the work area A3, which is a monitored area, if an event such as an abnormality occurs in the equipment 31B, an alarm sound is emitted in the equipment 31B to notify the abnormality, and the lamp 31Lb, which is a warning light, is turned on.

[0044] The warning sound emitted from facility 31B is collected by multiple microphones 32A, 32B, 32C, and 32D and transmitted as audio data from microphones 32A, 32B, 32C, and 32D to data collection computer 34. In addition, facility 31B with lamp 31Lb lit is photographed by camera 33, and the photographed image is transmitted from camera 33 to data collection computer 34.

[0045] The data aggregation computer 34 receives the audio data transmitted from the microphones 32A, 32B, 32C, and 32D and the photographic data transmitted from the camera 33, and links the audio data and the photographic data as information on the same event.

[0046] Furthermore, the data collection computer 34 calculates the sound source position from the difference in recording start time between microphones 32A, 32B, 32C, and 32D based on the audio data. Furthermore, the data collection computer 34 corrects the difference in recording start time between each piece of audio data from microphones 32A, 32B, 32C, and 32D based on the calculated sound source position. Furthermore, the data collection computer 34 corrects the difference in recording start time between the audio data from microphones 32A, 32B, 32C, and 32D and the image data from camera 33 associated with an event at facility 31B, thereby synchronizing them.

[0047] In this way, according to the data synchronization system 30, even in the work area A3, the discrepancy in the recording start time of each audio data and photographic data caused by the difference in the position of each microphone 32A, 32B, 32C, 32D and the difference in the propagation speed of light and sound can be corrected and synchronized. [Explanation of symbols]

[0048] 10, 20, 30 Data Synchronization System 11,31A~31F Equipment 12A, 12B, 22A-22D, 32A-32D Microphone (sound collection device) 13, 23, 33 Camera (imaging device) 14, 24, 34 Data Collection Computer (Data Collection Department) 21A, 21B Gates (Facilities) A1, A2, A3 work area

Claims

[Claim 1] A data synchronization system that synchronizes audio data of sounds emitted from equipment in a work area where the equipment is installed with photographed data of the equipment, a plurality of sound collection devices installed at different positions within the work area, collecting sounds emitted from the equipment and transmitting audio data; an imaging device that is installed in the work area and captures images of the facility and transmits the captured image data; a data aggregation unit that corrects time differences between the audio data from the plurality of sound collection devices and the image capture data from the image capture device to synchronize them; having Data synchronization system.

Images