Work location specification system, work location specification method, and work location specification program

Abstract

To provide a work location specification system capable of specifying a work location by using a vibration or sound sensor.SOLUTION: The work location specification system includes: imaging means for imaging a worker; a sound or vibration sensor attached to both hands of the worker and sensing a work sound; hand-to-hand distance estimation means for estimating a distance between both hands from an image of both hands of the worker imaged by the imaging means; sound source estimation means for estimating a direction of a sound source of the work sound and a distance up to the sound source of the work sound on the basis of information on the work sound acquired from the sound or vibration sensor and the distance between both hands; and work location specification means for specifying a work location on the basis of information acquired from the sound source estimation means and a work location candidate set in advance.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a work position specifying system, a work position specifying method, and a work position specifying program. [Background technology]

[0002] Systems for grasping the status of work have been developed. Patent Document 1 discloses a control device for grasping the status of work, which includes a communication unit and a processing unit. The communication unit is capable of receiving, from a tool on which the imaging device is provided, an image captured by the imaging device of a work location where work of tightening fastening parts is performed. The processing unit determines whether the fastening parts are tightened correctly based on a comparison result between a target image showing a state in which the fastening parts are tightened correctly at the work location and the captured image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-229210 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the system of Patent Document 1 may not be able to identify the work position from the captured image depending on the image capture position or the posture of the worker. Therefore, an object of the present disclosure is to provide a work position identification system that can identify the work position using a vibration or sound sensor. [Means for solving the problem]

[0005] One aspect of the work location identification system of the present disclosure is to An imaging means for imaging a worker; A sound or vibration sensor attached to both hands of the worker for detecting a work sound; a hand-to-hand distance estimation means for estimating a hand-to-hand distance from images of the worker's hands captured by the imaging means; a sound source estimation means for estimating a direction of a source of the work sound and a distance to the source of the work sound based on information of the work sound acquired from the sound or vibration sensor and the distance between the hands; The work position identifying system includes a work position identifying means for identifying a work position based on information acquired from the sound source estimating means and preset work position candidates.

[0006] With the above configuration, it is possible to provide a work position identification system capable of identifying a work position using a vibration or sound sensor.

[0007] Another aspect of the work location system of the present disclosure is to A glove sensor attached to both hands of a worker; A sound or vibration sensor attached to both hands of the worker for detecting a work sound; a hand-to-hand distance estimation means for estimating a hand-to-hand distance of the worker from information acquired by the glove sensor; a sound source estimation means for estimating a direction of a source of the work sound and a distance to the source of the work sound based on information of the work sound acquired from the sound or vibration sensor and the distance between the hands; The work position identifying system includes a work position identifying means for identifying a work position based on information acquired from the sound source estimating means and preset work position candidates.

[0008] According to the above-mentioned configuration, it is possible to provide a work position specifying system that can specify a work position using a vibration or sound sensor. In particular, it is possible to specify a work position without using an imaging device.

[0009] The work location identification system of the present disclosure comprises: The imaging means captures an image of a work area, and a work position candidate is set from the image of the work area.

[0010] With the above configuration, work position candidates can be set in advance.

[0011] The work position identification method of the present disclosure includes: An image of the worker is captured by the imaging means; Detecting work sounds with sound or vibration sensors attached to both hands of the worker; estimating a distance between the worker's hands from images of the worker's hands captured by the imaging means; estimating a direction of a source of the work sound and a distance to the source of the work sound based on the information of the work sound acquired from the sound or vibration sensor and the distance between the hands; The method for identifying a work position identifies a work position based on the estimated direction and distance of the sound source and preset work position candidates.

[0012] According to the above configuration, it is possible to provide a work position identification method capable of identifying a work position using a vibration or sound sensor.

[0013] The work position identification program of the present disclosure is An image of the worker is captured by the imaging means; Detecting work sounds with sound or vibration sensors attached to both hands of the worker; estimating a distance between the worker's hands from images of the worker's hands captured by the imaging means; estimating a direction of a source of the work sound and a distance to the source of the work sound based on the information of the work sound acquired from the sound or vibration sensor and the distance between the hands; The work position identification program causes an information processing device to identify a work position based on the estimated direction and distance of the sound source and preset work position candidates.

[0014] With the above configuration, it is possible to provide a work position identification program that can identify a work position using a vibration or sound sensor. Effect of the Invention

[0015] The present disclosure makes it possible to provide a work position identification system capable of identifying a work position using a vibration or sound sensor. [Brief description of the drawings]

[0016] [Figure 1] FIG. 1 is a diagram illustrating an operation principle of a work position specifying system according to an embodiment. [Diagram 2] 1 is a schematic diagram showing a configuration of a work position specifying system according to an embodiment; [Diagram 3] 1 is a flowchart of a work position specifying method according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] Embodiment Hereinafter, an embodiment of the present invention will be described with reference to the drawings. However, the invention according to the claims is not limited to the following embodiment. Furthermore, not all of the configurations described in the embodiment are necessarily essential as means for solving the problem. For clarity of explanation, the following description and drawings are omitted and simplified as appropriate. In each drawing, the same elements are given the same reference numerals, and repeated explanations are omitted as necessary.

[0018] (Description of the Work Position Identification System According to the Embodiment) Fig. 1 is a diagram showing the operation principle of a work position identifying system according to an embodiment. Fig. 2 is a schematic diagram showing the configuration of a work position identifying system according to an embodiment. The work position identifying system according to an embodiment will be described with reference to Figs. 1 and 2. The work position identifying system 200 is a system that identifies the position where work is being performed from a plurality of work position candidates, for example.

[0019] As shown in Fig. 1, in the work position identification system according to the embodiment, an imaging means captures an image of the work place, and work position candidates are set in advance from the image of the work place. The work position identification system 200 finds and sets work position candidates from within the work place using AI (Artificial Intelligence) or the like. Here, there are multiple work position candidates A, B, and C. When the sound or vibration sensors set on both hands detect a value that exceeds a threshold, the waveform is recorded. For example, assume that the waveforms of the right hand and the left hand are acquired as shown in the lower diagram of Fig. 1.

[0020] If the distance between the right and left hands is known from a video or glove sensor, the rough distance to the sound source can be estimated from the difference between the distance between the hands and the data acquired by the sound or vibration sensors attached to both hands. The work position can be identified by multiplying the estimated distance by the data of the candidate work positions. For example, in this case, the work position can be identified as C.

[0021] As shown in FIG. 2, a work position identifying system 200 according to the embodiment includes an imaging unit 201 , a sound or vibration sensor 202 , a hand-to-hand distance estimating unit 203 , a sound source estimating unit 204 , and a work position identifying unit 205 .

[0022] The imaging means 201 captures an image of the workplace in advance as described above. The imaging means 201 also captures an image of the worker and captures both hands. The imaging means 201 is, for example, an RGB camera. The imaging means capturing an image of the workplace and the imaging means capturing an image of the worker may be the same or different. The imaging means capturing an image of the workplace may capture a still image. It is preferable that the imaging means capturing an image of the worker captures a video.

[0023] The sound or vibration sensor 202 is attached to both hands of the worker. The sound or vibration sensor 202 detects work sounds. The sound or vibration sensor 202 can obtain work sounds without picking up noise in the workplace by detecting values ​​exceeding a threshold value.

[0024] The hand-to-hand distance estimation means 203 receives video data from the imaging means 201. The hand-to-hand distance estimation means 203 estimates the distance between the hands from images of the worker's hands captured by the imaging means 201. The hand-to-hand distance estimation means 203 estimates the distance between the hands using AI. Also, a glove sensor may be used instead of the imaging means 201. The hand-to-hand distance estimation means 203 may acquire data from the glove sensor to estimate the distance between the hands.

[0025] The sound source estimation means 204 receives sound data from a sound or vibration sensor. The sound source estimation means 204 estimates the direction of the source of the work sound and the distance to the source of the work sound based on the information of the work sound acquired from the sound or vibration sensor and the distance between the hands. The sound source estimation means 204 may use AI.

[0026] The work position identification means 205 identifies the work position based on information acquired from the sound source estimation means 204 and preset work position candidates. The work position identification means 205 identifies the work position using AI. The information processing device includes a hand-to-hand distance estimation means 203, a sound source estimation means 204, and a work position identification means 205. The information processing device includes a processor such as a CPU (Central Processing Unit) that processes a program to execute processing, and a memory that stores the program. The information processing device may be one device or may be composed of multiple devices. The information processing device may be a cloud server that executes some or all of its functions in a distributed manner.

[0027] The above configuration provides a work position identification system that can identify a work position using a vibration or sound sensor. In addition, when a glove sensor is used, the work position can be identified without using the imaging means 201 for anything other than setting work position candidates.

[0028] (Description of a work position identification method according to an embodiment) Fig. 3 is a flowchart of a work position specifying method according to an embodiment. The work position specifying method according to an embodiment will be described with reference to Fig. 3. The work position specifying method is a method for specifying a position where work is being performed from a plurality of work position candidates, for example.

[0029] As shown in Fig. 3, first, the imaging means 201 captures an image of a work position candidate (step S301). The imaging means 201 captures an image of the work site. Next, the work position identification system 200 sets a work position candidate in advance (step S302). Up to this point, the process can be performed in the pre-processing stage before the actual work is performed.

[0030] Next, the imaging means 201 captures a video of both hands of the worker (step S303). The inter-hand distance estimation means 203 estimates the distance between the hands (step S305). The inter-hand distance may be measured using a glove sensor instead of the imaging means 201. The work position identification means 205 also acquires video data (step S304).

[0031] The sound sensor 1 on the right hand detects the work sound (step S306), and the sound sensor 2 on the left hand similarly detects the work sound (step S307).

[0032] Next, the sound source estimation means 204 estimates the direction of the sound source and the distance from the sound source from the distance between the hands and the difference in sound volume between sound sensor 1 and sound sensor 2 (step S308). That is, the sound source estimation means 204 obtains information from steps S305, S306, and S307 to estimate the distance and direction of the sound source.

[0033] Finally, the work position identification means 205 identifies a position from among the specified work position candidates (step S309). The work position identification means 205 identifies a work position from the work position candidates set in step S302 and the distance and direction of the sound source. The work position identification means 205 may auxiliary use the video data acquired in step S305 as work position candidates, or may set work position candidates only from the video data without setting work position candidates in advance.

[0034] The above configuration provides a method for identifying a work position using a vibration or sound sensor. When a glove sensor is used, the work position can be identified without using an imaging means other than preprocessing. A program for identifying a work position can be provided by having an information processing device execute the above-mentioned method for identifying a work position.

[0035] In addition, a part or all of the processing in the above-mentioned information processing device can be realized as a computer program. Such a program can be stored using various types of non-transitory computer-readable media and supplied to a computer. The non-transitory computer-readable medium includes various types of tangible recording media. Examples of the non-transitory computer-readable medium include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory)). The program may also be supplied to a computer by various types of temporary computer-readable media. Examples of the temporary computer-readable medium include electrical signals, optical signals, and electromagnetic waves. The temporary computer-readable medium can supply the program to a computer via a wired communication path such as an electric wire and an optical fiber, or via a wireless communication path.

[0036] The present invention is not limited to the above-described embodiment, and can be modified as appropriate without departing from the spirit and scope of the present invention. [Explanation of symbols]

[0037] 200 Work position identification system, 201 Imaging means, 202 Sound or vibration sensor, 203 Inter-hand distance estimation means, 204 Sound source estimation means, 205 Work position identification means

Claims

1. Imaging means for imaging a worker; A sound or vibration sensor attached to both hands of the worker for detecting a work sound; a hand-to-hand distance estimation means for estimating a hand-to-hand distance from images of the worker's hands captured by the imaging means; a sound source estimation means for estimating a direction of a source of the work sound and a distance to the source of the work sound based on information of the work sound acquired from the sound or vibration sensor and the distance between the hands; A work position identifying system comprising: a work position identifying means for identifying a work position based on information acquired from the sound source estimating means and preset work position candidates.

2. A glove sensor attached to both hands of a worker; A sound or vibration sensor attached to both hands of the worker for detecting a work sound; a hand-to-hand distance estimation means for estimating a hand-to-hand distance of the worker from information acquired by the glove sensor; a sound source estimation means for estimating a direction of a source of the work sound and a distance to the source of the work sound based on information of the work sound acquired from the sound or vibration sensor and the distance between the hands; A work position identifying system comprising: a work position identifying means for identifying a work position based on information acquired from the sound source estimating means and preset work position candidates.

3. 3. The work position specifying system according to claim 1, wherein an imaging means captures an image of the work place and sets work position candidates from the image of the work place.

4. An image of the worker is captured by the imaging means; Detecting work sounds with sound or vibration sensors attached to both hands of the worker; estimating a distance between the worker's hands from images of the worker's hands captured by the imaging means; estimating a direction of a source of the work sound and a distance to the source of the work sound based on the information of the work sound acquired from the sound or vibration sensor and the distance between the hands; A work position identification method for identifying a work position based on the estimated direction and distance of the sound source and preset work position candidates.

5. An image of the worker is captured by the imaging means; Detecting work sounds with sound or vibration sensors attached to both hands of the worker; estimating a distance between the worker's hands from images of the worker's hands captured by the imaging means; estimating a direction of a source of the work sound and a distance to the source of the work sound based on the information of the work sound acquired from the sound or vibration sensor and the distance between the hands; A work position identification program that causes an information processing device to identify a work position based on the estimated direction and distance of the sound source and preset work position candidates.

Images