Information processing device, information processing system, information processing method, and recording medium

Abstract

This information processing device comprises an image acquisition unit, an image analysis unit, and a determination unit. The image acquisition unit acquires an image including a first area. The image analysis unit identifies worker information from the image. The determination unit compares pre-registered reference information with a worker, work area, and work content included in the worker information, and determines whether the worker is performing a predetermined work.

Description

Information processing device, information processing system, information processing method, and recording medium

[0001] The present disclosure relates to an information processing device, an information processing system, an information processing method, and a recording medium.

[0002] A technology related to this disclosure is disclosed in Patent Document 1. The technology disclosed in Patent Document 1 identifies a worker wearing a helmet by reading the light emission pattern of a light-emitting device attached to the helmet using image analysis. The technology disclosed in Patent Document 1 then monitors the worker's position, etc. based on the identification results.

[0003] JP 2009-186203 A

[0004] There are cases where multiple workers work within a controlled area. Controlled areas can be a variety of locations, such as construction sites, building sites, factories, amusement parks, retail stores, complexes, sports facilities, and farms. There is a demand for technology that monitors whether each worker is performing a specific task within the controlled area. The specific task can be, for example, an assigned task or a permitted task.

[0005] An example of a purpose of this disclosure is to provide a technique for monitoring whether each worker is performing a predetermined task within a controlled area.

[0006] The information processing device has an image acquisition means for acquiring an image including a first area, an image analysis means for identifying worker information from the image, and a determination means for comparing pre-registered reference information with the worker, work area, and work content included in the worker information, and determining whether the worker is performing a specified task.

[0007] The information processing system comprises: an image acquisition means for acquiring an image including a first area; an image analysis means for identifying worker information from the image; a determination means for comparing pre-registered reference information with the worker, work area, and work content included in the worker information to determine whether the worker is performing a specified task; a registration means for determining a light emission pattern for each worker and registering the light emission pattern by linking it to each worker; and an emission control means for causing a personal device carried by each worker to emit light in the light emission pattern for each worker, wherein the image analysis means comprises: an information processing device for detecting light emission in the light emission pattern from within the image, thereby detecting the worker; and a personal device carried by each worker that emits light in a specified light emission pattern.

[0008] In the information processing method, one or more computers acquire an image including a first area, identify worker information from the image, compare the worker, work area, and work content included in the worker information with pre-registered reference information, and determine whether the worker is performing a specified task.

[0009] The recording medium records a program that causes the computer to function as: an image acquisition means that acquires an image including a first area; an image analysis means that identifies worker information from the image; and a determination means that compares pre-registered reference information with the worker, work area, and work content included in the worker information, and determines whether the worker is performing the specified work.

[0010] 1 is a diagram illustrating an example of a functional block diagram of an information processing device. FIG. 2 is a flowchart illustrating an example of a processing flow of an information processing device. FIG. 3 is a diagram illustrating an example of a hardware configuration of an information processing device. FIG. 4 is a diagram illustrating an example of a functional block diagram of an information processing system. FIG. 5 is a diagram illustrating another example of a functional block diagram of an information processing device. FIG. 6 is a flowchart illustrating another example of a processing flow of an information processing device. FIG. 7 is a flowchart illustrating another example of a processing flow of an information processing device. FIG. 8 is a diagram illustrating another example of a functional block diagram of an information processing device. FIG. 9 is a diagram illustrating an example of information processed by an information processing device. FIG. 10 is a diagram illustrating an example of a owned device. FIG. 11 is a diagram illustrating an example of a detection unit of a owned device. FIG. 12 is a flowchart illustrating another example of a processing flow of an information processing device.

[0011] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In this disclosure, the drawings relate to one or more embodiments. In all drawings, similar components are designated by similar reference numerals, and descriptions thereof will be omitted as appropriate.

[0012] <<First embodiment>> Fig. 1 is a functional block diagram showing an overview of an information processing device 10. As shown in Fig. 1, the information processing device 10 has an image acquisition unit 11, an image analysis unit 12, and a determination unit 13. These functional units execute the processing of the flowchart in Fig. 2.

[0013] In S100, the image acquisition unit 11 acquires an image including a first area (management area). In S101, the image analysis unit 12 identifies worker information from the image acquired in S100. In S102, the determination unit 13 compares pre-registered reference information with the worker, work area, and work content included in the worker information identified in S101, and determines whether the worker is performing a predetermined work. The predetermined work may be, for example, an assigned work or an authorized work.

[0014] In this way, the information processing device 10 determines whether the worker is performing a predetermined task by comparing information identified from the image (worker information) with pre-registered information (reference information). With this information processing device 10, it is possible to monitor, by image analysis, whether each worker is performing a predetermined task within a management area.

[0015] Furthermore, the information processing device 10 identifies information (worker information) including the worker, work area, and work content from the image. Then, the information processing device 10 determines whether the worker is performing a specified task based on the identified information (worker information). The information processing device 10 uses both the work area and the work content as materials for this determination, making it possible to determine with high accuracy whether each worker is performing a specified task within a management area.

[0016] <<Second Embodiment>> <Overview> An information processing device 10 according to a second embodiment is a specific implementation of the configuration of the control device 10 according to the first embodiment. A detailed description will be given below.

[0017] <Hardware Configuration> First, an example of the hardware configuration of the information processing device 10 will be described. Each functional unit of the information processing device 10 is realized by any combination of hardware and software. Those skilled in the art will understand that there are various variations in the realization method and device. The software includes programs that are pre-stored in the device before shipping, and programs downloaded from recording media such as CDs (Compact Discs) or servers on the Internet.

[0018] FIG. 3 is a block diagram illustrating an example of the hardware configuration of an information processing device 10. As shown in FIG. 3, the information processing device 10 has a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules. The information processing device 10 does not necessarily have to have the peripheral circuit 4A. Note that the information processing device 10 may be composed of multiple devices that are physically and / or logically separated. In this case, each of the multiple devices may have the above hardware configuration.

[0019] The bus 5A is a data transmission path for the processor 1A, memory 2A, peripheral circuit 4A, and input / output interface 3A to mutually transmit and receive data. The processor 1A is, for example, a processing unit such as a CPU or a graphics processing unit (GPU). The memory 2A is, for example, a random access memory (RAM) or a read-only memory (ROM). The input / output interface 3A includes interfaces for acquiring information from input devices, external devices, external servers, external sensors, cameras, etc., and interfaces for outputting information to output devices, external devices, external servers, etc. The input / output interface 3A also includes an interface for connecting to a communication network such as the Internet. Examples of input devices include a keyboard, mouse, microphone, physical buttons, touch panel, etc. Examples of output devices include a display, speaker, printer, mailer, etc. The processor 1A can issue commands to each module and perform calculations based on the results of those calculations.

[0020] <Functional Configuration of Information Processing System 1> The information processing system 1 is used to monitor whether each worker is performing a predetermined task within a management area. As shown in Fig. 4, the information processing system 1 includes an information processing device 10, a plurality of personal devices 20, and an image capture device 30.

[0021] The image acquisition device 30 is, for example, a camera, and is installed in an area (management area) that the information processing device 10 wants to manage. There may be multiple image acquisition devices 30, or just one. The image acquisition device 30 photographs the management area in which it is installed and generates an image of the management area. The image acquisition device 30 then transmits the generated image to the information processing device 10. The transmitted image is processed by the information processing device 10 as appropriate.

[0022] A controlled area is an area where multiple workers work. Controlled areas can be, for example, but are not limited to, construction sites, building sites, factories, amusement parks, retail stores, complexes, sports facilities, farms, and the like. Each worker performs a specific task within the controlled area. The specific task can be, for example, an assigned task or a permitted task.

[0023] The owned device 20 is a device owned by a worker. The worker owns the owned device 20 while working in the management area. Each of a plurality of workers owns a owned device 20.

[0024] The portable device 20 is, for example, a wearable device. The portable device 20 may be a head-mounted device (such as a helmet-type device, a hat-type device, a sun visor-type device, a goggle-type device, or a headset). Alternatively, the portable device 20 may be a face-mounted device (such as an eyeglass-type device, a sunglasses-type device, a mask-type device, or an earmuff-type device). Alternatively, the portable device 20 may be a clothing-type device. Alternatively, the portable device 20 may be a hand- or arm-mounted device (such as a glove-type device, a watch-type device, a wristband-type device, or an armband-type device). Alternatively, the portable device 20 may be a shoe-type device. Alternatively, the portable device 20 may be a keychain-type device or a badge-type device that can be worn anywhere on the body. Note that the examples given here are merely examples, and the portable device 20 may be other wearable devices. Alternatively, the portable device 20 may be a non-wearable device. However, considering that the portable device 20 will be carried while working, it is preferable for the wearable device to not get in the way of work and to be helpful for work.

[0025] The owned device 20 has at least a communication function and a light emitting function.

[0026] The communication function is a function for communicating with an external device. Each of the multiple owned devices 20 is configured to be able to communicate with the information processing device 10. For example, the information processing device 10 and each of the multiple owned devices 20 may perform short-range wireless communication when their relative positions satisfy communication conditions. Alternatively, the information processing device 10 and each of the multiple owned devices 20 may perform wired communication when connected to each other by a cable or the like. Alternatively, the information processing device 10 and each of the multiple owned devices 20 may perform wireless communication via a communication network such as the Internet or a local area network (LAN).

[0027] The light-emitting function is a function of emitting light. The owned device 20 has a light-emitting unit such as a light and a control unit that controls the light-emitting state of the light-emitting unit. The light emitted by the light-emitting unit may be visible light, infrared light, or light of another wavelength. The owned device 20 can emit light in multiple light-emitting patterns. Each of the multiple owned devices 20 emits light in the light-emitting pattern specified by the information processing device 10.

[0028] The plurality of light emission patterns may differ from one another in light emission patterns. For example, the plurality of light emission patterns may differ from one another in the blinking cycle, the blinking rhythm, the number of blinks per cycle, the length of time the light is maintained on, the length of time the light is maintained off, etc. Furthermore, the plurality of light emission patterns may differ from one another in the color of light.

[0029] The information processing device 10 analyzes images taken within the management area and detects each worker in the image by detecting a predetermined light emission pattern. The information processing device 10 then further analyzes the image and identifies the area (work area) where each worker detected in the image is working and the work content each worker is performing. The information processing device 10 then determines whether the worker is performing a predetermined work based on the identification result. The functional configuration of the information processing device 10 will be described in detail below.

[0030] <Functional Configuration> Next, the functional configuration of the information processing device 10 will be described in detail. Fig. 5 shows an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 has an image acquisition unit 11, an image analysis unit 12, a determination unit 13, a storage unit 15, a registration unit 16, a light emission control unit 17, and an authentication unit 18. Note that the information processing device 10 does not necessarily have to have the storage unit 15. In this case, an external device configured to be able to communicate with the information processing device 10 has the storage unit 15.

[0031] Below, the processing of the above functional units will be explained, divided into processing when a worker enters the management area, processing when a worker is working in the management area, and processing when a worker leaves the management area.

[0032] "Processing when a worker enters the managed area" The authentication unit 18 performs authentication processing on the worker when the worker enters the managed area. That is, the authentication unit 18 accepts input of authentication information from the worker when the worker enters the managed area. The authentication unit 18 then performs authentication processing by comparing the input authentication information with the authentication information of each worker that is stored in advance in the storage unit 15.

[0033] The authentication unit 18 can perform authentication processing using any authentication technology. Examples of authentication technologies include, but are not limited to, biometric authentication, IC (integrated circuit) card authentication, IC tag authentication, IC chip authentication, and password authentication. Examples of biometric authentication include, but are not limited to, face authentication, iris authentication, fingerprint authentication, voiceprint authentication, vein authentication, and ear authentication.

[0034] Authentication information is information used in such authentication processing. Examples of authentication information include, but are not limited to, biometric information, passwords, IC card information (information stored in an IC card), IC tag information (information stored in an IC tag), and IC chip information (information stored in an IC chip). Biometric information includes, but is not limited to, face information, iris information, fingerprint information, voiceprint information, vein information, and auricle information.

[0035] In one example, an input device for inputting authentication information is installed at the entrance to the managed area. At the entrance to the managed area, workers enter their own authentication information into the input device to perform the authentication process. Only workers who are successful in the authentication process can enter the managed area.

[0036] The authentication unit 18 may output the result of the authentication process (authentication success / authentication failure) via an output device installed at the entrance of the managed area. The output device may be, but is not limited to, a display, a projection device, a speaker, a light, a vibrator, etc.

[0037] The registration unit 16 determines a light emission pattern for each worker, associates the light emission pattern with each worker, and registers the light emission pattern in the storage unit 15. "Registering in association with a worker" means registering in association with worker identification information. The worker identification information is information that identifies multiple workers from each other.

[0038] The registration unit 16 determines a different light emission pattern for each worker. For example, when determining a light emission pattern for a certain worker, the registration unit 16 can determine, as the light emission pattern for that worker, a light emission pattern that is not currently associated with any worker and registered.

[0039] In one example, multiple light emission patterns are created in advance and stored in the storage unit 15. From the multiple light emission patterns stored in advance, the registration unit 16 selects one light emission pattern that is not associated with any worker and registered at the time of determining the light emission pattern for that worker as the light emission pattern for that worker. When there are multiple light emission patterns that are not associated with any worker and registered, the selection method is not particularly limited. The registration unit 16 may select a light emission pattern randomly or by another method. Then, the registration unit 16 registers the selected light emission pattern in association with the worker identified in the authentication process.

[0040] In this way, when the authentication process at the time of entry is successful and a worker is identified through the authentication process, the registration unit 16 can determine a light-emitting pattern for the identified worker and register the light-emitting pattern in association with the identified worker. For example, when a worker is identified through the authentication process at the time of entry, the registration unit 16 refers to the storage unit 15 and selects one of the light-emitting patterns that are not currently associated with any worker and registered. The registration unit 16 then determines the selected light-emitting pattern as the light-emitting pattern for the worker and registers it in the storage unit 15 in association with the worker.

[0041] The light emission control unit 17 causes the portable device 20 carried by each worker to emit light in the light emission pattern of each worker. The light emission pattern of each worker is the light emission pattern for each worker registered in the storage unit 15 by the registration unit 16.

[0042] The light-emission control unit 17 notifies the owned device 20 carried by each worker of the light-emission pattern for each worker determined by the registration unit 16. Each owned device 20 can store the light-emission pattern notified by the light-emission control unit 17 therein. Then, each owned device 20 emits light in the light-emission pattern notified by the light-emission control unit 17.

[0043] The owned device 20 can emit light in the notified light emission pattern while the worker is working in the managed area.

[0044] For example, the owned device 20 may start emitting light in the notified light-emitting pattern in response to a notification from the light-emission control unit 17. Then, the owned device 20 may stop emitting light in the notified light-emission pattern in response to a predetermined notification from the information processing device 10 in "Processing when a worker leaves a managed area" described later.

[0045] Alternatively, a work start time and a work end time may be determined in advance and stored in the storage unit 15. Then, the light emission control unit 17 may notify the owned device 20 of the work start time and the work end time in addition to notifying the light emission pattern. Then, the owned device 20 may start emitting light in response to the arrival of the notified work start time, and stop emitting light in response to the arrival of the notified work end time.

[0046] Furthermore, a break start time and a break end time may be further determined in advance and stored in the storage unit 15. Then, the light emission control unit 17 may further notify the possessed device 20 of the break start time and the break end time. Then, the possessed device 20 may stop emitting light when the notified break start time arrives, and start emitting light when the notified break end time arrives.

[0047] Alternatively, a work start time and a work end time may be determined in advance for each worker and stored in the storage unit 15. Then, the light-emission control unit 17 may notify the owned device 20 of the work start time and work end time for each worker, in addition to notifying the light-emission pattern. Then, the owned device 20 may start emitting light in response to the arrival of the notified work start time, and stop emitting light in response to the arrival of the notified work end time. In this case, the light-emission control unit 17 reads out from the storage unit 15 the work start time and work end time of the worker identified by the authentication process at the time of entry. Then, the light-emission control unit 17 notifies the read work start time and work end time to the owned device 20.

[0048] Furthermore, a break start time and a break end time may be determined in advance for each worker and stored in the storage unit 15. The light-emitting control unit 17 may then notify the possessed device 20 of the break start time and the break end time for each worker. The possessed device 20 may then stop emitting light when the notified break start time arrives, and start emitting light when the notified break end time arrives. In this case, the light-emitting control unit 17 reads out from the storage unit 15 the break start time and the break end time of the worker identified by the authentication process at the time of entry. The light-emitting control unit 17 then notifies the possessed device 20 of the read break start time and the break end time.

[0049] Additionally, the portable device 20 may be capable of starting and stopping light emission in response to an operation by the worker.

[0050] There are various ways for the light emission control unit 17 to notify the owned device 20 of the light emission pattern. An example will be described below, but the present invention is not limited to this.

[0051] First Notification Example In this example, a worker who has succeeded in the authentication process puts the personal device 20 they possess into a state in which it can communicate with the information processing device 10. For example, the worker may perform an operation of touching or bringing their personal device 20 into proximity with a reader / writer of the information processing device 10. Alternatively, when a worker carrying the personal device 20 approaches a predetermined position such as an entrance / exit gate, the personal device 20 and the information processing device 10 may become communicable. When the personal device 20 and the information processing device 10 become communicable, the light-emission control unit 17 notifies the personal device 20 of the light-emission pattern determined by the registration unit 16. The personal device 20 may be loaned to the worker by a facility manager, or may be owned by the worker himself.

[0052] In this example, the light-emission control unit 17 notifies the worker of the light-emission pattern determined by the registration unit 16 in response to the success of the authentication process via a predetermined output device. The output device may be, but is not limited to, a display, a projection device, a speaker, or the like.

[0053] For example, the light-emission control unit 17 may cause the output device to output identification information of the light-emission pattern determined by the registration unit 16. Alternatively, the light-emission control unit 17 may cause the output device to output a code (such as a barcode or a two-dimensional code) indicating the light-emission pattern determined by the registration unit 16. A worker who has succeeded in the authentication process inputs the notified identification information of the light-emission pattern into his or her own device 20 by means of code reading, manual input, voice input, or the like. In this case, the device 20 has input means for accepting such input. The device 20 may be loaned to the worker by the facility manager, or may be owned by the worker himself or herself.

[0054] Third Notification Example In this example, the manager of the management area lends the owned device 20 to each worker. When a worker has successfully passed the authentication process, the manager of the management area takes out any one of the owned devices 20 and performs the same operation as the worker performed in the first or second example. This operation notifies the taken-out owned device 20 of the light emission pattern determined by the registration unit 16. The manager then lends the owned device 20 to the worker who has successfully passed the authentication process.

[0055] Fourth Notification Example In this example, an application dedicated to the service of the information processing device 10 is pre-installed on the owned device 20. A worker who has been successfully authenticated operates his / her own owned device 20 and logs in to the application using his / her own worker identification information. The light-emission control unit 17 notifies the owned device 20 that has logged in to the application using the worker identification information of the worker who has been successfully authenticated of the light-emission pattern determined by the registration unit 16 via the application. The owned device 20 may be loaned to the worker by a facility manager or may be owned by the worker himself / herself.

[0056] Here, an example of the process flow when a worker enters a management area will be described using the flowchart in Figure 6. Note that the purpose of this description is to explain the process flow. Details of each process have been described above, so a detailed description will be omitted here.

[0057] First, the information processing device 10 performs an authentication process on a worker entering a management area (S200). If the authentication process is successful (Yes in S201), the information processing device 10 determines an illumination pattern and registers the illumination pattern in association with the worker identified in the authentication process (S202). The information processing device 10 also notifies the owned device 20 of the determined illumination pattern (S202).

[0058] On the other hand, if the authentication process fails (No in S201), the information processing device 10 performs error processing (S203). For example, as the error processing, the information processing device 10 outputs information indicating that the authentication process failed via an output device installed at the entrance of the management area.

[0059] "Processing When a Worker is Working in a Controlled Area" The image acquisition unit 11 acquires an image including the controlled area (first area) generated by a camera located within the controlled area.

[0060] The camera may be fixed at a predetermined position within the controlled area. Alternatively, the camera may be attached to a means of transportation that moves within the controlled area. The means of transportation may be configured to be movable on land, in the air, or in or on water. Alternatively, the means of transportation may be configured to be movable on rails provided at any position on the floor, wall, ceiling, in the air, on the ground, etc.

[0061] The camera continuously captures moving images. The camera may detect and image visible light, infrared light, or light of other wavelengths. The camera may also detect and image two or more of visible light, infrared light, and light of other wavelengths. However, the camera has at least the function of detecting and imaging light emitted by the portable device 20.

[0062] The camera transmits the generated image in real time to the information processing device 10. The image acquisition unit 11 acquires the image transmitted from the camera.

[0063] The image analysis unit 12 identifies worker information from the image acquired by the image acquisition unit 11. The worker information indicates the worker (worker identification information), work area, and work content. Such worker information indicates which work area the worker detected in the image is working in and what work content he or she is doing.

[0064] First, the image analysis unit 12 detects a worker from the image acquired by the image acquisition unit 11. Then, based on the image, the image analysis unit 12 identifies the area where the detected worker is working and the work content that the detected worker is performing. This will be described in detail below.

[0065] Processing for detecting a worker from an image acquired by the image acquisition unit 11 The image analysis unit 12 detects a worker from an image by detecting light emitted in a predetermined light emission pattern from the image. The predetermined light emission pattern is a light emission pattern that is associated with the worker and registered in the above-mentioned "processing when a worker enters a controlled area."

[0066] As described above, each worker is assigned a unique light-emitting pattern. The personal device 20 carried by each worker emits light in the light-emitting pattern unique to that worker. Therefore, by detecting light emission in each light-emitting pattern from within the image and detecting the person carrying the personal device 20 that emits that light, each worker can be identified and detected from within the image.

[0067] The process of detecting light emission in a predetermined light emission pattern from within an image can be realized using any well-known technology. For example, a light-emitting portion of an image has a higher brightness than its surroundings. Furthermore, the brightness of a portion emitting light in a predetermined light emission pattern is not constant but fluctuates. The image analysis unit 12 may detect the light-emitting portion from within the image, for example, by detecting such a characteristic portion within the image. The image analysis unit 12 may then identify the light emission pattern by tracking the detected portion within the image and observing the change in brightness over time. After detecting light emission in a predetermined light emission pattern from within the image, the image analysis unit 12 can identify the worker associated with the light emission pattern detected from within the image by comparing the detected light emission pattern with the light emission patterns for each worker stored in the memory unit 15.

[0068] Processing for identifying the area where the detected worker is working The management area is divided into multiple work areas. For example, if the management area is a construction site or a building site, the multiple work areas may include a materials storage area, a hazardous materials storage area, a first work site, etc. Furthermore, if the management area is an amusement park, the multiple work areas may include a first play area (e.g., a ride area), a second play area (e.g., a game corner, etc.), etc. Note that the examples of work areas here are merely examples and are not limited to these.

[0069] The image analysis unit 12 identifies the work area in which the worker detected in the image is located. There are various methods for identifying the work area in which the worker detected in the image is located. An example will be described below, but the present invention is not limited to these examples.

[0070] For example, if cameras are fixed at predetermined positions in the management area, the work area that each camera will capture is determined in advance according to the installation position and orientation of each camera. Therefore, information indicating the work area that each camera will capture may be stored in advance in the storage unit 15. In this example, the image analysis unit 12 identifies the work area captured by the camera that generated the image in which the worker was detected, based on the information. The image analysis unit 12 then identifies the identified work area as the work area in which the worker detected in the image is located.

[0071] Alternatively, if a camera is attached to a vehicle moving within the management area, each image generated by the camera may be provided with location information (such as latitude and longitude information) indicating the shooting location. In this example, the image analysis unit 12 identifies the work area that includes the shooting location of the camera that generated the image in which the worker was detected, based on this location information and map information indicating the location of each work area that is pre-stored in the storage unit 15. The image analysis unit 12 then identifies the identified work area as the work area in which the worker detected in the image is located.

[0072] Alternatively, landmark objects and sounds for each work area may be stored in advance in the storage unit 15. In this example, the image analysis unit 12 detects landmark objects and sounds from within an image in which a worker is detected, thereby identifying the work area in which the worker detected in the image is located.

[0073] Processing for identifying the work being performed by the detected worker The image analysis unit 12 can identify the work being performed by the worker based on the worker's behavior, posture, tools and equipment being used by the worker, etc.

[0074] For example, a plurality of work contents are defined in advance. Then, for each work content, the behavior or posture that the worker takes when performing each work content is stored in the memory unit 15. In addition, for each work content, the tools and equipment that the worker uses when performing each work content may also be stored in the memory unit 15. The image analysis unit 12 detects the worker's behavior, posture, tools, equipment, etc. used by the worker through image analysis. Then, the image analysis unit 12 can identify the work content that the worker is performing by comparing the detection result with the behavior, posture, tools, equipment, etc. corresponding to each work content that is stored in advance.

[0075] The actions and postures of a worker can be detected using any known technology. For example, the actions and postures of a worker can be detected using technology such as OpenPose. Furthermore, the tools and equipment used by a worker can be identified using any known technology. For example, the tools and equipment used by a worker can be identified using a classifier generated by machine learning, feature point matching, or the like.

[0076] The determination unit 13 compares the pre-registered reference information with the worker, work area, and work content included in the worker information identified by the image analysis unit 12, and determines whether the worker is performing the specified work. The determination unit 13 can make this determination for each worker.

[0077] The reference information indicates the workers who are to work in the controlled area and the predetermined tasks of each worker, such as assigned tasks or permitted tasks.

[0078] The determination unit 13 determines, for each worker, whether the work area indicated in the reference information (such as the assigned work area or the permitted work area) matches the work area indicated in the worker information (the work area identified by image analysis). If they do not match, the determination unit 13 determines that the worker is not performing the specified work.

[0079] Furthermore, the determination unit 13 determines whether the work content indicated in the reference information (such as the assigned work content or the permitted work content) for each worker matches the work content indicated in the worker information (the work content identified by the image analysis). If they do not match, the determination unit 13 determines that the worker is not performing the specified work.

[0080] Then, if the work content indicated in the reference information matches the work content indicated in the worker information, and further if the work area indicated in the reference information matches the work area indicated in the worker information, the judgment unit 13 judges that the worker is performing the specified work.

[0081] When it is determined that the worker has not performed the predetermined work, the determination unit 13 can perform error processing. For example, as the error processing, the determination unit 13 may issue an error notification that causes an output device included in the information processing device 10 to output error information. Alternatively, as the error processing, the determination unit 13 may issue an error notification that causes an output device to transmit error information to a predetermined terminal device to output the error information. The predetermined terminal device is, for example, a terminal device for the manager of the management area, but is not limited to this.

[0082] The error information includes information about the worker who is determined not to be performing the specified task. For example, the error information may include the worker's worker identification information and an image of the worker. The image of the worker may include a facial image of the worker that is stored in advance in the storage unit 15. The image of the worker may also include an image captured of a scene in which the worker is not performing the specified task. An image captured of a scene in which the worker is not performing the specified task is an image in which worker information is identified in which the task area and / or task content do not match the reference information.

[0083] The error information may also include information about the worker whose work area and / or work content did not match the reference information. The error information may further include reference information about the worker. This information allows the administrator to understand the work area the worker should be in (such as the assigned work area or permitted work area) and the work content they should be performing (such as the assigned work content or permitted work content). The administrator can then understand which work area the worker was performing and what work content caused the error notification.

[0084] The determination unit 13 may also store the determination result in the storage unit 15 as log information.

[0085] Here, an example of the process flow when a worker is working in a management area will be described using the flowchart in Figure 7. Note that the purpose of this description is to explain the process flow. Details of each process have been described above, so a detailed description will be omitted here.

[0086] First, the information processing device 10 detects a worker from the image based on the light emission pattern associated with each worker and registered (S300). Next, the information processing device 10 identifies the work area and work content of the detected worker at the time of image capture based on the image (S301).

[0087] Next, the information processing device 10 identifies the predetermined task (task area and task content) of the detected worker based on the pre-registered reference information (S302). Next, the information processing device 10 compares the task area and task content of the detected worker at the time of image capture with the predetermined task (task area and task content) of the detected worker (S303). Then, the information processing device 10 executes processing according to the comparison result (S304). For example, if the information processing device 10 determines that the detected worker is not performing the predetermined task, it can execute error processing.

[0088] "Processing when a worker leaves the controlled area" The authentication unit 18 performs authentication processing on the worker when the worker leaves the controlled area. That is, the authentication unit 18 accepts input of authentication information from the worker when the worker leaves the controlled area. The authentication unit 18 then performs authentication processing by comparing the input authentication information with the authentication information of each worker that is pre-stored in the storage unit 15. The authentication unit 18 can perform authentication processing using the same means as when the worker enters the controlled area.

[0089] In one example, an input device for inputting authentication information is installed at the exit of the managed area. At the exit of the managed area, a worker inputs his / her own authentication information into the input device and performs authentication processing. Then, a worker who has successfully completed the authentication processing can exit the managed area.

[0090] The authentication unit 18 may output the result of the authentication process (authentication success / authentication failure) via an output device installed at the exit of the controlled area. The output device may be, but is not limited to, a display, a projection device, a speaker, a light, a vibrator, etc.

[0091] The registration unit 16 erases the light-emitting patterns associated with each worker and registered at a predetermined timing. This erasure dissolves the association between the worker and the light-emitting pattern. In one example, when a worker is identified through authentication processing at the time of exit, the registration unit 16 can erase the light-emitting patterns associated with the identified worker and registered.

[0092] Furthermore, the registration unit 16 can notify the owned device 20 of a reset of the light emission pattern. There are various ways of making this notification, but for example, a method similar to the above-mentioned "notification of the light emission pattern to the owned device 20 by the light emission control unit 17" may be adopted. In response to this notification, the owned device 20 can erase the "light emission pattern notified by the light emission control unit 17" stored in the device itself. In response to this notification, the owned device 20 may also end light emission in the notified light emission pattern.

[0093] Here, an example of the process flow when a worker leaves a controlled area will be described using the flowchart in Figure 8. Note that the purpose of this description is to explain the process flow. Details of each process have been described above, so a detailed description will be omitted here.

[0094] First, the information processing device 10 performs an authentication process on a worker exiting the management area (S400). If the authentication process is successful (Yes in S401), the information processing device 10 erases the light-emitting pattern associated with the worker identified in the authentication process and registered in the storage unit 15 (S402). Note that in S402, the information processing device 10 may notify the owned device 20 to reset the light-emitting pattern. In response to this notification, the owned device 20 can erase the "light-emitting pattern notified by the light-emitting control unit 17" stored in the device itself. In response to this notification, the owned device 20 may also terminate light emission in the notified light-emitting pattern.

[0095] On the other hand, if the authentication process fails (No in S401), the information processing device 10 performs error processing (S403). For example, as the error processing, the information processing device 10 outputs information indicating that the authentication process failed via an output device installed at the exit of the management area.

[0096] <Effects> According to the information processing device 10 of the second embodiment, the same effects as those of the information processing device 10 of the first embodiment are achieved.

[0097] The information processing device 10 also determines a light emission pattern for each worker, associates the light emission pattern with each worker, and registers the light emission pattern in the storage unit 15. The information processing device 10 then causes the personal device 20 carried by each worker to emit light in the light emission pattern of each worker. The information processing device 10 then detects light emission in the predetermined light emission pattern from within the image, thereby detecting the worker from within the image.

[0098] Various authentication methods, such as face recognition and gait recognition, can be used to detect each worker from an image. However, these methods reduce the accuracy of worker detection if the face or body is not clearly visible in the image. Furthermore, detection accuracy can be even worse when the surroundings are dark, such as on a bad weather day or at night. By detecting workers using a lighting pattern determined for each worker, as in the information processing device 10, it is possible to detect workers with high accuracy.

[0099] Furthermore, the information processing device 10 can determine different light emission patterns for each worker. According to such an information processing device 10, each light emission pattern can be used as identification information for each worker.

[0100] Furthermore, when determining the light emission pattern for each worker, the information processing device 10 can determine and register a light emission pattern that is not associated with any worker as the light emission pattern for that worker. With this information processing device 10, it is possible to determine different light emission patterns for each worker.

[0101] Furthermore, the information processing device 10 can associate and register a lighting pattern with a worker when the worker enters a controlled area, and dissolve the association when the worker leaves the controlled area. The workers working in the controlled area may vary from day to day. Therefore, the total number of workers working in the controlled area may be large. Preparing lighting patterns corresponding to each of these many workers requires a lot of effort. Meanwhile, the number of workers working simultaneously within a limited period, such as a day or half a day, is somewhat limited. In the case of an information processing device 10 that associates and registers a lighting pattern with a worker when the worker enters a controlled area and dissolves the association when the worker leaves the controlled area, a single lighting pattern can be shared among multiple workers. In this case, it is sufficient to prepare lighting patterns equivalent to the number of workers working simultaneously in the controlled area. Such an information processing device 10 can reduce the effort required to prepare multiple lighting patterns.

[0102] Furthermore, the information processing system 1 having the information processing device 10 and the portable device 20 linked to the information processing device 10 can achieve the above-described effects.

[0103] <<Third Embodiment>> An information processing apparatus 10 according to a third embodiment has a function of generating reference information based on information input by a user and storing the reference information in a storage unit 15. This will be described in detail below.

[0104] 9 shows an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 has an image acquisition unit 11, an image analysis unit 12, a determination unit 13, a creation unit 14, a storage unit 15, a registration unit 16, a light emission control unit 17, and an authentication unit 18. Note that the information processing device 10 does not necessarily have to have the storage unit 15. In this case, an external device configured to be able to communicate with the information processing device 10 has the storage unit 15.

[0105] The creating unit 14 creates reference information from the input work schedule information, and stores the created reference information in the storage unit 15.

[0106] The work schedule information is information that is created in advance by a person and input into the information processing device 10. The work schedule information includes information regarding the predetermined work of each worker. For example, the work schedule information indicates at least one of the work area of ​​each worker (such as an assigned work area or an authorized work area) and the work content (such as an assigned work content or authorized work content). The work schedule information may be information on a daily basis, a half-day basis, a weekly basis, or other basis.

[0107] The creation unit 14 can create reference information from work schedule information by adopting any one of the following first to third creation examples.

[0108] First Creation Example In this example, the work schedule information indicates both the work content and work area of ​​each worker. The creation unit 14 identifies the work content and work area of ​​each worker based on the work schedule information. The creation unit 14 then creates reference information by linking the identified work content and work area of ​​each worker to the worker identification information of each worker and registering them.

[0109] Second Creation Example In this example, the work schedule information indicates the work content of each worker, but does not indicate the work area. The creation unit 14 identifies the work content of each worker based on the work schedule information. Then, the creation unit 14 identifies the work area of ​​each worker based on the identified work content. For example, information indicating the work area where each work content will be performed is stored in advance in the storage unit 15. The creation unit 14 identifies the work area where the identified work content will be performed based on the information.

[0110] The creation unit 14 then creates reference information by linking the work content and work area of ​​each identified worker to the worker identification information of each worker and registering the work content and work area of ​​each identified worker.

[0111] In this example, the work schedule information indicates the work content and qualifications of each worker. The qualifications are related to the work to be performed in the controlled area, such as, but not limited to, a license to handle hazardous materials or a license to operate heavy machinery.

[0112] The creation unit 14 identifies the work content of each worker based on the work schedule information. The creation unit 14 also identifies the qualifications of each worker based on the work schedule information. Next, the creation unit 14 determines whether the work content of each worker indicated in the work schedule information and the qualifications of each worker satisfy predetermined conditions.

[0113] Information indicating the qualifications required to perform each work content is stored in advance in the storage unit 15. The predetermined condition is "having the qualifications to perform each work content." The creation unit 14 determines whether the predetermined condition is met based on the information stored in the storage unit 15 and the work content and qualifications of each worker.

[0114] If a predetermined condition is met, the creation unit 14 creates reference information by linking the work content of each worker indicated in the work schedule information to the worker identification information of each worker and registering it. Also, if a predetermined condition is met, the creation unit 14 creates reference information by identifying the work area of ​​each worker using the method of the first creation example or the second creation example, and linking the identified work area to the worker identification information of each worker and registering it.

[0115] On the other hand, if the predetermined conditions are not met, the creation unit 14 does not register the work content and work area of ​​each worker indicated by the work schedule information as reference information. In this case, the creation unit 14 can perform error processing. For example, as error processing, the creation unit 14 can output error information via an output device of the information processing device 10 or transmit the error information to a predetermined device registered in advance. The error information can indicate the content in the work schedule information that does not meet the above-mentioned predetermined conditions.

[0116] As a variation of the third creation example, the qualifications of each worker may be stored in advance in the storage unit 15. The work schedule information does not need to indicate the qualifications of each worker. In this case, the creation unit 14 refers to the storage unit 15 to identify the qualifications of each worker.

[0117] Other configurations of the information processing system 1 of the third embodiment are similar to the configurations of the information processing system 1 of the first or second embodiment. Also, other configurations of the information processing device 10 of the third embodiment are similar to the configurations of the information processing device 10 of the first or second embodiment. Also, the configuration of the owned device 20 of the third embodiment is similar to the configuration of the owned device 20 of the first or second embodiment.

[0118] According to the information processing device 10 of the third embodiment, the same effects as those of the information processing device 10 of the first and second embodiments are realized.

[0119] Furthermore, the information processing device 10 of the third embodiment creates reference information from input work schedule information. According to the information processing device 10 of the third embodiment, it is possible to reduce the labor required to manually create reference information.

[0120] For example, the information processing device 10 can create reference information by determining a work area based on the work content indicated in the work schedule information. In this way, when the information processing device 10 automatically creates part of the reference information, the amount of information included in the work schedule information can be reduced. As a result, the effort required to manually create work schedule information can be reduced.

[0121] Furthermore, the information processing device 10 can determine the appropriateness of each worker's work from the perspective of qualifications, based on the worker's qualifications and the work content of the worker indicated in the work schedule information. If the information processing device 10 determines that the work content is appropriate, it creates reference information linking the worker to the work content, and if it determines that the work content is inappropriate, it can perform error processing. This information processing device 10 can detect problems such as a worker being permitted (assigned) to work content that is inappropriate from the perspective of qualifications. As a result, it is expected that accidents and the like can be prevented before they occur.

[0122] Furthermore, the information processing system 1 having the information processing device 10 and the portable device 20 linked to the information processing device 10 achieve the above-described effects.

[0123] <<Fourth Embodiment>> The owned device 20 of the fourth embodiment has a function of setting the light-emitting state to an error state when the worker does not hold the owned device 20 in a predetermined manner. The information processing device 10 of the fourth embodiment has a function of detecting the owned device 20 (worker) whose light-emitting state is in an error state through image analysis. This will be described in detail below.

[0124] The worn device 20 has a control unit that monitors whether the worker is holding the worn device 20 in a predetermined manner. The predetermined manner is, for example, a manner in which the wearable device is worn in the intended correct way.

[0125] The control unit of the owned device 20 has a function of detecting that the worker is not holding the owned device 20 in a predetermined manner. This detection can be achieved using any widely known technology. For example, various sensors can be used. When the worker is wearing the owned device 20 in the correct way, pressure greater than a reference value may be applied to a predetermined part of the owned device 20. Therefore, the pressure at that predetermined part of the owned device 20 may be measured using a pressure sensor or the like. Then, the control unit of the owned device 20 may determine that the worker is not holding the owned device 20 in a predetermined manner if the measured pressure is less than the reference value.

[0126] Alternatively, a physical button may be provided at a predetermined portion of the owned device 20 where the pressure is applied. In this case, the physical button will be in a pressed state when the worker is holding the owned device 20 in a predetermined manner. On the other hand, the physical button will be in a not-pressed state when the worker is not holding the owned device 20 in a predetermined manner. The control unit of the owned device 20 may determine whether the worker is holding the owned device 20 in a predetermined manner based on the pressed state of the physical button.

[0127] The illustration here is merely an example, and the control unit of the owned device 20 may use other methods to detect that the worker is not holding the owned device 20 in a predetermined manner. Other examples will be described in the examples described later.

[0128] The control unit of the owned device 20 controls the light-emitting state of the light-emitting unit included in the owned device 20. The control unit of the owned device 20 causes the light-emitting unit to emit light in the light-emitting pattern notified by the information processing device 10. When the control unit of the owned device 20 detects that the worker is not holding the owned device 20 in a predetermined manner, it sets the light-emitting state of the light-emitting unit to an error state.

[0129] The error state may be, for example, a state in which no light is emitted or a state in which light is emitted in an error light pattern. Note that the error light pattern is a light pattern exclusively used in an error state and is not assigned to an operator as a light pattern for the operator.

[0130] The control unit of the owned device 20 may cause the light-emitting unit to alternately and repeatedly emit light in the light-emitting pattern notified by the information processing device 10 and indicate an error state. In this way, notification of both information for identifying the worker and an error state can be realized.

[0131] If the owned device 20 has multiple light-emitting units, the control unit of the owned device 20 may cause one light-emitting unit to emit light in the light-emitting pattern notified by the information processing device 10, and may set the light-emitting state of the other light-emitting units to an error state. In this way, notification of both information for identifying the worker and an error state can be realized.

[0132] The image analysis unit 12 of the information processing device 10 detects a owned device 20 whose light emission state is in an error state from the image acquired by the image acquisition unit 11. Note that if the error state is a state in which no light is emitted, the image analysis unit 12 can detect a owned device 20 in an error state by detecting the owned device 20 in the image based on the feature amounts of the appearance of the owned device 20 and determining whether each owned device 20 is emitting light in a predetermined light emission pattern. Detection of the owned device 20 in the image can be achieved, for example, by using a classifier generated by machine learning, feature point matching, or the like.

[0133] Then, when a owned device 20 in an error light emission state is detected, the image analysis unit 12 performs error processing. For example, the image analysis unit 12 can issue an error notification as the error processing. For example, the image analysis unit 12 may cause an output device included in the information processing device 10 to output error information. Alternatively, the image analysis unit 12 may send the error information to a predetermined terminal device to output the error information. The predetermined terminal device may be, for example, a terminal device for the administrator of the management area, but is not limited to this.

[0134] The error information includes information about the worker who is determined not to be holding the personal device 20 in a predetermined manner. For example, the error information may include the worker's worker identification information and an image of the worker. The image of the worker may include a facial image of the worker that is stored in advance in the storage unit 15. The image of the worker may also include an image captured of a scene in which the worker is not holding the personal device 20 in a predetermined manner. The image captured of a scene in which the worker is not holding the personal device 20 in a predetermined manner is an image in which the personal device 20 whose light-emitting state is in an error state is detected.

[0135] Other configurations of the information processing system 1 of the fourth embodiment are similar to the configurations of the information processing systems 1 of the first to third embodiments. Also, other configurations of the information processing device 10 of the fourth embodiment are similar to the configurations of the information processing device 10 of the first to third embodiments. Also, other configurations of the owned device 20 of the fourth embodiment are similar to the configurations of the owned device 20 of the first to third embodiments.

[0136] According to the information processing device 10 of the fourth embodiment, the same effects as those of the information processing devices 10 of the first to third embodiments are realized.

[0137] Furthermore, the owned device 20 of the fourth embodiment can set the light emission state to an error state in addition to emitting light in the light emission pattern notified by the information processing device 10. The error state is a state different from the light emission in the light emission pattern notified by the information processing device 10, such as a state in which no light is emitted or a state in which light is emitted in an error light emission pattern. With such a owned device 20, in addition to notifying the worker of information identifying the worker, the light emission state can be used to notify the worker of an error state.

[0138] Furthermore, the owned device 20 can change the light-emitting state to an error state in response to detecting that the worker is not holding the owned device 20 in a predetermined manner. With such a owned device 20, the light-emitting state can notify the worker that the worker is not holding the owned device 20 in a predetermined manner.

[0139] Furthermore, the information processing device 10 of the fourth embodiment can detect, through image analysis, a owned device 20 (worker) whose light emission state is in an error state. With this information processing device 10, it is possible to accurately detect, through image analysis, that the worker is not holding the owned device 20 in a predetermined manner.

[0140] <<Fifth Embodiment>> An information processing apparatus 10 according to a fifth embodiment has a function of detecting, from an image, a worker whose portable device 20 is not emitting light. This will be described in detail below.

[0141] The image analysis unit 12 detects people from the images acquired by the image acquisition unit 11. The image analysis unit 12 can detect people from the images using any well-known technology. Next, the image analysis unit 12 identifies which worker each of the detected people is based on the light emission pattern of the portable device 20 carried by each of the detected people.

[0142] The determination unit 13 performs error processing when the detected persons include a person whose worker association has not been identified. A person who is detected in the image but whose worker association has not been identified is a worker whose portable device 20 does not emit light in a predetermined light emission pattern. The determination unit 13 performs error processing when such a person is detected in the image.

[0143] For example, as an error processing, the determination unit 13 may perform a process of identifying which worker (error target) is the person whose owned device 20 is not emitting light. The determination unit 13 can extract, as the error target, a worker who is not detected from among the images of the workers included in the reference information. As described in the second embodiment, the reference information indicates workers who are scheduled to work in the management area. It is considered that a worker who is not detected from among the images of the workers included in such reference information does not emit light from the owned device 20 in a predetermined light emission pattern.

[0144] As a more specific example, when there is a person detected in an image whose identity has not been identified, the determination unit 13 can identify which worker (error target) that person is, based on images acquired during a predetermined confirmation time. That is, the determination unit 13 can extract, as an error target, a worker who has not been detected in images acquired during a predetermined confirmation time among the workers included in the reference information.

[0145] The length of the predetermined confirmation time is a predetermined value and can be determined depending on the size of the management area, the number of workers, etc.

[0146] The images acquired during the predetermined confirmation time are preferably images acquired in a time period close to the time when it was detected that a person whose identity has not been identified was present among the detected persons. For example, the images acquired during the predetermined confirmation time may be images acquired at the time of the detection and in a time period including both before and after the detection. Alternatively, the images acquired during the predetermined confirmation time may be images acquired at the time of the detection and in a time period including both before the detection. Alternatively, the images may be images acquired at the time of the detection and in a time period including both after the detection. Alternatively, the images may be images acquired in a time period before the detection. Alternatively, the images may be images acquired in a time period after the detection.

[0147] By narrowing down the images to be processed in this way to "images acquired in a time period close to the time when it was detected that a person whose worker identity has not been identified was present among the detected people," it is possible to identify the error target based on the situation in the time period close to the time of the detection. There may be a owned device 20 that was not emitting light in a predetermined light pattern several hours ago but is now emitting light in the predetermined light pattern. There may also be a owned device 20 that was emitting light in a predetermined light pattern several hours ago but is no longer emitting light in the predetermined light pattern. By narrowing down the images to be processed in this way, past situations can be eliminated and the error target can be identified based on the situation in the desired time period. As a result, the accuracy of identifying the error target is improved.

[0148] Furthermore, the determination unit 13 may perform error notification as error processing. For example, the determination unit 13 may cause an output device included in the information processing device 10 to output error information. Furthermore, the determination unit 13 may send the error information to a predetermined terminal device and cause it to output the error information. The predetermined terminal device may be, for example, a terminal device for a manager of the management area, but is not limited to this.

[0149] The error information includes information about the worker whose owned device 20 is determined not to be emitting light. For example, the error information may include the worker's worker identification information and an image of the worker. The image of the worker may include a facial image of the worker that is stored in advance in the storage unit 15. The image of the worker may also include an image of the worker captured with the owned device 20 not emitting light. The image of the worker captured with the owned device 20 not emitting light is an image of the worker detected with the owned device 20 not emitting light.

[0150] Other configurations of the information processing system 1 of the fifth embodiment are similar to the configurations of the information processing systems 1 of the first to fourth embodiments. Also, other configurations of the information processing device 10 of the fifth embodiment are similar to the configurations of the information processing device 10 of the first to fourth embodiments. Also, the configuration of the owned device 20 of the fifth embodiment is similar to the configuration of the owned device 20 of the first to fourth embodiments.

[0151] According to the information processing device 10 of the fifth embodiment, the same effects as those of the information processing devices 10 of the first to fourth embodiments are realized.

[0152] Furthermore, the information processing device 10 of the fifth embodiment detects a person from an image and then identifies which worker the detected person is based on the light emission pattern of the owned device 20. The information processing device 10 can then perform error processing if there is a person among the people detected from the image whose worker has not been identified. Such a person is a worker whose owned device 20 does not emit light in a predetermined light emission pattern. In other words, the information processing device 10 can perform error processing in response to the detection of a worker whose owned device 20 does not emit light in a predetermined light emission pattern.

[0153] Furthermore, the information processing device 10 can identify a worker who is not detected in the image among the "workers who are scheduled to work in the management area" indicated by the reference information as a worker whose owned device 20 does not emit light in a predetermined light emission pattern. In this way, the information processing device 10 can not only detect a person whose owned device 20 does not emit light in a predetermined light emission pattern from an image, but also identify that worker.

[0154] Furthermore, the information processing device 10 can identify, among the "workers scheduled to work in the controlled area" indicated by the reference information, workers who are not detected in the images acquired during the confirmation time as workers whose owned devices 20 do not emit light in the specified light emission pattern. By limiting the images to be processed in this way, it is possible to exclude, for example, past situations and identify workers whose owned devices 20 do not emit light in the specified light emission pattern based on the situation during a desired time period. As a result, the accuracy of identification is improved.

[0155] <<Modifications>> Modifications applicable to the first to fifth embodiments will be described below. These modifications also achieve the same effects as the first to fifth embodiments.

[0156] <First Modification> In the first modification, each owned device 20 has a unique light emission pattern in advance. Each owned device 20 emits light in its unique light emission pattern. The light emission pattern unique to each owned device 20 is different from the light emission patterns unique to other owned devices 20. This unique light emission pattern for each owned device 20 can be used as identification information for each owned device 20.

[0157] When entering a controlled area, a worker who has been successfully authenticated inputs the light emission pattern of the personal device 20 that he or she owns into the information processing device 10. For example, a worker who has been successfully authenticated puts his or her personal device 20 into a state in which it can communicate with the information processing device 10. The worker may perform an operation of touching or bringing his or her personal device 20 into proximity with a reader / writer of the information processing device 10. Alternatively, when a worker carrying the personal device 20 approaches a predetermined position such as an entrance / exit gate, the personal device 20 and the information processing device 10 may become capable of communicating with each other. When the personal device 20 and the information processing device 10 become capable of communicating with each other, the personal device 20 notifies the information processing device 10 of its light emission pattern.

[0158] Based on the notification, the registration unit 16 identifies a light emission pattern unique to the personal device 20 owned by each worker. Then, the registration unit 16 associates the identified light emission pattern with the worker (worker identification information) identified in the authentication process and registers it in the storage unit 15.

[0159] According to the first modified example, even if a unique light emission pattern is preliminarily set for each owned device 20, the same effects as those of the first to fifth embodiments can be achieved.

[0160] <Second Modification> In the second modification, a lighting pattern specific to a work area is used instead of a lighting pattern specific to a worker.

[0161] That is, in the second modified example, the registration unit 16 identifies the work area (assigned work area, permitted work area) of each worker who has been successfully authenticated, based on the reference information stored in the storage unit 15. Next, the registration unit 16 determines a light emission pattern corresponding to the identified work area for each worker. The registration unit 16 then associates the determined light emission pattern with the worker (worker identification information) identified in the authentication process and registers it in the storage unit 15.

[0162] The light emission control unit 17 notifies the owned device 20 of the light emission pattern carried by the worker who has been successfully authenticated. Then, the light emission control unit 17 causes the owned device 20 to emit light in the light emission pattern.

[0163] In the second variant, the image analysis unit 12 can identify the work area (assigned work area, permitted work area) of each person detected from the image based on the light emission pattern of the possessed device 20.

[0164] Then, the determination unit 13 determines whether the work area in which the person was detected (the work area in which the person is actually present) matches the work area of ​​the person identified based on the light emission pattern of the possessed device 20 (the assigned work area, the permitted work area). If they do not match, the determination unit 13 performs error processing.

[0165] According to the second modified example, it is possible to monitor, by image analysis, whether a worker is working in a predetermined work area.

[0166] <Third Modification> In the third modification, a light emitting pattern specific to the work content is used, rather than a light emitting pattern specific to the worker.

[0167] That is, in the third modified example, the registration unit 16 identifies the work content (assigned work content, permitted work content) of each worker who has been successfully authenticated, based on the reference information stored in the storage unit 15. Next, the registration unit 16 determines a light emission pattern corresponding to the identified work content for each worker. The registration unit 16 then associates the determined light emission pattern with the worker (worker identification information) identified in the authentication process and registers it in the storage unit 15.

[0168] The light emission control unit 17 notifies the owned device 20 of the light emission pattern carried by the worker who has been successfully authenticated. Then, the light emission control unit 17 causes the owned device 20 to emit light in the light emission pattern.

[0169] In the third variant, the image analysis unit 12 can identify the work content (assigned work content, permitted work content) of each person detected from the image based on the light emission pattern of the possessed device 20.

[0170] Then, the determination unit 13 determines whether the work content of the person identified by the image analysis (the work content that the person is actually performing) matches the work content of the person identified based on the light emission pattern of the possessed device 20 (the work content that the person has assigned or is permitted to perform). If they do not match, the determination unit 13 performs error processing.

[0171] According to the third modified example, it is possible to monitor whether the worker is performing the specified work by image analysis.

[0172] <<Example>> Next, a description will be given of an example of the information processing device 10. Note that the example of the information processing device 10 described here is merely an example, and the information processing device 10 is not limited to this example.

[0173] In this embodiment, the information processing device 10 is used at a work site such as a construction site or building site. At work sites such as construction sites or building sites, workers from multiple companies enter and exit the site at irregular intervals. This makes it difficult to monitor whether each worker is performing a predetermined action. By using the information processing device 10, it is possible to monitor whether each worker is performing a predetermined action even in such situations.

[0174] "Preprocessing" First, work schedule information as shown in FIG.

[0175] The work schedule information in FIG. 10 includes process information and information entered by the contracted company.

[0176] The process information is information created by a company that manages a work site, and includes information about the work to be performed at the work site.

[0177] "Process" is information that identifies multiple processes. "Work content 1" indicates the content of the work performed in each process. "Work content 2" indicates the content of the work that is a subdivision of the work indicated in work content 1. Specific examples of work content 2 include, but are not limited to, crawler crane work and concrete mixer truck work. "Required qualifications" indicates the qualifications required to perform the work indicated in work content 2. "Work start date" indicates the date on which the work indicated in work content 2 will begin. "Work end date" indicates the date on which the work indicated in work content 2 will end. "Work location" indicates the location where the work indicated in work content 2 will be performed. The work location is synonymous with the work area described in the above embodiment. "Work company" indicates the company in charge of the work indicated in work content 2.

[0178] The contracted company information is information prepared by the company in charge of each task, and includes information about the worker in charge of each task.

[0179] "Work start date" indicates the date on which the worker will start working on the work indicated in work content 2. "Work end date" indicates the date on which the worker will end working on the work indicated in work content 2. "Worker" indicates the name of the worker in charge of the work indicated in work content 2. "Acquired qualification information" indicates the qualifications acquired by the worker in charge of the work indicated in work content 2. "Personal identification information" is information used to authenticate the worker in charge of the work indicated in work content 2. Personal identification information is synonymous with the authentication information described in the above embodiment.

[0180] The information processing device 10 generates reference information as shown in Fig. 11 based on the work schedule information as shown in Fig. 10. Then, the information processing device 10 stores the generated reference information in the storage unit 15.

[0181] The reference information indicates, for each worker, information about the work that each worker is responsible for.

[0182] The "company name, name, personal information" column of the reference information records a combination of information from the "work company," "worker," and "personal identification information" columns of the work schedule information.

[0183] The information processing device 10 refers to the work schedule information for each combination recorded in the "company name, name, personal information" column, and identifies the process and work content 2 for which each worker is responsible. Then, the information processing device 10 records the identified content in the "process" and "work content 2" columns of the reference information.

[0184] Furthermore, the information processing device 10 refers to the work schedule information and identifies the work location and required qualifications for each work content 2. Then, the information processing device 10 records the identified content in the "work location" and "required qualifications" columns of the reference information.

[0185] Furthermore, the information processing device 10 refers to the work schedule information and identifies the dates on which each worker will start and finish their work on each work content 2. The information processing device 10 then records the identified content in the "Work Start Date" and "Work End Date" columns of the reference information.

[0186] Furthermore, the information processing device 10 refers to the work schedule information to identify the qualifications acquired by each worker, and then records the identified details in the "acquired qualification information" field of the reference information.

[0187] Information is written into the "Entry / Exit Confirmation," "Status Permission Area," "Status Action," "Status Identity Verification," and "Light Emitting Pattern" columns shown in Figure 11 on the day of the work. These columns will be described later.

[0188] The work site will be staffed by workers from multiple contract companies under contract with the parent company. The parent company will create work schedule information (Figure 10) that lists the work content and dates for the work site and distribute it to the contract companies. When distributed to the contract companies, only the process information in Figure 10 is included.

[0189] The contracting company checks the distributed work schedule information (Figure 10) and selects workers for the work it will be responsible for. The contracting company selects appropriate workers, taking into consideration the work period, necessary qualifications, etc. The contracting company then fills in the necessary information in the contracting company information form and submits it to the parent company.

[0190] When the parent company receives the work schedule information (FIG. 10) from all the contracted companies, with the contracted company information filled in, it performs necessary work such as confirmation work and then registers the content in the information processing device 10.

[0191] "Processing when a worker enters a managed area" When a worker arrives at a work site, he or she applies for entry at the entrance / exit gate. For example, the worker enters authentication information at the entrance / exit gate. In response, the information processing device 10 performs authentication processing based on the work schedule information and reference information stored in the storage unit 15 in preprocessing. In one example, the information processing device 10 identifies the worker in charge of the work for that day based on the "work start date" and "work end date" indicated in the work schedule information and reference information. The information processing device 10 then compares the authentication information entered in the "personal information" with the authentication information of the worker in charge of the work for that day to confirm whether the worker who entered the authentication information is registered as the worker in charge of the work for that day. If the worker who entered the authentication information is registered as the worker in charge of the work for that day, the authentication processing is successful. On the other hand, if the worker who entered the authentication information is not registered as the worker in charge of the work for that day, the authentication processing is unsuccessful.

[0192] If the authentication process is successful, the information processing device 10 updates the reference information in Fig. 11. Specifically, the information processing device 10 records the entry time in the "entry / exit confirmation" field for the worker identified in the authentication process.

[0193] On the other hand, if the authentication process fails, the information processing device 10 performs error processing. For example, the information processing device 10 causes an output device installed at the entrance / exit gate to output information indicating that the authentication process has failed.

[0194] Furthermore, if the authentication process is successful, the information processing device 10 determines the light emission pattern to be assigned to the worker who has succeeded in the authentication process. The "light emission pattern" column in FIG. 11 records identification information of the light emission pattern assigned to each worker. The information processing device 10 references this information and identifies a light emission pattern that has not been assigned to any worker at that time. The information processing device 10 then determines the identified light emission pattern as the light emission pattern to be newly assigned to the worker who has succeeded in the authentication process. The information processing device 10 updates the reference information in FIG. 11 in accordance with this determination. Specifically, the information processing device 10 records identification information of the light emission pattern assigned to the worker who has succeeded in the authentication process in the "light emission pattern" column of that worker.

[0195] Furthermore, if the authentication process is successful, the information processing device 10 displays information on a screen that can be confirmed by the site manager, urging the worker to lend the device 20. For example, a message saying "Worker wears helmet" is displayed on the screen. In response to the information, the site manager lends the device 20 to the worker who has succeeded in the authentication process.

[0196] Here, the portable device 20 of the embodiment will be described with reference to FIGS.

[0197] 12, the portable device 20 is a helmet-type device. The helmet is provided with a light emitting unit 21, a control unit 22, and a detection unit 23.

[0198] The light emitting unit 21 is, for example, a light. The light emitting unit 21 emits light in a predetermined light emitting pattern under the control of the control unit 22.

[0199] The detection unit 23 is configured to detect whether the worker is not holding the handheld device 20 in a predetermined manner. In the embodiment, the detection unit 23 detects whether the worker is not wearing a helmet.

[0200] FIG. 13 shows the configuration of the detection unit 23 . The detection unit 23 has an attachment unit 231 , a peeling unit 232 , and a conducting wire 233 .

[0201] An adhesive is applied to the surfaces of the affixing portion 231 and the peeling portion 232. Therefore, the detection unit 23 can be attached to a predetermined position by bringing the affixing portion 231 and the peeling portion 232 into contact with a predetermined position. While wearing the helmet, the worker brings the affixing portion 231 and the peeling portion 232 into contact with a predetermined position on their body (e.g., an earlobe) to attach the detection unit 23. The detection unit 23 is attached to a position where the helmet cannot be removed unless the detection unit 23 is peeled off from the predetermined position on the body. Furthermore, the support member (such as a string) that supports the detection unit 23 has a length such that the helmet cannot be removed without peeling off the detection unit 23 from the predetermined position on the body.

[0202] The conductor 233 extends across the attached portion 231 and the peelable portion 232. In the initial state, the conductor 233 is conductive. However, once the detection unit 23 is attached to a predetermined position, the attached portion 231 and the peelable portion 232 are separated. As a result, the conductor 233 is broken.

[0203] The configuration for achieving this disconnection is not particularly limited, and various techniques can be adopted. For example, this can be achieved by designing the force required to peel the affixing portion 231 from the peeling portion 232 to be smaller than the force required to peel the peeling portion 232 from the predetermined position. In this way, when the detection unit 23 is peeled off from the predetermined position, the peeling portion 232 remains in place, and only the affixing portion 231 is peeled off.

[0204] The control unit 22 communicates with the information processing device 10 and receives notification of a light emission pattern, etc. A plurality of light emission patterns are registered in advance in the control unit 22. The control unit 22 controls the light emission unit 21 to emit light in a predetermined light emission pattern. For example, the control unit 22 can cause the light emission unit 21 to emit light in a light emission pattern notified by the information processing device 10. The control unit 22 can also set the light emission state of the light emission unit 21 to an error state.

[0205] Furthermore, the control unit 22 monitors whether the conductor 233 is conductive or disconnected. Then, in response to detection that the conductor 233 is disconnected, the control unit 22 determines that the worker has taken off the helmet, i.e., that the worker is not holding the portable device 20 in a predetermined manner. Then, in response to this determination, the control unit 22 sets the light-emitting state of the light-emitting unit 21 to an error state.

[0206] After receiving the helmet as described above, the worker puts on the helmet and then attaches the detection unit 23 to a predetermined position on their body (for example, an earlobe). Then, the worker heads to the entrance / exit gate.

[0207] The entrance / exit gate is configured to perform short-range wireless communication with a nearby possessed device 20. When the possessed device 20 approaches the entrance / exit gate, the information processing device 10 notifies the possessed device 20 of the light emission pattern assigned to the worker who has succeeded in the authentication process by short-range wireless communication via the entrance / exit gate.

[0208] The control unit 22 stores the notified light emission pattern in a storage device. Then, after confirming that the light emission unit 21 is operating normally, the control unit 22 notifies the information processing device 10 via the entrance / exit gate that the processing has ended normally. Then, the control unit 22 causes the light emission unit 21 to start emitting light in the notified light emission pattern.

[0209] 11 in response to the "notification that the process has been completed successfully" from the owned device 20. Specifically, the information processing device 10 records "normal" in the "status permission area" and "status action" fields of the worker identified in the authentication process.

[0210] "Status permitted area" indicates the result of a determination as to whether the worker's work area identified by image analysis matches the worker's work area (assigned work area or permitted work area) indicated in the reference information.

[0211] "Status behavior" indicates the result of a determination as to whether the work content of the worker identified by image analysis matches the work content of the worker indicated in the reference information (assigned work content or permitted work content).

[0212] At the time of entry, these fields are recorded as "normal." These are then updated as appropriate in the "Processing when a worker is working in a controlled area" section described below.

[0213] After completing the above process, the information processing device 10 causes the entrance / exit gate to open. This allows the worker to enter the work site. After completing the above process, the information processing device 10 may also display information indicating that the worker is permitted to enter on a screen that can be confirmed by the work site manager. For example, a message saying "Entry OK" may be displayed on the screen.

[0214] "Processing When a Worker is Working in a Control Area" The information processing device 10 can perform the processing shown in the flowchart of FIG.

[0215] First, the information processing device 10 sets the identity check to "invalid" (S500). The identity check is normally set to "invalid." If a person is detected in the image but the worker's identity has not yet been identified, the identity check is rewritten to "valid." This rewriting process will be described later.

[0216] Next, the information processing device 10 acquires an image taken at the work site and detects people from the image (S501). Next, the information processing device 10 determines whether or not there is a person among the people detected in S501 whose portable device 20 is not detected to be emitting light (S502).

[0217] If there is no person among the people detected in S501 whose portable device 20 is not detected to be emitting light (No in S502), the information processing device 10 proceeds to S503.

[0218] In S503, the information processing device 10 identifies the worker based on the light emission pattern of the owned device 20. Specifically, the information processing device 10 selects one person as a processing target from among the people detected in the image. Then, the information processing device 10 identifies which worker the person is based on the light emission pattern of the owned device 20 of the selected person.

[0219] Next, the information processing device 10 checks whether the identity check is "invalid" (S504).

[0220] If the identity check is "invalid" (Yes in S504), the information processing device 10 determines whether the identified worker is performing a predetermined task (S510).

[0221] That is, the information processing device 10 identifies the work area where the worker is working based on the image. Next, the information processing device 10 compares the identified work area with the work area of ​​the worker indicated in the reference information to determine whether the worker is working in the work area indicated in the reference information. Then, the information processing device 10 updates the reference information in FIG. 11 based on the determination result.

[0222] Specifically, when the information processing device 10 determines that the worker is working in the work area indicated by the reference information, it records "normal" in the "status permitted area" field for that worker. On the other hand, when the information processing device 10 determines that the worker is not working in the work area indicated by the reference information, it records "abnormal" in the "status permitted area" field for that worker.

[0223] The information processing device 10 also identifies the work being performed by the worker based on the image. The information processing device 10 then compares the identified work with the work performed by the worker indicated in the reference information to determine whether the worker is performing the work indicated in the reference information. The information processing device 10 then updates the reference information in FIG. 11 based on the determination result.

[0224] Specifically, if the information processing device 10 determines that the worker is performing the work content indicated in the reference information, it records "normal" in the "status action" field for that worker. On the other hand, if the information processing device 10 determines that the worker is not performing the work content indicated in the reference information, it records "abnormal" in the "status action" field for that worker.

[0225] In S517 after S510, the information processing device 10 determines whether another person has been detected from the image. If another person has been detected from the image (Yes in S517), the information processing device 10 returns to S503, selects one of the other people as a new processing target, and repeats the same processing.

[0226] On the other hand, if no other person is detected from the image (No in S517), and if there is no instruction to end the process (No in S518), the information processing device 10 returns to S501, acquires a new image, and repeats the same process.

[0227] Furthermore, if there is a person among the people detected in S501 whose possessed device 20 cannot be detected as emitting light (Yes in S502), the information processing device 10 checks whether the identity check is set to "invalid" (S505).

[0228] If the identity check is not "invalid" (No in S505), that is, if the identity check is "valid", the information processing apparatus 10 proceeds to S503.

[0229] On the other hand, if the identity check is "invalid" (Yes in S505), the information processing device 10 sets the identity check to "valid" (S506). Next, the information processing device 10 sets the identity check time to the current time (S507). Next, the information processing device 10 sets the identity check period to a predetermined confirmation time (S508).

[0230] Next, the information processing device 10 updates the reference information in Fig. 11 (S509). Specifically, the information processing device 10 sets all values ​​recorded in the "Personal Verification Status" column other than "Abnormal" to "Checking". Then, the information processing device 10 proceeds to S503.

[0231] The process of S503 is as described above. In S504 after S503, the information processing apparatus 10 checks whether the identity check is "invalid."

[0232] If the identity check is not "invalid" (No in S504), that is, if the identity check is "valid", the information processing apparatus 10 proceeds to S511.

[0233] In S511, the information processing device 10 calculates the elapsed time based on the identity check time set in S507 and the current time. Next, the information processing device 10 determines whether the elapsed time exceeds the identity check period (S512).

[0234] If the elapsed time does not exceed the identity check period (Yes in S512), the information processing device 10 sets "success" in the "identity verification status" field for the person identified in S503 (S513). Thereafter, the information processing device 10 proceeds to S510.

[0235] On the other hand, if the elapsed time exceeds the identity check period (No in S512), the information processing device 10 updates the reference information in Fig. 11 (S514). Specifically, the information processing device 10 changes the "Checking" remaining in the "Identity Verification Status" field at that time to "Abnormal."

[0236] Thereafter, the information processing device 10 sets the identity check to "invalid" (S515). Then, after the information processing device 10 issues an abnormality notification (S516), if there is no instruction to end the process (No in S518), the information processing device 10 returns to S501, acquires a new image, and repeats the same process.

[0237] In S516, the information processing device 10 may issue an error notification that causes an output device included in the information processing device 10 to output error information. Alternatively, the information processing device 10 may issue an error notification that causes a predetermined terminal device to output the error information. The predetermined terminal device may be, for example, a terminal device for a manager at a work site, but is not limited to this.

[0238] The error information includes information about the worker whose "Personal Identification Status" field is marked as "Abnormal." For example, the error information may include the worker's worker identification information and an image of the worker. The image of the worker may include a facial image of the worker that is stored in advance in the storage unit 15. The image of the worker may also include an image of the worker captured with the owned device 20 not emitting light. The image of the worker captured with the owned device 20 not emitting light is an image of the worker detected with the owned device 20 not emitting light.

[0239] "Processing when a worker leaves a controlled area" When a worker leaves a work site, he or she submits an exit request at the entrance / exit gate. For example, the worker inputs authentication information at the entrance / exit gate. In response, the information processing device 10 performs authentication processing based on the work schedule information and reference information stored in the storage unit 15 in preprocessing. In one example, the information processing device 10 identifies the worker in charge of the work for that day based on the "work start date" and "work end date" indicated in the work schedule information and reference information. The information processing device 10 then compares the input authentication information with the authentication information of the worker in charge of the work for that day to confirm whether the worker who input the authentication information is registered as the worker in charge of the work for that day. If the worker who input the authentication information is registered as the worker in charge of the work for that day, the authentication processing is successful. On the other hand, if the worker who input the authentication information is not registered as the worker in charge of the work for that day, the authentication processing is unsuccessful.

[0240] If the authentication process is successful, the information processing device 10 updates the reference information in Fig. 11. Specifically, the information processing device 10 records the exit time in the "entry / exit confirmation" field for the worker identified in the authentication process.

[0241] On the other hand, if the authentication process fails, the information processing device 10 performs error processing. For example, the information processing device 10 causes an output device installed at the entrance / exit gate to output information indicating that the authentication process has failed.

[0242] If the authentication process is successful, the worker heads to the entrance / exit gate. The information processing device 10 notifies the owned device 20, which is close to the entrance / exit gate, by short-range wireless communication via the entrance / exit gate to cancel the light-emitting pattern. In response to the notification, the control unit 22 of the owned device 20 erases the light-emitting pattern stored in the storage device. In response to the notification, the control unit 22 of the owned device 20 also stops light emission from the light-emitting unit 21.

[0243] After the above process is completed, the control unit 22 of the owned device 20 notifies the information processing device 10 via the entrance / exit gate that the process has been completed successfully. In response to the notification, the information processing device 10 updates the reference information in FIG. 11 . Specifically, the information processing device 10 erases the value in the "light emitting pattern" field for the worker identified in the authentication process. This cancels the association between the worker and the light emitting pattern.

[0244] After completing the above process, the information processing device 10 causes the entrance / exit gate to open, allowing the worker to exit the work site. After completing the above process, the information processing device 10 also displays information on a screen that can be viewed by the work site manager, prompting the worker to return the device 20. For example, a message saying "Worker puts on and takes off helmet" may be displayed on the screen. In response to this information, the work site manager requests the worker, who has successfully passed through the entrance / exit gate after the authentication process, to return the device 20.

[0245] The worker removes the detection unit 23 from his / her body, puts on and takes off the helmet (possessed device 20), and then returns the helmet (possessed device 20) to the manager.

[0246] Here, a modification of the embodiment will be described.

[0247] The work schedule information of FIG. 10 and the reference information of FIG. 11 may indicate the materials that can be brought in / out for each work content. Then, in S510, the information processing device 10 may detect that each worker is bringing in / out materials that are different from the materials that can be brought in / out indicated in the reference information. Then, when the information processing device 10 detects that a certain worker is bringing in / out materials that are different from the materials that can be brought in / out indicated in the reference information, it may record "abnormal" in the "status action" column of the worker in the reference information of FIG. 11. The information processing device 10 can identify the materials that a worker is bringing in / out using any well-known technology. For example, it may identify the materials that a worker is bringing in / out using a classifier generated by machine learning, feature point matching, or the like.

[0248] The work schedule information of FIG. 10 and the reference information of FIG. 11 may indicate the hazardous materials that each worker can handle (such as carrying in and out). Then, in S510, the information processing device 10 may detect that each worker is handling a hazardous material that is different from the hazardous material that each worker is allowed to handle indicated in the reference information. If the information processing device 10 detects that a certain worker is handling a hazardous material that is different from the hazardous material that each worker is allowed to handle indicated in the reference information, the information processing device 10 may record "abnormal" in the "status behavior" column of the worker in the reference information of FIG. 11. The information processing device 10 can identify the hazardous material that each worker is handling using any well-known technology. For example, the information processing device 10 may identify the hazardous material that each worker is handling using a classifier generated by machine learning, feature point matching, or the like.

[0249] The work schedule information of FIG. 10 and the reference information of FIG. 11 may indicate the heavy equipment that each worker can operate. Then, in S510, the information processing device 10 may detect that each worker is operating a heavy equipment different from the heavy equipment that each worker is capable of operating indicated in the reference information. When the information processing device 10 detects that a certain worker is operating a heavy equipment different from the heavy equipment that each worker is capable of operating indicated in the reference information, the information processing device 10 may record "abnormal" in the "status behavior" column of the worker in the reference information of FIG. 11. The information processing device 10 can identify the heavy equipment that each worker is operating using any well-known technology. For example, the information processing device 10 may identify the heavy equipment that each worker is operating using a classifier generated by machine learning, feature point matching, or the like.

[0250] In addition, in the preprocessing, the information processing device 10 may determine the work time for each task and register it in the reference information. The information processing device 10 may, for example, refer to information indicating the work time for each task in advance and identify the work time for each task. The work time indicated by this information may be a time determined by a person, or may be an estimated value of the required work time calculated by a computer using a predetermined calculation process.

[0251] The information processing device 10 may calculate the progress of work by image analysis as a process when a worker is working within a management area. The information processing device 10 may perform error processing if there is work that has not been completed (work that the worker is still performing) even after the work time indicated in the reference information has elapsed. The information processing device 10 may, for example, issue an error notification that causes an output device included in the information processing device 10 to output error information. The information processing device 10 may also issue an error notification that causes a specified terminal device to output error information. The specified terminal device may, for example, be a terminal device for a manager at the work site, but is not limited to this.

[0252] Although this disclosure has been described above with reference to the embodiments, this disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of this disclosure within the scope of this disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0253] In addition, in the flowcharts used in the above explanation, multiple steps (processes) are described in order. However, the order of the steps performed in each embodiment is not limited to the order described. In each embodiment, the order of the steps shown in the drawings can be changed to the extent that the content is not affected. Furthermore, the above-mentioned embodiments can be combined to the extent that the content is not contradictory.

[0254] Some or all of the above embodiments may be described as, but are not limited to, the following notes. 1. An information processing device having: an image acquisition means for acquiring an image including a first area; an image analysis means for identifying worker information from the image; and a determination means for comparing pre-registered reference information with the worker, work area, and work content included in the worker information, and determining whether the worker is performing a specified work. 2. The information processing device described in 1, further having a creation means for creating the reference information from input work schedule information. 3. The work schedule information indicates the work content of each of the workers, and the creation means determines a work area for each of the workers based on the work content of each of the workers indicated in the work schedule information, and registers the determined work area as the reference information. 4. 5. The information processing device according to any one of 1 to 4, further comprising: a registration means for determining a light emission pattern for each of the workers and registering the light emission pattern associated with each of the workers; and a light emission control means for causing a device carried by each of the workers to emit light in the light emission pattern for each of the workers; and the image analysis means for detecting light emission in the light emission pattern from within the image, thereby detecting the worker from within the image. 6. The information processing device according to 5, further comprising: a registration means for determining the light emission pattern, which is different for each of the workers. 7. The information processing device according to 5, further comprising: a registration means for identifying a work area for each of the workers based on the reference information; and a light emission pattern corresponding to the identified work area for each of the workers. 8. 6. The information processing device according to 5, wherein the registration means identifies the work content of each of the workers based on the reference information, and determines the light emission pattern corresponding to the identified work content for each of the workers.9. The information processing device according to any one of 5 to 8, further comprising authentication means for performing authentication processing on the worker when he / she enters a controlled area, wherein the registration means, when the worker is identified by the authentication processing at the time of entry, determines the light emitting pattern and registers the light emitting pattern in association with the worker identified by the authentication processing at the time of entry. 10. The information processing device according to 9, wherein, when the worker is identified by the authentication processing at the time of entry, the registration means registers the light emitting pattern that is not registered in association with any worker at that time in association with the worker identified by the authentication processing at the time of entry. 11. The information processing device according to 9 or 10, wherein the authentication means performs authentication processing on the worker when he / she leaves the controlled area, and when the worker is identified by the authentication processing at the time of exit, the registration means erases the light emitting pattern that was registered in association with the worker identified by the authentication processing at the time of exit. 12. 13. The information processing device of any one of 1 to 4, further comprising registration means for identifying a light emission pattern unique to a personal device carried by each of the workers and registering the pattern in association with each of the workers, wherein the image analysis means detects light emission in the light emission pattern from within the image and identifies the worker included in the image based on the detection result. 13. The information processing device of any one of 5 to 12, wherein the personal device sets the light emission state to an error state if the worker does not carry the personal device in a predetermined manner, and the image analysis means performs error processing when detecting a personal device in the image whose light emission state is in the error state. 14. The information processing device of 13, wherein the error state is a state in which no light is emitted or a state in which light is emitted in an error light emission pattern. 15. The information processing device of any one of 1 to 14, wherein the image analysis means detects people from within the image, and when a person who has not been identified as one of the workers is included in the reference information, extracts the worker not detected in the image from among the workers included in the reference information as an error target.16. The information processing device described in 15, wherein, if there is a person among the detected people for which the worker has not been identified, the determination means extracts the worker included in the reference information who has not been detected in the images acquired during a predetermined confirmation time as an error target. 17. An information processing system comprising: the information processing device described in any of 5 to 14; and a personal device carried by each worker and emitting light in a predetermined light emission pattern. 18. An information processing system comprising: the information processing device described in 13; and a personal device carried by each worker, the personal device emitting light in a predetermined light emission pattern, and if the worker is not carrying the personal device in a predetermined manner, setting the light emission state to an error state. 19. An information processing method in which one or more computers acquire an image including a first area, identify worker information from the image, and compare pre-registered reference information with the worker, work area, and work content included in the worker information to determine whether the worker is performing a predetermined work. 20. A recording medium having recorded thereon a program that causes a computer to function as: an image acquisition means that acquires an image including a first area; an image analysis means that identifies worker information from the image; and a determination means that compares pre-registered reference information with the worker, work area, and work content included in the worker information, and determines whether the worker is performing a specified task.

[0255] Some or all of Supplements 2 to 16 that are dependent on the information processing device of Supplement 1 described above may also be dependent on the information processing method of Supplement 19 and the recording medium of Supplement 20 in the same dependent relationship as Supplement 1 and Supplements 2 to 16. Furthermore, within the scope of each of the above-mentioned embodiments, some or all of the configurations described as Supplements can be realized in various hardware, software, various recording means for recording software, or systems.

[0256] REFERENCE SIGNS LIST 1 Information processing system 10 Information processing device 11 Image acquisition unit 12 Image analysis unit 13 Determination unit 14 Creation unit 15 Storage unit 16 Registration unit 17 Light emission control unit 18 Authentication unit 20 Possessed device 21 Light emission unit 22 Control unit 23 Detection unit 231 Adhesion unit 232 Peeling unit 233 Conductive wire 30 Image acquisition device 1A Processor 2A Memory 3A Input / output I / F 4A Peripheral circuit 5A Bus

Claims

1. An information processing device having an image acquisition means for acquiring an image including a first area, an image analysis means for identifying worker information from the image, and a determination means for comparing pre-registered reference information with the worker, work area, and work content included in the worker information, and determining whether the worker is performing a specified task.

2. The information processing apparatus according to claim 1, further comprising a creating means for creating said reference information from input work schedule information.

3. The information processing device according to claim 2, wherein the work schedule information indicates the work content of each of the workers, and the creation means determines a work area for each of the workers based on the work content of each of the workers indicated in the work schedule information, and registers the determined work area as the reference information.

4. An information processing device as described in claim 2 or 3, wherein the work schedule information indicates the work content and qualifications of each of the workers, and the creation means determines whether the work content and qualifications of each of the workers indicated in the work schedule information satisfy specified conditions, and if the specified conditions are satisfied, registers the work content of each of the workers as the reference information.

5. An information processing device according to any one of claims 1 to 4, comprising: a registration means for determining a light emission pattern for each of the workers and registering the light emission pattern linked to each of the workers; and a light emission control means for causing a device carried by each of the workers to emit light in the light emission pattern for each of the workers, wherein the image analysis means detects the worker from within the image by detecting light emission in the light emission pattern from within the image.

6. The information processing device according to claim 5, wherein the registration means determines a different light emission pattern for each of the workers.

7. The information processing device according to claim 5, wherein the registration means identifies the work area of ​​each of the workers based on the reference information, and determines the light emission pattern corresponding to the identified work area for each of the workers.

8. The information processing device according to claim 5, wherein the registration means identifies the work content of each of the workers based on the reference information, and determines the light emission pattern corresponding to the identified work content for each of the workers.

9. An information processing device as described in any one of claims 5 to 8, further comprising an authentication means for performing an authentication process on the worker when the worker enters a management area, wherein the registration means determines the light emission pattern when the worker is identified by the authentication process at the time of entry, and registers the light emission pattern in association with the worker identified by the authentication process at the time of entry.

10. The information processing device described in claim 9, wherein the registration means, when the worker is identified by the authentication process at the time of entry, registers the light emission pattern that is not registered in association with any worker at that time in association with the worker identified by the authentication process at the time of entry.

11. An information processing device as described in claim 9 or 10, wherein the authentication means performs an authentication process on the worker when he or she leaves the managed area, and the registration means, when the worker is identified by the authentication process at the time of exit, erases the light emission pattern registered in association with the worker identified by the authentication process at the time of exit.

12. An information processing device as described in any one of claims 1 to 4, further comprising a registration means for identifying a light emission pattern specific to a device held by each of the workers and registering it in association with each of the workers, wherein the image analysis means detects light emission in the light emission pattern from within the image and identifies the worker included in the image based on the detection result.

13. An information processing device according to any one of claims 5 to 12, wherein the owned device sets the light-emitting state to an error state when the worker does not hold the owned device in a predetermined manner, and the image analysis means performs error processing when it detects the owned device in the image whose light-emitting state is in the error state.

14. The information processing device according to claim 13, wherein the error state is a state in which no light is emitted or a state in which light is emitted in an error light pattern.

15. An information processing device described in any one of claims 1 to 14, wherein the image analysis means detects people from within the image, and the determination means, if there is a person among the detected people who has not been identified as one of the workers, extracts the worker not detected from the image among the workers included in the reference information as an error target.

16. The information processing device described in claim 15, wherein, if there is a person among the detected persons who has not been identified as one of the workers, the determination means extracts the worker among the workers included in the reference information who has not been detected in the images acquired during a predetermined confirmation time as an error target.

17. An information processing system comprising: an information processing device according to any one of claims 5 to 14; and a portable device carried by each worker, which emits light in a predetermined light emission pattern.

18. An information processing system comprising: an information processing device according to claim 13; and a personal device carried by each worker, wherein the personal device emits light in a predetermined light pattern, and when the worker does not carry the personal device in the predetermined manner, the light emission state becomes an error state.

19. An information processing method in which one or more computers acquire an image including a first area, identify worker information from the image, compare the worker, work area, and work content included in the worker information with pre-registered reference information, and determine whether the worker is performing a specified task.

20. A recording medium having recorded thereon a program that causes a computer to function as: an image acquisition means that acquires an image including a first area; an image analysis means that identifies worker information from the image; and a determination means that compares pre-registered reference information with the worker, work area, and work content included in the worker information, and determines whether the worker is performing the specified work.

Images