Information management system, and information management method

Abstract

To provide an information management system and an information management method capable of collecting information about a vehicle in a work area.SOLUTION: According to an embodiment, an information management system includes a camera, an image processing part and a control part. The camera photographs a prescribed photographic range in a work area where a vehicle travels. The image processing part detects a code image obtained by coding information about the vehicle displayed on a prescribed display surface corresponding to the vehicle by a display unit from a photographic image photographed by the camera, and recognizes information shown by the code image detected from the photographic image. The control part outputs information recognized from the code image by the image processing part as information about the vehicle.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] FIELD OF THE DISCLOSURE An embodiment of the present invention relates to an information management system and an information management method. [Background technology]

[0002] Vehicles such as forklifts traveling within a work area such as a factory are operated with safety as the top priority. If an accident occurs in a work area such as a factory, not only will there be direct damage, but downtime will occur for verification and measures to prevent recurrence, leading to reduced productivity. For this reason, there is a demand for a system that monitors the operation of vehicles such as forklifts by collecting information about the vehicles within the work area. As a conventional technology, a system has been considered that can detect people and vehicles within the camera's shooting range using a camera-equipped lighting device that is integrally configured with a lighting device and a camera installed on the ceiling of a factory or the like. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2022-56585 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in conventional systems, although it is possible to detect a vehicle from an image captured by a camera installed on the ceiling, it is difficult to collect information about the vehicle. For example, by applying technology such as two-dimensional codes, it is possible to attach a medium on which a code image in which information unique to the vehicle is encoded is printed to the vehicle body (main body) of the vehicle, capture the code image fixed to the vehicle body with a camera installed on the ceiling, and recognize information indicating the code image from the image captured by the camera. However, since the display state of the code image fixed to the vehicle body, such as the size, cannot be changed, there is a problem that it may be difficult to recognize information indicating the code image with a camera installed on the ceiling. In addition, since the code image fixed to the vehicle cannot be easily changed, there is also a problem that it is not easy to display information other than information unique to the vehicle.

[0005] The problem to be solved by the present invention is to provide an information management system and an information management method capable of collecting information related to vehicles in a work area. [Means for solving the problem]

[0006] According to an embodiment, the information management system includes a camera, an image processing unit, and a control unit. The camera captures an image of a predetermined capture range in a work area in which a vehicle travels. The image processing unit detects a code image, which encodes information about the vehicle to be displayed by a display device on a predetermined display surface corresponding to the vehicle, from the captured image captured by the camera, and recognizes information indicated by the code image detected from the captured image. The control unit outputs the information recognized from the code image by the image processing unit as information about the vehicle. Effect of the Invention

[0007] According to the present invention, it is possible to provide an information management system and an information management method capable of collecting information related to vehicles in a work area. [Brief description of the drawings]

[0008] [Figure 1]FIG. 1 is a diagram for illustrating an outline of a configuration example of an information management system according to an embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of a configuration in which a projector serving as a display in the information management system according to the embodiment displays a code image on the roof of a vehicle. [Diagram 3] FIG. 3 is a diagram showing an example of a configuration in which a projector serving as a display in the information management system according to the embodiment displays a code image on a floor near a vehicle. [Figure 4] FIG. 4 is a diagram showing an example of the arrangement of camera-equipped lighting devices as cameras in the information management system according to the embodiment. [Diagram 5] FIG. 5 is a block diagram showing an example of the configuration of each device in the information management system according to the embodiment. [Figure 6] FIG. 6 is a block diagram showing an example of the configuration of a projector as a display device in the information management system according to the embodiment. [Figure 7] FIG. 7 is a block diagram showing an example of the configuration of a camera-equipped lighting device in an information management system according to the embodiment. [Figure 8] FIG. 8 is a block diagram showing an example of the configuration of a control system of a management device in an information management system according to an embodiment. [Figure 9] FIG. 9 is a block diagram showing an example of the configuration of a control system of a terminal device in the information management system according to the embodiment. [Figure 10] FIG. 10 is a flowchart for explaining an example of a process in which a terminal device in the information management system according to the embodiment creates a code image to be displayed on a projector. [Figure 11] FIG. 11 is a flowchart for explaining an example of an operation in which a projector serving as a display device in the information management system according to the embodiment displays a code image. [Figure 12] FIG. 12 is a flowchart for explaining an example of the operation of a camera-equipped lighting device including a camera in the information management system according to the embodiment. [Figure 13]FIG. 13 is a flowchart for explaining an example of the operation of the management device in the information management system according to the embodiment. [Figure 14] FIG. 14 is a diagram showing an example of a database for storing information related to vehicles provided in a storage device in the information management system according to the embodiment. [Figure 15] FIG. 15 is a diagram showing an example of a data table for storing information indicating the operating status of each vehicle, which is provided in the storage device in the information management system according to the embodiment. [Figure 16] FIG. 16 is a diagram showing an example of a data table for storing information indicating the driving conditions of each driver, which is provided in the storage device in the information management system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] The information management system (1) of the embodiment includes a camera (46), an image processing unit (45), and a control unit (41). The camera (46) captures an image of a predetermined capture range in a work area where a vehicle travels. The image processing unit (45) detects a code image obtained by encoding information about the vehicle that the display device (12) displays on a predetermined display surface corresponding to the vehicle from the captured image captured by the camera (46), and recognizes information indicated by the code image detected from the captured image. The control unit (41) outputs information recognized from the code image by the image processing unit (45) as information about the vehicle. As a result, the information management system (1) of the embodiment can capture a code image displayed on a predetermined display surface corresponding to the vehicle in the work area with the camera (46), and can obtain information about the vehicle indicated by the code image from the captured image captured by the camera (46). As a result, information about the vehicle traveling in the work area can be easily collected.

[0010] In the information management system (1) of the embodiment, the code image is an image in which information including the identification information of the vehicle and information indicating the driver of the vehicle is encoded. As a result, the information management system (1) of the embodiment can obtain the identification information of the vehicle and the identification information of the driver of the vehicle from the code image displayed on a predetermined display surface corresponding to the vehicle from an image captured by a camera.

[0011] In the information management system (1) of the embodiment, the image processing unit (45) specifies the position of the vehicle in the work area based on the shooting range of the captured image and the position of the vehicle in the captured image, and the control unit (41) outputs information including information indicating the position of the vehicle in the work area specified by the image processing unit and information recognized from the code image. As a result, the information management system (1) of the embodiment can obtain not only information indicated by the code image displayed on a predetermined display surface corresponding to the vehicle, but also information indicating the position of the vehicle from the captured image captured by the camera (46).

[0012] The information management system (1) of the embodiment further includes a management device (15) that stores information output by the control unit (41) in a storage device (52). This allows the information management system (1) of the embodiment to store information acquired from an image captured by the camera (46) in the storage device (52).

[0013] The information management system (1) of the embodiment stores, in the storage device (52), information indicating the operating status of each vehicle based on information collected for each vehicle from information stored in the storage device (52) by the management device (15). As a result, the information management system (1) of the embodiment can save information acquired from images captured by the camera (46) as information indicating the operating status of each vehicle, and can evaluate the operating status of each vehicle.

[0014] The information management system (1) of the embodiment stores, in the storage device (52), information indicating the work status of each driver based on information collected for each vehicle driver from the information stored in the storage device (52) by the management device (15).Therefore, the information management system (1) of the embodiment can save information acquired from images captured by the camera (46) as information indicating the work status of each driver, and can evaluate the work status of each driver.

[0015] In the information management system (1) of the embodiment, when the image processing unit (45) detects the code image, the control unit (41) causes the alarm device (14) installed at a position corresponding to the shooting range of the captured image in which the code image was detected to issue an alarm. In this way, the information management system (1) of the embodiment can issue an alarm when a code image corresponding to a vehicle is detected from the captured image captured by the camera (46), thereby improving safety in the work area.

[0016] The information management system (1) of the embodiment includes a display (12), a camera (46), an image processing unit (45), and a control unit (41). The display (12) displays a code image, which is an encoded version of information about a vehicle traveling in a work area, on a predetermined display surface corresponding to the vehicle. The camera (46) captures an image of a predetermined shooting range in the work area. The image processing unit (45) detects a code image from the captured image captured by the camera (46) and recognizes information indicated by the code image detected from the captured image. The control unit (41) outputs the information recognized from the code image by the image processing unit (45) as information about the vehicle. In this way, the information management system (1) of the embodiment can easily replace the code image displayed on the predetermined display surface corresponding to the vehicle, and can obtain information about the vehicle indicated by the code image from the captured image captured by the camera (46).

[0017] In the information management system (1) of the embodiment, the display (12) is a projector that projects the code image onto the predetermined display surface. As a result, the information management system (1) of the embodiment can easily replace the code image displayed on the predetermined display surface corresponding to the vehicle, and can also easily adjust the display of the code image displayed on the display surface.

[0018] In the information management method of the embodiment, a code image encoding information about a vehicle traveling in a work area is displayed on a predetermined display surface corresponding to the vehicle by a display (12), a predetermined shooting range in the work area is photographed by a camera (46), the code image is detected from the captured image taken by the camera (46), information indicated by the code image detected from the captured image is recognized, and the information recognized from the code image is output as information about the vehicle. In this way, the information management method of the embodiment can display an easily replaceable code image on a predetermined display surface corresponding to a vehicle, and can obtain information about the vehicle indicated by the code image from the captured image taken by the camera (46).

[0019] Hereinafter, embodiments will be described with reference to the drawings. The information management system 1 according to the embodiment is a system that manages information related to a work vehicle 11, such as a forklift, that travels within a work area of ​​a factory, etc. The information management system 1 acquires information related to the vehicle 11 from images captured by a camera, manages information related to the vehicle 11 and the driver (worker) of the vehicle 11, and issues an alarm to ensure the safety of people within the work area.

[0020] Fig. 1 is a diagram for illustrating a configuration example of an information management system 1 according to an embodiment. Fig. 2 is a block diagram showing an overall configuration example of the information management system 1 according to an embodiment. As shown in FIGS. 1 and 2, the information management system 1 comprises a vehicle 11, a projector 12, a camera-equipped lighting device 13, an alarm device 14, a management device 15, a terminal device 16, an external memory device 17, and the like.

[0021] Vehicle 11 travels within a work area. Vehicle 11 travels within the work area in response to driving operations by a driver. Vehicle 11 may travel by automatic driving or remote driving operations. Vehicle 11 may also be a work vehicle that not only travels within the work area, but also moves within the work area while performing a specific task.

[0022] For example, the vehicle 11 is a forklift equipped with a function of picking up luggage. The forklift as the vehicle 11 performs the work of picking up luggage at a collection point, moving the luggage to a designated transfer location, and placing the picked-up luggage at the designated transfer location. In the following embodiment, the vehicle 11 will be described assuming that it is a forklift operated by a driver.

[0023] The projector 12 displays a code image that can be captured by the camera of the camera-equipped lighting device 13. The projector 12 displays the code image on a display surface (display position) associated with the vehicle 11. For example, the projector 12 is mounted on the vehicle 11 and displays the code image on a vehicle body surface such as the roof of the vehicle 11. The projector 12 may also display the code image on a floor surface near the vehicle 11.

[0024] The projector 12 is an example of a display device, and may be replaced with, for example, a display device that displays a code image that can be captured by a camera on a display provided in the vehicle 11. Specifically, in the case of displaying a code image on the roof of the vehicle 11, the projector 12 may be replaced with a display device that displays a code image that can be captured by a camera on a display screen provided on the roof of the vehicle 11.

[0025] The code image displayed by the projector 12 in association with the vehicle 11 is an image in which information about the vehicle 11 is coded. The code image is, for example, an image of a two-dimensional code. The information about the vehicle indicated by the code image includes vehicle identification information and information indicating the driver of the vehicle (driver identification information). The information indicated by the code image may also include information indicating the work content assigned to the vehicle 11 (for example, luggage to be moved, and the location to which the luggage is to be moved). For example, the projector 12 imports the code image generated by the terminal device 16 via the external memory device 17.

[0026] The camera-equipped lighting device 13 is a lighting device equipped with a camera. The camera-equipped lighting device 13 is installed on the ceiling or the like in a factory, which is a work area, so as to illuminate the work area. The camera-equipped lighting device 13 includes not only a control unit 31 (see FIG. 7) that controls the lighting state of the lighting section 33 (see FIG. 7), but also a module camera 32 (see FIG. 7) that is a control module including an image processing section that processes images captured by the camera.

[0027] Furthermore, the camera-equipped lighting device 3 has a communication function and communicates with a management device 15 via a network. The camera-equipped lighting device 13 may also be configured to communicate with an alarm device 14 set in a location corresponding to the shooting range of the camera. The camera-equipped lighting device 13 may also have a function to communicate with a projector 12 located within the shooting range.

[0028] The alarm device 14 is installed at various locations in the work area. The alarm device 14 issues an alarm (alert) in response to a command from the management device 15 or the camera-equipped lighting device 13. The alarm device 14 may be any device that outputs an alert to alert people in the vicinity. The alarm device 14 may be, for example, a rotating light or a speaker that sounds a buzzer.

[0029] The management device 15 is an information processing device such as a server device. The management device 15 communicates with the camera-equipped lighting device 13 via a network. The management device 15 acquires information from the camera-equipped lighting device 13, and stores and manages the acquired information in a storage device. For example, the management device 15 stores the information acquired from the camera-equipped lighting device 13 in a database provided in the storage device. The management device 15 also stores in the storage device the results of tallying or analyzing information on each vehicle 11 and the driver of the vehicle in the work area based on information acquired from the camera-equipped lighting device 13 and the like. The management device 15 may also communicate with the alarm device 14 via a network. In this case, the management device 15 may cause the alarm device 14 to issue an alert based on information acquired from the camera-equipped lighting device 13.

[0030] The terminal device 16 creates a code image. The terminal device 16 creates the code image based on information input using an operation unit or the like. For example, the terminal device 16 acquires identification information of a vehicle displaying the code image and information indicating a driver who drives the vehicle, and creates a code image by encoding information including the identification information of the vehicle and information indicating the driver. The terminal device 16 writes the created code image to the external memory device 17. The terminal device 16 may also acquire a code image created by another device, and write the acquired code image to the external memory device 17.

[0031] The external memory device 17 has an interface corresponding to the memory interface of the projector 12 and the terminal device 16. When the external memory device 17 is connected to the terminal device 16, a code image is written into the external memory device 17 by the terminal device 16. When the external memory device 17 is connected to the projector 12, the external memory device 17 outputs the code image written by the terminal device to the projector 12. Note that the information management system 1 may be configured so that the code image can be transferred from the terminal device 16 to the projector 12 without going through the external memory device 17.

[0032] Next, a configuration example for the projector 12 in the information management system 1 according to the embodiment to display the code image C on the display surface (display position) associated with the vehicle 11 will be described. FIG. 3 is a diagram showing a first example of a configuration for the projector 12 in the information management system 1 according to the embodiment to display a code image C on the body of the vehicle 11. As shown in FIG. In a first configuration example shown in Fig. 3, the projector 12 displays the code image C on the roof 11a of the vehicle body forming the vehicle 11. That is, in the first configuration example shown in Fig. 3, the predetermined display surface corresponding to the vehicle 11 is the upper surface of the roof 11a of the vehicle 11. For example, the projector 12 is a projection device equipped with a short-focus projection unit capable of displaying the code image C even at a close distance, and is installed at an end of the roof 11a of the vehicle 11. Also, in the first configuration example, the projector 12 may be replaced with a display device that displays the code image on a display (display screen) provided on the roof 11a.

[0033] FIG. 4 is a diagram showing a second configuration example for the projector 12 in the information management system 1 according to the embodiment to display the code image C near the vehicle 11. In a second configuration example shown in Fig. 4, the projector 12 displays a code image C on a floor surface near the vehicle 11. That is, in the second configuration example shown in Fig. 4, the predetermined display surface corresponding to the vehicle 11 is the floor surface near the vehicle 11. In the example shown in Fig. 4, the code image C is projected onto the floor surface behind the vehicle 11 with the loading claws (forks) of a forklift as the vehicle 11 in front. The floor surface onto which the code image C is projected may be any surface near the vehicle 11 (or a position associated with the vehicle 11), and the code image may be projected onto a floor surface on the side of the vehicle 11, for example.

[0034] Next, an example of installation of the camera-equipped lighting device 13 in the information management system 1 according to the embodiment will be described. FIG. 5 is a diagram showing an example of installation of a plurality of camera-equipped lighting devices 13 in the information management system 1 according to the embodiment. As shown in Fig. 5, multiple lighting devices with cameras 13 are installed so that the shooting ranges A11 to A33 of each camera cover the entire work area A to be monitored. For example, in the lighting device with cameras 13 shown in the upper left of Fig. 5, the camera shoots an image in the shooting range A11 and detects a code image C present in the shot image. The lighting device with cameras 13 acquires the recognition result of the code image detected from the shot image as information related to the vehicle 11 present in the shooting range (detection area) A11.

[0035] 5, the multiple camera-equipped lighting devices 13 are installed so that their shooting ranges correspond to the detection areas obtained by dividing the work area A. This allows the information management system 1 to shoot the entire work area A using the multiple camera-equipped lighting devices 13, and to monitor the entire work area A.

[0036] Next, a configuration of the projector 12 serving as a display device in the information management system 1 according to the embodiment will be described. FIG. 6 is a block diagram showing an example of the configuration of a control system for the projector 12 serving as a display device in the information management system 1 according to the embodiment. As shown in FIG. 6, the projector 12 includes a control unit 21, a storage unit 22, a communication unit 23, a memory interface (I / F) 24, a projection unit 25, and the like.

[0037] The control unit 21 includes a processor, a memory, an interface, and the like. In the control unit 21, the processor is configured, for example, by a CPU (Central Processing Unit), and the like. The memory of the control unit 21 is configured, for example, by a storage device such as a ROM (Read Only Memory), a RAM (Random Access Memory), or an NVM (Non-Volatile Memory). The control unit 21 realizes various processing functions by the processor executing programs stored in the memory in the control unit 21 and the storage unit 22.

[0038] The storage unit 22 is configured with a rewritable non-volatile memory such as a hard disk drive (HDD) or a solid state drive (SSD). For example, the storage unit 22 stores display data such as a code image captured from an external memory. The storage unit 22 may also store various programs and setting data.

[0039] The communication unit 23 is a communication interface for communicating with an external device. The communication unit 23 may communicate with the camera-equipped lighting device 13, or may communicate with the management device 15. When the projector 12 is operated as a device that does not need to communicate with an external device, the communication unit 23 may be omitted.

[0040] The memory interface 24 is an interface for connecting the external memory device 17 that stores the code image and the like. When the interface of the external memory device 17 is connected, the memory interface 24 retrieves information such as the code image from the external memory device 17. Note that the communication unit 23 may be capable of communicating with the terminal device 16 that generates the code image, in which case the memory interface 24 may be omitted.

[0041] The projection unit 25 projects (displays) an image such as a code image. A projection device is used for the projection unit 25 so that the code image can be displayed on a predetermined projection surface. For example, when the projector 12 is mounted on the vehicle 11 and the roof 11a of the vehicle 11 is used as the projection surface for the code image, the projection unit 25 is configured with a short-focus projection device. The projection unit 25 also has an adjustment function for controlling the display state of the projected image. For example, the projection unit 25 adjusts the brightness, size, etc. of the projected image in response to an instruction from the control unit 21.

[0042] Next, the configuration of the camera-equipped lighting device 13 in the information management system 1 according to the embodiment will be described. FIG. 7 is a block diagram showing an example of the configuration of a control system in the camera-equipped lighting device 13 according to the embodiment. As shown in FIG. 7, the camera-equipped lighting device 13 is made up of a control unit 31, a module camera 32, a lighting section 33, and the like.

[0043] The control unit 31 includes a processor, a memory, an interface, etc. In the control unit 31, the processor is configured with, for example, a CPU, an ASIC (Application Specific Integrated Circuit), a microcomputer, an FPGA (Field Programmable Gate Array), and a DSP (Digital Signal processor).

[0044] In the control unit 31, a processor such as a CPU executes programs stored in a memory to realize various processes as the control unit. In the control unit 31, the memory is configured by a storage device such as a ROM, a RAM, an NVM, etc. The control unit 31 also includes an internal interface that connects to the module camera 32, etc.

[0045] The lighting unit 33 emits light using power supplied from a lighting power supply. The lighting unit 33 is composed of, for example, an LED. The lighting state of the lighting unit 33 is controlled by the control unit 31. The control unit 31 and the lighting unit 33 function as a lighting fixture.

[0046] The module camera 32 includes a control unit 41, a storage unit (memory) 42, a communication unit 43, an interface 44, an image processing unit 45, and an imaging unit (camera) 46. The control unit 41 and image processing unit 45 in the module camera 32 are processing units configured with a processor, a memory, an interface, etc. For example, the control unit 41 and the image processing unit 45 may be functions realized by the same hardware. Also, the control unit 41 or the image processing unit 45 may be realized by dedicated hardware, etc.

[0047] The control unit 41 performs various types of control and data processing by a processor such as a CPU executing a program stored in the memory. The storage unit 42 is composed of various types of memory. The communication unit 43 is a communication interface for communicating with an external device. The communication unit 43 communicates with the management device 15 via a network, for example. The interface 44 is an interface for connecting to the control unit 31. The imaging unit 46 is a camera that captures an image in a predetermined shooting range.

[0048] The image processing unit 45 performs image processing to acquire various information by analyzing the captured image captured by the imaging unit 46. The image processing unit 45 has a function of detecting a code image from the captured image and recognizing (decoding) information indicated by the detected code image (code image processing function).

[0049] The image processing unit 45 also has a function of detecting a person in the captured image (person detection function).The image processing unit 45 also has a function of detecting a state of the vehicle 11 (for example, the presence or absence of luggage, etc.) detected from the captured image (state detection function).The image processing unit 45 may also have a function of detecting the illuminance of light in the capture range from the captured image (function as an illuminance sensor), etc.

[0050] The image processing unit 45 supplies information indicating the processing results of each function to the control unit 41. This enables the control unit 41 to control each unit according to the processing results of the image processing unit 45 and to transmit the processing results of the image processing unit 45 to the management device 15. The various functions of the image processing unit 45 may be executed by the management device 15. In this case, the control unit 41 may transmit the image captured by the imaging unit 46 to the management device 15 and obtain the result of the image processing from the management device 15.

[0051] Next, the configuration of a control system of the management device 15 in the information management system 1 according to the embodiment will be described. FIG. 8 is a block diagram showing an example of the configuration of a control system of the management device 15 in the information management system 1 according to the embodiment. 8, the management device 15 includes a control unit 51, a storage unit (storage device) 52, and a communication unit 53. The management device 15 may also include a display unit and an operation unit as a user interface.

[0052] The control unit 51 includes a processor, a memory, an interface, and the like. In the control unit 51, the processor is configured by, for example, a CPU, and the like. The memory of the control unit 51 is configured by, for example, a storage device such as a ROM, a RAM, or an NVM. The processor of the control unit 51 realizes various processes by executing programs stored in the memory in the control unit 51 or the storage unit 52.

[0053] The storage unit 52 is a storage device configured by a rewritable non-volatile memory such as a hard disk drive (HDD) or a solid state drive (SSD). The storage unit 52 stores information acquired from a device such as a lighting device with a camera, and information obtained by a predetermined process. The storage unit 52 may also store programs and setting data. However, the management device 15 may store information in a storage device of an external device connected for communication. In this case, a part or all of the information stored in the storage unit 52 described in this embodiment may be stored in a storage device of an external device connected to the management device 15.

[0054] 8, the storage unit 52 has a database 52a that stores information acquired from the camera-equipped lighting device 13, etc. The storage unit 52 also has a data table 52b that stores information indicating the operating status of each vehicle based on information collected for each vehicle. The storage unit 52 also has a data table 52c that stores information indicating the work (driving) status of a driver based on information collected for each driver.

[0055] The communication unit 53 is a communication interface for communicating with an external device. For example, the communication unit 53 is a network interface for communicating with an external device via a network. In the configuration example shown in FIG. 2, the communication unit 53 has a communication interface for communicating with the camera-equipped lighting device 13, a communication interface for communicating with the alarm device 14, and a communication interface for communicating with the terminal device 16.

[0056] Next, the configuration of a control system of the terminal device 16 in the information management system 1 according to the embodiment will be described. FIG. 9 is a block diagram showing an example of the configuration of a control system of the terminal device 16 in the information management system 1 according to the embodiment. As shown in FIG. 9, the terminal device 16 includes a control unit 61, a storage unit 62, a communication unit 53, a display unit 64, an operation unit 65, a memory interface 66, and the like.

[0057] The control unit 61 includes a processor, a memory, an interface, and the like. In the control unit 61, the processor is configured, for example, by a CPU, and the like. The memory of the control unit 61 is configured, for example, by a storage device such as a ROM, a RAM, or an NVM. The processor of the control unit 61 realizes various processes by executing programs stored in the memory in the control unit 61 or the storage unit 62.

[0058] The storage unit 62 is configured with a rewritable non-volatile memory such as a hard disk drive (HDD) or a solid state drive (SSD). The communication unit 63 is a communication interface for communicating with an external device. In the information management system 1 having the configuration shown in FIG.

[0059] The display unit 64 is a display that displays information. The display unit 64 is composed of, for example, a liquid crystal display or an organic EL device. The operation unit 65 is composed of an input device for an operator to input operation instructions. The display unit 64 and the operation unit 65 may be composed of a display device with a touch panel.

[0060] The memory interface 66 is an interface for connecting the external memory device 17 that stores the code image and the like. The code image created by the control unit 61 or the like is written to the external memory device 17 connected to the memory interface 66. Note that the communication unit 63 may be capable of communicating with the projector 12 that displays the code image, in which case the memory interface 66 may be omitted.

[0061] Next, a process for creating a code image by the terminal device 16 in the information management system 1 according to the embodiment will be described. FIG. 10 is a flowchart for explaining an example of an operation of a process for creating a code image by the terminal device 16 in the information management system 1 according to the embodiment. When operating a vehicle 11 to be monitored by the information management system 1, a user such as a driver or manager sets (connects) an external memory device 17 to the memory interface 66 of the terminal device 16 and inputs an instruction to launch an application program for creating a code image.

[0062] In response to the start instruction, the control unit 61 of the terminal device 16 starts an application program installed in the storage unit 62 for creating a code image. When the application program starts, the control unit 61 accepts input of information required for creating a code image (step ST11).

[0063] For example, the user uses the operation unit 65 to input information indicated by a code image displayed in association with the vehicle 11. Specifically, the user inputs vehicle identification information of the vehicle 11 and information indicating the driver (driver identification information) through the operation unit 65. The vehicle identification information may be specified by the control unit 61 of the terminal device 16, which is selected by the user from a list of the vehicle identification numbers of the vehicles 11. The user may also input information other than the vehicle identification information and the driver identification information (e.g., work content, etc.).

[0064] When the information required for creating a code image is input, the control unit 61 of the terminal device 16 creates a code image by encoding the input information (step ST12). The code image is, for example, a two-dimensional code in a predetermined format. The control unit 61 creates the code image by encoding information including the vehicle identification information and the driver's identification information into a two-dimensional code in a predetermined format.

[0065] When the control unit 61 of the terminal device 16 creates the code image, it writes the created code image to the external memory device 17 set in the memory interface 66 (step ST13). When the control unit 61 writes the code image to the external memory device 17, it displays a message indicating completion of writing the code image on the display unit 64, and ends the code image creation process. When ending the code image creation process, the control unit 61 may display on the display unit 64 a guidance to set the external memory device 17 in the projector 12 of the vehicle 11 to be driven.

[0066] Next, a display process of a code image by the projector 12 in the information management system 1 according to the embodiment will be described. FIG. 11 is a flowchart for explaining an example of the operation of displaying a code image by the projector 12 in the information management system 1 according to the embodiment. The user connects (sets) the external memory device 17 in which the code image is written to the memory interface 24 of the projector 12 corresponding to the vehicle 11 being driven. When the control unit 21 of the projector 12 detects that the external memory device 17 has been set to the memory interface 24 (step ST31, YES), it retrieves the code image from the external memory device 17 (step ST32). When the control unit 21 of the projector 12 acquires the code image from the external memory device 17, the projection unit 25 projects the acquired code image onto a predetermined display surface (projection surface) to display the code image (step ST33). For example, the memory unit 22 stores initial setting values ​​for displaying the code image according to the distance from the installation position of the camera-equipped lighting device 13 (for example, the ceiling of a factory that is the work area) to the predetermined display surface (for example, the roof or floor of a vehicle). The control unit 21 projects the code image onto the predetermined display surface by the projection unit 25 set according to the initial setting values ​​stored in the memory unit 22.

[0067] As a specific example, in the case of the first configuration example shown in Fig. 3, the control unit 21 of the projector 12 causes the projection unit 25 to display the code image captured from the external memory device 17 on the upper surface of the roof 11a of the vehicle 11. In the case of the second configuration example shown in Fig. 4, the control unit 21 of the projector 12 causes the projection unit 25 to display the code image captured from the external memory device 17 on the floor surface near the vehicle 11.

[0068] The control unit 21 of the projector 12 displays the code image on a predetermined display surface by the projection unit 25, and then receives a display adjustment instruction (step ST34). For example, the control unit 21 may receive a display adjustment instruction from the camera-equipped lighting device 13 that communicates through the communication unit 23. The control unit 21 may also receive a display adjustment instruction input to an operation unit (not shown).

[0069] When the control unit 21 of the projector 12 receives a display adjustment instruction (step ST34, YES), it adjusts (updates) the display state of the code image by controlling the projection unit 25 according to the instruction (step ST35). For example, when the control unit 21 receives an instruction from the camera-equipped lighting device 13 to change the display size (or brightness, contrast, etc.) of the code image, it controls the projection unit 25 to change the display size (or brightness, contrast, etc.) of the code image.

[0070] If there is no instruction to end the display of the code image (step ST36, NO), the control unit 21 of the projector 12 displays the code image by repeatedly executing steps ST34-36. For example, the control unit 21 may determine to end the display of the code image when the external memory device 17 is removed. In this case, the control unit 21 ends the display of the code image when the external memory device 17 is removed. The control unit 21 may also end the display of the code image in response to an instruction to end the display input to an operation unit (not shown).

[0071] According to the above-mentioned process, the projector can project a code image, such as a two-dimensional code that encodes information including vehicle identification information and driver identification information, onto a predetermined display surface. The projector can display the code image at a display size according to the installation position of a camera-equipped lighting device equipped with a camera that captures the code image. Furthermore, since the projector can display a code image indicating different information on the display surface simply by replacing the code image, physical changes such as replacement of a medium on which a code image fixed to the vehicle is printed can be avoided. As a result, it is possible to easily change the code image displayed on the vehicle according to a change in the driver, etc.

[0072] Next, a process of collecting information such as information related to a vehicle by the camera-equipped lighting device 13 in the information management system 1 according to the embodiment will be described. FIG. 12 is a flowchart for explaining an example of the operation of the information collection process by the camera-equipped lighting device 13 in the information management system 1 according to the embodiment. The module camera 32 in the camera-equipped lighting device 13 captures an image of a predetermined shooting range by the imaging unit 46 (step ST50). For example, the control unit 41 of the module camera 32 causes the imaging unit 46 to capture an image of the shooting range at a predetermined cycle.

[0073] The control unit 41 of the module camera 32 supplies the captured image captured by the imaging unit 46 to the image processing unit 45, and the image processing unit 45 performs image analysis on the captured image (step ST51). The image processing unit 45 detects a code image from the captured image in the image analysis on the captured image. Furthermore, the image processing unit 45 detects the presence or absence of a person in the shooting range from the captured image as part of the image analysis.

[0074] Furthermore, when a code image is detected from a captured image in the image analysis, the image processing unit 45 may detect the state of the vehicle 11 corresponding to the code image. Specifically, if the vehicle is a forklift, the image processing unit 45 detects whether the forklift vehicle is holding a load. Furthermore, if the vehicle 11 is holding a load, the image processing unit 45 may identify the load from the image of the load.

[0075] When the image processing unit 45 detects a code image from the captured image (step ST52, YES), it recognizes information indicated by the code image detected in the captured image (step ST53). For example, the image processing unit 45 extracts a code image from the captured image and obtains information indicated by the code image by decoding the extracted code image. Furthermore, when multiple code images are present in the captured image, the image processing unit 45 extracts each of the multiple code images and recognizes each of the extracted code images.

[0076] When the image processing unit 45 recognizes the information indicated by the code image in the captured image, it estimates the position of the vehicle 11 to which the code image corresponds (step ST54). For example, the image processing unit 45 assumes that the imaging unit 46 captures an image of a predetermined imaging range (detection area), and estimates the position of the vehicle in the work area from the position of the vehicle shown in the captured image of the predetermined imaging range.

[0077] When the image processing unit 45 estimates the position of the vehicle, the control unit 41 of the module camera 32 determines whether or not a person has been detected in the captured image by image analysis (step ST55). If a person has been detected in the captured image (step ST55, YES), the control unit 41 causes the alarm device 14 installed in a position corresponding to the capture range of the captured image (for example, within the capture range and around the capture range) to issue an alert (step ST56).

[0078] However, the control unit 41 may be configured to cause the alarm device 14 to issue an alert regardless of whether or not a person is detected from the image captured by the imaging unit 46. In this case, when the control unit 41 detects a code image corresponding to the vehicle 11 from the captured image, it causes an alert to be issued from a device installed at a position corresponding to the capture range of the captured image.

[0079] Furthermore, when the control unit 41 detects a code image from the captured image by the imaging unit 46, it transmits information obtained from the captured image, including the recognition result of the code image, to the management device 15 (step ST57). For example, the control unit 41 obtains information including vehicle identification information and driver identification information as the recognition result of the code image. Furthermore, the control unit 41 obtains information such as the position (estimated position) of the vehicle in the work area, the presence or absence of people in the capture range (detection area), and the state of the vehicle (whether or not luggage is being carried, etc.) as the result of image analysis of the captured image by the image processing unit 45. As a result, the control unit 41 transmits information including the recognition result of the code image and the result of image analysis to the management device 15 as information related to the vehicle corresponding to the code image detected from the captured image.

[0080] 12 may be partly executed by management device 15. For example, management device 15 may acquire an image captured by imaging unit 46 of camera-equipped lighting device 13 via communication unit 53, and cause control unit 51 to execute the processes of steps ST51 to ST56 described above.

[0081] According to the above-mentioned process, the camera-equipped lighting device can identify a vehicle that has entered a predetermined shooting range from the image captured by the camera, and can issue an alert by an alarm installed within the shooting range and in the vicinity of the shooting range. As a result, it is possible to alert workers in and around the shooting range, and it is possible to realize the safe operation of vehicles in the work area.

[0082] According to the above-mentioned process, the lighting device with camera can obtain information about a vehicle that has entered the shooting range by recognizing a code image corresponding to the vehicle from the captured image. Furthermore, the lighting device with camera can obtain not only the recognition result of the code image but also the detection result of the presence or absence of a person and the state of the vehicle in the captured image, and can output such information as information about the vehicle in the shooting range. As a result, information showing the operation status of the vehicle and the work status of the driver can be visualized, making it possible to manage the operation of the vehicle and the work of the driver in the work area.

[0083] Next, a management process of information such as information related to the vehicle 11 by the management device 15 in the information management system 1 according to the embodiment will be described. FIG. 13 is a flowchart for explaining an example of the operation of the information management process by the management device 15 in the information management system 1 according to the embodiment. The management device 15 maintains communication with the camera-equipped lighting device 13 via the communication unit 53, and receives information sent from the camera-equipped lighting device 13 (step ST71). Upon receiving the information from the camera-equipped lighting device 13 (step ST72, YES), the control unit 51 of the management device 15 stores the received information in the database 52a provided in the storage unit 52 (step ST73).

[0084] FIG. 14 is a diagram showing an example of database 52a for storing information acquired (collected) from camera-equipped lighting device 13 and the like. When the database 52a shown in FIG. 14 is set, the control unit 51 identifies vehicle identification information, driver identification information, luggage information (whether luggage is being carried, identification information of the luggage being carried, etc.), shooting range (detection area), estimated position of the vehicle (position of the vehicle), and information indicating the presence or absence of a person based on information from the camera-equipped lighting device 13, and stores the information in the database 52a shown in FIG. 14.

[0085] When the control unit 51 of the management device 15 saves the new information in the database 52a, it updates the data table 52b that stores the information for each vehicle (step ST74). For example, the control unit 51 collects information about the vehicle about which the new information has been acquired from the database 52a, and updates the data table 52b that stores the data of the vehicle based on the collected information. The data table 52b that stores the data for each vehicle stores not only the data registered in the database 52a, but also information indicating the operating status of the vehicle that is generated (identified) from the collected data.

[0086] FIG. 15 is a diagram showing an example of the data table 52b that stores information obtained by collecting information for each vehicle. 15 is set, the control unit 51 compiles, for each vehicle, the travel route, baggage transport (baggage transport status), travel speed, operating time, etc. from the information collected for each vehicle. The control unit 51 stores the information compiled for each vehicle in the data table 52b in association with the vehicle identification information of each vehicle.

[0087] As a specific example, "travel route" is information indicating the assumed travel route of the vehicle by linking the position information for each vehicle. "Luggage transportation" is information indicating the luggage transportation status by the vehicle, such as the time the vehicle 11 held (transported) luggage, the distance traveled while holding luggage (luggage travel distance), and the number of times luggage transportation was performed, by arranging information indicating whether the vehicle 11 is holding luggage in chronological order. "Travel speed" is information indicating the average speed at which the vehicle 11 moved (average travel speed), or the fastest speed at which the vehicle 11 moved (maximum travel speed), etc. "Operation time" is information indicating the time the vehicle 11 was operated by the driver, etc.

[0088] For example, every time new information is registered in the database 52a, the control unit 51 updates the information on the vehicle included in the newly registered information in the data table 52b. The control unit 51 may also collect data for each vehicle at a timing designated by the manager or at a predetermined timing (when work in the work area is completed), and may update the data table 52b by aggregating information on each vehicle based on the collected data.

[0089] Furthermore, when the control unit 51 of the management device 15 saves the new information in the database 52a, it updates the data table 52c that stores the information for each driver (worker) (step ST75). For example, the control unit 51 collects information about the driver included in the newly acquired information from the database 52a, and updates the data table 52c that stores the data of the driver based on the collected information. The data table 52c that stores the data for each driver stores not only the data registered in the database 52a, but also information indicating the work status of the driver that is generated (identified) from the collected data.

[0090] FIG. 16 is a diagram showing an example of a data table 52c that stores information obtained by collecting information for each driver. 16 is set, the control unit 51 compiles, for each driver, the number of work days, vehicle operation time, driving route, baggage transportation (baggage transportation status), travel speed, etc., based on the information collected for each driver. The control unit 51 stores the information compiled for each driver in the data table 52c in association with the vehicle identification information of each vehicle.

[0091] For example, every time new information is registered in the database 52a, the control unit 51 updates the information about the driver included in the newly registered information in the data table 52b. The control unit 51 may also collect data for each driver at a timing designated by the manager or a predetermined timing (when work in the work area is completed), and may update the data table 52c by aggregating information about each driver based on the collected data.

[0092] As a specific example, "number of work days" is information indicating the number of days the driver drove the vehicle (performed work using the vehicle). "Vehicle operation time" is the time the driver operated (driving) the vehicle, and is information indicating the total time the driver operated the vehicle, calculated by arranging the collected information for each driver in chronological order. "Driving route" is information indicating the estimated driving route of the vehicle by linking the vehicle position information in the information collected for each driver.

[0093] "Baggage transportation" is information showing the status of luggage transportation by the driver, such as the time spent carrying (transporting) luggage in the vehicle, the distance traveled carrying luggage in the vehicle (baggage travel distance), and the number of times luggage was transported by the vehicle, by arranging the information collected for each driver on luggage carrying by each vehicle in chronological order. "Travel speed" is information showing the average travel speed of the vehicle driven by the driver (average travel speed), or the fastest speed at which the vehicle driven by the driver traveled (maximum travel speed), etc.

[0094] When the control unit 51 of the management device 15 updates the data table 52b for each vehicle or the data table 52c for each driver, it determines whether there is information to be reported (warned) to the administrator (step ST76). For example, the control unit 51 determines to warn the administrator when the data table 52b or the data table 52c contains an item that exceeds a predetermined reference value. Specifically, when there is a driver whose vehicle operation time exceeds a predetermined reference value, the control unit 51 notifies the administrator of information indicating the driver whose vehicle operation time exceeds the reference value. As a report (report) to the administrator, for example, an email including text information indicating the report content is sent to a preset email address of the administrator.

[0095] 13 may be executed by the camera-equipped lighting device 13. For example, the control unit 41 of the module camera 32 of the camera-equipped lighting device 13 may communicate with a storage device serving as an external device via the communication unit 43, and register information obtained from a captured image in the database 52a provided in the storage device.

[0096] As described above, for example, it is possible to measure the frequency of transportation by forklift. That is, the information management system according to the above-mentioned embodiment can store information indicating the operation status of each forklift in the work area in a data table for each vehicle, with the camera's shooting range as the detection area. As a result, it is possible to evaluate the operation status of each forklift, and create efficient forklift operation guidelines and operation plans.

[0097] Furthermore, the information management system according to the above-described embodiment can store information indicating the work status (work performance) using the vehicle of each driver in the work area in a data table for each vehicle, with the camera's shooting range as the detection area. As a result, even in an operation in which the driver drives any vehicle, the work using the vehicle can be evaluated for each driver. For example, the frequency of transporting luggage for each driver and the vehicle's travel route can be identified, making it possible to know the characteristics of the work using the vehicle by each driver.

[0098] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0099] 1...Information management system, 12…Projector, 13...Lighting device with camera (camera), 14...Alarm, 15...Management device (computer), 16...Terminal device, 17...External memory device, 21...Control unit, 22...Storage section, 23…Communications Department, 24...Memory interface, 25...projection section, 31...control unit, 32...Module camera, 33…Lighting department, 41...control unit, 42...Storage section, 43…Communications Department, 44…Interface, 45...image processing unit, 46...imaging unit, 51...control unit, 52...Storage section, 53…Communications Department, 61...control unit, 62...Storage section, 63…Communications Department, 64...display section, 65...Operation unit, 66...Memory interface.

Claims

1. A camera that captures an image of a predetermined shooting range in a work area in which a vehicle travels; an image processing unit that detects a code image obtained by encoding information about the vehicle, which is to be displayed by a display device on a predetermined display surface corresponding to the vehicle, from an image captured by the camera, and recognizes information indicated by the code image detected from the captured image; a control unit that outputs information recognized from the code image by the image processing unit as information regarding the vehicle; An information management system having:

2. The code image is an image in which information including identification information of the vehicle and information indicating the driver of the vehicle is coded. The information management system according to claim 1 .

3. the image processing unit specifies a position of the vehicle in the work area based on a shooting range of the captured image and a position of the vehicle in the captured image; The control unit outputs information including information indicating the position of the vehicle in the work area identified by the image processing unit and information recognized from the code image. The information management system according to claim 2.

4. The system further includes a management device that stores information output by the control unit in a storage device. The information management system according to claim 3.

5. The management device stores, in the storage device, information indicating an operating status of each vehicle based on information collected for each vehicle from the information stored in the storage device. The information management system according to claim 4.

6. The management device stores in the storage device information indicating a work status of each driver based on information collected for each driver of the vehicle from the information stored in the storage device. The information management system according to claim 4.

7. When the image processing unit detects the code image, the control unit causes an alarm device installed at a position corresponding to a shooting range of the captured image in which the code image is detected to issue an alarm.

7. An information management system according to any one of claims 1 to 6.

8. a display that displays a coded image that encodes information about a vehicle traveling in a work area on a predetermined display surface corresponding to the vehicle; a camera that captures an image of a predetermined shooting range in the work area; an image processing unit that detects a code image from an image captured by the camera and recognizes information indicated by the code image detected from the captured image; a control unit that outputs information recognized from the code image by the image processing unit as information regarding the vehicle; An information management system having:

9. The display device is a projector that projects the code image onto the predetermined display surface.

7. An information management system according to any one of claims 1 to 6.

10. displaying, by a display device, a coded image obtained by coding information about a vehicle traveling in a work area on a predetermined display surface corresponding to the vehicle; Taking an image of a predetermined shooting range in the work area with a camera; Detecting the code image from an image captured by the camera; Recognizing information indicated by the code image detected from the photographed image; outputting information recognized from the code image as information regarding the vehicle; An information management method having the above structure.

Images