Information processing device, information processing method, and information processing system

Abstract

To improve the accuracy of analyzing the movement of moving objects. [Solution] An example of an information processing device according to the present invention comprises an acquisition unit and a determination unit. The acquisition unit acquires an image of a predetermined space including a moving object on which code information is installed. The determination unit determines a determination time for determining whether or not the moving object is stationary, according to the detection accuracy when detecting the code information from the image acquired by the acquisition unit.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an information processing method, and an information processing system.

Background Art

[0002] Conventionally, object detection technologies in digital images have been known. For example, methods for estimating an object detection range for visualizing the real-world spatial range of a detected object from the viewpoint of a camera have been proposed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the prior art, there is room for improvement in improving the analysis accuracy of the movement of a moving object.

[0005] Therefore, the present disclosure proposes an information processing apparatus, an information processing method, and an information processing system capable of improving the analysis accuracy of the movement of a moving object.

Means for Solving the Problems

[0006] An information processing apparatus according to an example of an embodiment includes an acquisition unit and a determination unit. The acquisition unit acquires an image obtained by photographing a predetermined space including a moving object on which code information is installed. The determination unit determines a determination time for determining whether the moving object is stopped according to the detection accuracy when detecting the code information from the image acquired by the acquisition unit.

Brief Description of the Drawings

[0007] [Figure 1]Figure 1 shows an example of the configuration of an information processing system according to an embodiment. [Figure 2] Figure 2 is a diagram illustrating the overview of the information processing according to the embodiment. [Figure 3] Figure 3 is a diagram illustrating the method for calculating the center coordinates of a temporary stop area according to this embodiment. [Figure 4] Figure 4 is a diagram illustrating the method for calculating the center coordinates of an image according to this embodiment. [Figure 5] Figure 5 is a diagram illustrating the method for calculating the distance between center coordinates according to this embodiment. [Figure 6] Figure 6 is a diagram illustrating an example of a method for setting the determination time according to the embodiment. [Figure 7] Figure 7 is a diagram illustrating an example of a method for determining the judgment time according to the embodiment. [Figure 8] Figure 8 is a diagram illustrating an example of a method for determining the judgment time according to the embodiment. [Figure 9] Figure 9 is a diagram illustrating an example of a method for determining the judgment time according to the embodiment. [Figure 10] Figure 10 shows an example of the functional configuration of the information processing device according to the embodiment. [Figure 11] Figure 11 is a diagram showing an overview of the image information stored in the image information storage unit according to the embodiment. [Figure 12] Figure 12 is a flowchart showing an example of a processing procedure by the information processing device according to the embodiment. [Modes for carrying out the invention]

[0008] The information processing device 100 according to the embodiment described below comprises an acquisition unit 131 and a determination unit 132. The acquisition unit 131 acquires an image of a predetermined space including a mobile body 1 on which code information is installed. The determination unit 132 determines a determination time for determining whether or not the mobile body 1 is stopped, according to the detection accuracy when detecting code information from the image acquired by the acquisition unit 131.

[0009] Further, in the information processing apparatus 100, the determination unit 132 determines the determination time according to the detection accuracy based on the position in the image of a predetermined area set for the image.

[0010] Further, in the information processing apparatus 100, the determination unit 132 determines the determination time according to the detection accuracy taking into account the area of a predetermined area.

[0011] Further, in the information processing apparatus 100, the determination unit 132 determines the determination time according to the detection accuracy taking into account the size of the code information.

[0012] Further, in the information processing apparatus 100, the determination unit 132 determines the determination time according to the detection accuracy taking into account the position where the code information is installed on the moving body 1.

[0013] Further, in the information processing apparatus 100, the determination unit 132 determines the determination time according to the detection accuracy taking into account the shooting time when shooting the code information.

[0014] Further, in the information processing apparatus 100, the determination unit 132 determines the determination time according to the detection accuracy taking into account the shooting position when shooting the code information.

[0015] Further, in the information processing apparatus 100, the determination unit 132 determines the determination time according to the detection accuracy taking into account the illumination mode when shooting the code information.

[0016] Further, in the information processing apparatus 100, the determination time is defined in advance so that it becomes longer as a predetermined area is set closer to the center than the edge of the image.

[0017] Further, in the information processing apparatus 100, the acquisition unit 131 acquires an image of the code information photographed by the camera mounted on the lighting fixture 3.

[0018] The information processing method according to the embodiment described below is an information processing method performed by a computer and includes an acquisition step and a determination step. The acquisition step acquires an image of a predetermined space including a mobile body 1 on which code information is installed. The determination step determines a determination time for determining whether or not the mobile body 1 is stopped, according to the detection accuracy when detecting the code information from the image acquired in the acquisition step.

[0019] The information processing system SYS according to the embodiment described below comprises an acquisition unit 131 and a determination unit 132. The acquisition unit 131 acquires an image of a predetermined space including a mobile body 1 on which code information is installed. The determination unit 132 determines a determination time for determining whether or not the mobile body 1 is stopped, according to the detection accuracy when detecting code information from the image acquired by the acquisition unit 131.

[0020] Traditionally, object detection using cameras has been useful because camera footage can be used for various AI (Artificial Intelligence) analyses and video verification beyond object detection. For example, there is a technology that uses cameras installed on the ceiling of a facility to detect QR codes for the purpose of object identification and location information management, and then identifies and tracks the detected QR codes. Specifically, codes are placed on machinery and forklifts, and related information such as numbers and work instructions is stored on them. This makes it possible to track objects and improve work efficiency.

[0021] Furthermore, the information from the detected 2D code is transmitted in real time to servers and cloud systems, where it is recorded as the object's location and movement history, and analyzed as needed. For example, by obtaining the time and coordinates at which the 2D code was detected, and based on the acquired information, the movement status of a moving object such as a forklift can be analyzed by automatically detecting whether it has stopped or not.

[0022] However, conventional technology tracks the movement and stopping of an object by having a camera continuously detect a 2D code placed on the object, which can lead to misjudgments of the object's movement status. For example, if the camera's frame rate is set to 5fps, the camera can determine that the object has stopped for 1 second if five consecutive images of a 2D code indicating a stopped state are detected. For instance, if the second image of the 2D code is not detected, and only the third through fifth images are detected consecutively, the camera will determine that the object has stopped for 0.6 seconds, even if the actual stop time is 1 second. Therefore, if the condition for determining the movement state of an object is that it has stopped for 1 second, the camera may incorrectly determine that the object has not stopped.

[0023] Therefore, this disclosure proposes an information processing device, an information processing method, and an information processing system that can improve the accuracy of motion analysis of moving objects. The information processing device, information processing method, and information processing system according to the embodiments will be described below with reference to Figures 1 to 4.

[0024] [Embodiment] (1. Example System Configuration) First, an overview of the information processing system SYS according to the embodiment will be described using Figure 1. Figure 1 is a diagram showing an example configuration of the information processing system according to the embodiment. The information processing system SYS shown in Figure 1 is a system that can improve the accuracy of analysis of the movement of moving objects.

[0025] As shown in Figure 1, the information processing system SYS according to this embodiment includes a lighting fixture 3 installed inside a facility such as a factory or warehouse, and an information processing device 100 installed outside the facility. Note that Figure 1 is an example of the information processing system SYS according to this embodiment, and may also include a control device for controlling the lighting fixture 3, a monitoring device for monitoring the inside of the facility, and communication equipment such as routers and gateways that perform processing related to communication between the lighting fixture 3 and the information processing device 100.

[0026] Mobile vehicle 1 is an industrial vehicle, such as a forklift, that performs tasks such as unloading, loading, storing, and transporting goods within facilities such as factories and warehouses. Mobile vehicle 1 moves and stops within the facility according to the operator's commands.

[0027] The two-dimensional code 2 is installed on the mobile object 1 to manage its position and movement history. The two-dimensional code 2 is installed in a location that can be photographed from, for example, the lighting fixture 3. The two-dimensional code 2 can use any code, such as a QR code (registered trademark).

[0028] Lighting fixture 3 is installed in facilities such as factories and warehouses. Lighting fixture 3 is, for example, a ceiling light or spotlight installed on the ceiling of the facility. Lighting fixture 3 can communicate bidirectionally with control devices (not shown) in accordance with various communication standards (including wired and wireless communication standards) such as the RDM standard, which is an extension of DMX, and DALI (Digital Addressable Lighting Interface) (registered trademark). Lighting fixture 3 may also communicate bidirectionally with control devices through DMX nodes or communication equipment (not shown).

[0029] Additionally, a camera will be installed on lighting fixture 3. The camera mounted on lighting fixture 3 will photograph the inside of the facility, including the mobile unit 1 on which the QR code 2 is installed.

[0030] The information processing device 100 performs information processing according to the embodiment. If the information processing device 100 is composed of a server device, it may be implemented by a single server device, or it may be implemented by a cloud system in which multiple server devices and multiple storage devices work together.

[0031] The information processing device 100 may communicate with other devices via a predetermined network (for example, network N shown in Figure 10). In this case, the information processing device 100 may be connected to the predetermined network by wire or wireless connection. The information processing device 100 may also be equipped with a wireless communication function for connecting to the predetermined network wirelessly. For example, the information processing device 100 can perform wireless communication in accordance with the Bluetooth® or BLE (Bluetooth® Low Energy) communication standards.

[0032] The specified network may include public network infrastructure such as the Internet, telephone lines, and satellite communication networks, as well as various LANs (Local Area Networks) and WANs (Wide Area Networks), including Ethernet®. The specified network may also include dedicated network infrastructure such as IP-VPN (Internet Protocol-Virtual Private Network). Furthermore, the specified network may include wireless communication networks such as Wi-Fi® and Bluetooth®.

[0033] (2. Overview of Information Processing According to the Embodiment) In the information processing system SYS described above, the information processing device 100 acquires images taken inside the facility, including the mobile body 1 on which the two-dimensional code 2 is installed. The information processing device 100 also determines a determination time to determine whether the mobile body 1 is stopped or not, based on the detection accuracy when detecting the two-dimensional code 2 from the acquired images. Based on the determined determination time, the information processing device 100 automatically detects the status of the mobile body 1, such as whether it is temporarily stopped or not, thereby improving the accuracy of the analysis when analyzing the movement status of the mobile body 1. Figure 2 is a diagram illustrating the overview of the information processing according to the embodiment.

[0034] As shown in Figure 2, the information processing device 100 acquires an image EX-1 of a predetermined space including a mobile body 1 moving within the facility. Image EX-1 is captured by a camera mounted on a lighting fixture 3 installed within the facility. A two-dimensional code 2 is installed on the top surface of the mobile body 1.

[0035] After acquiring image EX-1, the information processing device 100 determines a determination time to determine whether the moving object 1 is stopped or not, based on the detection accuracy when detecting the two-dimensional code 2 in image EX-1. For example, the information processing device 100 determines the determination time based on the detection accuracy of the position in image EX-1 of the temporary stopping area A-1 (an example of a "predetermined area") set for the shooting range when photographing a predetermined space.

[0036] Specifically, the information processing device 100 determines a determination time for determining whether the moving object 1 is stopped, based on the length of the distance d between the center coordinates P of the temporary stopping area A-1 and the center coordinates P' of image EX-1, which corresponds to the shooting range (angle of view) when photographing a predetermined space. Figure 3 is a diagram illustrating the method for calculating the center coordinates of the temporary stopping area according to the embodiment.

[0037] As shown in Figure 3, if the coordinates of the four vertices of the pause area A-1, which is set as a rectangular area, are (X1, Y1), (X1, Y2), (X2, Y1), and (X2, Y2), then the center coordinates P(Xcenter, Ycenter) of the pause area A-1 will be ((X1+X2) / 2, (Y1+Y2) / 2). Figure 4 is a diagram illustrating the method for calculating the center coordinates of an image according to this embodiment.

[0038] As shown in Figure 4, if the coordinates of the four vertices of image EX-1 are (0,0), (0,Y'), (X',0), and (X',Y'), then the center coordinates P'(X'center,Y'center) of image EX-1, which captures a predetermined space including the moving object 1, will be (X' / 2,Y' / 2). Figure 5 is a diagram illustrating the method for calculating the distance between the center coordinates according to the embodiment.

[0039] The distance d between the center coordinates P(Xcenter, Ycenter) of the pause area A-1 shown in Figure 5 and the center coordinates P'(X'center, Y'center) of the image EX-1 shown in Figure 5 is calculated by the following equation (1).

[0040]

number

[0041] Figure 6 is a diagram illustrating an example of a method for setting the determination time according to the embodiment. The determination time is predetermined to be longer the closer the pause area A-1 (see, for example, Figures 3 and 5) is set to the center of the image EX-1 rather than the edge. That is, considering that the detection accuracy of the two-dimensional code 2 installed on the moving body 1 is higher the closer it is to the center of the shooting range, and the detection accuracy of the two-dimensional code 2 installed on the moving body 1 is lower the further it is from the center of the shooting range, the determination time for deriving the determination result that the moving body 1 is stopped is predetermined. The closer it is to the edge, for example as shown in Figure 6, the more it is possible to mechanically determine where the center coordinates P of the pause area A-1 (see, for example, Figures 3 and 5) is located in the image EX-1, the more the determination time corresponding to each of the multiple areas defined by the number of pixels from the center coordinates P' of the image EX-1 is set.

[0042] For example, the operator sets three areas for image EX-1 based on the number of pixels from the center coordinate P' of image EX-1. For example, a central area A-2 is a circular area less than 500 pixels from the center coordinate P' of image EX-1, a near-center area A-3 is a ring-shaped area between 500 pixels and 700 pixels from the center coordinate P' of image EX-1, and an edge area A-4 is an area between 700 pixels and 1000 pixels from the center coordinate P' of image EX-1.

[0043] Furthermore, the operator sets the judgment time corresponding to the central area A-2 to "1.0 (seconds)", the judgment time corresponding to the area near the center A-3 to "0.8 (seconds)", and the judgment time corresponding to the edge area A-4 to "0.6 (seconds)". Figures 7 to 9 are diagrams illustrating an example of the method for determining the judgment time according to the embodiment.

[0044] As shown in Figure 7, if the center coordinates P of the pause area A-1 are located in the center area A-2 of image EX-2, that is, if the distance d between the center coordinates P of the pause area A-1 and the center coordinates P' of image EX-2 is less than 500px (pixels), the determination time is set to "1.0 (seconds)". This allows us to derive the determination result that the moving object 1 is stopped in the pause area A-1, provided that the stopping time of the moving object 1 is "1.0 (seconds)". In other words, if the frame rate of the camera mounted on the lighting fixture 3 is set to 5fps, then five consecutive images of the two-dimensional code 2 must be detected.

[0045] Furthermore, as shown in Figure 8, if the center coordinates P of the pause area A-1 are located in area A-3 near the center of image EX-3, that is, if the distance d between the center coordinates P of the pause area A-1 and the center coordinates P' of image EX-3 is 500px (pixels) or more and less than 700px (pixels), the determination time is set to "0.8 (seconds)". This allows us to derive the determination result that the moving object 1 is stopped in pause area A-1, provided that the stopping time of the moving object 1 is "0.8 (seconds)". In other words, if the frame rate of the camera mounted on the lighting fixture 3 is set to 5fps, at least four consecutive images of the two-dimensional code 2 must be detected.

[0046] Furthermore, as shown in Figure 9, if the center coordinates P of the pause area A-1 are located in the edge area A-4 of image EX-4, that is, if the distance d between the center coordinates P of the pause area A-1 and the center coordinates P' of image EX-4 is 700px (pixels) or more, the determination time is set to "0.6 (seconds)". This allows us to derive the determination result that the moving object 1 is stopped in the pause area A-1, provided that the stopping time of the moving object 1 is "0.6 (seconds)". In other words, if the frame rate of the camera mounted on the lighting fixture 3 is set to 5fps, at least three consecutive images of the two-dimensional code 2 must be detected.

[0047] After determining the judgment time, the information processing device 100 determines the movement state of the moving object 1 based on the determined judgment time. For example, if the center coordinates P of the pause area A-1 are located in the center area A-2 of the image EX-1, the information processing device 100 derives a determination result that the moving object 1 is stopped in the pause area A-1, provided that the stopping time of the moving object 1 is "1.0 (seconds)".

[0048] In this way, when the information processing device 100 determines whether or not the moving object 1 is stopped in the temporary stopping area A-1 where it should stop, it can perform a determination process that corresponds to the detection accuracy when detecting the two-dimensional code 2, thereby improving the accuracy of the analysis of the movement of the moving object 1.

[0049] Furthermore, the information processing device 100 may determine the judgment time according to the detection accuracy that takes into account the area (size) of the pause area A-1. That is, if the distance d between the center coordinates is less than 500px (pixels) and the length of the long side of the pause area A-1 is less than 300px (pixels), the information processing device 100 may adopt the judgment time corresponding to the center area A-2.

[0050] Furthermore, the information processing device 100 may determine the judgment time according to the detection accuracy, taking into account the size of the two-dimensional code 2. For example, the judgment time may be adjusted taking into account that the detection accuracy of the two-dimensional code 2 increases as the size of the two-dimensional code 2 increases.

[0051] Furthermore, the information processing device 100 may determine the determination time according to the detection accuracy, taking into account the position where the two-dimensional code 2 is installed on the moving object 1. For example, if the two-dimensional code 2 is installed in a position that is difficult to photograph, the determination time may be adjusted taking into account the reduced detection accuracy of the two-dimensional code 2.

[0052] Furthermore, the information processing device 100 determines the judgment time according to the detection accuracy, which takes into account the time of day when the two-dimensional code 2 is photographed. For example, if the two-dimensional code 2 is photographed at a time when it is difficult to photograph it clearly, such as during twilight or backlighting, the judgment time may be adjusted to take into account the lower detection accuracy of the two-dimensional code 2.

[0053] Furthermore, the information processing device 100 may determine the judgment time according to the detection accuracy, taking into account the shooting position when photographing the two-dimensional code 2. For example, if the photograph is taken from above, such as from the ceiling, the judgment time may be adjusted taking into account that the detection accuracy of the two-dimensional code 2 decreases with distance from the ceiling.

[0054] Furthermore, the information processing device 100 may determine the judgment time according to the detection accuracy, taking into account the lighting conditions when photographing the two-dimensional code 2. For example, the judgment time may be adjusted taking into account that if the brightness of the lighting is high, the detection accuracy of the two-dimensional code 2 will be higher.

[0055] (3. Example of device configuration) Hereinafter, an example of the functional configuration of the information processing device 100 according to the embodiment will be described with reference to Figure 10. Figure 10 is a diagram showing an example of the functional configuration of the information processing device 100 according to the embodiment. The information processing device 100 according to the embodiment has a communication unit 110, a storage unit 120, and a processing unit 130.

[0056] (Communications Department 110) The communication unit 110 transmits and receives information with other devices, such as a control device that controls the lighting fixture 3 and terminal devices used by the operator. The communication unit 110 can be implemented, for example, by a predetermined communication circuit or NIC (Network Interface Card). The communication unit 31 can support any communication method. Communication methods supported by the communication unit 31 may include communication methods based on mobile data communication standards such as 4G, LTE (Long Term Evolution), and 5G, as well as communication methods based on wireless communication methods such as Wi-Fi (Local Area Network), Bluetooth (registered trademark), BLE (Bluetooth (registered trademark) Low Energy), and infrared communication.

[0057] (Storage unit 120) The storage unit 120 stores various types of information. For example, the storage unit 120 can store programs and data for implementing various controls performed by the processing unit 130. The storage unit 120 can be implemented using, for example, semiconductor memory elements such as RAM or flash memory, or storage devices such as hard disks or optical discs. If the storage unit 120 is implemented using flash memory, it may also be implemented using a removable, portable recording medium such as an SD card.

[0058] The storage unit 120 may store a dedicated application that has the function of executing information processing according to the embodiment. The storage unit 120 may also store various programs and data according to the purpose. As shown in Figure 10, the storage unit 120 has an image information storage unit 121 and a determination time storage unit 122.

[0059] (Image information storage unit 121) The image information storage unit 121 stores image information relating to a photograph taken of a predetermined space including the mobile body 1 on which the two-dimensional code 2 is installed. Figure 11 is a diagram showing an overview of the image information stored in the image information storage unit 121 according to this embodiment.

[0060] As shown in Figure 11, the image information stored in the image information storage unit 121 has multiple items, such as a "facility ID," a "lighting information," and an "image information." These items in the image information are interconnected.

[0061] The "Facility ID" field stores identification information to identify the facility where the image was taken. The "Lighting Information" field stores information about the lighting fixture 3 on which the camera that took the image is installed. For example, the information about lighting fixture 3 may include information about its installation location and lighting mode. The "Image Information" field stores image information of the image taken by the camera installed in lighting fixture 3.

[0062] (Decision time storage unit 122) The determination time storage unit 122 stores information on the determination time for determining whether or not the moving object 1 moving within the facility is stopped in the temporary stopping area A-1. For example, as shown in Figure 6 above, the determination time storage unit 122 stores information on the determination time predetermined for each image area set based on the distance from the center of the image. The determination time is predetermined to be longer the closer the temporary stopping area A-1 is set to the center of the image than the edge.

[0063] (Processing unit 130) The processing unit 130 is, for example, a control circuit (i.e., a controller) that controls each part of the information processing device 100, and has internal memory for storing programs that define various processing procedures and required data, and executes various processes using these. The processing unit 130 can be implemented by a microcomputer or the like. A microcomputer is equipped with a processor such as a CPU (Central Processing Unit) or MPU (Micro Processing Unit), and storage devices such as ROM (Read Only Memory) or RAM.

[0064] The ROM stores programs for controlling various parts of the information processing device 100, as well as application programs (for example, dedicated apps) for executing various processes. The CPU or other processor executes the programs and apps stored in the ROM, thereby enabling the microcomputer to control the information processing device 100 and realize various functions.

[0065] RAM is used as a memory area necessary for the execution of calculations by a processor such as a CPU. The processing unit 130 may also control the information processing device 100 and perform various functions by reading programs stored in the storage unit 120 and executing the read programs. Furthermore, the processing unit 130 may be implemented by an integrated circuit such as an ASIC (Application Specific Integrated Circuit), FPGA (Field Programmable Gate Array), or SoC (System-on-a-chip).

[0066] As shown in Figure 10, the processing unit 130 includes an acquisition unit 131, a determination unit 132, and a judgment unit 133.

[0067] (Acquisition part 131) The acquisition unit 131 acquires an image of a predetermined space including the mobile body 1 on which the two-dimensional code 2 is installed. For example, the acquisition unit 131 acquires image information of an image taken by a camera mounted on the lighting fixture 3 via the communication unit 110.

[0068] (Decision Section 132) The determination unit 132 determines a determination time to determine whether the moving object 1 is stopped or not, according to the detection accuracy when detecting the two-dimensional code 2 from the image acquired by the acquisition unit 131. For example, the determination unit 132 determines the determination time according to the detection accuracy based on the position in the image of the pause area A-1 set for an image of a predetermined space.

[0069] Specifically, the determination unit 132 refers to the determination time information stored in the determination time storage unit 122, and determines the determination time to be "1.0 (seconds)" if the center coordinates P of the pause area A-1 are located in the center area A-2 of the image EX-1, that is, if the distance d between the center coordinates P of the pause area A-1 and the center coordinates P' of the image EX-1 is less than 500px (pixels) (see Figures 6 and 7).

[0070] Furthermore, the determination unit 132 refers to the determination time information stored in the determination time storage unit 122, and if the center coordinates P of the pause area A-1 are located in the area A-3 near the center of image EX-1, that is, if the distance d between the center coordinates P of the pause area A-1 and the center coordinates P' of image EX-1 is 500px (pixels) or more and less than 700px (pixels), the determination time is set to "0.8 (seconds)" (see Figures 6 and 8).

[0071] Furthermore, the determination unit 132 refers to the determination time information stored in the determination time storage unit 122 and determines the determination time to be "0.6 (seconds)" if the center coordinates P of the pause area A-1 are located in the edge area A-4 of the image EX-1, that is, if the distance d between the center coordinates P of the pause area A-1 and the center coordinates P' of the image EX-1 is 700px (pixels) or more (see Figures 6 and 9).

[0072] Furthermore, the determination unit 132 can determine the judgment time according to the detection accuracy that takes into account the area of ​​the pause area A-1. For example, if the distance d between the center coordinates is less than 500px (pixels) and the length of the long side of the pause area A-1 is less than 300px (pixels), the determination unit 132 may adopt the judgment time corresponding to the center area A-2.

[0073] Furthermore, the determination unit 132 may determine the determination time according to the detection accuracy, taking into account the size of the two-dimensional code 2. For example, the determination time may be adjusted taking into account that the detection accuracy of the two-dimensional code 2 increases as the size of the two-dimensional code 2 increases.

[0074] Furthermore, the determination unit 132 may determine the determination time according to the detection accuracy, taking into account the position where the two-dimensional code 2 is installed on the moving body 1. For example, if the two-dimensional code 2 is installed in a position that is difficult to photograph, the determination time may be adjusted taking into account the reduced detection accuracy of the two-dimensional code 2.

[0075] Furthermore, the determination unit 132 determines the judgment time according to the detection accuracy, which takes into account the time of shooting when the two-dimensional code 2 is photographed. For example, if the two-dimensional code 2 is photographed at a time when it is difficult to photograph it clearly, such as during twilight or backlighting, the judgment time may be adjusted to take into account the lower detection accuracy of the two-dimensional code 2.

[0076] Furthermore, the determination unit 132 may determine the determination time according to the detection accuracy, taking into account the shooting position when photographing the two-dimensional code 2 (the positional relationship between the lighting fixture 3 and the two-dimensional code 2). For example, if the photograph is taken from above, such as from the ceiling, the determination time may be adjusted taking into account that the detection accuracy of the two-dimensional code 2 decreases with distance from the ceiling.

[0077] Furthermore, the determination unit 132 may determine the determination time according to the detection accuracy, taking into account the lighting conditions when photographing the two-dimensional code 2. For example, the determination time may be adjusted to take into account that if the brightness of the lighting is high, the detection accuracy of the two-dimensional code 2 will be higher.

[0078] (Judgment unit 133) The determination unit 133 determines the movement state of the moving object 1 based on the determination time determined by the decision unit 132. For example, if the center coordinates P of the pause area A-1 are located in the center area A-2 of the image EX-2 (see Figure 7 for example), the determination unit 133 derives a determination result that the moving object 1 is stopped in the pause area A-1, provided that the stopping time of the moving object 1 is "1.0 (seconds)".

[0079] (Processing by information processing device 100) The following describes the processing flow by the information processing device 100 according to the embodiment, using Figure 12. Figure 4 is a flowchart showing an example of the processing procedure by the information processing device 100 according to the embodiment.

[0080] As shown in Figure 12, the acquisition unit 131 acquires image information of the target facility according to the operator's instructions (step S101). For example, the acquisition unit 131 acquires an image of a predetermined space including the mobile body 1 on which the two-dimensional code 2 is installed at the target facility.

[0081] Furthermore, the decision unit 132 receives from the operator the setting of a pause area A-1 (for example, see Figure 2, etc.) for the image EX-1 of the target facility (for example, see Figure 2) (step S102).

[0082] Furthermore, the determination unit 132 obtains the center coordinates P of the pause area A-1 and the center coordinates P' of the image EX-1 (step S103).

[0083] Furthermore, the determination unit 132 calculates the distance d between the center coordinates (step S104), and determines the determination time based on the calculated distance d (step S105).

[0084] Furthermore, the determination unit 133 determines whether or not the moving body 1 is stopped based on the determination time determined by the decision unit 132 (step S106), and terminates the processing procedure shown in Figure 12.

[0085] [others] In the above embodiment, an example was described in which the information processing device 100 employs a rectangular pause area A-1, but it is not limited to this example. For example, the information processing device 100 may employ a pause area A-1 that is not rectangular, such as a quadrilateral, triangle, circle, or ellipse.

[0086] Furthermore, in the above embodiment, an example was described in which the information processing device 100 sets the determination time based on the distance d between the center coordinates, but this example is not particularly limiting. For example, the information processing device 100 may set one of the coordinates of the four sides of the pause area A-1 as a representative coordinate instead of the center coordinate P of the pause area A-1, calculate the distance between the set representative coordinate and the center coordinate P' of the image EX-1, and set the determination time based on the calculated distance. Also, if the pause area A-1 is not a rectangle but a triangle or other shape, the information processing device 100 may set the centroid as the representative coordinate.

[0087] Furthermore, in the above embodiment, the information processing device 100 can perform the detection process of the two-dimensional code 2 contained in the image EX-1 using a trained model that has been trained to detect two-dimensional codes from images.

[0088] Furthermore, a dedicated application for realizing the information processing performed by the information processing device 100 according to the above embodiment may be stored and distributed on a computer-readable recording medium such as an optical disc, semiconductor memory, magnetic tape, or flexible disc. In this case, for example, the information processing device 100 installs the dedicated application read from the recording medium and performs the information processing described above.

[0089] Furthermore, the operation history described in the above embodiment and the dedicated application may be stored on a disk device provided by a server device or cloud system on a network such as the Internet, and made available for download to the information processing device 100. Alternatively, the functions realized by the dedicated application may be realized through the cooperation of the OS (Operating System) and application software. In this case, the parts other than the OS may be stored on a medium and distributed, or the parts other than the OS may be stored on a server device or cloud system and made available for download to the information processing device 100.

[0090] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by known methods. In addition, the processing procedures, specific names, and information including various data and parameters shown in the above document and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each figure is not limited to the information shown.

[0091] Although embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments are included in the scope and spirit of the invention, as well as in the claims and their equivalents. Furthermore, these embodiments can be combined as appropriate, without contradicting the processing content.

[0092] Furthermore, the effects described herein are merely illustrative and not limiting, and other effects may also occur. [Explanation of Symbols]

[0093] SYS Information Processing System 1 Mobile Unit 2. Two-dimensional code 3 Lighting fixtures 100 Information Processing Devices 110 Communications Department 120 Storage section 130 Processing Unit 131 Acquisition Department 132 Decision Section 133 Judgment section

Claims

1. An acquisition unit that acquires an image of a predetermined space including a mobile object on which code information is installed; A determination unit determines a determination time for determining whether the moving object is stopped or not, according to the detection accuracy when detecting the code information from the image acquired by the acquisition unit; An information processing device characterized by comprising:

2. The aforementioned determination unit, The determination time is determined according to the detection accuracy based on the position of a predetermined area in the image, which is set for the image. The information processing apparatus according to feature 1.

3. The aforementioned determination unit, The determination time is determined according to the detection accuracy, which takes into account the area of ​​the predetermined area. The information processing apparatus according to feature 2.

4. The aforementioned determination unit, The determination time is determined according to the detection accuracy, which takes into account the size of the code information. The information processing apparatus according to feature 2.

5. The aforementioned determination unit, The determination time is determined according to the detection accuracy, which takes into account the position where the code information is installed on the moving object. The information processing apparatus according to feature 2.

6. The aforementioned determination unit, The determination time is determined according to the detection accuracy, which takes into account the time of capture when the code information is captured. The information processing apparatus according to feature 2.

7. The aforementioned determination unit, The determination time is determined according to the detection accuracy, which takes into account the position at which the code information is captured. The information processing apparatus according to feature 2.

8. The aforementioned determination unit, The determination time is determined according to the detection accuracy, which takes into account the lighting conditions when capturing the code information. The information processing apparatus according to feature 2.

9. The determination time is The predetermined area is defined in advance to be longer as it is set closer to the center than to the edges of the image. The information processing apparatus according to feature 2.

10. The acquisition unit is, The image of the code information captured by the camera mounted on the lighting fixture is acquired. An information processing apparatus according to any one of claims 1 to 9.

11. A method of information processing performed by a computer, An acquisition step of acquiring an image of a predetermined space including a mobile object on which code information is installed; A determination step is to determine a determination time for determining whether the moving object is stopped or not, according to the detection accuracy when detecting the code information from the image acquired in the acquisition step; An information processing method characterized by including

12. An acquisition unit that acquires an image of a predetermined space including a mobile object on which code information is installed; A determination unit determines a determination time for determining whether the moving object is stopped or not, according to the detection accuracy when detecting the code information from the image acquired by the acquisition unit; An information processing system characterized by comprising the following features.

Images