Mobile object passage determination system and determination method

Abstract

To provide a moving object passage determination system and a determination method that can be realized with simple structure and at low cost.SOLUTION: A moving object passage determination system that counts moving objects that pass through a predetermined passage determination target area in a predetermined direction includes: a plurality of AR markers that are arranged at least along a passing direction on one side in a direction crossing the passing direction of the moving objects in the passage determination target area and have different patterns; imaging means that is arranged on a side facing the plurality of AR markers in the passage determination target area and photographs the moving objects passing through the passage determination target area and the plurality of AR markers; passage determination means for determining the passage of the moving objects based on an image signal of an image photographed by the imaging means; and output means for outputting a determination result by the passage determination means. The passage determination means is configured to determine the passage of the moving objects based on the number of hidden AR markers photographed by the imaging means when the moving objects pass through the passage determination target area.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a mobile object passage determination system and method capable of counting the number of passengers and users of mobile objects passing through a predetermined passage determination target area in a predetermined direction, for example, public transportation such as buses and the like, and public facilities. [Background technology]

[0002] In public transportation, public facilities, commercial facilities, etc., it is important to accurately count the number of users. Focusing on public transportation, especially bus boarding and alighting, passenger counting is generally done based on the signal of an infrared sensor installed at the entrance. When a person passes in front of the sensor, the count in the counting device increases by one, so if the sensor is installed at the entrance and alighting, the number of people boarding (alighting) can be counted. This system, which is widely used on buses, can only obtain information on the passage of the point where the sensor is installed, and cannot handle turning back or stopping from that point. In addition, when introducing the device, the cost and driving power of the infrared sensor must be taken into consideration. Furthermore, in many cases, the system itself is not connected to the Internet, and the counting results are often available after the operation has ended. Therefore, in order to count the number of people during operation, it is desirable to be able to connect to the Internet like other IoT devices.

[0003] Another method is to install a camera at the boarding / alighting entrance and perform person recognition using images obtained from the camera. The input image is processed, person recognition is performed, and the number of passengers is allocated. This method overcomes the problems of turning back and stopping when using the infrared sensor described above, but accurate person recognition through image processing requires a lot of computational resources (data processing capacity), which leads to increased costs for the installed equipment and creates new problems such as privacy protection for photographing people. Note that if person recognition processing is performed on a server on the Internet, an increase in network traffic due to image transfer becomes a problem. Therefore, a mechanism is needed that enables person recognition processing within the installed equipment.

[0004] Additionally, in order to accurately grasp the number of passengers boarding and alighting, and transfer that information to a server to display the bus's congestion status and develop efficient operation plans, a system is needed that processes sensor signals or camera images using only equipment installed on the bus, and uploads the obtained information regarding the number of passengers to a server via the Internet.

[0005] In recent years, an on-board ticket examination support system has been proposed as a system for managing passengers getting on and off in public transportation (for example, Patent Document 1). The on-board ticket examination support system disclosed in Patent Document 1 includes a ticket examination device for boarding and disembarking processing, a pass sensor, a photographing device, a control device for controlling these devices, an image storage server connected to the control device, an on-board wireless device connected to the image storage server, an image display terminal carried by an on-board ticket examination attendant that communicates with the on-board wireless device, a management device for the number of people to be examined connected to the control device, and a display device for the number of people to be examined connected to the management device for the number of people to be examined.

[0006] A route bus boarding and alighting measurement system has also been proposed to measure boarding and alighting on buses (for example, Non-Patent Document 1). This route bus boarding and alighting measurement system combines a laser scanner and a single-board computer to determine boarding and alighting on a bus, extracts a point cloud corresponding to the surface of an object using a background subtraction method, and detects a point cloud corresponding to the surface of a human body from the point cloud. Based on this, the point cloud of each passenger is tracked, and the number of passengers getting on and off is measured by detecting when they pass through the door. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] JP 2009-217322 A [Non-patent literature]

[0008] [Non-Patent Document 1] Yuma Yamada and 3 others, “High-precision bus boarding and alighting measurement system using range finder”, Transactions of Information Processing Society of Japan, March 2019, Vol. 60, No. 3, p p. 934-944 Summary of the Invention [Problem to be solved by the invention]

[0009] However, the on-board ticket inspection support system disclosed in Patent Document 1 involves attaching a passing sensor to allow passengers to pay the fare at the same time as they board and disembark, which results in a problem that the equipment and system configuration is large-scale, and furthermore, it poses the need to build a payment system using IC cards or cashless payment.

[0010] In addition, the route bus boarding and alighting measurement system disclosed in Non-Patent Document 1 uses a laser scanner for detection, which requires special equipment installation and results in a relatively expensive system configuration.

[0011] SUMMARY OF THE PRESENT EMBODIMENTS Accordingly, an object of the present invention is to provide a moving object passage determination system and method that can be realized with a simple configuration and at low cost.

[0012] Another object of the present invention is to provide a mobile object passage determination system and method capable of dealing with a mobile object turning back or stopping in a passage determination target area and capable of performing accurate passage determination.

[0013] It is still another object of the present invention to provide a moving object passage determination system and method capable of dealing with cases in which a plurality of moving objects pass through a passage determination target area and capable of performing accurate passage determination. [Means for solving the problem]

[0014] According to the present invention, the moving object passage determination system is a moving object passage determination system that counts moving objects passing through a specified passage determination target area in a specified direction, and includes a plurality of AR markers having different patterns arranged along at least one side of the passing direction of the moving object in the passing determination target area, a photographing means arranged on the opposite side to the plurality of AR markers in the passing determination target area and photographing the moving object and the plurality of AR markers passing through the passing determination target area, a passing determination means that determines the passage of the moving object based on an image signal of the image photographed by the photographing means, and an output means that outputs the determination result by the passing determination means, and the passing determination means is configured to determine the passage of the moving object based on the number of hidden AR markers photographed by the photographing means when the moving object passes through the passing determination target area.

[0015] By using an AR (Augmented Reality) marker, which is a two-dimensional barcode, and a photographing means, when a moving body (person or object) passes through a passage determination target area, the passage (direction and count) of the moving body is determined based on the number of hidden AR markers photographed by the photographing means, which can be realized with a simple configuration and at low cost. In addition, the stopping of the moving body in the passage determination target area does not directly affect the determination.

[0016] It is preferable that the passage determination means, when the moving object passes through the passage determination target area, determines a passing direction of the moving object based on an order in which the plurality of AR markers photographed by the photographing means are hidden.

[0017] It is preferable that a plurality of AR markers having different patterns are further arranged along a vertical direction perpendicular to the passing direction of the passing judgment target area, and the passing judgment means is configured to judge the passing of the moving body based on the number of the plurality of hidden AR markers in the vertical direction photographed by the photographing means when the moving body passes through the passing judgment target area. This makes it possible to deal with differences in the vertical size of the moving body P.

[0018] It is also preferable that the passage determination means is configured to cancel the process of determining passage of the moving object when the moving object turns back from the passage determination target area. This allows the moving object to respond to turning back from the passage determination target area and enables accurate passage determination.

[0019] It is also preferable that the multiple AR markers are arranged at a predetermined interval in the passing direction of the moving bodies so as to ensure that at least one AR marker is not hidden between two adjacent moving bodies when the multiple moving bodies pass through the passing judgment target area, and the passing judgment means is configured to separate the multiple moving bodies into threads so that the patterns of the multiple hidden AR markers are continuous when the multiple moving bodies pass through the passing judgment target area, and to judge the passing of the multiple moving bodies based on predefined prohibited transitions and the priority of the multiple threads that reach the same thread. This makes it possible to accurately judge the passing of the multiple moving bodies when they pass through the passing judgment target area.

[0020] According to the present invention, the moving object passage determination method is a moving object passage determination method for counting the number of moving objects passing through a predetermined passage determination target area in a predetermined direction, and photographs a plurality of AR markers having different patterns arranged along at least one side of the direction crossing the passing direction of the moving object in the passage determination target area, and the moving object passing through the passage determination target area, and determines the passage of the moving object based on the number of hidden AR markers photographed by the photographing means when the moving object passes through the passage determination target area. This allows for a simple configuration and low cost implementation. In addition, the stopping of the moving object in the passage determination target area does not directly affect the determination.

[0021] It is also preferable that when a moving object passes through the passage determination target area, the passing direction of the moving object is determined based on the order in which the photographed multiple AR markers are hidden.

[0022] It is also preferable to further arrange a plurality of AR markers having different patterns along a vertical direction perpendicular to the passage direction of the passage determination target area, and to determine the passage of the moving body based on the number of hidden AR markers in the vertical direction photographed when the moving body passes through the passage determination target area.

[0023] It is also preferable to cancel the process of determining whether a moving object has passed through the pass-through determination area when the moving object has returned from the pass-through determination area. This allows the moving object to return from the pass-through determination area and enables accurate pass-through determination.

[0024] It is also preferable to arrange the multiple AR markers at a predetermined interval in the passing direction of the moving bodies so as to ensure that at least one AR marker is not hidden between two adjacent moving bodies when the multiple moving bodies pass through the passing determination target area, separate the multiple moving bodies into threads so that the patterns of the multiple hidden AR markers are continuous when the multiple moving bodies pass through the passing determination target area, and determine the passing of the multiple moving bodies based on predefined prohibited transitions and the priority of multiple threads that reach the same thread. This makes it possible to accurately determine the passing of the multiple moving bodies when they pass through the passing determination target area. Effect of the Invention

[0025] According to the present invention, the AR marker and the photographing means are used, and when a moving body (person or object) passes through the passage determination target area, the passage (direction and count) of the moving body is determined based on the number of hidden AR markers photographed by the photographing means. This allows the use of a very small camera module and a small board (single board computer) with PC functions without using a dedicated sensor such as an infrared sensor as in the past, and therefore the simple configuration and low cost can be realized. In addition, since the pattern in which the multiple AR markers are hidden is used for the passage determination, it is possible to introduce a process that excludes or does not count excessively the turning back or stopping during the passage. Therefore, the moving body can respond to the turning back or stopping from the passage determination target area, and accurate passage determination can be easily realized. Furthermore, it is possible to connect to the Internet via a mobile router using a mobile phone line.

[0026] That is, the present invention uses an AR marker, which is a two-dimensional barcode, for pass judgment, arranges the AR marker according to the rules required for judgment, and judges whether a moving body (person or object) has passed by the pattern where the marker is hidden in the captured video. The arrangement of the AR marker can be extended depending on the size of the target boarding / alighting entrance, and accurate pass judgment can be performed by defining the pass pattern. The AR marker can be printed with a normal PC printer, and if it is printed on a sticker or the like, it can be easily attached to the required location. The function required for the camera used for shooting is the performance to shoot videos with a certain degree of resolution and frequency (fps), and to satisfy this, a general-purpose camera module or a camera built into a smartphone can be used instead. Therefore, the present invention does not process how the image in the captured video changes, but performs pass judgment processing by an algorithm that recognizes only the pattern where multiple AR markers are hidden, so there is an advantage that the required processing power is overwhelmingly suppressed. Therefore, the pass judgment processing can be performed with sufficient margin on a single board computer to which the camera is supposed to be connected.

[0027] In addition, in order to provide versatility to the installation situation, the arrangement of multiple AR markers is defined so that it can be expanded along the passing direction, and even when the number of AR markers increases, the passing judgment pattern can be generalized and program code can be created. For these reasons, the present invention can be installed at the bus entrance at low cost and with easy installation conditions, and its judgment processing has a wide range of application that can handle turning back and stopping. Furthermore, the device configuration expected to build the system makes it possible to easily connect to the Internet like other IoT devices, and to provide real-time information on the number of people getting on and off. [Brief description of the drawings]

[0028] [Figure 1] 1 is a conceptual diagram illustrating a schematic configuration of a moving object passage determination system according to an embodiment of the present invention; [Diagram 2] 2 is a block diagram showing an outline of the electrical configuration of the moving object passage determination system of FIG. 1; [Diagram 3] 2 is a conceptual diagram for explaining a moving object passage determination method in the embodiment of FIG. 1. FIG. [Figure 4] 13A and 13B are diagrams illustrating the relationship between the passing state and the hiding state of the AR marker when the size of a moving object is the size of one marker. [Diagram 5] FIG. 13 is a diagram showing the relationship between the passing state and the hiding state of the AR marker when the size of a moving object is the size of two markers. [Figure 6] FIG. 13 is a diagram showing the relationship between the passing state and the hiding state of the AR marker when the size of a moving object is the equivalent of three markers. [Figure 7] 2 is a flowchart illustrating the operation of the moving object passage determination system of FIG. 1. [Figure 8] FIG. 11 is a conceptual diagram for explaining a moving object passage determination method according to another embodiment of the present invention. [Figure 9] FIG. 11 is a conceptual diagram for explaining a moving object passage determination method according to another embodiment of the present invention. [Figure 10] FIG. 11 is a conceptual diagram for explaining an example of decomposing the passing patterns of a plurality of moving objects into threads. [Figure 11] FIG. 11 is a conceptual diagram for explaining possible combinations of transitions of each pattern during the passage of a plurality of moving objects. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0029] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of a moving object passage determination system and a determination method according to the present invention will be described with reference to the drawings.

[0030] FIG. 1 shows a schematic configuration of a moving object passage determination system 100 according to an embodiment of the present invention, and FIG. 2 shows a schematic electrical configuration of the moving object passage determination system 100. As shown in FIG.

[0031] As shown in Fig. 1 and Fig. 2, the moving object passage determination system 100 in this embodiment includes a plurality of AR markers 10, a photographing means 20 arranged on the side facing the plurality of AR markers 10 in the passage determination target area F, which photographs a moving object (person or object) P passing through the passage determination target area F and the plurality of AR markers 10, a passage determination means 30 which determines the passage (direction and count) of the moving object P based on an image signal of the image photographed by the photographing means 20, and an output means 40 which outputs the determination result by the passage determination means 30. The moving object passage determination system 100 is assumed to be installed, for example, at an entrance or exit with a width of about 1 meter, such as a bus boarding / alighting entrance or an entrance gate of a public facility, and basically only one moving object P passes through at a time. A plurality of AR markers 10 are arranged on one side of the passage of the entrance or exit, a photographing means 20 is installed on the opposite side of the passage, and the plurality of AR markers 10 are photographed from the opposite side of the passage.

[0032] The multiple AR markers 10 are composed of, for example, three two-dimensional barcodes. The three AR markers 10 are formed to have different patterns. The three AR markers are arranged according to rules required for judgment. That is, they are arranged along the passing direction on one side wall W1 of the passage judgment target area F in a direction intersecting the passing direction of the moving object P. Also, each of the three AR markers 10 is given an ID (for example, "1," "2," and "3" from the left). These AR markers 10 can be printed with a normal PC printer, and if printed on a sticker or the like, they can be easily attached to the required location.

[0033] The imaging means 20 is disposed on a side wall W2 facing the multiple AR markers 10 of the passage determination target area F, and images the moving object P and the multiple AR markers 10 passing through the passage determination target area F. The imaging means 20 may be a small camera module capable of capturing video with a certain degree of resolution and frequency (fps), or a camera built into a smartphone. The imaging means 20 is configured to transfer the captured digital image signal to the passage determination means 30 via wired or wireless communication means.

[0034] 2, the passage determination means 30 is composed of a computer equipped with a display unit 31, a transmission unit 32, a reception unit 33, an input unit 34, a data bus 35, a storage unit 36, and a processing unit 37. The passage determination means 30 can be, for example, a single board computer.

[0035] The display unit 31 is made up of an LCD (Liquid Crystal Display) or an EL display (Electroluminescence Display) and is configured to display message information made up of characters or images, etc. It is not necessary to provide the display unit 31.

[0036] The transmission unit 32 constitutes the output means 40 of this embodiment, and is configured to transmit output signals such as the determination results processed in the processing unit 37 to the outside via a wired or wireless communication network.

[0037] The receiving unit 33 is configured to receive information such as a digital image signal transmitted from the photographing means 20. The digital image signal (image data) acquired by the receiving unit 33 is stored in a storage unit 36. The receiving unit 33 is also configured to be capable of receiving a control signal from the outside via a wired or wireless communication network.

[0038] The input unit 34 is composed of a keyboard or a touch panel, and is used to input registration information such as IDs of the multiple AR markers 10, transmission / reception addresses, processing operation start commands, and other necessary information. The input unit 34 may be connected and installed only when necessary.

[0039] The data bus 35 is connected between the display unit 31, the transmitting unit 32, the receiving unit 33, the input unit 34, the storage unit 36, and the processing unit 37, and is provided to enable data transfer among them in accordance with the control program.

[0040] The storage unit 36 ​​is mainly composed of, for example, a hard disk (HDD), and memories such as RAM and ROM. The storage unit 36 ​​is provided with a control program storage unit 36a, an image data storage unit 36b, an AR marker ID storage unit 36c, a passing pattern storage unit 36d, and a passing number storage unit 36e. The control program storage unit 36a stores a program for controlling the operation of the passing determination means 30. The image data storage unit 36b temporarily stores image data photographed by the photographing means 20. The AR marker ID storage unit 36c stores IDs previously assigned to the multiple AR markers 10. The passing pattern storage unit 36d stores previously registered passing patterns, for example, a passing pattern when the size of the moving object P is the size of one marker, a passing pattern when the size of the moving object P is the size of two markers, and a passing pattern when the size of the moving object P is the size of three markers. In addition, a threshold value for the increase in the number of hidden markers set in advance is stored in order to determine passing. The passing number storage unit 36e stores the result of counting the number of passes.

[0041] The processing unit 37 includes a CPU (Central Processing Unit) and controls the overall operation of the moving object passing determination system 100 according to a control program. The control program is configured to configure a hidden marker counting means 37a that counts the number of AR markers hidden by the moving object P from an image captured by the image capturing means 20, a passing determination means 37b that determines the passing of the moving object P based on the counting result of the hidden marker counting means 37a, a passing number counting means 37c that counts the number of passing markers, a return determination means 37d, and a cancellation means 37e that cancels the counting process of the passing determination of the moving object P when the moving object P returns from the passing determination target area F. In the processing unit 37, a known image calculation library that can be performed at high speed can be used to determine the AR markers in the image. The return determination means 37d determines the return by, for example, checking the order in which the multiple AR markers 10 are hidden when the moving object P passes (i.e., the passing pattern).

[0042] Hereinafter, an example of performing a passing judgment when a moving object P passes through a passing judgment target area F using the moving object passing judgment system 100 in this embodiment will be described with reference to Figs. 3 to 7. Fig. 3 is a conceptual diagram of a moving object passing judgment method in the present invention. Fig. 4 shows an example of the relationship between the passing state and the AR marker hiding state when the size of the moving object P is one marker width, Fig. 5 shows an example of the relationship between the passing state and the AR marker hiding state when the size of the moving object P is two marker widths, and Fig. 6 shows an example of the relationship between the passing state and the AR marker hiding state when the size of the moving object P is three marker widths. Fig. 7 shows the operation of the moving object passing judgment system 100.

[0043] 3 to 6, the passage determination is performed based on an increase in the number of AR markers 10 hidden by the moving object P and a threshold value thereof when the moving object P passes through the passage determination target area F. When the moving object P passes through the passage determination target area F, the increase in the number of AR markers 10 hidden by the moving object P changes, for example, as shown in FIGS. 4 to 6. As shown in FIG. 4, the passing pattern when the size of the moving body P is one marker width is (0,0,0) → (0,0,1) → (0,1,0) → (1,0,0) → (0,0,0). As shown in FIG. 5, the passing pattern when the size of the moving body P is two marker widths is (0,0,0) → (0,0,1) → (0,1,1) → (1,1,0) → (1,0,0). As shown in FIG. 6, the passing pattern when the size of the moving body P is three marker widths is (0,0,0) → (0,0,1) → (0,1,1) → (1,1,1) → (1,1,0) → (1,0,0) → (0,0,0). In the above passing patterns, the (0,0,0), (0,0,1) and (1,0,0) → (0,0,0) portions at both ends are common, and only the intermediate states change depending on the size of the passing moving object P. For example, the passing pattern when the size of the moving object P is three marker widths transitions as (0,1,1) → (1,1,1) → (1,1,0), so the numerical counter for determining passing can be incremented accordingly, and when it reaches a preset threshold value, it can be treated as a "pass" and the number of passes can be counted.

[0044] As shown in FIG. 7, when performing a passing judgment using the moving object passing judgment system 100, a plurality of AR markers 10 (for example, three AR markers) having different patterns are arranged in advance along the passing direction of one side wall surface W1 in a direction crossing the passing direction of the moving object P in the passing judgment target area F. When the moving object P passes through the passing judgment target area F, first, the AR marker 10 is photographed by the photographing means 20 (step S1). Next, the number of AR markers 10 hidden by the moving object P when the moving object P passes through the passing judgment target area F is counted (step S2). For example, when passing from the left side to the right, when the first marker is hidden, 1 is counted, when the second marker is hidden, 1 is added, and when the third marker is hidden, 1 is added. Next, it is determined whether the count number has reached a preset threshold value (for example, 3) (step S3). Here, if it is determined that the count number has not reached the threshold value, the process returns to step S2 and the above-mentioned process is repeated. On the other hand, if it is determined that the count number has reached the threshold, it is treated as a "pass" and a process of counting the number of passes is performed (step S4). Next, it is determined whether the moving object P has turned back from the pass determination target area F (step S5). Here, for example, the passing pattern is collated to determine whether there has been a change in the direction opposite to the hiding of the AR marker 10 by the moving object P (from right to left, which is the opposite of the passing pattern in Figures 4 to 6), and whether there has been a turn back is determined. If it is determined that there has been no turn back, the counting result of the number of passes is output in step S6.

[0045] On the other hand, if it is determined in step S5 that the moving object P has returned from the passage determination target area F, the counting process for the passage of the moving object P is cancelled in step S7, and the process proceeds to step S6. The cancellation process here involves, for example, adding "-1" to the count number and decreasing it by one.

[0046] As described in detail above, according to this embodiment, the moving object passage determination system 100 includes a plurality of AR markers 10, an imaging means 20 that is arranged on the side opposite the plurality of AR markers 10 in the passage determination target area F and images the moving object P and the plurality of AR markers 10 passing through the passage determination target area F, a passage determination means 30 that determines the passage (direction and count) of the moving object P based on an image signal of the image captured by the imaging means 20, and an output means 40 that outputs the determination result by the passage determination means 30.

[0047] This makes it possible to use a very small camera module and a small board (single board computer) with PC functions, without using a dedicated sensor such as an infrared sensor as in the past, and therefore allows for a simple configuration and low cost. In addition, since a pattern in which multiple AR markers 10 are hidden is used for the passage determination, it is possible to introduce a process that excludes or does not count excessively turning back or stopping during the passage. Therefore, it is possible for the moving object P to turn back or stop from the passage determination target area F, and accurate passage determination can be easily achieved. Furthermore, it is possible to connect to the Internet via a mobile router that uses a mobile phone line.

[0048] In the above embodiment, the multiple AR markers 10 are arranged along at least one side of the passing direction of the moving object P in the passing judgment target area F, but the present invention is not limited to this. For example, as shown in FIG. 8, multiple AR markers 10 and 10A having different patterns are also arranged along the vertical direction perpendicular to the passing direction of the passing judgment target area F, and the passing judgment means 30 may be configured to judge the passing of the moving object P based on the number of hidden AR markers 10 and 10A in the vertical direction photographed by the photographing means 20 when the moving object P passes through the passing judgment target area F. In this case, by arranging multiple AR markers 10 and 10A having two different patterns in the vertical direction and assigning the same ID, it is possible to deal with the difference in the vertical size of the moving object P. For example, when installed at the entrance of a bus, it is possible to deal with the height difference between adults and children, and it is possible to perform the passing judgment for each. In addition, when multiple AR markers 10 and 10A having two different patterns are arranged in the vertical direction, it is possible to prevent misreading of the AR markers during the passing judgment.

[0049] In the above embodiment, an example has been described in which three AR markers 10 arranged along the passing direction and each having a different pattern are used, but the present invention is not limited to this. Two or four or more AR markers may be used.

[0050] In the above-described embodiment, an example has been described in which the process for determining whether or not the moving object P has turned back from the pass determination target area F has been performed, but the present invention is not limited to this. For example, it is not necessary to take into consideration the moving object P turning back from the pass determination target area F as necessary.

[0051] In the above embodiment, the photographing means 20 and the passage determination means 30 are configured separately, but the present invention is not limited to this. For example, equipment in which the photographing means 20 such as a camera and the passage determination means 30 having a calculation function are integrated may be used. This expands the range of possible implementation forms of the system.

[0052] Hereinafter, an example in which passage determination is performed when a plurality of moving bodies (persons) P pass through a passage determination target area F using the moving body passage determination system 100 in this embodiment will be described with reference to FIGS.

[0053] Fig. 9 is a conceptual diagram of a moving object passage determination method when multiple persons P pass through a passage determination target area F in the present invention. Fig. 10 is a conceptual diagram for explaining an example of decomposing the passage patterns of multiple persons P into threads. Fig. 11 is a conceptual diagram for explaining possible combinations of transitions of each passage pattern when multiple persons P pass through.

[0054] In this embodiment, the multiple AR markers 10 are arranged at a predetermined interval in the passing direction so as to ensure that at least one AR marker is not hidden between two adjacent people when multiple people P exist in the passing determination target area S and pass through. It is assumed that a state (0) in which the AR marker is not hidden is included between the passing of multiple people P (see FIG. 9). Using this as a starting point, the threads are separated so that hidden markers are continuous, and each thread is associated so as to determine the passing of another person. For the change in the passing pattern between threads, prohibited transitions are set under conditions including the number of AR markers and the assumed passing speed, and a priority order is defined in the case where there are multiple threads that reach the same thread after the transition, and the pattern change is associated between the allowed transitions to determine the passing of multiple people P.

[0055] That is, to handle the passage of multiple persons P, prepare threads equal to the number of people to be judged. For example, prepare two threads to handle the passage of two people. Here, assuming that when multiple persons P pass, there is always a state in which the AR marker is not hidden between them, the threads are decomposed into two threads so that the passing pattern in which the AR marker is hidden is continuous (see Figure 10). Regarding transitions to such states, consider the case where the hiding passing pattern changes from (1,1,0) to (1,0,1) as shown in Figure 11, for example.

[0056] In this case, the (1,1,0) before the transition is the first thread, and a blank thread (0,0,0) is prepared as the second thread (see Figure 10). Here, a numerical counter N1 for pass determination is assigned to the first thread, and N2 (=0) is assigned to the second thread. As the pattern after the transition is (1,0,1), it is decomposed into two threads, (1,0,0) and (0,0,1), starting from the 0 in between. In this state, there are the following four possible combinations of thread transitions.

[0057] (a) [N1](1,1,0) → [N'](1,0,0) (b) [N1](1,1,0) → [N'](0,0,1) (c) [N2](0,0,0) → [N'](1,0,0) (d) [N2](0,0,0) → [N'](0,0,1)

[0058] Since each thread corresponds to the passage of a different person, there must be no overlap between the associations from the pre-transition to the post-transition thread. Therefore, we introduce two rules for thread transitions.

[0059] The first rule is the setting of "prohibited transitions" that exclude extreme pattern changes, which is effective in eliminating judgment errors. Here, the prohibited transitions are set appropriately based on the number of AR markers, the expected passing speed, etc. In this example, (1,1,0) → (1,0,0) is a prohibited transition because it is a large pattern change. This excludes the transition (a) above. That is, (a) [N1](1,1,0) → [N'](1,0,0) "forbidden transition"

[0060] The second rule defines the priority when there are multiple threads that reach the same thread after transition. In the above example, (b) and (d) transition to the same thread (0,0,1). That is, (b)[N1](1,1,0)→[N'](0,0,1) "Priority" (|N1| > |N2|) (d)[N2](0,0,0)→[N'](0,0,1)×

[0061] At this time, the transition with the larger absolute value of the numerical counters N1 and N2 is given priority, so that the passing judgment for each thread corresponds to the passing judgment for each person. The final remaining two transitions are as follows, and each thread is assigned as the passing judgment for a different person, and values ​​are added to the numerical counters according to the passing judgment pattern (α and β). (b)[N1](1,1,0)→[N1+α](0,0,1) (d)[N2](0,0,0)→[N2+β](1,0,0)

[0062] In this way, even for the transition (1,0,1) → (1,1,0), it is possible to determine whether it passes by decomposing it into two threads in the same way.

[0063] As described above, when performing a passing judgment when multiple persons P pass through the passing judgment target area F using the moving object passing judgment system 100, the passing judgment means 30 separates each of the multiple persons P into threads so that the passing patterns of the multiple hidden AR markers 10 are continuous when the multiple persons P pass through the passing judgment target area F, and judges the passing of multiple people based on predefined prohibited transitions and the priority of multiple threads that reach the same thread. This makes it possible to handle the case where multiple moving objects (persons) P pass through the passing judgment target area F, and to perform accurate passing judgment.

[0064] Using the moving object passage determination system 100 of this embodiment, a passage determination experiment was conducted in which multiple people P pass through a passage determination target area F at the entrance to a school cafeteria. The experimental results are shown in Table 1. The comparative example is a determination result in the case where prohibited transitions and priorities of multiple threads that reach the same thread are not defined.

[0065] [Table 1] As shown in Table 1, in this embodiment, the erroneous determination rate when a plurality of persons P pass through the passage determination target area F can be kept low.

[0066] The above-described embodiments are merely illustrative of the present invention, and are not limiting, and the present invention can be embodied in various other modified and altered forms. Therefore, the scope of the present invention is defined only by the claims and their equivalents. [Explanation of symbols]

[0067] 10, 10A Multiple AR markers 20. Shooting Method 30 Passage determination means 31 Display section 32 Transmitter 33 Receiving section 34 Input section 35 Data Bus 36 Storage area 36a Control program storage section 36b Image data storage section 36c AR marker ID storage section 36d Passing pattern storage section 36e Passing number storage section 37 Processing section 37a Counting method for hidden markers 37b Passage judgment means 37c Passing number counting means 37d Turnback Judgment Method 37e Cancellation method 40 Output Means 100 Moving object passage determination system F Passage judgment target area P Moving object (person) W1, W2 side wall

Claims

1. A moving object passage determination system that counts the number of moving objects passing through a predetermined passage determination target area in a predetermined direction, a plurality of AR markers having different patterns, the AR markers being arranged along at least one side of the passage determination target area in a direction intersecting the passage direction of the moving object; an imaging means arranged on a side facing the plurality of AR markers in the passage determination target area, for imaging a moving object passing through the passage determination target area and the plurality of AR markers; a passage determination means for determining passage of the moving object based on an image signal of the image captured by the imaging means; output means for outputting a result of the determination by the passage determination means; The passing determination means is configured to determine the passing of the moving object based on the number of the plurality of AR markers that are hidden and photographed by the photographing means when the moving object passes through the passing determination target area.

2. The moving object passage determination system according to claim 1, characterized in that the passage determination means determines the passing direction of the moving object based on the order in which the plurality of AR markers photographed by the photographing means are hidden when the moving object passes through the passage determination target area.

3. A plurality of AR markers having different patterns are further arranged along a vertical direction perpendicular to the passing direction of the passage determination target area; The moving object passing determination system according to claim 1 or 2, characterized in that the passage determination means is configured to determine the passage of the moving object based on the number of the multiple AR markers in the vertical direction photographed by the photographing means that are hidden when the moving object passes through the passage determination target area.

4. The moving object passage determination system according to any one of claims 1 to 3, characterized in that the passage determination means is configured to cancel the processing of the passage determination of the moving object when the moving object turns back from the passage determination target area.

5. the plurality of AR markers are arranged at predetermined intervals in a passing direction of the moving bodies so as to ensure that, when the plurality of moving bodies pass through the passage determination target area, at least one AR marker is not hidden between two adjacent moving bodies; The moving object passage determination system according to any one of claims 1 to 4, characterized in that the passage determination means is configured to separate each of the multiple moving objects into a thread so that the patterns of the multiple hidden AR markers are continuous when the multiple moving objects pass through the passage determination target area, and to determine the passage of the multiple moving objects based on predefined prohibited transitions and the priority of multiple threads that reach the same thread.

6. A moving object passage determination method for counting the number of moving objects passing through a predetermined passage determination target area in a predetermined direction, comprising: capturing an image of a plurality of AR markers having different patterns, the AR markers being arranged along at least one side of a direction intersecting the passing direction of the moving object in the passing determination target area, and the moving object passing through the passing determination target area; A moving object passage determination method, characterized in that the passage of the moving object is determined based on the number of the plurality of AR markers that are hidden when the moving object passes through the passage determination target area.

7. The moving object passage determination method according to claim 6, characterized in that, when the moving object passes through the passage determination target area, the passing direction of the moving object is determined based on the order in which the photographed multiple AR markers are hidden.

8. The moving body passage determination method according to claim 6 or 7, characterized in that a plurality of AR markers having different patterns are further arranged along a vertical direction perpendicular to the passage direction of the passage determination target area, and the passage of the moving body is determined based on the number of the plurality of AR markers hidden in the photographed vertical direction when the moving body passes through the passage determination target area.

9. 9. The moving object passage determination method according to claim 6, further comprising canceling a process of determining passage of the moving object when the moving object turns back from the passage determination target area.

10. arranging the plurality of AR markers at predetermined intervals in a passing direction of the moving bodies so as to ensure that, when the plurality of moving bodies pass through the passage determination target area, at least one AR marker is not hidden between two adjacent moving bodies; A method for determining whether or not a plurality of moving bodies pass through the passage determination target area, characterized in that when a plurality of moving bodies pass through the passage determination target area, each of the moving bodies is separated into a thread so that the patterns of the plurality of hidden AR markers are continuous, and the passage of the plurality of moving bodies is determined based on predefined prohibited transitions and the priority of a plurality of threads that reach the same thread.

Images