Multi-sensor handover system capable of tracking moving objects and method for providing parking service therein

The multi-sensor handover system accurately tracks vehicles across overlapping camera zones by comparing exit and entry images, enabling efficient parking services with minimal computation and consistent identification.

JP7617672B2Active Publication Date: 2025-01-20ライトビジョン インク
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2023532842
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-11-30
Filing Date
2021-11-25
Publication Date
2025-01-20
Estimated Expiration
2041-11-25

AI Technical Summary

Technical Problem

Conventional systems fail to accurately track vehicles moving through multiple camera fields of view, leading to misidentification and limited movement capture.

Method used

A multi-sensor handover system that uses first and second sensors to monitor overlapping handover areas, with a communication unit to acquire and compare images, and a handover unit to determine if a mobile object entering one area is the same as exiting another, allowing for accurate tracking without requiring specific object information.

Benefits of technology

Enables precise vehicle tracking across camera zones with minimal computational effort, facilitating parking services by assigning consistent identification codes and providing parking information.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007617672000001
    Figure 0007617672000001
  • Figure 0007617672000002
    Figure 0007617672000002
  • Figure 0007617672000003
    Figure 0007617672000003
Patent Text Reader

Abstract

A computing device for use in a handover system is provided. [Solution] The computing device used in the present invention includes a communication unit which is a communication connection path between a first sensor monitoring a first handover area and a second sensor monitoring a second handover area, and a handover unit which acquires a first image from the first sensor, acquires a second image from the second sensor, detects the exit of a mobile body from the first handover area through the acquired first image, detects the entry of a mobile body into the second handover area through the acquired second image, and determines whether the mobile body which has entered the second handover area is the same mobile body which exited from the first handover area through the detected exit and entry of the mobile body, wherein the second handover area is an area which matches with the first handover area.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a mobile tracking capable handover system and a method for operating the same.The present invention also relates to a multi-sensor handover system and a method for operating the same. [Background technology]

[0002] In conventional systems, a vehicle is tracked within the image captured by one camera, and therefore when the vehicle moves into the field of view of another camera, it is recognized as a different vehicle, and only limited movement of the vehicle can be grasped. In other words, conventional systems cannot properly track a vehicle moving in an area illuminated by multiple cameras. Summary of the Invention [Problem to be solved by the invention]

[0003] It is an object of the present invention to provide a handover system capable of tracking a moving object and a method for operating the same. It is also an object of the present invention to provide a multi-sensor handover system and a method for providing parking services therein. [Means for solving the problem]

[0004] In order to achieve the above object, a computing device according to an embodiment of the present invention includes a communication unit which is a communication connection path between a first sensor monitoring a first handover area and a second sensor monitoring a second handover area, and a handover unit which acquires a first image from the first sensor, acquires a second image from the second sensor, detects an exit of a mobile object from the first handover area through the acquired first image, detects an entry of a mobile object into the second handover area through the acquired second image, and determines whether a mobile object that has entered the second handover area is the same as a mobile object that has exited the first handover area through the detected exit of the mobile object and the detected entry of the mobile object, wherein the second handover area is an area that is matched with the first handover area.

[0005] A first sensor used in a handover system for monitoring a first handover area and acquiring a first image according to an embodiment of the present invention includes a communication unit that is a communication connection path with a second sensor monitoring a second handover area, and a handover unit that acquires a second image from the second sensor, detects an exit of a mobile object from one of the handover areas through one of the acquired images, detects an entry of a mobile object into another of the handover areas through another of the acquired images, and determines whether the mobile object that has entered the other handover area is the same as the mobile object that has exited one of the handover areas through the exit of the detected mobile object and the entry of the detected mobile object, where the handover areas are matched with each other.

[0006] A computing device according to another embodiment of the present invention includes a communication unit which is a communication connection path with a first sensor monitoring a first handover area, a second sensor monitoring a second handover area, or a parking sensor which grasps a parking position, and a parking unit which acquires a number of a mobile object when the mobile object enters a parking lot, and receives parking information of the mobile object from the parking sensor when the mobile object is parked in a parking space after passing through the handover area. Here, an identification code having the same identification code as that given to the entering mobile object or a sub-identification code same as that given to the entering mobile object is given to the mobile object passing through the handover area or the parked mobile object.

[0007] The handover system and method for providing parking services therein according to the present invention determine whether a mobile body that has entered a second handover area is the same as a mobile body that has exited from a first handover area and entered a second handover area, and if they are the same, can assign the identification code assigned to the mobile body that exited from the first handover area to the mobile body that has entered the second handover area.

[0008] That is, the handover system can perform handover through an algorithm that determines whether two moving objects are close in time and space. As a result, handover is performed only in a pre-specified handover area, so that multi-camera handover can be performed with a small amount of calculation.

[0009] In addition, the multi-sensor handover system and the method for providing parking services therein can grasp a moving path of a moving object through a handover process, grasp parking information such as a parking position of the moving object by a parking sensor, and provide various parking services using the grasped moving path or parking information. [Brief description of the drawings]

[0010] [Figure 1] 1 is a diagram illustrating a handover technique according to an embodiment of the present invention. [Diagram 2] 1 is a diagram illustrating a handover technique according to an embodiment of the present invention. [Diagram 3] 1 is a diagram illustrating a handover process using a queue according to an embodiment of the present invention. [Figure 4] 1 is a diagram illustrating a handover technique according to another embodiment of the present invention. [Diagram 5] 1 is a diagram illustrating a handover technique in a parking lot according to an embodiment of the present invention. [Figure 6] 1 is a diagram illustrating a handover technique according to another embodiment of the present invention. [Figure 7] 13 is a diagram illustrating a handover technique according to yet another embodiment of the present invention. [Figure 8] 13 is a diagram illustrating a handover technique according to yet another embodiment of the present invention. [Figure 9] 13 is a diagram illustrating a handover technique according to yet another embodiment of the present invention. [Figure 10] 13 is a diagram illustrating a handover technique according to yet another embodiment of the present invention. [Figure 11] 2 is a block diagram illustrating a handover server according to an embodiment of the present invention; [Figure 12] FIG. 11 is a block diagram illustrating a handover system according to yet another embodiment of the present invention. [Figure 13] 4 is a flowchart illustrating a process of providing a parking service using a handover system according to an embodiment of the present invention. [Figure 14] 11 is a flowchart illustrating a process of providing a parking service using a handover system according to another embodiment of the present invention. [Figure 15] 11 is a flowchart illustrating a parking guidance process using a handover system according to yet another embodiment of the present invention. [Figure 16]FIG. 1 is a block diagram illustrating the configuration of a computing device according to one embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] As used herein, singular expressions include plural expressions unless the context clearly indicates otherwise. In this specification, terms such as "comprise" or "include" should not be interpreted as including all of the various components or steps described in the specification, but may not include some of the components or steps, or may further include additional components or steps. In addition, terms such as "part" and "module" described in the specification refer to a unit that processes at least one function or operation, which may be embodied in hardware or software, or a combination of hardware and software.

[0012] The present invention relates to a handover system and a method for providing a parking service therein, in which a handover area monitored by a sensor, for example, a camera is set, and when a moving object moves through the set handover area, it is confirmed that the moving object is the same moving object with a small amount of calculation, and the moving object is tracked by assigning the same identification code (for example, a unique number or character string). Here, the moving object is, for example, a vehicle.

[0013] Basically, a camera assigns a different identification code to each handover area. Therefore, if the same moving object is assigned different identification codes, it is impossible to track the moving object. Therefore, when the handover system determines that the same moving object passes through a matching handover area, it can assign the same identification code to the moving object in the handover area. Therefore, it is possible to track the moving object.

[0014] According to one embodiment, the handover system can compare information on an exit queue that records the exit of a mobile object with information on an entrance queue that records the entrance of a mobile object to determine whether the mobile object is the same. In another aspect, the handover system can determine whether the mobile object is the same based on the exit and entrance of the mobile object in the handover area without needing to obtain specific information such as the type of mobile object and the vehicle number. Therefore, the handover system can accurately perform handover without machine learning, and as a result, multi-sensor handover and tracking of the mobile object are possible with a small amount of calculation (data processing amount).

[0015] In addition, in the conventional system, a vehicle cannot be tracked unless the type or number of the vehicle is known, whereas the handover system of the present invention can accurately track a moving object even in an environment where it is difficult to grasp specific information on the type or number of the moving object. Furthermore, the multi-sensor handover system of the present invention and the method of providing parking services therein can grasp parking information such as a parking position of a moving object parked after passing through a handover area, and provide various parking services to a user using the grasped parking information. Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, for convenience of explanation, it is assumed that the moving object is a vehicle.

[0016] Figures 1 and 2 are diagrams illustrating a handover technique according to an embodiment of the present invention, Figure 3 is a diagram illustrating a handover process using a queue according to an embodiment of the present invention, Figure 4 is a diagram illustrating a handover technique according to another embodiment of the present invention, and Figure 5 is a diagram illustrating a handover technique in a parking lot according to an embodiment of the present invention.

[0017] Referring to FIG. 1, the handover system of this embodiment can set a plurality of handover areas (110 and 112) on a road (100). Here, the first handover area (110) is an area monitored by a first sensor (first image acquisition device), e.g., a first camera, and the second handover area (112) is an area monitored by a second sensor (second image acquisition device), e.g., a second camera. Meanwhile, the handover areas (110 and 112) may have various polygonal shapes. For example, they may have a triangular or rectangular shape.

[0018] Also, the first handover area (110) may correspond to a part of the area monitored by the first camera, and the second handover area (112) may correspond to a part of the area monitored by the second camera, as shown in Fig. 2. Of course, the first handover area (110) may correspond to the entire area monitored by the first camera, and the second handover area (112) may correspond to the entire area monitored by the second camera. That is, the first handover area (110) may correspond to a part or the entire area monitored by the first camera, and the second handover area (112) may correspond to a part or the entire area monitored by the second camera.

[0019] According to one embodiment, the handover areas 110 and 112 can be matched with each other. For example, the second handover area 112, in which a vehicle that has passed through the first handover area 110 is likely to proceed, can be set as the handover area to be matched with the first handover area 110. That is, the matched handover areas 110 and 112 are areas that are close in time and space.

[0020] In general, as shown in FIG. 1, the handover areas (110 and 112) may be arranged side by side in the longitudinal direction of the road (100). Of course, on a curved road rather than a straight road, the handover areas (110 and 112) may be arranged sequentially and along the curved line. In another aspect, the handover areas (110 and 112) may be arranged side by side and adjacent to each other in the direction of vehicle travel. However, the handover areas (110 and 112) may abut as shown in FIG. 1, may be spaced apart from each other as shown in FIG. 4, or may be arranged overlapping in some circumstances.

[0021] An example of a handover process using handover areas (110 and 112) in a multiple sensor environment will be described below with reference to Fig. 3. A first sensor (Cam1, 310) can sense a first handover area (110) and transmit a sensing result (image) to a handover server (300, computing device), and a second sensor (Cam2, 312) can sense a second handover area (112) and transmit a sensing result (image) to the handover server (300).

[0022] According to an embodiment, the handover server (300) can detect a vehicle that has exited the first handover area (110) through analysis of an image transmitted from the first sensor (310) and input (write) information about the detected vehicle into the Zone 1 exit waiting queue. For example, the handover server (300) can extract an object from the image using various methods and detect an object corresponding to a vehicle by comparing the extracted object with a previously stored vehicle shape. As another example, the handover server (300) can extract feature points from the extracted object and determine whether it is a vehicle by comparing the feature points with previously stored feature points. The handover server (300) can also detect a vehicle that has entered the second handover area (112) through analysis of an image transmitted from the second sensor (312) and input information about the detected vehicle into the Zone 2 entrance waiting queue. Here, the Zone 1 exit queue and the Zone 2 entrance queue may be virtual queues set by the handover server 300, and may correspond to specific memory spaces.

[0023] Then, the handover server (300) can compare the Zone 1 exit queue with the Zone 2 entrance queue to determine whether the vehicle that has entered the second handover area (112) is a vehicle that has exited the first handover area (110). According to one embodiment, the handover server (300) can determine that a vehicle in the Zone 1 exit queue and a vehicle in the Zone 2 entrance queue that are close in time and space are the same vehicle. Of course, as long as it is determined whether they are the same vehicle using the Zone 1 exit queue and the Zone 2 entrance queue, various modifications are possible, and it is obvious to those skilled in the art that such modifications fall within the scope of the present invention.

[0024] If it is determined that the vehicle that has entered the second handover area (112) is the same vehicle as the vehicle that has exited the first handover area (110), the handover server (300) can assign the identification code (e.g., 3020293) that has been assigned to the vehicle that has exited the first handover area (110) to the vehicle that has entered the second handover area (112). As a result, the same identification code can be assigned to the vehicle that has exited the first handover area (110) and the vehicle that has entered the second handover area (112). Therefore, it is possible to track the vehicles in a simple manner.

[0025] A method of assigning an identification code to a vehicle entering the second handover area (112) may include first assigning a new identification code when the vehicle enters the second handover area (112), and then changing the new identification code to the identification code assigned to the vehicle that left the first handover area (110) depending on whether or not the previous vehicle is identified as the same vehicle. Alternatively, the identification code assigned to the vehicle that left the first handover area (110) after the vehicle is identified as the same vehicle without the process of assigning a new identification code may be assigned to the vehicle that entered the second handover area (112). This process of assigning an identification code may be performed automatically without the intervention of a user. Of course, for more detailed tracking, the identification codes for the same vehicle in the handover areas (110 and 112) may include the same sub-identification code even if they are different. According to an embodiment, the identification code may further include a sub-identification code illustrating the handover area in addition to the same sub-identification code.

[0026] For example, if the identification code given to a vehicle that has left the first handover area (110) is (handover1, 3020293), the identification code given to a vehicle that has entered the second handover area (112) is (handover2, 3020293). That is, the identification codes in the handover areas (110 and 112) include the same sub-identification code (3020293) and may also include a sub-identification code (handover1 or handover2) indicating each handover area. As a result, the identification code can be used to grasp information that the vehicle is the same and the vehicle's location information. Of course, in addition to the sub-identification code corresponding to the space, a sub-identification code indicating the time can also be used, or the sub-identification code corresponding to the space can be used without using the sub-identification code, and only the sub-identification code indicating the time can be used.

[0027] As another example, if the identification code given to a vehicle that has left the first handover area (110) is (handover1, 3020293), the identification code given to a vehicle that has entered the second handover area (112) is (handover1+handover2, 3020293). In other words, information about the handover area the vehicle passed through is included in the identification code, so it is possible to determine that it is the same vehicle and also to determine the route the vehicle traveled from the identification code alone. As a result, more precise and faster vehicle tracking is possible. According to another embodiment, the handover server (300) can detect a vehicle that has exited the second handover area (112) through analysis of an image transmitted from the second sensor (312) and input information about the detected vehicle to the Zone 2 exit waiting queue. Also, the handover server (300) can detect a vehicle that has entered the first handover area (110) through analysis of an image transmitted from the first sensor (310) and input information about the detected vehicle to the Zone 1 entrance waiting queue.

[0028] Then, the handover server (300) can compare the Zone 2 exit queue with the Zone 1 entry queue to determine whether the vehicle that entered the first handover area (110) is a vehicle that exited from the second handover area (112). If it is determined that the vehicle that entered the first handover area (110) is a vehicle that exited from the second handover area (112), the handover server (300) can assign the identification code (e.g., 3020293) that was assigned to the vehicle that exited the second handover area (112) to the vehicle that entered the first handover area (110). As a result, the same identification code can be assigned to the vehicle that exited the second handover area (112) and the vehicle that entered the first handover area (110). Therefore, the vehicle can be tracked.

[0029] In summary, the handover server (300) can assign the same identification code to a vehicle that has exited one of the matched handover areas and entered another area. That is, the handover server (300) can determine whether the vehicles are the same or not just by detecting the exit and entry of the vehicle in the handover area without grasping specific information such as the type of vehicle. As a result, it is not necessary to process a large amount of data to analyze whether the vehicles are the same or not.

[0030] Recently, cameras are installed in high places such as on the roofs of apartment buildings, but in this case, the distance between the camera and the vehicle is far, so it may not be easy to grasp the vehicle information. In such an environment, the handover technique of the present invention is more useful.

[0031] Meanwhile, in the above, whether or not the vehicles are the same vehicle is determined only by the exit and entry of the vehicle in the handover area, but as described later, specific vehicle information such as the type of vehicle, information on the road surface, etc. may be additionally used to determine whether or not the vehicles are the same vehicle depending on the situation. Also, in the above, the time of the exit from the first handover area (110) and the entry into the second handover area (112) is not taken into consideration, but if the entry does not occur within a preset time from the exit, it may not be recognized as the same vehicle, and if the preset time is exceeded, it may not be recognized as the same vehicle. For example, if a vehicle that has exited the first handover area (110) does not stop and enter the second handover area (112), another vehicle may enter the second handover area (112) first. In this case, if it is determined that the vehicles are the same vehicle, an error may occur. Therefore, it is efficient to determine whether or not the vehicles are the same vehicle by considering time. That is, the handover system can determine whether or not the vehicles are the same vehicle by considering both time and space, and assign an identification code to the vehicle.

[0032] Although not described above, such a handover system can be usefully used in a parking lot as shown in FIG. 5. In the parking lot, the vehicle number is recognized when the vehicle enters and an identification code (e.g., including the vehicle number) can be assigned to the vehicle. Even if the vehicle passes through the handover area (110 and 112), the same identification code is assigned, and even if the vehicle is parked in the parking space (500), the same identification code (e.g., 23gu4567) or a new identification code including the same sub-identification code (e.g., 1st area, 23gu4567, further including an identification code for the parking position) is assigned. As a result, the number, movement path, and parking position of the vehicle that entered the parking lot can all be known. Therefore, the parking fee is determined taking into account the entry time and exit time, and the driver can easily find his / her vehicle by searching the parking position where he / she parked using the identification code. Without such an identification code assignment method and handover technology, the entry time can be known, but the exact parking position cannot be known.

[0033] Figure 6 is a diagram illustrating a handover technique according to another embodiment of the present invention. Referring to Figure 6, the handover areas (110 and 112) should be set next to each other as in Figure 1, but the handover areas (110 and 112) may not be aligned due to various reasons such as a change in the detection direction of the sensor due to an external impact. In this case, information on the road (100) as well as the exit of the vehicle from the first handover area (110) and the entrance of the vehicle to the second handover area (112) can be taken into consideration.

[0034] For example, the handover server may store an image of a road surface, and if the alignment of the handover areas (110 and 112) is not aligned, the handover server may compare the image of the road surface seen in the handover areas (110 and 112) with the stored image to adjust the alignment, or may identify the handover area (110 or 112) as the area before the alignment was shifted. That is, the handover server may adjust and align the shifted handover areas (110 and 112) using the road surface information, and then analyze the exit of a vehicle from the first handover area (110) and the entry of a vehicle into the second handover area (112) to determine whether they are the same vehicle, and may add the same identification code.

[0035] That is, the handover server corrects the alignment or matching of the handover areas (110 and 112) through road analysis, and then determines whether the vehicles are the same or not by considering the exit and entrance of the vehicles in the handover areas (110 and 112). According to one embodiment, the road analysis may be performed by setting characteristic points on the road surface and comparing the characteristic points to reduce the amount of calculation.

[0036] 7 is a diagram illustrating a handover technique according to another embodiment of the present invention. Referring to FIG. 7, other vehicles may enter the second handover area (112) at the same time or at a slight time lag. In this case, it is difficult to determine which vehicle among the multiple vehicles has left the first handover area (110) and entered the second handover area (112).

[0037] Therefore, the handover server can additionally detect specific information about the vehicles present in the handover areas (110 and 112), such as the type of vehicle, and assign the same identification code to vehicles that have entered the second handover area (112) that are the same as those that have exited the first handover area (110).

[0038] Figure 8 is a diagram illustrating a handover technique according to another embodiment of the present invention. If it is difficult to accurately determine the exit and entry of a vehicle due to overspeeding, the second handover area (112) can be expanded to an expansion area (802) or the first handover area (110) can be expanded to an area (800) as shown in Figure 8. That is, if a vehicle travels at a speed higher than a preset speed, at least one of the handover areas (110 and 112) can be expanded. As the handover areas (110 and 112) are expanded, the vehicle can be detected and a handover can be performed even if the vehicle is traveling at a high speed.

[0039] In summary, the handover server can analyze the exit and entry of vehicles in the extended handover area to determine whether they are the same vehicle and can add the same identification code.

[0040] According to another embodiment, the extent to which the handover regions 110 and 112 are extended may vary depending on the speed of the vehicle. For example, the handover regions 110 and 112 may be extended in proportion to the speed of the vehicle.

[0041] 9 is a diagram illustrating a handover technique according to another embodiment of the present invention. Referring to FIG. 9, it may not be possible to determine whether a vehicle is the same in a specific handover area (110b and 112b) due to a sensor failure, etc. In this case, the handover server can determine whether a vehicle is the same by comparing the handover areas (110a and 110b) immediately before the specific handover area (110b and 112b) and the handover area (110c and 112c) immediately after the specific handover area (110b and 112b) in consideration of the driving direction, and can add the same identification code.

[0042] For example, when a vehicle exiting the 2-1 handover area (112a) enters the 1-3 handover area (110c), it can be determined whether it is the same vehicle by inputting vehicle information into the entry and exit queues. However, in this case, the accuracy of determining whether it is the same vehicle may be low, so it is also possible to determine whether it is the same vehicle by additionally acquiring specific vehicle information. As a result, even if the same identification code as that given to the vehicle in the 2-1 handover area (112a) is not given to the vehicles in the 1-2 handover area (110b) and the 2-2 handover area (112b), it can be given to the vehicles in the 1-3 handover area (110c) and the 2-3 handover area (112c). Therefore, even if the tracking of the vehicle is interrupted midway, it is possible to continue tracking the vehicle by using the exit and entry of the vehicle in the previous and next handover areas.

[0043] Figure 10 is a diagram illustrating a handover technique according to another embodiment of the present invention. As shown in Figure 10, when a vehicle straddles handover areas (110 and 1010, or 112 and 1012) arranged above and below, it is possible to determine whether the vehicle is the same or not by only the exit and entry of the vehicle in the handover area (110 and 112) but by additionally using specific information of the vehicle such as the type of the vehicle. Figure 11 is a block diagram illustrating a handover server according to an embodiment of the present invention.

[0044] Referring to FIG. 11, the handover server (computing device) of the present embodiment may include a control unit (1100), a communication unit (1102), a handover unit (1104), an identification code unit (1106), a sensor unit (1108), and a memory unit (1110). The communication unit (1102) is a communication connection path with a sensor that monitors the handover area. The handover unit (1104) determines whether the vehicles in the handover area are the same vehicle through the exit of the vehicle in the first handover area and the entrance of the vehicle in the second handover area, and if it is determined that the vehicles are the same vehicle, it can assign the identification code assigned to the vehicle in the first handover area to the vehicle in the second handover area. In addition, the handover unit (1104) may additionally acquire specific vehicle information such as the type of vehicle, and additionally consider the acquired specific vehicle information to determine whether the vehicles are the same vehicle, when it is difficult to determine whether the vehicles are the same vehicle only from the exit and entrance of the vehicle in the handover area as described in the above embodiment.

[0045] Furthermore, the handover unit (1104) may correct the matching of the handover area using road information when the matching of the handover area is misaligned, and may determine whether the vehicle is the same or not by considering the exit and entrance of the vehicle in the handover area. Furthermore, the handover unit (1104) may extend the handover area when the vehicle passes through the handover area at a preset speed or faster, and may determine whether the vehicle is the same or not by considering the exit and entrance of the vehicle in the extended handover area. The identification code unit (1106) may assign an identification code to the vehicle located in the handover area, and may assign the same identification code as that assigned to the exiting vehicle to the entering vehicle when it is determined that the vehicle in the entering handover area is a vehicle that has exited from the previous handover area or the matching handover area.

[0046] Of course, if a vehicle newly enters the handover area, a new identification code is assigned to it. The sensor unit (1108) can control the operation of a sensor that monitors the handover area. The memory unit (1110) can store various data such as information on the handover area, information on the identification code, and information on a specific vehicle. The control unit (1100) can overall control the operation of the components of the handover server.

[0047] In the above embodiment, the handover function is executed by the handover server, but the handover function can be executed by one or more of the sensors. That is, the sensor can execute the handover function of the above embodiment without the handover server. For example, a first sensor that monitors a first handover area and acquires a first image can include a communication unit that is a communication connection path with a second sensor that monitors a second handover area, and a handover unit that acquires a second image from the second sensor, detects the exit of a mobile object from the first handover area through the acquired first image, detects the entry of a mobile object into the second handover area through the acquired second image, and determines whether the mobile object that has entered the second handover area is the same as the mobile object that has exited the first handover area through the detected exit of the mobile object and the detected entry of the mobile object. Here, the second handover area is an area that is matched with the first handover area.

[0048] As another example, a second sensor monitoring a second handover area and acquiring a second image may include a communication unit that is a communication connection path with a first sensor monitoring a first handover area, and a handover unit that acquires a first image from the first sensor, detects an exit of a mobile object from the first handover area through the acquired first image, detects an entry of a mobile object into the second handover area through the acquired second image, and determines whether a mobile object that has entered the second handover area is the same as a mobile object that has exited the first handover area through the detected exit of the mobile object and the detected entry of the mobile object. Here, the second handover area is an area that is matched with the first handover area.

[0049] In addition to determining the same moving object, various methods for adding an identification code can be applied as well.

[0050] 12 is a block diagram illustrating a handover system according to another embodiment of the present invention. Referring to FIG. 12, the handover system of this embodiment is a system applicable to an apartment complex, a parking lot, etc., and may include a computing device (1200), a user terminal (1202), a first sensor (1210), a second sensor (1212), and a parking sensor (1214). As described in the above embodiment, the computing device (1200) can determine whether the vehicle is the same vehicle through the exit and entrance of the vehicle in the handover area monitored by the first sensor (1210) and the second sensor (1212) and assign the same identification code. The handover process has been described in detail in the above embodiment, so the following description will be omitted.

[0051] In addition, the computing device 1200 can be connected to a parking sensor 1214 to check parking information such as a parking position of a vehicle parked after passing through the handover area. For example, the parking sensor 1214 can be a camera, which can detect the number (vehicle number) of a parked vehicle and provide the detection result to the computing device 1200. As a result, the computing device 1200 can check the vehicle number when entering the vehicle, grasp the moving route of the vehicle through the handover area, and confirm the parking position. If the identification code of the vehicle in the handover area includes the vehicle number, and an identification code that is the same as the identification code assigned in the handover area or an identification code including a sub-identification code that is the same as the identification code assigned in the handover area is assigned to the vehicle when parking, the computing device 1200 can know which route the entered vehicle passed and where it was parked.

[0052] According to one embodiment, the computing device (1200) can be connected to a user terminal (1202) or a generation terminal, and can provide messages including contents related to parking locations, parking available areas, notices, illegal parking notices, instructions for disabled parking space movement, parking fees, etc., to the user terminal (1202), the generation terminal, or a member's shared terminal (e.g., a display installed in an apartment parking lot), etc. As a result, the user can easily find the parking location of the vehicle by knowing it.

[0053] For example, if the computing device (1200) is an apartment management server, when an apartment resident (user) parks, information about the parking location can be provided to the user's terminal (user terminal), so that the user can easily move to his / her vehicle. In particular, if a drunk person parks for someone else, the user may not know the location of his / her vehicle. Even in this case, the computing device (1200) provides a message with information about the vehicle's location to the user terminal (1202), so that the user can easily find the location of his / her vehicle by checking the message when he / she goes to work the next day.

[0054] As another example, if the computing device 1200 knows that the parked vehicle is an unregistered vehicle or a specific vehicle designated by an investigative agency, it can provide various information such as the vehicle's travel path, images in the handover area, and parking time to an external server, such as a police server, so that the police can better track down criminals.

[0055] 13 is a flow chart illustrating a process of providing a parking service using a handover system according to an embodiment of the present invention. Referring to FIG. 13, when a vehicle enters an indoor / outdoor parking lot or an outdoor parking lot of an apartment, a computing device (1200) can obtain information (such as a vehicle number) about the vehicle that has entered and track the vehicle as it passes through a handover area (S1300). Here, in the handover area, an identification code including the same identification code or the same sub-identification code can be given to the same vehicle.

[0056] Then, when the vehicle is parked at a specific location, the computing device (1200) can determine the parking location of the vehicle according to information provided from the parking sensor (1214) (S1302). As a result, the computing device (1200) can determine the vehicle's entry information, including the vehicle number, the travel route, and the parking location. In particular, the vehicles can be given the same sub-identification code or the same identification code including the vehicle number.

[0057] Then, the computing device (1200) can inform a user, for example an apartment resident, of the obtained entry information, travel route, or parking location through the user terminal (1202) (S1304). For this purpose, the computing device (1200) can obtain and store in advance the telephone number of a user, for example an apartment resident. Of course, information regarding the parking location can be provided to a multi-purpose terminal or a shared terminal, instead of the user terminal (1202).

[0058] According to an embodiment, the computing device 1200 can provide a user with not only information about the parking location but also various additional information by including it in a message. For example, the additional information can be information about advertisements, video / audio, identification code, unpaid management fees, notices, moving instructions due to parking in a disabled parking space, or parking fees, etc. Here, when a user watches an advertisement or video / audio, the user's generation management fees, parking fees, etc. can be discounted.

[0059] According to another embodiment, if the vehicle does not belong to a member of a particular group (eg an apartment resident), the additional information is information regarding parking fees, parking time, visit generation, identification code, etc.

[0060] 14 is a flow chart illustrating a process of providing a parking service using a handover system according to another embodiment of the present invention. Referring to FIG. 14, when a vehicle enters an indoor / outdoor parking lot or an outdoor parking lot of an apartment, a computing device (1200) can obtain information (such as a vehicle number) about the vehicle that has entered and track the vehicle as it passes through a handover area (S1400). Here, in the handover area, an identification code including the same identification code or the same sub-identification code can be given to the same vehicle.

[0061] Then, when the vehicle is parked at a specific location, the computing device (1200) can determine the parking location of the vehicle according to information provided from the parking sensor (1214) (S1402). As a result, the computing device (1200) can determine the vehicle's entry information, including the vehicle number, the movement route, and the parking location. In particular, the vehicles can be given the same sub-identification code or the same identification code including the vehicle number. Then, the computing device (1200) can determine the parking situation according to a message provided from the user terminal (1202), and can therefore determine the available parking locations (S1404).

[0062] Then, the computing device (1200) can provide information on the determined available parking locations to a newly entering vehicle to assist in convenient parking (S1406). In an apartment where parking space is insufficient, a user must spend a lot of time parking, but by introducing such a handover system, the user can know available parking spaces when entering the vehicle and can park conveniently. Even in an apartment where parking space is sufficient, it may not be possible to park in a specific parking space due to cleaning or the like. In this case, the user has to go to a specific parking space to park and find another parking space, which is inconvenient. Therefore, by introducing the handover system of the present invention, an available parking space can be easily determined and parked without such inconvenience. In addition, when parking in an apartment, a user usually tends to park in a location close to his or her own building. Therefore, the computing device (1200) can determine the user's preferred parking location in advance based on accumulated data and guide the user to a parking space available at the determined preferred parking location with the highest priority.

[0063] As another example, a user may specify to the computing device (1200) a desired parking location where the user wishes to park. In this case, the computing device (1200) may preferentially guide the user to available parking locations close to the desired parking location. Thus, the user's convenience is maximized. The computing device (1200) may also guide the user to a route to the specified parking location. Furthermore, in the case of a vehicle visiting an apartment building, the computing device (1200) may guide the visitor to available parking locations that are easy to access the building identified at the time of entry.

[0064] Figure 15 is a flow chart illustrating a parking guidance process using a handover system according to another embodiment of the present invention. Referring to Figure 15, when a vehicle enters a parking lot, the computing device (1200) can obtain information (such as a vehicle number) about the entered vehicle and track the vehicle as it passes through a handover area (S1500). Then, when the vehicle is parked at a specific location, the computing device (1200) can obtain the parking location of the vehicle according to information provided from the parking sensor (1214) (S1502). Then, the computing device (1200) can obtain whether the parking is illegal (S1504), and if it is determined that the parking is illegal, it can provide a warning message to move to another location through the user terminal (1402) because the parking is illegal (S1506).

[0065] For example, if a user parks in a handicapped parking space or parks a non-electric vehicle in an electric vehicle charging area, the computing device 1200 can send a warning message to the user to move to another location, so that the apartment security guard does not have to walk around to catch illegal parking and does not have to put warning stickers on the vehicle.

[0066] FIG. 16 is a block diagram illustrating the configuration of a computing device according to an embodiment of the present invention. Referring to FIG. 16, the computing device of this embodiment may include a control unit (1600), a communication unit (1602), a handover unit (1604), an identification code unit (1606), a sensor unit (1608), a parking unit (1610), and a storage unit (1612). The communication unit (1602) is a communication connection path between a first sensor and a second sensor for monitoring a handover area, and a third sensor for monitoring a parking space. The handover unit (1604) determines whether the vehicles in the handover area are the same vehicle through the exit of a vehicle in the first handover area and the entrance of a vehicle in the second handover area, and if it is determined that the vehicles are the same vehicle, the identification code given to the vehicle in the first handover area may be given to the vehicle in the second handover area in the same manner. Additional handover control contents are described in the above embodiment.

[0067] The identification code unit (1606) assigns an identification code to a vehicle located in the handover area, and in particular, when a vehicle in the handover area that has entered is determined to be a vehicle that has exited from the previous handover area or a matching handover area, the same identification code as that assigned to the exiting vehicle can be assigned to the entering vehicle. The sensor unit (1608) can control the operation of a sensor that monitors the handover area. The parking unit (1610) can grasp the moving route of the vehicle through a handover process, grasp parking information regarding a parking position, etc. through a parking sensor, and can guide a user to a parking position based on the grasped parking information, can guide an entering vehicle to a possible parking position, can provide a command to move to another space in the case of illegal parking, and can provide the moving route grasped through the handover operation to a police station, etc.

[0068] The storage unit (1612) can store various data such as information on a handover area, information on an identification code, information on a specific vehicle, parking information, etc. The control unit (1600) can control the overall operation of the components of the computing device.

[0069] Meanwhile, the components of the above-mentioned embodiment can be easily understood from the viewpoint of a process. That is, each component can be understood as each process. Also, the process of the above-mentioned embodiment can be easily understood from the viewpoint of a device component. Also, the above-mentioned technical contents can be embodied in the form of program instructions that can be executed by various computer means and recorded on a computer readable medium. The computer readable medium can include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium can be specially designed and configured for the embodiment, or can be known and usable by those skilled in the art of computer software. Examples of computer readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magnetic-optical media such as floptical disks, and hardware devices specially configured to store and execute program instructions, such as ROMs, RAMs, flash memories, and the like. Examples of program instructions include not only machine code, such as produced by a compiler, but also high level language code executable by a computer using an interpreter, etc. A hardware device may be configured to operate as one or more software modules to perform operations of an embodiment, and vice versa.

[0070] The above-described embodiments of the present invention have been disclosed for illustrative purposes, and a person having ordinary skill in the art with ordinary skill in the art may make various modifications, changes, and additions within the spirit and scope of the present invention, and it should be understood that such modifications, changes, and additions are also within the scope of the following claims. [Explanation of symbols]

[0071] 100 roads 110 First Handover Area 112 Second Handover Area 300 Handover Server 310 First Sensor 312 Second Sensor 500 parking spaces 800 areas 802 Extension Area 1100 Control section 1102 Communications Department 1104 Handover Department 1106 Identification Code 1108 Sensor section 1110 Storage section 1200 Computing Devices 1202 User terminal 1210 First Sensor 1212 Second Sensor 1214 Parking Sensor 1600 Control Unit 1602 Communications Department 1604 Handover Department 1606 Identification Code 1608 Sensor section 1610 Parking Department 1612 Storage section

Claims

1. a communication unit which is a communication connection path between a first sensor monitoring a first handover region and a second sensor monitoring a second handover region; a handover unit that acquires a first image from the first sensor, acquires a second image from the second sensor, detects an exit of a moving body from the first handover area through the acquired first image, detects an entry of a moving body into the second handover area through the acquired second image, and determines whether or not a moving body that has entered the second handover area is the same moving body that has exited from the first handover area through the detected exit of the moving body and the detected entry of the moving body, The second handover area is an area that is matched with the first handover area, A computing device characterized in that the handover unit determines, among the mobile bodies that have entered the second handover area, the mobile body that is closest in time to the mobile body that has left the first handover area as being the same mobile body as the mobile body that has left the first handover area.

2. The handover area is arranged along a longitudinal direction of a road, 2. The computing device of claim 1, wherein if it is determined that the mobile body entering the second handover area is the same as the mobile body leaving the first handover area, an identification code identical to the identification code assigned to the mobile body in the first handover area, or an identification code including the same sub-identification code as the identification code assigned to the mobile body, is assigned to the mobile body entering the second handover area.

3. A communication unit which is a communication connection path between a first sensor monitoring a first handover area and a second sensor monitoring a second handover area; a handover unit that acquires a first image from the first sensor, acquires a second image from the second sensor, detects an exit of a moving body from the first handover area through the acquired first image, detects an entry of a moving body into the second handover area through the acquired second image, and determines whether or not a moving body that has entered the second handover area is the same moving body that has exited from the first handover area through the detected exit of the moving body and the detected entry of the moving body, The second handover area is an area that is matched with the first handover area, Information about a mobile object that has exited the first handover area is input to an exit waiting queue, and information about a mobile object that has entered the second handover area is input to an entrance waiting queue; A computing device characterized in that the handover unit compares the exit waiting queue and the entrance waiting queue in time and space to determine whether a mobile object entering the second handover area is the same as a mobile object exiting the first handover area.

4. A communication unit which is a communication connection path between a first sensor monitoring a first handover area and a second sensor monitoring a second handover area; a handover unit that acquires a first image from the first sensor, acquires a second image from the second sensor, detects an exit of a moving body from the first handover area through the acquired first image, detects an entry of a moving body into the second handover area through the acquired second image, and determines whether or not a moving body that has entered the second handover area is the same moving body that has exited from the first handover area through the detected exit of the moving body and the detected entry of the moving body, The second handover area is an area that is matched with the first handover area, When the alignment of the handover area is shifted, the handover unit corrects the alignment of the handover area through road analysis, and then determines whether a mobile object that has entered the second handover area is the same as a mobile object that has exited the first handover area through the exit of the mobile object from the first handover area and the entry of the mobile object into the second handover area.

5. The computing device of claim 1, characterized in that when not only the mobile unit but also other mobile units enter the second handover area, the handover unit additionally uses mobile unit information including the type of mobile unit or the mobile unit number to detect a mobile unit among the mobile units that have entered the second handover area that is identical to the mobile unit that has exited the first handover area, and assigns to the detected mobile unit an identification code that is identical to the identification code assigned to the mobile unit that has exited the first handover area.

6. A communication unit which is a communication connection path between a first sensor monitoring a first handover area and a second sensor monitoring a second handover area; a handover unit that acquires a first image from the first sensor, acquires a second image from the second sensor, detects an exit of a moving body from the first handover area through the acquired first image, detects an entry of a moving body into the second handover area through the acquired second image, and determines whether or not a moving body that has entered the second handover area is the same moving body that has exited from the first handover area through the detected exit of the moving body and the detected entry of the moving body, The second handover area is an area that is matched with the first handover area, When the speed of a mobile object moving through the first handover area or the second handover area is equal to or greater than a preset speed, the handover unit extends the first handover area or the second handover area, and uses the extended handover area to determine whether the mobile object that entered the second handover area is the same as the mobile object that exited the first handover area.

7. Further comprising an identification code unit that adds an identification code to the moving object, The computing device of claim 1, wherein, when a 1-1 handover area and a 2-1 handover area matching thereto, a 1-2 handover area and a 2-2 handover area matching thereto, a 1-3 handover area and a 2-3 handover area matching thereto are sequentially arranged, if it is not determined whether mobile objects are the same in the 1-2 handover area and the 2-2 handover area, or if an identification code cannot be assigned to the mobile object, the handover unit compares a mobile object that has left the 2-1 handover area with a mobile object that has entered the 1-3 handover area, and if they are the same mobile objects, assigns the identification code assigned to the mobile object that has left the 2-1 handover area to the mobile object that has entered the 1-3 handover area, even if an identification code has not been assigned to the mobile object that has left the 2-2 handover area.

8. A first sensor used in a handover system for monitoring a first handover area and acquiring a first image, a communication unit for communicating with a second sensor monitoring a second handover region; a handover unit that acquires a second image from the second sensor, detects an exit of a moving body from one of the handover areas through one of the acquired images, detects an entry of a moving body into another of the handover areas through another of the acquired images, and determines whether or not the moving body that has entered the other handover area is the same moving body that has exited one of the handover areas through the detected exit of the moving body and the detected entry of the moving body, The handover areas are matched with each other; A sensor used in a handover system, characterized in that the handover unit determines, among the mobile bodies that have entered the second handover area, the mobile body that is closest in time to the mobile body that has left one of the first handover areas, as the same mobile body as the mobile body that has left one of the handover areas.

9. The handover area is arranged along a longitudinal direction of a road, The sensor used in the handover system described in claim 8, characterized in that if it is determined that the mobile body entering the other handover area is the same as the mobile body that exited one of the handover areas, an identification code that is the same as the identification code that was assigned to the mobile body in one of the handover areas or an identification code including the same sub-identification code as the identification code that was assigned to the mobile body is assigned to the mobile body that entered the other handover area.

Citation Information

Patent Citations

  • Object tracking method and device

    JP2018205870A

  • Parking lot management system in working cooperation with intelligent cameras

    US20130147954A1

  • Automatic time signature-based video matching for a camera network

    US20160014305A1

  • Vehicle number measuring system

    WO2019059090A1