Method and system for automatically recording and transmitting parking frame number

The system addresses high costs and forgetfulness in parking lot management by using vehicle-mounted modules to automatically record and transmit parking slot numbers, reducing camera requirements and ensuring accurate location recall.

JP2025003921AActive Publication Date: 2025-01-14TUNG THIH ELECTRONICS
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2023138891
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-06-19
Filing Date
2023-08-29
Publication Date
2025-01-14
Estimated Expiration
2043-08-29

AI Technical Summary

Technical Problem

Existing parking lot management systems require multiple cameras to record and display parking slot numbers, increasing construction and management costs, and drivers often forget the location of their parked vehicles without such systems.

Method used

A system that automatically records and transmits parking slot numbers using vehicle-mounted modules to determine vehicle speed, gear stage, and surrounding images, grouping characters, and prioritizing parking slot numbers for transmission to a user terminal.

Benefits of technology

Reduces the need for multiple cameras, lowers construction and management costs, and ensures drivers receive the correct parking slot number efficiently, minimizing forgetfulness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025003921000001_ABST
    Figure 2025003921000001_ABST
Patent Text Reader

Abstract

To provide a method and a system for automatically recording and transmitting a parking frame number.SOLUTION: The method and system for automatically recording and transmitting a parking frame number include the steps of: determining whether vehicle speed information is lower than a set value; acquiring some of a plurality of vehicle surrounding videos on the basis of vehicle gear stage information when it is confirmed that the vehicle speed information is lower than the set value; generating a parking frame identification model by the vehicle surrounding videos and identifying a plurality of characters corresponding to some vehicle surrounding videos; classifying the characters into groups so as to generate a plurality of sets of parking frame numbers respectively corresponding to some vehicle surrounding videos; and a step of stopping a vehicle engine and then transmitting a parking frame number highest in priority among the sets of parking frame numbers to a user terminal.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a method and system for recording parking space numbers, and more particularly to a method and system for automatically recording and transmitting parking space numbers. [Background technology]

[0002] Automobiles are now one of the indispensable means of transportation in people's lives. As the number of automobiles increases, parking lots are designed to be multi-story and large in area to meet the demand for parking large numbers of automobiles. To facilitate management, numbers are assigned to each parking space in a parking lot and are also painted inside the parking space (e.g., on the ground). For example, if the parking space number is "A001," the letter "A" indicates that the parking area is Area A, and the numbers "001" indicate that it is the parking space number.

[0003] However, due to different parking lot management methods, the numbering methods and patterns for the above-mentioned parking space numbers are different, and if the numbers assigned are complex and long and difficult for drivers to remember, the drivers may forget where they parked their cars. Summary of the Invention [Problem to be solved by the invention]

[0004] Currently, the parking lot management method is that when a vehicle enters a parking lot and takes a ticket, a camera installed at the entrance of the parking lot photographs the vehicle's license plate, and after the vehicle parks in the parking lot, a camera installed around the parking lot photographs the parking lot number again and records it in the management system. When the driver pays at the automatic payment machine, the parking lot number is displayed on the automatic payment machine's screen, which may solve the problem of the driver forgetting where he or she parked. However, the above method requires the installation of multiple cameras throughout the parking lot, and the more floors and floor area of ​​the parking lot, the more cameras are required, which increases the construction and management costs of the parking lot. In addition, when a vehicle enters a parking lot that does not have the above management method, the driver must remember the parking lot number himself or herself, so the problem of the driver forgetting where he or she parked still remains. [Means for solving the problem]

[0005] In order to solve the above problems, the present invention aims to provide a method for automatically recording and transmitting parking space numbers, which is executed by a system for automatically recording and transmitting parking space numbers, and includes the steps of: determining whether vehicle speed information of a vehicle is less than a set value; if it is determined that the vehicle speed information is less than the set value, acquiring a portion of vehicle surrounding images from a plurality of vehicle surrounding images based on gear information of the vehicle; creating a parking space identification model based on the plurality of vehicle surrounding images and identifying a plurality of characters corresponding to the portion of the vehicle surrounding images; grouping the plurality of characters to generate a plurality of sets of parking space numbers respectively corresponding to the portion of the vehicle surrounding images; determining the priority order of the plurality of sets of parking space numbers; and transmitting the parking space number with the highest priority order from the plurality of sets of parking space numbers to a user terminal after stopping the engine of the vehicle.

[0006] In some embodiments, the step of grouping the characters is performed according to the distance between each of the characters.

[0007] In some embodiments, the priority of sets of parking space numbers is determined by the number of times they are identified in a portion of the vehicle surroundings imagery.

[0008] In some embodiments, the priority of the sets of parking space numbers is determined by the installation positions of the vehicle camera modules that capture some of the images around the vehicle.

[0009] In some embodiments, the priority of sets of parking space numbers is determined by the time at which they are captured in some vehicle surroundings images.

[0010] In order to solve the above problem, the present invention provides a vehicle speed detection module that detects a traveling speed of a vehicle and acquires vehicle speed information; A gear detection module detects a gear of a vehicle and acquires gear information; A vehicle camera module that is installed in a vehicle and captures a plurality of images of the surroundings of the vehicle; an artificial intelligence module connected to the vehicle camera module, for creating a parking space identification model based on a plurality of vehicle surrounding images, and for identifying a plurality of characters corresponding to some of the vehicle surrounding images in the plurality of vehicle surrounding images; a character grouping module, connected to the artificial intelligence module, for grouping a plurality of characters so as to generate a plurality of sets of parking space numbers respectively corresponding to a portion of the vehicle surrounding images; A control module is connected to the vehicle speed detection module, the gear detection module, the vehicle camera module, the character grouping module, and the artificial intelligence module, and is configured to determine the priority order of the plurality of sets of parking space numbers; The objective of the present invention is to provide a system for automatically recording and transmitting parking space numbers, the system including: a communication module connected to the control module for transmitting the parking space number with the highest priority among a plurality of sets of parking space numbers to a user terminal.

[0011] In some embodiments, the character grouping module groups the characters according to the distance between each of the characters.

[0012] In some embodiments, the priority of sets of parking space numbers is determined by the number of times they are identified in a portion of the vehicle surroundings imagery.

[0013] In some embodiments, the priority of the sets of parking space numbers is determined by the installation positions of the vehicle camera modules that capture some of the images around the vehicle.

[0014] In some embodiments, the priority of the sets of parking space numbers is determined by the time at which some of the vehicle surrounding images are captured.

[0015] As described above, in the method and system for automatically recording and transmitting parking space numbers according to the present invention, the control module can determine the priority of multiple sets of parking space numbers according to the number of times the parking space number is identified in the vehicle surroundings image, the time when the parking space number is photographed, and the installation position of the vehicle camera module, and after the vehicle engine is turned off, the parking space number with the highest priority among the parking space numbers is transmitted to the user terminal via the communication module, thereby eliminating the problem of the driver forgetting where he or she parked. In addition, the control module can reduce the amount of information of the vehicle surroundings image input to the control module by acquiring part of the vehicle surroundings image according to gear position information, and can reduce the calculation load of the control module, thereby improving calculation efficiency. [Brief description of the drawings]

[0016] [Figure 1] 1 is a block diagram of a system for automatically recording and transmitting parking space numbers according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram showing the installation position of a vehicle camera module of the system for automatically recording and transmitting parking space numbers according to the embodiment; [Diagram 3] 1 is a block diagram illustrating a system for automatically recording and transmitting a parking space number according to an embodiment of the present invention, which performs a method for automatically recording and transmitting a parking space number according to an embodiment of the present invention. [Figure 4A]1 is a diagram showing the system for automatically recording and transmitting parking space numbers according to the embodiment acquiring a vehicle surrounding image; [Figure 4B] 13 is another diagram showing the system for automatically recording and transmitting a parking space number according to the embodiment of the present invention acquiring an image of the surroundings of a vehicle. [Figure 5A] 5A to 5C are diagrams illustrating a parking space number identification process according to the embodiment. [Figure 5B] 5A to 5C are diagrams illustrating a parking space number identification process according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] Please refer to FIG. 1. FIG. 1 is a block diagram of a system for automatically recording and transmitting a parking space number according to an embodiment of the present invention. In the embodiment, the system 100 for automatically recording and transmitting a parking space number is installed in a vehicle 150. The system 100 for automatically recording and transmitting a parking space number includes a vehicle speed detection module 10, a gear stage detection module 20, a vehicle camera module 30, an artificial intelligence module 40, a control module 50, and a communication module 60. The system 100 for automatically recording and transmitting a parking space number can transmit the parking space number to a user terminal 200 through the communication module 60. In another embodiment, the system 100 for automatically recording and transmitting a parking space number can be connected to the Internet (not shown) through the communication module 60, and the user terminal 200 can be connected to the Internet, so that the system 100 for automatically recording and transmitting a parking space number can transmit the parking space number to the user terminal 200 through the Internet. The user terminal 200 may be, for example, but is not limited to, a portable communication device (eg, a smartphone) or a wearable electronic device (eg, a smart watch).

[0018] The vehicle speed detection module 10 is coupled to the control module 50. The vehicle speed detection module 10 detects the traveling speed of the vehicle 150 to obtain vehicle speed information. The vehicle speed detection module 10 may be, for example, a wheel speed sensor or an axle speed sensor, but is not limited thereto. For example, the vehicle speed detection module 10 may be coupled to the wheels of the vehicle 150 to detect the rotation speed of the wheels to obtain the vehicle speed information. In another embodiment, the vehicle speed detection module 10 may be coupled to an output shaft of a transmission to detect the rotation speed of the output shaft to obtain the vehicle speed information.

[0019] The gear stage detection module 20 is coupled to the control module 50. The gear stage detection module 20 detects the gear stage of the vehicle 150 to obtain gear stage information. The gear stage detection module 20 may be, for example, a contact-type shift sensor or a non-contact-type shift sensor. For example, the gear stage detection module 20 may be coupled to a gear mechanism of the vehicle 150 to detect a change in the mechanical position of the gear mechanism to obtain the gear stage information. In another embodiment, the gear stage detection module 20 may detect a change in the mechanical position of the gear mechanism by magnetic induction to obtain the gear stage information. In another embodiment, the gear stage detection module 20 may detect a change in the mechanical position of the gear mechanism by photoelectric induction to obtain the gear stage information. The gear stage information may include, but is not limited to, a P gear (parking gear), an R gear (reverse gear), an N gear (neutral gear), a D gear (drive gear), a third gear, a second gear, and a low gear.

[0020] The vehicle camera module 30 is connected to the artificial intelligence module 40 and the control module 50. The vehicle camera module 30 is installed in the vehicle 150. The vehicle camera module 30 can acquire vehicle surroundings images by capturing images of the surroundings of the vehicle 150 (e.g., the front, left, right and / or rear, etc.) with a horizontal angle of view and a vertical angle of view. The vehicle camera module 30 may be, for example, a wide-angle camera, but is not limited thereto. The vehicle camera module 30 according to this embodiment is composed of multiple wide-angle cameras, but the vehicle camera module 30 according to other embodiments may be composed of one wide-angle camera.

[0021] For example, please refer to FIG. 2. FIG. 2 is a diagram showing the installation position of the vehicle camera module 30 of the system 100 for automatically recording and transmitting the parking space number according to the embodiment. The vehicle camera module 30 may include a front vehicle camera 31, a side vehicle camera 32, a side vehicle camera 33, and a rear vehicle camera 34. The front vehicle camera 31 that captures the image in front of the vehicle 150 is installed at the front of the vehicle 150. The side vehicle camera 32 that captures the image of the right side of the vehicle 150 is installed at the right side of the vehicle 150. The side vehicle camera 33 that captures the image of the left side of the vehicle 150 is installed at the left side of the vehicle 150. The rear vehicle camera 34 that captures the image of the rear of the vehicle 150 is installed at the rear of the vehicle 150. In other embodiments, the number of the vehicle camera modules 30 may be increased or decreased, and the installation position (e.g., roof and / or bottom) may be adjusted.

[0022] The artificial intelligence module 40 receives a plurality of vehicle surrounding images from the vehicle camera module 30, creates a parking space identification model according to the plurality of vehicle surrounding images, and identifies a plurality of characters corresponding to some vehicle surrounding images in the plurality of vehicle surrounding images according to the parking space identification model. In some embodiments, in order to create the parking space identification model, a large amount of images including parking space numbers may be input in advance to the artificial intelligence module 40 for training according to an object detection method using deep learning. The artificial intelligence module 40 may identify objects based on a neural network algorithm (e.g., YOLO), Region Based Convolutional Neural Networks (R-CNN) or Fast R-CNN, but is not limited thereto. The artificial intelligence module 40 may be stored in a non-volatile memory (e.g., a solid-state hard disk (SSD), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a read-only memory (ROM), etc.) to provide information required for the control module 50 to read or write.

[0023] The character grouping module 42 is connected to the artificial intelligence module 40. The character grouping module 42 groups the multiple characters identified by the artificial intelligence module 40 using a grouping algorithm, and generates multiple sets of parking space numbers corresponding to a portion of the vehicle surroundings images. In other words, the character grouping module 42 corresponds to a post-processing program for data processing, and can combine multiple characters into one or multiple sets of parking space numbers. In the process of grouping multiple characters, the characters may be grouped according to the distance between each other.

[0024] The control module 50 is connected to the vehicle speed detection module 10, the gear detection module 20, the vehicle camera module 30, the artificial intelligence module 40, the character grouping module 42, and the communication module 60. The control module 50 determines whether to perform identification in the part of the vehicle surroundings images to obtain the plurality of sets of parking space numbers based on the vehicle speed information from the vehicle speed detection module 10 and the gear information from the gear detection module. The control module 50 can further determine the priority of the plurality of sets of parking space numbers. In some embodiments, the control module 50 can determine the priority according to the number of times the plurality of sets of parking space numbers are identified in the part of the vehicle surroundings images in the plurality of vehicle surroundings images. For example, it is determined that the number that is identified the most times among the plurality of sets of parking space numbers in the part of the vehicle surroundings images in the plurality of vehicle surroundings images has the highest priority. In another embodiment, the control module 50 can determine the priority according to the installation position of the vehicle camera module 30 that identifies the plurality of sets of parking space numbers in the part of the vehicle surroundings images in the plurality of vehicle surroundings images. For example, the vehicle surroundings image captured by the front vehicle camera 31 or the rear vehicle camera 34 is determined to have the highest priority. In another embodiment, the control module 50 can determine the priority according to the time when the plurality of sets of parking space numbers are captured in a portion of the vehicle surroundings images in the plurality of vehicle surroundings images. For example, the priority of the number that is captured for the longest time among the plurality of sets of parking space numbers in a portion of the vehicle surroundings images in the plurality of vehicle surroundings images is determined to be the highest priority. In another embodiment, the control module 50 determines that the number that is captured the latest (e.g., closest to the current time) among the plurality of sets of parking space numbers in a portion of the vehicle surroundings images in the plurality of vehicle surroundings images is determined to be the highest priority. After stopping the engine of the parking space number vehicle 150, the control module 50 transfers the parking space number with the highest priority among the plurality of sets of parking space numbers to the communication module 60.The control module 50 may be, for example, a general or special purpose microprocessor, a field programmable gate array (FPGA), an application-specific integrated circuit (ASIC), a neural network accelerator, or other components, or a combination of these components.

[0025] The communication module 60 transmits the parking space number with the highest priority among the plurality of sets of parking space numbers from the control module 50 to the user terminal 200. The communication module 60 can transmit information including the parking space number to the user terminal 200 by a wireless communication transmission method, but is not limited thereto. The communication module 60 can support, but is not limited to, a Bluetooth communication standard, a WiFi communication standard, a Zigbee communication standard, a fourth generation (4G) cellular communication standard, or a fifth generation (5G) cellular communication standard. In another embodiment, the communication module 60 can transmit information including the parking space number to the user terminal 200 by a wired communication transmission method.

[0026] Please refer to Fig. 3. Fig. 3 is a flow chart showing that the system 100 for automatically recording and transmitting a parking space number according to the embodiment performs a method for automatically recording and transmitting a parking space number. The steps in Fig. 3 may be performed by the system 100 for automatically recording and transmitting a parking space number.

[0027] In step S200, the control module 50 judges whether the vehicle speed information from the vehicle speed detection module 10 is less than a set value. The set value may be, for example, 3km / hour to 8km / hour, but is not limited thereto. The control module 50 can compare the vehicle speed information acquired by the vehicle speed detection module 10 with the set value to judge whether the current running speed of the vehicle 150 is less than the set value. If it is judged as "No", that is, if the vehicle speed information is equal to or greater than the set value, step S200 is repeated, and the control module 50 continuously judges whether the vehicle speed information of the vehicle 150 is less than the set value. If it is judged as "Yes", the process proceeds to step S210.

[0028] In step S210, the control module 50 acquires some of the vehicle surrounding images from the multiple vehicle surrounding images based on the gear position information from the gear position detection module 20, and outputs the acquired images to the artificial intelligence module 40. For example, when the gear position information indicates that the vehicle is in D gear, the control module 50 may not acquire the vehicle surrounding images captured by the rear vehicle camera 34, but may only acquire the vehicle surrounding images captured by the front vehicle camera 31 and the side vehicle cameras 32 and 33. When the gear position information indicates that the vehicle is in D gear, it is determined that the vehicle 150 is not yet intending to park in a parking space (i.e., is still searching for a parking space), and the vehicle surrounding images acquired by the rear vehicle camera 34 have "no" or "very low" effect on the computation program for identifying the parking space number. Therefore, the control module 50 does not need to provide the vehicle surrounding images acquired by the rear vehicle camera 34 to the computation program for identifying the parking space number, and the computation load of the control module 50 can be reduced. In another embodiment, when the gear stage information indicates D gear, the image of the surroundings of the vehicle may not be acquired from the rear vehicle camera 34 and the side vehicle cameras 32, 33, and only the image of the surroundings of the vehicle may be acquired from the front vehicle camera 31.

[0029] In step S220, the artificial intelligence module 40 uses the parking space identification model to perform classification on some vehicle surrounding images among the multiple vehicle surrounding images acquired from the control module 50, and generates multiple characters corresponding to the some vehicle surrounding images, and outputs them to the character grouping module 42. The artificial intelligence module 40 obtains multiple characters, such as letters, numbers, and / or symbols, by performing cutting, analysis, and classification on the some vehicle surrounding images among the multiple vehicle surrounding images. In another embodiment, the characters may also include patterns.

[0030] In step S230, the character grouping module 42 groups the characters so as to generate a plurality of sets of parking space numbers corresponding to a portion of the vehicle surroundings image, and outputs the groups to the control module 50. The grouping of the characters may be performed according to the distance between each character.

[0031] In step S240, the control module 50 determines the priority of the multiple sets of parking space numbers. In some embodiments, the priority of the multiple sets of parking space numbers may be determined by the number of times that some vehicle surrounding images are identified. The reason why the number of times that the multiple sets of parking space numbers are identified is used as a judgment condition is that when the number of times that the multiple sets of parking space numbers are identified is high, it is highly likely that the driver of the vehicle 150 has selected a parking space that is the destination. In some embodiments, the priority of the multiple sets of parking space numbers may be determined by the installation position of the vehicle camera module that captures some vehicle surrounding images. The reason why the installation position of the vehicle camera (e.g., the front vehicle camera 31 or the rear vehicle camera 34) is used as a judgment condition is that the vehicle 150 usually stops at a parking space by moving straight or backward. In some embodiments, each of the vehicle surrounding images is recorded with shooting time information regarding the time when the image is captured, so that the control module 50 can determine the time sequence of each vehicle surrounding image from the shooting time information. The control module 50 may determine the priority of the multiple sets of parking space numbers based on multiple shooting time information of some vehicle surrounding images corresponding to the multiple sets of parking space numbers. In some embodiments, the control module 50 may determine that the number of the multiple sets of parking space numbers that has been photographed the longest in the partial vehicle surrounding images has the highest priority. For example, when the vehicle 150 is parked in the parking space without stopping the engine, the parking space number that has been photographed the longest by the car camera module 30 can be determined as the final parking position, and the control module 50 determines that the priority of this parking space number is the highest. In other embodiments, the control module 50 may determine that the number of the multiple sets of parking space numbers that has been photographed the latest in the partial vehicle surrounding images has the highest priority.

[0032] In step S250, the control module 50 checks whether the engine of the vehicle 150 has been stopped. For example, the control module 50 can check the stopped state of the engine of the vehicle 150 by an engine stop signal generated by a determination circuit in the vehicle 150 after the driver presses the engine stop button, or the control module 50 can check the stopped state of the engine of the vehicle 150 by an electricity cut signal (in the case of an electric vehicle) generated by a determination circuit in the vehicle 150 after the driver presses the engine stop button, but is not limited to the above methods. If the answer is "No", the process returns to step S200, and if the answer is "Yes", the process proceeds to step S260.

[0033] In step S260, the control module 50 transmits the parking space number with the highest priority among the plurality of sets of parking space numbers to the user terminal 200 through the communication module 60. In another embodiment, the control module 50 may determine whether to transmit the parking space number with the highest priority among the plurality of sets of parking space numbers to the user terminal 200 through the communication module 60 based on the “P gear” of the gear position information.

[0034] Please refer to FIG. 4A. FIG. 4A is a diagram showing a state where the system 100 for automatically recording and transmitting parking space numbers according to the embodiment acquires a vehicle surroundings image. When the gear position information indicates that the vehicle is in D gear, the control module 50 may acquire only the vehicle surroundings image corresponding to the first image range 310 captured by the front vehicle camera 31 and the side vehicle cameras 32 and 33, without acquiring the vehicle surroundings image corresponding to the second image range 340 captured by the rear vehicle camera 34. In this way, the amount of information of the vehicle surroundings image input to the control module 50 is reduced, thereby reducing the computation load of the control module 50 and improving the computation efficiency of the control module 50.

[0035] Please refer to FIG. 4B. FIG. 4B is another diagram showing a state in which the system 100 for automatically recording and transmitting parking space numbers according to the embodiment acquires a vehicle surroundings image. When the gear position information indicates that the vehicle is in the R gear, the control module 50 may not acquire a vehicle surroundings image corresponding to the first image range 310 captured by the front vehicle camera 31 and the side vehicle cameras 32 and 33, but may only acquire a vehicle surroundings image corresponding to the second image range 340 captured by the rear vehicle camera 34. In another embodiment, the control module 50 may not acquire a vehicle surroundings image corresponding to the second image range 340 captured by the rear vehicle camera 34 and / or a vehicle surroundings image corresponding to the image range captured by the front vehicle camera 31, but may only acquire a vehicle surroundings image corresponding to the image range captured by the side vehicle camera 32 or the side vehicle camera 33. Similarly, the method of acquiring a part of the vehicle surroundings images among the above-mentioned multiple vehicle surroundings images reduces the amount of information of the vehicle surroundings images input to the control module 50, thereby reducing the computation load of the control module 50 and improving the computation efficiency of the control module 50.

[0036] Please refer to FIG. 5A and FIG. 5B. FIG. 5A and FIG. 5B are diagrams showing the process of identifying the parking space number according to the embodiment. As shown in FIG. 5A, the vehicle 150 runs in the direction indicated by the arrow. When the vehicle 150 passes in front of the parking space, the control module 50 acquires a part of the vehicle surrounding images from the multiple vehicle surrounding images by the vehicle camera module 30 based on the gear information. Then, the artificial intelligence module 40 identifies characters from the part of the vehicle surrounding images, such as character 500 being "A", character 510 being "0", character 520 being "0", and so on. Finally, it is confirmed that the content of the multiple characters is "AAA000000123". The artificial intelligence module 40 outputs the identified characters to the character grouping module 42.

[0037] As shown in FIG. 5B, the character grouping module 42 can group a plurality of characters by a grouping algorithm and output the grouped characters to the control module 50. For example, the plurality of characters can be grouped according to the distance d between each character to generate parking space numbers 600, 610, and 620. Since the shooting time information is recorded in each vehicle surroundings image, the control module 50 can determine the shooting order of each vehicle surroundings image based on the shooting time information. When the vehicle 150 passes in front of the parking space number 620, the parking space number 620 is the parking space number that has been shot by the vehicle camera module 30 for the longest time (i.e., the vehicle surroundings image that has been shot the earliest), the parking space number 610 is the parking space number that has been shot by the vehicle camera module 30 for the next longest time, and the parking space number 600 is the parking space number that has been shot by the vehicle camera module 30 for the shortest time (i.e., the vehicle surroundings image that has been shot the latest). Therefore, the control module 50 provisionally determines the parking space number 620 as the first priority, determines the parking space number 610 as the second priority, and determines the parking space number 600 as the third priority. The first priority has a higher priority than the second priority, which has a higher priority than the third priority.

[0038] When the vehicle 150 continues to drive and reaches the parking space number 600, the parking space number 600 is photographed latest by the vehicle camera module 30, the parking space number 610 is photographed next latest by the vehicle camera module 30, and the parking space number 620 is photographed earliest by the vehicle camera module 30. Therefore, the control module 50 provisionally determines the parking space number 600 as the first priority, determines the parking space number 610 as the second priority, and determines the parking space number 620 as the third priority.

[0039] After the driver of the vehicle 150 finally decides to park at the location of parking space number 600 and turns off the engine, the control module 50 transmits the parking space number 600 determined as the first priority as a message to the user terminal 200 (e.g., a smartphone) via the communication module 60. This allows the driver to check the message on the smartphone and find out that the location where the vehicle 150 is parked is parking space number 600, thus eliminating the problem of forgetting where the vehicle was parked. In another embodiment, the control module 50 can determine the priority from the number of times the parking space number is identified in the vehicle surroundings image or the installation position of the vehicle camera module used.

[0040] As described above, in the method and system for automatically recording and transmitting parking space numbers according to the present invention, the control module 50 determines the priority order based on the number of times the parking space number is identified in the vehicle surroundings image, the time of shooting, or the installation position of the vehicle camera module, and after the engine of the vehicle 150 is stopped, the parking space number with the highest priority order is transmitted to the user terminal via the communication module 60, thereby eliminating the problem of the driver forgetting where he or she parked. In addition, the control module 50 acquires a portion of the vehicle surroundings image based on the gear position information, thereby reducing the amount of information of the vehicle surroundings image input to the control module 50, thereby reducing the calculation load of the control module 50 and relatively improving the calculation efficiency of the control module 50.

[0041] Although the present invention has been disclosed in the above preferred embodiments, those skilled in the art should understand that these embodiments are merely illustrative of the present invention and do not limit the scope of the present invention. Furthermore, any modifications or replacements equivalent to these embodiments should be considered to be within the scope of the present invention. Therefore, the scope of protection of the present invention should be determined based on the definition of the claims. [Explanation of symbols]

[0042] 10 Vehicle speed detection module 20 Gear detection module 30 Car camera module 31 Front car camera 32 Side car camera 33 Side car camera 34 Rear car camera 40 Artificial Intelligence Module 42 Character Grouping Module 50 Control Module 60 Communication Module 100 A system for automatically recording and transmitting parking space numbers 200 user terminals 310 First Image Range 340 Second Image Range 500, 510, 520 characters 600, 610, 620 Parking slot numbers d Distance S200, S210, S220, S230, S240, S250 Step

Claims

1. This is carried out by a system that automatically records and transmits parking space numbers. determining whether or not the vehicle speed information of the vehicle is less than a set value; acquiring a part of a plurality of vehicle surrounding images according to gear position information of the vehicle when the vehicle speed information is determined to be less than the set value; Creating a parking space identification model based on the plurality of vehicle surrounding images, and identifying a plurality of characters corresponding to the portion of the vehicle surrounding images; grouping the plurality of characters so as to generate a plurality of sets of parking space numbers each corresponding to the portion of the vehicle surroundings image; determining a priority order for the plurality of sets of parking space numbers; and transmitting the parking space number with the highest priority among the plurality of sets of parking space numbers to a user terminal after stopping an engine of the vehicle.

2. The method of claim 1 , wherein the step of grouping the plurality of characters is performed according to distances between each of the characters.

3. The method of claim 1 , wherein the priority of the sets of parking space numbers is determined by the number of times the sets of parking space numbers are identified in the portion of the vehicle surroundings images.

4. The method according to claim 1 , wherein the priority of the plurality of sets of parking space numbers is determined according to an installation position of a vehicle camera module that captures the partial vehicle surroundings image.

5. The method according to claim 1 , wherein the priority of the sets of parking space numbers is determined according to a time point when the part of the vehicle surroundings images are captured.

6. A vehicle speed detection module that detects a traveling speed of a vehicle and acquires vehicle speed information; A gear detection module detects a gear of the vehicle and acquires gear information; A vehicle camera module that is installed in the vehicle and captures a plurality of vehicle surrounding images; an artificial intelligence module connected to the vehicle camera module, for creating a parking space identification model based on the plurality of vehicle surrounding images, and for identifying a plurality of characters corresponding to some of the vehicle surrounding images in the plurality of vehicle surrounding images; a character grouping module, connected to the artificial intelligence module, for grouping the plurality of characters so as to generate a plurality of sets of parking space numbers respectively corresponding to the part of the vehicle surrounding images; a control module connected to the vehicle speed detection module, the gear detection module, the vehicle camera module, the character grouping module, and the artificial intelligence module, for determining a priority order for the plurality of sets of parking space numbers; a communication module coupled to the control module, the communication module being configured to transmit a highest priority parking space number in the plurality of sets of parking space numbers to a user terminal.

7. The system of claim 6 , wherein the character grouping module groups the plurality of characters according to a distance between each of the characters.

8. The system of claim 6 , wherein the priority of the sets of parking space numbers is determined by the number of times the sets of parking space numbers are identified in the portion of the vehicle surroundings images.

9. The system according to claim 6 , wherein the priority of the plurality of sets of parking space numbers is determined according to an installation position of an in-vehicle camera module that captures the partial vehicle surroundings video.

10. The system according to claim 6 , wherein the priority of the plurality of sets of parking space numbers is determined according to a time point when the partial vehicle surroundings image is captured.

Citation Information

Patent Citations

  • Information processing device, information processing method, and program

    JP2020013382A

  • Parking position confirmation system

    JP2020101976A

  • Parking position notification system of vehicle

    JP2021181937A

  • Information processing apparatus, information processing system, information processing method, and program

    JP2021192467A