Inspection device for berths in road

By combining a three-lens camera video inspection device with a data processing terminal, parking space and license plate information can be identified, solving the problems of high manual calibration costs and GPS drift in the management of roadside temporary parking fees, and achieving efficient and low-cost parking space positioning.

CN119049328APending Publication Date: 2024-11-29TIANJIN JL RAILWAY TRANSPORT EQUIP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411129109.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-16
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

Existing technologies for managing roadside temporary parking fees suffer from high costs associated with manual calibration and GPS positioning drift.

Method used

By employing a tri-lens camera video inspection device combined with a data processing terminal and handheld communication equipment, the device identifies berth ground markings and license plate information, and uses image processing technology to obtain the three-dimensional location information of the berths, reducing manual calibration costs and solving the GPS drift problem.

Benefits of technology

It enables rapid and accurate acquisition of berth information, reduces manpower and equipment costs, avoids GPS positioning drift, and improves positioning accuracy and efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119049328A_ABST
    Figure CN119049328A_ABST
Patent Text Reader

Abstract

The invention discloses the technical field of parking management, and relates to an on-road berth inspection device, which comprises a three-eye camera video inspection device, a data processing terminal, a communication connection device and handheld communication equipment, and is characterized in that the three-eye camera video inspection device is used for identifying a berth ground mark number and a berth frame; according to the device, the current parking space information is determined through a camera shooting unit, a parking space number and a parking space frame in the three-eye camera shooting video inspection device, and then the parking space frame and the vehicle are matched based on an image processing unit in the data processing terminal by detecting the vehicle and recognizing license plate information, so that the rapid current parking space information is obtained; meanwhile, the device positions the berth through the berth number and the berth frame, does not need to calibrate the berth information through a GPS (Global Positioning System), not only solves the problem of positioning drift caused by the GPS, but also reduces the use cost, the RTCM service charge required by an RTK (Real Time Kinematic) and the like.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This patent relates to the field of parking management technology, specifically an on-street parking space inspection device. Background Art

[0002] At present, the parking fee management of temporary roadside parking spaces is generally carried out by geomagnetism, high-position video, low-position video, inspection vehicles, etc.

[0003] High-position video, low-position video and geomagnetism, etc., require road breaking and construction, which requires approval from relevant departments, pushing back the operator's launch time;

[0004] Inspection vehicles are highly favored because they do not require additional construction and can be operated after installation. However, traditional inspection solutions require the use of handheld or mobile high-precision calibration equipment to calibrate the position of each berth. High-precision positioning equipment such as RTK requires a long wait at a location, which can be as fast as 30 seconds or as slow as 1-2 hours. However, parking projects range from 3,000 berths to tens of thousands of berths. The calibration labor cost of this solution is extremely huge.

[0005] Secondly, GPS brings the problem of long-term drift. No matter how accurate the positioning equipment is, under certain cost constraints, as well as multipath problems, weak signal problems and other positioning problems that cannot be overcome by themselves, the order problems caused by positioning drift cannot be solved during operation. Summary of the invention

[0007] The purpose of this patent is to provide an on-road berth inspection device to solve the problems of high labor calibration cost and easy positioning drift mentioned in the above background technology.

[0008] To achieve the above-mentioned purpose, this patent provides the following technical solutions: an on-road berth inspection device, including a three-eye camera video inspection device, a data processing terminal, a communication connection device and a handheld communication device;

[0009] The three-eye camera video inspection device is used to identify the berth ground mark and berth frame, determine the berth information currently photographed, and can identify the license plate information of the vehicle parked in the berth;

[0010] The three-eye camera video inspection device includes a placement platform, a front camera unit, a middle camera unit and a rear camera unit. The placement platform is installed on the external electric vehicle platform. One side of the placement platform is provided with three installation holes. The front camera unit, the middle camera unit and the rear camera unit are installed in the three installation holes respectively. The angles of the front camera unit and the rear camera unit can be adjusted.

[0011] The communication connection device and the three-eye camera video inspection device are both installed on the external electric vehicle platform, and the communication connection device is used to upload the pictures taken by the three-eye camera video inspection device to the data processing terminal, and the communication connection device is connected to the data processing terminal using a data network;

[0012] The data processing terminal stores berth system information for matching with the berth information collected by the three-eye camera video inspection device;

[0013] The handheld communication device is used to provide approximate location information to the three-eye camera video inspection device and provide berth information within a certain range of the current location;

[0014] The on-street berth inspection and positioning method comprises the following steps:

[0015] Step 1, calibrate the three-eye camera video inspection device, and establish the relative relationship between the front, middle and rear camera units in the three-eye camera video inspection device in the world coordinate system;

[0016] Step 2, using an electric vehicle platform to carry the device to the berth to be positioned;

[0017] Step 3: Provide approximate location information to the three-eye camera video inspection device through a handheld communication device to understand the berth information within the current location range;

[0018] Step 4, when the external electric vehicle platform carries the device forward, the three camera units of the three-eye camera video inspection device respectively capture images of the scene from three different perspectives;

[0019] Step 5, transmitting the pictures of the berth at different angles taken by the three-eye camera video inspection device to the data processing terminal through the communication connection device;

[0020] Step 6: The data processing terminal calculates the parallax of the berth in these images to obtain the three-dimensional position information of the berth and the corresponding physical coordinates;

[0021] This step is completed by the computing unit of the data processing terminal;

[0022] Step 7, after obtaining the physical coordinates of the berth, the data processing terminal verifies the length and width of the berth to obtain the relevance of each berth;

[0023] Step 8: The data processing terminal identifies the berth number in the image and matches it with the berth system information stored in the terminal to obtain the complete information of the berth and complete the inspection and positioning of the berth;

[0024] This step is completed by a comparison unit in the data processing terminal, and the berth system information is stored in a storage unit in the data processing terminal.

[0025] Preferably, the three-eye camera video inspection device is provided with an angle adjustment mechanism, and the angle adjustment mechanism can adjust the angles of the front camera unit and the rear camera unit in the three-eye camera video inspection device.

[0026] Preferably, the adjustment formula of the angle adjustment mechanism is: tanA -1 (L / 2-l 1 ) / l 2 = the numerical value of ∠A.

[0027] Preferably, ∠A is the angle between the front camera unit and the rear camera unit and the middle camera unit in the three-eye camera video inspection device;

[0028] The L is the berth length in the berth information;

[0029] The l 1 The distances between the front camera unit and the rear camera unit and the middle camera unit in the three-eye camera video inspection device;

[0030] The l 2 This is the distance between the three-eye camera video inspection device and the berth frame at this time.

[0031] Preferably, the method for calculating the correlation between parked vehicles and berths comprises the following steps:

[0032] Step 1: The three-eye camera video inspection device takes a picture of the parked vehicle in the berth frame to obtain the positions of the two visible wheels in the image, and infers the image positions of the other two wheels based on the image processing unit inside the data processing terminal;

[0033] Step 2, obtaining the absolute position of the vehicle in the world coordinate system based on the calibration information and the parallax information of the three-eye camera video inspection device;

[0034] Step 3: Obtain the positions of two points outside the berth in the image through the on-street berth inspection and positioning method, and infer the image position information of the four points of the complete berth;

[0035] Step 4, obtaining the absolute position of the berth in the world coordinate system according to the calibration information of the three-eye camera video inspection device and the parallax information of the three-eye camera video inspection device;

[0036] Step 5, obtaining the correlation between the vehicle and the berth by calculating the world coordinates of the berth and the vehicle.

[0037] Preferably, steps 1 to 5 are all processed in the data processing terminal. After obtaining the final calculation result, the data processing terminal sends it to the external management system through the communication unit inside the data processing terminal, and sends the feedback result to the handheld communication device.

[0038] Compared with the prior art, the beneficial effects of this patent are:

[0039] This device uses the camera unit in the three-eye camera video inspection device to identify the berth number and the berth frame to determine the current berth information, and then detects the vehicle and identifies the license plate information, and matches the berth frame and the vehicle based on the image processing unit inside the data processing terminal, so as to obtain the current berth information quickly, thereby reducing the cost of berth position calibration. At the same time, this device locates the berth by the berth number and the berth frame, and does not need to calibrate the berth information through GPS. It not only solves the positioning drift problem caused by GPS, but also reduces the cost of use. RTK and other devices require RTCM service fees, etc. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 This is the principle block diagram of this patent.

[0041] Figure 2 This is the principle block diagram of the angle adjustment mechanism of this patent. DETAILED DESCRIPTION

[0042] The following will be combined with the drawings in the embodiments of this patent to clearly and completely describe the technical solutions in the embodiments of this patent. Obviously, the described embodiments are only part of the embodiments of this patent, not all of them. Based on the embodiments in this patent, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this patent.

[0043] See also Figure 1-2 ,This patent provides a technical solution: an on-road berth inspection device, including a three-eye camera video inspection device, a data processing terminal, a communication connection device and a handheld communication device;

[0044] The three-eye camera video inspection device is used to identify the berth ground mark and berth frame, determine the berth information currently photographed, and can identify the license plate information of the parked vehicle in the berth;

[0045] The three-eye camera video inspection device includes a placement platform, a front camera unit, a middle camera unit and a rear camera unit. The placement platform is installed on the external electric vehicle platform. Three mounting holes are opened on one side of the placement platform. The front camera unit, the middle camera unit and the rear camera unit are respectively installed in the three mounting holes. The angles of the front camera unit and the rear camera unit can be adjusted.

[0046] The three-camera video inspection device is also equipped with a vehicle information recognition unit, which can capture images of the parking space and the parked vehicle in the parking space from three different perspectives through the three camera units, and the license plate number can be read through the vehicle information recognition unit;

[0047] The communication connection device and the three-eye camera video inspection device are both installed on the external electric vehicle platform. The communication connection device is used to upload the pictures taken by the three-eye camera video inspection device to the data processing terminal. The communication connection device is connected to the data processing terminal using a data network;

[0048] The communication connection device uses a 4G / 5G network. The device is responsible for transmitting the images taken by the three-eye camera video inspection device and vehicle information to the data processing terminal, and processing the images through the image recognition unit in the data processing terminal;

[0049] The data processing terminal stores berth system information for matching with the berth information collected by the three-eye camera video inspection device;

[0050] Handheld communication equipment, used to provide approximate location information to the three-eye camera video inspection device, and provide berth information within a certain range of the current location;

[0051] The handheld communication device can also receive the results of processing and calculation by the data processing terminal, which is convenient for the staff to check;

[0052] The on-street berth inspection and positioning method comprises the following steps:

[0053] Step 1, calibrate the three-eye camera video inspection device, and establish the relative relationship between the front, middle and rear camera units in the three-eye camera video inspection device in the world coordinate system;

[0054] Step 2, using an electric vehicle platform to carry the device to the berth to be positioned;

[0055] Step 3: Provide approximate location information to the three-eye camera video inspection device through a handheld communication device to understand the berth information within the current location range;

[0056] Step 4, when the external electric vehicle platform carries the device forward, the three camera units of the three-eye camera video inspection device respectively capture images of the scene from three different perspectives;

[0057] In this step, the three camera units are the front camera unit, the middle camera unit and the rear camera unit;

[0058] Step 5, transmitting the pictures of the berth at different angles taken by the three-eye camera video inspection device to the data processing terminal through the communication connection device;

[0059] Step 6: The data processing terminal calculates the parallax of the berth in these images to obtain the three-dimensional position information of the berth and the corresponding physical coordinates;

[0060] Step 7, after obtaining the physical coordinates of the berth, the data processing terminal verifies the length and width of the berth to obtain the relevance of each berth;

[0061] Step 8: The data processing terminal identifies the berth number in the image and matches it with the berth system information stored in the terminal to obtain the complete information of the berth and complete the inspection and positioning of the berth;

[0062] The device uses the camera unit in the three-eye camera video inspection device to identify the berth number and berth frame to determine the current berth information, and matches the berth frame based on the image processing unit inside the data processing terminal, so as to obtain the current berth information quickly, and compare it with the stored berth system information to complete the calibration of the berth, thereby reducing the cost of berth position calibration;

[0063] At the same time, the device locates the berth through the berth number and the berth frame, and does not need to calibrate the berth information through GPS. It not only solves the positioning drift problem caused by GPS, but also reduces the cost of use. RTK requires RTCM service fees, etc.

[0064] Specifically, the three-eye camera video inspection device is provided with an angle adjustment mechanism, which can adjust the angles of the front camera unit and the rear camera unit in the three-eye camera video inspection device;

[0065] Because the electric vehicle platform cannot always maintain a certain distance from the berth, it is necessary to adjust the angles of the front camera unit and the rear camera unit in the three-eye camera video inspection device according to the distance between the electric vehicle platform and the berth to reduce the result error;

[0066] The angle adjustment mechanism in this article includes a controller, a micro-stepping motor, a radar rangefinder and a computing unit. Every time the micro-stepping motor rotates, the angle of the camera unit increases or decreases by one degree. The radar rangefinder detects the distance between the three-eye camera video inspection device and the berth frame in real time, and then calculates the angle value according to the adjustment formula through the computing unit. According to the obtained value, the controller controls the micro-stepping motor to start and adjust the angle of the camera unit.

[0067] Specifically, the adjustment formula of the angle adjustment mechanism is: tanA -1 (L / 2-l 1 ) / l 2 = the numerical value of ∠A.

[0068] Specifically, ∠A is the angle between the front camera unit and the rear camera unit and the middle camera unit in the three-eye camera video inspection device;

[0069] The formula can be used to obtain the angles between the front camera unit and the rear camera unit and the middle camera unit respectively, and the front camera unit and the rear camera unit can be adjusted in real time through the angle adjustment mechanism to reduce the error as much as possible;

[0070] L is the berth length in the berth information;

[0071] l 1 The distances between the front camera unit and the rear camera unit and the middle camera unit in the three-eye camera video inspection device;

[0072] l 2 This is the distance between the three-eye camera video inspection device and the berth frame at this time.

[0073] Specifically, the method for calculating the correlation between a parked vehicle and a parking space includes the following steps:

[0074] Step 1: The three-eye camera video inspection device takes a picture of the parked vehicle in the berth frame to obtain the positions of the two visible wheels in the image, and infers the image positions of the other two wheels based on the image processing unit inside the data processing terminal;

[0075] Step 2, obtaining the absolute position of the vehicle in the world coordinate system based on the calibration information and the parallax information of the three-eye camera video inspection device;

[0076] Step 3: Obtain the positions of two points outside the berth in the image through the on-street berth inspection and positioning method, and infer the image position information of the four points of the complete berth;

[0077] Step 4, obtaining the absolute position of the berth in the world coordinate system according to the calibration information of the three-eye camera video inspection device and the parallax information of the three-eye camera video inspection device;

[0078] Step 5, obtaining the correlation between the vehicle and the berth by calculating the world coordinates of the berth and the vehicle.

[0079] Specifically, steps 1 to 5 are all processed in the data processing terminal. After the data processing terminal obtains the final calculation result, it will be sent to the external management system through the communication unit inside the data processing terminal, and the feedback result will be sent to the handheld communication device;

[0080] When a vehicle is parked in the wrong place, the data processing terminal will send the result to the external parking space management system, and the parking space management agency will dispatch staff to call the vehicle owner to park the vehicle correctly in the parking space. The staff will then take photos of the scene to collect evidence and upload them to the data processing terminal, which will then send feedback to the handheld communication device.

[0081] It is obvious to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above, and that the present invention can be implemented in other specific forms without departing from the spirit or essential features of the present invention. Therefore, the embodiments should be considered exemplary and non-restrictive in all respects, and the scope of the present invention is defined by the appended claims rather than the above description, and it is intended that all changes falling within the meaning and scope of the equivalent elements of the claims be included in the present invention. Any reference numeral in a claim should not be considered as limiting the claim to which it relates.

[0082] In addition, it should be understood that although the present specification is described according to implementation modes, not every implementation mode contains only one independent technical solution. This description of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each embodiment may also be appropriately combined to form other implementation modes that can be understood by those skilled in the art.

Claims

1. An on-street berth inspection device, comprising a three-eye camera video inspection device, a data processing terminal, a communication connection device and a handheld communication device, characterized in that: The three-eye camera video inspection device is used to identify the berth ground mark and berth frame, determine the berth information currently photographed, and can identify the license plate information of the vehicle parked in the berth; The three-eye camera video inspection device includes a placement platform, a front camera unit, a middle camera unit and a rear camera unit. The placement platform is installed on the external electric vehicle platform. One side of the placement platform is provided with three installation holes. The front camera unit, the middle camera unit and the rear camera unit are installed in the three installation holes respectively. The angles of the front camera unit and the rear camera unit can be adjusted. The communication connection device and the three-eye camera video inspection device are both installed on the external electric vehicle platform, and the communication connection device is used to upload the pictures taken by the three-eye camera video inspection device to the data processing terminal, and the communication connection device is connected to the data processing terminal using a data network; The data processing terminal stores berth system information for matching with the berth information collected by the three-eye camera video inspection device; The handheld communication device is used to provide approximate location information to the three-eye camera video inspection device and provide berth information within a certain range of the current location; The on-street berth inspection and positioning method comprises the following steps: Step 1, calibrate the three-eye camera video inspection device, and establish the relative relationship between the front, middle and rear camera units in the three-eye camera video inspection device in the world coordinate system; Step 2, using an electric vehicle platform to carry the device to the berth to be positioned; Step 3: Provide approximate location information to the three-eye camera video inspection device through a handheld communication device to understand the berth information within the current location range; Step 4, when the external electric vehicle platform carries the device forward, the three camera units of the three-eye camera video inspection device respectively capture images of the scene from three different perspectives; Step 5, transmitting the pictures of the berth at different angles taken by the three-eye camera video inspection device to the data processing terminal through the communication connection device; Step 6: The data processing terminal calculates the parallax of the berth in these images to obtain the three-dimensional position information of the berth and the corresponding physical coordinates; Step 7, after obtaining the physical coordinates of the berth, the data processing terminal verifies the length and width of the berth to obtain the relevance of each berth; Step 8: The data processing terminal identifies the berth number in the image and matches it with the berth system information stored internally, obtains the complete information of the berth, and completes the inspection and positioning of the berth.

2. The on-street berth inspection device according to claim 1, characterized in that: The three-eye camera video inspection device is provided with an angle adjustment mechanism, and the angle adjustment mechanism can adjust the angles of the front camera unit and the rear camera unit in the three-eye camera video inspection device.

3. The on-street berth inspection device according to claim 1, characterized in that: The adjustment formula of the angle adjustment mechanism is: tanA -1 (L / 2-l1) / l2=the value of ∠A.

4. The on-street berth inspection device according to claim 3, characterized in that: The ∠A is the angle between the front camera unit and the rear camera unit and the middle camera unit in the three-eye camera video inspection device; The L is the berth length in the berth information; The l1 is the distance between the front camera unit and the rear camera unit and the middle camera unit in the three-eye camera video inspection device; The l2 is the distance between the three-eye camera video inspection device and the berth frame at this time.

5. The on-street berth inspection device according to claim 1, characterized in that: The method for calculating the correlation between parked vehicles and parking spaces comprises the following steps: Step 1: The three-eye camera video inspection device takes a picture of the parked vehicle in the berth frame to obtain the positions of the two visible wheels in the image, and infers the image positions of the other two wheels based on the image processing unit inside the data processing terminal; Step 2, obtaining the absolute position of the vehicle in the world coordinate system based on the calibration information and the parallax information of the three-eye camera video inspection device; Step 3: Obtain the positions of two points outside the berth in the image through the on-street berth inspection and positioning method, and infer the image position information of the four points of the complete berth; Step 4, obtaining the absolute position of the berth in the world coordinate system according to the calibration information of the three-eye camera video inspection device and the parallax information of the three-eye camera video inspection device; Step 5, obtaining the correlation between the vehicle and the berth by calculating the world coordinates of the berth and the vehicle.

6. The on-street berth inspection device according to claim 5, characterized in that: The steps 1 to 5 are all processed in the data processing terminal. After obtaining the final calculation result, the data processing terminal sends it to the external management system through the communication unit inside the data processing terminal, and sends the feedback result to the handheld communication device.