System and method for realizing vehicle omnibearing photographing and defect detection based on camera

Abstract

The invention discloses a system and a method for realizing vehicle omnibearing photographing and defect detection based on a camera, and relates to the technical field of vehicle detection. The system comprises a license plate recognition module, a chassis scanning terminal all-in-one machine, an annular shooting trigger module, a five-direction annular shooting unit, a cloud server and a terminal. The obtained imaging picture is high in standardization, does not depend on personal subjective meaning representation, can be overcome due to differences of shooting directions, angles, light rays and the like, and is suitable for standardized popularization and application; the chassis scanning terminal all-in-one machine and the five-direction annular shooting unit can smoothly, rapidly and conveniently achieve efficient chassis scanning imaging and imaging in five directions of a vehicle, and compared with a manual handheld camera, the system has obvious convenience for a chassis, a vehicle roof and other positions which are not prone to being shot, the speed is higher, and the efficiency is higher; the photos are stored in the cloud server and can be called and modified at any time, and the traceability is high; and the efficiency is greatly improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of vehicle detection, and in particular relates to a camera-based system and method for realizing all-round vehicle photography and defect detection. Background Art

[0002] Vehicles require regular maintenance and upkeep, especially in repair centers and second-hand car sales. The chassis and appearance of the car need to be fully inspected. In the current scenario, the chassis is manually lifted up for manual observation and photographs taken with mobile phones. The exterior of the car is also manually inspected and photographed with mobile phones.

[0003] The existing manual handheld camera photography method has the following disadvantages: (1) There is no standardized operation. Different people, different mobile phones, and different shooting directions, angles, and light sources will have significant differences. It is impossible to form a standardized shooting standard, and thus it cannot be used as a standard inspection and evaluation basis; (2) For the chassis, roof, and other detailed positions of the car, it is impossible to shoot directly with a handheld camera, or it is difficult to shoot, especially for blind spots in panoramic shooting, rainy weather affecting the shooting of chassis detection, insufficient camera clarity, and high requirements for vehicle parking accuracy. These are all disadvantages of handheld camera photography; (3) Manual mobile phone photography is not convenient for later tracing and calling, and the convenience of storage and query is poor. It is easy to have unfair situations of artificial calling, modification, or replacement in the middle; (4) The existing manual mobile phone photography involves steps such as lifting the chassis, and the waiting time is relatively long. The chassis and vehicle appearance inspection cannot be carried out smoothly and continuously, and the efficiency is relatively low. Therefore, in response to the above problems, the present technical solution provides a system and method for realizing all-round photography and defect detection of vehicles based on a camera. Summary of the invention

[0004] The present invention provides a system and method for realizing all-round photography and defect detection of vehicles based on a camera, adopts a standardized detection station for photography and defect detection instead of manual handheld camera shooting. Compared with the prior art, the obtained imaging pictures are highly standardized and do not rely on the subjective expression of an individual, because the differences in shooting orientation, angle, light, etc. can be overcome, and are suitable for standardized promotion and application; the chassis scanning terminal integrated machine and the five-direction ring shooting unit can smoothly, quickly and conveniently realize efficient chassis scanning imaging and imaging in five directions of the vehicle, which is obviously convenient for the chassis, roof and other positions that are not easy to shoot compared with manual handheld cameras, and is faster and more efficient; the detection system adopting the scheme, the photos taken are stored in the cloud server, which can be called and modified at any time, and has strong traceability; compared with the existing vehicle appearance inspection, the owner does not even need to get off the vehicle, and can directly drive slowly, and 360-degree all-round photography and defect detection can be completed in a short time, which greatly improves efficiency; in summary, the problems in the background technology are solved.

[0005] In order to solve the above technical problems, the present invention is achieved through the following technical solutions:

[0006] The camera-based vehicle omnidirectional photography and defect detection system of the present invention comprises:

[0007] License plate recognition module: used to recognize the license plate of the vehicle to be detected;

[0008] Chassis scanning terminal integrated machine: It is set at the chassis scanning and testing station to perform an overall scan on the bottom of the vehicle chassis to be tested and obtain clear and complete vehicle chassis photos;

[0009] Ring-shooting trigger module: used to trigger five-direction ring-shooting of the vehicle to be inspected that enters the ring-shooting station;

[0010] Five-direction panoramic photography unit: used to take five-direction panoramic photography of vehicles entering the panoramic photography station. The five directions include the front, rear, left, right and top, to obtain clear and complete appearance photos of the vehicle in five directions;

[0011] Cloud server: used to store vehicle license plate information, corresponding vehicle chassis photos, and five-direction appearance photos of the vehicle transmitted via the network module; the cloud server is connected to the Alibaba Cloud scratch recognition algorithm through an interface; the ring-shot trigger module and the five-direction ring-shot unit are connected to the cloud server through a switch via the network module;

[0012] Terminal: Calls the vehicle chassis photos and five-direction appearance photos of the vehicle stored in the cloud server, as well as the scratch results identified by the Alibaba Cloud scratch recognition algorithm. The scratch results include the number and location of scratches identified in all pictures, and support the zooming in and restoring operations of all photos; the terminal is connected to the industrial computer that controls the inspection area; the industrial computer is connected to a touch screen and a loudspeaker. The touch screen displays the results of the chassis scan photos of the vehicle being inspected and the results of the five-direction panoramic photos in real time, and reminds the car owner to operate according to the projection command through the loudspeaker. The touch screen and loudspeaker are located at the inspection site.

[0013] Furthermore, the license plate recognition module is a license plate recognition camera, and the five-direction panoramic unit is composed of four exterior shooting cameras arranged in front, behind, left and right of the panoramic station and a roof shooting camera arranged on the top of the panoramic station.

[0014] Furthermore, video recorders are installed at the chassis scanning and inspection station and the ring-shooting station, and the data are synchronously transmitted to the cloud server for terminal access.

[0015] Furthermore, the cloud server is also connected to a management and control terminal, which can add and bind terminals and various system modules to the server, and support the addition, deletion, query and modification of terminals and various system modules; if the MAC address can be obtained through the NVR device number through interaction, it will be displayed; otherwise, if it cannot be obtained, it will be manually entered.

[0016] Furthermore, the terminal displays a ring-shot dashboard, which can show the operating environment monitoring before logging into the dashboard, and detect the smoothness of the current network, and divide the network smoothness into three levels: good, medium and bad according to the network ping value.

[0017] Furthermore, the chassis scanning terminal is ground-mounted or buried, and can scan and photograph the vehicle chassis.

[0018] Furthermore, the chassis scanning terminal integrated machine includes a table and a chassis scanning camera; during scanning, the table carries the vehicle to be tested and moves forward and the chassis scanning camera is stationary, or the table carries the vehicle to be tested and remains stationary and the chassis scanning camera moves forward through a linear mechanism.

[0019] Furthermore, the ground-mounted chassis scanning camera is located on the ground; and the underground chassis scanning camera is located in a pit in the middle of the table top.

[0020] The method for realizing all-round photography and defect detection of a vehicle based on a camera includes the following steps:

[0021] S1: When a vehicle enters a designated detection area, the vehicle information is obtained through the license plate recognition camera and transmitted to the cloud server through the network module;

[0022] S2. When the inspection area is the chassis scanning inspection station, enter the inspection station through the speed bump, and scan the vehicle chassis through the chassis scanning terminal to obtain a clear and complete chassis photo;

[0023] When the detection area is a surround-photographing station, the license plate recognition camera identifies that the vehicle has completely entered the surround-photographing station, triggering the surround-photographing mechanism. The loudspeaker device voice prompts the vehicle to enter the surround-photographing area and asks the vehicle to drive slowly. During the driving process, the four exterior cameras in front, behind, to the left and to the right of the surround-photographing station and the roof camera arranged on the top of the surround-photographing station take surround-photographs of the vehicle in five directions. After the vehicle leaves the surround-photographing area, the loudspeaker device voice prompts that the vehicle has completed the surround-photographing and drives away from the surround-photographing station; thus, clear and complete photos of the vehicle in five directions are obtained;

[0024] S3, processing the acquired vehicle chassis photos and the vehicle five-direction panoramic photos and merging them into a standardized panoramic image;

[0025] S4, transmitting the processed panoramic image to the server through the network module for data analysis and display;

[0026] S5. During the period from when the vehicle enters the inspection station and the surround-photographing station until it leaves the station, the touch screen displays the results of the chassis scanning photo of the vehicle being inspected and the results of the five-direction surround-photographing photo in real time;

[0027] S6. The terminal user or the owner of the detected vehicle calls the vehicle chassis photo data and the five-direction surround photo data through the terminal to preview, save, mark and enlarge the data;

[0028] S7. After the terminal operation is completed, the server saves the operation record and photo data for storage and backup to facilitate later query and management.

[0029] Furthermore, the merged standardized panorama is automatically uploaded to a folder under the specified directory, and the folder is named and stored according to the license plate number. The data transmission will be merged and sent back to the terminal through the external network for data analysis; redundant files are automatically deleted. After the data is uploaded to the cloud server, the local files are automatically deleted to avoid the hard disk capacity overload causing the industrial control to fail to operate normally or run slowly.

[0030] Compared with the prior art, the present invention has the following beneficial effects:

[0031] (1) Using standardized inspection stations for photography and defect inspection, rather than manual handheld camera shooting, the obtained images are highly standardized compared to the existing technology and do not rely on individual subjective expressions. Differences in shooting orientation, angle, light, etc. can be overcome, making it suitable for standardized promotion and application;

[0032] (2) The use of chassis scanning terminal and five-direction panoramic shooting unit can smoothly, quickly and conveniently realize efficient chassis scanning imaging and imaging in five directions of the vehicle. Compared with manual handheld cameras, it is obviously more convenient for the chassis, roof and other locations that are difficult to photograph, and it is faster and more efficient;

[0033] (3) With the detection system of this solution, the photos taken are stored in the cloud server and can be called and modified at any time, with strong traceability;

[0034] (4) Compared with existing vehicle appearance inspections, the vehicle owner does not even need to get out of the vehicle. The vehicle can be driven slowly and 360-degree photography and defect inspection can be completed in a short time, greatly improving efficiency.

[0035] Of course, any product implementing the present invention does not necessarily need to achieve all of the advantages described above at the same time. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for describing the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0037] Figure 1 This is a schematic structural diagram of a vehicle omnidirectional photography and defect detection system based on a camera according to the present invention;

[0038] Figure 2 A diagram of the hardware components of the system;

[0039] Figure 3 This is a functional diagram of the 360 ​​platform in this specific embodiment.

[0040] Figure 4 This is a functional diagram of the 360-degree gadget in this specific embodiment;

[0041] Figure 5 This is a structural schematic diagram of a chassis scanning and detection station in this specific embodiment;

[0042] Figure 6 A diagram showing the specific steps of a method for realizing all-round vehicle photography and defect detection based on a camera in a specific embodiment of the present invention;

[0043] Figure 7 A flowchart of a separate chassis scan in a specific embodiment of the present invention;

[0044] Figure 8 It is a separate five-position ring shooting flow chart in a specific embodiment of the present invention;

[0045] Fig. 9 The diagram is a principle and step diagram of the ring shot list in a specific embodiment of the present invention. DETAILED DESCRIPTION

[0046] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0047] In the description of the present invention, it should be understood that terms such as "directly in front", "directly behind", "directly to the left", "directly to the right", and "directly above" indicating directions or positional relationships are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the components or elements referred to must have a specific direction, be constructed and operated in a specific direction, and therefore should not be understood as limiting the present invention.

[0048] See also Figure 1-5 As shown, the camera-based vehicle omnidirectional photography and defect detection system of the present invention includes:

[0049] License plate recognition module: used to recognize the license plate of the vehicle to be detected;

[0050] Chassis scanning terminal integrated machine: It is set up at the chassis scanning and testing station to perform an overall scan on the bottom of the vehicle chassis to be tested to obtain a clear and complete vehicle chassis photo; by clicking on the chassis re-shoot on the terminal, the chassis re-shoot requires the vehicle to pass through the chassis scanning device again;

[0051] Ring-shooting trigger module: used to trigger five-direction ring-shooting of the vehicle to be inspected that enters the ring-shooting station;

[0052] Five-direction surround shooting unit: used to take five-direction surround shots of vehicles entering the surround shooting station, including the front, rear, left, right and top, to obtain clear and complete appearance photos of the vehicle in five directions; the vehicle passes the speed bump and slowly enters the surround shooting station area, and the license plate recognition successfully triggers the surround inspection mechanism for surround shooting; the surround shooting successfully takes pictures of the five directions and chassis on the touch screen; the license plate can be modified by clicking on the license plate edit on the terminal; the appearance can be retaken by clicking on the appearance retake on the terminal;

[0053] Cloud server: used to store vehicle license plate information, corresponding vehicle chassis photos, and five-direction appearance photos of the vehicle transmitted via the network module; the cloud server is connected to the Alibaba Cloud scratch recognition algorithm through an interface; the ring-shot trigger module and the five-direction ring-shot unit are connected to the cloud server through a switch via the network module;

[0054] Terminal: Call the vehicle chassis photos and five-direction appearance photos of the vehicle stored in the cloud server, as well as the scratch results identified by the Alibaba Cloud scratch recognition algorithm. The scratch results include the number and location of scratches identified in all pictures, and support the zooming in and restoring of all photos; the terminal is connected to the industrial computer controlling the detection area; the industrial computer is connected to a touch screen and amplifying equipment, and the touch screen displays the results of the chassis scan photos of the vehicle being detected and the results of the five-direction surround photos in real time, and reminds the owner to follow the projection command through the loudspeaker. The touch screen and the loudspeaker are located at the detection site; click to search history to view historical vehicle data; click to view surround photos; click to filter by time, you can filter by time, and you can also enter the license plate to search; identify and display scratches through the Alibaba Cloud scratch recognition algorithm; check to display scratches, you can see the picture with scratch marks, if not checked, the original picture will be displayed;

[0055] Click on a part to view images of six parts of the vehicle, which supports full-screen preview; you can also see the number of scratches on each part.

[0056] Among them, the license plate recognition module is a license plate recognition camera, and the five-direction panoramic shooting unit consists of four exterior shooting cameras arranged in front, behind, left and right of the panoramic shooting station and a roof shooting camera arranged on the top of the panoramic shooting station.

[0057] Among them, video recorders are installed at the chassis scanning and inspection station and the ring-shooting station, and the data is synchronously transmitted to the cloud server for terminal call.

[0058] Among them, the cloud server is also connected to the management and control end, which can add and bind terminals and various system modules to the server, and support the addition, deletion, query and modification of terminals and various system modules; if the MAC address can be obtained through the NVR device number, it will be displayed; otherwise, if it cannot be obtained, it will be manually entered.

[0059] Among them, the terminal displays a ring-shot dashboard, which can show the operating environment monitoring before logging into the dashboard, and detect the smoothness of the current network. According to the network ping value, the network smoothness is divided into three levels: good, medium and bad.

[0060] Among them, the chassis scanning terminal is ground-mounted or buried, and can scan and photograph the vehicle chassis.

[0061] Among them, the chassis scanning terminal integrated machine includes a table and a chassis scanning camera; during scanning, the table carries the vehicle to be tested and moves forward and the chassis scanning camera is stationary, or the table carries the vehicle to be tested and remains stationary and the chassis scanning camera moves forward through a linear mechanism.

[0062] Among them, the ground-mounted chassis scanning camera is located on the ground; the buried chassis scanning camera is located in a pit in the middle of the table.

[0063] like Figure 2 As shown, the corresponding hardware components are shown, including general equipment: exterior shooting camera, roof shooting camera, license plate recognition camera, video recorder, switch and server; the exterior shooting camera supports 3D digital noise reduction, digital wide dynamic and fixed focus camera; the roof shooting camera supports 3D digital noise reduction, digital wide dynamic, and has the function of network hemispherical camera; the license plate recognition camera is dedicated to license plate recognition; the video recorder has 8 video inputs and includes a 4T hard disk; the switch is an 8-port 100M POE switch; the server has an i5 CPU, 8G memory, 256 solid-state hard disk, and is equipped with a 23-inch display or a 55-inch TV; chassis scanning is an all-in-one chassis scanning terminal with a chassis imaging camera, which is divided into ground installation and buried type, with a resolution of 10000×2048 and an imaging time of ≤1 second; special equipment, including a speed bump at the front of the vehicle bottom scanning system for vehicle deceleration;

[0064] like Figure 3 As shown, it is a functional module of the terminal, which is named as 306 platform in this specific embodiment, and the specific functional modules are as follows:

[0065] Device binding: Displays the 360-degree panoramic camera devices of a store, i.e., all hardware in the system, in the form of a data list; supports basic functions such as adding, deleting, checking, and modifying devices; if the MAC address can be obtained through the NVR device number, it will be displayed; if it cannot be obtained, it needs to be entered manually.

[0066] Scratch recognition: All 360 panoramic shooting results are connected to the Alibaba Cloud scratch recognition algorithm, and the server is connected to the Alibaba Cloud scratch recognition algorithm through an interface;

[0067] Ring photo list: Displays the license plate number + shooting time as the smallest unit, showing the store to which the data belongs, five-direction exterior photos, chassis scan photos, and the number and location of scratches identified in all photos. Supports CRUD of ring photo results; as well as image zoom-in and restore operations;

[0068] Panoramic Dashboard: Displays the operating environment monitoring before logging into the dashboard; the function detects the smoothness of the current network, and divides the smoothness of the network into three levels: good, medium and poor according to the network ping value; the function detects whether the 360 ​​Panoramic Gadget is installed and opened normally in the current operating environment;

[0069] The initial state (before the surround shooting) displays the operating status (online / offline) and illumination direction of the 360-degree surround shooting device; displays the store information and the company logo to which the store belongs; displays the surround shooting results (during the surround shooting) The time from license plate recognition to vehicle entry to the final 360-degree surround shooting picture result display is less than 4 seconds; The touch screen used in the full-screen mode 360-degree surround shooting can be interactively avoided to refresh the web page, and the token is invalid and needs to be re-logged in. Change the license plate number after the surround shooting When the surround shooting vehicle is incorrectly recognized by the license plate and displayed on the billboard, the user can directly modify the license plate number on the billboard; Re-shoot the appearance of the vehicle that has been photographed from five directions After the user clicks to reshoot, the camera will re-shoot the appearance of the vehicle currently staying at the 360-degree surround shooting station from five directions; Re-shoot the appearance of the vehicle that has not been photographed from five directions is mainly due to the failure of the automatic triggering of the surround shooting function, which causes the system to fail to automatically trigger the 360-degree surround shooting. The reason may be that the license plate is offline or the 360-degree surround shooting gadget is not started: (1) Manually click the five-direction appearance reshoot. (2) After the retake is completed, manually enter the license plate number; (3) A pop-up window will appear to prompt confirmation; the chassis retake prompts the user to completely exit the 360-degree panoramic photography station to retake the photo. The chassis does not support manual reshooting; search by license plate number and time, and retrieve the corresponding ring-shot record for viewing; the information synchronization function supports synchronizing the five-direction device function with the Stargazing platform, which is used to trigger the designated camera under the store to initiate five-direction ring-shot; the SDK receives license plate recognition data and supports receiving license plate data from Hikvision cameras in the local area network; after the five-direction ring-shot trigger and photo return receive the license plate data, it sends a capture command to the designated five-direction ring-shot camera; after the five-direction ring-shot photo return is completed, the five-direction ring-shot camera returns the photo to the SDK; data merging automatically uploads the photo to the folder under the specified directory of the industrial control, and stores it in the folder named with the license plate number; data transmission will be merged and sent back to the Stargazing platform through the external network for data analysis; automatic deletion of redundant files After the data is uploaded to the cloud server, the local file is automatically deleted to avoid the industrial control from being unable to run normally or running slowly due to overload of hard disk capacity; store code entry makes relevant voice prompts to remind users to memorize store equipment information; ring-shot voice prompts make relevant voice prompts to remind users to leave the 360 ​​ring-shot workstation.

[0070] like Figure 4 As shown, it is a function module that comes with the terminal, which is named as 360 gadget function module in this specific embodiment:

[0071] Information synchronization function: supports synchronization with five-direction devices, which is used to trigger designated cameras in stores to initiate five-direction ring shooting;

[0072] Five-direction ring camera trigger and photo return: After receiving the license plate data, send a capture command to the specified five-direction ring camera; after the five-direction ring camera completes the capture, the photo is returned to the SDK

[0073] Other functions: data transmission, data deletion, data merging, code entry

[0074] Voice prompts for surround shooting: voice prompts for vehicle identification and surround shooting completion;

[0075] like Figure 5 As shown in the figure, the structure of the underground chassis scanning terminal is shown; in this structure, the chassis scanning camera is set in the tunnel, and the tunnel is located in the middle of the two sides of the table; when the wheels of the vehicle drive onto the table, there are two situations:

[0076] One is that the table is set to drive the conveyor belt to transport the vehicle forward, and the chassis scanning camera remains stationary to scan and photograph the vehicle from head to tail;

[0077] The other method is to keep the table still, and the chassis scanning camera in the tunnel is installed on a linear stroke, which can be a slider on a linear stroke or a slider on a linear motion screw mechanism, so that the scanning camera scans and takes pictures from the head to the tail relative to the bottom of the static vehicle chassis;

[0078] Of course, the difference between the ground-type structure and the tunnel-type structure is that there is no tunnel, and the other structures are essentially the same.

[0079] like Figure 6-9 As shown, a method for realizing all-round photography and defect detection of a vehicle based on a camera includes the following steps:

[0080] S1: When a vehicle enters a designated detection area, the vehicle information is obtained through the license plate recognition camera and transmitted to the cloud server through the network module;

[0081] S2. When the inspection area is the chassis scanning inspection station, enter the inspection station through the speed bump, and scan the vehicle chassis through the chassis scanning terminal to obtain a clear and complete chassis photo;

[0082] When the detection area is a surround-photographing station, the license plate recognition camera identifies that the vehicle has completely entered the surround-photographing station, triggering the surround-photographing mechanism. The loudspeaker device voice prompts the vehicle to enter the surround-photographing area and asks the vehicle to drive slowly. During the driving process, the four exterior cameras in front, behind, to the left and to the right of the surround-photographing station and the roof camera arranged on the top of the surround-photographing station take surround-photographs of the vehicle in five directions. After the vehicle leaves the surround-photographing area, the loudspeaker device voice prompts that the vehicle has completed the surround-photographing and drives away from the surround-photographing station; thus, clear and complete photos of the vehicle in five directions are obtained;

[0083] S3, processing the acquired vehicle chassis photos and the vehicle five-direction panoramic photos and merging them into a standardized panoramic image;

[0084] S4, transmitting the processed panoramic image to the server through the network module for data analysis and display;

[0085] S5. During the period from when the vehicle enters the inspection station and the surround-photographing station until it leaves the station, the touch screen displays the results of the chassis scanning photo of the vehicle being inspected and the results of the five-direction surround-photographing photo in real time;

[0086] S6. The terminal user or the owner of the detected vehicle calls the vehicle chassis photo data and the five-direction surround photo data through the terminal to preview, save, mark and enlarge the data;

[0087] S7. After the terminal operation is completed, the server saves the operation record and photo data for storage and backup to facilitate later query and management.

[0088] The system also supports other additional functions, such as a 65-ton weighing scale to actually display the weight of a 360-degree panoramic shot.

[0089] The merged standardized panorama is automatically uploaded to a folder under the specified directory, and the folder is named and stored according to the license plate number. The data transmission will be merged and sent back to the terminal through the external network for data analysis; redundant files are automatically deleted. After the data is uploaded to the cloud server, the local files are automatically deleted to avoid the overload of the hard disk capacity causing the industrial control to fail to operate normally or run slowly;

[0090] like Figure 7 As shown, it is a separate chassis scanning flow chart, which mainly includes license plate recognition and chassis scanning through chassis license plate recognition equipment, and uploading the data to the data end storage (cloud server);

[0091] like Figure 8 As shown, it is a separate five-direction surround shooting flow chart, which mainly includes license plate recognition through the five-direction front camera, and the five-direction surround shooting mechanism is activated by the five-direction surround shooting camera to perform surround shooting. In the data storage, it supports appearance reshooting, cloud storage of license plate and surround shooting data, and manual modification of license plate.

[0092] like Fig. 9 As shown, this is the panoramic list displayed on the terminal. The license plate recognition data is displayed through the 360 ​​panoramic background, and the license plate modification action can be performed.

[0093] The present invention can capture 360 ​​degrees without blind spots, solving the problem of blind spots in previous shooting; improves the clarity of the camera and provides the accuracy of scratch recognition; improves the accuracy of the vehicle parking position; improves the stability of recognition and the efficiency of outputting images; solves the problem of the surround head camera having no license plate recognition function; and optimizes the interactive experience: easy to learn and use, accurate and efficient, and with a user-friendly interface.

[0094] The preferred embodiments of the present invention disclosed above are only used to help illustrate the present invention. The preferred embodiments do not describe all the details in detail, nor do they limit the invention to the specific implementation methods described. Obviously, many modifications and changes can be made according to the content of this specification. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present invention, so that those skilled in the art can understand and use the present invention well. The present invention is limited only by the claims and their full scope and equivalents.

Claims

1. Realize the vehicle's all-round photography and defect detection system based on the camera, It is characterized in that include: License plate recognition module: used to recognize the license plate of the vehicle to be detected; Chassis scanning terminal integrated machine: It is set at the chassis scanning and testing station to perform an overall scan on the bottom of the vehicle chassis to be tested and obtain clear and complete vehicle chassis photos; Ring-shooting trigger module: used to trigger five-direction ring-shooting of the vehicle to be inspected that enters the ring-shooting station; Five-direction panoramic photography unit: used to take five-direction panoramic photography of vehicles entering the panoramic photography station. The five directions include the front, rear, left, right and top, to obtain clear and complete appearance photos of the vehicle in five directions; Cloud server: used to store vehicle license plate information, corresponding vehicle chassis photos, and vehicle appearance photos from five directions transmitted via the network module; the cloud server is connected to the Alibaba Cloud scratch recognition algorithm through an interface; The ring-shot trigger module and the five-direction ring-shot unit are connected to the cloud server through a switch via a network module; Terminal: Calls the vehicle chassis photos and five-direction appearance photos stored in the cloud server, as well as the scratch results identified by the Alibaba Cloud scratch recognition algorithm. The scratch results include the number and location of scratches identified in all pictures, and support the zooming in and restoring operations of all photos. The terminal is connected to the industrial computer that controls the inspection area. The industrial computer is connected to a touch screen and a sound amplification device. The touch screen displays the results of the chassis scanning photos of the vehicle being inspected and the results of the five-directional ring photos in real time, and reminds the car owner to operate according to the screen projection commands through the sound amplification device. The touch screen and sound amplification equipment are located at the inspection site.

2. The camera-based vehicle all-round photography and defect detection system according to claim 1, It is characterized in that The license plate recognition module is a license plate recognition camera, and the five-direction surround shooting unit consists of four exterior shooting cameras arranged in front, behind, left and right of the surround shooting station and a roof shooting camera arranged on the top of the surround shooting station.

3. The camera-based vehicle all-round photography and defect detection system according to claim 1, It is characterized in that Video recorders are installed at the chassis scanning and inspection station and the ring-shooting station, and the data is synchronously transmitted to the cloud server for terminal access.

4. The camera-based vehicle all-round photography and defect detection system according to claim 1, It is characterized in that The cloud server is also connected to a management and control terminal, which can add and bind terminals and system modules to the server, and support adding, deleting, checking and modifying terminals and system modules; if the MAC address can be obtained through the NVR device number, it will be displayed; otherwise, if it cannot be obtained, it will be manually entered.

5. The camera-based vehicle all-round photography and defect detection system according to claim 1, It is characterized in that The terminal displays a ring-shot dashboard, which can show the operating environment monitoring before logging into the dashboard, and detect the smoothness of the current network. The network smoothness is divided into three levels: good, medium and bad according to the network ping value.

6. The camera-based vehicle all-round photography and defect detection system according to claim 1, It is characterized in that The chassis scanning terminal integrated machine is ground-mounted or underground-buried and can scan and photograph the vehicle chassis.

7. The camera-based vehicle all-round photography and defect detection system according to claim 6, It is characterized in that The chassis scanning terminal integrated machine includes a table and a chassis scanning camera; during scanning, the table carries the vehicle to be tested and moves forward while the chassis scanning camera is stationary, or the table carries the vehicle to be tested and remains stationary while the chassis scanning camera moves forward through a linear mechanism.

8. The camera-based vehicle all-round photography and defect detection system according to claim 6, It is characterized in that The ground-mounted chassis scanning camera is located on the ground; the underground chassis scanning camera is located in a pit in the middle of the table.

9. A method for realizing all-round photography and defect detection of a vehicle based on a camera, based on a system for realizing all-round photography and defect detection of a vehicle based on a camera as claimed in any one of claims 1 to 8, It is characterized in that The steps include: S1: When a vehicle enters a designated detection area, the vehicle information is obtained through the license plate recognition camera and transmitted to the cloud server through the network module; S2. When the inspection area is the chassis scanning inspection station, enter the inspection station through the speed bump, and scan the vehicle chassis through the chassis scanning terminal to obtain a clear and complete chassis photo; When the detection area is a surround-photographing station, the license plate recognition camera identifies that the vehicle has completely entered the surround-photographing station, triggering the surround-photographing mechanism. The loudspeaker device voice prompts the vehicle to enter the surround-photographing area and asks the vehicle to drive slowly. During the driving process, the four exterior cameras in front, behind, to the left and to the right of the surround-photographing station and the roof camera arranged on the top of the surround-photographing station take surround-photographs of the vehicle in five directions. After the vehicle leaves the surround-photographing area, the loudspeaker device voice prompts that the vehicle has completed the surround-photographing and drives away from the surround-photographing station; thus, clear and complete photos of the vehicle in five directions are obtained; S3, processing the acquired vehicle chassis photos and the vehicle five-direction panoramic photos and merging them into a standardized panoramic image; S4, transmitting the processed panoramic image to the server through the network module for data analysis and display; S5. During the period from when the vehicle enters the inspection station and the surround-photographing station until it leaves the station, the touch screen displays the results of the chassis scanning photo of the vehicle being inspected and the results of the five-direction surround-photographing photo in real time; S6. The terminal user or the owner of the detected vehicle calls the vehicle chassis photo data and the five-direction surround photo data through the terminal to preview, save, mark and enlarge the data; S7. After the terminal operation is completed, the server saves the operation record and photo data for storage and backup to facilitate later query and management.

10. The method for realizing all-round vehicle photography and defect detection based on a camera according to claim 9, Features: The merged standardized panorama is automatically uploaded to a folder under the specified directory, and the folder is named and stored according to the license plate number. The data transmission will be merged and sent back to the terminal through the external network for data analysis; redundant files are automatically deleted. After the data is uploaded to the cloud server, the local files are automatically deleted to avoid the hard disk capacity overload causing the industrial control to fail to operate normally or run slowly.

Images