Intelligent vehicle pre-inspection method and system

Abstract

The present invention provides an intelligent vehicle pick-up pre-inspection method and system. According to a reservation request of a user terminal, vehicle pre-inspection data is generated and sent to a pre-inspection terminal. External monitoring data collected by a fixed-point monitoring device is acquired based on the pre-inspection request of the pre-inspection terminal. Internal monitoring data collected by a portable monitoring device corresponding to the pre-inspection terminal is acquired. Pre-inspection monitoring data is obtained according to the external monitoring data and the internal monitoring data. Compliance judgment is performed on the pre-inspection monitoring data based on a pre-inspection risk identification model. Risk identification data is obtained and sent to a management terminal, wherein the risk identification data includes time judgment data and operation judgment data. A pre-inspection backtracking request of a user terminal is received. Pre-inspection backtracking data is generated according to the pre-inspection monitoring data and sent to the user terminal.

Description

Technical Field

[0001] The present invention relates to data detection technology, and in particular to an intelligent vehicle pick-up pre-inspection method and system. Background Art

[0002] Vehicle pre-inspection is to conduct a comprehensive and systematic inspection of the car to ensure that the performance indicators of the car meet national standards and technical requirements. For example, pre-inspection of key components such as the brake system, steering system, and lighting system can ensure that these components work normally during driving.

[0003] In the prior art, when a vehicle needs pre-inspection, the owner usually parks the vehicle in a vehicle pre-inspection shop and the pre-inspection personnel conduct the pre-inspection. In this way, the owner generally does not see the entire process of the vehicle pre-inspection, which may cause the problem of automobile parts being replaced, or the pre-inspection personnel may falsely report pre-inspection faults.

[0004] Therefore, how to monitor the vehicle pre-inspection process and display the vehicle pre-inspection process to users in accordance with user needs has become an urgent problem to be solved. Summary of the invention

[0005] The present invention provides an intelligent vehicle pre-inspection method and system, which can monitor the vehicle pre-inspection process and display the vehicle pre-inspection process to the user in combination with the user's needs.

[0006] A first aspect of the present invention provides an intelligent vehicle pick-up pre-inspection method, comprising:

[0007] Generate vehicle pre-inspection data according to the reservation request of the user terminal and send it to the pre-inspection terminal, and obtain external monitoring data collected by the fixed-point monitoring device based on the pre-inspection request of the pre-inspection terminal;

[0008] Acquire internal monitoring data collected by a portable monitoring device corresponding to the pre-inspection end, and obtain pre-inspection monitoring data according to the external monitoring data and the internal monitoring data;

[0009] Based on the pre-check risk identification model, the pre-check monitoring data is subjected to compliance judgment, and the obtained risk identification data is sent to the management end, wherein the risk identification data includes time judgment data and operation judgment data;

[0010] A pre-check back-tracing request from the user terminal is received, and pre-check back-tracing data is generated according to the pre-check monitoring data and sent to the user terminal.

[0011] Optionally, in a possible implementation of the first aspect, generating vehicle pre-inspection data according to a reservation request of a user terminal and sending the vehicle pre-inspection data to a pre-inspection terminal, and acquiring external monitoring data collected by a fixed-point monitoring device based on the pre-inspection request of the pre-inspection terminal include:

[0012] Determine the pre-inspection vehicle and pre-inspection component according to the reservation request, and obtain the pre-inspection queue corresponding to the pre-inspection component;

[0013] Obtain the current pre-inspection vehicle and the waiting pre-inspection vehicle corresponding to the pre-inspection queue, determine the estimated waiting time corresponding to the pre-inspection vehicle according to the sum of the current pre-inspection time corresponding to the current pre-inspection vehicle and the waiting pre-inspection time of the waiting pre-inspection vehicle, and send it to the user end;

[0014] According to the information determined by the user terminal about the estimated waiting time, the pre-inspection vehicle and pre-inspection component are obtained to generate vehicle pre-inspection data and send it to the pre-inspection terminal;

[0015] Receiving a pre-inspection request from the pre-inspection terminal, acquiring monitoring video data collected by the fixed-point monitoring device on the pre-inspection area, and obtaining external monitoring data according to the monitoring video data;

[0016] Acquiring internal monitoring data collected by the portable monitoring device corresponding to the pre-inspection end, including:

[0017] In response to the pre-check request, real-time video data collected by the portable monitoring device is acquired, and internal monitoring data is obtained according to the real-time video data.

[0018] Optionally, in a possible implementation of the first aspect, compliance judgment is performed on the pre-check monitoring data based on the pre-check risk identification model to obtain risk identification data and send it to the management end, wherein the risk identification data includes time judgment data and operation judgment data, including:

[0019] Acquiring the operation path corresponding to the external monitoring data based on the pre-inspection risk identification model, and performing external compliance judgment on the pre-inspection end according to the operation path to obtain part judgment data;

[0020] Acquire part data and pre-inspection time data corresponding to the internal monitoring data according to the pre-inspection risk identification model;

[0021] Performing internal compliance judgment on the pre-inspection end based on the part data to obtain part judgment data, and obtaining operation judgment data based on the position judgment data and the part judgment data;

[0022] Obtain historical time data corresponding to the pre-check component, perform time compliance judgment on the pre-check time data according to the historical time data to obtain time judgment data, obtain risk identification data according to the time judgment data and operation judgment data and send it to the management end.

[0023] Optionally, in a possible implementation manner of the first aspect, acquiring an operation path corresponding to the external monitoring data based on the pre-inspection risk identification model, and performing external compliance judgment on the pre-inspection end according to the operation path to obtain the part judgment data includes:

[0024] Determine the reserved license plate corresponding to the pre-inspected vehicle, identify the license plates of multiple vehicles in the external monitoring data, and determine the vehicle corresponding to the reserved license plate as the target vehicle;

[0025] Retrieving a part segmentation template, wherein the part segmentation template includes a plurality of area frames, each of the area frames corresponds to a corresponding segmentation area;

[0026] superimposing the part segmentation template on the external monitoring data, and determining a plurality of pre-inspection areas in the external monitoring data according to the area frame;

[0027] Determine a pre-inspection area corresponding to the target vehicle as a target area, and obtain a part area corresponding to each of the segmented areas in the target area, wherein the part area at least includes a front area, a rear area, and a body area;

[0028] Acquire a person profile in the external monitoring data, and determine the person profile corresponding to the identity information of the pre-inspection terminal as a target profile;

[0029] Acquire a motion path corresponding to the target contour, and determine a current pre-inspection area corresponding to the target contour according to the motion path;

[0030] Determine the part area corresponding to the pre-inspection component as the target pre-inspection area, obtain the pre-inspection end where the current pre-inspection area and the target pre-inspection area are consistent as a normal end, and the pre-inspection end where the current pre-inspection area and the target pre-inspection area are inconsistent as an abnormal end;

[0031] A part abnormality label corresponding to the abnormal end is generated, and part judgment data is obtained according to the normal end or the abnormal end.

[0032] Optionally, in a possible implementation manner of the first aspect, acquiring a motion path corresponding to the target contour, and determining a current pre-inspection area corresponding to the target contour according to the motion path includes:

[0033] Acquire the center point of the target contour as a positioning point, and generate a motion path corresponding to the target contour according to the positioning points corresponding to multiple moments;

[0034] Determine a phase difference distance between two adjacent positioning points at the same time, and when the phase difference distance is less than a reference phase difference distance, determine the corresponding positioning point as a pre-check point;

[0035] Determine the pre-check duration of the target contour according to the time corresponding to the consecutive adjacent pre-check points, and when the pre-check duration is greater than the pre-check duration threshold, obtain the positioning point corresponding to the target contour at the current time as the judgment point;

[0036] The region center point of each of the part regions is obtained, the interval distance between the region center point and the judgment point is determined, and the part region with the smallest interval distance is obtained as the current pre-inspection region corresponding to the target contour.

[0037] Optionally, in a possible implementation manner of the first aspect, performing internal compliance judgment on the pre-inspection end based on the part data to obtain part judgment data includes:

[0038] Obtaining an associated parts list corresponding to the pre-inspection component, wherein the associated parts list includes a plurality of associated parts corresponding to the pre-inspection component;

[0039] Parsing the part data to obtain a plurality of part contours in the internal monitoring data, and comparing the part contours with standard contours corresponding to the associated parts to obtain contour similarity values;

[0040] Determine the part contour whose contour similarity value is greater than the similarity threshold as the pre-inspection contour corresponding to the associated part;

[0041] Acquire the pre-inspection end without the pre-inspection profile as an abnormal end, and the pre-inspection end with the pre-inspection profile as a pending end;

[0042] Extracting a hand contour from the internal monitoring data, and obtaining a part contour intersecting with the hand contour as a determination contour;

[0043] An internal compliance judgment is performed on the pending end according to the judgment profile to obtain a normal end or an abnormal end, an abnormal part label corresponding to the abnormal end is generated, and part judgment data is obtained according to the normal end or the abnormal end.

[0044] Optionally, in a possible implementation manner of the first aspect, performing internal compliance judgment on the to-be-determined end according to the determination profile to obtain a normal end or an abnormal end includes:

[0045] Obtaining the intersection duration between the hand contour and the determination contour, and when the intersection duration is greater than the reference intersection duration and the determination contour is the pre-check contour, determining that the pending end is a normal end;

[0046] When the intersection duration is greater than the reference intersection duration and the determined contour is not the pre-checked contour, taking the center point of the determined contour as a reference and determining a determination range corresponding to the determined contour according to a preset radius;

[0047] The determined contour that contains the pre-checked contour within the determined range is obtained as a normal contour, and the determined contour that does not contain the pre-checked contour within the determined range is obtained as an abnormal contour;

[0048] The undetermined end corresponding to the normal contour is determined as a normal end, and the undetermined end corresponding to the abnormal contour is determined as an abnormal end.

[0049] Optionally, in a possible implementation manner of the first aspect, acquiring historical time data corresponding to the pre-check component, and performing time compliance judgment on the pre-check time data according to the historical time data to obtain time judgment data includes:

[0050] Parsing the pre-check time data to obtain the start time and the end time of the internal monitoring data, and obtaining the current pre-check duration according to the start time and the end time;

[0051] According to the historical time data, a plurality of historical pre-check durations corresponding to the pre-check component are obtained, and a mean value of each of the historical pre-check durations is calculated to obtain a reference pre-check duration;

[0052] A minimum duration extreme value is obtained based on the product of the reference pre-check duration and the minimum offset coefficient, and a maximum duration extreme value is obtained based on the product of the reference pre-check duration and the maximum offset coefficient;

[0053] A duration determination interval is obtained based on the minimum duration extreme value and the maximum duration extreme value, and a current pre-check duration within the duration determination interval is determined as a normal pre-check duration, and a current pre-check duration not within the duration determination interval is determined as an abnormal pre-check duration;

[0054] Determine that the pre-inspection end corresponding to the normal pre-inspection duration is a normal end, and the pre-inspection end corresponding to the abnormal pre-inspection duration is an abnormal end, generate a duration abnormality label corresponding to the abnormal end, and obtain duration judgment data according to the normal end or the abnormal end.

[0055] Optionally, in a possible implementation manner of the first aspect, receiving a pre-check back-tracing request from the user terminal, and generating pre-check back-tracing data according to the pre-check monitoring data and sending the data to the user terminal includes:

[0056] Determining a backtracking requirement of the user terminal based on the pre-check backtracking request, wherein the backtracking requirement includes an external amplification requirement and an internal amplification requirement;

[0057] Retrieving a backtracking template, the backtracking template comprising a core display area and an auxiliary display area, filling the external monitoring data into the core display area according to the external amplification requirement, and filling the internal monitoring data into the auxiliary display area to obtain a type of backtracking data and sending it to the user end;

[0058] According to the internal amplification requirement, the internal monitoring data is filled into the core display area, and the external monitoring data is filled into the auxiliary display area, so as to obtain two types of traceability data and send them to the user end.

[0059] A second aspect of the present invention provides an intelligent vehicle pick-up pre-inspection system, comprising:

[0060] A generation module, used to generate vehicle pre-inspection data according to a reservation request from a user terminal and send it to a pre-inspection terminal, and obtain external monitoring data collected by a fixed-point monitoring device based on the pre-inspection request from the pre-inspection terminal;

[0061] An acquisition module, used to acquire the internal monitoring data collected by the portable monitoring device corresponding to the pre-inspection end, and obtain the pre-inspection monitoring data according to the external monitoring data and the internal monitoring data;

[0062] A judgment module, used to perform compliance judgment on the pre-check monitoring data based on the pre-check risk identification model, and obtain risk identification data and send it to the management end, wherein the risk identification data includes time judgment data and operation judgment data;

[0063] The receiving module is used to receive the pre-check traceback request of the user terminal, generate pre-check traceback data according to the pre-check monitoring data, and send it to the user terminal.

[0064] The beneficial effects of the present invention are as follows:

[0065] 1. The present invention monitors the pre-inspection process of the pre-inspection personnel by monitoring video data. Subsequently, the corresponding video data can be retrieved in combination with user needs for retrospective viewing, so that when problems occur in the pre-inspection, the corresponding solution can be quickly found by retrospective video. When monitoring the pre-inspection process, this solution adopts an external fixed-point monitoring device and an internal portable monitoring device to monitor simultaneously. When performing external monitoring, it determines whether there are any operational abnormalities in the external pre-inspection operation of the pre-inspection personnel based on the pre-inspection operation path of the pre-inspection personnel. When performing internal monitoring, it determines whether there are any abnormalities in the internal pre-inspection operation of the pre-inspection personnel based on the operation data and pre-inspection time data of the parts that need to be pre-inspected, thereby improving the standardization of the pre-inspection personnel in the pre-inspection process.

[0066] 2. When monitoring the external pre-inspection operation process of the pre-inspection personnel, the present invention first determines the action path of the pre-inspection personnel, and the action route of the pre-inspection personnel can be obtained through the action path. Then, the amplitude of the current movement of the pre-inspection personnel is determined according to the reference phase difference distance, and the area where the pre-inspection personnel is pre-inspecting is determined. Then, according to the pre-inspection time of the pre-inspection personnel, the current positioning point of the pre-inspection personnel and the regional center point of the pre-inspection area are obtained. Finally, the specific area where the pre-inspection personnel is currently pre-inspecting is determined through the interval distance between the regional center point and the judgment point, which enables the management personnel to more accurately judge whether the pre-inspection area of ​​the pre-inspection personnel is correct. When the present invention performs time compliance judgment on the pre-inspection time data of the pre-inspection component, the historical pre-inspection time of the pre-inspection component is firstly averaged to obtain a benchmark pre-inspection time, and the maximum time extreme value or the minimum time extreme value is obtained according to the product of the benchmark pre-inspection time and the maximum or minimum offset coefficient, and the rationality of the pre-inspection time used by the pre-inspection personnel is judged based on the time judgment interval, so as to improve the accuracy of the judgment on the pre-inspection time data of the pre-inspection personnel when performing time compliance judgment on the pre-inspection time data.

[0067] 3. When processing the pre-inspection retrospective video data, the present invention will first integrate the external monitoring video data and the internal monitoring video data. During the integration, this solution will zoom in and display one of the video data and reduce and display the other video data based on user needs, so that the user can review the video of the pre-inspection process based on his or her own viewing needs. The user can review the complete and detailed vehicle pre-inspection process, thereby improving the standardization of the pre-inspection process. BRIEF DESCRIPTION OF THE DRAWINGS

[0068] Figure 1 It is a flowchart of an intelligent vehicle pick-up pre-inspection method provided by an embodiment of the present invention;

[0069] Figure 2 is a schematic diagram of a part segmentation template provided by an embodiment of the present invention;

[0070] Figure 3 is a schematic diagram of backtracking data provided by an embodiment of the present invention;

[0071] Figure 4 It is a structural schematic diagram of an intelligent vehicle reception pre-inspection system provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0072] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0073] See also Figure 1 , is a flow chart of an intelligent vehicle pick-up pre-inspection method provided by an embodiment of the present invention, Figure 1 The execution subject of the method shown may be a software and / or hardware device. The execution subject of the present application may include but is not limited to at least one of the following: user equipment, network equipment, etc. Among them, user equipment may include but is not limited to computers, smart phones, personal digital assistants (PDA) and the electronic devices mentioned above. Network equipment may include but is not limited to a single network server, a server group consisting of multiple network servers, or a cloud based on cloud computing consisting of a large number of computers or network servers, wherein cloud computing is a type of distributed computing, a super virtual computer composed of a group of loosely coupled computers. This embodiment does not limit this. It includes steps S1 to S4, as follows:

[0074] S1, according to the reservation request of the user terminal, generate vehicle pre-inspection data and send it to the pre-inspection terminal, and obtain external monitoring data collected by the fixed-point monitoring equipment based on the pre-inspection request of the pre-inspection terminal.

[0075] It is understandable that in actual applications, when a user's vehicle needs to be pre-inspected, the user can log in to the vehicle pre-inspection shop's appointment software through the user terminal, and make a pre-inspection appointment for the vehicle through the software. The pre-inspection user can enter his or her own vehicle information when making an appointment, such as the license plate number, vehicle model, parts that need to be pre-inspected, etc. Through this information, the vehicle pre-inspection shop can subsequently configure corresponding pre-inspection personnel to conduct pre-inspection of the vehicle.

[0076] It can also be understood that in order to facilitate the user to review the data during the vehicle pre-inspection later, this solution will control the corresponding monitoring equipment to capture video of the pre-inspection process of the pre-inspection personnel, so that the user can subsequently review the vehicle pre-inspection process through the collected video data.

[0077] The user terminal can be a terminal held by the user, such as a mobile phone, computer, etc. The pre-inspection terminal can be a terminal held by the pre-inspection personnel, such as a mobile phone. Fixed-point monitoring equipment refers to equipment that can monitor the entire process of vehicle pre-inspection, such as surveillance cameras in vehicle pre-inspection shops, and external monitoring data refers to video data collected by fixed-point monitoring equipment.

[0078] Through the above implementation, the user can make an appointment for vehicle pre-inspection at home, thereby improving the efficiency of the user's vehicle pre-inspection.

[0079] Based on the above embodiment, the specific implementation of step S1 may be:

[0080] S11, determining a pre-inspection vehicle and a pre-inspection component according to the reservation request, and acquiring a pre-inspection queue corresponding to the pre-inspection component.

[0081] It is understandable that the pre-inspection personnel of the vehicle pre-inspection shop have their own vehicle parts that they are responsible for pre-inspecting, and the pre-inspection areas of different pre-inspection parts may also be different. Since different users may need to pre-inspect different vehicles and pre-inspection parts, after the user's appointment request is approved, the user will be assigned a corresponding pre-inspection queue, and then the corresponding pre-inspection personnel will be configured for the user's vehicle in the future through the pre-inspection queue. For example, a scratched vehicle can be added to the pre-inspection queue corresponding to the scratch, and then the pre-inspection personnel responsible for the scratch will perform the pre-inspection. A vehicle with an engine failure can be added to the pre-inspection queue corresponding to the engine failure, and the personnel responsible for pre-inspecting the engine will perform the pre-inspection.

[0082] Among them, the pre-inspection queue refers to a queue in which vehicles with the same problem type are arranged in the order of appointment.

[0083] S12, obtaining the current pre-inspection vehicle and the waiting pre-inspection vehicle corresponding to the pre-inspection queue, and determining the estimated waiting time corresponding to the pre-inspection vehicle according to the sum of the current pre-inspection time corresponding to the current pre-inspection vehicle and the waiting pre-inspection time of the waiting pre-inspection vehicle, and sending it to the user end.

[0084] Specifically, the preinspection queue corresponding to the preinspection vehicle may have vehicles undergoing preinspection or vehicles waiting for preinspection. Therefore, after receiving the user's preinspection application, the server can determine the time required for the vehicles currently undergoing preinspection in the preinspection queue, as well as the preinspection time required for the vehicles waiting for preinspection, and add the two together to obtain the estimated waiting time for the corresponding preinspection vehicle. The server will send the estimated waiting time to the user for confirmation.

[0085] S13, according to the information determined by the user terminal about the estimated waiting time, the pre-inspection vehicle and pre-inspection components are obtained to generate vehicle pre-inspection data and send it to the pre-inspection terminal.

[0086] It is understandable that, after the user chooses to accept the estimated waiting time, vehicle pre-inspection data can be generated according to the vehicle information and vehicle component information that the user needs to pre-inspect and sent to the corresponding pre-inspection end for subsequent pre-inspection operations.

[0087] The vehicle pre-inspection data refers to the vehicle components that need to be pre-inspected and the information of the vehicle that needs to be pre-inspected, such as the model of the vehicle, the license plate number, etc.

[0088] S14, receiving a pre-inspection request from the pre-inspection terminal, acquiring monitoring video data collected by the fixed-point monitoring device on the pre-inspection area, and obtaining external monitoring data according to the monitoring video data.

[0089] After the server confirms the user's pre-inspection request, before the pre-inspection process begins, the pre-inspection personnel will send a message to the server to start the pre-inspection. The time when the message is sent can be used to determine the start time of the fixed-point monitoring equipment's monitoring data on the pre-inspected vehicle, and the monitoring video data can be recorded to obtain external monitoring data.

[0090] Through the above implementation, the user can subsequently review the external monitoring data of the vehicle pre-inspection process.

[0091] S2, obtaining internal monitoring data collected by the portable monitoring device corresponding to the pre-inspection end, and obtaining pre-inspection monitoring data according to the external monitoring data and the internal monitoring data.

[0092] In actual applications, each pre-inspection personnel will have a wearable monitoring device during the pre-inspection process, which can record the specific pre-inspection process of the vehicle and obtain internal monitoring data.

[0093] Among them, the pre-inspection monitoring data is the video recording data of the pre-inspection process. The pre-inspection monitoring data includes external monitoring data and internal monitoring data. The internal monitoring data refers to the video data recorded by the portable monitoring device with recording properties worn by the pre-inspection personnel.

[0094] In some embodiments, the internal monitoring data may be obtained by the following steps:

[0095] S21, responding to the pre-check request, acquiring real-time video data collected by the portable monitoring device, and obtaining internal monitoring data according to the real-time video data.

[0096] Specifically, while the pre-inspection personnel are conducting the pre-inspection, the monitoring equipment they carry with them records the data, and when the pre-inspection is completed, the internal monitoring data is generated synchronously.

[0097] Through the above implementation, the user can review the monitoring data of the internal details during the vehicle pre-inspection process.

[0098] S3, performing compliance judgment on the pre-check monitoring data based on the pre-check risk identification model, obtaining risk identification data and sending it to the management end, wherein the risk identification data includes time judgment data and operation judgment data.

[0099] It is understandable that the management personnel can make abnormal risk judgments on the entire pre-inspection process based on the pre-inspection operation path and time of the pre-inspection personnel, and judge whether there are operational errors or risks of illegal operations in the pre-inspection process of the pre-inspection personnel.

[0100] The pre-inspection risk identification model is a model for risk judgment during the pre-inspection process of the vehicle. Compliance judgment refers to the judgment of whether the pre-inspection personnel have made abnormal operations during the vehicle pre-inspection process. The pre-inspection risk identification model is used to make compliance judgments on the pre-inspection process to obtain risk identification data.

[0101] Among them, time judgment data refers to the data obtained after judging the duration of the pre-inspection process of the pre-inspection personnel, operation judgment data refers to the data obtained after judging the operation of the pre-inspection process of the pre-inspection personnel, and risk identification data includes time judgment data and operation judgment data.

[0102] Based on the above embodiment, the specific implementation of step S3 may be:

[0103] S31, acquiring the operation path corresponding to the external monitoring data based on the pre-inspection risk identification model, and performing external compliance judgment on the pre-inspection end according to the operation path to obtain part judgment data.

[0104] It is understandable that the external monitoring data can show the action route of the pre-inspection personnel during the pre-inspection process, that is, the above-mentioned operation path. The server will make a judgment on the operation path of the pre-inspection personnel. The operation path can be used to determine the specific area where the pre-inspection personnel conducts pre-inspection. For example, if the user makes an appointment for pre-inspection of the front part of the vehicle, when the pre-inspection personnel stays at the rear part of the vehicle for a long time, there may be an abnormality.

[0105] Based on the above embodiment, the specific implementation of step S31 may be:

[0106] S311, determining the reserved license plate corresponding to the pre-inspected vehicle, identifying the license plates of multiple vehicles in the external monitoring data, and determining the vehicle corresponding to the reserved license plate as the target vehicle.

[0107] It is understandable that there may be multiple vehicles scheduled for pre-inspection in the vehicle pre-inspection shop, that is, there may be multiple vehicles parked in the pre-inspection area. At this time, it is necessary to confirm the information of the current pre-inspected vehicle. When the user applies for an appointment, the detailed information of the vehicle including the license plate number has been sent to the server. When the pre-inspection starts, the license plate number can be identified and confirmed, so that the pre-inspection process of the corresponding vehicle can be monitored.

[0108] Among them, the target vehicle refers to the vehicle that the pre-inspection personnel conducts pre-inspection. In actual applications, in order to enable the fixed-point monitoring equipment to clearly record the pre-inspection process of the vehicle, the fixed-point monitoring equipment in the vehicle pre-inspection shop can be an overhead camera, so that multiple vehicles in the pre-inspection area can be clearly photographed, and the pre-inspection process of the pre-inspected vehicles in the pre-inspection area can be fully recorded.

[0109] Specifically, when recognizing the license plate number, the license plate outline can be extracted first, and then the license plate number corresponding to the license plate outline can be extracted, and the reserved license plate number can be compared with the extracted multiple license plate numbers to determine that the vehicle corresponding to the license plate that is the same as the reserved license plate is the target vehicle.

[0110] S312, retrieve a part segmentation template, wherein the part segmentation template includes a plurality of area frames, each of the area frames corresponds to a corresponding segmentation area.

[0111] In actual applications, multiple vehicles will be parked in the pre-inspection area, and the pre-inspected vehicles will be parked in the white rectangular marking frame. During the pre-inspection, the pre-inspection personnel need to go to the area corresponding to the white rectangular marking frame to conduct corresponding inspections on the vehicles. Therefore, the movement route of the pre-inspection personnel in the white rectangular marking frame can be used to determine the part of the vehicle currently being pre-inspected, thereby determining whether the part of the vehicle currently being pre-inspected by the pre-inspection personnel is abnormal.

[0112] See also Figure 2 , is a schematic diagram of a part segmentation template provided by an embodiment of the present invention. It is understandable that when the shooting posture of the monitoring device remains unchanged, the position of the white rectangular marked frame in the shooting interface will not change. Therefore, when constructing the part segmentation template, the area frame corresponding to each white rectangular marked frame can be configured, and the parking position of the vehicle can be quickly locked through the area frame. After the area frame corresponding to the specific pre-inspected vehicle is determined later, the data in the area frame can be pre-inspected and monitored, thereby improving the standardization of the pre-inspection process.

[0113] It is understandable that if Figure 2As shown, when the direction of the vehicle parking is certain, the various parts of the outside of the vehicle, such as the front, body and rear parts, can be seen through the monitoring screen. During the pre-inspection, if the pre-inspection personnel need to go to the outside of the vehicle for corresponding inspection, they may go to the corresponding parts of the outside of the vehicle for inspection. For example, when the pre-inspection personnel need to check the engine, they may go to the area corresponding to the front of the vehicle for corresponding inspection. Therefore, in order to determine the specific area for inspection by the pre-inspection personnel, this solution will also divide the vehicle into multiple parts through the part segmentation template to determine the corresponding front area, body area and rear area, so as to judge whether the part area during the external inspection by the pre-inspection personnel is abnormal in the subsequent inspection.

[0114] Among them, the segmentation area is an area used to divide the exterior of the vehicle into parts, such as Figure 2 In some embodiments, due to the different models of vehicles, the proportions of the front, body and rear of different models may also be different, so the proportions between the segmented areas can be set accordingly according to the vehicle model, so that after determining the model of the pre-inspected vehicle, the part segmentation template corresponding to its model can be retrieved to determine the pre-inspection position and divide the vehicle exterior.

[0115] S313, superimposing the part segmentation template on the external monitoring data, and determining a plurality of pre-inspection areas in the external monitoring data according to the area frame.

[0116] The pre-inspection area refers to an area where multiple pre-inspection vehicles are parked, such as Figure 2 The area corresponding to the area box A, area box B, and area box C described in .

[0117] S314, determining the pre-inspection area corresponding to the target vehicle as the target area, obtaining the part areas corresponding to each of the segmented areas in the target area, the part areas at least including the front area, the rear area and the body area.

[0118] It is understandable that in order to monitor the pre-inspection process of the pre-inspection personnel, it is necessary to determine the specific parking area of ​​the pre-inspected vehicle, and then monitor the pre-inspection process of the pre-inspection personnel in the area. Therefore, the pre-inspection area where the target vehicle is located can be determined as the target area, and the area can be monitored later. After the part segmentation template is superimposed on the external monitoring data, the target area can be segmented by the segmentation area, thereby obtaining the front area, rear area and body area corresponding to the target vehicle.

[0119] The target vehicle refers to the vehicle that the pre-inspection personnel need to pre-inspect, and the target area refers to the pre-inspection area where the target vehicle is located. For example, when the target vehicle is parked Figure 2When the area corresponding to the area box B in the image is the target area, the area corresponding to the area box B is the target area.

[0120] S315, obtaining a person profile in the external monitoring data, and determining the person profile corresponding to the identity information of the pre-inspection end as a target profile.

[0121] It is understandable that there may be multiple persons in the pre-inspection area, and multiple person outlines may be extracted from the video data. Therefore, it is necessary to determine the person outline of the pre-inspected person corresponding to the target vehicle and then track and monitor the person outline.

[0122] In actual applications, each pre-inspection personnel can enter their own identity information in advance, and the external monitoring equipment can determine the target outline that needs to be tracked and monitored by comparing the facial information of the pre-inspection personnel.

[0123] The target profile refers to the profile of the pre-screening personnel that the server needs to monitor.

[0124] S316, acquiring a motion path corresponding to the target contour, and determining a current pre-inspection area corresponding to the target contour according to the motion path.

[0125] It is understandable that when conducting pre-inspection, the pre-inspection personnel will go to the area they need to pre-inspect, and the action path can be used to obtain the action route of the pre-inspection personnel, so as to determine the specific area where the pre-inspection personnel are conducting pre-inspection. For example, when the pre-inspection personnel need to pre-inspect the parts in the external front area of ​​the vehicle, their action route may be concentrated in the area corresponding to the front of the vehicle.

[0126] The action path refers to the action route of the pre-inspection personnel during the pre-inspection process, and the current pre-inspection area refers to the specific area that the pre-inspection personnel is currently pre-inspecting.

[0127] Based on the above embodiment, the specific implementation of step S316 may be:

[0128] S3161, obtaining the center point of the target contour as a positioning point, and generating a motion path corresponding to the target contour according to the positioning points corresponding to multiple moments.

[0129] It can be understood that the movement of the target contour can determine the action route of the pre-inspection personnel, so the action path of the pre-inspection personnel can be obtained through the positioning points corresponding to multiple target contours. Since the target contour has multiple contour points, the center point can be selected as the positioning point to determine the position of the target contour. Since the pre-inspection personnel may be moving at any time, the action path corresponding to the target contour can be determined according to the positioning points at different times.

[0130] The positioning point refers to the point used to determine the current position of the pre-inspection personnel.

[0131] S3162, determining a phase difference distance between two adjacent positioning points at different times, and when the phase difference distance is smaller than a reference phase difference distance, determining the corresponding positioning point as a pre-check point.

[0132] It is understandable that the pre-inspection personnel may be moving at any time. For example, when the pre-inspection personnel needs to pre-inspect the front area of ​​the vehicle, they may pass through the body area, which will cause the pre-inspection personnel's movement path to include the body area. Therefore, when determining the current pre-inspection area of ​​the pre-inspection personnel, this solution will determine whether the distance between two adjacent points is too close. If it is too close, the pre-inspection personnel may be moving slightly in the corresponding area, and they may be conducting a pre-inspection in the corresponding area. Therefore, the corresponding positioning point can be used as a pre-inspection point, and the pre-inspection point will be used to determine the specific area where the pre-inspection personnel is currently located in the subsequent determination.

[0133] Among them, the pre-inspection point refers to the location point where the pre-inspection personnel is located, and the reference phase difference distance refers to the preset threshold value used to determine the movement amplitude of the pre-inspection personnel during the pre-inspection process. The threshold value can be used to determine the current movement amplitude of the pre-inspection personnel. If it exceeds the threshold value, it can be determined that the current movement amplitude of the pre-inspection personnel may be large, and the pre-inspection personnel may be walking, such as passing through a certain area. If it is less than the threshold value, it can be determined that the current movement amplitude of the pre-inspection personnel is small, and the pre-inspection personnel may be moving back and forth with a small amplitude near a certain position, such as performing a pre-inspection of a certain part.

[0134] S3163, determining the pre-check duration of the target contour according to the time points corresponding to the consecutive adjacent pre-check points, and when the pre-check duration is greater than the pre-check duration threshold, obtaining the positioning point corresponding to the target contour at the current time point as a judgment point.

[0135] It is understandable that when the pre-inspection personnel conduct pre-inspection on a certain part of the car, they will stay in the area where the part is located. If the pre-inspection personnel stays in a certain area for a very short time, then the pre-inspection personnel may just pass by this area. Therefore, the time corresponding to multiple consecutive adjacent pre-inspection points can be obtained, and the length of time the pre-inspection personnel stays can be determined by the start and end times of these moments.

[0136] When the pre-inspection time of the pre-inspection personnel is greater than the pre-inspection time threshold, it can be considered that the pre-inspection personnel has stayed in a certain area for a long time. Therefore, it can be determined that the pre-inspection personnel may perform pre-inspection operations here. At this time, the positioning point where the pre-inspection personnel is currently located can be used as the judgment point, and the specific area where the pre-inspection personnel is located can be determined through the judgment point.

[0137] The pre-inspection duration refers to the duration that the pre-inspection personnel perform continuous small movements, which is used to determine the duration that the pre-inspection personnel stay in the area. The pre-inspection duration threshold refers to the threshold for determining the duration that the pre-inspection personnel stay, for example, it can be 5 minutes. When the pre-inspection personnel stays in the area for more than 5 minutes, it can be determined that the pre-inspection personnel performs pre-inspection in the area. The judgment point refers to the point used to determine the area where the pre-inspection personnel is located.

[0138] S3164, obtaining the area center point of each of the part areas, determining the interval distance between the area center point and the judgment point, and obtaining the part area with the smallest interval distance as the current pre-inspection area corresponding to the target contour.

[0139] It is understandable that each area of ​​a car has a center point. When the pre-inspection personnel is performing pre-inspection operations, the interval between the positioning point of the pre-inspection personnel's current position and the center point of the car's area may be relatively close. By comparing the interval distance between the positioning point and the center point of each area, it can be determined that the area with the smallest interval distance from the positioning point of the pre-inspection personnel's position is the area that the pre-inspection personnel is currently pre-inspecting.

[0140] The area center point refers to the center point of the part area, and the interval distance refers to the distance between the area center point and the positioning point of the pre-inspection personnel's current position. The smaller the interval distance, the closer the pre-inspection personnel is to the pre-inspection area. See Figure 2 , the distance between the pre-inspection personnel and the center point of the vehicle body area is the smallest at this moment, so it can be determined that the pre-inspection personnel is currently located in the vehicle body area.

[0141] Through the above implementation, the external pre-inspection process of the pre-inspection personnel can be monitored.

[0142] S317, determining the part area corresponding to the pre-inspection component as a target pre-inspection area, obtaining a pre-inspection end where the current pre-inspection area is consistent with the target pre-inspection area as a normal end, and a pre-inspection end where the current pre-inspection area is inconsistent with the target pre-inspection area as an abnormal end.

[0143] It is understandable that after the user makes an appointment application, the server will allocate the corresponding pre-inspection area for the vehicle that needs pre-inspection according to the vehicle parts that the user applies for pre-inspection. When the area where the automobile parts that the pre-inspection personnel are currently pre-inspecting are located is consistent with the target pre-inspection area allocated by the server, it can be judged that the pre-inspection personnel at the pre-inspection end are performing normal pre-inspection operations and are normal ends. When the area where the automobile parts that the pre-inspection personnel are currently pre-inspecting are located is inconsistent with the target pre-inspection area allocated by the management end, it can be judged that the pre-inspection personnel at the pre-inspection end are performing abnormal pre-inspection operations and are abnormal ends.

[0144] The target pre-inspection area refers to the area corresponding to the vehicle components that need to be pre-inspected, and the current pre-inspection area refers to the area where the pre-inspection personnel are currently located.

[0145] S318, generating a location abnormality label corresponding to the abnormal end, and obtaining location judgment data according to the normal end or the abnormal end.

[0146] It is understandable that when the pre-inspection personnel perform abnormal operations on a certain part of the car, a part abnormality label is generated, which can let the management personnel know what type of abnormality occurred in the pre-inspection process and carry out targeted solutions later. The part judgment data is the abnormal judgment data when the pre-inspection personnel operate on the external parts of the vehicle.

[0147] S32, acquiring part data and pre-inspection time data corresponding to the internal monitoring data according to the pre-inspection risk identification model.

[0148] In actual applications, the pre-inspection personnel can wear the monitoring equipment on their heads, so that the internal monitoring data can collect the video data in front of the pre-inspection personnel. Therefore, when the pre-inspection personnel are inspecting parts, they can collect the parts data, and the pre-inspection time of the pre-inspection personnel can also be obtained through the start recording time and the end recording time of the internal monitoring data. Through the parts data, it can be determined in the future whether the pre-inspection personnel complies with the specifications when inspecting parts, and through the pre-inspection time data, it can be determined in the future whether the pre-inspection time of the pre-inspection personnel is abnormal.

[0149] The part data includes the name of the part and the specific outline of the part, and the pre-inspection time data refers to the time required for the pre-inspection personnel to complete the part pre-inspection operation.

[0150] S33, performing internal compliance judgment on the pre-inspection end based on the part data to obtain part judgment data, and obtaining operation judgment data according to the position judgment data and the part judgment data.

[0151] It is understandable that this solution will determine whether the pre-inspection personnel have performed pre-inspection operations in compliance with regulations on the automobile parts that need to be pre-inspected based on the parts data extracted from the internal monitoring data.

[0152] Among them, when making internal compliance judgments, this solution will combine the specific parts that the pre-inspection personnel touch and the length of time they touch to make compliance judgments on the parts. Operation judgment data is used to judge whether the pre-inspection operation of the pre-inspection personnel complies with regulations, including location judgment data and part judgment data.

[0153] Based on the above embodiment, the specific implementation of step S33 may be:

[0154] S331, obtaining an associated parts list corresponding to the pre-inspection component, wherein the associated parts list includes a plurality of associated parts corresponding to the pre-inspection component.

[0155] It is understandable that the auto parts that need to be pre-inspected for each component of the car are different. Therefore, an associated parts table can be set to determine the specific parts corresponding to different components. For example, when the parts of the car exhaust need to be pre-inspected, the exhaust pipe, muffler and other related auto parts may be involved.

[0156] Among them, the associated parts table refers to a table of automobile parts corresponding to the automobile pre-inspection components, which is convenient for subsequent judgment on whether the pre-inspection personnel have pre-inspected the corresponding parts. The associated parts table can include the names and images of automobile parts, so that they can be compared with the part contours extracted by the internal monitoring equipment.

[0157] S332, parsing the part data to obtain a plurality of part contours in the internal monitoring data, and comparing the part contours with standard contours corresponding to the associated parts to obtain contour similarity values.

[0158] It can be understood that after extracting multiple part contours from the internal monitoring data, it is necessary to find the part contour corresponding to the component that needs pre-inspection from the multiple part contours in the video data. Specifically, it can be compared with the corresponding standard part contour in the associated parts table to find the specific part that needs pre-inspection.

[0159] Among them, the part contour refers to the contour of the part extracted from the internal monitoring data, and the standard part contour refers to the contour of the part that needs to be pre-inspected in the associated parts table. The similarity between the two contours can be compared by contour comparison technology in the prior art, such as contour feature comparison technology. The contour similarity value is a numerical value that can represent the similarity between the extracted part contour and the standard part contour in the associated parts table. The larger the value, the greater the similarity.

[0160] S333: Determine the part contour whose contour similarity value is greater than the similarity threshold as the pre-inspection contour corresponding to the associated part.

[0161] It is understandable that there are multiple part contours associated with the automotive parts that need to be pre-inspected, so the multiple part contours extracted from the video data must be compared one by one. After the comparison, the part contour with the largest contour similarity value in the associated parts table is selected. It can be considered that the part contour is consistent with the part contour corresponding to the part that needs to be pre-inspected.

[0162] The similarity threshold is a threshold of contour similarity, for example, it may be 95%. If the contour similarity value of two parts is greater than a preset similarity threshold, it can be considered that the contours of the two parts are the same.

[0163] S334, obtaining that the pre-inspection end without the pre-inspection profile is an abnormal end and the pre-inspection end with the pre-inspection profile is a pending end.

[0164] It is understandable that if the part contour corresponding to the associated parts table is not extracted from the monitoring data, it can be considered that the portable detection equipment worn by the pre-inspection personnel has not identified the automotive parts that need pre-inspection, and the pre-inspection personnel may not be in the area where the pre-inspection parts are located at this time. It can be considered that the pre-inspection operation of the pre-inspection personnel is abnormal. When the portable monitoring equipment worn by the pre-inspection personnel identifies the automotive parts that need pre-inspection, the pre-inspection personnel may be in the area where the pre-inspection parts are located at this time. Therefore, it can be continued to determine whether the process of pre-inspection of the parts is abnormal in the future.

[0165] Among them, the abnormal end refers to the pre-inspection end with problems, and the pending end refers to the pre-inspection end that needs to be monitored and determined.

[0166] S335, extracting the hand contour in the internal monitoring data, and obtaining the part contour intersecting with the hand contour as the determination contour.

[0167] In actual applications, pre-inspection personnel can wear gloves of a different color from the automobile parts during the pre-inspection process, usually white gloves. The monitoring equipment carried by the pre-inspection personnel can extract the white gloves worn by the pre-inspection personnel, and then determine the specific parts touched by the pre-inspection personnel through the extracted hand contour, and then determine whether the parts touched by the pre-inspection personnel are abnormal.

[0168] In some embodiments, when extracting the hand contour, multiple adjacent pixel points corresponding to the pixel values ​​of the glove may be extracted, and then contour extraction may be performed using the multiple adjacent pixel points to obtain the hand contour of the pre-inspected person.

[0169] It can be understood that when the pre-inspection personnel conducts pre-inspection, there is an intersection between the pre-inspection personnel's hand contour and the automobile part contour. Therefore, the part contour that intersects with the hand contour can be used as the judgment contour. The judgment contour refers to the part contour that determines whether the pre-inspection process of the pre-inspection personnel's parts is abnormal.

[0170] S336, performing internal compliance judgment on the pending end according to the judgment profile, obtaining a normal end or an abnormal end, generating a part abnormality label corresponding to the abnormal end, and obtaining part judgment data according to the normal end or the abnormal end.

[0171] It can be understood that after determining the parts that the pre-inspection personnel have touched, it is possible to determine whether the pre-inspection process of the parts by the pre-inspection personnel is abnormal based on the duration. If the part currently being pre-inspected by the pre-inspection personnel is not the part corresponding to the part that needs to be pre-inspected, then the pre-inspection process in this area may be abnormal, and the pending end will be determined as an abnormal end, and an abnormal label of the corresponding type will be added to the abnormal end.

[0172] Among them, the part exception label is the exception label corresponding to the part type during the pre-inspection process. The server will remind the management personnel through this label, so that the management personnel can deal with the problem in a targeted manner later.

[0173] Based on the above embodiment, the specific implementation of step S336 may be:

[0174] S3361, obtaining the intersection duration between the hand contour and the determination contour, and when the intersection duration is greater than the reference intersection duration and the determination contour is the pre-check contour, determining that the pending end is a normal end.

[0175] Specifically, when the pre-inspection personnel are pre-inspecting automobile parts, the contour of the pre-inspection personnel's hand will be in contact with the contour of the part for a long time, so the intersection time between the pre-inspection personnel's hand contour and the judgment contour can be used to determine whether there is an abnormality in the pre-inspection process of the pre-inspection personnel. If the intersection time is greater than the benchmark intersection time and the judgment contour is the required pre-inspection contour, it can be considered that the pre-inspection personnel is inspecting the parts that need to be pre-inspected, and the pending end can be considered normal at this time.

[0176] Among them, the benchmark intersection duration is a time threshold used to determine whether the pre-inspection personnel are conducting pre-inspection of the corresponding parts of the automobile. For example, it can be 2 minutes. When the pre-inspection personnel touches a certain automobile part for more than 2 minutes, it can be determined that they may be conducting pre-inspection of the corresponding part.

[0177] If the intersection duration is greater than the reference intersection duration and the determined contour is the pre-inspection contour, it means that the part currently pre-inspected by the pre-inspection personnel is normal, so it can be determined as a normal end.

[0178] S3362: When the intersection duration is greater than the reference intersection duration and the determined contour is not the pre-checked contour, a determination range corresponding to the determined contour is determined according to a preset radius with the center point of the determined contour as a reference.

[0179] It is understandable that if the intersection time is greater than the benchmark intersection time, but the determined contour is not the pre-inspection contour, the part being pre-inspected by the pre-inspection personnel may not be the part corresponding to the pre-inspection component. Therefore, it is necessary to make an abnormal judgment on it. Specifically, it can be determined whether there is a part contour that needs to be pre-inspected around the determined contour. If so, it means that the pre-inspection personnel may be supporting the part corresponding to the pre-inspection component and contacting other parts when pre-inspecting it. If there is no part contour that needs to be pre-inspected around the determined contour, it means that the part currently being pre-inspected by the pre-inspection personnel may be abnormal.

[0180] The preset radius refers to the range radius of abnormal traversal around the determined contour, and the radius may be set in advance.

[0181] S3363, obtaining a judgment contour in which the pre-check contour exists within the judgment range as a normal contour, and a judgment contour in which the pre-check contour does not exist within the judgment range as an abnormal contour.

[0182] It can be understood that when there is a contour of an automobile part that needs pre-inspection within the judgment range, it means that the pre-inspection personnel may be supporting the parts corresponding to the pre-inspection components and contacting other parts when pre-inspecting them. Therefore, the corresponding judgment contour can be used as a normal contour. If there is no contour of an automobile part that needs pre-inspection within the judgment range, the part currently being pre-inspected by the pre-inspection personnel may be abnormal. Therefore, the corresponding judgment contour can be used as an abnormal contour.

[0183] S3364, determining that the undetermined end corresponding to the normal contour is a normal end, and the undetermined end corresponding to the abnormal contour is an abnormal end.

[0184] Through the above implementation, management personnel at the management end can make more accurate compliance judgments on the internal operations of pre-inspection personnel.

[0185] S34, obtaining the historical time data corresponding to the pre-inspection component, performing time compliance judgment on the pre-inspection time data according to the historical time data to obtain time judgment data, and obtaining risk identification data according to the time judgment data and the operation judgment data and sending it to the management end.

[0186] It is understandable that the pre-inspection personnel generally record the time taken when pre-inspecting automobile parts. Each pre-inspection will be recorded, and the average time taken for all historical pre-inspections of the same automobile parts will be taken as the historical time data. The time used for this pre-inspection will be compared with the historical time data, so as to determine whether the time used by the pre-inspection personnel in this pre-inspection process is normal and obtain data for time judgment.

[0187] Based on the above embodiment, the specific implementation of step S34 may be:

[0188] S341, parsing the pre-check time data to obtain the start time and the end time of the internal monitoring data, and obtaining the current pre-check duration according to the start time and the end time.

[0189] In actual applications, when the pre-inspection personnel starts the pre-inspection, the monitoring equipment they carry with them will record the current time, and when the pre-inspection ends, the end time will also be recorded. The difference between the two is the length of time the pre-inspection personnel currently spends on the pre-inspection.

[0190] S342, obtaining a plurality of historical pre-check durations corresponding to the pre-check component according to the historical time data, and calculating an average of the historical pre-check durations to obtain a reference pre-check duration.

[0191] Specifically, when different problems occur in the pre-inspected vehicle, different parts need to be pre-inspected, so the time taken by the pre-inspection personnel in each pre-inspection process may also be different. Therefore, taking the average of the pre-inspection time of multiple times in history of the pre-inspection parts can improve the accuracy of time judgment.

[0192] The benchmark pre-check duration refers to the average of historical time data.

[0193] S343, obtaining a minimum duration extreme value based on the product of the benchmark pre-check duration and the minimum offset coefficient, and obtaining a maximum duration extreme value based on the product of the benchmark pre-check duration and the maximum offset coefficient.

[0194] It can be understood that the longest time and the shortest time required for the pre-inspection personnel to pre-inspect the corresponding automobile parts can be obtained by multiplying the benchmark pre-inspection time by the offset coefficient.

[0195] Among them, the minimum offset coefficient is the coefficient corresponding to the shortest pre-check duration. For example, when the benchmark pre-check duration is 1 hour and the minimum offset coefficient is 0.1, the minimum duration is 6 minutes. The maximum offset coefficient is the coefficient corresponding to the longest pre-check duration. For example, when the benchmark pre-check duration is 1 hour and the maximum offset coefficient is 2, the maximum duration is 2 hours.

[0196] S344, obtaining a duration judgment interval based on the minimum duration extreme value and the maximum duration extreme value, determining that the current pre-check duration within the duration judgment interval is a normal pre-check duration, and the current pre-check duration not within the duration judgment interval is an abnormal pre-check duration.

[0197] It can be understood that if the pre-inspection time currently used by the pre-inspection personnel is between the minimum time extreme value and the maximum time extreme value, then the current pre-inspection time can be determined to be a normal pre-inspection time. If the pre-inspection time currently used by the pre-inspection personnel is not between the minimum time extreme value and the maximum time extreme value, for example, if it is less than the minimum time extreme value, the time is too short, and the pre-inspection personnel may not have performed pre-inspection operations on the automotive parts that need to be pre-inspected; if it is greater than the maximum time extreme value, the time is too long, and the pre-inspection personnel may have problems during the pre-inspection process. In this case, the current pre-inspection time can be determined to be an abnormal pre-inspection time.

[0198] The duration judgment interval refers to the duration value interval between the minimum duration extreme value and the maximum duration extreme value.

[0199] S345, determining that the pre-inspection end corresponding to the normal pre-inspection duration is a normal end and the pre-inspection end corresponding to the abnormal pre-inspection duration is an abnormal end, generating a duration abnormality label corresponding to the abnormal end, and obtaining duration judgment data according to the normal end or the abnormal end.

[0200] It can be understood that when the pre-inspection time used by the pre-inspection personnel is normal, the corresponding pre-inspection end can be judged to be normal. When the pre-inspection time used by the pre-inspection personnel is abnormal, the corresponding pre-inspection end can be judged to be abnormal. Corresponding labels will be added to the abnormal ends to facilitate subsequent management personnel to distinguish the type of abnormality.

[0201] The purpose of the abnormal label is to let the management know what type of abnormality the pre-inspection end has, so that targeted solutions can be taken later. Duration judgment data refers to the management's judgment data on whether the time taken by the pre-inspection personnel during the pre-inspection process is reasonable.

[0202] Through the above method, the pre-inspection process of the pre-inspection personnel can be monitored to improve the standardization of the pre-inspection process.

[0203] S4, receiving a pre-check back-tracing request from the user terminal, generating pre-check back-tracing data according to the pre-check monitoring data, and sending the data to the user terminal.

[0204] It is understandable that when a user wants to apply to view the pre-inspection process of the pre-inspection personnel, he must first send a pre-inspection backtracking viewing request through the user terminal. After receiving the request, the server will send the corresponding pre-inspection data to the user according to the user's specific requirements.

[0205] Among them, the pre-inspection monitoring data will be stored in the database at the end of the pre-inspection process. Each pre-inspected vehicle has corresponding stored data. Therefore, when the user wants to review it, the corresponding review data can be quickly retrieved from the database and sent to the user end for the user to review.

[0206] The pre-check backtracking request refers to a request from the user end for backtracking the pre-check process, and the pre-check backtracking data refers to backtracking video data of the pre-check process generated in combination with user requirements.

[0207] Based on the above embodiment, the specific implementation of step S4 may be:

[0208] S41, determining a backtracking requirement of the user terminal based on the pre-check backtracking request, where the backtracking requirement includes an external amplification requirement and an internal amplification requirement.

[0209] In actual applications, when the user needs to perform a backtrace, the user can click the button corresponding to the backtrace request. After the user clicks, the backtrace application page will pop up, and the user can choose whether to amplify the external monitoring data or the internal monitoring data.

[0210] Specifically, since the pre-inspection monitoring data includes external monitoring data and internal monitoring data, this solution will integrate these two video data when generating a retrospective video. During the integration, this solution will enlarge and display one of the video data and reduce and display the other video data based on user needs, so that users can retrospect the video of the pre-inspection process based on their own viewing needs.

[0211] The external amplification demand refers to the user's need to magnify and display external monitoring data, and the internal amplification demand refers to the user's need to magnify and display internal monitoring data.

[0212] S42, calling a backtracking template, the backtracking template comprising a core display area and an auxiliary display area, filling the external monitoring data into the core display area according to the external amplification requirement, and filling the internal monitoring data into the auxiliary display area to obtain a type of backtracking data and sending it to the user terminal.

[0213] See also Figure 3 , which is a schematic diagram of a type of backtracking data provided by an embodiment of the present invention. It can be understood that the backtracking template is a template for playing back the video data recorded by the external and internal monitoring devices, and the backtracking template is divided into a core display area and an auxiliary display area. The core display area can be used to display the enlarged video data, and the auxiliary display area can be used to display the reduced video data.

[0214] When the user selects the external magnification requirement, it means that the user may want to focus on the video data outside the vehicle. Therefore, the external monitoring data can be enlarged and filled into the core display area, and the internal monitoring data can be reduced and filled into the auxiliary display area.

[0215] S43, filling the internal monitoring data into the core display area according to the internal amplification requirement, filling the external monitoring data into the auxiliary display area, and obtaining two types of traceability data to send to the user terminal.

[0216] When the user selects the internal zoom requirement, it means that the user may want to focus on the video data inside the vehicle. Therefore, the internal monitoring data can be enlarged and filled into the core display area, and the external monitoring data can be reduced and filled into the auxiliary display area to obtain the second type of traceback data and send it to the user end.

[0217] Through the above implementation, the video data of the vehicle pre-inspection process can be backtracked in combination with user needs, so that when problems occur in the pre-inspection, corresponding solutions can be quickly found through the backtracked video.

[0218] See also Figure 4 , is a schematic diagram of the structure of an intelligent vehicle pre-checking system provided by an embodiment of the present invention, the intelligent vehicle pre-checking system comprising:

[0219] A generation module, used to generate vehicle pre-inspection data according to a reservation request from a user terminal and send it to a pre-inspection terminal, and obtain external monitoring data collected by a fixed-point monitoring device based on the pre-inspection request from the pre-inspection terminal;

[0220] An acquisition module, used to acquire the internal monitoring data collected by the portable monitoring device corresponding to the pre-inspection end, and obtain the pre-inspection monitoring data according to the external monitoring data and the internal monitoring data;

[0221] A judgment module, used to perform compliance judgment on the pre-check monitoring data based on the pre-check risk identification model, and obtain risk identification data and send it to the management end, wherein the risk identification data includes time judgment data and operation judgment data;

[0222] The receiving module is used to receive the pre-check traceback request of the user terminal, generate pre-check traceback data according to the pre-check monitoring data, and send it to the user terminal.

[0223] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. An intelligent vehicle pre-inspection method, characterized in that: include: Generate vehicle pre-inspection data according to the reservation request of the user terminal and send it to the pre-inspection terminal, and obtain external monitoring data collected by the fixed-point monitoring device based on the pre-inspection request of the pre-inspection terminal; Acquire internal monitoring data collected by a portable monitoring device corresponding to the pre-inspection end, and obtain pre-inspection monitoring data according to the external monitoring data and the internal monitoring data; Based on the pre-check risk identification model, the pre-check monitoring data is subjected to compliance judgment, and the obtained risk identification data is sent to the management end, wherein the risk identification data includes time judgment data and operation judgment data; Receiving a pre-check back-tracing request from the user terminal, generating pre-check back-tracing data according to the pre-check monitoring data and sending the data to the user terminal; According to the reservation request of the user terminal, the vehicle pre-inspection data is generated and sent to the pre-inspection terminal, and the external monitoring data collected by the fixed-point monitoring device is obtained based on the pre-inspection request of the pre-inspection terminal, including: Determine the pre-inspection vehicle and pre-inspection component according to the reservation request, and obtain the pre-inspection queue corresponding to the pre-inspection component; Obtain the current pre-inspection vehicle and the waiting pre-inspection vehicle corresponding to the pre-inspection queue, determine the estimated waiting time corresponding to the pre-inspection vehicle according to the sum of the current pre-inspection time corresponding to the current pre-inspection vehicle and the waiting pre-inspection time of the waiting pre-inspection vehicle, and send it to the user end; According to the information determined by the user terminal about the estimated waiting time, the pre-inspection vehicle and pre-inspection component are obtained to generate vehicle pre-inspection data and send it to the pre-inspection terminal; Receiving a pre-inspection request from the pre-inspection terminal, acquiring monitoring video data collected by the fixed-point monitoring device on the pre-inspection area, and obtaining external monitoring data according to the monitoring video data; Acquiring internal monitoring data collected by the portable monitoring device corresponding to the pre-inspection end, including: In response to the pre-check request, obtaining real-time video data collected by the portable monitoring device, and obtaining internal monitoring data based on the real-time video data; Based on the pre-check risk identification model, the pre-check monitoring data is subjected to compliance judgment, and the obtained risk identification data is sent to the management end, wherein the risk identification data includes time judgment data and operation judgment data, including: Acquiring the operation path corresponding to the external monitoring data based on the pre-inspection risk identification model, and performing external compliance judgment on the pre-inspection end according to the operation path to obtain part judgment data; Acquire part data and pre-inspection time data corresponding to the internal monitoring data according to the pre-inspection risk identification model; Performing internal compliance judgment on the pre-inspection end based on the part data to obtain part judgment data, and obtaining operation judgment data based on the position judgment data and the part judgment data; Obtaining historical time data corresponding to the pre-check component, performing time compliance judgment on the pre-check time data according to the historical time data to obtain time judgment data, and obtaining risk identification data according to the time judgment data and the operation judgment data and sending it to the management end; The operation path corresponding to the external monitoring data is acquired based on the pre-inspection risk identification model, and external compliance judgment is performed on the pre-inspection end according to the operation path to obtain the part judgment data, including: Determine the reserved license plate corresponding to the pre-inspected vehicle, identify the license plates of multiple vehicles in the external monitoring data, and determine the vehicle corresponding to the reserved license plate as the target vehicle; Retrieving a part segmentation template, wherein the part segmentation template includes a plurality of area frames, each of the area frames corresponds to a corresponding segmentation area; superimposing the part segmentation template on the external monitoring data, and determining a plurality of pre-inspection areas in the external monitoring data according to the area frame; Determine a pre-inspection area corresponding to the target vehicle as a target area, and obtain a part area corresponding to each of the segmented areas in the target area, wherein the part area at least includes a front area, a rear area, and a body area; Acquire a person profile in the external monitoring data, and determine the person profile corresponding to the identity information of the pre-inspection terminal as a target profile; Acquire a motion path corresponding to the target contour, and determine a current pre-inspection area corresponding to the target contour according to the motion path; Determine the part area corresponding to the pre-inspection component as the target pre-inspection area, obtain the pre-inspection end where the current pre-inspection area and the target pre-inspection area are consistent as a normal end, and the pre-inspection end where the current pre-inspection area and the target pre-inspection area are inconsistent as an abnormal end; A part abnormality label corresponding to the abnormal end is generated, and part judgment data is obtained according to the normal end or the abnormal end.

2. The method according to claim 1, characterized in that: Acquiring a motion path corresponding to the target contour, and determining a current pre-inspection area corresponding to the target contour according to the motion path, including: Acquire the center point of the target contour as a positioning point, and generate a motion path corresponding to the target contour according to the positioning points corresponding to multiple moments; Determine a phase difference distance between two adjacent positioning points at the same time, and when the phase difference distance is less than a reference phase difference distance, determine the corresponding positioning point as a pre-check point; Determine the pre-check duration of the target contour according to the time corresponding to the consecutive adjacent pre-check points, and when the pre-check duration is greater than the pre-check duration threshold, obtain the positioning point corresponding to the target contour at the current time as the judgment point; The region center point of each of the part regions is obtained, the interval distance between the region center point and the judgment point is determined, and the part region with the smallest interval distance is obtained as the current pre-inspection region corresponding to the target contour.

3. The method according to claim 1, characterized in that The pre-inspection end is internally judged for compliance based on the part data to obtain part judgment data, including: Obtaining an associated parts list corresponding to the pre-inspection component, wherein the associated parts list includes a plurality of associated parts corresponding to the pre-inspection component; Parsing the part data to obtain a plurality of part contours in the internal monitoring data, and comparing the part contours with standard contours corresponding to the associated parts to obtain contour similarity values; Determine the part contour whose contour similarity value is greater than the similarity threshold as the pre-inspection contour corresponding to the associated part; Acquire the pre-inspection end without the pre-inspection profile as an abnormal end, and the pre-inspection end with the pre-inspection profile as a pending end; Extracting a hand contour from the internal monitoring data, and obtaining a part contour intersecting with the hand contour as a determination contour; An internal compliance judgment is performed on the pending end according to the judgment profile to obtain a normal end or an abnormal end, an abnormal part label corresponding to the abnormal end is generated, and part judgment data is obtained according to the normal end or the abnormal end.

4. The method according to claim 3, characterized in that Performing internal compliance judgment on the pending end according to the judgment profile to obtain a normal end or an abnormal end includes: Obtaining the intersection duration between the hand contour and the determination contour, and when the intersection duration is greater than the reference intersection duration and the determination contour is the pre-check contour, determining that the pending end is a normal end; When the intersection duration is greater than the reference intersection duration and the determined contour is not the pre-checked contour, taking the center point of the determined contour as a reference and determining a determination range corresponding to the determined contour according to a preset radius; The determined contour that contains the pre-checked contour within the determined range is obtained as a normal contour, and the determined contour that does not contain the pre-checked contour within the determined range is obtained as an abnormal contour; The undetermined end corresponding to the normal contour is determined as a normal end, and the undetermined end corresponding to the abnormal contour is determined as an abnormal end.

5. The method according to claim 1, characterized in that Acquiring historical time data corresponding to the pre-check component, and performing time compliance judgment on the pre-check time data according to the historical time data to obtain time judgment data, including: Parsing the pre-check time data to obtain the start time and the end time of the internal monitoring data, and obtaining the current pre-check duration according to the start time and the end time; According to the historical time data, a plurality of historical pre-check durations corresponding to the pre-check component are obtained, and a mean value of each of the historical pre-check durations is calculated to obtain a reference pre-check duration; A minimum duration extreme value is obtained based on the product of the reference pre-check duration and the minimum offset coefficient, and a maximum duration extreme value is obtained based on the product of the reference pre-check duration and the maximum offset coefficient; A duration determination interval is obtained based on the minimum duration extreme value and the maximum duration extreme value, and a current pre-check duration within the duration determination interval is determined as a normal pre-check duration, and a current pre-check duration not within the duration determination interval is determined as an abnormal pre-check duration; Determine that the pre-inspection end corresponding to the normal pre-inspection duration is a normal end, and the pre-inspection end corresponding to the abnormal pre-inspection duration is an abnormal end, generate a duration abnormality label corresponding to the abnormal end, and obtain duration judgment data according to the normal end or the abnormal end.

6. The method according to claim 1, characterized in that Receiving a pre-check back-tracing request from the user terminal, generating pre-check back-tracing data according to the pre-check monitoring data and sending the data to the user terminal, including: Determining a backtracking requirement of the user terminal based on the pre-check backtracking request, wherein the backtracking requirement includes an external amplification requirement and an internal amplification requirement; Retrieving a backtracking template, the backtracking template comprising a core display area and an auxiliary display area, filling the external monitoring data into the core display area according to the external amplification requirement, and filling the internal monitoring data into the auxiliary display area to obtain a type of backtracking data and sending it to the user end; According to the internal amplification requirement, the internal monitoring data is filled into the core display area, and the external monitoring data is filled into the auxiliary display area, so as to obtain two types of traceability data and send them to the user end.

7. A pre-inspection system for the intelligent vehicle receiving pre-inspection method according to claim 1, characterized in that: include: A generation module, used to generate vehicle pre-inspection data according to a reservation request from a user terminal and send it to a pre-inspection terminal, and obtain external monitoring data collected by a fixed-point monitoring device based on the pre-inspection request from the pre-inspection terminal; An acquisition module, used to acquire the internal monitoring data collected by the portable monitoring device corresponding to the pre-inspection end, and obtain the pre-inspection monitoring data according to the external monitoring data and the internal monitoring data; A judgment module, used to perform compliance judgment on the pre-check monitoring data based on the pre-check risk identification model, obtain risk identification data and send it to the management end, wherein the risk identification data includes time judgment data and operation judgment data; The receiving module is used to receive the pre-check traceback request of the user terminal, generate pre-check traceback data according to the pre-check monitoring data, and send it to the user terminal.

Images