Goods escorting method, device and equipment, storage medium and program product

Abstract

The embodiment of the invention provides a cargo escorting method, electronic equipment, a storage medium and a program product, and relates to the technical field of security and protection. The method comprises the steps that when an escort vehicle executes an escort task according to an escort route, in-vehicle video data of the escort vehicle is collected, the in-vehicle video data is used for displaying the cargo state and the escort personnel state, and then whether the cargo state and the escort personnel state are in an abnormal escort state or not is judged; and when the cargo state and / or the escort personnel state are / is in the abnormal escort state, the alarm information is generated based on the abnormal escort state, so that the whole-process monitoring of escort is realized, the abnormal state of the escort cargo and the escort personnel can be found in time, the alarm information is sent to a bank, and the safety of the escort process is improved.

Description

Technical Field

[0001] The present application relates to the field of security technology, and in particular to a cargo escort method, electronic equipment, storage medium, and program product. Background Art

[0002] The escort of cash, precious metals, and other items is a crucial component of financial services, involving the safe transfer of large amounts of cash and other valuables between bank branches, vaults, and during transport. To ensure safety during transport, banks have established strict regulations regarding the vetting of escort personnel and the escort process.

[0003] Existing escort methods primarily rely on manual monitoring, monitoring equipment, and positioning devices to ensure compliance and safety during the escort process. For example, during the escort process, escort personnel are required to strictly follow established procedures, carefully verify the quantity and packaging of cash when loading and unloading, and record relevant information. Furthermore, escort vehicles must be equipped with positioning devices that transmit their location information to the bank's backend to determine their location during the escort process.

[0004] However, there are many complex and uncertain risks in the escort process. Whether it is manual monitoring, monitoring equipment or positioning equipment, it is impossible for the bank to grasp every detail of the escort in a timely and comprehensive manner, and it is difficult to ensure that abnormal situations during the escort are discovered in time, thereby reducing the safety of the escort. Summary of the Invention

[0005] The present application provides a cargo escort method, device, equipment, storage medium and product to solve the technical problems that the existing technology cannot timely and comprehensively feedback every detail of the escort process, and it is difficult to ensure timely detection of abnormal situations during the escort.

[0006] In a first aspect, the present application provides a cargo escort method, comprising:

[0007] When the escort vehicle performs the escort mission according to the escort route, the in-vehicle video data of the escort vehicle is collected, and the in-vehicle video data is used to display the status of the cargo and the status of the escort personnel;

[0008] Determine whether the cargo status and escort personnel status are in abnormal escort status;

[0009] When the cargo status and / or the escort personnel status are in an abnormal escort state, an alarm message is generated based on the abnormal escort state.

[0010] In a second aspect, the present application provides a cargo escort device, comprising:

[0011] The acquisition module is used to collect the escort vehicle's in-vehicle video data when the escort vehicle performs the escort mission along the escort route. The in-vehicle video data is used to display the status of the cargo and the escort personnel;

[0012] A judgment module is used to judge whether the status of the goods and the status of the escort personnel are in an abnormal escort state;

[0013] The generation module is used to generate alarm information based on the abnormal escort status when the cargo status and / or the escort personnel status are in an abnormal escort status.

[0014] In a third aspect, an embodiment of the present application provides an electronic device, comprising: a processor, and a memory communicatively connected to the processor;

[0015] The memory stores computer-executable instructions;

[0016] The processor executes the computer-executable instructions stored in the memory to implement the above first aspect and / or various possible implementations of the first aspect.

[0017] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, they are used to implement the first aspect above and / or various possible implementation methods of the first aspect.

[0018] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the above first aspect and / or various possible implementation methods of the first aspect.

[0019] The cargo escort method provided by the present application collects in-vehicle video data of the escort vehicle when the escort vehicle performs the escort mission according to the escort route. The in-vehicle video data is used to display the cargo status and the escort personnel status, and then respectively judge whether the above-mentioned cargo status and escort personnel status are in an abnormal escort status; and when the above-mentioned cargo status and / or escort personnel status are in an abnormal escort status, an alarm message is generated based on the abnormal escort status, thereby realizing the whole process monitoring of the escort, and being able to timely discover the abnormal status of the escorted cargo and escort personnel, and prompting the relevant personnel to take corresponding measures through the alarm message, thereby improving the safety of the escort process. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0021] Figure 1 Schematic diagram of the process of the cargo escort method provided in the embodiment of the present application Figure 1;

[0022] Figure 2 Schematic diagram of the process of the cargo escort method provided in the embodiment of the present application Figure 2 ;

[0023] Figure 3 A route map between an escort starting point and an escort end point provided in an embodiment of the present application;

[0024] Figure 4 A schematic diagram of an object recognition model provided in an embodiment of the present application;

[0025] Figure 5 A schematic diagram of an escort personnel identification model provided in an embodiment of the present application;

[0026] Figure 6 Schematic diagram of the process of the cargo escort method provided in the embodiment of the present application Figure 3 ;

[0027] Figure 7 A schematic diagram of the structure of the cargo escort device provided for this application;

[0028] Figure 8 This is a schematic diagram of the structure of the electronic device provided in this application.

[0029] The above drawings illustrate specific embodiments of the present application, which will be described in more detail below. These drawings and the textual description are not intended to limit the scope of the present application in any way, but rather to illustrate the concepts of the present application to those skilled in the art by reference to specific embodiments. DETAILED DESCRIPTION

[0030] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

[0031] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of the relevant data comply with the relevant laws, regulations and standards of the relevant countries and regions, take necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0032] In addition, this application involves conducting big data analysis of user information (including but not limited to personal biometrics, identity data, consumption data, asset data, electronic terminal operation data, etc.), and using artificial intelligence technology to make automated decisions, and making technical solutions that have a significant impact on personal rights and interests based on the results of automated decisions. The application provides users with corresponding operation entrances for them to choose to agree or reject the results of automated decisions; if the user chooses to reject, the expert decision-making process will be entered.

[0033] It should be noted that the methods, devices, equipment, storage media and products for cargo escort provided in this application can be used in the field of security technology, and can also be used in any field other than the field of security technology. The application fields of the methods, devices, equipment, storage media and products for cargo escort in this application are not limited.

[0034] In banks, the escort of valuables like cash is a crucial aspect of financial operations. To ensure the safe transfer of valuables like cash between bank branches, in vaults, and during transportation, banks have established strict regulations regarding escort personnel and procedures.

[0035] For example, existing escort methods primarily rely on manual monitoring, monitoring equipment, and positioning devices to ensure the compliance and safety of the escort process. Before the escort, the escort personnel's identity information is reviewed and uploaded to the escort management system. During the escort process, escort personnel are required to strictly follow escort procedures and carefully verify the quantity and packaging of cash when loading and unloading, and record relevant information. Furthermore, escort vehicles must be equipped with positioning devices to transmit their location information to the bank's backend to determine their location during the escort.

[0036] However, there are many complex and uncertain risks in the escort process. Whether it is manual monitoring, monitoring equipment or positioning equipment, it is impossible for the bank to grasp every detail of the escort in a timely and comprehensive manner, and it is difficult to ensure that abnormal situations during the escort are discovered in time, thereby reducing the safety of the escort.

[0037] The cargo escort method provided by this application collects in-vehicle video data from the escort vehicle, identifies the escorted cargo and escort personnel from the in-vehicle video data, and analyzes whether the escorted cargo is in an abnormal state such as damage or displacement, as well as whether the escort personnel's personal information, current actions, and escort equipment held by the escort personnel comply with regulations, in order to determine whether the current escort is in an abnormal escort state. If the current escort is in an abnormal escort state, an alarm message is generated. This method realizes the full-process monitoring of the escorted cargo and escort personnel, and can promptly detect and report abnormal escort states to relevant staff, allowing staff to fully grasp every detail of the escort process and improve the safety of the escort process.

[0038] The following specific embodiments describe in detail the technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0039] Figure 1 Schematic diagram of the process of the cargo escort method provided in the embodiment of the present application Figure 1 This method can be applied to escort systems, such as Figure 1 As shown, the method includes:

[0040] S101. When the escort vehicle performs an escort mission according to an escort route, collect in-vehicle video data of the escort vehicle.

[0041] Among them, the in-vehicle video data is used to display the status of the cargo and the escort personnel.

[0042] Specifically, the escort vehicle is equipped with at least one monitoring device that collects real-time in-vehicle video data. After acquiring this in-vehicle video data, the escort system identifies the escorted cargo and escort personnel, and then identifies the cargo status and escort personnel status. The cargo status includes, but is not limited to, its appearance, damage status, and location. The escort personnel status includes, but is not limited to, its identity, attire, movements, and the equipment it carries.

[0043] Exemplarily, this method is applied to a bank escort system, where the escorted cargo is a cash box. After the surveillance equipment on the escort vehicle captures in-vehicle video data, it uploads the data to the bank escort system. The bank escort system extracts frames from the in-vehicle video data to generate multiple video frames, which are then input into a target recognition model, which includes an item recognition model and an escort identification model. The item recognition model is trained based on cargo images with item status labels to output the cargo status, while the escort identification model is trained based on escort personnel images with person status labels to output the escort personnel status. It is understood that item status labels can include, for example, damaged, deformed, obscured, scattered, category, location, and quantity. Person status labels can include, for example, clothing type, illegal behavior, personnel badge information, and missing equipment.

[0044] Understandably, monitoring equipment can also be installed outside the escort vehicle, which can not only record the loading and unloading process, but also monitor surrounding vehicles and personnel close to the escort vehicle during the escort process, thereby realizing full-process and all-round monitoring of the escort and improving the safety of the escort process.

[0045] S102. Determine whether the cargo status and the escort personnel status are in an abnormal escort state respectively; if the cargo status and / or the escort personnel status are in an abnormal escort state, execute the following step S103; if neither the cargo status nor the escort personnel status are in an abnormal escort state, execute the following step S104.

[0046] Specifically, after obtaining the cargo status and escort personnel status, it is determined whether the cargo status is in an abnormal escort state, and whether the escort personnel status is in an abnormal escort state, to ensure the safety of the cargo during escort and the escort personnel's operational compliance. For example, if the cargo status includes damage, the escort task is determined to be in an abnormal escort state, and the abnormal escort state can be, for example, "damaged cargo." If the number of escort personnel is less than the standard escort number corresponding to the escort task, the escort task is determined to be in an abnormal escort state, and the abnormal escort state can be, for example, "an escort personnel is absent."

[0047] This method is based on the status of the goods and the status of the escort personnel during the escort process to judge whether the status of the goods and the status of the escort personnel meet the escort specifications, which is conducive to timely discovering safety hazards and violations in the escort process, thereby promoting the standardization of escort work and improving the safety of the escort process.

[0048] S103: Generate alarm information based on the abnormal escort status.

[0049] Specifically, as shown in step S102 above, if the cargo status and / or escort personnel status are in an abnormal escort state, an alarm message is generated based on the abnormal escort state. Examples of abnormal escort states include: escort personnel violations, abnormal cargo position, and opened cargo packaging. Examples of alarm messages generated based on these abnormal escort states include: escort mission number [2025000], alarm time: January 1, 2025, cargo information: cash box No. 001, abnormal escort state: door open, cash box No. 001 moved 50 centimeters back from its original position, and escort Xiao Wang [No. 00123] violated regulations while holding protective equipment. Furthermore, after the alarm message is generated, supervisors can promptly identify any abnormalities in the escort mission during transportation and take appropriate measures.

[0050] S104: Generate monitoring records.

[0051] Specifically, as shown in step S102 above, if neither the cargo nor the escort personnel are in an abnormal escort state, that is, if both the cargo and escort personnel are in a normal escort state, a monitoring record is generated based on the normal escort state, and the monitoring record carries a time tag. This method improves the supervision of the escort process and can generate an escort record corresponding to the entire escort process based on the monitoring record. In subsequent escort optimization, the escort route, the placement of escorted goods, and the allocation of escort tasks are optimized based on this escort record, thereby improving escort efficiency.

[0052] The cargo escort method provided in this embodiment collects in-vehicle video data of the escort vehicle when the escort vehicle performs the escort mission according to the escort route. The in-vehicle video data is used to display the cargo status and the escort personnel status, and then respectively determine whether the above-mentioned cargo status and escort personnel status are in an abnormal escort state; and when the above-mentioned cargo status and / or escort personnel status are in an abnormal escort state, an alarm message is generated based on the abnormal escort state, thereby realizing full-process monitoring of the escort, and being able to promptly discover and feedback the abnormal status of the escorted cargo and escort personnel, thereby improving the safety of the escort process.

[0053] Figure 2 Schematic diagram of the process of the cargo escort method provided in the embodiment of the present application Figure 2 .like Figure 2 As shown, this embodiment Figure 1 Based on the embodiment, a possible cargo escort method is described in detail, which includes:

[0054] S201: Obtain an escort request.

[0055] Specifically, after receiving an escort mission, the escort system determines the corresponding escort personnel requirements based on the escort mission's escort level and escort requirements. These escort personnel requirements include, for example, personnel position type, position level, and equipment requirements. Before the escort mission begins, the escort system receives an escort request from the escort party. This escort request includes, but is not limited to, escort mission and escort personnel information. The escort mission includes, but is not limited to, the escort starting point and the escort destination.

[0056] Optionally, the escort system may receive an escort assignment by, for example, receiving escort assignment information submitted by an initiator, including but not limited to escort level and escort requirements. Furthermore, the escort request may be obtained by, for example, receiving the escort request via the identity verification module of the escort system. Exemplarily, the identity verification module is located on the door of the escort vehicle. After an escort officer selects an escort assignment, the escort system sequentially collects facial information from multiple escort officers and compares this facial information with multiple facial information in an escort officer database to obtain escort officer information corresponding to the multiple escort officers. The escort request is then generated based on this escort officer information.

[0057] It is understandable that the escort system can also collect other biometric information such as fingerprints of escort personnel to determine escort personnel information. In addition, the escort personnel can swipe their employee card on the identity verification module so that the identity verification module can retrieve the corresponding escort personnel information from the escort personnel database based on the employee information.

[0058] S202. Determine whether the corresponding escort personnel are qualified to perform the escort mission based on the escort personnel information; if all escort personnel are qualified to perform the escort mission, execute the following step S203; if at least one escort personnel is not qualified to perform the escort mission, execute the following step S213.

[0059] Specifically, after obtaining the escort personnel information, the escort personnel information of multiple escort personnel is verified according to the escort level and escort requirements corresponding to the escort task to determine whether the multiple escort personnel meet the escort level and escort requirements corresponding to the escort task. Exemplarily, the escort level of the escort task is level one escort, and the escort requirements are: at least 5 escort personnel, and at least one of the 5 escort personnel holds a senior escort professional qualification certificate. The escort system collects the facial information of the 5 escort personnel, compares the facial information with the multiple facial information in the escort personnel database, and obtains the escort personnel information corresponding to the above 5 escort personnel. It is determined in turn whether the information of the 5 escort personnel includes level one escort qualifications and whether it includes a senior escort professional qualification certificate to determine whether the above 5 escort personnel have the escort qualifications for the above level one escort task.

[0060] This method verifies the escort personnel information before the escort mission is started, which is conducive to ensuring that each escort personnel involved in the escort mission has the escort qualifications required by the escort mission, thereby improving the security of the escort mission.

[0061] S203: Obtain road information between the escort starting point and the escort end point, and collect the initial status of the escorted goods.

[0062] If the judgment result of the above step S202 indicates that all escort personnel are qualified to perform the escort task, the escort process is started, which includes but is not limited to: route planning, information collection of escorted goods, and startup and debugging of multiple monitoring devices.

[0063] The road information includes but is not limited to: road condition information and accident information within a preset time period; the initial status of the cargo includes: initial quantity of the cargo, initial appearance of the cargo, and initial location of the cargo.

[0064] Specifically, road information corresponding to multiple roads between the escort starting point and the escort end point is obtained, and video data of the escorted cargo is collected using monitoring equipment installed in the escort vehicle. Based on the recognition and analysis of this video data, the initial state of the escorted cargo is determined. For example, the video data of the escorted cargo is frame-processed at preset intervals to obtain multiple cargo image frames. These multiple cargo image frames are then recognized and analyzed using an object recognition model to determine the initial state of the cargo.

[0065] Exemplarily, when this method is applied to a bank escort system, where the escorted cargo is, for example, a cash box, the object recognition model is trained based on multiple images of cash boxes with status identifiers. For example, a large number of images of cash boxes of varying specifications and models are collected, including images of normal and abnormal states. Normal states include, but are not limited to, fully packaged and neatly stacked, while abnormal states include, but are not limited to, damaged packaging, deformed boxes, obscured boxes, and open boxes. These images are annotated with the cash box's category, location information, and status labels to produce a training set for the object recognition model. Examples of categories include size and model code, location information can be annotated using bounding box coordinates, and status labels include normal and specific abnormal types. Furthermore, this annotated training set is input into the object recognition model. By continuously adjusting model parameters, the model's recognition accuracy and robustness for cash boxes is improved. The object recognition model is then obtained when the recognition accuracy reaches a preset level.

[0066] Optionally, the road information between the escort starting point and the escort end point within a preset time period is obtained through an API (Application Programming Interface). The preset time period is set based on the escort demand, and the preset time period can be, for example, one month before the current time.

[0067] It is understandable that the above-mentioned monitoring equipment can be, for example: a high-definition camera, an infrared sensor and a wide-angle lens, and this application does not impose any restrictions on this.

[0068] It should be noted that the escort personnel information in step S201 includes: image registration information. When the escort personnel are all capable of performing the escort task, the escort task is bound to the above-mentioned escort personnel information, so that in the subsequent escort process, the escort personnel's on-the-job status and behavioral operations can be judged based on the escort personnel information.

[0069] S204: Plan the escort route based on the road information.

[0070] The road information includes road condition information within a preset time period. The preset time period may be, for example, road condition information from one week prior to the current time. Furthermore, the road condition information includes, but is not limited to, construction sections, the number of vehicles in the current area, the number of vehicles that can be accommodated, section markings, average speed on the section, and the corresponding time period.

[0071] Specifically, the road from the escort starting point to the escort end point is divided into multiple sections. According to the road condition information corresponding to each section, when the road condition information includes abnormal road conditions, the no-entry threshold of the corresponding section is increased, and it is determined whether the no-entry threshold of each section meets the preset traffic conditions, so as to determine the section with good traffic conditions as the passable section, and generate the escort route based on multiple passable sections. Among them, abnormal sections include but are not limited to: construction sections

[0072] For example, Figure 3 A route map between the escort starting point and the escort end point provided in the embodiment of the present application is as follows: Figure 3 As shown, there are four road sections between the escort starting point A and the escort end point B. Since there is only one road section, Section 1, leading from the escort starting point A to the escort end point B, and the traffic information for Section 1 indicates that Section 1 is unobstructed, the corresponding no-travel threshold for Section 1 is 0.1. Since the next sections to Section 1 are Sections 2, 3, and 4, and Section 2 is a construction section, the corresponding no-travel threshold for Section 2 is determined to be 0.7. Section 4 is a congested section with a long travel time, and based on the travel time of Section 4, the corresponding no-travel threshold for Section 4 is determined to be 0.4. Since the no-travel threshold of 0.7 for Section 2 is greater than the no-travel threshold of 0.4 for Section 4, the next passable section after Section 1 is determined to be Section 4. Furthermore, since only Section 3 can lead to the escort end point B after Section 4, and the traffic information for Section 3 indicates that Section 3 is unobstructed, the corresponding no-travel threshold for Section 3 is 0.1, and therefore, the next passable section after Section 4 is Section 3. Thus, a plurality of passable sections are obtained: section 1, section 4 and section 3, and thus section 1, section 4 and section 3 are determined as escort routes.

[0073] It should be noted that different abnormal road conditions correspond to different no-entry thresholds. The no-entry thresholds for different abnormal road conditions are determined by the traffic risk value and traffic efficiency corresponding to the abnormal road conditions. They can also be determined by combining the traffic risk value, traffic efficiency and driving preference. This application does not impose any restrictions on this.

[0074] S205. When the escort vehicle performs the escort mission according to the escort route, collect in-vehicle video data of the escort vehicle.

[0075] Specifically, the escort system displays the escort route through the display interface of the escort vehicle to instruct the escort personnel to drive the escort vehicle according to the escort route. During the escort process, the monitoring equipment on the escort vehicle collects the in-vehicle video data of the escort vehicle in real time.

[0076] S206. Determine whether the quantity of the goods is inconsistent with the initial quantity of the goods, whether the appearance of the goods is in an abnormal appearance state, and whether the offset between the position of the goods and the initial position of the goods is greater than a preset offset; if the quantity of the goods is inconsistent with the initial quantity of the goods, and / or the appearance of the goods is not in a normal appearance state, and / or the offset is greater than a preset offset, execute the following step S208; if the quantity of the goods is consistent with the initial quantity of the goods, the appearance of the goods is in a normal appearance state, and the offset is not greater than the preset offset, execute the following step S209.

[0077] The in-vehicle video data in step S205 is used to display the status of the cargo and the escort personnel. The cargo status includes the quantity, appearance, and location of the cargo. To ensure the safety of the escorted cargo during transportation, this step identifies and determines the cargo status. Specifically, the in-vehicle video data is frame-processed to obtain multiple item image frames. Based on these multiple item image frames, it is determined whether the cargo quantity is inconsistent with the initial quantity obtained in step S203, whether the cargo appearance is inconsistent with the initial appearance obtained in step S203, and whether the offset between the cargo position and the initial position obtained in step S203 is greater than a preset offset.

[0078] Optionally, the above-mentioned multiple item image frames are input into an item recognition model to obtain the quantity of goods, the appearance identification of goods and the location information of goods. Figure 4 This is a schematic diagram of an object recognition model provided in an embodiment of the present application. Figure 4As shown, this object recognition model resizes the original image frame to obtain image frames of different scales, extracts and fuses features from these frames, and then performs a similarity measurement based on the fused features to obtain the object recognition result. It also locates the escorted item in the image frame to obtain its location information. This object recognition model not only fuses multi-scale features to obtain multi-scale fused features, capturing characteristic information about objects of different sizes, but also downsamples the original image frame to extract and fuse features from frames of different resolutions to obtain multi-resolution fused features. It then performs a similarity measurement based on the multi-scale and multi-resolution fused features to obtain a measurement result, which indicates whether the object to be identified in the original image frame is the target item.

[0079] For example, the multi-scale, multi-resolution fusion features of the original image frame are measured in similarity with the feature data of the target item with damaged packaging. When the similarity value obtained by the similarity measurement is greater than a preset similarity, a first measurement result is obtained. The first measurement result is used to indicate that the item to be identified in the original image frame is the target item with damaged packaging; when the similarity value obtained by the similarity measurement is not greater than the preset similarity, a second measurement result is obtained. The second measurement result is used to indicate that the item to be identified in the original image frame is not the target item with damaged packaging.

[0080] It should be noted that this application does not limit the execution order of step S207 and the above step S202.

[0081] S207: Determine whether the cargo is in an abnormal escort state.

[0082] When the judgment result of the above step S206 indicates that: the quantity of goods is inconsistent with the initial quantity of goods, and / or the appearance of the goods is not in a normal appearance state, and / or the offset is greater than the preset offset, it is determined that the state of the goods is in an abnormal escort state, and the quantity, appearance and location of the goods are monitored during the escort process, which is conducive to timely detection of abnormal escort status of goods and warnings to escort personnel and background monitoring personnel, thereby improving the safety of the escort process.

[0083] For example, the escorted goods are type A cash boxes, and the initial quantity of goods is 3. The in-vehicle video frames in the escort vehicle are extracted to obtain multiple image frames. The multiple image frames are identified and analyzed by the object recognition model, and the number of type A cash boxes is obtained to be 3, cash box No. 001 is in an open state, and the offset of cash box No. 001 is greater than the preset offset. After comparing the number of cash boxes with the initial quantity of goods, the number of cash boxes and the initial quantity of goods are obtained, indicating that the quantity of goods is normal. In addition, the appearance of the cash box is in an abnormal escort state, and the position of the cash box is in an abnormal escort state. Therefore, the cargo status of the cash box is in an abnormal escort state.

[0084] S208: Determine whether the cargo is in normal escort status.

[0085] When the judgment result of the above step S206 indicates that the quantity of goods is consistent with the initial quantity of goods, the appearance of the goods is in a normal appearance state, and the offset is not greater than the preset offset, it means that the quantity, appearance and position of the goods all meet the escort specifications. Therefore, it is determined that the status of the goods is in a normal escort state.

[0086] Optionally, based on normal escort status and abnormal escort status, escort records corresponding to the escort task are generated to improve the supervision of the entire escort process and provide an objective basis for subsequent accident investigations, task reviews, and other work.

[0087] S209. Determine whether the personnel image data is consistent with the image registration information, and whether the personnel behavior data conforms to normal escort behavior; if the personnel image data is consistent with the image registration information, and the personnel behavior data conforms to normal escort behavior, execute the following step S211; if the personnel image data is inconsistent with the image registration information, and / or the personnel behavior data does not conform to normal escort behavior, execute the following step S212.

[0088] The escort personnel status includes personnel image data and personnel behavior data; the escort personnel information in step S201 includes image registration information.

[0089] To further enhance the safety and compliance of the escort process, this step identifies and assesses the escort personnel's information, behavior, and clothing. This ensures that escort personnel adhere to standards throughout the entire escort process and facilitates the timely detection of non-escort personnel and escort personnel on the escort vehicle. Specifically, multiple image frames corresponding to the in-vehicle video data are input into the escort personnel recognition model to obtain escort personnel image data and behavior data. This image data is then compared with the image registration information to verify whether the current escort personnel is consistent with the escort personnel corresponding to the pre-escort image registration information. Furthermore, the behavior data includes, but is not limited to, behavior tags and clothing tags. Examples of behavior tags include: normal escort status tags, missing equipment, illegal opening of escorted cargo packaging, and improper guard posture. Clothing tags include: normal escort status tags, missing work badges, not wearing uniforms, and illegal use of masks. Understandably, if the image data is inconsistent with the image registration information, information about off-duty personnel or non-escort personnel will be obtained.

[0090] This method identifies and judges escort personnel through in-vehicle video data. Through identity verification and behavior judgment, it can promptly detect abnormal operations of escort personnel, thereby improving the supervision of the escort process and realizing standardized and intelligent full-process management.

[0091] Optionally, the escort personnel recognition model is trained based on images of personnel carrying the above-mentioned behavior labels and clothing labels. Figure 5 This is a schematic diagram of an escort personnel identification model provided in an embodiment of the present application. Figure 5 As shown, this escort identification model uses a transformer encoder and decoder separately, significantly improving inference speed by decoupling intra-scale interactions. It also convolves cross-scale downsampled data before inputting it into the classification layer. This reduces the resolution of the downsampled image frames, improving data processing efficiency at the classification layer. Furthermore, the multi-scale features extracted by the encoder at each stage are fused with the corresponding features from the decoder layer to generate richer image features, which improves classification accuracy at the classification layer. After receiving the feature data output by the decoder, the classification layer analyzes and processes it to determine a confidence level that the detected object is the target behavior, corresponding to the image data with the aforementioned behavior label and / or clothing label. Furthermore, if the confidence level is below a preset threshold, the target behavior is not present; if it is above the preset threshold, the target behavior is present.

[0092] S210: Determine whether the escort personnel is in a normal escort state.

[0093] If the judgment result of step S209 indicates that the personnel image data is consistent with the image registration information and the personnel behavior data conforms to normal escort behavior, it means that the escort personnel are on duty and their behavior conforms to escort standards. Therefore, the escort personnel are determined to be in a normal escort state. During the escort process, this method not only standardizes the escort personnel's escort behavior by verifying personnel information and judging personnel behavior, but also provides intelligent supervision of the entire escort process.

[0094] S211. Determine whether the escort personnel is in an abnormal escort state.

[0095] When the judgment result of the above step S209 indicates that: the personnel image data is inconsistent with the image registration information, and / or the personnel behavior data does not conform to normal escort behavior, it means that there are non-escort personnel among the current escort personnel or the escort personnel have left their posts without authorization, and / or the escort behavior of the escort personnel does not conform to the escort specifications. Therefore, it is determined that the escort personnel status is in an abnormal escort state.

[0096] When the method identifies escort personnel status such as non-escort personnel impersonating others, escort personnel leaving their posts, or escort personnel holding protective equipment in an incorrect posture, the escort personnel status will be determined as abnormal escort status, which is conducive to timely feedback of abnormal escort status, so that corresponding measures can be taken in time to avoid loss of escorted items.

[0097] S212: When the cargo status and / or the escort personnel status are in an abnormal escort status, generate an alarm message based on the abnormal escort status.

[0098] The explanation of step S213 is similar to that of step S103 above, and will not be repeated here.

[0099] S213: Generate a reminder of escort qualification abnormality.

[0100] The judgment result of step S202 includes a verification tag indicating that the eligibility information does not meet the escort mission requirements. Examples of such verification tags include expired credentials, failed facial recognition, and an escort level below the required level for the escort mission. Specifically, if the judgment result of step S202 indicates that at least one escort member does not meet the eligibility requirements for the escort mission, an escort qualification anomaly notification is generated based on the escort member's corresponding escort information, the escort mission, and the verification tag, and the notification is fed back to the relevant personnel.

[0101] Before the escort mission begins, this method screens out escort personnel who are not qualified for the escort mission by verifying their information, ensuring the compliance and reliability of the escort team, which is conducive to improving the safety of the escort process.

[0102] The cargo escort method provided in this embodiment obtains an escort request, and based on the escort personnel information in the escort request, determines whether the corresponding escort personnel are qualified to perform the escort task. If the escort personnel are qualified to perform the escort task, the method obtains the road information between the escort starting point and the escort end point, collects the initial state of the escorted cargo, and then plans the escort route based on the road information. Before the escort, the method realizes the automated review of the escort qualifications and the intelligent planning of the escort route, which not only ensures the professionalism and reliability of the escort team, but also helps to obtain the optimal escort route, thereby improving the escort efficiency. As the escort vehicle carries out its escort mission along the escort route, it collects in-vehicle video data. Using this in-vehicle video data, it determines whether the cargo quantity is inconsistent with the initial quantity, whether the cargo appearance is abnormal, and whether the offset between the cargo position and the initial position is greater than a preset offset. If so, the cargo is determined to be in an abnormal escort state; if not, the cargo is determined to be in a normal escort state. Furthermore, it determines whether the personnel image data is consistent with the image registration information and whether the personnel behavior data is consistent with normal escort behavior. If so, the escort personnel is determined to be in a normal escort state; if not, the escort personnel is determined to be in an abnormal escort state. Furthermore, after determining the abnormal escort state, an alarm message is generated based on the abnormal escort state. This method achieves full-process and comprehensive monitoring of escort personnel and escorted cargo, providing timely feedback on any abnormal conditions of the escort personnel and cargo during the escort process, thereby ensuring the standardization and safety of the escort process.

[0103] Figure 6 Schematic diagram of the process of the cargo escort method provided in the embodiment of the present application Figure 3 .like Figure 6 As shown, this embodiment Figures 1 to 2 Based on the embodiment, a method for adjusting an escort route is described in detail, and the method includes:

[0104] S601. Obtaining driving data of the escort vehicle.

[0105] The driving data includes: environmental data, remaining escort sections, and road condition information of the remaining escort sections.

[0106] Specifically, the escort vehicle is equipped with a positioning module, which determines the current road section of the escort vehicle and, based on the escort route and the current road section, determines the corresponding remaining escort sections. Optionally, environmental data and road condition information corresponding to the remaining escort sections are obtained through an API interface. Furthermore, the above environmental data can also be collected by environmental data sensors installed on the escort vehicle, which is not limited in this application.

[0107] S602: Evaluate the safety risk value of the escort route based on the environmental data and the road condition information of the remaining escort sections.

[0108] The remaining escort sections include: multiple sections following the current driving section in the escort route.

[0109] Specifically, different environmental data and road condition information correspond to different safety risk weights. For example, the safety risk weight associated with a sunny day is smaller than that associated with light snow, and the safety risk weight associated with a road section with smooth traffic is smaller than that associated with a school section. By combining the safety risk weight associated with the environmental data and the multiple safety risk weights associated with the remaining escort sections, a section safety risk value is derived for each remaining escort section. Based on these multiple section safety risk values, the safety risk value of the escort route is determined.

[0110] Optionally, the road condition information includes: construction section information, traffic volume, and average speed of the section; the remaining escorted sections include: multiple escorted sub-sections. A method for determining the safety risk value of an escorted sub-section is provided herein, comprising: determining an environmental risk weight corresponding to environmental data, and separately determining a section risk weight corresponding to the construction section information, traffic volume, and average speed of each escorted sub-section; superimposing the multiple section risk weights corresponding to each escorted sub-section to obtain a corresponding target risk weight; and determining a safety risk value based on the environmental risk weight and the target risk weight.

[0111] This method determines the safety risk value of the corresponding road section through the road section risk weight corresponding to multiple road condition data. The safety risk value reflects the safety and transportation efficiency of the escort route and provides a reliable basis for adjusting the escort route.

[0112] For example, Figure 3As shown, the escort starting point is A, the escort end point is B, and the escort period is from 1pm to 3pm. Then the road condition information corresponding to multiple sections from A to B within the escort period within one month before the current moment is obtained. The road condition information includes: the number of vehicles in the current area, the number of vehicles that can be accommodated, the average speed of the section, the section mark, and the sub-period. In addition, A and B belong to the same area, and the environmental data of the corresponding areas of A and B within one month before the current moment are obtained through the API interface. After obtaining the environmental data and road condition information, time series data is generated based on the road condition information and environmental data, and each section mark corresponds to a time series data in each sub-period. Among them, the time series data can be, for example: [environmental data, the number of vehicles in the current area, the number of vehicles that can be accommodated, the average speed of the section, the section mark, the sub-period mark]. For example, if the environmental data indicates a sunny day, the data corresponding to sunny days is marked as 1. The number of vehicles in the current area is 100, the number of vehicles that can be accommodated is 300, and the average speed of the road section is 40. The section mark corresponding to the first road section is 1. The first sub-period from 1:00 to 2:00 is marked as 1. The time series data generated based on the above environmental data and road condition information is: [1, 100, 300, 40, 1, 1]. Then, based on the preset rules, the safety risk value corresponding to this time series data is determined. For example, the preset rules indicate that the safety risk weight corresponding to sunny days is: 0.1; the current number of vehicles in the area / the number of vehicles that can be accommodated is less than or equal to 1 / 3, the corresponding safety risk weight is: 0.3; the average speed of the road section is [40, 50], the corresponding safety risk weight is: 0.2. Then, by multiplying these multiple safety risk weights, the first safety risk value corresponding to the first road section is: 0.1×0.3×0.2=0.6.

[0113] It can be understood that after obtaining the section safety risk values ​​corresponding to the plurality of remaining escort sections, the plurality of section safety risk values ​​are summed up, and the summed value is normalized to obtain the safety risk value of the escort route.

[0114] S603. Determine whether the security risk value is greater than a preset threshold; if the security risk value is greater than the preset threshold, execute the following step S604; if the security risk value is not greater than the preset threshold, execute the following step S608.

[0115] Specifically, for each remaining escort section, the safety risk value is determined to be greater than a preset threshold to assess whether the safety and escort efficiency of the corresponding remaining escort section can meet the escort requirements. The preset threshold can be determined based on the safety level of the escort task or set according to the escort requirements. This application does not impose any restrictions on this.

[0116] This method helps to timely avoid safety risks during escort by evaluating whether the safety risk values ​​of the remaining escort routes meet the escort requirements, thereby improving the safety and efficiency of escort tasks.

[0117] S604: Plan an optimal driving route based on the driving data.

[0118] If the judgment result of step S603 indicates that the safety risk value is greater than the preset threshold, the safety risk of the remaining escort routes is too high to meet the escort safety requirements. Therefore, the remaining escort routes need to be replanned. Specifically, based on the safety risk values ​​corresponding to multiple candidate road sections between the current road section and the escort destination in the driving data, candidate road sections with high safety risk values ​​are eliminated, and candidate road sections with low safety risk values ​​are determined as the road sections to be passed. The optimal driving route is then generated based on the multiple road sections to be passed.

[0119] Optionally, a method for planning an optimal driving route is provided herein. The method includes: determining the escort vehicle's current route from driving data, obtaining multiple candidate routes between the current route and the escort destination, and obtaining current road condition information corresponding to each candidate route; determining at least one route to be evaluated from the multiple candidate routes, and determining a corresponding safety risk value based on the current road condition information corresponding to each route to be evaluated; and determining the route to be passed corresponding to the lowest safety risk value as the route to be passed, until the destination of the route to be passed becomes the escort destination. Furthermore, if the safety risk value is not greater than a preset threshold, the escort route is determined to be the optimal driving route.

[0120] The road condition information includes: construction section information, traffic volume, average speed of the section, and the remaining escort section includes: multiple escort sub-sections. The section to be evaluated is the next candidate section corresponding to the current section.

[0121] S605. Determine whether the optimal driving route is consistent with the remaining escort sections; if the optimal driving route is inconsistent with the remaining escort sections, execute the following step S606; if the optimal driving route is consistent with the remaining escort sections, execute the following step S607.

[0122] Specifically, after obtaining the optimal driving route, determine whether the optimal driving route is consistent with the remaining escort sections. If the optimal driving route is inconsistent with the remaining escort sections, update the escort route to the optimal driving route, and complete the optimization update of the escort route so that the escort vehicle completes the escort task according to the optimal driving route; if the optimal driving route is consistent with the remaining escort sections, there is no need to update the escort route.

[0123] After obtaining the optimal driving route, the method determines whether the optimal driving route is consistent with the remaining escort sections. Combined with the following steps S606 and S607, the dynamic optimization of the escort route is completed, thereby improving the escort efficiency while ensuring escort safety.

[0124] S606: Update the escort route to the optimal driving route.

[0125] Specifically, when the optimal driving route is inconsistent with the remaining escort sections, the escort route is updated to the optimal driving route so that the escort vehicle completes the escort mission according to the optimal driving route, thereby improving the escort efficiency while ensuring escort safety.

[0126] S607: Generate alarm information based on the safety risk value and the road condition information corresponding to the remaining escort road section.

[0127] Specifically, when the optimal driving route is consistent with the remaining escort sections, an alarm message is generated based on the safety risk value and the road condition information corresponding to the remaining escort sections to promptly remind backend management personnel that the current escort route has a high risk value, which in turn helps staff take corresponding measures to deal with escort risks.

[0128] S608: Determine the escort route as the optimal driving route.

[0129] The judgment result of the above step S603 indicates that: when the safety risk value is not greater than the preset threshold, it means that the safety risk value of the current escort route meets the requirements of the escort task. Therefore, there is no need to replan the escort route, and the above escort route is the optimal driving route.

[0130] The cargo escort method provided in this embodiment obtains driving data from the escort vehicle and, based on environmental data and road condition information for the remaining escorted sections, assesses the safety risk value of the escort route. It then determines whether the safety risk value is greater than a preset threshold. If the safety risk value is not greater than the preset threshold, the escort route is determined to be the optimal driving route. Furthermore, if the safety risk value is greater than the preset threshold, it determines whether the optimal driving route is consistent with the remaining escorted sections. If the optimal driving route is consistent with the remaining escorted sections, the escort route is updated to the optimal driving route, completing the optimization and update of the escort route. If the optimal driving route is inconsistent with the remaining escorted sections, a safety alert is generated based on the safety risk value and road condition information corresponding to the remaining escorted sections, providing timely feedback on potential risks that cannot be avoided during the escort process. This allows relevant personnel to take countermeasures based on the safety alert, thereby improving the safety of the escort process. Furthermore, the optimal driving route is planned based on road condition information and environmental data, taking into account both escort efficiency and escort safety. The escort mission is executed according to the optimal driving route, thereby improving both escort efficiency and escort safety.

[0131] Figure 7 The structural diagram of the cargo escort device provided for this application is as follows: Figure 7 As shown, the cargo escort device 70 provided in this embodiment includes:

[0132] The acquisition module 701 is used to collect in-vehicle video data of the escort vehicle when the escort vehicle performs the escort mission according to the escort route. The in-vehicle video data is used to display the status of the cargo and the status of the escort personnel;

[0133] A judgment module 702 is used to judge whether the cargo status and the escort status are in an abnormal escort state respectively;

[0134] The generating module 703 is configured to generate an alarm message based on the abnormal escort status when the cargo status and / or the escort personnel status are in an abnormal escort status.

[0135] In a possible implementation, the apparatus further includes: an acquisition module 704 and a planning module 705;

[0136] The acquisition module 704 is used to acquire an escort request, wherein the escort request includes: an escort task and escort personnel information; the escort task includes: an escort starting point and an escort end point;

[0137] The judgment module 702 is further configured to judge whether the corresponding escort personnel has the qualifications to perform the escort task according to the escort personnel information;

[0138] The acquisition module 704 is further configured to acquire the road information between the escort starting point and the escort end point, and collect the initial status of the escorted goods, if the escort personnel are qualified to perform the escort mission;

[0139] The planning module 705 is used to plan the escort route based on the road information.

[0140] In a possible implementation, the cargo status includes: cargo quantity, cargo appearance, and cargo location; the cargo initial status includes: cargo initial quantity, cargo initial appearance, and cargo initial location; and the apparatus further includes: a determination module 706;

[0141] The judgment module 702 is further configured to judge whether the quantity of the goods is consistent with the initial quantity of the goods, whether the appearance of the goods is in a normal appearance state, and whether the offset between the position of the goods and the initial position of the goods is greater than a preset offset;

[0142] The determining module 706 is configured to determine that the cargo status is in an abnormal escort state if the cargo quantity is inconsistent with the initial cargo quantity, and / or the cargo appearance is not in a normal appearance state, and / or the offset is greater than a preset offset;

[0143] The determining module 706 is further configured to determine that the cargo status is in a normal escort state when the cargo quantity is consistent with the initial cargo quantity, the cargo appearance is in a normal appearance state, and the offset is not greater than a preset offset.

[0144] In a possible implementation, the escort personnel status includes: personnel image data and personnel behavior data; the escort personnel information includes: image registration information;

[0145] The judgment module 702 is further configured to judge whether the personnel image data is consistent with the image registration information, and whether the personnel behavior data conforms to normal escort behavior;

[0146] The determining module 706 is further configured to determine that the escort personnel status is in a normal escort status if the personnel image data is consistent with the image registration information and the personnel behavior data conforms to normal escort behavior;

[0147] The determining module 706 is further configured to determine that the escort personnel status is in an abnormal escort status when the personnel image data is inconsistent with the image registration information and / or the personnel behavior data does not conform to normal escort behavior.

[0148] In a possible implementation, the apparatus further includes: an evaluation module 707 and an update module 708;

[0149] The acquisition module 704 is further configured to acquire the driving data of the escort vehicle, wherein the driving data includes: environmental data, remaining escort sections, and road condition information of the remaining escort sections;

[0150] The evaluation module 707 is configured to evaluate the safety risk value of the escort route based on the environmental data and the road condition information of the remaining escort sections, wherein the remaining escort sections include: multiple sections after the current travel section in the escort route;

[0151] The judgment module 702 is further configured to judge whether the security risk value is greater than a preset threshold;

[0152] The planning module 705 is specifically configured to plan an optimal driving route based on the driving data when the safety risk value is greater than a preset threshold;

[0153] The judgment module 702 is further configured to judge whether the optimal driving route is consistent with the remaining escort route;

[0154] The updating module 708 is configured to update the escort route to the optimal driving route when the optimal driving route is inconsistent with the remaining escort route sections;

[0155] The generating module 703 is further configured to generate an alarm message based on the safety risk value and the road condition information corresponding to the remaining escort section when the optimal driving route is consistent with the remaining escort section.

[0156] In a possible implementation, the road condition information includes: construction section information, traffic volume, and average speed of the section; the remaining escort section includes: multiple escort sub-sections; and the device further includes: a processing module 709;

[0157] The determination module 706 is further configured to determine the environmental risk weight corresponding to the environmental data, and to determine the section risk weight corresponding to the construction section information, traffic volume, and average speed of each escort sub-section;

[0158] The processing module 709 is used to perform superposition processing on the multiple road section risk weights corresponding to each escort sub-section to obtain the corresponding target risk weight;

[0159] The determination module 706 is further configured to determine the safety risk value based on the environmental risk weight and the target risk weight.

[0160] In a possible implementation, the determining module 706 is further configured to determine the current road section of the escort vehicle from the driving data;

[0161] The acquisition module 704 is further configured to acquire multiple candidate road sections between the current road section and the escort destination, and current road condition information corresponding to each candidate road section;

[0162] The determining module 706 is further configured to determine at least one road section to be evaluated from the plurality of candidate road sections, and determine a corresponding safety risk value based on current road condition information corresponding to each road section to be evaluated, wherein the road section to be evaluated is the next candidate road section corresponding to the current road section;

[0163] The determining module 706 is further configured to determine the to-be-assessed road section corresponding to the minimum safety risk value as the to-be-passed road section, until the end point of the to-be-passed road section becomes the escort end point.

[0164] The cargo escort device provided in this embodiment can execute the method provided in the above method embodiment. Its implementation principle and technical effects are similar, and are not described in detail in this embodiment.

[0165] Figure 8 This is a schematic diagram of the structure of the electronic device provided in this application. Figure 8 As shown, the electronic device 80 provided in this embodiment includes: at least one processor 801 and a memory 802. Optionally, the device 80 also includes a communication component 803. The processor 801, the memory 802 and the communication component 803 are connected via a bus 804.

[0166] During the specific implementation process, at least one processor 801 executes the computer-executable instructions stored in the memory 802, so that the at least one processor 801 performs the above method.

[0167] The specific implementation process of the processor 801 can be found in the above method embodiment. Its implementation principle and technical effects are similar and will not be repeated here in this embodiment.

[0168] In the above embodiments, it should be understood that the processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASICs), etc. A general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in the present invention may be directly executed by a hardware processor or by a combination of hardware and software modules within the processor.

[0169] The memory may include random access memory (RAM) and may also include non-volatile memory (NVM), such as at least one disk storage.

[0170] A bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus. Buses can be categorized as address buses, data buses, and control buses. For ease of illustration, the buses in the drawings of this application are not limited to just one bus or just one type of bus.

[0171] The present application also provides a computer program product, including a computer program, which implements the above method when executed by a processor.

[0172] The present application also provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the above method is implemented.

[0173] The readable storage medium may be implemented by any type of volatile or non-volatile memory device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The readable storage medium may be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0174] An exemplary readable storage medium is coupled to a processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be an integral part of the processor. The processor and the readable storage medium can be located in an application specific integrated circuit (ASIC). Of course, the processor and the readable storage medium can also exist in the device as discrete components.

[0175] The division of units is merely a logical functional division; actual implementations may employ alternative divisions, such as combining or integrating multiple units or components into another system, or omitting or disabling certain features. Furthermore, any direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection between devices or units, either through an interface, electrical, mechanical, or other means.

[0176] Units described as separate components may or may not be physically separate, and components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0177] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0178] If a function is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the various embodiments of the method of the present invention. The aforementioned storage medium includes various media that can store program code, such as USB flash drives, mobile hard drives, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical disks.

[0179] Those skilled in the art will appreciate that all or part of the steps in the above-described method embodiments can be implemented using hardware associated with program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0180] It should be noted that for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that this application is not limited by the order of the actions described, because according to this application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all optional embodiments, and the actions and modules involved are not necessarily required by this application.

[0181] It should be further noted that, although the various steps in the flowchart are shown in sequence as indicated by the arrows, these steps are not necessarily performed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps may be performed in other orders. Moreover, at least a portion of the steps in the flowchart may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily performed at the same time, but may be performed at different times. The execution order of these sub-steps or stages is not necessarily to be performed in sequence, but may be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0182] It should be understood that the above-described device embodiments are merely illustrative, and the device of the present application may also be implemented in other ways. For example, the division of units / modules in the above-described embodiments is merely a logical functional division, and actual implementations may employ other division methods. For example, multiple units, modules, or components may be combined or integrated into another system, or some features may be omitted or not implemented.

[0183] In addition, unless otherwise specified, the functional units / modules in the various embodiments of the present application may be integrated into a single unit / module, each unit / module may exist physically separately, or two or more units / modules may be integrated together. The aforementioned integrated units / modules may be implemented in the form of hardware or software program modules.

[0184] If an integrated unit / module is implemented in hardware, the hardware may be digital circuits, analog circuits, etc. The physical implementation of the hardware structure includes, but is not limited to, transistors, memristors, etc. Unless otherwise specified, the processor may be any appropriate hardware processor, such as a CPU, GPU, FPGA, DSP, and ASIC. Unless otherwise specified, the storage unit may be any appropriate magnetic storage medium or magneto-optical storage medium, such as resistive random access memory (RRAM), dynamic random access memory (DRAM), static random access memory (SRAM), enhanced dynamic random access memory (EDRAM), high-bandwidth memory (HBM), hybrid memory cube (HMC), etc.

[0185] If the integrated unit / module is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a memory and includes a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the various embodiments of the present application. The aforementioned memory includes: U disk, read-only memory (ROM), random access memory (RAM), mobile hard disk, magnetic disk, or optical disk, etc., various media that can store program code.

[0186] In the above embodiments, the description of each embodiment has its own emphasis. For parts not described in detail in a particular embodiment, please refer to the relevant description of other embodiments. The technical features of the above embodiments can be combined in any way. To keep the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0187] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present invention that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0188] It should be understood that the present application is not limited to the exact structure described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A cargo escort method, characterized in that: include: When the escort vehicle performs the escort mission according to the escort route, the in-vehicle video data of the escort vehicle is collected, and the in-vehicle video data is used to display the status of the goods and the status of the escort personnel; respectively determining whether the cargo status and the escort personnel status are in an abnormal escort status; In the case where the cargo status and / or the escort personnel status are in an abnormal escort status, an alarm message is generated based on the abnormal escort status.

2. The method according to claim 1, characterized in that Before the escort vehicle performs the escort task according to the escort route, the method further includes: Obtaining an escort request, wherein the escort request includes: an escort task and escort personnel information; the escort task includes: an escort starting point and an escort destination; Determining whether the corresponding escort personnel has the qualifications to perform the escort mission based on the escort personnel information; If the escort personnel are qualified to perform the escort mission, obtain the road information between the escort starting point and the escort end point, and collect the initial status of the escorted goods; The escort route is planned based on the road information.

3. The method according to claim 2, characterized in that The cargo status includes: cargo quantity, cargo appearance and cargo location; the cargo initial status includes: cargo initial quantity, cargo initial appearance and cargo initial location; and determining whether the cargo status is in an abnormal escort state includes: Determining whether the quantity of the goods is consistent with the initial quantity of the goods, whether the appearance of the goods is in a normal appearance state, and whether the offset between the position of the goods and the initial position of the goods is greater than a preset offset; When the quantity of the goods is inconsistent with the initial quantity of the goods, and / or the appearance of the goods is not in a normal appearance state, and / or the offset is greater than a preset offset, it is determined that the state of the goods is in an abnormal escort state; When the quantity of the goods is consistent with the initial quantity of the goods, the appearance of the goods is in a normal appearance state, and the offset is not greater than a preset offset, it is determined that the state of the goods is in a normal escort state.

4. The method according to claim 2 or 3, characterized in that The escort personnel status includes: personnel image data and personnel behavior data; the escort personnel information includes: image registration information, and the judgment of whether the escort personnel status is in an abnormal escort state includes: Determining whether the personnel image data is consistent with the image registration information, and whether the personnel behavior data conforms to normal escort behavior; If the personnel image data is consistent with the image registration information and the personnel behavior data conforms to normal escort behavior, determining that the escort personnel status is in a normal escort status; When the personnel image data is inconsistent with the image registration information, and / or the personnel behavior data does not conform to normal escort behavior, it is determined that the escort personnel status is in an abnormal escort status.

5. The method according to claim 4, characterized in that In the process of the escort vehicle performing the escort task according to the escort route, the method further includes: Acquire driving data of the escort vehicle, the driving data including: environmental data, remaining escort road sections, and road condition information of the remaining escort road sections; Evaluate the safety risk value of the escort route based on the environmental data and the road condition information of the remaining escort sections, wherein the remaining escort sections include: multiple sections after the current travel section in the escort route; Determining whether the security risk value is greater than a preset threshold; When the safety risk value is greater than a preset threshold, planning an optimal driving route based on the driving data; Determining whether the optimal driving route is consistent with the remaining escort route; When the optimal driving route is inconsistent with the remaining escort route, updating the escort route to the optimal driving route; When the optimal driving route is consistent with the remaining escort section, an alarm message is generated based on the safety risk value and the road condition information corresponding to the remaining escort section.

6. The method according to claim 5, characterized in that The road condition information includes: construction section information, traffic volume, and average speed of the section; the remaining escort section includes: multiple escort sub-sections; and the safety risk value of the escort route is evaluated based on the environmental data and the road condition information of the remaining escort sections, including: Determining the environmental risk weight corresponding to the environmental data, and determining the section risk weight corresponding to the construction section information, traffic volume, and average speed of each escort sub-section; Superimposing the multiple road section risk weights corresponding to each of the escort sub-sections to obtain the corresponding target risk weight; The safety risk value is determined based on the environmental risk weight and the target risk weight.

7. The method according to claim 6, characterized in that The planning of the optimal driving route based on the driving data includes: Determining a current road section of the escort vehicle from the driving data, and obtaining a plurality of candidate road sections between the current road section and the escort destination, as well as current road condition information corresponding to each candidate road section; Determining at least one road section to be evaluated from the multiple candidate road sections, and determining a corresponding safety risk value based on current road condition information corresponding to each road section to be evaluated, wherein the road section to be evaluated is the next candidate road section corresponding to the current road section; The road section to be assessed corresponding to the minimum safety risk value is determined as the road section to be passed, until the end point of the road section to be passed becomes the escort end point.

8. A cargo escort device, characterized in that: include: An acquisition module is used to collect in-vehicle video data of the escort vehicle when the escort vehicle performs the escort mission according to the escort route, and the in-vehicle video data is used to display the status of the goods and the status of the escort personnel; A judgment module, used to judge whether the status of the cargo and the status of the escort personnel are in an abnormal escort state respectively; A generating module is used to generate alarm information based on the abnormal escort status when the cargo status and / or the escort personnel status are in an abnormal escort status.

9. An electronic device, characterized in that: include: a processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 7 when executed by a processor.

11. A computer program product, characterized in that The invention comprises a computer program, which implements the method according to any one of claims 1 to 7 when being executed by a processor.

Images