Goods transportation method, order processing method, device and system, medium and equipment
By collecting and analyzing multiple cabin images during the cargo transportation of autonomous vehicles and generating pick-up confirmation results, the problem of insufficient safety and reliability during unmanned delivery is solved, and the completeness and accuracy of cargo transportation is achieved.
Patent Information
- Application Number
- CN202510386612.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-03-28
- Publication Date
- 2025-07-08
AI Technical Summary
In the existing autonomous cargo transportation technology, the lack of effective identity authentication and in-cabin image acquisition means, resulting in insufficient safety and reliability of the unmanned delivery process, and the integrity and accuracy of the cargo during transportation cannot be ensured.
During the cargo transportation process of autonomous driving vehicles, the cargo delivery itinerary, pickup authentication operation, pickup process and in-cabin images after the door is closed are collected through the vehicle terminal, and the vehicle status is generated and sent to the platform end. The platform end generates the pickup confirmation results based on multiple in-cabin images to ensure the integrity of cargo transportation.
It improves the safety and reliability of the unmanned delivery process, avoids empty truck transportation, lost goods in the middle of the journey, and unsuccessful pickup of users, and improves transportation efficiency and safety.
Smart Images

Figure CN120278618A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of autonomous driving technology, and in particular to the fields of intelligent logistics, unmanned delivery, etc. Specifically, the present disclosure relates to a method for transporting goods for a vehicle terminal, a method for processing orders for a platform end, a device, a freight order processing system based on autonomous driving, an electronic device, a computer-readable storage medium, and a computer program product. Background Art
[0002] Autonomous driving technology is currently in a stage of rapid development, and applications at L3 (conditional automation) and L4 (high automation) levels have been achieved. Some enterprises are testing L5 (full automation). Passenger vehicles, commercial vehicles (such as trucks), and specific areas (such as parks, ports) are the main application scenarios. Currently, autonomous driving operation vehicles have carried out pilot operations in some cities, mainly concentrated in restricted areas (such as specific urban roads or parks), and are gradually developing towards fields such as unmanned delivery.
[0003] The methods described in this section are not necessarily methods that have been previously conceived or adopted. Unless otherwise specified, no method described in this section should be considered prior art solely because it is included in this section. Similarly, unless otherwise specified, the problems mentioned in this section should not be considered to have been recognized in any prior art. Summary of the Invention
[0004] The present disclosure provides a method for transporting goods for a vehicle terminal, a method for processing orders for a platform end, a device, a freight order processing system based on autonomous driving, an electronic device, a computer-readable storage medium, and a computer program product.
[0005] According to one aspect of the present disclosure, there is provided a method for cargo transportation for a vehicle terminal, including: receiving indication information indicating a freight transportation process sent by a platform terminal, where the freight transportation process includes a delivery trip and a pick-up authentication operation, and the pick-up authentication operation is used for the identity authentication of the consignee; controlling a target vehicle corresponding to the vehicle terminal to execute the delivery trip; during the execution of the delivery trip, collecting at least one first in-cabin image of a target cabin of the target vehicle; in response to detecting that the target vehicle arrives at the destination of the cargo transportation, executing the pick-up authentication operation; during the pick-up process of the consignee after the pick-up authentication operation is completed, collecting at least one second in-cabin image of the target cabin; in response to detecting that the cabin door has been closed, collecting at least one third in-cabin image of the target cabin; sending a first vehicle state to the platform terminal, where the first vehicle state is used to trigger the platform terminal to send a pick-up confirmation result, and the pick-up confirmation result is generated based on at least one first in-cabin image, at least one second in-cabin image, and at least one third in-cabin image, and the first vehicle state indicates that the cabin door has been closed after the consignee picks up the goods; and obtaining the pick-up confirmation result from the platform terminal to determine whether to end the freight transportation process.
[0006] According to another aspect of the present disclosure, there is provided a method for order processing for a platform terminal, including: in response to receiving a freight order, generating a freight transportation process based on the freight order, where the freight transportation process includes a delivery trip and a pick-up authentication operation, and the pick-up authentication operation is used for the identity authentication of the consignee; sending the indication information indicating the freight transportation process to the vehicle terminal of the target vehicle; in response to receiving the first vehicle state sent by the vehicle terminal, obtaining a plurality of in-cabin images of a target cabin of the target vehicle collected by the vehicle terminal, where the first vehicle state indicates that the cabin door of the target cabin has been closed after the consignee picks up the goods, and the plurality of in-cabin images include at least one first in-cabin image during the execution of the delivery trip, at least one second in-cabin image during the pick-up process of the consignee after the pick-up authentication operation is completed, and at least one third in-cabin image after the cabin door is closed after the pick-up process; and obtaining the pick-up confirmation result based on the plurality of in-cabin images.
[0007] According to another aspect of the present disclosure, there is provided a cargo transportation device for a vehicle terminal, including: a receiving unit configured to receive indication information indicating a freight transportation process sent by a platform terminal, where the freight transportation process includes a delivery trip and a pick-up authentication operation for authenticating the identity of a consignee; a control unit configured to control a target vehicle corresponding to the vehicle terminal to execute the delivery trip; a first acquisition unit configured to acquire at least one first in-cabin image of a target compartment of the target vehicle during the execution of the delivery trip; an execution unit configured to execute the pick-up authentication operation in response to detecting that the target vehicle arrives at the destination of the cargo transportation; a second acquisition unit configured to acquire at least one second in-cabin image of the target compartment during the pick-up process of the consignee after the pick-up authentication operation is completed; a third acquisition unit configured to acquire at least one third in-cabin image of the target compartment in response to detecting that the compartment door has been closed; a sending unit configured to send a first vehicle state to the platform terminal, where the first vehicle state is used to trigger the platform terminal to send a pick-up confirmation result, and the pick-up confirmation result is generated based on at least one first in-cabin image, at least one second in-cabin image, and at least one third in-cabin image, and the first vehicle state indicates that the compartment door has been closed after the consignee picks up the goods; and an obtaining unit configured to obtain the pick-up confirmation result from the platform terminal to determine whether to end the freight transportation process.
[0008] According to one aspect of the present disclosure, there is provided an order processing device for a platform terminal, including: a generating unit configured to generate a freight transportation process based on a freight order in response to receiving the freight order, where the freight transportation process includes a delivery trip and a pick-up authentication operation for authenticating the identity of a consignee; a sending unit configured to send the indication information indicating the freight transportation process to a vehicle terminal of a target vehicle; a first obtaining unit configured to obtain a plurality of in-cabin images of a target compartment of the target vehicle collected by the vehicle terminal in response to receiving a first vehicle state sent by the vehicle terminal, where the first vehicle state indicates that the compartment door of the target compartment has been closed after the consignee picks up the goods, and the plurality of in-cabin images include at least one first in-cabin image during the execution of the delivery trip, at least one second in-cabin image during the pick-up process of the consignee after the pick-up authentication operation is completed, and at least one third in-cabin image after the compartment door is closed after the pick-up process; and a second obtaining unit configured to obtain a pick-up confirmation result based on the plurality of in-cabin images.
[0009] According to another aspect of the present disclosure, there is provided an autonomous driving-based freight order processing system, including: a vehicle terminal configured to execute the cargo transportation method for a vehicle terminal of the present disclosure; and a platform terminal configured to execute the order processing method for a platform terminal of the present disclosure.
[0010] According to another aspect of the present disclosure, there is provided an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the goods transportation method for a vehicle terminal or the order processing method for a platform end of the present disclosure.
[0011] According to another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer to execute the goods transportation method for a vehicle terminal or the order processing method for a platform end of the present disclosure.
[0012] According to another aspect of the present disclosure, there is provided a computer program product, including a computer program, wherein the computer program, when executed by a processor, implements the goods transportation method for a vehicle terminal or the order processing method for a platform end of the present disclosure.
[0013] It should be understood that the content described in this part is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it used to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] The drawings exemplarily illustrate embodiments and form a part of the specification, and are used together with the written description of the specification to explain the exemplary implementation manners of the embodiments. The illustrated embodiments are only for illustrative purposes and do not limit the scope of the claims. In all the drawings, the same reference numerals refer to similar but not necessarily identical elements.
[0015] Figure 1 A schematic diagram of an exemplary system in which the various methods described herein can be implemented according to an embodiment of the present disclosure is shown;
[0016] Figure 2 A flowchart of a goods transportation method for a vehicle terminal according to an embodiment of the present disclosure is shown;
[0017] Figure 3 A flowchart of an order processing method for a platform end according to an embodiment of the present disclosure is shown;
[0018] Figure 4 A flowchart of a pick-up authentication operation according to an embodiment of the present disclosure is shown;
[0019] Figure 5 A flowchart of a goods transportation method for a vehicle terminal according to an embodiment of the present disclosure is shown;
[0020] Figure 6Shows a flowchart of an order processing method for the platform side according to an embodiment of the present disclosure;
[0021] Figure 7 Shows a flowchart of a shipping certification operation according to an embodiment of the present disclosure;
[0022] Figure 8 Shows a schematic diagram of a freight transportation process according to an exemplary embodiment of the present disclosure;
[0023] Figure 9 Shows a flowchart of executing a freight transportation process according to an exemplary embodiment of the present disclosure;
[0024] Figure 10 Shows a flowchart of storing images in a storage compartment according to an embodiment of the present disclosure;
[0025] Figure 11 Shows a flowchart of obtaining images inside the compartment according to an exemplary embodiment of the present disclosure;
[0026] Figure 12 Shows a structural block diagram of a cargo transportation device for a vehicle terminal according to an embodiment of the present disclosure;
[0027] Figure 13 Shows a structural block diagram of an order processing device for the platform side according to an embodiment of the present disclosure;
[0028] Figure 14 Shows a structural block diagram of an autonomous driving-based freight order processing system according to an embodiment of the present disclosure;
[0029] Figure 15 Shows a structural block diagram of an exemplary electronic device that can be used to implement the embodiments of the present disclosure. Detailed Embodiments
[0030] The following describes exemplary embodiments of the present disclosure with reference to the accompanying drawings. Various details of the embodiments of the present disclosure are included to assist in understanding, and they should be considered merely exemplary. Therefore, those of ordinary skill in the art should recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.
[0031] In the present disclosure, unless otherwise specified, the terms "first", "second", etc. are used to describe various elements and are not intended to limit the positional relationship, timing relationship, or importance relationship of these elements. Such terms are only used to distinguish one element from another. In some examples, the first element and the second element may refer to the same instance of the element, and in certain cases, based on the context description, they may also refer to different instances.
[0032] In the description of the various examples in this disclosure, the terms used are for the purpose of describing particular examples only and are not intended to be limiting. Unless the context clearly indicates otherwise, an element may be one or more if the number of the element is not specifically limited. In addition, the term "and / or" used in this disclosure covers any and all possible combinations of the listed items.
[0033] Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.
[0034] Figure 1 FIG. shows a schematic diagram of an exemplary system 100 in which the various methods and apparatuses described herein may be implemented according to embodiments of the present disclosure. Referring Figure 1 thereto, the system 100 includes a motor vehicle 110, a server 120, and one or more communication networks 130 that couple the motor vehicle 110 to the server 120.
[0035] In an embodiment of the present disclosure, the motor vehicle 110 may include a computing device according to an embodiment of the present disclosure and / or be configured to execute a method according to an embodiment of the present disclosure.
[0036] The server 120 may run one or more services or software applications that enable the implementation of the goods transportation method for the vehicle terminal or the order processing method for the platform side of the present disclosure. In certain embodiments, the server 120 may also provide other services or software applications, which may include non-virtual environments and virtual environments. In Figure 1 the configuration shown, the server 120 may include one or more components that implement the functions performed by the server 120. These components may include software components, hardware components, or a combination thereof that may be executed by one or more processors. A user of the motor vehicle 110 may sequentially utilize one or more client applications to interact with the server 120 to utilize the services provided by these components. It should be understood that various different system configurations are possible, which may be different from the system 100. Therefore, Figure 1 is an example of a system for implementing the various methods described herein and is not intended to be limiting.
[0037] Server 120 may include one or more general-purpose computers, dedicated server computers (such as PC (Personal Computer) servers, UNIX servers, midrange servers), blade servers, mainframe computers, server clusters, or any other suitable arrangement and / or combination. Server 120 may include one or more virtual machines running a virtual operating system, or other computing architectures involving virtualization (such as one or more flexible pools of logical storage devices that can be virtualized to maintain virtual storage devices of the server). In various embodiments, server 120 may run one or more services or software applications that provide the functions described below.
[0038] The computing units in server 120 may run one or more operating systems including any of the above operating systems as well as any commercially available server operating systems. Server 120 may also run any one of a variety of additional server applications and / or middleware applications, including HTTP servers, FTP servers, CGI servers, JAVA servers, database servers, etc.
[0039] In some implementations, server 120 may include one or more applications to analyze and merge data feeds and / or event updates received from motor vehicle 110. Server 120 may also include one or more applications to display data feeds and / or real-time events via one or more display devices of motor vehicle 110.
[0040] Network 130 may be any type of network known to those skilled in the art, which may support data communication using any one of a variety of available protocols (including but not limited to TCP / IP, SNA, IPX, etc.). By way of example only, one or more networks 110 may be a satellite communication network, a local area network (LAN), an Ethernet-based network, token ring, a wide area network (WAN), the Internet, a virtual network, a virtual private network (VPN), an intranet, an extranet, a blockchain network, a public switched telephone network (PSTN), an infrared network, a wireless network (including for example Bluetooth, WiFi), and / or any combination of these with other networks.
[0041] System 100 may also include one or more databases 150. In some embodiments, these databases can be used to store data and other information. For example, one or more of the databases 150 can be used to store information such as audio files and video files. The data repositories 150 can reside in various locations. For example, a data repository used by the server 120 can be local to the server 120, or can be remote from the server 120 and can communicate with the server 120 via a network-based or dedicated connection. The data repositories 150 can be of different types. In some embodiments, the data repositories used by the server 120 can be databases, such as relational databases. One or more of these databases can store, update, and retrieve data to and from the database in response to commands.
[0042] In some embodiments, one or more of the databases 150 can also be used by applications to store application data. The databases used by applications can be different types of databases, such as key-value repositories, object repositories, or conventional repositories supported by a file system.
[0043] The motor vehicle 110 may include sensors 111 for sensing the surrounding environment. The sensors 111 may include one or more of the following sensors: visual cameras, infrared cameras, ultrasonic sensors, millimeter-wave radars, and lidar (LiDAR). Different sensors can provide different detection accuracies and ranges. The cameras can be mounted in the front, rear, or other positions of the vehicle. The visual cameras can capture the situation inside and outside the vehicle in real time and present it to the driver and / or passengers. In addition, by analyzing the images captured by the visual cameras, information such as traffic signal indications, intersection situations, and the operating states of other vehicles can be obtained. The infrared cameras can capture objects in night vision conditions. The ultrasonic sensors can be mounted around the vehicle and are used to measure the distance between the vehicle and external objects by taking advantage of the strong directivity of ultrasonic waves. The millimeter-wave radars can be mounted in the front, rear, or other positions of the vehicle and are used to measure the distance between the vehicle and external objects by using the characteristics of electromagnetic waves. The lidar can be mounted in the front, rear, or other positions of the vehicle and is used to detect object edge and shape information for object recognition and tracking. Due to the Doppler effect, the radar device can also measure the speed change between the vehicle and moving objects.
[0044] The motor vehicle 110 may also include a communication device 112. The communication device 112 may include a satellite positioning module capable of receiving satellite positioning signals (e.g., Beidou, GPS, GLONASS, and GALILEO) from satellites 141 and generating coordinates based on these signals. The communication device 112 may also include a module for communicating with a mobile communication base station 142. The mobile communication network may implement any suitable communication technology, such as current or evolving wireless communication technologies like GSM / GPRS, CDMA, LTE, etc. (e.g., 5G technology). The communication device 112 may also have a vehicle networking or vehicle-to-everything (V2X) module configured to enable vehicle-to-vehicle (V2V) communication with other vehicles 143 and vehicle-to-infrastructure (V2I) communication with infrastructure 144, for example. Additionally, the communication device 112 may have a module configured to communicate with a user terminal 145 (including but not limited to a smart phone, a tablet computer, or a wearable device such as a watch) via a wireless local area network or Bluetooth using the IEEE802.11 standard, for example. With the communication device 112, the motor vehicle 110 may also access the server 120 via the network 130.
[0045] The motor vehicle 110 may also include a control device 113. The control device 113 may include a processor communicating with various types of computer-readable storage devices or media, such as a central processing unit (CPU) or a graphics processing unit (GPU), or other dedicated processors, etc. The control device 113 may include an autonomous driving system for automatically controlling various actuators in the vehicle. The autonomous driving system is configured to control the power train, steering system, and braking system, etc. (not shown) of the motor vehicle 110 via a plurality of actuators in response to inputs from a plurality of sensors 111 or other input devices to control acceleration, steering, and braking respectively, without human intervention or with limited human intervention. Some of the processing functions of the control device 113 may be implemented by cloud computing. For example, some processing may be performed using an in-vehicle processor, while other processing may utilize computing resources in the cloud. The control device 113 may be configured to execute the methods according to the present disclosure. Additionally, the control device 113 may be implemented as an example of a computing device on the motor vehicle side (client side) according to the present disclosure.
[0046] Figure 1 The system 100 may be configured and operated in various ways to enable the application of the various methods and devices described according to the present disclosure.
[0047] According to an embodiment of the present disclosure, as Figure 2As shown, a cargo transportation method for a vehicle terminal is provided, including: Step S201, receiving indication information sent by the platform terminal indicating a freight transportation process, where the freight transportation process includes a delivery trip and a pick-up authentication operation, and the pick-up authentication operation is used for the identity authentication of the consignee; Step S202, controlling a target vehicle corresponding to the vehicle terminal to execute the delivery trip; Step S203, during the execution of the delivery trip, collecting at least one first in-cabin image of a target compartment of the target vehicle; Step S204, in response to detecting that the target vehicle arrives at the destination of the cargo transportation, executing the pick-up authentication operation; Step S205, during the consignee's pick-up process after the pick-up authentication operation is completed, collecting at least one second in-cabin image of the target compartment; Step S206, in response to detecting that the hatch door has been closed, collecting at least one third in-cabin image of the target compartment; Step S207, sending a first vehicle status to the platform terminal, where the first vehicle status is used to trigger the platform terminal to send a pick-up confirmation result, and the pick-up confirmation result is generated based on at least one first in-cabin image, at least one second in-cabin image, and at least one third in-cabin image, and the first vehicle status indicates that the hatch door has been closed after the consignee picks up the goods; and Step S208, obtaining the pick-up confirmation result from the platform terminal to determine whether to end the freight transportation process.
[0048] Thus, by enabling the vehicle terminal to collect in-cabin images at each key stage during the execution of the freight transportation process (including the stage of executing the delivery trip, the stage of the consignee picking up the goods, and the stage after the pick-up is completed), and by reporting the vehicle status after the consignee picks up the goods, triggering the platform terminal to confirm the entire freight transportation process based on the in-cabin images of the above-mentioned stages, and determining whether to end the freight transportation process at the vehicle terminal based on the confirmation result, the safety and reliability of the unmanned delivery process can be improved.
[0049] In some embodiments, the target vehicle may be an autonomous vehicle, such as a passenger car, a bus, or a truck with autonomous driving capabilities. The target compartment may be the passenger compartment or the cargo compartment of the autonomous vehicle (such as the trunk or the cargo hold of the truck), and correspondingly, the hatch door of the target compartment may be the door of the passenger compartment or the hatch door of the cargo compartment (such as the trunk lid or the compartment door of the cargo hold).
[0050] In some embodiments, the vehicle terminal of the target vehicle may be the vehicle's total service module of the target vehicle, which can be used to communicate with the platform terminal and control the target vehicle by invoking the corresponding modules in the target vehicle.
[0051] In some exemplary application scenarios, such as in the unmanned delivery scenario, after the user places the goods in the target compartment, the user can submit a freight order to the platform end through their client. Among them, the freight order may include the destination information of the goods transportation. After receiving the freight order, the platform end can generate an indication information indicating the freight process based on the freight order, which is used to send to the vehicle terminal of the target vehicle and executed by the vehicle terminal for the freight process.
[0052] In some embodiments, the generated freight process may include at least one trip and at least one operation with a certain order to be executed by the vehicle terminal.
[0053] In some embodiments, the freight process may include a delivery trip and a pick-up authentication operation. Among them, the delivery trip may include the destination information of the goods transportation, and the pick-up authentication operation may be used for the identity authentication of the consignee.
[0054] Among them, after receiving the above indication information, the vehicle terminal can start to execute the delivery trip. During the execution of the delivery trip, the vehicle terminal can control the target vehicle to drive from its current location to the destination of the goods transportation by invoking the module related to the autonomous driving ability of the target vehicle, and during the driving process, it can take the first in-compartment image by invoking the camera device in the target compartment.
[0055] In some embodiments, during the driving process, it can be taken once every preset time interval until the delivery trip is completed. In some embodiments, during the driving process, it can be taken once every preset time interval until the delivery trip is completed, and at the same time, it is taken once at the start and end of the trip respectively.
[0056] In some embodiments, in response to detecting that the target vehicle has reached the above destination, the delivery trip can be ended and the pick-up authentication operation can be started. The pick-up authentication operation is used for the identity authentication of the consignee.
[0057] In some embodiments, the vehicle terminal can provide an identity authentication interface to the consignee. For example, it can display an identity authentication entry (such as a QR code, an identity authentication information input area, etc.) to the consignee through the vehicle's outer screen; or for another example, it can perform face recognition on the consignee through the camera device outside the vehicle for identity authentication. In response to the consignee passing the above identity authentication, the hatch of the target compartment can be unlocked to complete the pick-up authentication operation.
[0058] After the vehicle terminal detects that the consignee opens the hatch through the hatch sensor, it can automatically call the camera device in the target compartment to capture the second in-compartment image. In some embodiments, at least one second in-compartment image can be captured for the target compartment after the hatch is opened. In some embodiments, it can also be captured once every preset time interval after the hatch is opened until the hatch is closed again.
[0059] After the vehicle terminal detects that the hatch is closed again, it can call the camera device in the target compartment to capture the third in-compartment image of the interior of the target compartment again.
[0060] In some embodiments, the in-compartment images in the above three stages can be sent to the platform end in real time after being collected.
[0061] In some embodiments, the in-compartment images in the above three stages can also be temporarily stored in the vehicle terminal after being collected, and sent to the platform end together when sending the first vehicle state to the platform end, or transmitted to the platform end after receiving the in-compartment picture acquisition request from the platform end.
[0062] In some embodiments, the in-compartment images in the above three stages can also be stored in the object storage server after being collected, and then the platform end can obtain them from the object storage server.
[0063] After the hatch is closed again, the vehicle terminal can send the current first vehicle state (that is, the state where the hatch is closed again after the consignee picks up the goods) to the platform end, so as to trigger the platform end to send the pick-up confirmation result to the vehicle terminal.
[0064] Among them, the pick-up confirmation result is generated based on the above in-compartment images after the platform end obtains the first in-compartment image, the second in-compartment image, and the third in-compartment image collected in the above respective stages.
[0065] In some embodiments, the generation of the above pick-up confirmation result can be to input the above in-compartment images into a pre-trained neural network model, so that the model analyzes the above in-compartment images and outputs the pick-up confirmation result.
[0066] In some embodiments, the generation of the above pick-up confirmation result can also be to input the above in-compartment images together with the prompt text into a large model, so that the large model analyzes each in-compartment image under the guidance of the prompt text and outputs the pick-up confirmation result.
[0067] In some embodiments, the above pick-up confirmation result can also be obtained through manual confirmation. For example, when the first in-compartment image contains the image of the goods, the second in-compartment image contains the image of the consignee's pick-up process, and the third in-compartment image does not contain the image of the goods, it is considered that the consignee has successfully picked up the goods.
[0068] Thus, by confirming the entire process of the delivery process, situations such as empty vehicle transportation, loss of goods during transit, unsuccessful or partial pickup by the user are avoided, enhancing the safety and reliability of unmanned delivery.
[0069] In some embodiments, after obtaining the above pickup confirmation result, in response to the pickup confirmation result indicating that the consignee has successfully picked up the goods, the platform side can mark the freight order as completed.
[0070] In some embodiments, after obtaining the above pickup confirmation result, the platform side can send the above pickup confirmation result to the vehicle terminal.
[0071] In response to receiving the above pickup confirmation result sent by the platform side, the vehicle terminal can end the current freight process. After ending the current freight process, the vehicle can, for example, go to the parking lot or initiate the freight process corresponding to the next freight order. The vehicle terminal can also directly end the current freight process without waiting for the pickup confirmation result sent by the platform side to improve the delivery efficiency.
[0072] Thus, by enabling the vehicle terminal to collect in-cabin images at various key stages during the execution of the freight process (including the stage of executing the delivery trip, the stage of the consignee picking up the goods, and the stage after the pickup is completed), and by reporting the vehicle status after the consignee picks up the goods, triggering the platform side to confirm the entire freight process based on the in-cabin images at the above various stages, and determining whether to end the freight process at the vehicle side based on the confirmation result, the safety and reliability of the unmanned delivery process can be enhanced.
[0073] In some embodiments, in response to the pickup confirmation result indicating that the consignee has not successfully picked up the goods (for example, the goods are still in the target cabin as shown in the third in-cabin image), the platform side can generate an exception handling work order and assign it to relevant ground crew for exception elimination, or send a corresponding prompt message to the consignee to prompt the consignee to complete the pickup.
[0074] In some embodiments, after obtaining the above pickup confirmation result, the platform side can send the above pickup confirmation result to the vehicle terminal.
[0075] In response to receiving the pickup confirmation result indicating that the consignee has not successfully picked up the goods, the vehicle terminal does not end the current freight process to continue waiting for the handling by relevant ground crew or for the consignee to continue picking up the goods. In response to the vehicle terminal being taken over by relevant ground crew, or in response to receiving the pickup confirmation result indicating that the consignee has successfully picked up the goods after the consignee picks up the goods again, the vehicle terminal can end the current freight process.
[0076] In some embodiments, the freight transportation process may include a delivery trip, a pick-up authentication operation, and a pick-up confirmation operation. Among them, the delivery trip and the pick-up authentication operation are similar to those described above. The pick-up confirmation operation can be initiated after the pick-up authentication operation ends and may include multiple service actions such as detecting and reporting the vehicle status and obtaining the pick-up confirmation result. Thus, by splitting the freight transportation process to be executed by the vehicle terminal into at least one trip and multiple operations, and each trip and operation includes one or more service actions to be executed by the vehicle terminal with an execution order, the autonomy of the vehicle terminal can be greatly improved, and the efficiency of unmanned cargo transportation can be enhanced.
[0077] In some embodiments, as Figure 3 shown, there is provided an order processing method for a platform side, including: Step S301, in response to receiving a freight order, generating a freight transportation process based on the freight order, where the freight transportation process includes a delivery trip and a pick-up authentication operation, and the pick-up authentication operation is used for the identity authentication of the consignee; Step S302, sending indication information indicating the freight transportation process to the vehicle terminal of the target vehicle; Step S303, in response to receiving the first vehicle status sent by the vehicle terminal, obtaining multiple in-cabin images of the target compartment of the target vehicle collected by the vehicle terminal, where the first vehicle status indicates that the compartment door of the target compartment has been closed after the consignee picks up the goods, and the multiple in-cabin images include at least one first in-cabin image during the execution of the delivery trip, at least one second in-cabin image during the consignee's pick-up process after the pick-up authentication operation is completed, and at least one third in-cabin image after the compartment door is closed after the pick-up process; and Step S304, obtaining a pick-up confirmation result based on the multiple in-cabin images.
[0078] Thus, by enabling the vehicle terminal to collect in-cabin images at each key stage during the execution of the freight transportation process (including the stage of executing the delivery trip, the stage of the consignee picking up the goods, and the stage after the pick-up is completed), and triggering the platform side to confirm the entire freight transportation process based on the in-cabin images of the above-mentioned stages by reporting the vehicle status after the consignee picks up the goods, the safety and reliability of the unmanned delivery process can be improved.
[0079] Among them, the above operations performed by the platform side are similar to the operations of the platform side described above and will not be elaborated here.
[0080] In some embodiments, as Figure 4 shown, the above pick-up authentication operation performed by the vehicle terminal may include: Step S401, providing an identity authentication interface for the consignee; Step S402, starting to time after the pick-up authentication operation is initiated to obtain the first waiting duration for waiting for the consignee to perform identity authentication; and Step S403, unlocking the compartment door in response to the first waiting duration not exceeding the first preset duration and the consignee passing the identity authentication based on the identity authentication interface.
[0081] After the delivery trip ends and the pick-up authentication operation is initiated, the pick-up authentication timing can start. And in response to the first waiting duration not exceeding the first preset duration, and for the object storage service and the consignee passing the identity authentication, the hatch door of the target compartment is unlocked. Among them, providing an identity authentication interface for the consignee can be implemented in a similar manner as described above, which will not be elaborated here.
[0082] Thus, by performing pick-up authentication timing during the pick-up authentication phase, it is possible to avoid the vehicle waiting for a long time, ensure the safety of vehicle docking, and improve the efficiency of the overall freight transportation process.
[0083] In some embodiments, the above pick-up authentication operation may further include: in response to receiving a waiting instruction sent by the platform end within a second preset duration after the pick-up authentication operation is initiated, controlling the target vehicle to drive on the road within a preset range around the destination and return to the destination within a third preset duration, where the waiting instruction is generated based on a waiting request issued by the consignee; and restarting the timing of the first waiting duration.
[0084] Thus, in response to receiving the consignee's waiting instruction, controlling the target vehicle to drive around the destination (for example, controlling the target vehicle to drive in circles around the destination) and return to the destination to restart the authentication waiting timing within a specified time (for example, within the third preset duration), thereby ensuring the safety of vehicle docking and providing the user with the ability to pick up the package later, improving the user experience.
[0085] In some embodiments, the vehicle terminal can control the camera device in the target compartment to continue taking in-cabin images during the process of controlling the target vehicle to drive around the destination, and at the time of pick-up confirmation, also use this part of the in-cabin images as reference information for obtaining the pick-up confirmation result, thereby further improving the safety and reliability of the delivery process.
[0086] In some embodiments, the above pick-up authentication operation may further include: in response to the consignee not performing identity authentication after the first waiting duration exceeds the first preset duration, reporting a pick-up authentication timeout event to the platform end. Thus, by performing pick-up authentication timing during the pick-up authentication phase, it is possible to report pick-up authentication anomalies in a timely manner and improve the efficiency of handling abnormal events.
[0087] In some embodiments, such as Figure 5As shown, the freight transportation process may further include a pick-up trip, a shipping authentication operation, and a shipping confirmation operation. The above-mentioned method for transporting goods using a vehicle terminal may further include: Step S501, before controlling the target vehicle to execute a delivery trip, controlling the target vehicle to execute a pick-up trip; Step S502, during the execution of the pick-up trip, collecting at least one fourth in-cabin image of the target compartment; Step S503, in response to detecting that the target vehicle arrives at the shipping location of the goods transportation, performing a shipping authentication operation, where the shipping authentication operation is used for the identity authentication of the shipper; Step S504, during the process of placing the goods into the target compartment after the shipping authentication operation is completed, collecting at least one fifth in-cabin image of the target compartment; Step S505, performing a shipping confirmation operation, where the shipping confirmation operation may include: sending a second vehicle status to the platform side, where the second vehicle status is used to trigger the platform side to send a first shipping confirmation result, and the first shipping confirmation result is generated based on at least one fourth in-cabin image and at least one fifth in-cabin image. The second vehicle status indicates that the cabin door has been closed after the shipper places the goods into the target compartment, and the first shipping confirmation result is used to indicate whether the goods have been successfully loaded into the target compartment; and in response to receiving the first shipping confirmation result sent by the platform side, and the first shipping confirmation result indicates that the goods have been successfully loaded into the target compartment, starting the delivery trip.
[0088] In some embodiments, the freight transportation process may further include a pick-up trip, a shipping authentication operation, and a shipping confirmation operation before the delivery trip. In some exemplary application scenarios, such as in a goods delivery scenario based on an autonomous vehicle, the user can submit a freight order including a pick-up address and a goods transportation destination to the platform side through the client. After receiving the freight order, the platform side can generate a freight transportation process for sending to the vehicle terminal of the target vehicle and executed by the vehicle terminal based on the freight order. The freight transportation process may include a pick-up trip, a shipping authentication operation, a shipping confirmation operation, a delivery trip, and a pick-up confirmation operation.
[0089] Among them, the pick-up trip may include the shipping location of the goods, and the shipping authentication operation may be used for the identity authentication of the shipper.
[0090] After receiving the instruction information indicating the above-mentioned freight transportation process, the vehicle terminal first executes the pick-up trip. By calling the module related to the autonomous driving ability of the target vehicle, it controls the target vehicle to drive from its current location to the shipping location determined by the user, and during the driving process, it collects the fourth in-cabin image by calling the camera device in the target compartment.
[0091] In some embodiments, the collection of the fourth in-cabin image may be to collect one fourth in-cabin image in response to the start of the pick-up trip. In some embodiments, it may also be to collect the fourth in-cabin image once every preset time interval in response to the start of the pick-up trip until the pick-up trip ends.
[0092] In some embodiments, in response to detecting that the target vehicle has reached the place of dispatch, the pick-up trip can be ended and the shipping authentication operation can be initiated. Among them, the shipping authentication operation is used for the identity authentication of the shipper.
[0093] In some embodiments, the vehicle terminal can provide an identity authentication interface to the shipper. The identity authentication interface of the shipper is similar to the identity authentication interface of the consignee described above and will not be elaborated here. In response to the shipper passing the identity authentication, the hatch door of the target compartment can be unlocked to complete the shipping authentication operation.
[0094] After the vehicle terminal detects through the hatch door sensor that the shipper has opened the hatch door, it can automatically call the camera device in the target compartment to take the fifth in-compartment image. In some embodiments, at least one fifth in-compartment image can be taken of the target compartment after the hatch door is opened. In some embodiments, it can also be taken once every preset time interval after the hatch door is opened until the hatch door is closed again.
[0095] In some embodiments, the in-compartment images in the above two stages can be sent to the platform end in real time after being collected.
[0096] In some embodiments, the in-compartment images in the above two stages can also be temporarily stored in the vehicle terminal after being collected and sent to the platform end together when sending the second vehicle state to the platform end, or transmitted to the platform end after receiving the in-compartment picture acquisition request from the platform end.
[0097] In some embodiments, the in-compartment images in the above two stages can also be stored in the object storage server after being collected, and then the platform end can obtain them from the object storage server.
[0098] After the hatch door is closed again, the vehicle terminal can send the current second vehicle state (that is, the state after the hatch door is closed again after the shipper puts the goods into the target compartment) to the platform end, which is used to trigger the platform end to send the first shipping confirmation result to the vehicle terminal.
[0099] Among them, the first shipping confirmation result is generated based on the fourth in-compartment image and the fifth in-compartment image collected in the above stages after the platform end obtains them.
[0100] In some embodiments, the generation of the first shipping confirmation result can be to input the above in-compartment images into a pre-trained neural network model, so that the model analyzes the above in-compartment images and outputs the first shipping confirmation result.
[0101] In some embodiments, the generation of the first shipment confirmation result may also be to input the above-mentioned in-cabin images together with the prompt text into a large model, so that the large model analyzes each in-cabin image under the guidance of the prompt text and outputs the first shipment confirmation result.
[0102] In some embodiments, the first shipment confirmation result can also be obtained through manual confirmation. For example, when the fourth in-cabin image does not contain a cargo image and the fifth in-cabin image contains an image of the shipper putting the cargo into the vehicle, it is considered that the cargo has been successfully loaded into the target compartment.
[0103] In some embodiments, after obtaining the above first shipment confirmation result, in response to the first shipment confirmation result indicating that the cargo has been successfully loaded into the target compartment, the platform side can send this confirmation result to the vehicle terminal. After the vehicle terminal obtains this confirmation result, it can end the shipment confirmation operation and start the delivery trip.
[0104] Thus, when the freight transportation process further includes a receiving process, by further enabling the vehicle terminal to collect in-cabin images at each key stage during the execution of the receiving process (including the stage of executing the receiving trip and the stage of the shipper putting the cargo into the vehicle), and triggering the platform side to confirm the entire freight transportation process based on the in-cabin images at each of the above stages by reporting the vehicle status after the shipper puts the cargo in, the safety and reliability of the shipping process can be improved, and thus the safety and reliability of the overall freight transportation process can be improved.
[0105] In some embodiments, in response to the first shipment confirmation result indicating that the cargo has not been successfully loaded into the target compartment (for example, the fifth in-cabin image does not show that the cargo has been placed in the target compartment), an exception handling work order can be generated and assigned to relevant personnel for exception troubleshooting.
[0106] In some embodiments, the first shipment confirmation result is also used to indicate whether the placed cargo belongs to a specific category of items (such as prohibited items). Accordingly, when the vehicle terminal receives the first shipment confirmation result, and the first shipment confirmation result indicates that the cargo has been successfully loaded into the target compartment and the cargo does not belong to a specific category of items, it can end the shipment confirmation operation and start the delivery trip. Thus, the safety during the automated shipment process of the cargo can be further improved.
[0107] In some embodiments, such as Figure 6As shown, the freight transportation process may further include a pick-up trip, a shipping authentication operation, and a shipping confirmation operation. The shipping authentication operation is used for authenticating the identity of the shipper, and the shipping confirmation operation is used for determining whether to initiate a delivery trip. The above-mentioned order processing method for the platform side may further include: Step S601, in response to receiving a second vehicle status sent by the vehicle terminal, obtaining at least one fourth in-cabin image and at least one fifth in-cabin image of the target cockpit collected by the vehicle terminal. Among them, the second vehicle status indicates that the hatch has been closed after the shipper has placed the goods in the target compartment. At least one fourth in-cabin image is collected during the execution of the pick-up trip, and at least one fifth in-cabin image is collected during the process of the shipper placing the goods in the target compartment after the shipping authentication operation is completed; Step S602, based on at least one fourth in-cabin image and at least one fifth in-cabin image, obtaining a shipping confirmation result, where the shipping confirmation result is used to indicate whether the goods have been successfully loaded into the target compartment; and Step S603, sending the shipping confirmation result to the vehicle terminal, and the shipping confirmation result is used to complete the shipping confirmation operation.
[0108] Thus, when the freight transportation process further includes a pick-up process, by further enabling the vehicle terminal to collect in-cabin images at each key stage during the execution of the pick-up process (including the stage of executing the pick-up trip and the stage of the shipper placing the goods in the vehicle), and triggering the platform side to confirm the entire freight transportation process based on the in-cabin images at the above-mentioned various stages by reporting the vehicle status after the shipper places the goods, the safety and reliability of the shipping process can be improved, and further the safety and reliability of the overall freight transportation process can be improved.
[0109] Among them, the above operations performed by the platform side are similar to the operations of the platform side described above, and will not be elaborated here.
[0110] In some embodiments, the above-mentioned shipping confirmation operation performed by the vehicle terminal may further include: obtaining a second shipping confirmation result from the shipper, where the second shipping confirmation result is used to indicate that the shipper has confirmed that shipping can be carried out; and among them, in response to receiving a first shipping confirmation result sent by the platform side, and the first shipping confirmation result indicates that the goods have been successfully loaded into the target compartment, initiating a delivery trip may include: in response to receiving the first shipping confirmation result and the second shipping confirmation result, and the first shipping confirmation result indicates that the goods have been successfully loaded into the target compartment, initiating a delivery trip.
[0111] In some embodiments, the obtaining of the second shipping confirmation result may be based on the vehicle terminal displaying a shipping confirmation prompt to the user through the vehicle external screen and obtaining the user's shipping confirmation.
[0112] In some embodiments, the second shipment confirmation result may also be obtained based on the client displaying a shipment confirmation prompt to the user, uploading the user's shipment confirmation result to the platform, and then sending it to the vehicle terminal by the platform.
[0113] Therefore, by further obtaining the shipment confirmation result from the shipper, the safety and reliability of the shipment process can be further improved, thereby improving the safety and reliability of the overall freight process.
[0114] In some embodiments, Figure 7 As shown, the above-mentioned shipment authentication operation may include: step S701, providing an identity authentication interface for the shipper; step S702, starting timing after initiating the shipment authentication operation to obtain a second waiting time for the shipper to perform identity authentication; and step S703, unlocking the cabin door in response to the second waiting time not exceeding the fourth preset time and the shipper passing the identity authentication based on the identity authentication interface.
[0115] After the cargo receiving trip is completed and the shipment authentication operation is started, the shipment authentication timing can be started, and in response to the second waiting time not exceeding the fourth preset time and the consignor passing the identity authentication, the door of the target cabin is unlocked. Among them, providing the consignor with an identity authentication interface can be implemented based on a similar method as described above, which will not be repeated here.
[0116] Therefore, by performing delivery authentication timing during the delivery authentication stage, it is possible to avoid long waiting times for vehicles, ensure the safety of vehicle parking, and improve the efficiency of the overall delivery process.
[0117] In some embodiments, the above-mentioned shipment authentication operation may further include: in response to the second waiting time exceeding the fourth preset time, the shipper still does not perform identity authentication, reporting a shipment authentication timeout event to the platform. Thus, by timing the shipment authentication in the shipment authentication stage, it is possible to timely report the shipment authentication anomalies and improve the efficiency of handling abnormal events.
[0118] In some embodiments, the above-mentioned order processing method for the platform side may also include: in response to receiving an abnormal event reported by a vehicle terminal, generating an abnormal processing work order corresponding to the abnormal event, wherein the abnormal event includes reporting a pickup authentication timeout event or a delivery authentication timeout event.
[0119] Therefore, after receiving an abnormal event, an exception handling work order is generated to trigger the relevant abnormal event handling process, thereby further improving the safety and controllability of the overall freight process.
[0120] In some embodiments, the above-mentioned goods transportation method for a vehicle terminal may further include: in response to detecting that the hatch is opened, sending a third vehicle state to the platform side, where the third vehicle state is used to indicate that the hatch has been opened; and wherein, during the process of putting the goods into the target compartment after the shipping authentication operation is completed, or during the pick-up process of the consignee after the pick-up authentication operation is completed, the acquisition of the in-compartment image of the target compartment may include: in response to receiving an image acquisition instruction sent by the platform side, acquiring the in-compartment image until the hatch of the target vehicle is closed, where the third vehicle state is used to trigger the platform side to send the image acquisition instruction.
[0121] Thus, by actively reporting the event of the vehicle door being opened and performing in-compartment image acquisition according to the instruction of the platform side, the monitoring intensity of the platform side for the freight transportation process can be further improved, and the safety and reliability of the overall freight transportation process can be enhanced.
[0122] In some embodiments, the shipping confirmation operation and the pick-up confirmation operation may further include the detection of the hatch being opened.
[0123] In some embodiments, after the shipping authentication operation ends, start the shipping confirmation operation, and real-time detect whether the hatch of the target compartment is opened; in response to the hatch being opened, send a third vehicle state to the platform side, where the third vehicle state is used to indicate that the hatch has been opened; after receiving the third vehicle state, the platform side sends an image acquisition instruction to the vehicle terminal; the vehicle terminal, in response to receiving the image acquisition instruction, calls the camera device in the target compartment to perform the fifth in-compartment image acquisition; in response to detecting that the hatch is closed again, report the second vehicle state to the platform side; after receiving the second vehicle state, the platform side acquires the fourth in-compartment image and the fifth in-compartment image, and performs shipping confirmation based on the above-mentioned in-compartment images.
[0124] In some embodiments, in response to receiving the third vehicle state during the execution of the shipping confirmation operation, the platform side may start a shipping confirmation process on the platform side; subsequently, in response to receiving the second vehicle state, continue to execute the shipping confirmation process to complete the shipping confirmation.
[0125] In some embodiments, in response to receiving the third vehicle state during the execution of the shipping confirmation operation, the platform side may initiate a shipping confirmation work order on the platform side and assign the work order to the corresponding staff; subsequently, in response to receiving the second vehicle state, the relevant staff can start to perform the shipping confirmation.
[0126] In some embodiments, after the pick-up authentication operation ends, a pick-up confirmation operation is initiated, and whether the hatch of the target compartment is opened is detected in real time; in response to the hatch being opened, a third vehicle status is sent to the platform side, where the third vehicle status is used to indicate that the hatch has been opened; after receiving the third vehicle status, the platform side sends an image acquisition instruction to the vehicle terminal; in response to receiving the image acquisition instruction, the vehicle terminal calls the camera device in the target compartment to perform second in-compartment image acquisition; in response to detecting that the hatch is closed again, the first vehicle status is reported to the platform side, and at the same time, third in-compartment images are acquired; after receiving the first vehicle status, the platform side obtains the first in-compartment image, the second in-compartment image, and the third in-compartment image, and performs delivery confirmation based on the above in-compartment images.
[0127] In some embodiments, in response to receiving the third vehicle status during the execution of the pick-up confirmation operation, the platform side can initiate a pick-up confirmation process on the platform side; subsequently, in response to receiving the first vehicle status, the pick-up confirmation process is continued to complete the pick-up confirmation.
[0128] In some embodiments, in response to receiving the third vehicle status during the execution of the pick-up confirmation operation, the platform side can initiate a pick-up confirmation work order and assign the work order to the corresponding staff; subsequently, in response to receiving the first vehicle status, the relevant staff can start the pick-up confirmation.
[0129] In some embodiments, before the delivery trip is started after the delivery confirmation operation in the freight process, a hatch locking operation can also be included. Thereby, the hatch of the target compartment can be kept locked during the goods transportation process, further improving the safety of the goods during transportation.
[0130] Figure 8 A schematic diagram of a freight process according to an exemplary embodiment of the present disclosure is shown.
[0131] In some exemplary embodiments, as Figure 8 shown, the freight process generated based on the freight order can include a pick-up trip, a delivery authentication operation, a delivery confirmation operation, a hatch locking operation, a delivery trip, a pick-up authentication operation, and a pick-up confirmation operation.
[0132] Figure 9 A flowchart of executing a freight process according to an exemplary embodiment of the present disclosure is shown.
[0133] In some exemplary embodiments, as Figure 9As shown, the execution of the freight transportation process includes: Step S901, execute the pick-up journey and control the target vehicle to drive to the place of dispatch; Step S902, during the execution of the pick-up journey, collect at least one fourth in-cabin image; Step S903, in response to the target vehicle arriving at the place of dispatch, end the pick-up journey and initiate the dispatch authentication operation; Step S904, in response to the shipper's identity authentication being passed, unlock the hatch door of the target compartment and end the dispatch authentication operation, and initiate the dispatch confirmation operation; Step S905, in response to the identity authentication not being performed within the time limit, report the dispatch authentication timeout exception event to the platform side; Step S906, in response to detecting that the hatch door is opened, report the third vehicle status to the platform side; Step S907, in response to receiving the image collection instruction issued by the platform side, collect at least one fifth in-cabin image; Step S908, in response to detecting that the hatch door is closed, report the second vehicle status to the platform side; Step S909, the platform side, in response to receiving the second vehicle status, based on the fourth in-cabin image and the fifth in-cabin image, obtain the first dispatch confirmation result, and at the same time obtain the second dispatch confirmation result from the shipper, so as to obtain the final dispatch confirmation result; Step S910, in response to the dispatch confirmation result passing, end the dispatch confirmation operation and execute the hatch door locking operation; Step S911, initiate the delivery journey and control the target vehicle to drive to the destination of the goods transportation; Step S912, during the execution of the delivery journey, collect at least one first in-cabin image; Step S913, in response to the target vehicle arriving at the destination, end the delivery journey and initiate the pick-up authentication operation; Step S914, in response to the platform side receiving the waiting request sent by the user, send a waiting instruction to the vehicle terminal and make the target vehicle drive near the destination for authentication waiting; Step S915, in response to the identity authentication not being performed within the time limit, report the pick-up authentication timeout exception event to the platform side; Step S916, in response to the consignee's identity authentication being passed, unlock the hatch door of the target compartment and end the pick-up authentication operation, and initiate the pick-up confirmation operation; Step S917, in response to detecting that the hatch door is opened, report the third vehicle status to the platform side; Step S918, in response to receiving the image collection instruction issued by the platform side, collect at least one second in-cabin image; Step S919, in response to detecting that the hatch door is closed, report the first vehicle status to the platform side and collect at least one third in-cabin image at the same time; Step S920, the platform side, in response to receiving the first vehicle status, based on the first in-cabin image, the second in-cabin image and the third in-cabin image, obtain the pick-up confirmation result; Step S921, in response to the pick-up confirmation result indicating that the consignee has successfully picked up the goods, mark the corresponding freight order as completed and send the pick-up confirmation result to the vehicle terminal so that the vehicle terminal ends the current freight transportation process.
[0134] In some embodiments, such as Figure 10As shown, the above-mentioned goods transportation method for a vehicle terminal may further include: Step S1001, after collecting the in-cabin image of the target cabin, uploading the in-cabin image of the target cabin to the object storage server; Step S1002, receiving the storage path information fed back by the object storage server; and Step S1003, sending the storage path information to the platform side. The platform side can, for example, obtain the in-cabin image of the target cabin from the object storage server according to the storage path information.
[0135] In some embodiments, the object storage server is used to provide object storage services and can be used to store and manage unstructured data (such as documents, pictures, videos, log files, etc.).
[0136] In some embodiments, the in-cabin image of the target cabin can be uploaded to the object storage server through the object storage service API (Application Programming Interface).
[0137] In some embodiments, after the vehicle terminal finishes uploading the in-cabin image, it can send the storage path information of the in-cabin image on the object storage server to the platform side, so that the platform side can obtain the corresponding in-cabin image from the object storage server according to the storage path information when it needs to obtain the in-cabin image. Among them, the storage path information may include the object storage server URL address and the relative storage path of the in-cabin image.
[0138] Thus, through the application of the object storage service, efficient and stable uploading and reading of the in-cabin image can be realized.
[0139] In some embodiments, the in-cabin image collected by the vehicle terminal is stored on the object storage server. The above-mentioned order processing method for the platform side may further include: receiving the storage path information of the in-cabin image on the object storage server sent by the vehicle terminal; and among them, the acquisition of the in-cabin image includes: obtaining the in-cabin image from the object storage server according to the storage path information. Thus, efficient and stable uploading and reading of the in-cabin image can be realized.
[0140] In some embodiments, the communication between the vehicle terminal and the platform side (such as the transmission of the in-cabin image acquisition instruction, the transmission of the vehicle state, etc.) can be realized based on the Internet of Things.
[0141] In some embodiments, the vehicle terminal and the platform terminal each maintain a set of subscribers and publishers. Taking the transmission of the in-cabin image acquisition instruction as an example, the platform terminal publishes the in-cabin image acquisition instruction to the message middleware through the publisher it maintains; the vehicle terminal subscribes to this channel through the subscriber, so as to obtain the in-cabin image acquisition instruction. Thus, through the communication link combining the Internet of Things and the object storage service, while realizing the efficient and stable upload of the in-cabin image, the communication quality between the vehicle terminal and the platform terminal is ensured, and the communication link congestion caused by the upload of the in-cabin image is avoided.
[0142] Figure 11 The flowchart of obtaining the in-cabin image according to an exemplary embodiment of the present disclosure is shown.
[0143] In some exemplary embodiments, as Figure 11 shown, the process of obtaining the in-cabin image may include: Step S1101, the platform terminal publishes the in-cabin image acquisition instruction to the message middleware; Step S1102, the vehicle terminal subscribes to the publisher to receive the in-cabin image acquisition instruction; Step S1103, the vehicle terminal sends the in-cabin image acquisition instruction to the perception module; Step S1104, the camera device in the target cabin performs video acquisition and sends the key frames of the in-cabin video (for example, the video stream encoded in H264 or H265) to the vehicle terminal; Step S1105, the vehicle terminal decodes the above key frames through ffmpeg and encodes them to obtain the in-cabin image in a preset format (for example, jpeg format); Step S1106, upload the in-cabin image through the object storage service API; Step S1107, the vehicle terminal publishes the storage path information of the in-cabin image to the message middleware; Step S1108, the platform terminal subscribes to the publisher to receive the storage path information of the in-cabin image; Step S1109, the platform terminal obtains the corresponding in-cabin image from the object storage server according to the storage path information.
[0144] In some embodiments, as Figure 12As shown, a cargo transportation device 1200 for a vehicle terminal is also provided. The device 1200 includes: a receiving unit 1210 configured to receive indication information indicating a freight transportation process sent by a platform terminal, where the freight transportation process includes a delivery trip and a pick-up authentication operation for authenticating the identity of the consignee; a control unit 1220 configured to control a target vehicle corresponding to the vehicle terminal to execute the delivery trip; a first acquisition unit 1230 configured to acquire at least one first in-cabin image of a target cabin of the target vehicle during the execution of the delivery trip; an execution unit 1240 configured to execute the pick-up authentication operation in response to detecting that the target vehicle arrives at the destination of the cargo transportation; a second acquisition unit 1250 configured to acquire at least one second in-cabin image of the target cabin during the pick-up process of the consignee after the pick-up authentication operation is completed; a third acquisition unit 1260 configured to acquire at least one third in-cabin image of the target cabin in response to detecting that the cabin door has been closed; a sending unit 1270 configured to send a first vehicle state to the platform terminal, where the first vehicle state is used to trigger the platform terminal to send a pick-up confirmation result, and the pick-up confirmation result is generated based on the at least one first in-cabin image, the at least one second in-cabin image, and the at least one third in-cabin image, and the first vehicle state indicates that the cabin door has been closed after the consignee picks up the goods; and an obtaining unit 1280 configured to obtain the pick-up confirmation result from the platform terminal to determine whether to end the freight transportation process.
[0145] Among them, the operations and achievable technical effects performed by the units 1210 to 1280 in the above-mentioned cargo transportation device 1200 for a vehicle terminal are similar to the steps S201 to S208 in the above-mentioned cargo transportation method for a vehicle terminal, and will not be elaborated here.
[0146] In some embodiments, such as Figure 13As shown in the figure, an order processing device 1300 for the platform side is further provided. The device 1300 includes: a generation unit 1310 configured to generate a freight transportation process based on the received freight order in response to receiving the freight order, where the freight transportation process includes a delivery trip and a pick-up authentication operation for authenticating the identity of the consignee; a sending unit 1320 configured to send indication information indicating the freight transportation process to the vehicle terminal of the target vehicle; a first acquisition unit 1330 configured to acquire a plurality of in-cabin images of the target compartment of the target vehicle collected by the vehicle terminal in response to receiving a first vehicle state sent by the vehicle terminal, where the first vehicle state indicates that the hatch of the target compartment has been closed after the consignee picks up the goods, and the plurality of in-cabin images include at least one first in-cabin image during the execution of the delivery trip, at least one second in-cabin image during the consignee's pick-up process after the pick-up authentication operation is completed, and at least one third in-cabin image after the hatch is closed after the pick-up process; and a second acquisition unit 1340 configured to acquire a pick-up confirmation result based on the plurality of in-cabin images.
[0147] Among them, the operations and achievable technical effects performed by the units 1310 to 1340 in the above-mentioned order processing device 1300 for the platform side are similar to the steps S301 to S304 in the above-mentioned order processing method for the platform side, and will not be elaborated here.
[0148] In some embodiments, as Figure 14 shown in the figure, a freight order processing system 1400 based on autonomous driving is further provided. The system 1400 includes: a vehicle terminal 1410 configured to execute the above-mentioned goods transportation method for the vehicle terminal; and a platform side 1420 configured to execute the above-mentioned order processing method for the platform side.
[0149] According to an embodiment of the present disclosure, an electronic device, a readable storage medium, and a computer program product are further provided.
[0150] Referring to Figure 15 , the block diagram of an electronic device 1500 that can be used as a server or a client of the present disclosure will now be described. It is an example of a hardware device that can be applied to various aspects of the present disclosure. The electronic device is intended to represent various forms of digital electronic computer devices, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein.
[0151] As shown Figure 15 in FIG. 1, the electronic device 1500 includes a computing unit 1501 which can perform various appropriate actions and processes according to computer programs stored in a read-only memory (ROM) 1502 or computer programs loaded from a storage unit 1508 into a random access memory (RAM) 1503. In the RAM 1503, various programs and data required for the operation of the electronic device 1500 can also be stored. The computing unit 1501, the ROM 1502, and the RAM 1503 are connected to each other through a bus 1504. An input / output (I / O) interface 1505 is also connected to the bus 1504.
[0152] A plurality of components in the electronic device 1500 are connected to the I / O interface 1505, including: an input unit 1506, an output unit 1507, a storage unit 1508, and a communication unit 1509. The input unit 1506 can be any type of device capable of inputting information into the electronic device 1500. The input unit 1506 can receive input numerical or character information and generate key signal inputs related to user settings and / or function controls of the electronic device, and can include but are not limited to a mouse, a keyboard, a touch screen, a trackpad, a trackball, a joystick, a microphone, and / or a remote controller. The output unit 1507 can be any type of device capable of presenting information, and can include but are not limited to a display, a speaker, a video / audio output terminal, a vibrator, and / or a printer. The storage unit 1508 can include but are not limited to magnetic disks, optical disks. The communication unit 1509 allows the electronic device 1500 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks, and can include but are not limited to a modem, a network card, an infrared communication device, a wireless communication transceiver, and / or a chipset, such as a Bluetooth device, an 802.11 device, a WiFi device, a WiMax device, a cellular communication device, and / or the like.
[0153] The computing unit 1501 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 1501 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 1501 executes the various methods and processes described above, such as the goods transportation method for a vehicle terminal or the order processing method for a platform end in the present disclosure. For example, in some embodiments, the goods transportation method for a vehicle terminal or the order processing method for a platform end in the present disclosure can be implemented as a computer software program, which is tangibly included in a machine-readable medium, such as the storage unit 1508. In some embodiments, part or all of the computer program can be loaded and / or installed onto the electronic device 1500 via the ROM 1502 and / or the communication unit 1509. When the computer program is loaded into the RAM 1503 and executed by the computing unit 1501, one or more steps of the goods transportation method for a vehicle terminal or the order processing method for a platform end described above can be executed. Alternatively, in other embodiments, the computing unit 1501 can be configured to execute the goods transportation method for a vehicle terminal or the order processing method for a platform end in the present disclosure by any other suitable means (e.g., by means of firmware).
[0154] Various embodiments of the systems and techniques described above in this document can be implemented in digital electronic circuitry, integrated circuit systems, field-programmable gate arrays (FPGA), application-specific integrated circuits (ASIC), application-specific standard products (ASSP), systems-on-chip (SOC), complex programmable logic devices (CPLD), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include: implemented in one or more computer programs, the one or more computer programs can be executed and / or interpreted on a programmable system including at least one programmable processor, the programmable processor can be a special or general programmable processor, can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit the data and instructions to the storage system, the at least one input device, and the at least one output device.
[0155] The program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, a special purpose computer, or other programmable data processing device, such that the program codes, when executed by the processor or controller, cause the functions / operations specified in the flowchart and / or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine, or entirely on the remote machine or server.
[0156] In the context of the present disclosure, a machine-readable medium may be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0157] In order to provide interaction with a user, the systems and techniques described herein may be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer. Other kinds of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and the input received from the user may be in any form (including acoustic input, voice input, or tactile input).
[0158] The systems and techniques described herein can be implemented in a computing system including backend components (e.g., as a data server), or a computing system including middleware components (e.g., an application server), or a computing system including frontend components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described herein), or a computing system including any combination of such backend components, middleware components, or frontend components. The components of the system can be interconnected to each other by digital data communication in any form or medium (e.g., a communication network). Examples of communication networks include: local area network (LAN), wide area network (WAN), and the Internet.
[0159] A computer system can include a client and a server. The client and the server are generally far from each other and typically interact through a communication network. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, can also be a server of a distributed system, or a server incorporating a blockchain.
[0160] It should be understood that various forms of the processes shown above can be used, steps can be reordered, added, or deleted. For example, the steps recited in this disclosure can be executed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this is not limited herein.
[0161] Although embodiments or examples of the present disclosure have been described with reference to the accompanying drawings, it should be understood that the above methods, systems, and devices are merely exemplary embodiments or examples, and the scope of the present invention is not limited by these embodiments or examples, but is only defined by the appended claims after authorization and their equivalent scope. Various elements in the embodiments or examples can be omitted or replaced by their equivalent elements. In addition, the steps can be executed in an order different from that described in the present disclosure. Further, the various elements in the embodiments or examples can be combined in various ways. Importantly, as technology evolves, many of the elements described herein can be replaced by equivalent elements that emerge after the present disclosure.
Claims
1. A goods transportation method for a vehicle terminal, the method comprising: Receiving indication information sent by a platform terminal indicating a freight transportation process, wherein the freight transportation process includes a delivery trip and a pick-up authentication operation for authenticating the identity of the consignee; Controlling a target vehicle corresponding to the vehicle terminal to execute the delivery trip; During the execution of the delivery trip, collecting at least one first in-cabin image of a target cabin of the target vehicle; In response to detecting that the target vehicle arrives at the destination of the goods transportation, performing the pick-up authentication operation; During the pick-up process of the consignee after the pick-up authentication operation is completed, collecting at least one second in-cabin image of the target cabin; In response to detecting that the hatch has been closed, collecting at least one third in-cabin image of the target cabin; Sending a first vehicle status to the platform terminal, wherein the first vehicle status is used to trigger the platform terminal to send a pick-up confirmation result, and the pick-up confirmation result is generated based on the at least one first in-cabin image, the at least one second in-cabin image, and the at least one third in-cabin image, and the first vehicle status indicates that the hatch has been closed after the consignee picks up the goods; and Obtaining the pick-up confirmation result from the platform terminal to determine whether to end the freight transportation process.
2. The method according to claim 1, wherein The pick-up authentication operation includes: Providing an identity authentication interface for the consignee; Starting to time after the pick-up authentication operation is started to obtain a first waiting duration for waiting for the consignee to perform identity authentication; and In response to the first waiting duration not exceeding a first preset duration and the consignee passing the identity authentication based on the identity authentication interface, unlocking the hatch.
3. The method according to claim 2, wherein The pick-up authentication operation further includes: In response to receiving a waiting instruction sent by the platform terminal within a second preset duration after the pick-up authentication operation is started, controlling the target vehicle to drive on a road within a preset range around the destination and return to the destination within a third preset duration, wherein the waiting instruction is generated based on a waiting request sent by the consignee; and Restarting to time the first waiting duration.
4. The method according to claim 2 or 3, wherein, The pick-up authentication operation further includes: In response to the consignee still not performing identity authentication after the first waiting duration exceeds the first preset duration, reporting a pick-up authentication timeout event to the platform terminal.
5. The method according to any one of claims 1 to 4, wherein, The freight transportation process further includes a goods receiving trip, a delivery authentication operation, and a delivery confirmation operation, and the method further includes: Before controlling the target vehicle to execute the delivery trip, controlling the target vehicle to execute the goods receiving trip; During the execution of the goods receiving trip, collecting at least one fourth in-cabin image of the target cabin; In response to detecting that the target vehicle arrives at the place of dispatch of the goods transportation, performing the delivery authentication operation for authenticating the identity of the shipper; During the process of putting the goods into the target cabin after the delivery authentication operation is completed, collecting at least one fifth in-cabin image of the target cabin; Performing a delivery confirmation operation, wherein the delivery confirmation operation includes: Send the second vehicle status to the platform end, where the second vehicle status is used to trigger the platform end to send a first shipment confirmation result, and the first shipment confirmation result is generated based on the at least one fourth in-cabin image and the at least one fifth in-cabin image. The second vehicle status indicates that the hatch has been closed after the shipper has placed the goods in the target compartment. The first shipment confirmation result is used to indicate whether the goods have been successfully loaded into the target compartment; and In response to receiving the first shipment confirmation result sent by the platform end, and the first shipment confirmation result indicates that the goods have been successfully loaded into the target compartment, initiate the delivery trip.
6. The method according to claim 5, wherein The shipment confirmation operation further includes: Obtain a second shipment confirmation result from the shipper, where the second shipment confirmation result is used to indicate that the shipper has confirmed that shipment can be made; and where The step of initiating the delivery trip in response to receiving the first shipment confirmation result sent by the platform end, and the first shipment confirmation result indicates that the goods have been successfully loaded into the target compartment includes: In response to receiving the first shipment confirmation result and the second shipment confirmation result, and the first shipment confirmation result indicates that the goods have been successfully loaded into the target compartment, initiate the delivery trip.
7. The method according to claim 5 or 6, wherein The shipment authentication operation includes: Provide an identity authentication interface for the shipper; Start timing after initiating the shipment authentication operation to obtain a second waiting duration for waiting for the shipper to perform identity authentication; and In response to the second waiting duration not exceeding a fourth preset duration and the shipper passing identity authentication based on the identity authentication interface, unlock the hatch.
8. The method according to claim 7, wherein The shipment authentication operation further includes: In response to the shipper still not performing identity authentication after the second waiting duration exceeds the fourth preset duration, report a shipment authentication timeout event to the platform end.
9. The method according to any one of claims 1 to 8, further includes: In response to detecting that the hatch is opened, send a third vehicle status to the platform end, and the third vehicle status is used to indicate that the hatch has been opened; And where During the process of placing the goods in the target compartment after the shipment authentication operation is completed, or during the pick-up process of the consignee after the pick-up authentication operation is completed, the acquisition of the in-cabin image of the target compartment includes: In response to receiving an image acquisition instruction sent by the platform end, acquire the in-cabin image of the target compartment until the hatch of the target vehicle is closed, where the third vehicle status is used to trigger the platform end to send the image acquisition instruction.
10. The method according to any one of claims 1 to 9, further includes: After acquiring the in-cabin image of the target compartment, upload the in-cabin image of the target compartment to an object storage service end; Receive the storage path information fed back by the object storage service end; And Send the storage path information to the platform end.
11. An order processing method for a platform end, the method includes: In response to receiving a freight order, generate a freight process based on the freight order, where the freight process includes a delivery trip and a pick-up authentication operation for authenticating the identity of the consignee; Send the indication information indicating the freight process to the vehicle terminal of the target vehicle; In response to receiving the first vehicle status sent by the vehicle terminal, obtain a plurality of in-cabin images of the target compartment of the target vehicle collected by the vehicle terminal, where the first vehicle status indicates that the hatch of the target compartment has been closed after the consignee picks up the goods, and the plurality of in-cabin images include at least one first in-cabin image during the execution of the delivery trip, at least one second in-cabin image during the consignee's pick-up process after the pick-up authentication operation is completed, and at least one third in-cabin image after the hatch is closed after the pick-up process; and Obtain a pick-up confirmation result based on the plurality of in-cabin images.
12. The method according to claim 11, wherein, The freight process further includes a receiving trip, a shipping authentication operation, and a shipping confirmation operation. The shipping authentication operation is used for authenticating the identity of the shipper, and the shipping confirmation operation is used for determining whether to initiate the delivery trip. The method further includes: In response to receiving the second vehicle status sent by the vehicle terminal, obtain at least one fourth in-cabin image and at least one fifth in-cabin image of the target cockpit collected by the vehicle terminal, where the second vehicle status indicates that the hatch has been closed after the shipper places the goods in the target compartment, the at least one fourth in-cabin image is collected during the execution of the receiving trip, and the at least one fifth in-cabin image is collected during the process of the shipper placing the goods in the target compartment after the shipping authentication operation is completed; Obtain a shipping confirmation result based on the at least one fourth in-cabin image and the at least one fifth in-cabin image, where the shipping confirmation result is used to indicate whether the goods have been successfully loaded into the target compartment; and Send the shipping confirmation result to the vehicle terminal, and the shipping confirmation result is used to complete the shipping confirmation operation.
13. The method according to claim 11 or 12, wherein The in-cabin images collected by the vehicle terminal are stored on an object storage server. The method further includes: Receive the storage path information of the in-cabin images on the object storage server sent by the vehicle terminal; and where The obtaining of the in-cabin images includes: Obtain the in-cabin images from the object storage server according to the storage path information.
14. The method according to any one of claims 11 to 13, further includes: In response to receiving an abnormal event reported by the vehicle terminal, generate an abnormal handling work order corresponding to the abnormal event, where the abnormal event includes a pick-up authentication timeout event or a shipping authentication timeout event.
15. A cargo transportation device for a vehicle terminal, the device includes: A receiving unit, configured to receive the indication information indicating the freight process sent by the platform end, where the freight process includes a delivery trip and a pick-up authentication operation for authenticating the identity of the consignee; A control unit, configured to control a target vehicle corresponding to the vehicle terminal to execute the delivery trip; A first acquisition unit, configured to acquire at least one first in-cabin image of a target cabin of the target vehicle during the execution of the delivery trip; An execution unit, configured to execute the pick-up authentication operation in response to detecting that the target vehicle arrives at the destination of the goods transportation; A second acquisition unit, configured to acquire at least one second in-cabin image of the target cabin during the pick-up process of the consignee after the pick-up authentication operation is completed; A third acquisition unit, configured to acquire at least one third in-cabin image of the target cabin in response to detecting that the cabin door has been closed; A sending unit, configured to send a first vehicle state to the platform side, where the first vehicle state is used to trigger the platform side to send a pick-up confirmation result, and the pick-up confirmation result is generated based on the at least one first in-cabin image, the at least one second in-cabin image, and the at least one third in-cabin image, and the first vehicle state indicates that the cabin door has been closed after the consignee picks up the goods; and An acquisition unit, configured to acquire the pick-up confirmation result from the platform side to determine whether to end the freight transportation process.
16. An order processing device for a platform side, the device includes: A generation unit, configured to generate a freight transportation process based on the freight order in response to receiving the freight order, where the freight transportation process includes a delivery trip and a pick-up authentication operation, and the pick-up authentication operation is used for the identity authentication of the consignee; A sending unit, configured to send indication information indicating the freight transportation process to a vehicle terminal of a target vehicle; A first acquisition unit, configured to acquire a plurality of in-cabin images of a target cabin of the target vehicle acquired by the vehicle terminal in response to receiving the first vehicle state sent by the vehicle terminal, where the first vehicle state indicates that the cabin door of the target cabin has been closed after the consignee picks up the goods, and the plurality of in-cabin images include at least one first in-cabin image during the execution of the delivery trip, at least one second in-cabin image during the pick-up process of the consignee after the pick-up authentication operation is completed, and at least one third in-cabin image after the cabin door is closed after the pick-up process; and A second acquisition unit, configured to acquire a pick-up confirmation result based on the plurality of in-cabin images.
17. An autonomous driving-based freight order processing system, the system includes: A vehicle terminal, configured to execute the method according to any one of claims 1 to 10; And A platform side, configured to execute the method according to any one of claims 11 to 14.
18. An electronic device, including: At least one processor; And A memory communicatively connected to the at least one processor; Wherein The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method according to any one of claims 1 - 14.
19. A non-transitory computer-readable storage medium storing computer instructions, wherein, The computer instructions are used to cause a computer to perform the method according to any one of claims 1-14.
20. A computer program product comprising a computer program, wherein, The computer program, when executed by a processor, implements the method according to any one of claims 1-14.