Remote control method and device, server, medium and computer program product

Abstract

The embodiment of the invention relates to a remote control method and device, a server, a medium and a computer program product. The method comprises the following steps: receiving an assistance request sent by a trapped vehicle; the assistance request comprises vehicle information of the trapped vehicle; determining queue information of the assistance request in a to-be-processed request queue according to the vehicle information; sending a control instruction to the first control end according to the queue information of the assistance request; the control instruction is used for instructing the first control end to respond to the assistance request. By adopting the method, the problem that the response to the assistance request initiated by the trapped vehicle is not timely can be solved.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of autonomous driving technology, and in particular, to a remote control method, device, server, medium, and computer program product. Background Art

[0002] With the development of autonomous driving technology, the Remote Operating System (ROS) is increasingly widely used in autonomous vehicles. The ROS system can realize remote operation and monitoring of autonomous vehicles. When an autonomous vehicle encounters difficulties, the ROS system can be used to remotely control the autonomous vehicle to get out of trouble.

[0003] Generally, when an autonomous vehicle is in trouble, it sends a Remote Operation (RA) request to the ROS system, and the ROS system responds to the received request to help the trapped vehicle get out of trouble.

[0004] However, in the traditional technology, there is a problem that the response to the RA request initiated by the trapped vehicle is not timely. Summary of the Invention

[0005] Embodiments of the present disclosure provide a remote control method, device, server, medium, and computer program product, which can be used to solve the problem that the response to the RA request initiated by the trapped vehicle is not timely.

[0006] In a first aspect, an embodiment of the present disclosure provides a remote control method, the method includes:

[0007] Receiving an assistance request sent by a trapped vehicle; the assistance request includes vehicle information of the trapped vehicle;

[0008] Determining queue information of the assistance request in a to-be-processed request queue according to the vehicle information;

[0009] Sending a control instruction to a first control end according to the queue information of the assistance request; the control instruction is used to instruct the first control end to respond to the assistance request.

[0010] In a second aspect, an embodiment of the present disclosure provides a remote control device, the device includes:

[0011] A receiving module, configured to receive an assistance request sent by a trapped vehicle; the assistance request includes vehicle information of the trapped vehicle;

[0012] A determining module, configured to determine queue information of the assistance request in a to-be-processed request queue according to the vehicle information;

[0013] A sending module, configured to send a control instruction to a first control end according to the queue information of the assistance request; the control instruction is used to instruct the first control end to respond to the assistance request.

[0014] In a third aspect, an embodiment of the present disclosure provides a server, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the method described in the first aspect above is implemented.

[0015] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the method described in the first aspect above is implemented.

[0016] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program. When the computer program is executed by a processor, the method described in the first aspect above is implemented.

[0017] The remote control method, device, server, medium, and computer program product provided by the embodiments of the present disclosure. The server receives an assistance request from a trapped vehicle, and the assistance request includes vehicle information of the trapped vehicle. Thus, the queue information of the assistance request in the queue of requests to be processed can be determined according to the vehicle information. Further, a control instruction is sent to the first control end according to the queue information of the assistance request to instruct the first control end to respond to the assistance request. Compared with the prior art in which the server determines the queue information of the assistance request in the queue of requests to be processed according to the received time of the assistance request, the embodiments of the present disclosure determine the queue information of the assistance request in the queue of requests to be processed according to the vehicle information of the trapped vehicle, rather than simply according to the received time of the assistance request of the trapped vehicle. In this way, by considering from multiple dimensions in combination with the vehicle information of the trapped vehicle, the queue information of the assistance request of the trapped vehicle in the queue of requests to be processed can be reasonably determined. Thus, a control instruction can be sent to the first control end in time according to the determined queue information of the assistance request, instructing the first control end to respond to the assistance request of the trapped vehicle in time, ensuring that the first terminal can respond to the assistance request initiated by the trapped vehicle more timely according to the queue information of the assistance request. Description of the Drawings

[0018] Figure 1 It is an application environment diagram of the remote control method in an embodiment;

[0019] Figure 2 It is a flowchart of the remote control method in an embodiment;

[0020] Figure 3 It is a flowchart of the remote control method in another embodiment;

[0021] Figure 4 Schematic diagram of the state of the control end in one embodiment;

[0022] Figure 5 Schematic diagram of the process of the remote control method in another embodiment;

[0023] Figure 6 Schematic diagram of the process of the remote control method in another embodiment;

[0024] Figure 7 Schematic diagram of the process of the remote control method in another embodiment;

[0025] Figure 8 Schematic diagram of the process of the remote control method in another embodiment;

[0026] Figure 9 Block diagram of the structure of the remote control device in one embodiment;

[0027] Figure 10 Block diagram of the structure of the remote control device in another embodiment;

[0028] Figure 11 Block diagram of the structure of the remote control device in another embodiment;

[0029] Figure 12 Block diagram of the structure of the remote control device in another embodiment;

[0030] Figure 13 Block diagram of the structure of the remote control device in another embodiment;

[0031] Figure 14 Block diagram of the structure of the remote control device in another embodiment;

[0032] Figure 15 Block diagram of the structure of the remote control device in another embodiment;

[0033] Figure 16 Block diagram of the structure of the remote control device in another embodiment;

[0034] Figure 17 Internal structure diagram of the electronic device in one embodiment. Detailed implementation manners

[0035] In order to make the objectives, technical solutions and advantages of the embodiments of the present disclosure clearer, the following further describes the embodiments of the present disclosure in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the embodiments of the present disclosure, and are not used to limit the embodiments of the present disclosure.

[0036] First, before specifically introducing the technical solution of the embodiment of the present disclosure, the technical background or technical evolution context based on the embodiment of the present disclosure is introduced. Generally, in the field of autonomous driving, when an autonomous driving vehicle is trapped, a remote control terminal is required to assist the trapped vehicle to get out of trouble. Generally, the assistance mode of the autonomous driving vehicle includes a seat mode and a single vehicle mode. The seat mode is that when the autonomous driving vehicle is trapped, the server queues the assistance request sent by the trapped vehicle, and assigns the assistance request to the control terminal corresponding to the idle seat in the queue order. The single vehicle mode is that when the autonomous driving vehicle is trapped, the exclusive control terminal responds to the assistance request of the vehicle, that is, the vehicle and the control terminal correspond one to one in the single vehicle mode. Exemplarily, the situation in which the vehicle is trapped may include the autonomous driving vehicle itself causing the autonomous driving vehicle to stop moving, for example, the controller of the autonomous driving vehicle is damaged, the power supply of the autonomous driving vehicle is faulty, the line of the autonomous driving vehicle is abnormal, etc., or the autonomous driving vehicle stops moving due to external factors, for example, the water level on the road is deep due to heavy rain, and the vehicle is stuck in a muddy road and cannot move. When the assistance mode of the autonomous driving vehicle is in the seat mode, the autonomous driving vehicle sends a remote operation (RA) request to the remote operating system (ROS) when it is in trouble. The ROS system assigns a corresponding control end to the RA request, and uses the control end to remotely control the trapped autonomous driving vehicle to help the autonomous driving vehicle out of trouble. However, in the prior art, if the autonomous driving vehicle is in the seat mode and the control end is not idle when the vehicle is in trouble, the ROS system sorts multiple RA requests according to the time when the RA request is received, and when there is an idle control end, the RA requests in the sorting queue are assigned control ends in turn. However, due to the different task types, locations and other information of each autonomous driving vehicle, the urgency of each autonomous driving vehicle in trouble is also different. Therefore, only sorting the RA requests according to the reception time of the RA request, and then making the corresponding control end assist the autonomous driving vehicle to get out of trouble, there will be a problem of untimely response to the RA request initiated by the trapped vehicle. How to solve the problem of untimely response to the RA request initiated by the trapped vehicle has become a difficult problem that needs to be solved urgently.

[0037] The technical solutions involved in the embodiments of the present disclosure are introduced below in combination with the scenarios to which the embodiments of the present disclosure are applied.

[0038] The remote control method provided by the embodiment of the present disclosure can be applied to Figure 1In the shown system architecture, the system architecture includes a vehicle terminal 101, a control terminal 102, and a server 103. Among them, the vehicle terminal 101 can be a non-motor vehicle such as an electric bicycle, a motorcycle, a car, or various motor vehicles, etc.; the control terminal 102 can be an electronic device such as a mobile phone, a tablet computer, an IPAD, etc., or can also be an APP software installed on the electronic device; the server 103 can be an independent server or a server cluster composed of multiple servers. Among them, the vehicle terminal 101 is provided with a communication component, which can communicate with the server 103 in a wireless manner. For example, the vehicle terminal 101 can send a RA request to the server 103. In addition, the control terminal 102 and the server 103 can communicate in a wireless or wired manner. The embodiments of the present disclosure do not limit the communication methods among the vehicle terminal 101, the control terminal 102, and the server 103.

[0039] In one embodiment, as Figure 2 shown, a remote control method is provided. Taking the server in Figure 1 as an example for illustration, the method includes the following steps:

[0040] S201, receiving an assistance request sent by a trapped vehicle; the assistance request includes the vehicle information of the trapped vehicle.

[0041] Among them, the assistance request sent by the trapped vehicle can be a Remote Operation (RA) request. The assistance request can instruct the corresponding control terminal to respond to the assistance request through the server to help the trapped vehicle get out of trouble. Optionally, the vehicle information of the trapped vehicle can include the identification information of the trapped vehicle, the attribute information of the trapped vehicle, etc.

[0042] In this embodiment, the trapped vehicle can send an assistance request to the server in a manner of being manually initiated or automatically triggered when it encounters difficulties. Exemplarily, when there is a safety officer on the trapped vehicle, the trapped vehicle can generate an assistance request according to the click operation or input operation of the safety officer on the interaction interface and send the assistance request to the server; when the trapped vehicle is a vehicle in a fully unmanned stage, the trapped vehicle can obtain the real-time state of the vehicle according to the state detection device. When the real-time state of the vehicle is in trouble, the trapped vehicle can generate an assistance request according to the vehicle information of the trapped vehicle and send the assistance request to the server.

[0043] S202, determining the queue information of the assistance request in the to-be-processed request queue according to the vehicle information.

[0044] Among them, the to-be-processed request queue includes multiple to-be-processed requests, which can be sent to the server by other previously trapped vehicles. The server can process each to-be-processed assistance request according to the order of the to-be-processed requests in the to-be-processed request queue. It can be understood that the queue information of the assistance request can be used to represent the arrangement position of the assistance request in the to-be-processed request queue. Exemplarily, the queue information can include the arrangement position of the assistance request in the to-be-processed queue.

[0045] In this embodiment, the server sorts the assistance request of the trapped vehicle and other to-be-processed requests according to the vehicle information of the trapped vehicle above, and determines the queue information of the assistance request in the to-be-processed request queue. Optionally, the server can obtain the vehicle information corresponding to each to-be-processed request in the to-be-processed request queue, calculate the similarity between the vehicle information corresponding to the assistance request and the vehicle information corresponding to each to-be-processed request, determine the vehicle information with the highest similarity to the vehicle information corresponding to the assistance request, and arrange the assistance request after the to-be-processed request corresponding to the vehicle information with the highest similarity. For example, if the position of the to-be-processed request corresponding to the vehicle information with the highest similarity to the vehicle information corresponding to the assistance request in the to-be-processed request queue is 5, the assistance request can be arranged at the 6th position in the to-be-processed request queue.

[0046] Optionally, in some scenarios, to avoid the server repeatedly processing the assistance requests sent by the same vehicle and causing resource waste, the server can compare the vehicle identifier corresponding to the received assistance request with the vehicle identifiers of the to-be-processed assistance requests in the to-be-processed request queue. If the vehicle identifiers of the to-be-processed assistance requests in the to-be-processed request queue include a vehicle identifier that is the same as the vehicle identifier of the received assistance request, it can be determined that the assistance request is a repeatedly sent assistance request. The server will not perform the operation of determining the queue information of the assistance request in the to-be-processed request queue according to the vehicle information, and send a prompt message of "repeated request broadcast" to the trapped vehicle.

[0047] S203, send a control instruction to the first control end according to the queue information of the assistance request; the control instruction is used to instruct the first control end to respond to the assistance request.

[0048] Among them, the first control end is a control end that can respond to the assistance request. For example, the first control end can be a terminal corresponding to a remote operator or a server, etc.; further, the first control end can be called a seat for assisting in processing an autonomous vehicle.

[0049] In this embodiment, the server forwards each request in the to-be-processed request queue to an idle control terminal in sequence according to the arrangement order of the requests in the to-be-processed request queue. Exemplarily, when the queue information of the above assistance request in the to-be-processed request queue is at the head of the to-be-processed request queue, the server may determine the idle control terminal as the first control terminal and forward the assistance request to the first control terminal to instruct the first control terminal to respond to the assistance request.

[0050] In the above remote control method, the server receives an assistance request from a trapped vehicle, and the assistance request includes vehicle information of the trapped vehicle, so that the queue information of the assistance request in the to-be-processed request queue can be determined according to the vehicle information. Further, a control instruction is sent to the first control terminal according to the queue information of the assistance request to instruct the first control terminal to respond to the assistance request. Compared with the prior art in which the server determines the queue information of the assistance request in the to-be-processed request queue according to the time when the assistance request is received, in the embodiments of the present disclosure, the queue information of the assistance request in the to-be-processed request queue is determined according to the vehicle information of the trapped vehicle, rather than simply according to the reception time of the assistance request of the trapped vehicle. In this way, the queue information of the assistance request of the trapped vehicle can be reasonably determined by considering from multiple dimensions in combination with the vehicle information of the trapped vehicle, so that a control instruction can be sent to the first control terminal in time according to the determined queue information of the assistance request, instructing the first control terminal to respond to the assistance request of the trapped vehicle in time, and ensuring that the first terminal can respond to the assistance request initiated by the trapped vehicle more timely according to the queue information of the assistance request.

[0051] In the scenario of determining the queue information of the assistance request in the to-be-processed request queue according to the vehicle information, the priority of the assistance request can be determined first according to the vehicle information, and then the queue information of the assistance request in the to-be-processed request queue can be determined according to the priority of the assistance request. In one embodiment, as Figure 3 shown, the above S202 includes:

[0052] S301, determining the priority of the assistance request according to the vehicle information.

[0053] In this embodiment, due to different scenarios of trapped vehicles, vehicle attributes, vehicle identifiers, etc., the urgency of the assistance requests corresponding to trapped vehicles is also different. Therefore, the urgency of the assistance request can be obtained according to the vehicle information, and then the priority of the assistance request can be determined according to the urgency of the assistance request. It can be understood that the higher the urgency of the assistance request, the higher the priority of the assistance request, and the lower the urgency of the assistance request, the lower the priority of the assistance request.

[0054] Optionally, in this embodiment, the priorities of assistance requests may include a first level, a second level, and a third level, where the first level is the highest priority and the third level is the lowest priority. When it is determined that the urgency of an assistance request is extremely urgent based on vehicle information, the priority corresponding to the assistance request may be determined to be the first level.

[0055] S302. Determine queue information of the assistance request in the queue of requests to be processed according to the priority of the assistance request.

[0056] In this embodiment, the higher the priority of an assistance request, the more forward the position of the assistance request in the queue of requests to be processed. Optionally, if the priorities of multiple assistance requests in the queue of requests to be processed are the same, the queue information of the assistance requests with the same priority in the queue of requests to be processed is determined according to the time when the server receives each assistance request.

[0057] In this embodiment, first, the priority of the assistance request is determined according to the vehicle information, and then, according to the priority of the assistance request, the queue information of the assistance request in the queue of requests to be processed is determined. The vehicle information is converted into a quantitative priority, so that the queue information of the assistance request in the queue of requests to be processed is determined according to the priority of the assistance request, improving the accuracy of the determined queue information of the assistance request in the queue of requests to be processed.

[0058] The process of determining the priority of the assistance request according to the vehicle information will be elaborated in detail below. In one embodiment, the vehicle information includes multiple index information of the vehicle, and the above S301 includes: determining the priority of the assistance request according to the weights of the respective index information.

[0059] Among them, the index information of the trapped vehicle may include the task type of the trapped vehicle, the version information of the autonomous driving computing platform (Apollo Computing Unit, ACU), the location information, the attribute information, etc. The task type of the trapped vehicle may be a road test vehicle or an operating vehicle, the location information is the location where the trapped vehicle is located, and the attribute information of the trapped vehicle may include being followed by a safety officer and being unmanned throughout the process.

[0060] In this embodiment, the weights of the respective index information may be preset, and the weights of the respective index information of the trapped vehicle are summed to obtain the total weight corresponding to the vehicle information of the trapped vehicle. Thus, the priority of the assistance request for the trapped vehicle is determined according to the total weight corresponding to the vehicle information of the trapped vehicle. It can be understood that the higher the total weight, the higher the priority of the assistance request, and the lower the total weight, the lower the priority of the assistance request.

[0061] Exemplarily, if the attribute information of the trapped vehicle is that there is a safety officer following, the weight corresponding to the attribute information of the trapped vehicle can be 0.2. If the attribute information of the trapped vehicle is that there is no one following during the whole stage, the weight corresponding to the attribute information of the trapped vehicle can be 0.8. If the location of the trapped vehicle is in the urban area, the weight corresponding to the location information of the trapped vehicle can be 0.7. If the location of the trapped vehicle is in the suburban area, the weight corresponding to the location information of the trapped vehicle can be 0.3. The ACU version can include Version 1 and Version 2. If the ACU version is Version 1, the weight corresponding to the ACU version information of the trapped vehicle can be 0.4. If the ACU version is Version 2, the weight corresponding to the ACU version information of the trapped vehicle can be 0.6. If the task type of the trapped vehicle is the road test stage, the weight corresponding to the task type of the trapped vehicle can be 0.4. If the task type of the trapped vehicle is the operation stage, the weight corresponding to the task type of the trapped vehicle can be 0.6. Further, the priority levels can include the first level, the second level, and the third level. If the server receives three assistance requests, namely Assistance Request 1, Assistance Request 2, and Assistance Request 3, the indicator information of Assistance Request 1 includes having a safety officer following, suburban area, Version 1, and road test. The indicator information of Assistance Request 2 includes no one following during the whole stage, urban area, Version 2, and operation. The indicator information of Assistance Request 3 includes having a safety officer following, suburban area, Version 2, and operation. Then the total weight corresponding to Assistance Request 1 is 1.3, the total weight corresponding to Assistance Request 2 is 2.7, and the total weight corresponding to Assistance Request 3 is 1.7. The priority of Assistance Request 2 can be determined as the first level, the priority of Assistance Request 3 can be determined as the second level, and the priority of Assistance Request 1 is the third level.

[0062] In this embodiment, compared with determining the priority of the assistance request according to a single piece of information, determining the priority of the assistance request according to the weights of multiple indicator information is more accurate in determining the priority of the assistance request comprehensively from multiple aspects, thereby improving the accuracy of the determined priority of the assistance request, and further affecting the timeliness of responding to the operation request.

[0063] In the case where the assistance request of the trapped vehicle cannot be processed in time, waiting is required. During the waiting process, the queue information of the assistance request in the queue of pending requests may change. The following will elaborate on the detailed process of updating the queue information of the assistance request in the queue of pending requests. In one embodiment, the above method further includes: during the process of determining the first control end, updating the queue information of the assistance request in the queue of pending requests according to the waiting time of the assistance request.

[0064] In this embodiment, during the process of determining the first control end, the priority corresponding to the assistance request is relatively low, resulting in a relatively long waiting time for the assistance request. If the assistance request is not responded to for a long time, it will affect the operation and safety of the trapped vehicle. Therefore, the time weight corresponding to the assistance request can be determined according to the waiting time of the assistance request, and then the queue information of the assistance request in the queue of requests to be processed can be updated according to the weight of the vehicle information corresponding to the assistance request and the time weight. For example, the sum of the weights of the vehicle information corresponding to the assistance request and the time weight can be obtained, and the queue information of the assistance request in the queue of requests to be processed can be updated according to this sum of weights. For example, if the sum of weights corresponding to the assistance request is higher, the queue information of the assistance request is more forward.

[0065] Optionally, the waiting time of the assistance request can be used to calculate the time weight corresponding to the assistance request. The longer the waiting time, the higher the time weight corresponding to the assistance request. For example, calculate the sum of the waiting durations of all assistance requests to obtain the total waiting duration. Further, calculate the proportion of the waiting duration of each assistance request in the total waiting duration, and multiply this proportion by the preset weight parameter to obtain the time weight of each assistance request. Then, according to the time weight of each assistance request and the weight of the vehicle information corresponding to each assistance request, the queue information of the assistance request of the trapped vehicle in the queue of requests to be processed is updated.

[0066] Optionally, during the process of determining the first control end, the server can send a prompt message to the trapped vehicle to prompt the trapped vehicle to wait for an idle control end to respond to the assistance request. The trapped vehicle can convert the prompt message into voice information and display the prompt message to the safety officer in the vehicle through the voice output component of the trapped vehicle. Exemplarily, the prompt message can be "The operator is busy, waiting in the queue".

[0067] Further, when there is a safety officer following the trapped vehicle, after the trapped vehicle receives the prompt message sent by the server, it can send a request to stop waiting to the server according to the instruction triggered by the safety officer in the trapped vehicle. After the server receives the request to stop waiting sent by the trapped vehicle, the assistance request of the trapped vehicle is removed from the queue of requests to be processed.

[0068] In this embodiment, considering the impact of the waiting time on the trapped vehicle, the queue information of the assistance request in the queue of requests to be processed is updated according to the waiting time, making the queue information of the assistance request in the queue of requests to be processed more reasonable, so that the first control end can respond to the assistance request in a timely manner.

[0069] Next, the determination process of the first control end will be elaborated in detail. In one embodiment, the above method further includes: determining the control end in the idle state among multiple candidate control ends as the first control end.

[0070] In this embodiment, multiple candidate control terminals corresponding to the assistance request of the trapped vehicle can be determined according to the location information of the trapped vehicle. Further, the control terminal in the idle state among the multiple candidate control terminals is determined as the first control terminal. Exemplarily, if the location information corresponding to the assistance request is City A, multiple control terminals corresponding to City A can be determined as candidate control terminals.

[0071] Optionally, it can be determined whether the control terminal is in the idle state through the status value of the control terminal. Exemplarily, as Figure 4 shown, when the control terminal has not established a communication connection with the server, the status value of the control terminal can be 0; after the control terminal establishes a connection with the server and is idle, the status value of the control terminal can be 1; after the control terminal is determined as the first control terminal, the status value of the control terminal can be 2; when the control terminal responds to the assistance request, the status value of the control terminal can be 3.

[0072] In this embodiment, first, multiple candidate control terminals corresponding to the assistance request are determined from multiple control terminals, and then the first control terminal is determined from the multiple candidate control terminals. The determination method is simple and not error-prone, and the control terminal is only responsible for partial types of assistance requests and is more proficient in responding to the assistance request, thereby improving the efficiency and accuracy of responding to the assistance request.

[0073] Generally, the assistance mode of the trapped vehicle can be the single-vehicle mode, that is, the mode where one control terminal corresponds to one vehicle, or the assistance mode of the trapped vehicle can also be the seat mode, that is, the mode where multiple control terminals correspond to multiple vehicles. Before determining the queue information of the assistance request in the to-be-processed request queue according to the vehicle information, it is necessary to determine whether the trapped vehicle is in the single-vehicle mode or the seat mode. When the trapped vehicle is in the seat mode, then according to the vehicle information, the queue information of the assistance request in the to-be-processed request queue is determined. In one embodiment, the vehicle information includes the identification information of the trapped vehicle, such as Figure 5 shown, the above method further includes:

[0074] S401, determining whether the trapped vehicle is in the single-vehicle mode according to the identification information of the trapped vehicle and the preset database; the preset database includes the vehicle identifiers in the single-vehicle mode.

[0075] Among them, the single-vehicle mode is used to represent that when the vehicle is in distress, the exclusive second control terminal responds to the assistance request of the vehicle, that is, the vehicles in the single-vehicle mode and the control terminals are in one-to-one correspondence.

[0076] In this embodiment, the preset database includes vehicle identifiers of all vehicle models of bicycles. By determining whether the preset database includes the vehicle identifier of the trapped vehicle, it is determined whether the trapped vehicle is in the single-bicycle mode. If the preset database includes the vehicle identifier of the trapped vehicle, it is determined that the trapped vehicle is in the single-bicycle mode; if the preset database does not include the vehicle identifier of the trapped vehicle, it is determined that the trapped vehicle is in the seat mode.

[0077] S402. If the trapped vehicle is in the single-bicycle mode, the assistance request is assigned to the second control end corresponding to the trapped vehicle.

[0078] In this embodiment, the server can pre-store the correspondence between the vehicles of each single-bicycle model and the second control end. Each vehicle in the single-bicycle mode corresponds to a second control end. If the trapped vehicle is a single-bicycle model, according to the correspondence between the vehicles of each single-bicycle model and the second control end, the assistance request of the trapped vehicle is assigned to the corresponding second control end.

[0079] S403. If the trapped vehicle is in the seat mode, execute determining the queue information of the assistance request in the queue of requests to be processed according to the vehicle information.

[0080] Among them, the seat mode means that when an autonomous vehicle is trapped, the server queues the assistance requests sent by the trapped vehicle and assigns the assistance requests to the control ends corresponding to the idle seat modes in sequence according to the queuing order.

[0081] In this embodiment, if the trapped vehicle is in the seat mode, according to the vehicle information, the assistance request and other requests to be processed are sorted to determine the queue information of the assistance request in the queue of requests to be processed, so that the server can assign the assistance request to the first control end in sequence according to the queue of requests to be processed.

[0082] Optionally, during the process of determining the first control end, if it is determined that the trapped vehicle is in the single-bicycle mode, the assistance request is assigned to the second control end corresponding to the trapped vehicle, and the assistance request is removed from the queue of requests to be processed. If the initial state of the trapped vehicle is the seat mode, but during the process of the trapped vehicle waiting to determine the first control end, the trapped vehicle is modified to the single-bicycle mode, then according to the correspondence between the vehicles of each single-bicycle model and the second control end, the assistance request of the trapped vehicle is assigned to the corresponding second control end, and the assistance request is removed from the queue of requests to be processed.

[0083] In this embodiment, by judging the mode corresponding to the trapped vehicle, when the trapped vehicle is in the single-bicycle mode, the assistance request is assigned to the second control end corresponding to the trapped vehicle, and when the trapped vehicle is in the seat mode, according to the vehicle information, the queue information of the assistance request in the queue of requests to be processed is determined, so as to avoid the ineffective sorting of the assistance request when the trapped vehicle is in the single-bicycle mode and affect the timeliness of responding to the assistance request.

[0084] After determining the first control terminal, the first terminal sends a response message to the trapped vehicle through the server. Figure 6 As shown, the above method also includes:

[0085] S501, receiving a first response message sent by a first control terminal; the first response message is generated by the first control terminal in response to an assistance request; the first response message includes operation information for controlling a trapped vehicle to perform an escape operation.

[0086] The first response information may include multiple operation information and the execution order of the multiple operation information.

[0087] In this embodiment, after the server determines the first control end, it sends a prompt message of successful control end matching to the trapped vehicle and forwards the above-mentioned assistance request to the first control end. The first control end responds to the assistance request, generates a first response message corresponding to the assistance request, and sends the first response message to the server.

[0088] Optionally, an operation instruction library may be pre-stored in the first control terminal, the operation instruction library including multiple operation information and the correspondence between each operation information and vehicle information, so that the first control terminal can determine the operation information corresponding to the assistance request based on the vehicle information of the trapped vehicle in the received assistance request and the preset operation instruction library, and form a first response information based on the operation information; or, the first control terminal can generate the first response information based on the instruction information input by the seat personnel corresponding to the first control terminal.

[0089] S502, sending first response information to the trapped vehicle.

[0090] In this embodiment, after receiving the first response information, the server sends the first response information to the corresponding trapped vehicle to instruct the trapped vehicle to perform operations according to the first response information, thereby achieving vehicle escape.

[0091] Optionally, if the first response information includes multiple operation information and the execution order of the multiple operation information, the server sends the first response information to the trapped vehicle. After receiving the first response information, the trapped vehicle can execute the multiple operation information in the execution order of the multiple operation information to escape.

[0092] In this embodiment, the first control end generates a first response message in response to the assistance request, and the first control end sends the first response information to the server, which then sends the first response information to the trapped vehicle, so that the trapped vehicle can perform an escape operation according to the first response message. The transmission of the first response message is completed through the server, which can avoid direct communication between the first control end and the trapped vehicle, reduce the time for the first control end to establish a communication connection with the trapped vehicle, and improve the security of transmitting the first response information.

[0093] When receiving the second response information sent by the trapped vehicle, and the second response information indicates that the trapped vehicle has not escaped, a rescue message is sent to the terminal corresponding to the rescuer. Figure 7 As shown, the above method also includes:

[0094] S601, receiving second response information sent by the trapped vehicle; the second response information is used to indicate whether the trapped vehicle is freed.

[0095] In this embodiment, after the trapped vehicle receives the first response information, it parses the first response information to obtain the operation information corresponding to the trapped vehicle, and performs operations according to the operation information. Furthermore, after the trapped vehicle completes the operation according to the first response information, it can send a second response information to the server according to the current vehicle status to inform the server whether it is out of trouble.

[0096] Exemplarily, if the trapped vehicle is successfully escaped, the second response information sent by the trapped vehicle to the server is used to indicate that the trapped vehicle has been escaped; if the trapped vehicle fails to be escaped, the second response information sent by the trapped vehicle to the server is used to indicate that the trapped vehicle has not been escaped.

[0097] S602: If the second response information indicates that the trapped vehicle has not escaped, a rescue message is sent to a terminal corresponding to the rescue personnel.

[0098] Among them, when there is a safety officer following the trapped vehicle, the rescuer can be the safety officer in the trapped vehicle. When there is no one following the trapped vehicle at all stages, the rescuer can be other rescuers from the outside. There is a corresponding relationship between other rescuers and vehicles. One other rescuer can correspond to multiple vehicles, and one vehicle can also correspond to multiple rescuers.

[0099] In this embodiment, if the second response message indicates that the trapped vehicle has not been rescued, when there is a safety officer following the trapped vehicle, the terminal corresponding to the rescue personnel can be the terminal corresponding to the safety officer in the trapped vehicle, and the rescue information sent can be used to instruct the safety officer to perform rescue operations on the trapped vehicle; or, when the trapped vehicle is in the fully unmanned stage, the terminal where the rescue personnel are located can be other rescue personnel, and the server sends rescue information to the terminals of other rescue personnel corresponding to the trapped vehicle to instruct the other rescue personnel to go to the location where the trapped vehicle is located to perform rescue operations on the trapped vehicle, that is, to instruct the rescue personnel to respond to the assistance request of the trapped vehicle.

[0100] Further, as an optional implementation manner, if the trapped vehicle still cannot be rescued after the safety officer of the trapped vehicle performs rescue operations, the trapped vehicle can send a rescue request for help to external rescue personnel to the server, and the server then sends rescue information to the terminals of other rescue personnel.

[0101] Optionally, the server may fail to allocate an assistance request to the first control end. For example, if the assistance request cannot be sent to the first control end, then the rescue personnel need to assist the trapped vehicle to be rescued. At this time, the server can send rescue information to the terminal corresponding to the rescue personnel to assist the trapped vehicle to be rescued through the rescue personnel. Optionally, as another implementation manner, when the first control end responds to the assistance request of the trapped vehicle, if the communication connection between the first control end and the server fails, or the communication connection between the trapped vehicle and the server fails, the server can also send rescue information to the terminal corresponding to the rescue personnel to assist the trapped vehicle to be rescued through the rescue personnel. Further, as another optional implementation manner, when the server determines that the components of the trapped vehicle are working abnormally, the server can instruct the components of the trapped vehicle to perform initialization operations. If the components of the trapped vehicle are still working abnormally, the server can send rescue information to the terminal corresponding to the rescue personnel to assist the trapped vehicle to be rescued through the rescue personnel.

[0102] In this embodiment, when the trapped vehicle still cannot be rescued, the trapped vehicle sends a second response message to the server, causing the server to send rescue information to the terminal of the rescue personnel, enabling the rescue personnel to promptly perform rescue operations on the trapped vehicle, and further improving the timeliness of responding to the assistance request of the vehicle.

[0103] Next, a specific remote control scenario is used to introduce an embodiment of the present disclosure. Specifically, see Figure 8 As shown, the method includes the following steps:

[0104] S1, receiving an assistance request sent by a trapped vehicle; the assistance request includes vehicle information of the trapped vehicle; the vehicle information includes multiple index information and a vehicle identifier of the vehicle.

[0105] S2, determining whether the trapped vehicle is in single-vehicle mode according to the identification information of the trapped vehicle and a preset database; the preset database includes the identification of vehicles in single-vehicle mode.

[0106] S3: If the trapped vehicle is in single-vehicle mode, the assistance request is allocated to the second control terminal corresponding to the trapped vehicle, and the assistance request is removed from the request queue to be processed.

[0107] S4: If the trapped vehicle is in a seat mode, the priority of the assistance request is determined according to the weight of each indicator information.

[0108] S5: Determine queue information of the assistance request in the queue of pending requests according to the priority of the assistance request.

[0109] S6, determining a control terminal in an idle state among the multiple candidate control terminals as a first control terminal; in the process of determining the first control terminal, updating queue information of the assistance request in the pending request queue according to the waiting time of the assistance request.

[0110] S7, sending a control instruction to the first control terminal according to the queue information of the assistance request; the control instruction is used to instruct the first control terminal to respond to the assistance request.

[0111] S8, receiving a first response message sent by the first control end; the first response message is generated by the first control end in response to the assistance request; the first response message includes operation information for controlling the trapped vehicle to perform an escape operation; and the first response message is sent to the trapped vehicle.

[0112] S9, receiving a second response message sent by the trapped vehicle; the second response message is used to indicate whether the trapped vehicle is freed.

[0113] S10: If the second response information indicates that the trapped vehicle has not escaped, a rescue message is sent to a terminal corresponding to the rescue personnel.

[0114] In the above remote control method, the server receives an assistance request from a trapped vehicle, and the assistance request includes vehicle information of the trapped vehicle, so that the queue information of the assistance request in the to-be-processed request queue can be determined according to the vehicle information. Further, a control instruction is sent to the first control end according to the queue information of the assistance request to instruct the first control end to respond to the assistance request. Compared with the prior art in which the server determines the queue information of the assistance request in the to-be-processed request queue according to the time when the assistance request is received, in the embodiments of the present disclosure, the queue information of the assistance request in the to-be-processed request queue is determined according to the vehicle information of the trapped vehicle, rather than simply according to the reception time of the assistance request of the trapped vehicle. In this way, the queue information of the assistance request of the trapped vehicle in the to-be-processed request queue can be reasonably determined by considering from multiple dimensions in combination with the vehicle information of the trapped vehicle, so that a control instruction can be sent to the first control end in time according to the determined queue information of the assistance request, instructing the first control end to respond to the assistance request of the trapped vehicle in time, and ensuring that the first terminal can respond to the assistance request initiated by the trapped vehicle more timely according to the queue information of the assistance request.

[0115] It should be understood that although Figure 2-8 the steps in the flowchart of Figure 2-8 are shown in sequence according to the indication of the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise clearly stated in this article, the execution of these steps has no strict order limit, and these steps can be executed in other orders. Moreover,

[0116] In one embodiment, as Figure 9 shown, a remote control device is provided, including: a first receiving module 10, a first determining module 11, and a first sending module 12, where:

[0117] The first receiving module 10 is configured to receive an assistance request sent by a trapped vehicle; the assistance request includes vehicle information of the trapped vehicle.

[0118] The first determining module 11 is configured to determine queue information of the assistance request in the to-be-processed request queue according to the vehicle information.

[0119] The first sending module 12 is configured to send a control instruction to the first control end according to the queue information of the assistance request; the control instruction is used to instruct the first control end to respond to the assistance request.

[0120] The remote control device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effects are similar, which will not be elaborated here.

[0121] In one embodiment, as Figure 10 shown, the above first determination module 11 includes: a first determination unit 111 and a second determination unit 112, where:

[0122] The first determination unit 111 is configured to determine the priority of the assistance request according to the vehicle information.

[0123] The second determination unit 112 is configured to determine the queue information of the assistance request in the queue of requests to be processed according to the priority of the assistance request.

[0124] The remote control device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effects are similar, which will not be elaborated here.

[0125] In one embodiment, the above first determination unit 111 is configured to determine the priority of the assistance request according to the weights of the respective index information.

[0126] The remote control device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effects are similar, which will not be elaborated here.

[0127] In one embodiment, as Figure 11 shown, the above device further includes: an update module 13, configured to update the queue information of the assistance request in the queue of requests to be processed according to the waiting time of the assistance request during the process of determining the first control end.

[0128] The remote control device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effects are similar, which will not be elaborated here.

[0129] In one embodiment, as Figure 12 shown, the above device further includes: a second determination module 14, configured to determine the control end in the idle state among the multiple candidate control ends as the first control end.

[0130] The remote control device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effects are similar, which will not be elaborated here.

[0131] In one embodiment, as Figure 13 shown, the above device further includes: a third determination module 15, a distribution module 16, where:

[0132] The third determination module 15 is configured to determine whether the trapped vehicle is in the single-vehicle mode according to the identification information of the trapped vehicle and a preset database; the preset database includes the vehicle identifications of the single-vehicle mode.

[0133] The allocation module 16 is used to allocate the assistance request to the second control terminal corresponding to the trapped vehicle if the trapped vehicle is in single-vehicle mode.

[0134] The remote control device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effect are similar, which will not be repeated here.

[0135] In one embodiment, Figure 14 As shown, the above-mentioned device also includes: a removal module 17, which is used to allocate the assistance request to the second control end corresponding to the trapped vehicle if it is determined that the trapped vehicle is in a single-vehicle mode during the process of determining the first control end, and remove the assistance request from the pending request queue.

[0136] The remote control device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effect are similar, which will not be repeated here.

[0137] In one embodiment, Figure 15 As shown, the above device also includes: a second receiving module 18 and a second sending module 19, wherein:

[0138] The second receiving module 18 is used to receive the first response information sent by the first control end; the first response information is generated by the first control end in response to the assistance request; the first response information includes operation information for controlling the trapped vehicle to perform an escape operation.

[0139] The second sending module 19 is used to send the first response information to the trapped vehicle.

[0140] The remote control device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effect are similar, which will not be repeated here.

[0141] In one embodiment, Figure 16 As shown, the above device further includes: a third receiving module 20 and a third sending module 21, wherein:

[0142] The third receiving module 20 is used to receive the second response information sent by the trapped vehicle; the second response information is used to indicate whether the trapped vehicle is freed.

[0143] The third sending module 21 is used to send rescue information to a terminal corresponding to the rescue personnel if the second response information indicates that the trapped vehicle has not escaped.

[0144] The remote control device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effect are similar, which will not be repeated here.

[0145] For the specific limitations of the remote control device, reference may be made to the limitations of the remote control method in the foregoing text, which will not be elaborated herein. Each module in the above-mentioned remote control device can be implemented in whole or in part by software, hardware, and their combination. Each of the above modules can be embedded in the processor of the electronic device in hardware form or independent of it, or stored in the memory of the electronic device in software form, so that the processor can call and execute the operations corresponding to each of the above modules.

[0146] Figure 17 is a block diagram of a server 1400 shown according to an exemplary embodiment. Referring to Figure 17 , the server 1400 includes a processing component 1420, which further includes one or more processors, and memory resources represented by a memory 1422 for storing instructions or computer programs executable by the processing component 1420, such as application programs. The application programs stored in the memory 1422 may include one or more modules each corresponding to a set of instructions. In addition, the processing component 1420 is configured to execute instructions to perform the above-mentioned remote control method.

[0147] The server 1400 may further include a power supply component 1424 configured to perform power management of the device 1400, a wired or wireless network interface 1426 configured to connect the device 1400 to a network, and an input / output (I / O) interface 1428. The server 1400 may operate based on an operating system stored in the memory 1422, such as Window14 14erverTM, Mac O14 XTM, UnixTM, LinuxTM, FreeB14DTM or the like.

[0148] In an exemplary embodiment, a storage medium including instructions is also provided, such as a memory 1422 including instructions, and the above instructions can be executed by the processor of the server 1400 to complete the above method. The storage medium may be a non-transitory computer-readable storage medium. For example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0149] In an exemplary embodiment, a computer program product is also provided. When the computer program is executed by a processor, the above method can be implemented. The computer program product includes one or more computer instructions. When these computer instructions are loaded and executed on a computer, part or all of the above method can be implemented in accordance with the process or function described in the embodiments of the present disclosure.

[0150] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, storage, database, or other medium used in the embodiments provided by the present disclosure can include at least one of non-volatile and volatile memories. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc.

[0151] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope described in this specification.

[0152] The above-described embodiments merely represent several implementation manners of the embodiments of the present disclosure. The description is relatively specific and detailed, but it should not be construed as a limitation on the scope of the invention patent. It should be noted that for those of ordinary skill in the art, without departing from the concept of the embodiments of the present disclosure, several modifications and improvements can be made, and these all belong to the protection scope of the embodiments of the present disclosure. Therefore, the protection scope of the patent of the embodiments of the present disclosure should be subject to the appended claims.

Claims

1. A remote control method, It is characterized in that The method comprises: Receiving an assistance request sent by a trapped vehicle; the assistance request includes vehicle information of the trapped vehicle; Determining queue information of the assistance request in a queue of pending requests according to the vehicle information; A control instruction is sent to the first control terminal according to the queue information of the assistance request; the control instruction is used to instruct the first control terminal to respond to the assistance request.

2. The method according to claim 1, It is characterized in that The determining, according to the vehicle information, queue information of the assistance request in a queue of pending requests includes: determining a priority of the assistance request according to the vehicle information; According to the priority of the assistance request, queue information of the assistance request in a queue of pending requests is determined.

3. The method according to claim 2, It is characterized in that The vehicle information includes a plurality of index information of the vehicle, and determining the priority of the assistance request according to the vehicle information includes: The priority of the assistance request is determined according to the weight of each indicator information.

4. The method according to any one of claims 1 to 3, It is characterized in that The method further comprises: In the process of determining the first control end, queue information of the assistance request in the pending request queue is updated according to the waiting time of the assistance request.

5. The method according to claim 4, It is characterized in that The method further comprises: A control end in an idle state among a plurality of candidate control ends is determined as the first control end.

6. The method according to claim 1, It is characterized in that The vehicle information includes identification information of the trapped vehicle; and the method further includes: Determine whether the trapped vehicle is in a single-vehicle mode according to the identification information of the trapped vehicle and a preset database; the preset database includes a vehicle identification of the single-vehicle mode; If the trapped vehicle is in single-vehicle mode, assigning the assistance request to a second control terminal corresponding to the trapped vehicle; If the trapped vehicle is in seat mode, the step of determining queue information of the assistance request in a queue of pending requests based on the vehicle information is performed.

7. The method according to claim 6, It is characterized in that The method further comprises: In the process of determining the first control end, if it is determined that the trapped vehicle is in single-vehicle mode, the assistance request is allocated to the second control end corresponding to the trapped vehicle, and the assistance request is removed from the pending request queue.

8. The method according to any one of claims 1 to 3, It is characterized in that The method further comprises: receiving a first response message sent by a first control end; the first response message is generated by the first control end in response to the assistance request; the first response message includes operation information for controlling the trapped vehicle to perform an escape operation; The first response information is sent to the trapped vehicle.

9. The method according to claim 8, It is characterized in that The method further comprises: Receive the second response message sent by the trapped vehicle; the second response message is used to indicate whether the trapped vehicle has been rescued. If the second response message indicates that the trapped vehicle has not been rescued yet, send a rescue message to the terminal corresponding to the rescue personnel.

10. A remote control device Characterized in that The device includes: A first receiving module, configured to receive an assistance request sent by a trapped vehicle; the assistance request includes vehicle information of the trapped vehicle. A first determining module, configured to determine queue information of the assistance request in a to-be-processed request queue according to the vehicle information. A first sending module, configured to send a control instruction to a first control end according to the queue information of the assistance request; the control instruction is used to instruct the first control end to respond to the assistance request.

11. A server, including a memory, a processor, and a computer program stored on the memory and executable on the processor Characterized in that When the processor executes the computer program, the steps of the method according to any one of claims 1 to 9 are implemented.

12. A storage medium, on which a computer program is stored Characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 9 are implemented.

13. A computer program product, including a computer program Characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 9 are implemented.

Images