Method and device for remote driving, electronic device and storage medium

Abstract

The present disclosure provides a remote driving method and device, an electronic device and a storage medium. Based on a vehicle interconnection system and a preset sensor, road condition information within a preset range is acquired. The road condition information and vehicle state information are sent to a remote control end. A control instruction sent by the remote control end is received, and the control instruction is used to control the vehicle. Compared with the related art, the present disclosure acquires road condition information around the vehicle through the vehicle interconnection system and the preset sensor. The road condition information acquired in different ways can complement each other and provide mutual corroboration, and can provide more accurate road condition information for the remote control end. When the unmanned system of the vehicle fails or the use scene of the vehicle is complex, the vehicle can be driven by the remote control end to avoid safety accidents. By acquiring road condition information in different ways, the safety of remote driving the vehicle is further ensured.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of vehicles, and particularly relates to a remote driving method and device, an electronic device and a storage medium. BACKGROUND

[0002] At present, the unmanned driving technology can solve most simple vehicle scenes, but the unmanned driving technology still needs to be improved for complex vehicle scenes. In order to avoid traffic accidents of the unmanned vehicle during driving, almost all unmanned vehicles need to be equipped with a safety officer. Vehicles that have applied the unmanned driving technology also need the driver to constantly pay attention to the road conditions; and cannot achieve complete unmanned driving. When the unmanned driving system of the vehicle fails or appears a vehicle scene that cannot be solved, the safety of the vehicle cannot be guaranteed. SUMMARY

[0003] The present disclosure provides a remote driving method and device, an electronic device and a storage medium. The main purpose is to realize remote control of vehicle driving.

[0004] According to a first aspect of the present disclosure, a remote driving method is provided, comprising:

[0005] obtaining road condition information within a preset range based on a vehicle interconnection system and a preset sensor;

[0006] sending the road condition information and vehicle state information to a remote control end;

[0007] receiving a control instruction sent by the remote control end, wherein the control instruction is used to control the vehicle.

[0008] Optionally, the obtaining of the road condition information within the preset range based on the vehicle interconnection system and the preset sensor comprises:

[0009] obtaining first road condition information within the preset range based on the vehicle interconnection system;

[0010] obtaining second road condition information within the preset range based on the preset sensor;

[0011] performing evaluation processing on the first road condition information and the second road condition information to obtain the road condition information.

[0012] Optionally, the performing of the evaluation processing on the first road condition information and the second road condition information to obtain the road condition information comprises:

[0013] determining whether a connection delay of the vehicle interconnection system is greater than a first preset threshold;

[0014] If the connection delay of the vehicle interconnection system is greater than the first preset threshold, the second road condition information is taken as the road condition information.

[0015] If the connection delay of the vehicle interconnection system is less than or equal to the first preset threshold, the first road condition information and the second road condition information are taken as the road condition information.

[0016] Optionally, after obtaining the road condition information within the preset range based on the vehicle interconnection system and the preset sensor, the method further comprises:

[0017] determining whether to start remote driving based on the road condition information within the preset range and vehicle state information;

[0018] The obtaining of the road condition information within the preset range based on the vehicle interconnection system and the preset sensor further comprises:

[0019] When it is determined to start the remote driving, the road condition information within the preset range is obtained based on the vehicle interconnection system and the preset sensor.

[0020] According to a second aspect of the present disclosure, a method for remote driving is provided, comprising:

[0021] receiving road condition information and vehicle state information within a preset range sent by a vehicle;

[0022] analyzing the road condition information and vehicle state information, and generating a control instruction for controlling the vehicle;

[0023] sending the control instruction to the vehicle so that the vehicle drives according to the control instruction.

[0024] Optionally, before analyzing the road condition information and vehicle state information, and generating a control instruction for controlling the vehicle, the method further comprises:

[0025] based on the road condition information, dividing a danger level and generating corresponding safety warning information;

[0026] if no feedback information of the safety warning information is received within a preset time threshold, increasing the danger level corresponding to the road condition information by one level and issuing corresponding safety warning information, the feedback information being issued when the control instruction is generated.

[0027] Optionally, the analyzing of the road condition information and vehicle state information, and the generating of a control instruction for controlling the vehicle, comprises:

[0028] based on the danger level, sorting the road condition information of different vehicles, different danger levels corresponding to different processing priorities;

[0029] The sorted road condition information is processed according to the processing priority, and the control instruction is generated.

[0030] According to a third aspect of the present disclosure, a device for remote driving is provided, comprising:

[0031] An acquisition unit is configured to acquire road condition information within a preset range based on a vehicle interconnection system and a preset sensor.

[0032] A first sending unit is configured to send the road condition information and vehicle state information to a remote control end.

[0033] A first receiving unit is configured to receive a control instruction sent by the remote control end, wherein the control instruction is used to control the vehicle.

[0034] Optionally, the acquisition unit comprises:

[0035] A first acquisition module is configured to acquire first road condition information within a preset range based on the vehicle interconnection system.

[0036] A second acquisition module is configured to acquire second road condition information within the preset range based on the preset sensor.

[0037] An evaluation module is configured to evaluate and process the first road condition information and the second road condition information to obtain the road condition information.

[0038] Optionally, the evaluation module is further configured to:

[0039] determine whether a connection delay of the vehicle interconnection system is greater than a first preset threshold value;

[0040] if the connection delay of the vehicle interconnection system is greater than the first preset threshold value, the second road condition information is taken as the road condition information;

[0041] if the connection delay of the vehicle interconnection system is less than or equal to the first preset threshold value, the first road condition information and the second road condition information are taken as the road condition information.

[0042] Optionally, the device further comprises:

[0043] A determination unit is configured to determine whether to start remote driving based on the road condition information within the preset range and the vehicle state information after acquiring the road condition information within the preset range based on the vehicle interconnection system and the preset sensor.

[0044] The acquisition unit is further configured to:

[0045] acquire the road condition information within the preset range based on the vehicle interconnection system and the preset sensor when it is determined to start the remote driving.

[0046] According to a fourth aspect of the present disclosure, there is provided a device for remote driving, comprising:

[0047] a second receiving unit configured to receive road condition information and vehicle state information within a preset range sent by a vehicle;

[0048] a generating unit configured to analyze the road condition information and the vehicle state information, and generate a control instruction for controlling the vehicle;

[0049] a second sending unit configured to send the control instruction to the vehicle, so that the vehicle drives according to the control instruction.

[0050] Optionally, the device further comprises:

[0051] a dividing unit configured to, before analyzing the road condition information and the vehicle state information and generating the control instruction for controlling the vehicle, divide a danger level based on the road condition information and generate corresponding safety warning information;

[0052] an increasing unit configured to, if no feedback information of the safety warning information is received within a preset time threshold, increase the danger level corresponding to the road condition information by one level and issue corresponding safety warning information, the feedback information being issued when the control instruction is generated.

[0053] Optionally, the generating unit comprises:

[0054] a sorting module configured to sort the road condition information of different vehicles based on the danger level, different danger levels corresponding to different processing priorities;

[0055] a generating module configured to process the sorted road condition information according to the processing priorities to generate the control instruction.

[0056] According to a fifth aspect of the present disclosure, there is provided an electronic device, comprising:

[0057] at least one processor; and

[0058] a memory communicatively connected with the at least one processor; wherein

[0059] the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method of the first aspect and / or the second aspect.

[0060] According to a sixth aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to perform the method according to the first aspect and / or the second aspect.

[0061] According to a seventh aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the method according to the first aspect and / or the second aspect.

[0062] The present disclosure provides a remote driving method and device, an electronic device and a storage medium. Road condition information in a preset range is obtained based on a vehicle interconnection system and a preset sensor; the road condition information and vehicle state information are sent to a remote control end; and a control instruction sent by the remote control end is received, wherein the control instruction is used to control the vehicle. Compared with the related art, the road condition information around the vehicle is obtained by the vehicle interconnection system and the preset sensor; the road condition information obtained in different ways can be complementary and mutually corroborative, and can provide more accurate road condition information for the remote control end. When the unmanned system of the vehicle fails or the use scene of the vehicle is complex, the vehicle is driven by the remote control end, so that a safety accident can be avoided. The road condition information is obtained in different ways, so that the safety of the remote driving vehicle is further ensured.

[0063] It should be understood that the content described in this part is not intended to identify key or important features of the embodiments of the present application, nor to limit the scope of the present application. Other features of the present application will become apparent from the following description. BRIEF DESCRIPTION OF DRAWINGS

[0064] The accompanying drawings are used to better understand the present scheme and do not limit the present disclosure. Among them:

[0065] Figure 1 A flowchart of a remote driving method provided by an embodiment of the present disclosure;

[0066] Figure 2 A flowchart of another remote driving method provided by an embodiment of the present disclosure;

[0067] Figure 3 A flowchart of another remote driving method provided by an embodiment of the present disclosure;

[0068] Figure 4 A structural diagram of a remote driving device provided by an embodiment of the present disclosure;

[0069] Figure 5 A structural diagram of another remote driving device provided by an embodiment of the present disclosure;

[0070] Figure 6 FIG. 2 shows a schematic diagram of another device for remote driving according to an embodiment of the present disclosure;

[0071] Figure 7 FIG. 2 shows a schematic diagram of another device for remote driving according to an embodiment of the present disclosure;

[0072] Figure 8 FIG. 3 shows a schematic block diagram of an example electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0073] The exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the present disclosure are set forth in order to provide an overall understanding of the embodiments of the present disclosure. It should be noted that the embodiments of the present disclosure can be practiced with variations of these details as would be understood by those of ordinary skill in the art. Therefore, it is to be understood that the embodiments of the present disclosure can be practiced with variations of the details without departing from the scope and spirit of the present disclosure. Similarly, it should be noted that the description of the embodiments of the present disclosure is not intended to limit the present disclosure to the described embodiments, but rather the described embodiments are intended to be exemplary.

[0074] The method and device for remote driving, the electronic device and the storage medium according to the embodiments of the present disclosure are described below with reference to the accompanying drawings.

[0075] Figure 1 FIG. 4 shows a flowchart of a method for remote driving according to an embodiment of the present disclosure.

[0076] As shown in FIG. 4, the method comprises the following steps: Figure 1

[0077] In step 101, road condition information within a preset range is obtained based on a vehicle interconnection system and a preset sensor.

[0078] In the embodiments of the present disclosure, the vehicle interconnection system is a cellular vehicle to everything (C-V2X), referred to as V2X. The V2X can realize vehicle to vehicle (V2V), vehicle to network (V2N), vehicle to infrastructure (V2I), vehicle to pedestrian (V2P), etc. The preset sensor can be a laser radar sensor or an image sensor, which is not limited in the present disclosure. The road condition information is information about pedestrians, vehicles, obstacles and road conditions around the vehicle, which is not limited in the present disclosure.

[0079] ​The preset sensor is greatly affected by the environment. For example, before the vehicle drives to an intersection, the preset sensor can only obtain the road condition information of the current road, and cannot perceive the road condition information of other roads due to the shielding of roadside buildings. When the weather condition is poor, the identification accuracy of the preset sensor will decrease. By obtaining the road condition information in the preset range of the vehicle in different ways, the perception dimension of the vehicle can be improved, and the stability and safety of remote driving can be improved.

[0080] In step 102, the road condition information and vehicle state information are sent to the remote control end.

[0081] The unmanned driving technology has solved most of the simple vehicle scenarios, but it is weak in adapting to complex road conditions and lacks the ability to handle emergencies. The unmanned driving technology is still in the development stage and has not yet reached the mature stage. However, the unmanned driving technology needs to be improved through a large number of use cases to improve the ability of unmanned driving.

[0082] In an embodiment of the present disclosure, when the vehicle equipped with the unmanned driving system drives to a complex road condition or the unmanned driving system of the vehicle fails, the road condition information and vehicle state information are sent to the remote control end. The vehicle state information can include but is not limited to the speed, acceleration, and other information reflecting the state of the vehicle. The remote control end controls the driving of the vehicle according to the road condition information and vehicle state information.

[0083] In step 103, the control instruction sent by the remote control end is received, and the control instruction is used to control the vehicle.

[0084] In an embodiment of the present disclosure, the vehicle can perform data transmission and exchange with the remote control end through but not limited to 5G communication. It can be understood that the remote driving requires that the communication delay be as low as possible. The 5G communication has the characteristics of high transmission rate and low delay. Therefore, the present disclosure does not limit how the vehicle communicates with the remote control end.

[0085] The present disclosure provides a remote driving method, which obtains road condition information in a preset range based on a vehicle interconnection system and a preset sensor, sends the road condition information and vehicle state information to a remote control end, and receives a control instruction sent by the remote control end, wherein the control instruction is used to control the vehicle. Compared with related technologies, the present disclosure obtains the road condition information around the vehicle through the vehicle interconnection system and the preset sensor. The road condition information obtained in different ways can be complementary and mutually corroborative, and can provide more accurate road condition information for the remote control end. When the unmanned driving system of the vehicle fails or the vehicle scenario is complex, the vehicle can be driven by the remote control end to avoid safety accidents. By obtaining the road condition information in different ways, the safety of remote driving the vehicle is further ensured.

[0086] For the purpose of clearly illustrating the embodiments of the present disclosure, the embodiments of the present disclosure provide a flowchart of another method for remote driving.

[0087] As shown in the method comprises the following steps: Figure 2

[0088] Step 201, based on the vehicle interconnection system, obtaining first road condition information within a preset range.

[0089] Step 202, based on a preset sensor, obtaining second road condition information within a preset range.

[0090] In particular, in the embodiments of the present disclosure, the vehicle interconnection system can obtain more road condition information around the vehicle, and the first road condition information of the vehicle interconnection system and the second road condition information obtained by the preset sensor can be complementary and mutually corroborative, ensuring that the vehicle can obtain comprehensive and accurate road condition information. The information obtained by the first road condition information and the second road condition information has the same part, such as the information of the surrounding vehicles; there are also different parts, for example, the first road condition information can include vehicle information that cannot be obtained by the preset sensor (such as the vehicle being blocked by an obstacle).

[0091] Step 203, based on the road condition information within the preset range and the vehicle state information, determining whether to start remote driving.

[0092] In particular, in the embodiments of the present disclosure, when the vehicle travels to a complex section, the road condition information obtained by the vehicle through the preset sensor and the vehicle interconnection system will cause the occupation of the computing power of the vehicle end to be too large. Therefore, after the occupation of the computing power of the vehicle end reaches the warning threshold, it is determined to start remote driving. At the same time, if the vehicle's autonomous driving system fails, it is determined to start remote driving.

[0093] In some other embodiments of the present disclosure, whether to start remote driving is determined by monitoring the density of vehicles within a preset range of the vehicle.

[0094] Step 204, evaluating and processing the first road condition information and the second road condition information to obtain the road condition information.

[0095] As a refinement of the embodiments of the present disclosure, the correction processing of the first road condition information and the second road condition information to obtain the road condition information comprises: determining whether the connection delay of the vehicle interconnection system is greater than a first preset threshold; if the connection delay of the vehicle interconnection system is greater than the first preset threshold, the second road condition information is taken as the road condition information; if the connection delay of the vehicle interconnection system is less than or equal to the first preset threshold, the first road condition information and the second road condition information are taken as the road condition information. ​

[0096] Specifically in the embodiments of the present disclosure, the connection delay is the communication delay of the vehicle interconnection system. The remote driving has a very high requirement on the communication delay, because the remote driving needs to transmit the vehicle and road condition information in real time to ensure that the vehicle can respond in time during driving. Generally speaking, the remote driving needs to ensure that the communication delay is within the millisecond level, which requires that the communication network of the vehicle interconnection system must have the characteristics of high speed, low delay and high reliability.

[0097] If the communication delay of the vehicle interconnection system exceeds the first preset threshold, it can be considered that the first road condition information obtained through the vehicle interconnection system is not suitable for being transmitted to the remote control end as the road condition information. When it is determined that the communication delay of the vehicle interconnection system is less than the first preset threshold, the first road condition information obtained through the vehicle interconnection system can be transmitted to the remote control end as the road condition information.

[0098] Step 205, transmitting the road condition information and the vehicle state information to the remote control end.

[0099] Step 206, receiving the control instruction sent by the remote control end, wherein the control instruction is used for controlling the vehicle.

[0100] For the description of steps 205-206, please refer to the above embodiments, and the embodiments of the present disclosure will not be described one by one.

[0101] Figure 3 Another flowchart of a method for remote driving provided by the embodiments of the present disclosure.

[0102] As shown in the figure, the method comprises the following steps: Figure 3

[0103] Step 301, receiving the road condition information and the vehicle state information within a preset range sent by a vehicle.

[0104] In the embodiments of the present disclosure, the vehicle transmits the road condition information and the vehicle state information within a preset range to the remote control end in real time. The remote driving vehicle can avoid safety accidents caused by faults of the unmanned system or complex road conditions that cannot be handled.

[0105] Step 302, analyzing the road condition information and the vehicle state information, and generating a control instruction for controlling the vehicle.

[0106] ​In the embodiments of this disclosure, control commands for operating the vehicle are generated based on the analysis results of road condition information and vehicle status information. After receiving the road condition information and vehicle status information sent by the vehicle at the remote control terminal, it is necessary to analyze the road condition information and vehicle status information. For example, after the vehicle encounters complex road conditions and initiates remote driving, the surrounding road conditions quickly become clear; then, it is only necessary to observe whether remote driving needs to continue. The road condition information and vehicle status information acquired by the vehicle are projected onto the display device of the virtual cockpit, and the vehicle is remotely driven through the control device in the virtual cockpit.

[0107] In some embodiments of this disclosure, in complex road conditions where the vehicle's computing power is insufficient for autonomous driving, remote autonomous driving is achieved by sending road condition information and vehicle status information to a remote control terminal, utilizing the computing power of the remote control terminal.

[0108] Step 303: Send the control command to the vehicle so that the vehicle can drive according to the control command.

[0109] In the embodiments of this disclosure, after generating control commands at the remote control terminal, the control commands are transmitted to the vehicle in real time, enabling the vehicle to drive according to the control commands. During the testing phase of driverless vehicles, remote driving reduces the need for safety personnel, thereby reducing labor costs and lowering operating costs.

[0110] This disclosure provides a method for remote driving, which involves receiving road condition information and vehicle status information within a preset range sent by a vehicle; analyzing the road condition information and vehicle status information to generate control commands for operating the vehicle; and sending the control commands to the vehicle so that the vehicle can drive according to the control commands. Compared with related technologies, this disclosure acquires road condition information around the vehicle through a vehicle interconnection system and preset sensors; the road condition information acquired through different methods can complement and corroborate each other, providing more accurate road condition information for the remote control terminal. In cases of vehicle autonomous driving system malfunction or complex usage scenarios, driving the vehicle remotely can prevent accidents. Acquiring road condition information through different methods further ensures the safety of remote vehicle driving.

[0111] As one possible implementation of this disclosure, before analyzing the road condition information and vehicle status information and generating control commands to operate the vehicle, the method further includes: classifying hazard levels based on the road condition information and issuing corresponding safety alarm information; if no feedback information of the safety alarm information is received within a preset time threshold, then increasing the hazard level corresponding to the road condition information by one level and issuing corresponding safety alarm information, wherein the feedback information is issued when the control command is generated.

[0112] Specifically, in the embodiments of the present disclosure, the vehicles in need of remote driving are determined by classifying the danger levels based on the real-time road condition information and vehicle state information transmitted by the vehicles. For example, in the virtual cockpit, multiple vehicles can be viewed at the same time, but not all vehicles starting remote driving need to be immediately controlled by remote driving. Therefore, by classifying the danger levels and generating corresponding danger warning information, the operator is prompted to respond to generate control instructions. If the operator does not respond within a preset time threshold, the danger level corresponding to the road condition information is increased by one level, and the corresponding safety warning information is issued.

[0113] As a realizable manner of the embodiments of the present disclosure, the analyzing the road condition information and the vehicle state information and generating the control instructions for controlling the vehicle includes: sorting the road condition information of different vehicles based on the danger levels, different danger levels corresponding to different processing priorities; and processing the sorted road condition information according to the processing priorities to generate the control instructions.

[0114] Specifically, in the embodiments of the present disclosure, after classifying the danger levels according to the road condition information, the vehicles in need of remote driving control are determined by sorting the danger levels of the road condition information of different vehicles. Since the danger levels corresponding to different vehicles change at any time, the processing order of the vehicles in need of remote driving control also changes at any time.

[0115] It should be noted that the embodiments of the present disclosure can include multiple steps, and in order to facilitate description, these steps are numbered, but these numbers are not a limitation on the execution time slots and execution order between the steps; these steps can be implemented in any order, and the embodiments of the present disclosure do not limit this.

[0116] Corresponding to the above-mentioned remote driving method, the present application also proposes a remote driving device. Since the device embodiments of the present application correspond to the above-mentioned method embodiments, for details not disclosed in the device embodiments, please refer to the above-mentioned method embodiments, which will not be described in detail in the present application.

[0117] Figure 4 A structural schematic diagram of a remote driving device provided by the embodiments of the present disclosure is shown in Figure 4 as shown, comprising:

[0118] The acquisition unit 41 is configured to acquire road condition information within a preset range based on a vehicle interconnection system and a preset sensor.

[0119] The first sending unit 42 is configured to send the road condition information and vehicle state information to a remote control end.

[0120] The first receiving unit 43 is configured to receive a control instruction sent by the remote control end, wherein the control instruction is used for controlling the vehicle.

[0121] Further, in a possible implementation manner of the embodiment, as shown in Figure 5 the acquisition unit 41 comprises:

[0122] The first acquisition module 411 is configured to acquire first road condition information within a preset range based on the vehicle interconnection system.

[0123] The second acquisition module 412 is configured to acquire second road condition information within the preset range based on the preset sensor.

[0124] The evaluation module 413 is configured to perform evaluation processing on the first road condition information and the second road condition information to obtain the road condition information.

[0125] Further, in a possible implementation manner of the embodiment, the evaluation module 413 is further configured to:

[0126] determine whether the connection delay of the vehicle interconnection system is greater than a first preset threshold value;

[0127] if the connection delay of the vehicle interconnection system is greater than the first preset threshold value, the second road condition information is taken as the road condition information;

[0128] if the connection delay of the vehicle interconnection system is less than or equal to the first preset threshold value, the first road condition information and the second road condition information are taken as the road condition information.

[0129] Further, in a possible implementation manner of the embodiment, as shown in Figure 5 the device further comprises:

[0130] The determination unit 44 is configured to, after acquiring the road condition information within the preset range based on the vehicle interconnection system and the preset sensor, determine whether to start remote driving based on the road condition information within the preset range and vehicle state information.

[0131] The acquisition unit 41 is further configured to:

[0132] acquire the road condition information within the preset range based on the vehicle interconnection system and the preset sensor when it is determined to start the remote driving.

[0133] Figure 6 A structural schematic diagram of a device for remote driving provided by the embodiment of the present disclosure, as shown in Figure 6 comprises:

[0134] The second receiving unit 51 is configured to receive road condition information and vehicle state information within a preset range sent by a vehicle.

[0135] The generating unit 52 is configured to analyze the road condition information and the vehicle state information, and generate a control instruction for controlling the vehicle.

[0136] The second sending unit 53 is configured to send the control instruction to the vehicle, so that the vehicle drives according to the control instruction.

[0137] Further, in a possible implementation manner of the embodiment, as shown in Figure 7 the device further comprises:

[0138] The dividing unit 54 is configured to, before analyzing the road condition information and the vehicle state information and generating the control instruction for controlling the vehicle, divide a danger level based on the road condition information and issue corresponding safety warning information.

[0139] The increasing unit 55 is configured to, if no feedback information of the safety warning information is received within a preset time threshold, increase the danger level corresponding to the road condition information by one level and issue corresponding safety warning information, the feedback information being issued when the control instruction is generated.

[0140] Further, in a possible implementation manner of the embodiment, as shown in Figure 7 the generating unit 52 comprises:

[0141] The sorting module 521 is configured to sort the road condition information of different vehicles based on the danger level, different danger levels corresponding to different processing priorities.

[0142] The generating module 522 is configured to process the sorted road condition information according to the processing priorities, and generate the control instruction.

[0143] It should be noted that the foregoing explanation and description of the method embodiment are also applicable to the device of the present embodiment, and the principle is the same, which will not be limited in the present embodiment.

[0144] According to the embodiments of the present disclosure, the present disclosure further provides an electronic device, a readable storage medium and a computer program product.

[0145] Figure 8A schematic block diagram of an example electronic device 600 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptops, desktops, tablets, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown here, their connections and relationships, and their functions, are meant to be examples only, and are not intended to limit the implementations of the present disclosure described and / or claimed in this document.

[0146] As shown in FIG. 8, the device 600 includes a computing unit 601 that can perform various appropriate actions and processes according to a computer program stored in a ROM (Read-Only Memory) 602 or a computer program loaded into a RAM (Random Access Memory) 603 from the storage unit 608. In the RAM 603, various programs and data required for the operation of the device 600 can also be stored. The computing unit 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604. An I / O (Input / Output) interface 605 is also connected to the bus 604.

[0147] A plurality of components in the device 600 are connected to the I / O interface 605, including an input unit 606, such as a keyboard, a mouse, and the like; an output unit 607, such as various types of displays, speakers, and the like; a storage unit 608, such as a magnetic disk, an optical disk, and the like; and a communication unit 609, such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 609 allows the device 600 to exchange information / data with other devices through a computer network, such as the Internet, and / or various telecommunication networks.

[0148] The computing unit 601 can be various general and / or special purpose processing components with processing and computing capabilities. Some examples of the computing unit 601 include, but are not limited to, a CPU (Central Processing Unit), a GPU (Graphic Processing Units), various special-purpose AI (Artificial Intelligence) computing chips, various computing units running machine learning model algorithms, a DSP (Digital Signal Processor), and any appropriate processor, controller, microcontroller, etc. The computing unit 601 performs various methods and processes described above, such as the method of remote driving. For example, in some embodiments, the method of remote driving can be implemented as a computer software program, which is tangibly embodied in a machine-readable medium, such as the storage unit 608. In some embodiments, part or all of the computer program can be loaded and / or installed onto the device 600 via the ROM 602 and / or the communication unit 609. When the computer program is loaded onto the RAM 603 and executed by the computing unit 601, one or more steps of the methods described above can be performed. Alternatively, in other embodiments, the computing unit 601 can be configured, by any appropriate means (e.g., by means of firmware), to perform the aforementioned method of remote driving.

[0149] Various implementations of the systems and techniques described above herein can be realized in digital electronic circuitry, integrated circuitry, a Field Programmable Gate Array (FPGA), an Application-Specific Integrated Circuit (ASIC), an ASSP (Application Specific Standard Product), a SOC (System On Chip), a CPLD (Complex Programmable Logic Device), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.

[0150] Program code for carrying out methods of the present disclosure can be written in any combination of one or more programming languages. The program code can be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the program code, when executed by the processor or controller, produces the functions / operations specified in the flowcharts and / or the block diagrams. The program code can be executed entirely on a machine, partially on a machine, partially on a machine as a stand-alone software package, partially on a machine and partially on a remote machine or entirely on a remote machine or server.

[0151] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. Machine-readable storage medium can include, without limitation, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium will include one or more lines of electrical connections, portable computer disks, hard disks, RAM, ROM, EPROM (Electrically Programmable Read-Only-Memory), or flash memory, fiber optics, CD-ROM (Compact Disc Read-Only Memory), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0152] To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having a display device (e.g., a CRT (Cathode-Ray Tube) or LCD (Liquid Crystal Display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

[0153] The systems and techniques described herein can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a user computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described herein), or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, and a blockchain network.

[0154] The computer system can include clients and servers. The clients and servers are generally remote from each other and typically interact through a communication network. The relationship of client and server is one of communication and distribution, with the server generally providing communication and distribution services to the clients. The servers can be cloud servers, also known as cloud computing servers or cloud hosts, which are a host product in the cloud computing service system to solve the defects of large management difficulty and weak business scalability in traditional physical hosts and VPS services ("Virtual Private Server", or simply "VPS"). The servers can also be servers of a distributed system, or servers combined with a blockchain.

[0155] It should be noted that artificial intelligence is a discipline that studies enabling computers to simulate some human thinking processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.), and has both hardware and software technologies. Artificial intelligence hardware technologies generally include technologies such as sensors, special artificial intelligence chips, cloud computing, distributed storage, big data processing, etc.; artificial intelligence software technologies mainly include computer vision technology, speech recognition technology, natural language processing technology, and machine learning / deep learning, big data processing technology, knowledge graph technology, etc.

[0156] It can be understood by those skilled in the art that the first, second, and various other numerical designations involved in the present disclosure are only for the convenience of description and do not limit the scope of the embodiments of the present disclosure, nor represent the order of precedence.

[0157] At least one of the present disclosure can also be described as one or more, multiple can be two, three, four or more, the present disclosure does not make restrictions. In the embodiments of the present disclosure, for a technical feature, the technical features in the technical feature are distinguished by "first", "second", "third", "A", "B", "C" and "D" and the like. The technical features described by "first", "second", "third", "A", "B", "C" and "D" have no order or size order.

[0158] It should be understood that the steps shown above can be reordered, added or deleted. For example, the steps described in the present disclosure can be executed in parallel, sequentially or in different order, as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, which is not limited herein.

[0159] The above specific embodiments do not constitute a limitation on the protection scope of the present disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A method for remote driving, characterized in that, include: Based on the vehicle connectivity system and preset sensors, road condition information within a preset range is obtained; The road condition information and vehicle status information are sent to the remote control terminal; Receive control commands sent by the remote control terminal, wherein the control commands are used to control the vehicle; The acquisition of road condition information within a preset range based on the vehicle connectivity system and preset sensors includes: Based on the vehicle interconnection system, first road condition information within a preset range is obtained; Based on the preset sensor, second road condition information within a preset range is obtained; The first and second road condition information are evaluated and processed to obtain the road condition information; The step of evaluating and processing the first road condition information and the second road condition information to obtain the road condition information includes: Determine whether the connection latency of the vehicle interconnection system is greater than a first preset threshold; If the connection delay of the vehicle interconnection system is greater than the first preset threshold, then the second road condition information will be used as the road condition information. If the connection latency of the vehicle interconnection system is less than or equal to the first preset threshold, then the first road condition information and the second road condition information are used as the road condition information.

2. The method according to claim 1, characterized in that, After acquiring road condition information within a preset range based on the vehicle connectivity system and preset sensors, the method further includes: Based on road condition and vehicle status information within a preset range, determine whether to initiate remote driving; The method of acquiring road condition information within a preset range based on the vehicle interconnection system and preset sensors also includes: When the remote driving is initiated, the road condition information within a preset range is obtained based on the vehicle interconnection system and the preset sensors.

3. A method for remote driving, characterized in that, include: Receive road condition information and vehicle status information sent by vehicles within a preset range; The road condition information and vehicle status information are analyzed, and control commands for operating the vehicle are generated. The control command is sent to the vehicle so that the vehicle drives in accordance with the control command; The method by which the vehicle obtains road condition information within a preset range is as follows: Based on the vehicle connectivity system, obtain the first road condition information within a preset range; Based on preset sensors, acquire second road condition information within a preset range; The first and second road condition information are evaluated and processed to obtain the road condition information; The step of evaluating and processing the first road condition information and the second road condition information to obtain the road condition information includes: Determine whether the connection latency of the vehicle interconnection system is greater than a first preset threshold; If the connection delay of the vehicle interconnection system is greater than the first preset threshold, then the second road condition information will be used as the road condition information. If the connection latency of the vehicle interconnection system is less than or equal to the first preset threshold, then the first road condition information and the second road condition information are used as the road condition information.

4. The method according to claim 3, characterized in that, Before analyzing the road condition information and vehicle status information and generating control commands to operate the vehicle, the method further includes: Based on the road condition information, the danger level is classified and corresponding safety warning information is issued; If no feedback information of the safety alarm is received within the preset time threshold, the danger level corresponding to the road condition information is increased by one level and the corresponding safety alarm information is issued. The feedback information is issued when the control command is generated.

5. The method according to claim 4, characterized in that, The step of analyzing the road condition information and vehicle status information, and generating control commands to operate the vehicle, includes: The road condition information of different vehicles is sorted according to the hazard level, and different hazard levels correspond to different processing priorities; The sorted road condition information is processed according to the processing priority, and the control command is generated.

6. A remote driving device, characterized in that, include: The acquisition unit is used to acquire road condition information within a preset range based on the vehicle interconnection system and preset sensors; The first sending unit is used to send the road condition information and vehicle status information to the remote control terminal; The first receiving unit is used to receive control commands sent by the remote control terminal, wherein the control commands are used to control the vehicle; The acquisition of road condition information within a preset range based on the vehicle connectivity system and preset sensors includes: Based on the vehicle interconnection system, first road condition information within a preset range is obtained; Based on the preset sensor, second road condition information within a preset range is obtained; The first and second road condition information are evaluated and processed to obtain the road condition information; The step of evaluating and processing the first road condition information and the second road condition information to obtain the road condition information includes: Determine whether the connection latency of the vehicle interconnection system is greater than a first preset threshold; If the connection delay of the vehicle interconnection system is greater than the first preset threshold, then the second road condition information will be used as the road condition information. If the connection latency of the vehicle interconnection system is less than or equal to the first preset threshold, then the first road condition information and the second road condition information are used as the road condition information.

7. A remote driving device, characterized in that, include: The second receiving unit is used to receive road condition information and vehicle status information within a preset range sent by the vehicle. The generation unit is used to analyze the road condition information and vehicle status information, and generate control commands to operate the vehicle. The second sending unit is used to send the control command to the vehicle so that the vehicle can drive according to the control command; The method for obtaining the road condition information within the preset range sent by the vehicle is as follows: Based on the vehicle connectivity system, obtain the first road condition information within a preset range; Based on preset sensors, acquire second road condition information within a preset range; The first and second road condition information are evaluated and processed to obtain the road condition information; The step of evaluating and processing the first road condition information and the second road condition information to obtain the road condition information includes: Determine whether the connection latency of the vehicle interconnection system is greater than a first preset threshold; If the connection delay of the vehicle interconnection system is greater than the first preset threshold, then the second road condition information will be used as the road condition information. If the connection latency of the vehicle interconnection system is less than or equal to the first preset threshold, then the first road condition information and the second road condition information are used as the road condition information.

8. An electronic device, characterized in that, include: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-5.

9. A non-transitory computer-readable storage medium storing computer instructions, characterized in that, The computer instructions are used to cause the computer to perform the method according to any one of claims 1-5.

10. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method according to any one of claims 1-5.

Images