Autonomous driving remote control method, autonomous driving vehicle and cloud device

Abstract

To provide a remote control method for autonomous driving with higher safety and reliability in which the vehicle generates a specific control command based on a detour reference route and a current driving environment so that the control command becomes more consistent with an actual driving environment of the vehicle, and also to provide an autonomous driving vehicle and a cloud device.SOLUTION: The method includes steps of: when it is detected that a currently corresponding front road section of a vehicle is impassable, transmitting a support request to a cloud server; acquiring a detour reference route returned from the cloud server; generating a control command based on the detour reference route and the current driving environment of the vehicle; and controlling the driving of the vehicle based on the control command.SELECTED DRAWING: Figure 1A

Description

[Technical field]

[0001] The present disclosure relates to the field of computer technology, specifically to the field of artificial intelligence technology such as autonomous driving and smart transportation, and in particular to a remote control method for autonomous driving, an autonomous driving vehicle, and a cloud device. [Background technology]

[0002] With the rapid development of computer technology, the field of artificial intelligence has also developed rapidly, and technologies such as smart transportation, smart automobiles, and smart driving have become increasingly widely used. As an indispensable part of fields such as smart transportation, smart automobiles, and smart driving, it is important to realize how quickly and accurately the remote control of autonomous driving can be realized. Summary of the Invention

[0003] The present disclosure provides an autonomous driving remote control method, an autonomous driving vehicle, and a cloud device.

[0004] A first aspect of the present disclosure is a remote control method for autonomous driving, comprising the steps of: sending an assistance request to a cloud server when it is detected that a road section ahead that a vehicle currently corresponds to is impassable; obtaining a detour reference route returned from the cloud server; generating a control command based on the detour reference route and the current driving environment of the vehicle; and controlling driving of the vehicle based on the control command.

[0005] A second aspect of the present disclosure is a remote control method for autonomous driving, including a step of determining target driving data in response to an acquired assistance request transmitted from a vehicle, where the assistance request includes an identifier of the vehicle, and the target driving data is vehicle state data and driving environment data related to the identifier of the vehicle; a step of determining a detour reference route corresponding to the vehicle based on the target driving data; and a step of returning the detour reference route to the vehicle.

[0006] A third aspect of the present disclosure is a remote control device for autonomous driving, comprising: a transmission module configured to send an assistance request to the cloud server when it is detected that the road section ahead that the vehicle currently corresponds to is impassable; an acquisition module configured to acquire a detour reference route returned from the cloud server; a generation module configured to generate control commands based on the detour reference route and the current driving environment of the vehicle; and a first control module configured to control driving of the vehicle based on the control commands.

[0007] A fourth aspect of the present disclosure is a remote control device for autonomous driving, comprising: a first determination module configured to determine target driving data in response to an acquired assistance request from a vehicle, where the assistance request includes an identifier of the vehicle, and the target driving data is vehicle state data and driving environment data related to the identifier of the vehicle; a second determination module configured to determine a detour reference route corresponding to the vehicle based on the target driving data; and a second reply module configured to return the detour reference route to the vehicle.

[0008] A fifth aspect of the present disclosure is a vehicle-side electronic device comprising at least one processor and a memory communicatively connected to the at least one processor, wherein the memory stores instructions executable by the at least one processor, and when the instructions are executed by the at least one processor, the at least one processor can execute the remote control method for autonomous driving described in the first aspect above.

[0009] A sixth aspect of the present disclosure is a cloud electronic device comprising at least one processor and a memory communicatively connected to the at least one processor, wherein the memory stores instructions executable by the at least one processor, and when the instructions are executed by the at least one processor, the at least one processor can execute the remote control method for autonomous driving described in the first aspect above.

[0010] A seventh aspect of the present disclosure is a computer program product including a computer program that, when executed by a processor, realizes the remote control method for autonomous driving described in the first aspect above.

[0011] An eighth aspect of the present disclosure is a non-transitory computer-readable storage medium storing computer instructions for causing a computer to execute the remote control method for autonomous driving described in the first aspect above.

[0012] A ninth aspect of the present disclosure is an autonomous driving vehicle equipped with the vehicle-side electronic device according to the fifth aspect.

[0013] A tenth aspect of the present disclosure is a cloud appliance comprising the cloud appliance according to the embodiment of the sixth aspect. An eleventh aspect of the present disclosure is a computer program that, when executed by a processor, realizes the remote control method for autonomous driving described in the first aspect above. Effect of the Invention

[0014] The autonomous driving remote control method, autonomous driving vehicle, and cloud device disclosed herein have the following beneficial effects. When it is detected that the road section ahead that the vehicle currently corresponds to is impassable, an assistance request is sent to a cloud server, a detour reference route is obtained from the cloud server, a control command is generated based on the detour reference route and the current driving environment of the vehicle, and the driving of the vehicle is controlled based on the control command. The cloud server only provides the detour reference route, and then the vehicle generates a specific control command based on the detour reference route and the current driving environment, so that the control command is more consistent with the actual driving environment of the vehicle, and the safety and reliability are higher.

[0015] However, the contents described in this summary are not intended to identify key or important features of the embodiments of the present disclosure, and are not intended to limit the scope of the present disclosure. Other features of the present disclosure will be readily understood through the following description. [Brief description of the drawings]

[0016] The drawings are used for a better understanding of the present technical solution, and are not intended to limit the present disclosure. [Figure 1A] 1 is a schematic flowchart of a remote control method for autonomous driving according to one embodiment of the present disclosure. [Figure 1B] FIG. 2 is a schematic diagram of a detour reference route according to an embodiment of the present disclosure. [Diagram 2] 10 is a schematic flowchart of a remote control method for autonomous driving according to another embodiment of the present disclosure. [Diagram 3] 13 is a schematic flowchart of a remote control method for autonomous driving according to yet another embodiment of the present disclosure. [Figure 4] 1 is a schematic configuration diagram of an autonomous driving remote control device according to one embodiment of the present disclosure. FIG. [Diagram 5] FIG. 11 is a schematic configuration diagram of an autonomous driving remote control device according to another embodiment of the present disclosure. [Figure 6] FIG. 13 is a schematic configuration diagram of an autonomous driving remote control device according to yet another embodiment of the present disclosure. [Figure 7] 1 is a block diagram of a vehicle-side electronic device that executes a remote control method for autonomous driving according to an embodiment of the present disclosure. FIG. [Figure 8] FIG. 1 is a block diagram of a cloud electronic device that executes a remote control method for autonomous driving according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] In the following, exemplary embodiments of the present disclosure will be described in combination with the drawings, and various details of the embodiments of the present disclosure will be included therein for ease of understanding, and they should be regarded as merely illustrative. Therefore, those skilled in the art can make various changes and modifications to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, the following description will omit the description of well-known functions and configurations.

[0018] Artificial intelligence is a field that studies simulating some of the human thought processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.) in computers, and includes both hardware and software level technologies. AI hardware technologies generally include technologies such as sensors, dedicated AI chips, cloud computing, distributed storage, and big data processing, while AI software technologies mainly include computer vision technology, voice recognition technology, natural language processing technology, machine learning, deep learning, big data processing technology, knowledge graph technology, and other technologies.

[0019] Autonomous driving is an assisted driving system that can assist the driver in steering and driving on the road, performing a series of operations such as moving forward, braking, and changing lanes, allowing the driver to control the vehicle at any time, and the system can notify the driver to intervene in control in some specific situations.

[0020] Smart transportation is a comprehensive, real-time, accurate and efficient traffic management system that functions comprehensively over a wide area and is built by effectively integrating and operating advanced information technology, data communication transmission technology, electronic sensing technology, control technology and computer technology into the entire ground traffic management system. It consists of two parts: a traffic information service system and a traffic management system.

[0021] The method for remotely controlling autonomous driving according to the embodiment of the present disclosure can be applied to any vehicle capable of parallel driving. The parallel driving vehicle in the present disclosure refers to any vehicle that can be manually driven, autonomously driven, and controlled by a parallel driving platform via a network connection.

[0022] In addition, the parallel driving platform in the embodiment of the present disclosure may include a cloud server and at least one cockpit. Among them, both the cloud server and the cockpit can be connected to the vehicle via a network as necessary to exchange data with the vehicle. In addition, the cockpit may be provided with a vehicle control simulation module such as a steering wheel, an accelerator pedal, a brake pedal, etc., and other modules capable of controlling the parallel driving vehicles, so that the driver can remotely control the parallel driving vehicles from the cockpit as necessary.

[0023] Note that the names of the cloud server and cockpit in this disclosure are merely schematic and do not limit the scope of protection of this disclosure. In actual use, the cloud server is also called a parallel operation server, a parallel operation console, etc., and the cockpit is also called a smart vehicle compartment, a smart cabin, a cloud server cockpit, a cloud server cabin, etc., and this disclosure is not limited thereto.

[0024] Hereinafter, an autonomous driving remote control method, an autonomous driving vehicle, and a cloud device according to embodiments of the present disclosure will be described in detail with reference to the drawings.

[0025] FIG. 1A is a schematic flowchart of a remote control method for autonomous driving according to an embodiment of the present disclosure.

[0026] The remote control method for autonomous driving according to an embodiment of the present disclosure can be executed by a remote control device for autonomous driving according to an embodiment of the present disclosure, and the device can be disposed in a vehicle.

[0027] As shown in FIG. 1A, the autonomous driving remote control method includes the following steps 101 to 104.

[0028] In step 101, if it is detected that the road section ahead that the vehicle currently corresponds to is impassable, an assistance request is sent to the cloud server.

[0029] Here, the vehicle may encounter an unexpected situation such as a barricade blockage, a temporary change in road, or a traffic regulation during autonomous driving, which may prevent the vehicle from passing through normally or may cause an unexpected situation due to the vehicle being unable to respond immediately. In an embodiment of the present disclosure, when an autonomous vehicle detects that the vehicle cannot pass through the current road section while driving, it can send an assistance request to a cloud server.

[0030] It should be appreciated that to further ensure the safety of the vehicle and passengers, the vehicle may choose to stop or reduce its driving speed before sending a request for assistance to the cloud server, thereby reducing safety risks.

[0031] In step 102, the detour reference route returned from the cloud server is obtained.

[0032] Here, the detour reference route is a route that the cloud server generates based on the collected driving environment data of the vehicle after receiving the assistance request transmitted from the vehicle.

[0033] In addition, the detour reference route acquired by the vehicle may be in various forms. For example, the detour reference route may be the coordinates of one destination point, or the detour reference route may be the coordinates of a series of consecutive destination points. That is, after acquiring the assistance request sent by the vehicle, the cloud server does not need to provide specific control instructions to the vehicle, but only needs to provide the vehicle driving route.

[0034] Note that the above forms are merely examples and do not limit the forms of the detour reference route in the embodiments of the present disclosure.

[0035] In step 103, a control command is generated based on the detour reference route and the current driving environment of the vehicle.

[0036] Here, the current driving environment is determined by the vehicle based on data collected by each sensor and camera mounted on the vehicle, and may include, for example, the distance between the vehicle and obstacles in various directions, the road width, the weather, etc., and this disclosure is not limited thereto.

[0037] In actual use, when the detouring reference route is the coordinates of a target point, the vehicle can calculate a route from the current position to the target point according to the current driving environment, and generate corresponding control commands according to the route. Alternatively, the detouring reference route is the coordinates of a series of target points, and after receiving the coordinates of the series of target points, the vehicle first constructs a route based on the series of target points, and then generates corresponding control commands according to the current driving environment and the route. Alternatively, the detouring reference route is the coordinates of a series of target points, and after receiving the coordinates of the series of target points, the vehicle sequentially constructs a route between two adjacent target points and corresponding control commands according to the coordinates and order of the series of target points.

[0038] For example, the detouring reference route as shown in Fig. 1B includes target points A, B, C, D, and E, and the vehicle first constructs a detouring reference route as shown in Fig. 1B based on the position of each target point, and then analyzes the detouring reference route according to the current driving environment and generates a corresponding control command. For example, the vehicle first determines a driving route for driving from the current position to the target point A, and then generates a corresponding control command based on the driving route, and the control command may be that the vehicle drives at a current speed or decelerates.

[0039] Alternatively, when the vehicle drives to the target point B, the vehicle determines a driving route to the target point C based on the current position and the data collected by each sensor and camera mounted on the vehicle, and further generates a corresponding control command based on the driving route, which may be by rotating the steering wheel of the vehicle 45 degrees to the left, or by driving straight and then turning left.

[0040] Note that the above examples are merely examples and do not limit the control commands in the present disclosure.

[0041] In step 104, the operation of the vehicle is controlled based on the control command.

[0042] It should be understood that, in order to further improve the safety of vehicle driving and reduce the risk of unexpected events, the autonomous vehicle may continue to detect obstacles in the process of controlling the driving of the vehicle based on the control command, and if the autonomous vehicle detects an obstacle, it may indicate that there may be a safety risk on the current detour reference route, and thus the autonomous vehicle may be controlled to stop and send an assistance request to the cloud server again.

[0043] It should be understood that in the embodiments of the present disclosure, when a vehicle encounters an impassable road section ahead, when sending an assistance request to the cloud server, the cloud server only provides the vehicle with a detour reference route, and then the vehicle generates corresponding control commands based on the current real-time driving environment, thereby not only avoiding the vehicle from being stuck during autonomous driving, but also ensuring that the commands for controlling the vehicle are generated by the vehicle based on the latest driving environment, that is, the control commands for controlling the driving of the vehicle are safe and reliable.

[0044] In an embodiment of the present disclosure, when it is detected that the road section ahead that the vehicle currently corresponds to is impassable, an assistance request is sent to the cloud server, a detour reference route is obtained from the cloud server, a control command is generated based on the detour reference route and the current driving environment of the vehicle, and the driving of the vehicle is controlled based on the control command. The cloud server only provides the detour reference route, and then the vehicle generates a specific control command based on the detour reference route and the current driving environment, so that the control command is more consistent with the actual driving environment of the vehicle, and the safety and reliability are higher.

[0045] In addition, since the detour reference route is determined by the cloud server based on the vehicle driving environment known to the vehicle, and the driving environment at the time when the vehicle acquires the detour reference route may have already changed, the vehicle may not be able to obtain an accurate control command when generating a control command based on the detour reference route and the current driving environment of the vehicle. Therefore, in one possible embodiment of the present disclosure, after the vehicle acquires the detour reference route returned from the cloud server, the vehicle may first perform a safety check of the detour reference route, and determine whether to generate a control command based on the result of the safety check. Hereinafter, with reference to FIG. 2, another remote control method for autonomous driving according to an embodiment of the present disclosure will be further described.

[0046] FIG. 2 is a schematic flowchart of a remote control method for autonomous driving according to another embodiment of the present disclosure.

[0047] In step 201, if it is detected that the road section ahead that the vehicle currently corresponds to is impassable, an assistance request is sent to the cloud server.

[0048] In step 202, a detour reference route returned from the cloud server is obtained.

[0049] In step 203, a safety check is performed on the detour reference route based on the current driving environment of the vehicle.

[0050] It should be understood that the driving environment for the cloud server to generate the detouring reference route may not be completely consistent with the current actual driving environment of the vehicle, so before the vehicle generates a control command based on the detouring reference route, it needs to perform a safety check on the detouring route, and thereby generate a corresponding control command based on the corresponding check result.

[0051] When performing a safety check of a detour reference route, the check can be performed from various aspects.

[0052] For example, based on data collected by the sensors and cameras mounted on the vehicle, it can be determined whether another vehicle will suddenly overtake the vehicle from behind, whether another vehicle will approach from the opposite direction, or whether a pedestrian will suddenly intrude into the road while the vehicle is driving from the current position to the target point. That is, it is possible to check whether there is a safety risk while the vehicle is driving from the current position to the target point.

[0053] Alternatively, the vehicle obtains the distance between the vehicle and the obstacle based on the data collected by each sensor and camera, and then checks whether the distance to the obstacle is too close and poses a safety hazard when driving along the detour reference route.

[0054] Alternatively, based on the detected vehicle width from the road surface, it is checked whether it is safe for the current vehicle to drive along the reference route.

[0055] It should be noted that the above checking method is merely an example, and the embodiment of the present disclosure is not limited to checking the safety of the detour reference route.

[0056] In step 204, if the detour reference route passes the safety check, calculate the current driving trajectory, speed and / or departure time based on the current position of the autonomous vehicle, the current driving environment and the coordinates of the destination point.

[0057] Here, if the detour reference route passes the safety check, it indicates that the vehicle can be driven according to the detour reference route.

[0058] In order to further ensure the reliability of the generated control commands and reduce the risk of unexpected events occurring, during a specific driving operation, the vehicle can first calculate the corresponding driving trajectory, driving speed and / or departure time based on the current position, driving environment and coordinates of the target point.

[0059] For example, in the detour reference route shown in Figure 1B, there are target points A, B, C, D, and E. When a vehicle wants to drive from its current position to target point A, the vehicle first calculates the driving trajectory, speed, and departure time from the current position to target point A based on the current position, driving environment, and coordinates of point A.

[0060] It should be noted that the above examples are merely examples, and the embodiments of the present disclosure are not limited to calculating the corresponding driving trajectory, driving speed, and / or departure time.

[0061] In step 205, generate respective control commands corresponding to respective execution mechanisms in the vehicle based on the current driving trajectory, speed and / or departure time.

[0062] Here, the vehicle generates corresponding control commands based on different situations of the calculated current driving trajectory, speed and / or departure time.

[0063] For example, in the detour reference route as shown in FIG. 1B, the driving trajectory, speed and departure time from the current position to the target point A have already been calculated, so that a corresponding control command can be generated, which may be that the steering wheel maintains the current angle, drives at the current speed, and departs after 2 seconds.

[0064] Alternatively, in the detour reference route as shown in FIG. 1B , the driving trajectory, speed and departure time from destination point A to destination point B have already been calculated, so that a corresponding control command can be generated, which may be that the steering wheel of the vehicle is rotated 45 degrees to the left, driving at the current speed, and departing after 1 second.

[0065] Note that the above examples are merely examples and do not limit the control commands in the present disclosure.

[0066] It should be appreciated that the generated control commands may not include a speed, in which case the vehicle may default to driving in the scenario at a pre-defined speed that is less than the autonomous vehicle's current driving speed, or the pre-defined speed may be a set fixed value at which the vehicle drives when remotely driven.

[0067] Also, during actual driving, if the current driving trajectory, speed and / or departure time are abnormal, a message of target point error can be returned to the cloud server so that the cloud server updates the target point.

[0068] Here, the error message may include evidence of the collision with the target point, such as captured images or driving parameters of the vehicle in the execution mechanism.

[0069] For example, if the current driving trajectory calculated by the vehicle is not feasible based on the actual driving conditions and the collected images, the target point error and the collected images can be returned to the cloud server so that the cloud server can update the target point.

[0070] Alternatively, if the current driving speed calculated by the vehicle is obviously too high, it can send the aim point error and the driving parameters of the vehicle back to the cloud server so that the cloud server can update the aim point.

[0071] It should be noted that the above situations are merely examples and are not intended to limit abnormal situations in the embodiments of the present disclosure.

[0072] In step 206, the operation of the vehicle is controlled based on the control command.

[0073] In this embodiment, after the vehicle obtains the detour reference route returned from the cloud server, the vehicle first performs a safety check on the detour reference route, and only if the check is passed, the vehicle calculates a current driving trajectory, speed and / or departure time based on the current position, current driving environment and coordinates of the target point of the autonomous driving vehicle, and generates a corresponding control command based on the calculation result, and controls the driving of the vehicle using the control command. By first performing a safety check on the detour reference route, the safety of the detour reference route can be further ensured, the accuracy and feasibility of each generated control command can be further improved, and the vehicle can avoid wasting resources and time in calculating driving parameters when the detour reference route is abnormal.

[0074] In the above embodiment, the vehicle-side remote control method in the autonomous driving process is described. Hereinafter, the vehicle-side remote control method in the autonomous driving process in the cloud server will be described in detail with reference to FIG.

[0075] FIG. 3 is a schematic flowchart of a remote control method in an autonomous driving process according to an embodiment of the present disclosure.

[0076] The remote control method in an autonomous driving process according to an embodiment of the present disclosure can be executed by a remote control device in an autonomous driving process according to an embodiment of the present disclosure, and the device can be located on a cloud server.

[0077] In step 301, target driving data is determined in response to an acquired request for assistance from the vehicle.

[0078] Here, the assistance request includes a vehicle identifier.

[0079] The target driving data is vehicle state data and driving environment data associated with an identifier for the vehicle.

[0080] It should be understood that the data uploaded by the vehicle to the cloud server may include the vehicle's current location, photos collected by the onboard camera, the current operating status of various onboard devices, such as speed, steering wheel steering angle, etc.

[0081] When the cloud server receives the vehicle identifier transmitted from the vehicle, it can determine the vehicle that transmitted the assistance request, thereby determining target driving data based on the data that the vehicle uploaded to the cloud server.

[0082] In step 302, a detour reference route is determined for the vehicle based on the target driving data.

[0083] It should be understood here that in order to improve the accuracy of the detour reference route, the cloud server can first build a current corresponding driving environment reference map of the vehicle on the display screen based on the target driving data.

[0084] Here, the driving environment reference map may include the vehicle's current position, the distance between the vehicle and obstacles in each direction, other surrounding vehicles, pedestrians, road surfaces, etc., and the present disclosure is not limited thereto.

[0085] Also, the detour reference route can be determined in various ways.

[0086] The driver in the cockpit can select each reference point on the screen based on the driving environment reference map, and after acquiring the touch operation, the background system may determine each reference point selected by the driver as each target point on the detour reference route, and then generate the detour reference route by sequentially connecting each target point.

[0087] The background system of the cloud server may automatically select corresponding target points in the driving environment reference map based on the target driving data, and then generate corresponding detour reference routes.

[0088] Alternatively, the background system of the cloud server automatically selects corresponding reference points in the driving environment reference map based on the target driving data, and then the driver checks them, and generates a corresponding detour reference route by setting the points that pass the check as target points of the detour reference route.

[0089] For example, in the detour reference route map shown in FIG. 1B , the driver in the cockpit selects points A, B, C, D, and E on the screen as respective reference points based on the driving environment reference map, and when the background system obtains this touch operation, it can determine each of points A, B, C, D, and E as respective target points in the detour reference route, and then generate the corresponding detour reference route by sequentially connecting each of the target points A, B, C, D, and E.

[0090] It should be noted that the above method is merely an example, and the embodiment of the present disclosure is not limited to determining a detour reference route.

[0091] In step 303, a detour route reference is returned to the vehicle.

[0092] Here, after determining the detour reference route, the cloud server can return the detour reference route to the vehicle.

[0093] It should be appreciated that the detour reference route may take a variety of forms.

[0094] The cloud server may transmit the coordinates of each point one by one to the vehicle based on the position order of each point on the detour reference route.

[0095] Alternatively, the cloud server may transmit the coordinates of each point on the detour reference route to the vehicle all at once, based on the position order of each point on the detour reference route.

[0096] Note that the above example is merely an example, and the embodiment of the present disclosure is not limited to a form in which the cloud server transmits a detour reference route to a vehicle.

[0097] In an embodiment of the present disclosure, after the cloud server obtains an assistance request from a vehicle, it first determines target driving data, determines a detour reference route corresponding to the vehicle according to the target driving data, and then returns the detour reference route to the vehicle, and the vehicle generates a corresponding control command according to the detour reference route returned by the cloud server and the current driving environment, and further controls the driving of the vehicle. The cloud server only provides the detour reference route, and then the vehicle generates a specific control command according to the detour reference route and the current driving environment, so that the control command is more consistent with the actual driving environment of the vehicle, and the safety and reliability are higher.

[0098] According to an embodiment of the present disclosure, the present disclosure further provides a remote control device for autonomous driving.

[0099] FIG. 4 is a schematic configuration diagram of an autonomous driving remote control device according to an embodiment of the present disclosure.

[0100] As shown in FIG. 4 , the autonomous driving remote control device 400 includes a sending module 410, an acquiring module 420, a generating module 430, and a first control module 440.

[0101] Here, the sending module 410 is configured to send an assistance request to the cloud server when it is detected that the road section ahead currently corresponding to the vehicle is impassable.

[0102] The obtaining module 420 is configured to obtain the detour reference route returned from the cloud server.

[0103] The generation module 430 is configured to generate control instructions based on the detour reference route and the current driving environment of the vehicle.

[0104] The first control module 440 is configured to control operation of the vehicle based on the control command.

[0105] In addition, the above description of the embodiment of the remote control method in the autonomous driving process is also applicable to the remote control device in the autonomous driving process according to the embodiment of the present disclosure, and the implementation principle is similar, so the description will be omitted here.

[0106] When the autonomous driving remote control device according to the embodiment of the present disclosure detects that the road section ahead that the vehicle currently corresponds to is impassable, it sends an assistance request to the cloud server, obtains a detour reference route returned from the cloud server, generates a control command based on the detour reference route and the current driving environment of the vehicle, and controls the driving of the vehicle based on the control command. The cloud server only provides the detour reference route, and then the vehicle generates a specific control command based on the detour reference route and the current driving environment, so that the control command is more consistent with the actual driving environment of the vehicle, and the safety and reliability are higher.

[0107] FIG. 5 is a schematic configuration diagram of a remote control device for autonomous driving according to another embodiment of the present disclosure.

[0108] As shown in FIG. 5, the autonomous driving remote control device 500 includes a transmitting module 510, an acquiring module 520, a generating module 530, a first control module 540, a first reply module 550, a second control module 560, and a detecting module 570.

[0109] Here, the sending module 510 is configured to send an assistance request to the cloud server when it is detected that the road section ahead currently corresponding to the vehicle is impassable.

[0110] It should be understood that the transmitting module 510 in this embodiment can have the same function and configuration as the transmitting module 410 in the above embodiment.

[0111] The obtaining module 520 is configured to obtain the detour reference route returned from the cloud server.

[0112] It should be understood that the acquisition module 520 in this embodiment can have the same function and configuration as the acquisition module 420 in the above embodiment.

[0113] The generation module 530 includes: a check unit 5310, configured to perform a safety check of the detouring reference route based on the current driving environment of the vehicle; and a generation unit 5320, configured to generate control instructions corresponding to the detouring reference route if the detouring reference route passes the safety check, and generate each control instruction respectively corresponding to each execution mechanism in the vehicle based on the current driving trajectory, speed and / or departure time; and a calculation unit 5330 configured to calculate a current driving trajectory, a speed and / or a departure time based on the current position of the autonomous vehicle, the current driving environment and the coordinates of the target point.

[0114] It should be understood that the generating module 530 in this embodiment can have the same function and configuration as the generating module 430 in the above embodiment.

[0115] The first control module 540 is configured to control operation of the vehicle based on the control command.

[0116] It should be understood that the first control module 540 in this embodiment may have the same function and configuration as the first control module 440 in the above embodiment.

[0117] The first reply module 550 is configured to reply a message of the destination point error to the cloud server if the current driving trajectory, speed and / or departure time are abnormal, so that the cloud server updates the destination point.

[0118] The second control module 560 is configured to control the vehicle to stop or to reduce the driving speed of the vehicle.

[0119] The detection module 570 is configured to detect an obstacle during the process of controlling the driving of the vehicle based on the control command, and is configured to control the autonomous vehicle to stop when an obstacle is detected, and to send an assistance request to the cloud server again.

[0120] In addition, the above description of the embodiment of the remote control method in the autonomous driving process is also applicable to the remote control device in the autonomous driving process according to the embodiment of the present disclosure, and the implementation principle is similar, so the description will be omitted here.

[0121] In the embodiment of the present disclosure, after the vehicle obtains the detour reference route returned from the cloud server, the remote control device for autonomous driving first performs a safety check on the detour reference route, and only if the check is passed, calculates a current driving trajectory, speed and / or departure time based on the current position, current driving environment and coordinates of the target point of the autonomous driving vehicle, and generates a corresponding control command based on the calculation result, thereby controlling the driving of the vehicle using the control command. By first performing a safety check on the detour reference route, the safety of the detour reference route can be further ensured, the accuracy and feasibility of each generated control command can be further improved, and the vehicle can avoid wasting resources and time in calculating driving parameters when the detour reference route is abnormal.

[0122] FIG. 6 is a schematic configuration diagram of a remote control device in an automatic driving process according to yet another embodiment of the present disclosure.

[0123] As shown in FIG. 6, the autonomous driving remote control device 600 includes a first determination module 610, a second determination module 620, and a second reply module 630.

[0124] Here, the first determination module 610 is configured to determine target driving data in response to an acquired request for assistance from a vehicle, where the request for assistance includes an identifier of the vehicle, and the target driving data is vehicle state data and driving environment data associated with the identifier of the vehicle.

[0125] The second determination module 620 is configured to determine a detour reference route corresponding to the vehicle based on the target driving data.

[0126] In a possible implementation form, the second determination module 620 further includes a construction unit 6210 configured to construct a current corresponding driving environment reference map of the vehicle on the display screen based on the target driving data, a determination unit 6220 configured to determine each target point on the detour reference route in response to a touch operation acquired on the display screen, and a generation unit 6230 configured to generate a detour reference route by sequentially connecting each target point.

[0127] The second reply module 630 is configured to reply the detour route reference to the vehicle.

[0128] In addition, the above description of the embodiment of the remote control method in the autonomous driving process is also applicable to the remote control device in the autonomous driving process according to the embodiment of the present disclosure, and the implementation principle is similar, so the description will be omitted here.

[0129] In the autonomous driving remote control device according to the embodiment of the present disclosure, after the cloud server receives an assistance request from the vehicle, the cloud server first determines target driving data, determines a detour reference route corresponding to the vehicle based on the target driving data, and then returns the detour reference route to the vehicle, and the vehicle generates a corresponding control command based on the detour reference route returned by the cloud server and the current driving environment, and further controls the driving of the vehicle. The cloud server only provides the detour reference route, and the vehicle then generates a specific control command based on the detour reference route and the current driving environment, so that the control command is more consistent with the actual driving environment of the vehicle, and the safety and reliability are higher.

[0130] According to an embodiment of the present disclosure, the present disclosure further provides an electronic device and a readable storage medium.

[0131] It should be understood that the electronic device may be a vehicle-side electronic device or a cloud electronic device.

[0132] 7 is a block diagram of a vehicle-side electronic device that executes a remote control method for autonomous driving according to an embodiment of the present disclosure. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, mobile phones, smartphones, wearable devices, and other similar computing devices. The components shown in this specification, their connections and relationships, and their functions are merely examples and are not intended to limit the description of the present specification and / or the implementation of the present disclosure as required.

[0133] As shown in FIG. 7, the vehicle side electronic device includes one or more processors 701, a memory 702, and an interface for connecting each component with a high-speed interface and a low-speed interface. Each component can be connected to each other by different buses and mounted on a common motherboard, or mounted in other manners as needed. The processor can process instructions executed in the electronic device, including instructions in or stored in the memory for displaying graphical information of a GUI on an external input / output device (e.g., a display device coupled to the interface). In other embodiments, multiple processors and / or multiple buses can be used along with multiple memories as needed. Similarly, multiple electronic devices can be connected, each device can provide some required operations (e.g., a server array, a group of blade servers, or a multi-processor system). In FIG. 7, one processor 701 is taken as an example.

[0134] The memory 702 is a non-transitory computer-readable storage medium provided by the present disclosure, in which the memory stores instructions executable by at least one processor to cause the at least one processor to execute the method for remote control of autonomous driving provided by the present disclosure. The non-transitory computer-readable storage medium of the present disclosure stores computer instructions for causing a computer to execute the method for remote control of autonomous driving provided by the present disclosure.

[0135] The memory 702 stores, as a non-transitory computer-readable storage medium, non-transitory software programs, non-transitory computer-executable programs, and modules, such as program instructions / modules (e.g., the sending module 410, the acquiring module 420, the generating module 430, and the first control module 440 shown in FIG. 4) corresponding to the autonomous driving remote control method in the embodiment of the present disclosure. The processor 701 executes the non-transitory software programs, instructions, and modules stored in the memory 702 to execute various functional applications and data processing of the server, that is, to realize the autonomous driving remote control method in the above embodiment of the method.

[0136] The memory 702 may include a storage program area and a storage data area, in which the storage program area may store an operating system, an application program required for at least one function, and the storage data area may store data created by the use of the electronic device of the remote control of the autonomous driving, etc. The memory 702 may also include a high-speed random access memory, and may further include a non-transient memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory 702 may selectively include a memory configured remotely with respect to the processor 701, and these remote memories may be connected to the electronic device of the remote control method of the autonomous driving through a network. Examples of the above networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0137] The vehicle-side electronic device of the autonomous driving remote control method may further include an input device 703 and an output device 704. The processor 701, the memory 702, the input device 703, and the output device 704 may be connected via a bus or other methods, and FIG. 7 illustrates an example in which they are connected via a bus.

[0138] The input device 703 can receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device of the autonomous driving remote control method, such as a touch screen, a keypad, a mouse, a track pad, a touchpad, a pointing stick, one or more mouse buttons, a trackball, a joystick, etc. The output device 704 can include a display device, an auxiliary lighting device (e.g., LED), and a haptic feedback device (e.g., vibration motor), etc. The display device can include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display, and a plasma display. In some embodiments, the display device can be a touch screen.

[0139] As shown in FIG. 8, a block diagram of a cloud electronic device that executes a remote control method for autonomous driving according to an embodiment of the present disclosure.

[0140] As shown in FIG. 8, the cloud electronic device includes one or more processors 801, memory 802, and an interface for connecting each component with a high-speed interface and a low-speed interface. Each component can be connected to each other by different buses and mounted on a common motherboard, or mounted in other manners as needed. The processor can process instructions executed in the electronic device, including instructions in or stored in the memory for displaying graphical information of a GUI on an external input / output device (e.g., a display device coupled to the interface). In other embodiments, multiple processors and / or multiple buses can be used along with multiple memories as needed. Similarly, multiple electronic devices can be connected, each of which can provide some required operations (e.g., a server array, a group of blade servers, or a multi-processor system). In FIG. 8, one processor 801 is taken as an example.

[0141] The cloud electronic device may further include an input device 803 and an output device 804.

[0142] In addition, the memory 802, input device 803, and output device 804 in the cloud electronic device can have the same configuration and functions as the memory 702, input device 703, and output device 704 in the vehicle-side electronic device, respectively, and so description thereof will be omitted here.

[0143] The present disclosure further provides an autonomous vehicle, which may be equipped with the vehicle-side electronic devices in the above embodiments, and may also be equipped with other related devices capable of operating the vehicle, and the present disclosure is not limited thereto.

[0144] The present disclosure further provides a cloud appliance, which may include the cloud electronic appliance in the above embodiments.

[0145] Specifically, the cloud electronic device may be the cloud server in the above embodiment.

[0146] Furthermore, the cloud device may further include the cockpit in the above embodiment.

[0147] Various embodiments of the systems and techniques described herein may be realized in digital electronic circuitry systems, integrated circuit systems, application specific integrated circuits (ASICs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may be embodied in one or more computer programs that may be executed and / or interpreted by a programmable system that includes at least one programmable processor, which may be a special purpose or general purpose programmable processor, and that may receive data and instructions from and transmit data and instructions to a storage system, at least one input device, and at least one output device.

[0148] These computing programs (also referred to as programs, software, software applications, or code) may include machine instructions for a programmable processor and may be implemented in high level process and / or object oriented programming languages ​​and / or assembly / machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and / or device (e.g., magnetic disk, optical disk, memory, programmable logic device (PLD)) for providing machine instructions and / or data to a programmable processor, including a machine-readable medium for receiving machine instructions that are a machine-readable signal. The term "machine-readable signal" refers to any signal for providing machine instructions and / or data to a programmable processor.

[0149] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user, and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other types of devices can also provide interaction with a user, for example, the feedback provided to the user can be any form of sensing feedback (e.g., visual feedback, auditory feedback, or haptic feedback) and can receive input from the user in any form (including acoustic input, speech input, and haptic input).

[0150] The systems and techniques described herein may be implemented in a computing system with a back-end component (e.g., a data server), or a computing system with a middleware component (e.g., an application server), or a computing system with a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user interacts with the embodiments of the systems and techniques described herein), or any combination of such back-end, middleware, and front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), the Internet, and a blockchain network.

[0151] The computer system may include a client and a server. The client and the server are generally remote from each other and usually interact with each other through a communication network. The relationship between the client and the server is generated by a computer program that runs on a corresponding computer and has a client-server relationship with each other. The server may be a cloud server, also called a cloud computing server or cloud host, which is a host product of a cloud computing service system, and solves the shortcomings of traditional physical hosts and VPS (Virtual Private Server) services, such as difficult management and weak business scalability. The server may be a server of a distributed system or a server combined with a blockchain.

[0152] According to the technical solution of the embodiment of the present disclosure, when it is detected that the road section ahead that the vehicle currently corresponds to is impassable, an assistance request is sent to the cloud server, a detour reference route is obtained from the cloud server, a control command is generated according to the detour reference route and the current driving environment of the vehicle, and the driving of the vehicle is controlled according to the control command. The cloud server only provides the detour reference route, and then the vehicle generates a specific control command according to the detour reference route and the current driving environment, so that the control command is more consistent with the actual driving environment of the vehicle, and the safety and reliability are higher.

[0153] An embodiment of the present disclosure further provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, can realize the remote control method for autonomous driving described in any of the above embodiments.

[0154] When the computer program is executed, it has the following beneficial effects: When it is detected that the road section ahead that the vehicle currently corresponds to is impassable, it sends an assistance request to the cloud server, obtains a detour reference route returned by the cloud server, generates a control command according to the detour reference route and the current driving environment of the vehicle, and controls the driving of the vehicle according to the control command. The cloud server only provides the detour reference route, and then the vehicle generates a specific control command according to the detour reference route and the current driving environment, so that the control command is more consistent with the actual driving environment of the vehicle, and the safety and reliability are higher.

[0155] It should be understood that steps can be rearranged, added, or deleted using the various forms of flow shown above. For example, each step described in the present disclosure can be performed in parallel, sequentially, or in a different order, but this specification is not limited thereto, as long as the technical solution disclosed in the present disclosure can achieve the desired results.

[0156] The above specific implementation methods do not limit the protection scope of the present disclosure. Those skilled in the art can make various modifications, combinations, subcombinations, and substitutions based on design requirements and other factors. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present disclosure should be included within the protection scope of the present disclosure.

Claims

1. sending an assistance request to a cloud server when it is detected that the road section ahead currently corresponding to the vehicle is impassable; obtaining a detour reference route returned from the cloud server; generating a control command based on the detour reference route and a current driving environment of the vehicle; controlling operation of the vehicle based on the control command; Including, generating a control command based on the detouring reference route and a current driving environment of the vehicle, If the detouring reference route is a coordinate of a target point, the vehicle calculates a route from a current position to the target point based on a current driving environment, and generates a corresponding control command based on the route; Conducting a safety check of the detouring reference route based on the current driving environment of the vehicle to determine whether there is a safety risk between the current position of the vehicle and the target point, the safety risk including whether another vehicle may suddenly overtake from behind the vehicle, whether another vehicle may drive from the opposite direction, or whether a pedestrian may suddenly intrude; If there is no safety risk, calculate a current driving trajectory, speed and / or departure time according to the current position of the autonomous vehicle, the current driving environment and the coordinates of the target point, and generate each control command corresponding to each execution mechanism in the vehicle according to the current driving trajectory, speed and / or departure time; After calculating the current driving trajectory, speed and / or departure time, if the current driving trajectory, speed and / or departure time are abnormal, returning a target point error message to the cloud server, so that the cloud server updates the target point; A method for remote control of autonomous driving, comprising:

2. Prior to the step of sending a request for assistance to a cloud server, The method for remote control of autonomous driving according to claim 1 , further comprising the step of controlling the vehicle to stop or to reduce the driving speed of the vehicle.

3. detecting an obstacle in a process of controlling the driving of the vehicle based on the control command; If an obstacle is detected, controlling the autonomous vehicle to stop and sending an assistance request to the cloud server again. The method for remote control of automatic driving according to claim 1, comprising:

4. determining target driving data in response to an acquired request for assistance from a vehicle, the request for assistance including an identifier of the vehicle, the target driving data being vehicle state data and driving environment data associated with the identifier of the vehicle; determining a detour reference route corresponding to the vehicle based on the target driving data; returning the detour reference route to the vehicle; Including, The vehicle is If the detour reference route is a coordinate of a target point, calculate a route from a current position to the target point based on a current driving environment, and generate a corresponding control command based on the route; Calculating a route from a current position to the target point based on the current driving environment, and generating a corresponding control command based on the route. Conducting a safety check of the detouring reference route based on the current driving environment of the vehicle to determine whether there is a safety risk between the current position of the vehicle and the target point, the safety risk including whether another vehicle may suddenly overtake from behind the vehicle, whether another vehicle may drive from the opposite direction, or whether a pedestrian may suddenly intrude; If there is no safety risk, calculate a current driving trajectory, speed and / or departure time according to the current position of the autonomous vehicle, the current driving environment and the coordinates of the target point, and generate each control command corresponding to each execution mechanism in the vehicle according to the current driving trajectory, speed and / or departure time; After calculating the current driving trajectory, speed and / or departure time, if the current driving trajectory, speed and / or departure time are abnormal, returning a target point error message to the cloud server, so that the cloud server updates the target point; A method for remote control of autonomous driving, comprising:

5. determining a detouring reference route corresponding to the vehicle based on the target driving data, constructing a currently corresponding driving environment reference map of the vehicle on a display screen according to the target driving data; determining each of the landmark points on the detour reference route in response to a touch operation acquired on the display screen; generating the detour reference route by sequentially connecting each of the landmark points; The method for remote control of automatic driving according to claim 4, further comprising:

6. a sending module configured to send an assistance request to the cloud server when it is detected that the road section ahead currently corresponding to the vehicle is impassable; an acquisition module configured to acquire a detour reference route returned from the cloud server; a generation module configured to generate a control command based on the detour reference route and a current driving environment of the vehicle; a first control module configured to control operation of the vehicle based on the control command; Equipped with The generating module includes: If the detouring reference route is a coordinate of a target point, the vehicle calculates a route from a current position to the target point based on a current driving environment, and generates a corresponding control command based on the route; A check unit configured to perform a safety check of the detour reference route based on a current driving environment of the vehicle to determine whether there is a safety risk between the current position of the vehicle and the target point, the safety risk including whether another vehicle may suddenly overtake from behind the vehicle, whether another vehicle may drive from the opposite direction, or whether a pedestrian may suddenly intrude; A calculation unit configured to calculate a current driving trajectory, a speed and / or a departure time according to a current position of the autonomous vehicle, a current driving environment and coordinates of the target point if there is no safety risk; and a generating unit configured to generate respective control commands corresponding to respective execution mechanisms in the vehicle based on the current driving trajectory, speed and / or departure time; Equipped with A remote control device for autonomous driving, wherein after the calculation unit calculates the current driving trajectory, speed and / or departure time, the generation unit returns a target point error message to the cloud server, so that the cloud server updates the target point, if the current driving trajectory, speed and / or departure time is abnormal.

7. The remote control device for autonomous driving according to claim 6 , further comprising a second control module configured to control the vehicle to stop or to reduce a driving speed of the vehicle.

8. detecting an obstacle during a process of controlling the operation of the vehicle based on the control command; The remote control device for autonomous driving according to claim 6 , further comprising a detection module configured to control the autonomous vehicle to stop when an obstacle is detected, and to resend an assistance request to the cloud server.

9. a first determination module configured to determine target driving data in response to an acquired request for assistance from a vehicle, the request for assistance including an identifier of the vehicle, the target driving data being vehicle state data and driving environment data associated with the identifier of the vehicle; a second determination module configured to determine a detour reference route corresponding to the vehicle based on the target driving data; a second reply module configured to reply the detour reference route to the vehicle; Equipped with The vehicle is If the detour reference route is a coordinate of a target point, calculate a route from a current position to the target point based on a current driving environment, and generate a corresponding control command based on the route; According to a current driving environment of the vehicle, perform a safety check of the detour reference route to determine whether there is a safety risk between the current position of the vehicle and the target point, the safety risk including whether another vehicle may suddenly overtake from behind the vehicle, whether another vehicle may drive from the opposite direction, or whether a pedestrian may suddenly intrude; If there is no safety risk, calculate a current driving trajectory, speed and / or departure time according to the current position of the autonomous vehicle, the current driving environment and the coordinates of the target point, and generate respective control commands corresponding to each execution mechanism in the vehicle according to the current driving trajectory, speed and / or departure time; A remote control device for autonomous driving, which, after calculating the current driving trajectory, speed and / or departure time, if the current driving trajectory, speed and / or departure time are abnormal, returns a target point error message to the cloud server so that the cloud server updates the target point.

10. The second determination module: a construction unit configured to construct, on a display screen, a currently corresponding driving environment reference map of the vehicle based on the target driving data; a determination unit configured to determine each landmark point on the detour reference route in response to a touch operation acquired on the display screen; a generating unit configured to generate the detour reference route by connecting each of the landmarks in sequence; The remote control device for automatic driving according to claim 9, further comprising:

11. At least one processor; a memory communicatively connected to the at least one processor; Equipped with The memory stores instructions executable by the at least one processor, and when the instructions are executed by the at least one processor, the at least one processor can execute the remote control method for autonomous driving described in any one of claims 1 to 3. A vehicle-side electronic device.

12. A non-transitory computer-readable storage medium storing computer instructions for causing a computer to execute the method for remote control of autonomous driving according to any one of claims 1 to 5.

13. At least one processor; a memory communicatively connected to the at least one processor; Equipped with The memory stores instructions executable by the at least one processor, and when the instructions are executed by the at least one processor, the at least one processor can execute the autonomous driving remote control method described in claim 4 or 5. A cloud electronic device.

14. An autonomous vehicle comprising the vehicle-side electronic device according to claim 11.

15. A cloud appliance comprising the cloud appliance of claim 13.

16. A computer program product including a computer program that, when executed by a processor, realizes the method for remote control of autonomous driving according to any one of claims 1 to 5.

17. A computer program that, when executed by a processor, realizes the method for remote control of autonomous driving according to any one of claims 1 to 5.

Images