Remote control driving control method and device for vehicle
By detecting the video stream delay parameters and adjusting the vehicle control parameters according to different delay intervals, the problem of video delay affecting safety during remote driving is solved, and the safety of remote driving is improved.
Patent Information
- Application Number
- CN202410968927.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-18
- Publication Date
- 2024-11-08
AI Technical Summary
Video streaming during remote control driving can affect the safety of remote control driving, making it difficult for drivers to control the vehicle in a timely manner.
By obtaining the video stream of the vehicle in remote driving mode, detecting the video stream delay parameters, determining the vehicle's control parameters based on the delay parameters, including the maximum allowable driving speed and start-stop control, and dividing multiple delay intervals to adapt to different delays Adjust control parameters to ensure safety.
It effectively avoids the problem that remote control drivers cannot control the vehicle in time when the video delay is too large, and improves the safety of remote control driving of the vehicle in the case of video delay.
Smart Images

Figure CN118915534A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of remote control driving technology, and in particular, to a remote control driving control method and device for a vehicle. Background Art
[0002] Remote control driving generally relies on installing a camera on the vehicle to transmit the video stream back to the cockpit through the network, and play the camera data in real time, so that the remote driver can map the real scene around the vehicle and control it. Since there is a delay in the video stream, and the remote driver is not sensitive to small changes in the delay, it is difficult to control the speed in real time according to the delay change. If the video delay is too large, it will have a great impact on the safety of remote control driving. Summary of the invention
[0003] In order to overcome the deficiencies of the prior art, the present application provides a remote control driving control method and device for a vehicle to solve the problem that during current remote control driving, there is a delay in the video stream, which affects the safety of remote control driving.
[0004] The technical solution adopted by this application to solve its technical problem is:
[0005] In one aspect, a remote control driving method for a vehicle is provided, comprising:
[0006] Get the video stream collected by the vehicle in remote control driving mode;
[0007] Detecting a delay parameter of the video stream;
[0008] Determining control parameters for the vehicle according to the delay parameters, wherein the control parameters at least include control parameters for longitudinal control and / or lateral control of the vehicle;
[0009] The vehicle is remotely controlled according to the control parameters.
[0010] Furthermore, the control parameters include at least one of the following: maximum allowable driving speed of the vehicle, start and stop of the vehicle.
[0011] Furthermore, the delay parameter includes at least one of the following: delay duration, number of consecutive frames for which the delay duration reaches a preset duration, and frequency of delay occurrence.
[0012] Further, determining the control parameters of the vehicle according to the delay parameters includes:
[0013] Based on the delay parameter, the current delay interval is determined from a plurality of preset delay intervals, and the control parameter corresponding to the current delay interval is used as the control parameter of the vehicle, wherein different delay intervals correspond to different control parameters, and different delay intervals correspond to different delay conditions.
[0014] Furthermore, the using the control parameter corresponding to the current delay interval as the control parameter of the vehicle includes:
[0015] When the current delay interval is the first interval, the corresponding control parameters include the maximum allowable speed of the vehicle being 0; and / or,
[0016] When the current delay interval is the second interval, the corresponding control parameters include the maximum allowed driving speed being the preset speed.
[0017] Furthermore, the using the control parameter corresponding to the current delay interval as the control parameter of the vehicle includes:
[0018] When the current delay interval is the third interval, the corresponding control parameter includes prohibiting remote control driving; and / or,
[0019] When the current delay interval is the fourth interval, the corresponding control parameters include allowing remote control driving to be performed.
[0020] Further, when the current delay interval is the second interval:
[0021] When the delay interval is the first sub-interval, the corresponding control parameters include stopping the current task, parking at a safe location, and controlling the maximum allowable speed of the vehicle to be a first preset speed; and / or,
[0022] When the delay interval is the second sub-interval, the corresponding control parameters include continuing the current task and controlling the maximum allowable speed of the vehicle to be the second preset speed; and / or,
[0023] In the case where the delay interval is the third subinterval, the corresponding control parameters include continuing the current task, not limiting the maximum allowable speed of the vehicle, or controlling the maximum allowable speed of the vehicle to be a third preset speed;
[0024] Among them, the second interval includes the first sub-interval, the second sub-interval and the third sub-interval, the delay corresponding to the third sub-interval is better than that of the second sub-interval, the delay corresponding to the second sub-interval is better than that of the first sub-interval, and the first preset speed is less than the second preset speed and less than the third preset speed.
[0025] Further, the first preset speed, the second preset speed and / or the third preset speed are determined according to the delay parameter, wherein the larger the delay parameter is, the smaller the first preset speed, the second preset speed and / or the third preset speed is.
[0026] Further, when it is detected that the delay parameter of the video stream changes from being in the current delay interval to being in the first target delay interval, the method further includes:
[0027] If the first target delay interval is greater than the current delay interval, the vehicle is remotely controlled according to the control parameter corresponding to the first target delay interval; and / or,
[0028] If the first target delay interval is smaller than the current delay interval, and there is no intermediate delay interval between the first target delay interval and the current delay interval, the vehicle is remotely controlled according to the control parameters corresponding to the first target delay interval, and the delay conditions corresponding to the first target delay interval, the intermediate delay interval, and the current delay interval become worse in sequence; and / or,
[0029] If the first target delay interval is smaller than the current delay interval, and there is at least one intermediate delay interval between the first target delay interval and the current delay interval, the vehicle is remotely controlled according to the control parameters corresponding to the target intermediate delay interval.
[0030] Furthermore, the remote control of the vehicle according to the control parameter corresponding to the target intermediate delay interval includes:
[0031] The vehicle is remotely controlled by using the control parameters corresponding to each intermediate delay interval in order from large to small of the at least one intermediate delay interval, and in the process of controlling the vehicle by using the control parameters corresponding to any intermediate delay interval, when the jump condition corresponding to the intermediate delay interval is met, the control parameters corresponding to the next intermediate delay interval or the first target delay interval are used to control the vehicle.
[0032] Further, determining the current delay interval from a plurality of preset delay intervals based on the delay parameter includes:
[0033] Acquire at least one of the following parameters: the current environment of the vehicle, the current task performed by the vehicle, and the target task to be performed by the vehicle;
[0034] If the parameter meets the preset parameter condition, determining the second target delay interval as the current delay interval;
[0035] If the parameter does not meet the preset parameter condition, determining the third target delay interval as the current delay interval;
[0036] The second target delay interval and the third target delay interval have different corresponding control parameters.
[0037] In another aspect, a remote control driving control device for a vehicle is provided, comprising:
[0038] A video stream acquisition module is used to acquire the video stream collected by the vehicle in the remote control driving mode;
[0039] A delay parameter detection module, used to detect the delay parameters of the video stream;
[0040] A control parameter determination module, used to determine control parameters for the vehicle according to the delay parameter, wherein the control parameters at least include control parameters for longitudinal control and / or lateral control of the vehicle;
[0041] The vehicle remote control driving module is used to perform remote control driving of the vehicle according to the control parameters.
[0042] Beneficial effects:
[0043] The technical solution of the present application provides a remote control driving control method and device for a vehicle, and the control method includes: after obtaining the video stream collected by the vehicle in the remote control driving mode, detecting the delay parameter of the video stream, determining the control parameter of the vehicle through the delay parameter, and finally controlling the vehicle by remote control driving according to the control parameter. That is, the present application adopts different control parameters to control the vehicle under different delay conditions, effectively avoiding the problem that the remote control driver cannot control the vehicle in time when the video delay is too large, and improving the safety of remote control driving when the vehicle video has a delay. BRIEF DESCRIPTION OF THE DRAWINGS
[0044] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0045] Figure 1 This is a flow chart of a remote control driving control method for a vehicle provided in an embodiment of the present application;
[0046] Figure 2 is a flow chart of a specific vehicle remote control driving control method provided in an embodiment of the present application;
[0047] Figure 3 This is a schematic diagram of delay interval division provided in an embodiment of the present application;
[0048] Figure 4 It is a schematic structural diagram of a remote control driving control device for a vehicle provided in an embodiment of the present application;
[0049] Figure 5 It is a schematic diagram of the structure of a remote control driving control system for a vehicle provided in an embodiment of the present application. DETAILED DESCRIPTION
[0050] In order to make the purpose, technical scheme and advantages of the present application clearer, the technical scheme of the present application is described in detail below in conjunction with the accompanying drawings and embodiments. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other implementation methods obtained by ordinary technicians in the field without making creative work belong to the scope of protection of the present application.
[0051] The traditional control method of autonomous driving vehicles requires the driver to control the vehicle based on the video stream collected by the vehicle, such as the vehicle's surrounding environment, when entering the remote control driving mode. However, since the video stream is transmitted from the vehicle to the remote control driving end, there is a delay due to the influence of network transmission. When the delay is serious, if the vehicle speed is fast, the driver may not have time to react after viewing the delayed video stream, causing a safety accident.
[0052] To solve this technical problem, refer to Figure 1 The present application provides a remote control method for driving a vehicle, comprising:
[0053] S11: Obtain a video stream collected by the vehicle in the remote control driving mode; wherein the video stream is a collected video of the vehicle's surrounding environment.
[0054] S12: Detect the delay parameters of the video stream; the delay parameters include at least one of the following: delay duration, the number of consecutive frames when the delay duration reaches a preset duration, and the frequency of delay occurrence.
[0055] Among them, the delay duration refers to the time difference between the time when the remote control driving end receives a certain video stream and the time when the vehicle sends the video stream. The smaller the time difference, the better the delay. Optionally, the delay size of the video stream can be determined by the timestamp information of the communication link (different from the video stream link). The communication link can be an uplink from the vehicle to the remote control driving end, or a downlink from the remote control driving end to the vehicle. For example, for the uplink, the time when the vehicle sends the video stream will correspond to a communication timestamp, and the time when the remote control driving end receives the video stream will correspond to a communication timestamp. By comparing the two timestamps, the delay size can be determined.
[0056] The number of continuous frames whose delay duration reaches the preset duration refers to the number of frames of the video stream whose time difference is greater than the preset duration and is continuous. The fewer the number of continuous frames, the better the delay situation.
[0057] The frequency of delay refers to the number of times the delay duration is greater than the threshold within a preset period. The threshold is set according to actual needs.
[0058] It can be understood that the delay parameter in the embodiment of the present application can adopt any one of the delay length, the number of consecutive frames at which the delay length reaches a preset length, and the frequency at which the delay occurs, or two or all three can be used at the same time.
[0059] It should be noted that in the embodiment of the present application, the delay parameters of the video stream can be detected based on the video stream of the video stream transmission channel, or a detection channel specifically used to detect the delay parameters can be established to detect the delay parameters of the video stream based on the data of the video stream delay detection channel.
[0060] S13: Determine the control parameters of the vehicle according to the delay parameters, wherein the control parameters at least include control parameters for longitudinal control and / or lateral control of the vehicle; it should be noted that longitudinal control mainly involves acceleration and deceleration of the vehicle in the front and rear directions, which is usually achieved by controlling the throttle and brakes. Lateral control focuses on the left and right steering of the vehicle, which is mainly achieved by controlling the steering wheel.
[0061] Among them, the longitudinal control parameters include at least one of the following: the maximum allowable speed of the vehicle, the start and stop of the vehicle. The maximum allowable speed of the vehicle refers to the maximum speed that the vehicle can reach during remote control driving. When this speed is reached, the speed of the vehicle will not increase even if the remote control driving end performs acceleration operations such as stepping on the accelerator. Generally speaking, the better the delay situation, the greater the maximum allowable speed of the vehicle. On the contrary, the worse the delay situation, the smaller the maximum allowable speed of the vehicle. In serious cases, the vehicle needs to stop immediately.
[0062] Exemplarily, the lateral control parameter includes the minimum allowable turning radius of the vehicle, which refers to the minimum turning radius that the vehicle can reach during remote control driving. The better the delay situation, the smaller the minimum allowable turning radius of the vehicle. On the contrary, the worse the delay situation, the larger the minimum allowable turning radius of the vehicle.
[0063] As an optional implementation method of the embodiment of the present application, the current delay interval is determined from a plurality of preset delay intervals based on the delay parameter, and the control parameters corresponding to the current delay interval are used as the control parameters of the vehicle, wherein different delay intervals correspond to different control parameters, and different delay intervals correspond to different delay conditions.
[0064] In some embodiments, using the control parameter corresponding to the current delay interval as the control parameter of the vehicle includes:
[0065] When the current delay interval is the first interval, the corresponding control parameters include the maximum allowable vehicle speed being 0; and / or, when the current delay interval is the second interval, the corresponding control parameters include the maximum allowable vehicle speed being a preset speed.
[0066] When the current delay interval is the first interval, the delay is very serious. If the vehicle continues to drive, the probability of a safety accident is very high. At this time, the vehicle is not allowed to continue driving, so the maximum allowed driving speed of the vehicle is 0.
[0067] When the current delay interval is the second interval, the delay situation is relatively good, so the maximum allowable driving speed at this time is determined according to the delay situation.
[0068] Preferably, when the current delay interval is the second interval:
[0069] When the delay interval is the first sub-interval, the corresponding control parameters include stopping the current task, parking at a safe location, and controlling the maximum allowed speed of the vehicle to be the first preset speed; at this time, the delay is more serious, although driving is allowed, there is also a probability of a safety accident, so the vehicle needs to be controlled to stop the current task and park at the complete position. In the process of controlling the vehicle to park at a safe location, it is necessary to ensure that the maximum speed of the vehicle does not exceed the first preset speed.
[0070] When the delay interval is the second sub-interval, the corresponding control parameters include continuing the current task and controlling the maximum allowable driving speed of the vehicle to be the second preset speed; at this time, compared with the first sub-interval, the delay situation is better, so the current task can be continued, but the maximum driving speed needs to be limited to ensure that the maximum driving speed of the vehicle does not exceed the second preset speed.
[0071] When the delay situation is very good, there is no need to limit the maximum speed of the vehicle, or a larger maximum allowable speed of the vehicle can be set.
[0072] Therefore, optionally, when the delay interval is the third sub-interval, the corresponding control parameters include continuing the current task, not limiting the maximum allowable driving speed of the vehicle, or controlling the maximum allowable driving speed of the vehicle to be a third preset speed.
[0073] Among them, the second interval includes the first sub-interval, the second sub-interval and the third sub-interval, the delay corresponding to the third sub-interval is better than that of the second sub-interval, the delay corresponding to the second sub-interval is better than that of the first sub-interval, and the first preset speed is less than the second preset speed and less than the third preset speed.
[0074] In one embodiment, the first preset speed, the second preset speed and / or the third preset speed are fixed values, and the specific values are set according to actual needs.
[0075] However, since the gap between the upper and lower limits of a delay interval may be large, when a fixed value is used, in order to ensure safety under any circumstances within an interval, the preset speed uses a smaller fixed value. In this way, when the delay situation in the interval is good, the vehicle speed is slower, affecting the efficiency of task execution.
[0076] Therefore, in another embodiment, the first preset speed, the second preset speed and / or the third preset speed are determined according to the delay parameter, wherein the larger the delay parameter is, the smaller the first preset speed, the second preset speed and / or the third preset speed is. In this way, the vehicle's task execution efficiency is improved while ensuring the vehicle's safety.
[0077] In some other embodiments, using the control parameter corresponding to the current delay interval as the control parameter of the vehicle includes:
[0078] When the current delay interval is the third interval, the corresponding control parameter includes prohibiting remote control driving; and / or, when the current delay interval is the fourth interval, the corresponding control parameter includes allowing remote control driving. The delay situation in the fourth interval is better than that in the third interval. When the current delay interval is the third interval, the delay is very serious and remote control driving cannot be continued. Therefore, remote control driving is directly prohibited at this time. When the current delay interval is the fourth interval, the delay situation is better and remote control driving may continue.
[0079] It can be understood that, referring to the division of the second interval, the fourth interval can also be divided into the same sub-intervals, and the control of each sub-interval is also the same as the control of the sub-interval of the second interval, which will not be described in detail here.
[0080] As an optional implementation of the embodiment of the present application, determining the current delay interval from a plurality of preset delay intervals based on the delay parameter includes:
[0081] Obtain at least one of the following parameters: the current environment of the vehicle, the current task performed by the vehicle, and the target task to be performed by the vehicle; if the parameter meets the preset parameter condition, determine the second target delay interval as the current delay interval; if the parameter does not meet the preset parameter condition, determine the third target delay interval as the current delay interval; wherein the control parameters corresponding to the second target delay interval and the third target delay interval are different. The second target delay interval and the third target delay interval are the delay intervals described above.
[0082] The parameters meeting the preset parameter conditions include the current environment being the preset environment, the current task being the preset current task, and the target task being the preset target task. The same delay parameter under the preset environment and / or the preset current task and / or the preset target task has different requirements for vehicle control, because some environments or tasks require more precise vehicle control. Therefore, under the same delay parameter, the requirements for control parameters are also more stringent, such as a smaller maximum allowable driving speed.
[0083] S14: Performing remote control driving on the vehicle according to the control parameters.
[0084] In actual control, it is generally necessary to redetermine the current delay interval at regular intervals. In the embodiment of the present application, the redetermined current delay interval is used as the first target delay interval, and the first target delay interval is the delay interval described above.
[0085] In the case where it is detected that the delay parameter of the video stream changes from being in the current delay interval to being in the first target delay interval, the method further includes:
[0086] If the first target delay interval is greater than the current delay interval, the vehicle is remotely controlled according to the control parameters corresponding to the first target delay interval; when the first target delay interval is greater than the current delay interval, it means that the delay situation has become worse, so the vehicle is directly controlled according to the control parameters corresponding to the first target delay interval.
[0087] If the first target delay interval is smaller than the current delay interval, and there is no intermediate delay interval between the first target delay interval and the current delay interval, the vehicle is remotely controlled according to the control parameters corresponding to the first target delay interval, and the delay conditions corresponding to the first target delay interval, the intermediate delay interval, and the current delay interval become worse in sequence.
[0088] If the first target delay interval is smaller than the current delay interval, and there is at least one intermediate delay interval between the first target delay interval and the current delay interval, the vehicle is remotely controlled according to the control parameters corresponding to the target intermediate delay interval. Exemplarily, the vehicle is remotely controlled according to the order of the at least one intermediate delay interval from large to small, and in the process of controlling the vehicle using the control parameters corresponding to any intermediate delay interval, when the jump condition corresponding to the intermediate delay interval is met, the control parameters corresponding to the next intermediate delay interval or the first target delay interval are used to control the vehicle. Exemplarily, the jump condition is that the delay duration of the preset number of frames is lower than the threshold.
[0089] That is, when the delay situation becomes better, in order to ensure the safety of vehicle driving, it is necessary to adjust step by step, and the vehicle cannot be directly controlled according to the control parameters corresponding to the first target delay interval.
[0090] To explain the present application scheme in more detail, the present application embodiment provides a specific implementation method:
[0091] like Figure 2 As shown in the figure, first establish a video stream delay detection channel, then detect the push stream delay in real time based on the established video stream delay detection channel, and then perform stability verification on the video delay, such as filtering and other operations. Then identify the delay interval, limit the speed according to the interval, and then verify the speed of the trajectory point. After the verification is successful, send the trajectory to the control.
[0092] like Figure 3 As shown, this method divides the remote control driving under unmanned operation in mines into four delay intervals, namely S0, S1, S2, and S3, and sets corresponding speed intervals respectively.
[0093] S0: Remote control driving is prohibited. In the S0 range, the video streaming delay is too large, driving is not allowed, and the speed limit is 0km / h;
[0094] S1: Low-speed remote control driving. In the S1 section, there is a certain delay in video streaming. It is recommended to stop the car at a safe location at a low speed and not continue working. For example, the speed limit in this section is 2km / h;
[0095] S2: Remote control driving at a safe speed. In the S2 range, the video streaming delay is within a relatively acceptable range. For example, the speed limit is 4km / h, and the speed limit is planned according to the speed limit.
[0096] S3: Normal speed remote control driving. In the S3 range, the video streaming delay is in the ideal range, and normal driving can be carried out according to the actual mode without speed restrictions.
[0097] At the same time, it will separately identify whether the current vehicle is in a preset environment such as a soil discharge position or is about to enter the preset environment. If it is in a preset environment such as a soil discharge position, the current delay interval will be upgraded (that is, if the current delay is identified as S2, it will be adjusted to S1) to ensure absolute safety in preset environments such as soil discharge positions.
[0098] When switching from a small delay interval to a large delay interval, set the switching conditions according to the current interval. Take the example of entering the S0 interval with a delay of 1s:
[0099] When the vehicle detects 5 consecutive frames of data with a delay of more than 1 second in the S3 interval, the current delay interval is directly switched from S3 to S0.
[0100] When the vehicle detects 10 consecutive frames of data with a delay of more than 1 second in the S2 interval, the current delay interval is directly switched from S2 to S0.
[0101] When the vehicle detects 15 consecutive frames of data with a delay of more than 1 second in the S1 interval, the current delay interval is directly switched from S1 to S0.
[0102] When switching from a large delay interval to a small delay interval, the jump will be made gradually, that is, it is not allowed to jump directly from S0 to S3. The delay must be stable, and it must jump gradually from S0 to S3 to achieve driving at normal speed.
[0103] When the vehicle detects 5 consecutive frames of data with a delay of less than 1s in the S0 interval, the current delay interval is switched from S0 to S1. Then, when the conditions of the S1 interval are met, it jumps to S2, and then, when the delay interval conditions of the S2 interval are met, it jumps to S3, and starts remote control driving at normal speed.
[0104] Based on the same inventive concept, Figure 4 As shown, the present application provides a remote control driving control device 40 for a vehicle, comprising:
[0105] The video stream acquisition module 41 is used to acquire the video stream collected by the vehicle in the remote control driving mode.
[0106] The delay parameter detection module 42 is used to detect the delay parameters of the video stream; the delay parameters include at least one of the following: delay duration, the number of consecutive frames when the delay duration reaches a preset duration, and the frequency of delay occurrence.
[0107] The control parameter determination module 43 is used to determine the control parameters of the vehicle according to the delay parameters, wherein the control parameters at least include control parameters for longitudinal control and / or lateral control of the vehicle; the control parameters include at least one of the following: the maximum allowable driving speed of the vehicle, and the start and stop of the vehicle.
[0108] Determining the control parameters of the vehicle according to the delay parameters includes:
[0109] Based on the delay parameter, the current delay interval is determined from a plurality of preset delay intervals, and the control parameter corresponding to the current delay interval is used as the control parameter of the vehicle, wherein different delay intervals correspond to different control parameters, and different delay intervals correspond to different delay conditions.
[0110] In one embodiment, using the control parameter corresponding to the current delay interval as the control parameter of the vehicle includes:
[0111] When the current delay interval is the first interval, the corresponding control parameters include the maximum allowable vehicle speed being 0; and / or, when the current delay interval is the second interval, the corresponding control parameters include the maximum allowable vehicle speed being a preset speed.
[0112] Among them, when the current delay interval is the second interval:
[0113] When the delay interval is the first subinterval, the corresponding control parameters include stopping the current task, parking at a safe location, and controlling the maximum allowable speed of the vehicle to be the first preset speed; and / or, when the delay interval is the second subinterval, the corresponding control parameters include continuing the current task, and controlling the maximum allowable speed of the vehicle to be the second preset speed; and / or, when the delay interval is the third subinterval, the corresponding control parameters include continuing the current task, not limiting the maximum allowable speed of the vehicle, or controlling the maximum allowable speed of the vehicle to be the third preset speed;
[0114] Among them, the second interval includes the first sub-interval, the second sub-interval and the third sub-interval, the delay corresponding to the third sub-interval is better than that of the second sub-interval, the delay corresponding to the second sub-interval is better than that of the first sub-interval, and the first preset speed is less than the second preset speed and less than the third preset speed.
[0115] It also includes: determining the first preset speed, the second preset speed and / or the third preset speed according to the delay parameter, wherein the larger the delay parameter is, the smaller the first preset speed, the second preset speed and / or the third preset speed is.
[0116] In another embodiment, using the control parameter corresponding to the current delay interval as the control parameter of the vehicle includes:
[0117] When the current delay interval is the third interval, the corresponding control parameter includes prohibiting remote control driving; and / or, when the current delay interval is the fourth interval, the corresponding control parameter includes allowing remote control driving.
[0118] Preferably, determining the current delay interval from a plurality of preset delay intervals based on the delay parameter includes:
[0119] Obtain at least one of the following parameters: the current environment in which the vehicle is located, the current task performed by the vehicle, and the target task that the vehicle is about to perform; if the parameters meet the preset parameter conditions, determine the second target delay interval as the current delay interval; if the parameters do not meet the preset parameter conditions, determine the third target delay interval as the current delay interval; wherein the control parameters corresponding to the second target delay interval and the third target delay interval are different.
[0120] The vehicle remote control driving module 44 is used to perform remote control driving of the vehicle according to the control parameters.
[0121] As a preferred implementation method of the embodiment of the present application, when it is detected that the delay parameter of the video stream changes from being in the current delay interval to being in the first target delay interval, it also includes:
[0122] If the first target delay interval is larger than the current delay interval, the vehicle is remotely driven and controlled according to the control parameters corresponding to the first target delay interval; and / or, if the first target delay interval is smaller than the current delay interval, and there is no intermediate delay interval between the first target delay interval and the current delay interval, the vehicle is remotely driven and controlled according to the control parameters corresponding to the first target delay interval, and the delay conditions corresponding to the first target delay interval, the intermediate delay interval and the current delay interval become worse in sequence; and / or, if the first target delay interval is smaller than the current delay interval, and there is at least one intermediate delay interval between the first target delay interval and the current delay interval, the vehicle is remotely driven and controlled according to the control parameters corresponding to the target intermediate delay interval.
[0123] The step of performing remote control of the vehicle according to the control parameters corresponding to the target intermediate delay interval includes:
[0124] The vehicle is remotely controlled by using the control parameters corresponding to each intermediate delay interval in order from large to small of the at least one intermediate delay interval, and in the process of controlling the vehicle by using the control parameters corresponding to any intermediate delay interval, when the jump condition corresponding to the intermediate delay interval is met, the control parameters corresponding to the next intermediate delay interval or the first target delay interval are used to control the vehicle.
[0125] The remote control driving control device for a vehicle provided in the embodiment of the present application detects the delay parameter of the video stream after acquiring the video stream collected by the vehicle in the remote control driving mode, determines the control parameter of the vehicle through the delay parameter, and finally controls the vehicle through remote control driving according to the control parameter. That is, the present application scheme uses different control parameters to control the vehicle under different delay conditions, effectively avoiding the problem that the remote control driver cannot control the vehicle in time when the video delay is too large, and improving the safety of remote control driving when the vehicle video has a delay.
[0126] Based on the same inventive concept, Figure 5 As shown, the present application provides a remote control driving control system 50 for a vehicle, comprising:
[0127] at least one processor 51 and at least one memory 52;
[0128] The memory 52 stores executable instructions of the processor 51;
[0129] The processor 51 is configured to execute the remote control driving control method for a vehicle provided in the above embodiment.
[0130] The remote control driving control system of the vehicle provided by the embodiment of the present application stores the executable instructions of the processor in the memory. When the executable instructions are executed, the processor can detect the delay parameters of the video stream after acquiring the video stream collected by the vehicle in the remote control driving mode, determine the control parameters of the vehicle through the delay parameters, and finally perform remote control driving control on the vehicle according to the control parameters. That is, the present application scheme uses different control parameters to control the vehicle under different delay conditions, effectively avoiding the problem that the remote control driver cannot control the vehicle in time when the video delay is too large, and improving the safety of remote control driving when the vehicle video has a delay.
[0131] Based on the same inventive concept, the present application provides a vehicle, and applies the remote control driving control method of the vehicle provided in the above embodiment.
[0132] The vehicle provided in the embodiment of the present application, using the remote control driving control method of the vehicle provided in the above embodiment, can detect the delay parameters of the video stream after acquiring the video stream collected by the vehicle in the remote control driving mode, determine the control parameters of the vehicle through the delay parameters, and finally perform remote control driving control on the vehicle according to the control parameters. That is, the present application scheme uses different control parameters to control the vehicle under different delay conditions, effectively avoiding the problem that the remote control driver cannot control the vehicle in time when the video delay is too large, and improving the safety of remote control driving when the vehicle video has a delay.
[0133] It can be understood that the same or similar parts of the above embodiments can be referenced to each other, and the contents not described in detail in some embodiments can refer to the same or similar contents in other embodiments.
[0134] It should be noted that, in the description of this application, the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In addition, in the description of this application, unless otherwise specified, the meaning of "plurality" refers to at least two.
[0135] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.
[0136] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.
[0137] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.
[0138] In addition, each functional unit in each embodiment of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.
[0139] The storage medium mentioned above can be a read-only memory, a magnetic disk or an optical disk, etc.
[0140] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.
[0141] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.
Claims
1. A remote control driving method for a vehicle, characterized in that: include: Get the video stream collected by the vehicle in remote control driving mode; Detecting a delay parameter of the video stream; Determining control parameters for the vehicle according to the delay parameters, wherein the control parameters at least include control parameters for longitudinal control and / or lateral control of the vehicle; The vehicle is remotely controlled according to the control parameters.
2. The method according to claim 1, characterized in that The control parameters include at least one of the following: the maximum allowable driving speed of the vehicle, and the start and stop of the vehicle.
3. The method according to claim 1, characterized in that The delay parameters include at least one of the following: delay duration, the number of consecutive frames when the delay duration reaches a preset duration, and the frequency of delay occurrence.
4. The method according to claim 1, characterized in that: Determining the control parameter of the vehicle according to the delay parameter includes: Based on the delay parameter, the current delay interval is determined from a plurality of preset delay intervals, and the control parameter corresponding to the current delay interval is used as the control parameter of the vehicle, wherein different delay intervals correspond to different control parameters, and different delay intervals correspond to different delay conditions.
5. The method according to claim 4, characterized in that The using the control parameter corresponding to the current delay interval as the control parameter of the vehicle comprises: When the current delay interval is the first interval, the corresponding control parameters include the maximum allowable speed of the vehicle being 0; and / or, When the current delay interval is the second interval, the corresponding control parameters include the maximum allowed driving speed being the preset speed.
6. The method according to claim 4, characterized in that The using the control parameter corresponding to the current delay interval as the control parameter of the vehicle comprises: When the current delay interval is the third interval, the corresponding control parameter includes prohibiting remote control driving; and / or, When the current delay interval is the fourth interval, the corresponding control parameters include allowing remote control driving to be performed.
7. The method according to claim 5, characterized in that When the current delay interval is the second interval: When the delay interval is the first sub-interval, the corresponding control parameters include stopping the current task, parking at a safe location, and controlling the maximum allowable speed of the vehicle to be a first preset speed; and / or, When the delay interval is the second sub-interval, the corresponding control parameters include continuing the current task and controlling the maximum allowable speed of the vehicle to be the second preset speed; and / or, In the case where the delay interval is the third subinterval, the corresponding control parameters include continuing the current task, not limiting the maximum allowable driving speed of the vehicle, or controlling the maximum allowable driving speed of the vehicle to be a third preset speed; Among them, the second interval includes the first sub-interval, the second sub-interval and the third sub-interval, the delay corresponding to the third sub-interval is better than that of the second sub-interval, the delay corresponding to the second sub-interval is better than that of the first sub-interval, and the first preset speed is less than the second preset speed and less than the third preset speed.
8. The method according to claim 7, characterized in that Also includes: The first preset speed, the second preset speed and / or the third preset speed are determined according to the delay parameter, wherein the larger the delay parameter is, the smaller the first preset speed, the second preset speed and / or the third preset speed is.
9. The method according to claim 4, characterized in that In the case where it is detected that the delay parameter of the video stream changes from being in the current delay interval to being in the first target delay interval, the method further includes: If the first target delay interval is greater than the current delay interval, the vehicle is remotely controlled according to the control parameter corresponding to the first target delay interval; and / or, If the first target delay interval is smaller than the current delay interval, and there is no intermediate delay interval between the first target delay interval and the current delay interval, the vehicle is remotely controlled according to the control parameters corresponding to the first target delay interval, and the delay conditions corresponding to the first target delay interval, the intermediate delay interval, and the current delay interval become worse in sequence; and / or, If the first target delay interval is smaller than the current delay interval, and there is at least one intermediate delay interval between the first target delay interval and the current delay interval, the vehicle is remotely controlled according to the control parameters corresponding to the target intermediate delay interval.
10. The method according to claim 9, characterized in that The remote control of the vehicle according to the control parameter corresponding to the target intermediate delay interval includes: The vehicle is remotely controlled by using the control parameters corresponding to each intermediate delay interval in order from large to small of the at least one intermediate delay interval, and in the process of controlling the vehicle by using the control parameters corresponding to any intermediate delay interval, when the jump condition corresponding to the intermediate delay interval is met, the control parameters corresponding to the next intermediate delay interval or the first target delay interval are used to control the vehicle.
11. The method according to claim 4, characterized in that Determining the current delay interval from among a plurality of preset delay intervals based on the delay parameter includes: Acquire at least one of the following parameters: the current environment of the vehicle, the current task performed by the vehicle, and the target task to be performed by the vehicle; If the parameter meets the preset parameter condition, determining the second target delay interval as the current delay interval; If the parameter does not meet the preset parameter condition, determining the third target delay interval as the current delay interval; The second target delay interval and the third target delay interval have different corresponding control parameters.
12. A remote control driving control device for a vehicle, characterized in that: include: A video stream acquisition module is used to acquire the video stream collected by the vehicle in the remote control driving mode; A delay parameter detection module, used to detect the delay parameters of the video stream; A control parameter determination module, used to determine control parameters for the vehicle according to the delay parameter, wherein the control parameters at least include control parameters for longitudinal control and / or lateral control of the vehicle; The vehicle remote control driving module is used to perform remote control driving of the vehicle according to the control parameters.
