Vehicle safety control method, device, electronic device, vehicle and storage medium

Abstract

The present application provides a vehicle safety control method, device, electronic device, vehicle and storage medium. Among them, an electronic image of an intelligent driving perception screen is acquired in real time; wherein the electronic image is used to display the identification information of the vehicle and the identification information of the surrounding environment; the current instruction input by the user for the identification information of the vehicle and the identification information of the surrounding environment is received in real time; according to at least one layer of safety judgment mechanism, if it is determined that the current instruction is unreasonable, the next instruction adjacent to the current instruction is received, and the next instruction covers the current instruction; the safety judgment mechanism is used to indicate that the vehicle is driven safely after judging that the current instruction is reasonable; and if it is determined that the current instruction is reasonable, the vehicle is allowed to be controlled to drive according to the current instruction.

Description

Technical Field

[0001] The present invention relates to the field of vehicle control technology, and in particular to a vehicle safety control method, device, electronic equipment, vehicle and storage medium. Background Art

[0002] In the related art, there is a possibility that other people, such as others, may operate the vehicle during driving. If other people make wrong operations and the vehicle responds to the wrong operations, it may easily lead to safety risks. Summary of the invention

[0003] The present application provides a vehicle safety control method, device, electronic equipment, vehicle and storage medium.

[0004] The present application provides a vehicle safety control method, comprising:

[0005] Acquire an electronic image of the intelligent driving perception screen in real time; wherein the electronic image is used to display the identification information of the vehicle and the identification information of the surrounding environment;

[0006] receiving in real time a current instruction input by a user with respect to identification information of the vehicle and identification information of the surrounding environment;

[0007] According to at least one layer of safety judgment mechanism, if it is determined that the current instruction is unreasonable, a next instruction adjacent to the current instruction is received, and the next instruction covers the current instruction; the safety judgment mechanism is used to indicate that the self-vehicle drives safely after judging that the current instruction is reasonable; and,

[0008] If it is determined that the current instruction is reasonable, then the vehicle is allowed to be controlled to drive according to the current instruction.

[0009] Further, if it is determined that the current instruction is unreasonable according to at least one layer of security judgment mechanism, a next instruction adjacent to the current instruction is received, and the next instruction overwrites the current instruction, including:

[0010] Based on the user safety judgment mechanism of the safety judgment mechanism, if it is determined that the current instruction is unreasonable, receiving the user to re-enter the next instruction to overwrite the current instruction;

[0011] The user safety judgment mechanism is used to indicate that unreasonable instructions are corrected by the user.

[0012] Further, if it is determined that the current instruction is unreasonable according to at least one layer of security judgment mechanism, a next instruction adjacent to the current instruction is received, and the next instruction overwrites the current instruction, including:

[0013] The driver safety judgment mechanism based on the safety judgment mechanism, if it is determined that the current instruction is unreasonable, receives the driver to re-enter the next instruction to overwrite the current instruction;

[0014] The driver safety judgment mechanism is used to indicate that the driver assists the user in correcting unreasonable instructions.

[0015] Furthermore, if it is determined that the current instruction is unreasonable, receiving the next instruction re-entered by the driver to overwrite the current instruction includes:

[0016] If it is determined that the abnormal frequency of the current instruction is greater than a first frequency threshold, receiving a disabling instruction re-entered by the driver to overwrite the current instruction;

[0017] The disabling instruction is used to control the soft switch to be invalid, and the disabling instruction is input through a physical key operation.

[0018] Furthermore, the physical buttons include physical buttons arranged on opposite sides of the steering wheel of the vehicle, and the physical buttons arranged on the two sides are pressed simultaneously to generate the disabling instruction.

[0019] Furthermore, the next instruction includes one or more of a cancellation of the current instruction, a termination co-driving instruction for the driver to physically take over, and a disable instruction for controlling the soft switch to be invalid; the termination co-driving instruction has the highest authority.

[0020] Furthermore, the safety judgment mechanism also includes an intelligent driving system safety judgment mechanism;

[0021] The step of receiving a next instruction adjacent to the current instruction and overwriting the current instruction with the next instruction according to at least one layer of security judgment mechanism if the current instruction is determined to be unreasonable includes:

[0022] Analyzing the rationality and risk of the current instruction according to the intelligent driving system safety judgment mechanism to determine whether the current instruction is reasonable;

[0023] If it is determined that the current instruction is unreasonable and the current instruction is beyond the scope that the intelligent driving system can handle, a request instruction for requesting the driver to take over manually is generated to cover the current instruction;

[0024] Among them, the intelligent driving system safety judgment mechanism is used to indicate the rationality and risks of the intelligent driving system judgment instructions.

[0025] Further, if it is determined that the current instruction is unreasonable according to at least one layer of security judgment mechanism, a next instruction adjacent to the current instruction is received, and the next instruction overwrites the current instruction, including:

[0026] If the background safety supervision mechanism of the safety judgment mechanism detects that the disabling frequency is greater than the second frequency threshold, a background deactivation instruction is received, and the deactivation instruction overwrites the current instruction, so that the vehicle owner account applies for re-learning and then reactivation;

[0027] Among them, the deactivation instruction is used to indicate the termination of the intelligent driving function.

[0028] Further, after allowing the vehicle to be controlled to drive according to the current instruction, the method further includes:

[0029] An interrupt icon for interrupting the execution of the current instruction and a continue icon for continuing the execution of the current instruction are displayed in the electronic image; the interrupt icon is used to interrupt the execution of the current instruction; the continue icon is used to continue the execution of the current instruction;

[0030] If an operation for the interrupt icon mark input is received, the control of the vehicle to intelligently drive according to the current instruction is interrupted;

[0031] If an operation for inputting the continue-execution icon mark is received, the vehicle is controlled to continue intelligent driving according to the current instruction.

[0032] The present application provides a vehicle safety control device, which is used to implement the vehicle safety control method as described above, and the vehicle safety control device includes:

[0033] An electronic image acquisition module, used to acquire an electronic image of an intelligent driving perception screen in real time; wherein the electronic image is used to display identification information of the vehicle and identification information of the surrounding environment;

[0034] An instruction acquisition module, used for receiving in real time the current instruction input by the user with respect to the identification information of the vehicle and the identification information of the surrounding environment;

[0035] An instruction update module is used to receive a next instruction adjacent to the current instruction and overwrite the current instruction with the next instruction according to at least one layer of safety judgment mechanism if the current instruction is determined to be unreasonable; the safety judgment mechanism is used to indicate that the vehicle can be driven safely after judging that the current instruction is reasonable; and

[0036] The control driving module is used to allow the vehicle to be controlled to drive according to the current instruction if it is determined that the current instruction is reasonable.

[0037] The present application provides a vehicle, comprising one or more processors, for implementing the vehicle safety control method as described above.

[0038] The present application provides an electronic device, comprising one or more processors, for implementing any of the methods described above.

[0039] The present application provides a computer-readable storage medium having a program stored thereon. When the program is executed by a processor, the method described in any one of the above items is implemented.

[0040] The present application provides a computer program product, comprising a computer program / instruction, which implements any of the above methods when executed by a processor.

[0041] In some embodiments, the vehicle safety control method of the present application can overwrite an unreasonable current instruction with the next instruction, and not respond to the unreasonable current instruction. At the same time, respond to the next instruction, thereby avoiding safety risks and improving the safety of instruction response. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 Shown is a schematic flow chart of a vehicle safety control method according to an embodiment of the present application;

[0043] Figure 2 Shown Figure 1 A schematic diagram of a safety judgment mechanism of a vehicle safety control method shown;

[0044] Figure 3 Shown Figure 1 A schematic diagram of a soft switch of the vehicle safety control method shown;

[0045] Figure 4 Shown Figure 1 A schematic diagram of a physical button for generating a disable command in the vehicle safety control method shown;

[0046] Figure 5 Shown is a schematic diagram of the structure of a vehicle safety control device provided in an embodiment of the present application;

[0047] Figure 6 Shown is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0048] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with one or more embodiments of the present specification. Instead, they are merely examples of devices and methods consistent with some aspects of one or more embodiments of the present specification as detailed in the appended claims.

[0049] It should be noted that: in other embodiments, the steps of the corresponding method are not necessarily performed in the order shown and described in this specification. In some other embodiments, the steps included in the method may be more or less than those described in this specification. In addition, a single step described in this specification may be decomposed into multiple steps for description in other embodiments; and multiple steps described in this specification may be combined into a single step for description in other embodiments.

[0050] In order to solve the technical problem that the vehicle responds to an erroneous operation, which may easily lead to safety risks, the embodiment of the present application provides a vehicle safety control method, which receives the next instruction adjacent to the current instruction and overwrites the current instruction with the next instruction based on at least one layer of safety judgment mechanism if the current instruction is determined to be unreasonable. In this way, the unreasonable current instruction can be overwritten by the next instruction, and the unreasonable current instruction is not responded to. At the same time, responding to the next instruction avoids safety risks and improves the safety of instruction response.

[0051] Figure 1 Shown is a flow chart of a vehicle safety control method according to an embodiment of the present application.

[0052] like Figure 1 As shown, the vehicle safety control method may include, but is not limited to, the following steps 110 to 140:

[0053] Step 110, acquiring an electronic image of the intelligent driving perception screen in real time; wherein the electronic image is used to display identification information of the vehicle and identification information of the surrounding environment.

[0054] The electronic image is displayed on the ADV (Advanced Driver Assistance System) of the vehicle. The vehicle's perception device serves as the "eyes and ears" of the intelligent driving system. The intelligent driving system can indirectly perceive the surrounding environment of the vehicle by acquiring the real-time perception data of the vehicle's surrounding environment from the vehicle's perception device, thereby generating and displaying an electronic image corresponding to the perception data of the vehicle and the surrounding environment.

[0055] In this regard, the electronic image corresponding to the perception data of the vehicle and the surrounding environment is used to display basic information, such as the display information of the actual distance of the vehicle relative to the surrounding environment. Correspondingly, the display distance of the vehicle icon relative to the surrounding environment icon is displayed on the electronic image.

[0056] In addition, the electronic image may also include one or more of the identification information such as the vehicle icon and the surrounding environment icon. Moreover, the surrounding environment icon may include, but is not limited to, other vehicle icons and lane icons in the surrounding environment. Among them, the vehicle icon, other vehicle icon and lane icon represent the information of the vehicle and the surrounding environment used to indicate the road conditions, and are used to respectively indicate the distribution of the actual vehicle, actual other vehicles and actual lanes in the actual environment. In this way, these icons and other identification information are used to illustrate the distribution of the actual environment and can reflect the situation of the real environment.

[0057] The electronic image in this article can be displayed on the intelligent driving perception screen ADV of the HMI (Human-Machine Interface) to achieve human-machine interaction.

[0058] The electronic image may also include control indicators for controlling the vehicle, including but not limited to a speed adjustment icon for adjusting the vehicle speed, a lane control icon for controlling lane changes of the vehicle, and / or a vehicle control icon for controlling the vehicle to follow or overtake.

[0059] Use the following steps ① to ③ to generate a control mark:

[0060] ①. Generate your own car icon.

[0061] Because the surrounding environment of the vehicle is constantly changing during driving, and the sensing device is installed on the vehicle body, the position of the sensing object in the surrounding environment can only be determined by the vehicle itself. Therefore, it is necessary to generate the vehicle icon corresponding to the vehicle that is "stationary" relative to the sensing device.

[0062] ②. Determine the relative position of the perceived object and the vehicle based on real-time perception data.

[0063] The real-time perception data collected by the perception device can be used to determine the position of the perception object in the surrounding environment relative to the vehicle, that is, the relative position of the perception object and the vehicle. There may be multiple perception objects in the surrounding environment within the perception range of the perception device, and each perception object has a relative position with the vehicle. For example: if the first perception object is the vehicle lane, the first perception object is located directly below the vehicle; if the second perception object is the vehicle in front of the left adjacent lane or the right adjacent lane, the second perception object is located in front of the left or right of the vehicle.

[0064] ③. Using the vehicle icon as a reference, generate an icon of the perceived object at the relative position of the vehicle icon, and generate a control mark.

[0065] The vehicle icon is regarded as the origin of the reference coordinate system, and the vehicle icon is used as a reference. According to the relative position of the perceived object and the vehicle, the icon of the perceived object is generated at the relative position of the vehicle icon. For example, if the first perceived object (such as the lane) is located directly below the vehicle, the icon of the first perceived object (the lane) is generated directly below the vehicle icon; if the third perceived object (such as the vehicle in front of the lane) is located directly in front of the vehicle, the icon of the second perceived object (the vehicle in front of the lane) is generated directly in front of the vehicle icon.

[0066] Step 120 , receiving in real time the current instruction input by the user with respect to the identification information of the vehicle and the identification information of the surrounding environment.

[0067] Step 130: According to at least one layer of security judgment mechanism, if it is determined that the current instruction is unreasonable, the next instruction adjacent to the current instruction is received, and the next instruction overwrites the current instruction.

[0068] The next instruction in this article overrides the current instruction. The next instruction can be a reasonable instruction, or it can be the final reasonable instruction after multiple unreasonable instructions.

[0069] At least one layer of security judgment mechanism in the embodiment of the present application is used to take security as the first principle, so that all instructions are ultimately reasonable instructions to improve security.

[0070] The safety judgment mechanism in this paper is used to represent the intelligent driving that determines that the current instructions are reasonable and makes the vehicle safe.

[0071] The current instruction is unreasonable, which indicates that the current instruction will affect driving safety. The unreasonable current instruction may include, but is not limited to, dangerous driving instructions or malicious instructions. The current instruction is, for example, that the current instruction is frequently generated in a short period of time. The current instruction is, for example, that there is no road on the left and right sides of the surrounding environment, such as sea water, and the current instruction is to turn left or right.

[0072] Next, the current command may be input by touch or by voice.

[0073] Step 140: If it is determined that the current instruction is reasonable, the vehicle is allowed to be controlled to drive according to the current instruction. In this way, intelligent driving of the vehicle according to the current instruction can be achieved.

[0074] This article not only supports the driver (called the main driver) to judge whether the instructions are reasonable, but also supports the co-pilot user to judge whether the current instructions are reasonable. Please see below for detailed instructions.

[0075] Figure 2 Shown Figure 1 A schematic diagram of the safety judgment mechanism of the vehicle safety control method shown.

[0076] Continue as Figure 1 and Figure 2 As shown, the safety judgment mechanism of the vehicle safety control method may include but is not limited to one or more of the user safety judgment mechanism, the driver safety judgment mechanism, the intelligent driving system safety judgment mechanism and the background safety supervision mechanism. In actual use, one or more can be used. When using all safety judgment mechanisms, the user safety judgment mechanism, the driver safety judgment mechanism, the intelligent driving system safety judgment mechanism and the background safety supervision mechanism can be performed in turn, and no further details will be given here.

[0077] In this regard, the above step 130 may adopt at least one of the following optional embodiments to implement overwriting the current instruction with the next instruction:

[0078] In a first optional embodiment, based on the user safety judgment mechanism, if the current instruction is determined to be unreasonable, the user re-enters the next instruction to overwrite the current instruction. The user safety judgment mechanism is used to indicate that the unreasonable instruction is corrected by the user.

[0079] The next instruction may include, but is not limited to, a deceleration instruction and / or a braking instruction, thereby creating a relatively safe use environment for the vehicle.

[0080] The user safety judgment mechanism is as follows:

[0081] 1. After the user issues a command, if Zhijia agrees to execute it, the user can cancel it at any time during the execution process by clicking the cancel button on the screen or using a voice cancel command. The user here can include the driver and other people besides the driver. The user, such as the co-pilot, issues a command, and the user, such as the back seat user, issues a command.

[0082] 2. After the user issues a command, if he finds that the command is unreasonable, he can overwrite the previous command with other commands to allow the intelligent driving to perform more reasonable operations.

[0083] 3. After the user issues a command and finds that there is a risk, he can use the deceleration command to let the intelligent driving slow down immediately to avoid the risk.

[0084] 4. After the user issues an instruction and finds that there is a risk, he can avoid the risk by issuing a brake instruction.

[0085] In the embodiment of the present application, if the user finds that he has entered the wrong current instruction, he can re-enter the next instruction to overwrite the unreasonable or wrong instruction and correct the wrong instruction in time to improve the security and accuracy of the instruction.

[0086] The driver and intelligent driving system in this article need to have the power, authority and means to effectively disable this function. Please see below for detailed instructions.

[0087] In the related art, when human-machine co-driving is controlled by screen touch or voice, there is a possibility that the operation is not performed by the driver himself, and this possibility may cause safety risks without the consent of the non-driver himself. The vehicle safety control method provided in the embodiment of the present application can eliminate the risks of human-machine co-driving by non-drivers through screen and voice by overwriting the operation of non-drivers by the driver.

[0088] Continue to see Figure 1 and Figure 2 As shown, in the second optional embodiment, the driver safety judgment mechanism based on the safety judgment mechanism, if it is determined that the current instruction is unreasonable, receives the driver to re-enter the next instruction to overwrite the current instruction; wherein, the driver safety judgment mechanism is used to indicate that the driver assists the user in correcting unreasonable instructions.

[0089] It should be noted that the driver has the highest authority and can take over or prohibit touch screen and voice control at any time. Therefore, even if the intelligent driving perception makes mistakes, misses detection or misjudges the risk of instructions, the driver can cancel, terminate or take over.

[0090] The above driver safety judgment mechanism is as follows:

[0091] 1. After the user issues a command, the driver can cancel or terminate the execution of the command by using the cancel command on the screen or voice cancel command.

[0092] 2. After the user issues a command, the driver can directly take over the vehicle to terminate the execution of the shared driving command.

[0093] 3. The driver can disable touch screen control and voice control with one button through the steering wheel combination button. After disabling, it can only be unlocked through the steering wheel button, and the soft switch is invalid to prevent others from continuing to operate after unlocking through the soft switch. The authority of the driver-car co-driving button is lower than that of the two buttons to disable screen touch and language.

[0094] In the related art, when the autonomous driving uses the touch screen, or the human-machine interaction controls the intelligent driving function through voice, the co-pilot or other people in the car cabin may maliciously interfere (such as children, pets, cats and dogs). In the embodiment of the present application, the risk of malicious interference is eliminated through multiple methods such as gesture intention inference, central control shortcut key locking, cloud recognition of malicious interference in the cabin, and manual takeover and exit by the driver.

[0095] In the embodiment of the present application, the driver can assist the user in correcting unreasonable instructions, thereby improving the safety and rationality of instruction input.

[0096] Figure 3 Shown Figure 1 A schematic diagram of a soft switch of a vehicle safety control method is shown.

[0097] Continue as Figure 1 and Figure 3 As shown, if it is determined that the current instruction is unreasonable, the receiving driver re-enters the next instruction to overwrite the current instruction, including:

[0098] If it is determined that the abnormal frequency of the current command is greater than the first frequency threshold, the driver is received to re-enter a disable command to overwrite the current command. The disable command is used to control the soft switch to be invalid, and the disable command is input through physical button operation. The disable command is also used to indicate that the input control authority of all software is disabled during this power-on cycle.

[0099] It should be noted that the intelligent driving system will analyze the rationality of the touch screen and voice control. If multiple and high-frequency unreasonable operations are found, the touch screen and voice control will be temporarily disabled until the owner confirms that they can be released and passes the re-test.

[0100] The first frequency threshold is used to indicate the tolerance of the vehicle to erroneous commands. The first frequency threshold is set according to user needs. The larger the first frequency threshold, the higher the frequency of erroneous commands tolerated.

[0101] The abnormal frequency of the above-mentioned current instruction is greater than the first frequency threshold, which is used to indicate that a malicious input instruction is currently received, such as only touch or voice, and no clear instruction. The embodiment of the present application needs to refuse to respond to this malicious input instruction. In order to avoid further losses caused by malicious intent, a disable instruction is input to disable the function of the soft switch, making the function of the soft switch invalid. In this way, even if malicious situations continue to exist, they are all regarded as invalid, reducing the losses caused by malicious intent.

[0102] Continue as Figure 3As shown, the function of the soft switch is entered in any of the following ways: 1) The touch interaction mode of human-vehicle co-driving is not disabled. 2) NOA (Navigation On Autopilot, intelligent driving assistance) is started, and the ADV (Advanced Driver Assistance System, advanced driving assistance system) map is turned on, and this function automatically takes effect.

[0103] The soft switch function is exited by any of the following methods: (1) the touch interaction mode of the driver-vehicle co-driving is disabled and the ADV map is exited; (2) NOA exits; (3) manual takeover.

[0104] In the embodiments of the present application, the system can fully withstand the user's misoperation and disorderly operation, and at the same time prevent the user's misoperation and disorderly operation, thereby improving the safety of vehicle control. At the same time, shared driving can reject intentions that may cause risks to the outside world, reject intentions that may cause risks to the vehicle itself, and reject intentions that violate laws and regulations. The system has the final say, and users can make misoperations / disorderly operations, and the intelligent driving judgment will be rejected if it is unreasonable or unsafe or cannot be achieved in the current environment.

[0105] Figure 4 Shown Figure 1 A schematic diagram of a physical button for generating a disable command in the vehicle safety control method shown.

[0106] like Figure 4 As shown, the physical buttons include physical buttons arranged on opposite sides of the steering wheel of the vehicle, and the physical buttons arranged on both sides are pressed simultaneously to generate a disable instruction.

[0107] like Figure 4 As shown, the above vehicle safety control method may further include but is not limited to the following two steps:

[0108] The first step is to receive a disabling instruction from a physical button (may be referred to as a button) of the vehicle; the physical button is used to disable the function of the soft switch.

[0109] In the second step, the disabling instruction overwrites the current instruction, and in response to the disabling instruction, controls the function of disabling the soft switch on the touch screen, and / or controls the touch function of the touch screen to be disabled.

[0110] In addition, after the disabling instruction overwrites the current instruction, the above method may also include but is not limited to exiting the function of the above soft switch, disabling the touch function of the above touch screen, and switching the touch screen to other screens. Other screens are commonly used screens for the main driver to use. Other screens are, for example, navigation screens, and other screens are, for example, entertainment music screens.

[0111] In the embodiment of the present application, by manually operating the physical buttons, the braking is forcibly disabled, thereby reducing the interference of other users on the main driver and improving the safety of the main driver.

[0112] Since there are many physical buttons in the vehicle and they are set in different locations. For example, the physical buttons can be buttons on the steering wheel or buttons on the center console. The number of the above physical buttons can be one or more, and there is no limitation here. The detailed description is as follows:

[0113] Continue as Figure 4 The physical buttons shown in the box are shown in FIG. The physical buttons in this article include physical buttons arranged on opposite sides of the steering wheel of the vehicle, and the physical buttons on both sides are pressed at the same time to generate a disable command.

[0114] The physical buttons arranged on opposite sides of the steering wheel may be two physical buttons, or more than two (not including two) physical buttons. For example, the two physical buttons are arranged symmetrically, which is not only beautiful, but also faster and more convenient for the driver to operate with both hands on the steering wheel.

[0115] In the embodiment of the present application, physical buttons are manually operated to forcibly disable the vehicle, thereby reducing the interference of the co-driver on the driver. At the same time, by operating multiple physical buttons at the same time, forced disabling is achieved, which not only facilitates the driver to disable the operation of other users, but also avoids the driver's misoperation.

[0116] In some actual application scenarios, after waiting for the current driving to end and the vehicle to be powered on again, the process returns to step 110 to step 140 to continue to determine whether the current instruction is reasonable, etc.

[0117] For the driver, the next instruction includes one or more of canceling the current instruction, terminating the shared driving instruction for the driver to physically take over, and disabling the instruction for controlling the soft switch to be invalid; the terminating the shared driving instruction has the highest authority.

[0118] Among them, physical takeover can be, but is not limited to, the user operating one or more of the steering wheel, stepping on the accelerator pedal, and stepping on the brake pedal to force exit from shared driving.

[0119] Continue to see Figure 1 and Figure 2As shown, in the third optional embodiment, the safety judgment mechanism also includes an intelligent driving system safety judgment mechanism. Accordingly, in step 1, according to the intelligent driving system safety judgment mechanism of the safety judgment mechanism, the rationality and risk of the current instruction are analyzed to determine whether the current instruction is reasonable. In step 2, if it is determined that the current instruction is unreasonable and the current instruction exceeds the scope that the intelligent driving system can handle, a request instruction for requesting manual takeover of the driver is generated to cover the current instruction. In step 3, if it is determined that the current instruction is unreasonable and is within the scope that the intelligent driving system can handle, the intelligent driving system is controlled. In step 4, if it is determined that the current instruction is reasonable, the above step 140 is executed.

[0120] Among them, the intelligent driving system safety judgment mechanism is used to indicate the rationality and risks of the intelligent driving system's judgment instructions.

[0121] It should be noted that the intelligent driving system is given high permissions, and touch screen or voice commands are only weak requests. Whether to execute and how to execute will be determined by the intelligent driving system. The intelligent driving system will include instructions in the safety assessment, and will reject those that are risky or beyond its capabilities (similar to changing lanes with a lever, the intelligent driving system will execute in time, delay execution or reject according to the situation). Therefore, even if someone maliciously operates randomly and gives a dangerous command, the vehicle will not execute it.

[0122] The safety judgment mechanism of the above-mentioned intelligent driving system is as follows:

[0123] 1. After receiving the instructions from the user, the intelligent driving system will analyze the rationality and risks of the instructions based on its own safety rules, and will refuse to execute or delay the execution of risky instructions.

[0124] 2. During the execution of the user's instructions, if the intelligent driving system finds that the dynamic environment is no longer suitable for continued execution, it will suspend or terminate the execution of the instructions and automatically adopt the most appropriate strategy to respond.

[0125] 3. During the process of executing the user's instructions, if the intelligent driving system finds that the dynamic environment is no longer suitable for continued execution and the emergency situation exceeds the capabilities of the intelligent driving system, the system will promptly request the user to take over.

[0126] 4. After receiving the instructions from the user, the system will analyze each instruction. If malicious operations are found, a warning will be issued. If there is no improvement, all touch screen control and voice control permissions will be disabled during this power-on cycle. For example, multiple obviously unreasonable instructions are received in a short period of time, and high-frequency irregular multi-finger gesture operations appear on the screen in a short period of time.

[0127] Continue to see Figure 1 and Figure 2As shown, in a fourth optional embodiment, the method further includes receiving a deactivation instruction from the background, and overwriting the current instruction with the deactivation instruction if the background safety supervision mechanism of the safety judgment mechanism detects that the frequency of disabling is greater than the second frequency threshold, so that the owner account applies for re-learning and then enables; wherein the deactivation instruction is used to indicate the termination of the intelligent driving function. In this way, the deactivation instruction can be used to overwrite the current instruction.

[0128] For example, if the smart driving system safety judgment mechanism is temporarily disabled multiple times within a certain period, the background will disable the touch screen control and voice control of the vehicle, that is, receive the background's deactivation command, so that the owner's account can apply for re-learning and re-enabling. In this way, after passing the learning and test, the function can be restored to normal use.

[0129] As an embodiment, the method also includes step 1, after allowing the vehicle to be controlled to drive according to the current instruction, displaying an interrupt icon mark for interrupting the execution of the current instruction and a continue icon mark for continuing the execution of the current instruction in the electronic image; the interrupt icon mark is used to interrupt the execution of the current instruction; the continue icon mark is used to continue the execution of the current instruction.

[0130] Step 2: If an operation is received for the interrupt icon input, the vehicle is interrupted to drive intelligently according to the current instruction.

[0131] Step 3: If an operation is received for inputting the continue icon mark, the vehicle is controlled to continue intelligent driving according to the current instruction.

[0132] In one example, in step A, an interruption touch indicator and / or a continue execution touch indicator are displayed in the electronic image; the interruption touch indicator is used to interrupt the execution of the first instruction; the continue execution touch indicator is used to continue the execution of the first instruction. In step B, if the interruption touch indicator is touched, the control of the vehicle to intelligently drive according to the first instruction is interrupted. In step C, if the continue execution touch indicator is touched, the vehicle is controlled to continue to intelligently drive according to the first instruction.

[0133] In another example, in step a, an interruption indicator and / or a continuation indicator are displayed in the electronic image; the interruption indicator is used to interrupt the execution of the first instruction; the continuation indicator is used to continue the execution of the first instruction. In step b, if a voice instruction input for the interruption indicator is received, the control of the vehicle to intelligently drive according to the first instruction is interrupted. In step c, if a voice instruction input for the continuation indicator is received, the vehicle is controlled to continue to intelligently drive according to the first instruction.

[0134] In the embodiment of the present application, the execution of instructions can be interrupted in a timely manner, so as to facilitate timely human-computer interaction with the user.

[0135] In this article, the authority of the human-vehicle co-driving command is lower than the authority of the intelligent driving judgment, and the authority of the intelligent driving system judgment is lower than the authority of physical takeover. The driving command sent by the user is just a wish (hoping that the vehicle will fulfill his wish), not command and control, let alone driving, but just communication with the intelligent driving system. Human-vehicle co-driving builds a channel to transmit the user's intention to the system, and each intention ensures that the system and the driver can reject or cancel the intention midway after the feasibility and risk assessment of the system. How to realize the intention is entirely decided by the system, and the decision-making process can be free from interference from the sender.

[0136] Next, it supports reasonable operations by the co-pilot (touch and slide) or other people in the car. The co-pilot only sends his intentions and does not directly operate the vehicle. In the past, the co-pilot passed the message to the driver to realize his intentions. Under the framework of shared driving, it is realized through the intelligent driving system. Both the driver and the intelligent driving system have driving qualifications and fully follow the existing architecture of "intelligent driving + driver supervision".

[0137] Finally, currently, intelligent driving is a black hole for users. The system focuses on the realization of functions, but lacks interaction with users during use, resulting in experience problems such as multiple takeovers, lack of personality, lack of confidence, and lack of security. Shared driving inserts an abstract middle layer between driving control and people, encapsulates driving behavior, decouples driving control from people, and makes the vehicle face people's intentions rather than control. In turn, shared driving also encapsulates the system's perception and decision-making into a reasonable form and displays it to users through HMI (Human-Machine Interface), thereby building a two-way interaction channel between people and cars, allowing users to have a fully controlled intelligent driving experience.

[0138] Based on the same inventive concept as the above method, the embodiment of the present application also provides a vehicle safety control device, such as Figure 5 As shown, the vehicle safety control device is used to implement the above vehicle safety control method. The above vehicle safety control device may include but is not limited to the following modules:

[0139] The electronic image acquisition module 31 is used to acquire the electronic image of the intelligent driving perception screen in real time; wherein the electronic image is used to display the identification information of the vehicle and the identification information of the surrounding environment;

[0140] The instruction acquisition module 32 is used to receive in real time the current instruction input by the user for the identification information of the vehicle and the identification information of the surrounding environment;

[0141] The instruction update module 33 is used to receive the next instruction adjacent to the current instruction and overwrite the current instruction with the next instruction according to at least one layer of safety judgment mechanism if the current instruction is determined to be unreasonable; the safety judgment mechanism is used to indicate that the vehicle can be driven safely after judging that the current instruction is reasonable; and

[0142] The control driving module 34 is used to control the vehicle to drive according to the current instruction if it is determined that the current instruction is reasonable.

[0143] As an embodiment, the above-mentioned vehicle safety control device also includes: an icon identification display module, which is used to display an interrupt icon identification for interrupting the execution of the current instruction and a continue icon identification for continuing the execution of the current instruction in the electronic image after allowing the control of the vehicle to drive according to the current instruction; the interrupt icon identification is used to interrupt the execution of the current instruction; the continue icon identification is used to continue the execution of the current instruction; an interrupt control module, which is used to interrupt the control of the vehicle to drive intelligently according to the current instruction if an operation is received for the interrupt icon identification input; a control module, which is used to control the vehicle to continue to drive intelligently according to the current instruction if an operation is received for the continue icon identification input.

[0144] The implementation process of the functions and effects of each module in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, and the same technical effect can be achieved, which will not be repeated here.

[0145] An embodiment of the present application provides an electronic device, including the above vehicle safety control device.

[0146] Of course, the electronic device is one or more of a server device and a PC (Personal Computer) device, wherein the server device and the PC device may include but are not limited to a server, a desktop computer, a tablet computer or a notebook computer.

[0147] In addition, the electronic device may include, but is not limited to, a vehicle-mounted terminal connected to the vehicle and a mobile terminal independent of the vehicle. The vehicle-mounted terminal connected to the vehicle may be, but is not limited to, a body processor, a controller, a center console, or a car HUD head-up display. The mobile terminal independent of the vehicle may be, but is not limited to, a smart phone, a smart phone watch, a tablet computer, or a laptop computer.

[0148] An embodiment of the present application provides a vehicle, comprising the above vehicle safety control device.

[0149] Exemplarily, the vehicle may include, but is not limited to, one or more of a heavy truck, a light commercial vehicle, and a passenger car. In this way, the method is applied to a variety of application scenarios such as heavy trucks, light commercial vehicles, and passenger cars, thereby improving the versatility of the method.

[0150] Figure 6 Shown is a schematic structural diagram of an electronic device 50 provided in an embodiment of the present application.

[0151] like Figure 6 As shown, the electronic device 50 includes one or more processors 51 for implementing the above vehicle safety control method.

[0152] In some embodiments, the electronic device 50 may include a storage medium 59. For example, the computer-readable storage medium may store a program that can be called by the processor 51, and may include a non-volatile storage medium. In some embodiments, the electronic device 50 may include a memory 58 and an interface 57. In some embodiments, the electronic device 50 may also include other hardware according to actual applications.

[0153] The computer-readable storage medium of the embodiment of the present application stores a program thereon, which, when executed by the processor 51, is used to implement the vehicle safety control method described above.

[0154] The present application provides a computer program product, comprising a computer program / instruction, which implements any of the above methods when executed by a processor.

[0155] The present application also provides a computer program, which is stored in a computer-readable storage medium, for example, Figure 6 The computer program is stored in a storage medium 59, and when the processor executes the computer program, the processor 51 is prompted to execute the method described above.

[0156] The present application may take the form of a computer program product implemented on one or more computer-readable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing program code. Computer-readable storage media include permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer-readable storage media include but are not limited to: phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

[0157] The above description is only a preferred embodiment of this specification and is not intended to limit this specification. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of this specification should be included in the scope of protection of this specification.

[0158] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the phrase "includes a ..." defines an element, and does not exclude the presence of other identical elements in the process, method, commodity or device including the element.

Claims

1. A vehicle safety control method, characterized in that: include: Acquire an electronic image of the intelligent driving perception screen in real time; wherein the electronic image is used to display the identification information of the vehicle and the identification information of the surrounding environment; receiving in real time a current instruction input by a user with respect to identification information of the vehicle and identification information of the surrounding environment; According to at least one layer of safety judgment mechanism, if it is determined that the current instruction is unreasonable, the next instruction adjacent to the current instruction is received, and the next instruction covers the current instruction; the safety judgment mechanism is used to indicate that the self-vehicle drives safely after judging that the current instruction is reasonable; wherein the safety judgment mechanism includes at least one of a user safety judgment mechanism, a driver safety judgment mechanism, an intelligent driving system safety judgment mechanism and a background safety supervision mechanism; as well as, If it is determined that the current instruction is reasonable, then the vehicle is allowed to be controlled to drive according to the current instruction.

2. The vehicle safety control method according to claim 1, characterized in that: The step of receiving a next instruction adjacent to the current instruction and overwriting the current instruction with the next instruction according to at least one layer of security judgment mechanism if the current instruction is determined to be unreasonable includes: Based on the user safety judgment mechanism of the safety judgment mechanism, if it is determined that the current instruction is unreasonable, receiving the user to re-enter the next instruction to overwrite the current instruction; The user safety judgment mechanism is used to indicate that unreasonable instructions are corrected by the user.

3. The vehicle safety control method according to claim 1 or 2, characterized in that: The step of receiving a next instruction adjacent to the current instruction and overwriting the current instruction with the next instruction according to at least one layer of security judgment mechanism if the current instruction is determined to be unreasonable includes: The driver safety judgment mechanism based on the safety judgment mechanism, if it is determined that the current instruction is unreasonable, receives the driver to re-enter the next instruction to overwrite the current instruction; The driver safety judgment mechanism is used to indicate that the driver assists the user in correcting unreasonable instructions.

4. The vehicle safety control method according to claim 3, characterized in that: If it is determined that the current instruction is unreasonable, receiving the next instruction re-entered by the driver to overwrite the current instruction, including: If it is determined that the abnormal frequency of the current instruction is greater than a first frequency threshold, receiving a disabling instruction re-entered by the driver to overwrite the current instruction; The disabling instruction is used to control the soft switch to be invalid, and the disabling instruction is input through a physical key operation.

5. The vehicle safety control method according to claim 4, characterized in that: The physical buttons include physical buttons arranged on opposite sides of the steering wheel of the vehicle, and the physical buttons arranged on the two sides are pressed simultaneously to generate the disabling instruction.

6. The vehicle safety control method according to claim 3, characterized in that: The next instruction includes one or more of canceling the current instruction, a termination co-driving instruction for the driver to physically take over, and a disable instruction for controlling the soft switch to be invalid; the termination co-driving instruction has the highest authority.

7. The vehicle safety control method according to claim 3, characterized in that: The safety judgment mechanism also includes an intelligent driving system safety judgment mechanism; The step of receiving a next instruction adjacent to the current instruction and overwriting the current instruction with the next instruction according to at least one layer of security judgment mechanism if the current instruction is determined to be unreasonable includes: Analyzing the rationality and risk of the current instruction according to the intelligent driving system safety judgment mechanism to determine whether the current instruction is reasonable; If it is determined that the current instruction is unreasonable and the current instruction is beyond the scope that the intelligent driving system can handle, a request instruction for requesting the driver to take over manually is generated to cover the current instruction; Among them, the intelligent driving system safety judgment mechanism is used to indicate the rationality and risks of the intelligent driving system judgment instructions.

8. The vehicle safety control method according to claim 3, characterized in that: The step of receiving a next instruction adjacent to the current instruction and overwriting the current instruction with the next instruction according to at least one layer of security judgment mechanism if the current instruction is determined to be unreasonable includes: If the background safety supervision mechanism of the safety judgment mechanism detects that the disabling frequency is greater than the second frequency threshold, a background deactivation instruction is received, and the deactivation instruction overwrites the current instruction, so that the vehicle owner account applies for re-learning and then reactivation; Among them, the deactivation instruction is used to indicate the termination of the intelligent driving function.

9. The vehicle safety control method according to any one of claims 4 to 8, characterized in that: After allowing the vehicle to be controlled to drive according to the current instruction, the method further includes: An interrupt icon for interrupting the execution of the current instruction and a continue icon for continuing the execution of the current instruction are displayed in the electronic image; the interrupt icon is used to interrupt the execution of the current instruction; the continue icon is used to continue the execution of the current instruction; If an operation for the interrupt icon mark input is received, the control of the vehicle to intelligently drive according to the current instruction is interrupted; If an operation for inputting the continue-execution icon mark is received, the vehicle is controlled to continue intelligent driving according to the current instruction.

10. A vehicle safety control device, characterized in that: For implementing the vehicle safety control method according to any one of claims 1 to 9, the vehicle safety control device comprises: An electronic image acquisition module, used to acquire an electronic image of an intelligent driving perception screen in real time; wherein the electronic image is used to display identification information of the vehicle and identification information of the surrounding environment; An instruction acquisition module, used for receiving in real time the current instruction input by the user with respect to the identification information of the vehicle and the identification information of the surrounding environment; An instruction update module is used to receive a next instruction adjacent to the current instruction and overwrite the current instruction with the next instruction according to at least one layer of safety judgment mechanism, if the current instruction is determined to be unreasonable; the safety judgment mechanism is used to indicate that the self-vehicle drives safely after judging that the current instruction is reasonable; wherein the safety judgment mechanism includes at least one of a user safety judgment mechanism, a driver safety judgment mechanism, an intelligent driving system safety judgment mechanism and a background safety supervision mechanism; as well as, The control driving module is used to allow the vehicle to be controlled to drive according to the current instruction if it is determined that the current instruction is reasonable.

11. An electronic device, characterized in that: It comprises one or more processors for implementing the vehicle safety control method as described in any one of claims 1-9.

12. A vehicle, characterized in that: It comprises one or more processors for implementing the vehicle safety control method as described in any one of claims 1-9.

13. A computer-readable storage medium, characterized in that: A program is stored thereon, and when the program is executed by a processor, the vehicle safety control method as described in any one of claims 1-9 is implemented.

Images