Sentry mode interaction method and apparatus, and electronic device

Abstract

The invention relates to a sentry mode interaction method and device and electronic equipment, and belongs to the technical field of intelligent driving, and the interaction method comprises the steps: obtaining a visual danger value, a radar alarm value and a vehicle body vibration value, obtaining a risk value according to the visual danger value, the radar alarm value and the vehicle body vibration value, obtaining a risk level according to the risk value, and obtaining a risk result; according to the risk level, the interaction mode is determined, the interaction mode comprises low-risk interaction, medium-risk interaction and high-risk interaction, the interaction mode is changed from low risk to high risk, the corresponding reminding level is progressive layer by layer, and dangerous events can be effectively prevented from continuing to spread.

Description

Technical Field

[0001] The present application relates to the field of intelligent driving technology, and in particular to an interaction method, device and electronic device of a sentinel mode. Background Art

[0002] The sentry mode function of the existing intelligent driving system can support the continuous recording of image information around the vehicle body when the vehicle is powered off. If a risk event such as body damage occurs, it can be used for subsequent investigation and evidence collection. However, there is a lack of effective means to prevent the occurrence of risk events. Therefore, there is an urgent need for a method that can interact according to the risk level of the vehicle body to effectively reduce the occurrence of risk events. Summary of the invention

[0003] To this end, the present invention provides a sentinel mode interaction method, device and electronic device to solve the problem of lack of effective means to prevent the occurrence of risk events in the prior art.

[0004] In a first aspect, a sentinel mode interaction method is provided, the method comprising:

[0005] Obtain visual danger values, radar warning values ​​and vehicle body vibration values;

[0006] Obtaining a risk value according to the visual danger value, the radar warning value and the vehicle body vibration value;

[0007] A risk level is obtained based on the risk value;

[0008] An interaction mode is determined according to the risk level; the interaction mode includes low-risk interaction, medium-risk interaction and high-risk interaction.

[0009] Further, the risk value is obtained according to the visual danger value, the radar warning value and the vehicle body vibration value, including:

[0010] The risk value is obtained according to the risk formula, and the risk formula is:

[0011] E=μ 1 α+μ 2 β+μ 3 χ;

[0012] Among them, E is the risk value; α is the visual hazard value; μ 1 is the visual hazard value weight; β is the radar alarm value; μ 2 is the radar alarm value weight; χ is the vehicle body vibration value; μ 3 is the weight of the vehicle body vibration value.

[0013] Furthermore, obtaining a risk level according to the risk value includes:

[0014] If the risk value is less than or equal to the first preset risk value, the risk level is a low risk level;

[0015] If the risk value is greater than the first preset risk value and less than or equal to the second preset risk value, the risk level is a medium risk level;

[0016] If the risk value is greater than a second preset risk value, the risk level is a high risk level.

[0017] Further, determining the interaction mode according to the risk level includes:

[0018] If the risk level is a low risk level, a dynamic detection device around the vehicle body is turned on to record the motion state of moving objects around the vehicle body;

[0019] If the risk level is a medium risk level, the dynamic detection device around the vehicle body is turned on, and the sound and light prompts are turned on at the same time to remind pedestrians or passing vehicles to pay attention to the distance between vehicles;

[0020] If the risk level is a high risk level, the dynamic detection device around the vehicle body will be turned on, and the sound and light prompts will be turned on. At the same time, the car owner will be actively called according to the voice communication method reserved by the owner. When the voice is connected, the external speaker of the vehicle will be connected to facilitate the owner to communicate with people around the vehicle body.

[0021] Furthermore, the visual hazard value weight, the radar alarm value weight and the vehicle body vibration value weight are all set according to the sensitivity of the sentinel mode; the sensitivity of the sentinel mode is set according to the sentinel mode set by the vehicle owner.

[0022] Furthermore, obtaining the visual risk value includes:

[0023] Collect real-time images of objects around the vehicle body through the vehicle body camera;

[0024] Obtaining the real-time collision coefficient using an existing kinematics model according to the real-time image;

[0025] If the collision coefficient is greater than a preset collision coefficient, the collision coefficient is the visual hazard value.

[0026] Further, the obtaining of the radar alarm value includes:

[0027] Collect the distance value of the nearest object around the vehicle body through radar;

[0028] If the distance value is less than the preset distance value, the distance value is the radar alarm value.

[0029] Furthermore, obtaining the vehicle body vibration value includes:

[0030] Obtain the vibration amplitude value of the vehicle body through the vibration sensor;

[0031] If the vibration amplitude value is greater than the preset vibration amplitude, the vibration amplitude value is the vehicle body vibration value.

[0032] In a second aspect, a sentinel mode interaction device is provided, the device comprising:

[0033] An acquisition module is used to acquire visual danger values, radar warning values ​​and vehicle body vibration values;

[0034] A risk value module, used for obtaining a risk value according to the visual danger value, the radar warning value and the vehicle body vibration value;

[0035] A risk level module, used to obtain a risk level according to the risk value;

[0036] The interaction mode determination module is used to determine the interaction mode according to the risk level; the interaction mode includes low-risk interaction, medium-risk interaction and high-risk interaction.

[0037] In a third aspect, an electronic device is provided, including:

[0038] at least one processor; and

[0039] a memory communicatively connected to the at least one processor; wherein,

[0040] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform any of the above-mentioned sentinel mode interaction methods.

[0041] The present invention adopts the above technical solution and has at least the following beneficial effects:

[0042] Provided is a sentinel mode interaction method, device and electronic equipment, which obtain visual hazard values, radar alarm values ​​and vehicle body vibration values, obtain risk values ​​based on the visual hazard values, radar alarm values ​​and vehicle body vibration values, obtain risk levels based on the risk values, and determine interaction modes based on the risk levels. The interaction modes include low-risk interaction, medium-risk interaction and high-risk interaction. The interaction modes range from low risk to high risk, and the corresponding reminder levels are also progressive, which can effectively prevent dangerous events from continuing to spread.

[0043] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0045] Figure 1 is a flow chart of an interactive method of sentinel mode shown in an exemplary embodiment of the present invention;

[0046] Figure 2 is a schematic block diagram of an interactive device in sentinel mode shown in an exemplary embodiment of the present invention;

[0047] Figure 3 It is a schematic block diagram of an electronic device shown in an exemplary embodiment of the present invention. DETAILED DESCRIPTION

[0048] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0049] The sentry mode function of the existing intelligent driving system can support the continuous recording of image information around the vehicle body when the vehicle is powered off. If a risk event such as vehicle body damage occurs, it can be used for subsequent investigation and evidence collection. However, there is no effective means to prevent the occurrence of risk events.

[0050] The embodiments of the present application provide a sentinel mode interaction method, device and electronic device. The interaction mode is determined according to the risk level. The interaction modes include low-risk interaction, medium-risk interaction and high-risk interaction. The interaction modes range from low risk to high risk, and the corresponding reminder levels are also progressive, which can effectively prevent the dangerous incident from continuing to spread. If the sentinel alarm incident has already occurred, the vehicle owner and the people outside the vehicle can communicate remotely and in a timely manner when the incident occurs, thereby saving communication costs.

[0051] The method and device in this application are described below through specific embodiments.

[0052] See also Figure 1 , Figure 1 is a flowchart of an interactive method of sentinel mode shown in an exemplary embodiment of the present invention, see Figure 1 , the method comprising:

[0053] Step S11, obtaining a visual danger value, a radar warning value, and a vehicle body vibration value;

[0054] Step S12, obtaining a risk value according to the visual danger value, the radar warning value and the vehicle body vibration value;

[0055] Step S13, obtaining a risk level according to the risk value;

[0056] Step S14: determining an interaction mode according to the risk level; the interaction mode includes low-risk interaction, medium-risk interaction and high-risk interaction.

[0057] It should be noted that the technical solution provided in this embodiment can be added to the existing Sentinel system in the form of a small program in specific practice, or it can also be in the form of an independent application to provide an interface to the outside world to complete the interactive function; applicable scenarios include but are not limited to: intelligent driving and smart cockpit.

[0058] It can be understood that the method provided in this embodiment obtains the risk value based on the visual hazard value, the radar alarm value and the vehicle body vibration value, obtains the risk level based on the risk value, and determines the interaction mode based on the risk level. The interaction modes include low-risk interaction, medium-risk interaction and high-risk interaction. The interaction modes range from low risk to high risk, and the corresponding reminder levels are also progressive, which can effectively prevent the dangerous events from continuing to spread.

[0059] In specific practice, "obtaining visual danger value, radar alarm value and vehicle body vibration value" in step S11 includes: collecting real-time images of objects around the vehicle body through the vehicle body camera; obtaining real-time collision coefficients based on the real-time images using the existing kinematic model; if the collision coefficient is greater than the preset collision coefficient, the collision coefficient is the visual danger value. Collecting the distance value of the nearest object around the vehicle body through radar; if the distance value is less than the preset distance value, the distance value is the radar alarm value. Obtaining the vibration amplitude value of the vehicle body through the vibration sensor; if the vibration amplitude value is greater than the preset vibration amplitude, the vibration amplitude value is the vehicle body vibration value.

[0060] It should be noted that the preset collision coefficient, preset distance value and preset vibration amplitude are obtained based on the historical data of the Sentinel system. The historical data include the collision coefficient of the collision object when various sentinel events occur, the distance between the collision object and the vehicle body before various sentinel events occur, and the vibration amplitude value of the vehicle body when various sentinel events occur.

[0061] In specific practice, in step S12, "obtaining a risk value based on the visual danger value, the radar alarm value and the vehicle body vibration value" includes: obtaining a risk value based on a risk formula, and the risk formula is: E = μ 1 α+μ 2 β+μ 3 χ; where E is the risk value; α is the visual hazard value; μ 1 is the visual hazard value weight; β is the radar alarm value; μ 2 is the radar alarm value weight; χ is the vehicle body vibration value; μ3 is the weight of the vehicle body vibration value.

[0062] It should be noted that the visual hazard value weight, radar alarm value weight and vehicle body vibration value weight are all set according to the sensitivity of the sentinel mode; the sensitivity of the sentinel mode is set according to the sentinel mode setting set by the car owner.

[0063] In specific practice, "obtaining a risk level based on the risk value" in step S13 includes: if the risk value is less than or equal to a first preset risk value, the risk level is a low risk level; if the risk value is greater than the first preset risk value and less than or equal to a second preset risk value, the risk level is a medium risk level; if the risk value is greater than the second preset risk value, the risk level is a high risk level.

[0064] It should be noted that the first preset risk value is smaller than the second preset risk value, and the first preset risk value and the second preset risk value are set according to the sentry mode set by the vehicle owner.

[0065] In specific practice, "determining the interaction mode according to the risk level" in step S14 includes: if the risk level is a low risk level, turning on the dynamic detection device around the vehicle body to record the motion status of moving objects around the vehicle body; if the risk level is a medium risk level, turning on the dynamic detection device around the vehicle body, and turning on the sound prompt and light prompt at the same time, so as to remind pedestrians or passing vehicles to pay attention to the distance between vehicles; if the risk level is a high risk level, turning on the dynamic detection device around the vehicle body, turning on the sound prompt and light prompt, and actively calling the owner according to the voice communication method reserved by the owner, and connecting the vehicle's external speaker when the voice is connected, so that the owner can communicate with people around the vehicle body.

[0066] It should be noted that when the Sentry Mode system is working, it continuously records and saves image information of risk events to the vehicle and the cloud. When the risk level is high, the owner can communicate with the owner of the collision vehicle based on the video in the cloud.

[0067] It can be understood that, in the technical solution provided in this embodiment, the interaction mode ranges from low risk to high risk, and the corresponding reminder levels are also progressive, which can effectively prevent the dangerous incident from continuing to spread.

[0068] See also Figure 2 , Figure 2 is a schematic block diagram of an interactive device in sentinel mode according to an exemplary embodiment of the present invention, see Figure 2 , the sentinel mode interaction device 100 includes:

[0069] An acquisition module 101 is used to acquire a visual danger value, a radar warning value, and a vehicle body vibration value;

[0070] A risk value module 102, used to obtain a risk value according to a visual danger value, a radar warning value and a vehicle body vibration value;

[0071] A risk level module 103 is used to obtain a risk level according to the risk value;

[0072] The interaction mode determination module 104 is used to determine the interaction mode according to the risk level; the interaction mode includes low-risk interaction, medium-risk interaction and high-risk interaction.

[0073] It should be noted that the technical solution provided in this embodiment can be applied in specific practice to scenarios including but not limited to: intelligent driving and intelligent cockpit.

[0074] It can be understood that the device provided in this embodiment obtains a risk value based on the visual hazard value, the radar alarm value and the vehicle body vibration value, obtains a risk level based on the risk value, and determines an interaction mode based on the risk level. The interaction modes include low-risk interaction, medium-risk interaction and high-risk interaction. The interaction modes range from low risk to high risk, and the corresponding reminder levels are also progressive, which can effectively prevent the dangerous events from continuing to spread.

[0075] See also Figure 3 , Figure 3 is a schematic block diagram of an electronic device according to an exemplary embodiment of the present invention, see Figure 3 , an electronic device 200, comprising:

[0076] at least one processor 202; and

[0077] A memory 201 is communicatively connected to at least one processor 202; wherein,

[0078] The memory 201 stores instructions that can be executed by at least one processor 202. The instructions are executed by the at least one processor 202 to enable the at least one processor 202 to execute any of the above-mentioned sentinel mode interaction methods.

[0079] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

[0080] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0081] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0082] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A sentinel mode interaction method, characterized in that: The method comprises: Obtain visual danger values, radar warning values ​​and vehicle body vibration values; Obtaining a risk value according to the visual danger value, the radar warning value and the vehicle body vibration value; A risk level is obtained based on the risk value; An interaction mode is determined according to the risk level; the interaction mode includes low-risk interaction, medium-risk interaction and high-risk interaction.

2. The method according to claim 1, characterized in that The risk value is obtained according to the visual danger value, the radar warning value and the vehicle body vibration value, including: The risk value is obtained according to the risk formula, and the risk formula is: E=μ1α+μ2β+μ3χ; Among them, E is the risk value; α is the visual hazard value; μ1 is the visual hazard value weight; β is the radar alarm value; μ2 is the radar alarm value weight; χ is the body vibration value; μ3 is the body vibration value weight.

3. The method according to claim 2, characterized in that The risk level obtained based on the risk value includes: If the risk value is less than or equal to the first preset risk value, the risk level is a low risk level; If the risk value is greater than the first preset risk value and less than or equal to the second preset risk value, the risk level is a medium risk level; If the risk value is greater than a second preset risk value, the risk level is a high risk level.

4. The method according to claim 3, characterized in that: Determining the interaction mode according to the risk level includes: If the risk level is a low risk level, a dynamic detection device around the vehicle body is turned on to record the motion state of moving objects around the vehicle body; If the risk level is a medium risk level, the dynamic detection device around the vehicle body is turned on, and the sound and light prompts are turned on at the same time to remind pedestrians or passing vehicles to pay attention to the distance between vehicles; If the risk level is a high risk level, the dynamic detection device around the vehicle body will be turned on, and the sound and light prompts will be turned on. At the same time, the car owner will be actively called according to the voice communication method reserved by the owner. When the voice is connected, the external speaker of the vehicle will be connected to facilitate the owner to communicate with people around the vehicle body.

5. The method according to claim 2, characterized in that: The visual danger value weight, the radar warning value weight and the vehicle body vibration value weight are all set according to the sensitivity of the sentinel mode; the sensitivity of the sentinel mode is set according to the sentinel mode set by the vehicle owner.

6. The method according to claim 1, characterized in that The obtaining of the visual risk value comprises: Collect real-time images of objects around the vehicle body through the vehicle body camera; Obtaining the real-time collision coefficient using an existing kinematics model according to the real-time image; If the collision coefficient is greater than a preset collision coefficient, the collision coefficient is the visual hazard value.

7. The method according to claim 1, characterized in that The obtaining of the radar alarm value comprises: Collect the distance value of the nearest object around the vehicle body through radar; If the distance value is less than the preset distance value, the distance value is the radar alarm value.

8. The method according to claim 1, characterized in that: The obtaining of the vehicle body vibration value comprises: Obtain the vibration amplitude value of the vehicle body through the vibration sensor; If the vibration amplitude value is greater than the preset vibration amplitude, the vibration amplitude value is the vehicle body vibration value.

9. An interactive device in sentinel mode, characterized in that: The device comprises: An acquisition module is used to acquire visual danger values, radar warning values ​​and vehicle body vibration values; A risk value module, used for obtaining a risk value according to the visual danger value, the radar warning value and the vehicle body vibration value; A risk level module, used to obtain a risk level according to the risk value; The interaction mode determination module is used to determine the interaction mode according to the risk level; the interaction mode includes low-risk interaction, medium-risk interaction and high-risk interaction.

10. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the sentinel mode interaction method according to any one of claims 1 to 8.

Images