Vehicle risk reminding method and device, vehicle, medium and computer program product

Abstract

The invention relates to the technical field of vehicles, in particular to a vehicle risk reminding method and device, a vehicle, a medium and a computer program product.The method comprises the steps that surrounding environment information of the vehicle is collected; determining a risk target meeting a preset condition in the surrounding environment information, and evaluating a risk level of the risk target; and constructing a secondary virtual animation of the behavior of the risk target according to the risk level, and displaying the secondary virtual animation on the vehicle-mounted screen equipment. Therefore, the problem that the severity degree of the risk cannot be accurately transmitted due to the fact that risk reminding is carried out on the user only in a visual marking mode in the related technology is solved.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a vehicle risk reminder method, device, vehicle, medium and computer program product. Background Art

[0002] As the number of cars continues to increase, the incidence of road traffic accidents has also increased. In order to improve driving safety and reduce traffic accidents, various driving risk warning systems and technologies have been developed. These systems usually identify potential risk targets by sensing the surrounding environment of the vehicle and provide warning information to the driver.

[0003] The main methods of driving risk reminders in related technologies include using sensors (such as cameras, radars, lidars, etc.) to detect objects and pedestrians around the vehicle, and marking these risk targets through the in-vehicle screen or other display devices. For example, some systems will mark risk targets with a red box or icon on the screen, which may be accompanied by a sound prompt or text description.

[0004] However, simple visual markings in related technologies may not be enough to attract the driver's attention, especially in complex traffic environments. A single reminder method (such as using only color markings or sound prompts) may not be able to fully convey the severity of the risk, making it difficult for the driver to accurately judge the impending danger. Summary of the invention

[0005] The present application provides a vehicle risk reminder method, device, vehicle, medium and computer program product to solve the problem that the risk reminder to the user is only provided by visual marking in the related art, but the severity of the risk cannot be accurately conveyed.

[0006] The first aspect of the present application provides a vehicle risk reminder method, comprising the following steps: collecting the surrounding environment information of the vehicle; determining the risk targets that meet the preset conditions in the surrounding environment information, and evaluating the risk level of the risk targets; constructing a secondary virtual animation of the behavior of the risk targets according to the risk level, and displaying the secondary virtual animation on the vehicle-mounted screen device.

[0007] Optionally, evaluating the risk level of the risk target includes: obtaining the risk type of the risk target; and determining the risk level of the risk target according to the risk type and the relative position and speed between the risk target and the vehicle.

[0008] Optionally, the risk levels include first to third risk levels, and constructing a secondary virtual animation of the behavior of the risk target according to the risk levels includes: determining a virtual animation template according to the risk levels; and constructing a secondary virtual animation of the behavior of the risk target based on the virtual animation template.

[0009] Optionally, different risk levels correspond to different virtual animation templates, wherein the first risk level corresponds to a basic prompt template, the second risk level corresponds to an enhanced warning template, and the third risk level corresponds to an emergency alert template.

[0010] Optionally, a secondary virtual animation of the behavior of the risk target is constructed based on the virtual animation template, including: if the virtual animation template is a basic prompt template, the secondary virtual animation is to display the basic motion trajectory or basic form of the risk target; if the virtual animation template is an enhanced warning template, the secondary virtual animation is to display the accelerated motion or irregular motion of the risk target; if the virtual animation template is an emergency alert template, the secondary virtual animation is to display the emergency avoidance action of the risk target or to magnify the risk target.

[0011] The second aspect of the present application provides a vehicle risk reminder device, including: a collection module for collecting the surrounding environment information of the vehicle; a determination module for determining the risk targets that meet preset conditions in the surrounding environment information and evaluating the risk level of the risk targets; a reminder module for constructing a secondary virtual animation of the behavior of the risk target according to the risk level, and displaying the secondary virtual animation on a vehicle-mounted screen device.

[0012] Optionally, the determination module is further used to: obtain the risk type of the risk target; and determine the risk level of the risk target according to the risk type, the relative position and speed between the risk target and the vehicle.

[0013] Optionally, the risk level includes first to third risk levels, and the reminder module is further used to determine a virtual animation template according to the risk level; and construct a secondary virtual animation of the behavior of the risk target based on the virtual animation template.

[0014] Optionally, different risk levels correspond to different virtual animation templates, wherein the first risk level corresponds to a basic prompt template, the second risk level corresponds to an enhanced warning template, and the third risk level corresponds to an emergency alert template.

[0015] Optionally, the reminder module is further used to, if the virtual animation template is a basic prompt template, then the secondary virtual animation is to display the basic motion trajectory or basic form of the risk target; if the virtual animation template is an enhanced warning template, then the secondary virtual animation is to display the accelerated motion or irregular motion of the risk target; if the virtual animation template is an emergency alert template, then the secondary virtual animation is to display the emergency avoidance action of the risk target or to enlarge the risk target.

[0016] The third aspect of the present application provides a vehicle, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement a vehicle risk reminder method as described in the above embodiment.

[0017] The fourth aspect of the present application provides a computer-readable storage medium on which a computer program or instruction is stored. When the computer program or instruction is executed, it is used to implement the vehicle risk reminder method as described in the above embodiment.

[0018] The fifth aspect of the present application provides a computer program product, including: a computer program or instructions, which, when executed, implements the vehicle risk reminder method as described in the above embodiment.

[0019] Therefore, this application has at least the following beneficial effects:

[0020] The embodiment of the present application can identify potential collision risk targets around the vehicle, and by creating secondary virtual animations of the behavior of the risk targets, the risk situation can be presented to the driver in a more intuitive and vivid way, and the appropriate reminder intensity can be selected according to different risk levels, thereby significantly improving driving safety and reducing the accident rate. This solves the problem that the risk reminder to the user is only provided by visual marking in the related art, and the severity of the risk cannot be accurately conveyed.

[0021] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0023] Figure 1 A flow chart of a vehicle risk reminder method provided according to an embodiment of the present application;

[0024] Figure 2 This is an enhanced example diagram of a secondary virtual animation provided according to an embodiment of the present application;

[0025] Figure 3 A block diagram of a vehicle risk reminder device provided according to an embodiment of the present application;

[0026] Figure 4 It is a schematic diagram of the structure of a vehicle according to an embodiment of the present application. DETAILED DESCRIPTION

[0027] Embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0028] The vehicle risk reminder method, device, vehicle, medium and computer program product of the embodiments of the present application are described below with reference to the accompanying drawings. In response to the problems mentioned in the above background technology, the present application provides a vehicle risk reminder method, in which potential collision risk targets around the vehicle can be identified, and the risk situation can be presented to the driver in a more intuitive and vivid way by creating a secondary virtual animation of the behavior of the risk target, and the appropriate reminder intensity can be selected according to different risk levels, thereby significantly improving driving safety and reducing the accident rate. As a result, the problem of only reminding users of risks through visual markings in the related technology and failing to accurately convey the severity of the risk is solved.

[0029] Specifically, Figure 1 A flow chart of a vehicle risk reminder method provided in an embodiment of the present application.

[0030] like Figure 1 As shown, the vehicle risk reminder method includes the following steps:

[0031] In step S101 , the surrounding environment information of the vehicle is collected.

[0032] It is understandable that the embodiments of the present application can collect environmental information around the vehicle in real time through a sensing device installed on the vehicle (such as a camera, radar, laser radar, ultrasonic sensor, etc.), wherein the environmental information may include: the location of surrounding objects, road conditions, etc.

[0033] In step S102, risk targets that meet preset conditions in the surrounding environment information are determined, and risk levels of the risk targets are evaluated.

[0034] After receiving the surrounding environment information, the embodiment of the present application can identify potential risk targets, which are pedestrians, animals, other vehicles, static obstacles, etc. that may pose a real threat to the vehicle. The preset conditions are to screen out those risk targets that may pose a real threat to the vehicle, and can be specifically set according to the actual situation. For example, for pedestrians, stricter distance and speed thresholds may be required; for other vehicles, their driving trajectory and intention may need to be considered, without making specific new settings.

[0035] In one embodiment of the present application, evaluating the risk level of a risk target includes: obtaining a risk type of the risk target; and determining the risk level of the risk target according to the risk type, the relative position and speed between the risk target and the vehicle. The risk level includes first to third risk levels.

[0036] It is understandable that the embodiments of the present application can classify risk targets into different risk types according to their characteristics, such as pedestrians, bicycles, cars, fixed obstacles, etc. The embodiments of the present application can calculate the relative position (distance and angle) between the risk target and the vehicle and their respective moving speeds based on the data collected by the vehicle sensor.

[0037] Furthermore, the embodiment of the present application can evaluate the risk level according to the risk type, relative position and speed of the risk target. Specifically, the risk level can be divided into the first to third risk levels, where:

[0038] The first risk level may represent a lower risk, for example, the risk target is at a greater distance and is moving slowly or stationary. The second risk level may represent a medium risk, for example, the risk target is close to the vehicle but its moving speed is moderate, or the risk target is approaching the vehicle at a faster speed.

[0039] The third risk level may represent a higher risk, for example, the risk target is very close to the vehicle and moves toward the vehicle at a high speed, or the risk target suddenly appears in front of the vehicle.

[0040] In step S103, a secondary virtual animation of the behavior of the risk target is constructed according to the risk level, and the secondary virtual animation is displayed on the in-vehicle screen device.

[0041] The embodiments of the present application can create secondary virtual animations of the behaviors of risky targets and remind users through the in-car screen, thereby presenting risk situations to drivers in a more intuitive and vivid manner, thereby improving driving safety and reducing the accident rate.

[0042] In one embodiment of the present application, constructing a secondary virtual animation of the behavior of the risk target according to the risk level includes: determining a virtual animation template according to the risk level; and constructing a secondary virtual animation of the behavior of the risk target based on the virtual animation template.

[0043] Among them, different risk levels correspond to different virtual animation templates, among which the first risk level corresponds to the basic prompt template, the second risk level corresponds to the enhanced warning template, and the third risk level corresponds to the emergency alarm template.

[0044] Furthermore, a secondary virtual animation of the behavior of the risk target is constructed based on the virtual animation template, including: if the virtual animation template is a basic prompt template, the secondary virtual animation is to display the basic motion trajectory or basic form of the risk target; if the virtual animation template is an enhanced warning template, the secondary virtual animation is to display the accelerated motion or irregular motion of the risk target; if the virtual animation template is an emergency alarm template, the secondary virtual animation is to display the emergency avoidance action of the risk target or to magnify the risk target.

[0045] It is understandable that the embodiment of the present application can generate a secondary virtual animation of the corresponding risk target according to the virtual animation template. If the virtual animation template is a basic prompt template, the secondary virtual animation is to show the basic motion trajectory or basic form of the risk target. For example, if the risk target is a pedestrian, the animation may simply show the pedestrian's walking trajectory. If the virtual animation template is an enhanced warning template, the secondary virtual animation is to show the accelerated motion or irregular motion of the risk target. For example, if the risk target is a fast-approaching bicycle, the animation will show the acceleration process and irregular movement path of the bicycle. If the virtual animation template is an emergency alarm template, the secondary virtual animation is to show the emergency avoidance action of the risk target or to amplify the risk target. For example, if the risk target is a car that suddenly appears, the animation will show the emergency braking or sharp turning action of the car, and the image of the car may be enlarged to attract the driver's high attention.

[0046] Furthermore, the generated secondary virtual animation is displayed to the driver through the in-vehicle screen device. These screen devices may include but are not limited to: AR glasses, AR-HUD, instrument screen, central control screen, co-pilot screen, rear screen, etc.

[0047] In addition to visual display, multiple sensory stimulations such as sound, color change, and tactile feedback can be combined to further improve the driver's alertness. For example: Sound prompts: For low risks, soft sound prompts can be used; for medium risks, obvious warning sounds can be used; for high risks, rapid alarm sounds can be used. Color changes: For low risks, light yellow or orange highlight marks can be used; for medium risks, yellow or red highlight marks can be used with flashing effects; for high risks, continuously flashing red highlight marks can be used. Tactile feedback: For high risks, seat vibrations or steering wheel vibrations can be used to increase the driver's perception.

[0048] The construction of the secondary virtual animation involved in the embodiment of the present application is described in detail below. Figure 2 As shown in the figure, the upper part shows a car driving on the road with a pedestrian crossing the road in front. On the map page of perception restoration, the pedestrian obstacle is identified, so the pedestrian is identified as a risk target. The lower part shows the secondary virtual animation built according to the risk level, making the behavior of the risk target more obvious. In this example, the pedestrian's actions are magnified or displayed in a more obvious animation form to enhance the driver's attention. Through the secondary virtual animation, the driver can observe the risk point more intuitively, thereby improving driving safety.

[0049] According to the vehicle risk reminder method proposed in the embodiment of the present application, it is possible to identify potential collision risk targets around the vehicle, and by creating secondary virtual animations of the behaviors of the risk targets, the risk situation can be presented to the driver in a more intuitive and vivid way, and the appropriate reminder intensity can be selected according to different risk levels, thereby significantly improving driving safety and reducing the accident rate. Thus, the problem that the risk reminder to the user is only provided by visual marking in the related art, and the severity of the risk cannot be accurately conveyed, etc., is solved.

[0050] Next, the vehicle risk reminder device proposed according to the embodiment of the present application is described with reference to the accompanying drawings.

[0051] Figure 3 It is a block diagram of a vehicle risk reminder device according to an embodiment of the present application.

[0052] like Figure 3 As shown, the vehicle risk reminder device 10 includes: a collection module 100 , a determination module 200 and a reminder module 300 .

[0053] Among them, the collection module 100 is used to collect the surrounding environment information of the vehicle; the determination module 200 is used to determine the risk targets that meet the preset conditions in the surrounding environment information and evaluate the risk level of the risk targets; the reminder module 300 is used to construct a secondary virtual animation of the behavior of the risk target according to the risk level, and display the secondary virtual animation on the vehicle-mounted screen device.

[0054] In one embodiment of the present application, the determination module 200 is further used to: obtain the risk type of the risk target; and determine the risk level of the risk target according to the risk type, the relative position and speed between the risk target and the vehicle.

[0055] In one embodiment of the present application, the risk level includes first to third risk levels, and the reminder module 300 is further used to determine a virtual animation template according to the risk level; and construct a secondary virtual animation of the behavior of the risk target based on the virtual animation template.

[0056] In one embodiment of the present application, different risk levels correspond to different virtual animation templates, wherein the first risk level corresponds to a basic prompt template, the second risk level corresponds to an enhanced warning template, and the third risk level corresponds to an emergency alert template.

[0057] In one embodiment of the present application, the reminder module 300 is further used to, if the virtual animation template is a basic prompt template, then the secondary virtual animation is to display the basic motion trajectory or basic form of the risk target; if the virtual animation template is an enhanced warning template, then the secondary virtual animation is to display the accelerated motion or irregular motion of the risk target; if the virtual animation template is an emergency alert template, then the secondary virtual animation is to display the emergency avoidance action of the risk target or to magnify the risk target.

[0058] It should be noted that the aforementioned explanation of the vehicle risk reminder method embodiment is also applicable to the vehicle risk reminder device of this embodiment, and will not be repeated here.

[0059] According to the vehicle risk reminder device proposed in the embodiment of the present application, it is possible to identify potential collision risk targets around the vehicle, and by creating secondary virtual animations of the behaviors of risk targets, it is possible to present the risk situation to the driver in a more intuitive and vivid way, and it is possible to select appropriate reminder strengths according to different risk levels, thereby significantly improving driving safety and reducing the accident rate. This solves the problem that the risk reminder to the user is only provided by visual markings in the related art, and the severity of the risk cannot be accurately conveyed.

[0060] Figure 4 A schematic diagram of the structure of a vehicle provided in an embodiment of the present application. The vehicle may include:

[0061] Memory 401 , processor 402 , and a computer program stored in the memory 401 and executable on the processor 402 .

[0062] When the processor 402 executes the program, the vehicle risk reminder method provided in the above embodiment is implemented.

[0063] Furthermore, the vehicle also includes:

[0064] The communication interface 403 is used for communication between the memory 401 and the processor 402 .

[0065] The memory 401 is used to store computer programs that can be executed on the processor 402 .

[0066] The memory 401 may include a high-speed RAM (Random Access Memory) memory, and may also include a non-volatile memory, such as at least one disk memory.

[0067] If the memory 401, the processor 402 and the communication interface 403 are implemented independently, the communication interface 403, the memory 401 and the processor 402 can be connected to each other through a bus and communicate with each other. The bus can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 4 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0068] Optionally, in a specific implementation, if the memory 401, the processor 402 and the communication interface 403 are integrated on a chip, the memory 401, the processor 402 and the communication interface 403 can communicate with each other through an internal interface.

[0069] The processor 402 may be a CPU (Central Processing Unit), or an ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the embodiments of the present application.

[0070] An embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the above-mentioned vehicle risk reminder method is implemented.

[0071] An embodiment of the present application also provides a computer program product, including: a computer program or instructions, which, when executed, implements the vehicle risk reminder method as described in the above embodiment.

[0072] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms are not necessarily directed to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or N embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0073] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0074] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0075] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiment, the N steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array, a field programmable gate array, etc.

[0076] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0077] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A vehicle risk reminder method, characterized in that: The following steps are involved: Collecting vehicle's surrounding environment information; Determine the risk target that meets the preset conditions in the surrounding environment information, and evaluate the risk level of the risk target; A secondary virtual animation of the behavior of the risk target is constructed according to the risk level, and the secondary virtual animation is displayed on a vehicle-mounted screen device.

2. The vehicle risk reminder method according to claim 1, characterized in that: The step of evaluating the risk level of the risk target includes: Obtaining the risk type of the risk target; The risk level of the risk target is determined according to the risk type, the relative position and speed between the risk target and the vehicle.

3. The vehicle risk reminder method according to claim 1 or 2, characterized in that: The risk levels include first to third risk levels, and a secondary virtual animation of the behavior of the risk target is constructed according to the risk levels, including: determining a virtual animation template according to the risk level; A secondary virtual animation of the behavior of the risk target is constructed based on the virtual animation template.

4. The vehicle risk reminder method according to claim 3, characterized in that: Different risk levels correspond to different virtual animation templates, wherein the first risk level corresponds to a basic prompt template, the second risk level corresponds to an enhanced warning template, and the third risk level corresponds to an emergency alert template.

5. The vehicle risk reminder method according to claim 4, characterized in that: The constructing of the secondary virtual animation of the behavior of the risk target based on the virtual animation template includes: If the virtual animation template is the basic prompt template, the secondary virtual animation is to display the basic motion trajectory or basic form of the risk target; If the virtual animation template is the enhanced warning template, the secondary virtual animation is to show the accelerated motion or irregular motion of the risk target; If the virtual animation template is the emergency alert template, the secondary virtual animation is to display the emergency avoidance action of the risk target or to magnify the risk target.

6. A vehicle risk reminder device, characterized in that: include: A collection module, used to collect the surrounding environment information of the vehicle; A determination module, used to determine risk targets that meet preset conditions in the surrounding environment information and evaluate the risk level of the risk targets; The reminder module is used to construct a secondary virtual animation of the behavior of the risk target according to the risk level, and display the secondary virtual animation on the vehicle-mounted screen device.

7. The vehicle risk reminder device according to claim 6, characterized in that: The determination module is further used for: Obtaining the risk type of the risk target; The risk level of the risk target is determined according to the risk type, the relative position and speed between the risk target and the vehicle.

8. A vehicle, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the vehicle risk reminder method as described in any one of claims 1 to 5.

9. A computer-readable storage medium having a computer program or instruction stored thereon, characterized in that: When the computer program or instruction is executed, the vehicle risk reminder method according to any one of claims 1 to 5 is implemented.

10. A computer program product comprising: A computer program or instruction, characterized in that when the computer program or instruction is executed, it implements the vehicle risk reminder method described in any one of claims 1-5.

Images