Vehicle acousto-optic early warning reminding method, vehicle processor and vehicle

Abstract

The invention relates to a vehicle acousto-optic early warning reminding method, a vehicle processor and a vehicle. The method comprises the following steps: acquiring environment information around the vehicle; detecting driving state information of surrounding vehicles in the environment information; the surrounding vehicles are vehicles in the same lane and / or adjacent lane with the vehicle; detecting danger information of surrounding vehicles to the vehicle according to the driving state information; and when it is detected that the danger information exists, according to the vehicle orientation in the driving state information, zone control is conducted on an atmosphere lamp and / or a loudspeaker at the position associated with the vehicle orientation in the vehicle. Through the application, the driving state information and the danger information of the surrounding vehicle can be detected, and the atmosphere lamp and / or the loudspeaker at the associated position in the vehicle are / is controlled in the corresponding zone to perform early warning reminding on people in the vehicle according to the vehicle orientation of the surrounding vehicle with the danger information, so that the people in the vehicle can determine the orientation of the danger, and the safety of the vehicle is improved. The problem that effective information of surrounding conditions cannot be provided by single atmosphere lamp reminding or audio reminding is solved.

Description

Technical Field

[0001] The present application relates to the technical field of intelligent assisted driving, and particularly to a vehicle sound and light warning method, a vehicle processor, and a vehicle. Background Art

[0002] With the development of automotive safety, users have higher and higher requirements for assisted driving and human-machine interaction configurations. Various instruments, display screens in the cockpit, and the traffic environment outside the vehicle can transmit a large amount of information to the driver. In complex and changeable driving conditions, relying solely on small icons on the instrument panel or text prompts on the central control screen to convey safety risk information, some important safety prompt signals are easily ignored by the driver.

[0003] In the related art, multi-sensory safety reminder methods such as ambient light reminder or audio reminder can effectively break through the interference of information and ensure that dangerous information is received by the driver. However, the current single ambient light reminder or audio reminder can only play a simple reminder role and cannot provide more effective information about the surrounding situation for the driver.

[0004] In view of the problem that the single ambient light reminder or audio reminder in the related art cannot provide effective information about the surrounding situation, no effective solution has been proposed yet. Summary of the Invention

[0005] Based on this, in view of the above technical problems, it is necessary to provide a vehicle sound and light warning method, a vehicle processor, and a vehicle that can provide effective information about the surrounding environment.

[0006] In a first aspect, in the present embodiment, a vehicle sound and light warning method is provided, including:

[0007] Obtain the environmental information around the vehicle;

[0008] Detect the driving state information of surrounding vehicles in the environmental information; the surrounding vehicles are vehicles in the same lane and / or adjacent lanes as the vehicle;

[0009] Detect the danger information of the surrounding vehicles to the vehicle according to the driving state information;

[0010] When detecting the existence of the danger information, perform zonal control on the ambient light and / or speaker at the position associated with the vehicle orientation in the vehicle according to the vehicle orientation in the driving state information.

[0011] In some of the embodiments, the detecting the danger information of the surrounding vehicles to the vehicle according to the driving state information includes:

[0012] Detect the speed, acceleration, and distance from the vehicle of any one of the surrounding vehicles according to the driving state information;

[0013] Based on the speed, acceleration, and distance, determine the danger information of any one of the surrounding vehicles.

[0014] In some embodiments, the determining the danger information of any one of the surrounding vehicles based on the speed, acceleration, and distance includes:

[0015] Based on the distance and at least one preset distance range, determine the approaching level of any one of the surrounding vehicles;

[0016] Determine the danger information according to the speed, acceleration, and approaching level.

[0017] In some embodiments, it further includes:

[0018] Determine the danger information according to the vehicle type and abnormal state of the surrounding vehicle.

[0019] In some embodiments, the detecting the danger information of the surrounding vehicle to the vehicle according to the driving state information includes:

[0020] Detect the high-risk driving habits of any one of the surrounding vehicles according to the driving state information, and determine the high-risk driving habits as the danger information.

[0021] In some embodiments, the detecting the high-risk driving habits of any one of the surrounding vehicles according to the driving state includes:

[0022] Obtain historical driving data from the cloud associated with any one of the surrounding vehicles;

[0023] By comparing the historical driving data and the driving state information, match and determine the high-risk driving habits and the occurrence times of any one of the surrounding vehicles.

[0024] In some embodiments, the zoning control of the ambient light and / or speaker at the position associated with the vehicle orientation in the vehicle according to the vehicle orientation in the driving state information includes:

[0025] Based on the vehicle orientation, turn on the ambient light at the associated position through the corresponding ambient light zoning controller for zoning control;

[0026] And / or, based on the vehicle orientation, turn on the speaker at the associated position through the corresponding speaker zoning controller for zoning control.

[0027] In some of these embodiments, the zonal control of the ambient lights and / or speakers at positions associated with the vehicle orientation in the vehicle according to the vehicle orientation in the driving state information further includes:

[0028] Performing a risk ranking on the surrounding vehicles according to the occurrence times of any high-risk driving habits of the surrounding vehicles in the risk information;

[0029] Based on the risk ranking, zonal control of the ambient lights and / or speakers at positions associated with the vehicle orientation in the vehicle is sequentially performed according to the vehicle orientation of any of the surrounding vehicles.

[0030] In some of these embodiments, it further includes:

[0031] Real-time detection of the head positions of the vehicle occupants through in-vehicle sensors;

[0032] Dynamically adjusting the audio intensity of the speakers according to the head positions.

[0033] In some of these embodiments, it further includes:

[0034] Controlling the change of the light-emitting parameters of the ambient lights in a preset light-emitting mode according to the proximity level in the risk information; the light-emitting parameters at least include one of the following: light-emitting frequency, light-emitting brightness, and light-emitting color;

[0035] And / or, controlling the change of the audio parameters of the speakers in a preset audio mode according to the proximity level in the risk information; the audio parameters at least include one of the following: audio intensity and sound effect.

[0036] In a second aspect, a vehicle processor is provided in this embodiment, including:

[0037] An information acquisition module for acquiring the environmental information around the vehicle;

[0038] An information detection module for detecting the driving state information of the surrounding vehicles in the environmental information; the surrounding vehicles are vehicles in the same lane and / or adjacent lanes as the vehicle;

[0039] A risk detection module for detecting the risk information of the surrounding vehicles to the vehicle according to the driving state information;

[0040] A zonal control module for, when the risk information is detected to exist, performing zonal control of the ambient lights and / or speakers at positions associated with the vehicle orientation in the vehicle according to the vehicle orientation in the driving state information.

[0041] In a third aspect, a vehicle is provided in this embodiment, including an environmental perception device, a surround speaker group and / or a surround atmosphere light group, and a vehicle processor, where the vehicle processor is configured to run a computer program to execute the vehicle acoustic and optical warning reminder method described in the first aspect above.

[0042] In a fourth aspect, a storage medium is provided in this embodiment, on which a computer program is stored, and when the program is executed by a processor, it implements the vehicle acoustic and optical warning reminder method described in the first aspect above.

[0043] Compared with the related art, in the vehicle acoustic and optical warning reminder method, vehicle processor, and vehicle provided in this embodiment, by obtaining the environmental information around the vehicle; detecting the driving state information of surrounding vehicles in the environmental information; the surrounding vehicles being vehicles in the same lane and / or adjacent lanes as the vehicle; detecting the danger information of the surrounding vehicles to the vehicle according to the driving state information; when detecting the existence of the danger information, performing zonal control on the atmosphere lights and / or speakers at positions associated with the vehicle orientation in the vehicle according to the vehicle orientation in the driving state information. Through this embodiment, it is possible to detect the driving state information and danger information of surrounding vehicles, and according to the vehicle orientation of the surrounding vehicles with danger information, correspondingly perform zonal control on the atmosphere lights and / or speakers at associated positions in the vehicle to give a warning reminder to the vehicle occupants, enabling the vehicle occupants to determine the orientation where the danger appears, and solving the problem that a single atmosphere light reminder or audio reminder cannot provide effective information about the surrounding situation.

[0044] Details of one or more embodiments of the present application are set forth in the following drawings and description to make other features, objects, and advantages of the present application more concise and understandable. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments and descriptions of the present application are used to explain the present application and do not constitute an improper limitation of the present application. In the drawings:

[0046] Figure 1 is a hardware structure block diagram of a terminal of the vehicle acoustic and optical warning reminder method in an embodiment;

[0047] Figure 2 is a flowchart of the vehicle acoustic and optical warning reminder method in an embodiment;

[0048] Figure 3 is a flowchart of the vehicle acoustic and optical warning reminder method in another embodiment;

[0049] Figure 4 is a schematic diagram of the working principle of the vehicle acoustic and optical warning reminder method in an embodiment;

[0050] Figure 5 It is a structural block diagram of a vehicle processor in an embodiment.

[0051] In the figure: 102, processor; 104, memory; 106, transmission device; 108, input / output device; 10, information acquisition module; 20, information detection module; 30, danger detection module; 40, partition control module. Specific implementation manners

[0052] To understand the purpose, technical solution and advantages of the present application more clearly, the present application will be described and illustrated below in conjunction with the accompanying drawings and embodiments.

[0053] Unless otherwise defined, the technical terms or scientific terms involved in the present application shall have the general meanings understood by those with ordinary skills in the technical field to which the present application belongs. In the present application, words such as "a", "one", "a kind of", "the", "these" and the like do not indicate a limitation in quantity, and they can be singular or plural. The terms "including", "comprising", "having" and any variants thereof involved in the present application are intended to cover non-exclusive inclusion; for example, a process, method, system, product or device including a series of steps or modules (units) is not limited to the listed steps or modules (units), but may include unlisted steps or modules (units), or may include other steps or modules (units) inherent in these processes, methods, products or devices. The terms "connected", "coupled" and the like involved in the present application do not limit to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The "multiple" involved in the present application means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" may represent: A exists alone, A and B exist simultaneously, and B exists alone. Usually, the character " / " indicates that the objects associated before and after are in an "or" relationship. The terms "first", "second", "third" and the like involved in the present application are only used to distinguish similar objects and do not represent a specific sorting of the objects.

[0054] The method embodiment provided in this embodiment can be executed on a terminal, a computer or a similar computing device. For example, running on a terminal Figure 1 It is a hardware structural block diagram of the terminal of the vehicle sound and light warning reminder method in this embodiment. As Figure 1 shown, the terminal may include one or more ( Figure 1Only one processor 102 (only one is shown in the figure) and a memory 104 for storing data are shown. The processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA. The above terminal may further include a transmission device 106 for communication functions and an input / output device 108. Those of ordinary skill in the art can understand that Figure 1 The structure shown is only schematic and does not limit the structure of the above terminal. For example, the terminal may further include more or fewer components than those Figure 1 shown in the figure, or have a different configuration from that Figure 1 shown in the figure.

[0055] The memory 104 can be used to store computer programs. For example, software programs and modules of application software, such as the computer program corresponding to the vehicle acoustic and optical warning reminder method in this embodiment. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, implements the above method. The memory 104 may include a high-speed random access memory, and may further include a non-volatile memory, such as one or more magnetic storage devices, flash memories, or other non-volatile solid-state memories. In some instances, the memory 104 may further include a memory remotely provided with respect to the processor 102, and these remote memories can be connected to the terminal through a network. Examples of the above network include, but are not limited to, the Internet, an enterprise intranet, a local area network, a mobile communication network, and combinations thereof.

[0056] The transmission device 106 is used to receive or send data via a network. The above network includes a wireless network provided by the communication provider of the terminal. In one instance, the transmission device 106 includes a network adapter (abbreviated as NIC), which can be connected to other network devices through a base station and thus communicate with the Internet. In one instance, the transmission device 106 may be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0057] In this embodiment, a vehicle acoustic and optical warning reminder method is provided. Figure 2 is a flowchart of the vehicle acoustic and optical warning reminder method in this embodiment, as Figure 2 shown in the figure, and the method includes the following steps:

[0058] Step S201, obtain the environmental information around the vehicle.

[0059] Specifically, when the vehicle is powered on and enters the startup state, it is confirmed that the vehicle starts to drive. The vehicle processor uses the vehicle startup command as the command trigger point to activate functions such as the vehicle's external cameras, external radars, external lidars, internal cameras, and internal radars. Exemplarily, the body processor can be used as the vehicle processor in this embodiment.

[0060] During the driving and stationary processes of the vehicle after startup, environmental information around the vehicle is collected through environmental perception devices such as external radars and cameras. Among them, the environmental perception devices can also include ultrasonic sensors, lidars, etc., and the environmental information includes but is not limited to surrounding vehicle information, road information, pedestrian information, traffic signal and sign information, and obstacle information, etc.

[0061] The vehicle processor is connected to the environmental perception devices. The environmental perception devices can also upload the collected surrounding information to the vehicle processor to obtain the environmental information around the vehicle in the vehicle processor. In addition, the obtained environmental information can be uploaded to the cloud service associated with the vehicle for storage through the vehicle network server.

[0062] Step S202, detect the driving state information of surrounding vehicles in the environmental information; the surrounding vehicles are vehicles in the same lane and / or adjacent lanes as the vehicle.

[0063] Specifically, in the vehicle processor, the point cloud data of surrounding vehicles can be obtained through the radar, the morphology of surrounding vehicles can be drawn, and the driving state information of surrounding vehicles in the environmental information can be detected. The surrounding vehicles can be vehicles in the same lane and / or adjacent lanes as the vehicle itself, and its driving state information includes but is not limited to the vehicle orientation, vehicle distance, speed, acceleration, etc. of the surrounding vehicles relative to the vehicle itself. Among them, specifically, after converting the original point cloud data collected by the lidar from the lidar coordinate system to the vehicle coordinate system, the distance between the closest points in the point cloud data to the vehicle itself can be calculated as the vehicle distance, and the distribution of the point cloud data in the vehicle coordinate system can be calculated to determine the orientation of the surrounding vehicles.

[0064] In addition, the visual data obtained by combining the external camera (identifying vehicle appearance, license plate, turn signal status, etc.) can also be used to detect the driving state information of surrounding vehicles.

[0065] Step S203, detect the danger information of surrounding vehicles to the vehicle according to the driving state information.

[0066] Specifically, the danger information of surrounding vehicles to the vehicle itself can include the danger of surrounding vehicles approaching, and the danger that the surrounding vehicles are not approaching but have high-risk driving habits. Both of these situations may pose a danger to the vehicle itself.

[0067] Among them, for the danger of approaching surrounding vehicles, it can be judged according to the distance between the surrounding vehicles and the vehicle itself, combined with speed and acceleration. For example, when the distance is within a set range and the surrounding vehicles show no tendency to decelerate, dangerous information is detected. Furthermore, multiple preset distance ranges can be set, and when the distance is within different preset distance ranges, different levels of dangerous information correspond. For the danger that the surrounding vehicles are not approaching but have high-risk driving habits, the historical driving data and accident situations stored in the cloud service associated with the surrounding vehicles can be used for judgment. When high-risk driving habits are detected in the driving state information of the surrounding vehicles, dangerous information is detected.

[0068] In addition, the driving state of surrounding vehicles and the situations that may pose risks to the vehicle itself can be analyzed more comprehensively based on the driving state information. For example, by comparing consecutive multi-frame point cloud models, the speed and acceleration of surrounding vehicles can be calculated according to the position change amount of the vehicle at different times and the corresponding time intervals; analyze the changes in the front and rear endpoints and the central axis direction of the surrounding vehicle point cloud model, and cooperate with the angle change of the point cloud on the horizontal plane to accurately determine the driving direction of the surrounding vehicle. For example, if the front point cloud of the vehicle head moves forward and the rear point cloud of the vehicle tail moves backward, and the central axis angle is stable, it indicates that the vehicle is driving straight; if the central axis shows an angular deviation, combined with uneven displacement of the front and rear point clouds, it can be known that the vehicle is turning, and the turning radius and angular rate can be calculated according to the angle change amount; continuously monitor the relative position relationship between the surrounding vehicle point cloud and the lane line, and combine the lateral displacement of the surrounding vehicle in multiple frames of point clouds. When the surrounding vehicle point cloud crosses from one side of the original lane line to the other side, and the lateral displacement exceeds a certain threshold, the speed and direction are stable, it is determined as a normal lane change; if the displacement changes suddenly and the speed is abnormal, it may be an illegal and dangerous lane change.

[0069] Step S204, when dangerous information is detected, the atmosphere lights and / or speakers at positions associated with the vehicle orientation in the vehicle are controlled in zones according to the vehicle orientation in the driving state information.

[0070] Specifically, the association relationship between different orientations outside the vehicle and the atmosphere lights and / or speakers at different positions inside the vehicle is pre-configured, and the atmosphere lights and / or speakers are controlled in zones according to the vehicle orientation of the surrounding vehicles with dangerous information outside the vehicle relative to the vehicle itself based on the pre-configured association relationship.

[0071] The interior of the vehicle is equipped with a surrounding ambient light group and a surrounding speaker group, and ambient lights and / or speakers are provided in each direction inside the vehicle. In one embodiment, the exterior directions of the vehicle can generally be divided into eight directions: front, rear, left, right, left front, right front, left rear, and right rear. The surrounding ambient light group inside the vehicle is also divided in the same way, so that the exterior directions of the vehicle correspond one-to-one with the ambient lights inside the vehicle. Exemplarily, the surrounding ambient light group can include ambient lights provided in the eight directions of the front, rear, left, right, left front, right front, left rear, and right rear of the vehicle, and the surrounding speaker group can include speakers provided in the four directions of the front left, front right, rear left, and rear right of the vehicle. When a vehicle direction with dangerous information appears in the left front outside the vehicle, the ambient light and / or speaker in the left front inside the vehicle are correspondingly controlled to turn on. The vehicle processor is connected to the surrounding ambient light group and the surrounding speaker group inside the vehicle, and the ambient lights and speakers at different positions are controlled in zones through the corresponding zone controllers.

[0072] Furthermore, for the danger levels of the dangerous information, such as different vehicle distances, multiple preset lighting modes and preset audio modes can be correspondingly set. To correspond to different levels of dangerous information, the ambient lights are controlled in the preset lighting modes, and / or the speakers are controlled to turn on in the preset audio modes, so as to more intuitively give early warning reminders to the people inside the vehicle and provide more effective information such as the degree of danger. It should be noted that the surrounding ambient light group and the surrounding speaker group in this embodiment can be set and controlled independently. Specifically, according to the configuration of the vehicle, a solution of combining the surrounding ambient light group and the surrounding speaker group for early warning reminders, or the surrounding ambient light group and the surrounding speaker group giving early warning reminders independently respectively is adopted.

[0073] Through the above steps, it is possible to detect the driving state information and dangerous information of surrounding vehicles, and correspondingly control the ambient lights and / or speakers at the associated positions inside the vehicle to turn on according to the vehicle directions of the surrounding vehicles with dangerous information, and give early warning reminders of the specific directions of the dangerous information through the zoned ambient lights and / or speakers inside the vehicle, so that the people inside the vehicle can determine more effective information such as the direction where the danger appears. Especially when the people inside the vehicle are in the blind area and their attention is distracted, it is better to give early warning reminders to the people inside the vehicle, solving the problem that a single ambient light reminder or audio reminder cannot provide effective information about the surrounding situation.

[0074] In some of the embodiments, detecting the dangerous information of the surrounding vehicles on the vehicle according to the driving state information in step S203 above includes the following steps:

[0075] Detect the speed, acceleration, and vehicle distance from the vehicle of any surrounding vehicle according to the driving state information; based on the speed, acceleration, and vehicle distance, determine the dangerous information of any surrounding vehicle.

[0076] Specifically, based on the vehicle distance and at least one preset distance range, determine the approaching level of any surrounding vehicle; based on the speed, acceleration, and approaching level, determine the danger information.

[0077] In the vehicle processor, the point cloud data of surrounding vehicles can be obtained through a radar, and the shapes of surrounding vehicles can be drawn. After converting the original point cloud data collected by the lidar from the lidar coordinate system to the vehicle coordinate system, select the point closest to the host vehicle in the point cloud data of any surrounding vehicle, and calculate the distance from this point to the origin of the vehicle coordinate system (usually the center position of the vehicle), which is the vehicle distance between the two vehicles.

[0078] After detecting the vehicle distance between any surrounding vehicle and the host vehicle, based on the set preset distance range, determine the approaching level to which the vehicle distance between the surrounding vehicle and the host vehicle belongs, and further combine the speed and acceleration to determine whether there is a collision danger. When there is a collision danger, it is detected that there is danger information. For example, when the vehicle distance exceeds the set preset distance range, there is no danger information; when the vehicle distance is within the set preset distance range, but the acceleration and speed show a braking and decelerating trend, there is no collision risk and danger information; when the vehicle distance is within the set preset distance range, and the acceleration and speed show a uniform and accelerating trend, there may be a collision danger, and it is detected that there is danger information. Further, multiple preset distance ranges can also be set. When the vehicle distance is within different preset distance ranges, different levels of danger information corresponding to different approaching levels are respectively corresponding.

[0079] Further, the above steps further include:

[0080] Determine the danger information according to the vehicle type and abnormal state of the surrounding vehicle.

[0081] Specifically, in the actual driving scenario, when the surrounding vehicle is a large vehicle such as a truck, a freight car, an engineering vehicle, or a special transport vehicle, the possibility of collision between the surrounding vehicle and the host vehicle is relatively greater, and the danger is higher. In order to play an effective warning and reminder role, the approaching level of the surrounding vehicle can be directly used as the danger information.

[0082] In addition, the judgment of danger information can also be combined with the abnormal state of the large vehicle, such as overloading, vehicle body tilt, cargo scattering, etc. When it is detected that the vehicle type of the surrounding vehicle is a large vehicle and there is an abnormal state, it can be determined as the highest level of danger information.

[0083] By detecting the vehicle distance of the surrounding vehicle to the host vehicle according to the driving state information in this embodiment to determine the danger information of the approaching level of the surrounding vehicle, it is possible to determine that there may be a collision danger based on the vehicle distance, speed, and acceleration, and there is a surrounding vehicle with danger information.

[0084] In some of these embodiments, detecting the danger information of surrounding vehicles for the vehicle according to the driving state information in the above step S203 includes the following steps:

[0085] Detect the high-risk driving habits of any surrounding vehicle according to the driving state information, and determine the high-risk driving habits as danger information.

[0086] Specifically, for surrounding vehicles associated with cloud services, the historical driving data and accident situations of the vehicles are collected and stored in the cloud services. For example, lane-changing habits, turning locations, overtaking habits, accidents, and emergency situations (such as activating the vehicle's AEB (Autonomous Emergency Braking) and almost having a collision). High-risk driving habits include, but are not limited to, frequent lane-changing, sharp turning, overtaking, accidents, and emergencies, etc.

[0087] In the historical driving data, frequent hard acceleration and hard braking can be determined by analyzing vehicle speed and acceleration data. If the vehicle speed changes significantly within a short period of time and the acceleration exceeds a certain threshold, it can be considered that hard acceleration or hard braking has occurred. Similarly, frequent lane changes can be judged by steering angle and vehicle position data. When the steering angle changes frequently and the vehicle crosses multiple lanes in a short time, it can be determined as frequent lane-changing. In addition, behaviors such as too close following distance and speeding can also be regarded as high-risk driving habits.

[0088] Obtain the historical driving data from the cloud associated with any surrounding vehicle; by comparing the historical driving data and the driving state information, match and determine the high-risk driving habits and the occurrence times of any surrounding vehicle.

[0089] Continuously monitor the surrounding vehicles through an external vehicle radar and an external vehicle camera to obtain the driving state information. Compare and match the data of high-risk driving habits in the historical driving data with the current driving state information of the surrounding vehicles. If overlapping data is obtained through the matching, it indicates that the current driving state information of the surrounding vehicles also has high-risk driving habits, such as frequent lane-changing and overtaking around the vehicle itself. Record the occurrence times of the high-risk driving habits of each surrounding vehicle, and detect the currently occurring high-risk driving habits of any surrounding vehicle as danger information.

[0090] In some of these embodiments, if a surrounding vehicle currently has high-risk driving habits and is approaching a risk, the vehicle's AEB can be directly activated for braking; if a surrounding vehicle currently has high-risk driving habits but is not approaching, the surrounding vehicles can be ranked according to the occurrence times of the high-risk driving habits, and the ambient lights and / or speakers can be controlled in zones and warning reminders can be given according to the vehicle orientations of the surrounding vehicles in turn.

[0091] By using the historical driving data and accident conditions stored in the cloud service associated with surrounding vehicles in this embodiment to judge the current driving state information, when a high-risk driving habit is detected in the driving state information of surrounding vehicles, a danger information is detected, realizing the pre-judgment of the danger of the surrounding vehicles to the vehicle itself.

[0092] In some of these embodiments, in step S204 above, according to the vehicle orientation in the driving state information, the ambient lights and / or speakers at positions associated with the vehicle orientation inside the vehicle are controlled in zones, including the following steps:

[0093] Based on the vehicle orientation, turn on the ambient lights at the associated positions through the corresponding ambient light zone controller for zone control; and / or, based on the vehicle orientation, turn on the speakers at the associated positions through the corresponding speaker zone controller and conduct zone control.

[0094] Specifically, the surrounding ambient light group and the surrounding speaker group can be set and controlled independently. Specifically, according to the vehicle configuration, a scheme of combining the surrounding ambient light group and the surrounding speaker group for warning reminders, or the surrounding ambient light group and the surrounding speaker group for independent warning reminders respectively, is adopted.

[0095] The vehicle processor is connected to the surrounding ambient light group and the surrounding speaker group inside the vehicle, and the ambient lights and speakers at different positions are controlled in zones through the corresponding zone controllers. Among them, the ambient light zone controller and / or the speaker zone controller can receive the orientation instructions of the vehicle orientation from the vehicle processor or the environment perception device, as well as other control instructions for controlling the light-emitting parameters of the ambient lights and / or the audio parameters of the speakers, and turn on the ambient lights and / or speakers at the associated positions correspondingly.

[0096] Generally, the vehicle exterior orientation can be divided into eight orientations: front, rear, left, right, front left, front right, rear left, and rear right. The surrounding ambient light group inside the vehicle is also divided in the same way, so that the vehicle exterior orientation corresponds to the ambient lights inside the vehicle one by one. Exemplarily, the surrounding ambient light group can include ambient lights set at the eight orientations of the vehicle front, rear, left, right, front left, front right, rear left, and rear right, and the surrounding speaker group can include speakers set at the four orientations of the vehicle front left, front right, rear left, and rear right.

[0097] Furthermore, a preset light-emitting mode can be set for the ambient lights, and a preset audio mode can be set for the speakers. According to the approaching level in the danger information, the light-emitting parameters of the ambient lights are correspondingly controlled in the preset light-emitting mode; the light-emitting parameters at least include one of the following: light-emitting frequency, light-emitting brightness, and light-emitting color; and / or, according to the approaching level in the danger information, the audio parameters of the speakers are correspondingly controlled in the preset audio mode; the audio parameters at least include one of the following: audio intensity and sound effect.

[0098] Among them, different preset lighting modes and preset audio modes respectively correspond to different proximity levels of danger information. The higher the proximity level of the danger information, the more urgent it is, and it is necessary to make the vehicle occupants respond to this danger information as soon as possible. Correspondingly, a more obvious and urgent lighting mode and audio mode can be adopted. The danger information with a lower proximity level is relatively less urgent, and correspondingly, a relatively gentle lighting mode and audio mode can be adopted. In this way, the vehicle occupants can more intuitively obtain the orientation and proximity level of the danger information based on the orientation and lighting mode of the ambient light in the vehicle.

[0099] The lighting parameters in the lighting mode at least include one of the following: lighting frequency, lighting brightness, and lighting color; the audio parameters in the audio mode at least include one of the following: audio intensity and sound effect. By controlling the corresponding parameter changes in different modes, the reminder of danger information with different proximity levels is realized. Exemplarily, the preset lighting mode includes three modes: emergency mode, warning mode, and normal mode. In the emergency mode, the lighting frequency is 3 times per second, the lighting color is red, and the lighting brightness is the strongest. In the warning mode, the lighting frequency is 2 times per second, the lighting color is orange, and the lighting brightness is medium. In the normal mode, the lighting frequency is 1 time per second or does not blink, the lighting color is green, and the lighting brightness is the weakest. The preset audio mode includes two modes: emergency mode and warning mode. In the emergency mode, the audio intensity is the strongest, and the sound effect is an alarm prompt sound. In the warning mode, the audio intensity is medium, and the sound effect is a rapid prompt sound.

[0100] In some embodiments, when the vehicle in front brakes suddenly, but the brake lights of the rear taillights of the vehicle in front are damaged or blocked by dirt, etc., after determining that there is danger information based on the vehicle distance, speed, and acceleration, the ambient light on the instrument panel (front) is controlled to flash urgently and brightly.

[0101] When it is detected that the vehicle on the right is located in the blind area of the A-pillar on the right side of the vehicle, and the vehicle in the blind area makes an emergency and malicious lane change to occupy our lane, the ambient light near the right A-pillar (right front) flashes urgently and brightly.

[0102] When there is only the driver in the front row of the vehicle, and the road lighting is insufficient and requires high concentration, there are vehicles constantly following in the left and right rear, and there is no sign of deceleration, and they change lanes back and forth. At this time, the rear passengers can prompt the danger situation behind through the flashing of the ambient lights in the front, back, left, and right of the rear row. The driver can also perceive the flashing of the ambient lights behind the rear row through the central control screen and the rearview mirror.

[0103] When the driver is driving alone and his vision leaves the driving vision, such as when looking for items in the vehicle and other dangerous operations, the speaker volume is low or damaged and cannot give an alarm sound reminder. At this time, it is reminded by the urgent and bright flashing of the ambient light.

[0104] When the vehicle is parked temporarily, the driver is busy in the vehicle and unable to perceive the external situation. At this time, the lighting modes of the surrounding atmosphere light groups in different directions can be controlled to prompt surrounding objects and distances.

[0105] In this embodiment, the specific directions where surrounding vehicles with dangerous information appear are prompted by the surrounding atmosphere light groups in the vehicle, avoiding blind spots and distraction of driving attention. Moreover, effective information such as distance can be provided through different lighting modes. Due to the noise during vehicle driving, especially on highways and other complex working conditions with high noise, it is very difficult for the driver to hear the sounds and specific directions outside the vehicle from inside the vehicle. The specific directions where surrounding vehicles with dangerous information appear are prompted by the surrounding speaker groups in the vehicle, and effective information such as distance can also be provided through different audio modes. Based on the vision of the atmosphere lights in the vehicle, the people inside the vehicle can further strengthen sound localization, enabling them to clearly know the directions where dangers appear. Whether it is for intelligent avoidance or manual avoidance, the correct directions can be determined.

[0106] In some of the embodiments, in step S204 above, according to the vehicle direction in the driving state information, the atmosphere lights and / or speakers at positions associated with the vehicle direction inside the vehicle are controlled in zones, and the following steps are further included:

[0107] According to the occurrence times of the high-risk driving habits of any surrounding vehicle in the dangerous information, risk ranking is performed on the surrounding vehicles; based on the risk ranking, successively according to the vehicle direction of any surrounding vehicle, the atmosphere lights and / or speakers at positions associated with the vehicle direction inside the vehicle are controlled in zones.

[0108] Specifically, the driving state information of surrounding vehicles is continuously monitored through an external vehicle radar and an external vehicle camera. The data of high-risk driving habits in the historical driving data is compared and matched with the current driving state information of the surrounding vehicles. If overlapping data is obtained through the matching, it indicates that the current driving state information of the surrounding vehicles also has high-risk driving habits, such as frequent lane changes and overtaking around the vehicle of the present vehicle. The occurrence times of the high-risk driving habits of each surrounding vehicle are recorded, and the currently occurring high-risk driving habit of any surrounding vehicle is detected as dangerous information. In addition, according to the occurrence times of the high-risk driving habits, risk ranking is performed on the surrounding vehicles. Based on the risk ranking and on the basis of the zone control of the atmosphere lights and / or speakers provided in the above embodiments, successively in the order from high risk to low risk, the vehicle directions of the surrounding vehicles with high-risk driving habits are reminded.

[0109] In this embodiment, the surrounding vehicles are ranked according to the occurrence of high-risk driving habits, and the orientation of the vehicles is reminded in sequence according to the risk ranking, thereby providing a pre-determination logic for dangerous information. The dangerous information of the vehicle distance can also be combined to achieve a more definite activation orientation for the atmosphere light and / or the speaker.

[0110] In some of these embodiments, the following steps are further included:

[0111] The head position of the people in the vehicle is detected in real time through the in-vehicle sensors; the audio intensity of the speaker is dynamically adjusted according to the head position.

[0112] Specifically, the head positions of the drivers and other people in the vehicle are detected in real time through the in-vehicle camera and millimeter-wave radar. After a speaker at a certain orientation in the vehicle is activated, the audio intensity of the speaker can be dynamically adjusted according to the head position. Without changing the activation orientation of the speaker, even when the people in the vehicle move, the ear position can be recognized according to the head position, and the audio intensity of the speaker is dynamically adjusted so that the sound received by the people in the vehicle does not change. For example, if there is dangerous information in the left front, the speaker in the left front of the vehicle is activated, but the sound will not become weaker because the head of the people in the vehicle leans back.

[0113] The present embodiment will be described and illustrated below through preferred embodiments.

[0114] Figure 3 is a flowchart of the vehicle sound and light warning reminder method of this embodiment, as Figure 3 shown, the method includes the following steps:

[0115] Step S301, obtaining the environmental information around the vehicle.

[0116] Step S302, detecting the driving state information of the surrounding vehicles in the environmental information.

[0117] Step S303, detecting the speed, acceleration, and vehicle distance from the vehicle of any surrounding vehicle according to the driving state information; determining the approach level of any surrounding vehicle based on the vehicle distance and at least one preset distance range; determining the dangerous information according to the speed, acceleration, and approach level.

[0118] Step S304, obtaining the historical driving data from the cloud associated with any surrounding vehicle; matching and determining the high-risk driving habits and occurrence times of any surrounding vehicle as the dangerous information by comparing the historical driving data and the driving state information.

[0119] Step S305, when the danger information is a high-risk driving habit of a vehicle, rank the surrounding vehicles according to the occurrence times of the high-risk driving habit of any surrounding vehicle in the danger information; based on the risk ranking, successively control the ambient lights and speakers at the positions associated with the vehicle orientation in the vehicle according to the vehicle orientation of any surrounding vehicle.

[0120] Step S306, when the danger information is the approaching level of the vehicle distance, control the change of the light-emitting parameters of the ambient lights according to the approaching level in a preset light-emitting mode; and control the change of the audio parameters of the speaker according to the approaching level in a preset audio mode.

[0121] Step S307, detect the head position of the people in the vehicle in real time through the in-vehicle sensor; dynamically adjust the audio intensity of the speaker according to the head position.

[0122] It should be noted that the steps shown in the above process or the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than here. For example, steps S303 and S304 are cases where the vehicle distance and high-risk driving habits determine the danger information, and the specific execution order is not limited.

[0123] Figure 4 is a schematic diagram of the working principle of the vehicle sound and light warning reminder method in this embodiment. As Figure 4 shown, when the user is using the vehicle (including when the vehicle is driving and when the vehicle is stationary), the environmental perception devices such as the radar and camera outside the vehicle work normally. In this embodiment, the vehicle body processor is used to collect the driving state information such as the vehicle distance and azimuth change of the surrounding vehicles during the vehicle use process, and upload the collected information to the cloud service through the vehicle network service.

[0124] Classify and organize in the cloud service, and perform merging processing with the similar data of other vehicles associated with the cloud. Further screen out the navigation data, and organize to obtain the following four types of information: the lane-changing habits of surrounding vehicles, the turning points of surrounding vehicles, the overtaking habits of surrounding vehicles, and the accident and emergency habits of surrounding vehicles. Send these information to the vehicle equipped with this function through the cloud service, and the vehicle receives the information through the vehicle network server.

[0125] Receive the above information in the vehicle body processor of the vehicle, and at the same time continuously monitor the surrounding vehicles through the environmental perception devices such as the radar and camera outside the vehicle, compare and match the above habit data and driving state data of the surrounding vehicles, and rank the surrounding vehicles according to the occurrence times of the high-risk driving habits of the vehicles. Trigger the warning reminder function corresponding to the vehicle orientation in sequence according to the risk ranking (that is, activate the ambient lights and speakers at the corresponding orientation).

[0126] If the surrounding vehicles currently exhibit high-risk driving habits and pose a risk of approaching, the vehicle's AEB can be directly activated for braking.

[0127] If the surrounding vehicles currently exhibit high-risk driving habits but are not approaching, the ambient light controller obtains the vehicle's orientation through the external radar and camera and activates the ambient light at the corresponding position to flash. The ambient light zone controller receives the orientation instruction and controls the ambient light at the corresponding position to start flashing. Moreover, the light emission frequency, light emission color, and light emission intensity of the ambient light can be adjusted according to the distance between the surrounding vehicles and the vehicle itself.

[0128] The speaker controller receives the vehicle orientation of the danger information and issues the corresponding orientation instruction. The speaker zone controller activates the speaker at the corresponding orientation through the orientation instruction. Through the arrangement of the 360° surround speaker group, sound localization inside and outside the vehicle can be achieved.

[0129] In this embodiment, a vehicle processor is also provided. This processor is used to implement the above embodiments and preferred implementation manners, and those that have been described will not be repeated here. The following terms such as "module", "unit", "sub-unit", etc. can be a combination of software and / or hardware that can achieve a predetermined function. Although the processor described in the following embodiments is preferably implemented in software, implementation in hardware, or a combination of software and hardware is also possible and contemplated.

[0130] Figure 5 is the structural block diagram of the vehicle processor in this embodiment, as Figure 5 shown, the vehicle processor includes:

[0131] An information acquisition module 10, which is used to acquire the environmental information around the vehicle;

[0132] An information detection module 20, which is used to detect the driving state information of the surrounding vehicles in the environmental information; the surrounding vehicles are vehicles in the same lane and / or adjacent lanes as the vehicle;

[0133] A danger detection module 30, which is used to detect the danger information of the surrounding vehicles to the vehicle according to the driving state information;

[0134] A zone control module 40, which is used to, when danger information is detected, perform zone control on the ambient light and / or speakers at the positions associated with the vehicle orientation inside the vehicle according to the vehicle orientation in the driving state information.

[0135] Through the vehicle processor provided in this embodiment, it is possible to detect the driving state information and danger information of surrounding vehicles. According to the vehicle orientation of the surrounding vehicles with danger information, the atmosphere lights and / or speakers at the associated positions inside the vehicle are controlled to turn on in corresponding zones, and the specific orientation of the danger information is used to give early warning reminders through the zoned atmosphere lights and / or speakers inside the vehicle, enabling the vehicle occupants to determine more effective information such as the orientation where the danger appears. Especially when the vehicle occupants are in the blind spot or their attention is distracted, it can better give early warning reminders to the vehicle occupants, solving the problem that a single atmosphere light reminder or audio reminder cannot provide effective information about the surrounding situation.

[0136] It should be noted that the above-mentioned various modules can be functional modules or program modules, and can be implemented either by software or by hardware. For the modules implemented by hardware, the above-mentioned various modules can be located in the same processor; or the above-mentioned various modules can also be located in different processors in any combined form.

[0137] In this embodiment, a vehicle is provided, which includes: an environment perception device, a surround speaker group and / or a surround atmosphere light group, and a vehicle processor. The vehicle processor is configured to run a computer program to execute the vehicle acoustic and optical early warning reminder method in the above embodiment.

[0138] Among them, the environment perception device includes devices such as an external vehicle radar and a camera. The surround speaker group and the surround atmosphere light group are provided with atmosphere lights and / or speakers in each orientation inside the vehicle. The vehicle processor can specifically be a power domain processor, a chassis domain processor, a cockpit domain / smart information domain processor, an intelligent driving domain processor, or a body domain processor.

[0139] It should be noted that the specific examples in this embodiment can refer to the examples described in the above embodiment and the optional implementation manners, and will not be repeated in this embodiment.

[0140] In addition, in combination with the vehicle acoustic and optical early warning reminder method provided in the above embodiment, a storage medium can also be provided in this embodiment to implement it. A computer program is stored on the storage medium; when the computer program is executed by a processor, it implements any one of the vehicle acoustic and optical early warning reminder methods in the above embodiment.

[0141] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all information and data that have been authorized by the user or fully authorized by all parties.

[0142] It should be understood that the specific embodiments described herein are for the purpose of explaining this application and not for limiting it. All other embodiments obtained by those of ordinary skill in the art without creative efforts according to the embodiments provided in this application fall within the protection scope of this application.

[0143] Obviously, the accompanying drawings are only some examples or embodiments of this application. For those of ordinary skill in the art, this application can also be applied to other similar situations based on these drawings without creative efforts. Additionally, it can be understood that although the work done during the development here may be complex and time-consuming, for those of ordinary skill in the art, certain design, manufacturing, or production changes based on the technical content disclosed in this application are only routine technical means and should not be regarded as insufficient disclosure of this application.

[0144] The term "embodiment" in this application means that the specific features, structures, or characteristics described in connection with the embodiments may be included in at least one embodiment of this application. The phrase appears in various positions in the specification and does not necessarily mean the same embodiment, nor does it mean being independent or alternative to other embodiments and mutually exclusive. Those of ordinary skill in the art can clearly or implicitly understand that the embodiments described in this application can be combined with other embodiments without conflict.

[0145] The above-described embodiments only represent several implementation manners of this application, and their descriptions are relatively specific and detailed, but they should not be construed as limiting the scope of patent protection. It should be noted that for those of ordinary skill in the art, without departing from the concept of this application, several modifications and improvements can still be made, and these all belong to the protection scope of this application. Therefore, the protection scope of this application shall be subject to the appended claims.

Claims

1. A vehicle sound and light warning reminder method, characterized in that: include: Obtaining environmental information around the vehicle; Detecting driving status information of surrounding vehicles in the environmental information; The surrounding vehicles are vehicles in the same lane and / or adjacent lane as the vehicle; Detecting danger information of the surrounding vehicles to the vehicle according to the driving state information; When the presence of the danger information is detected, the ambient lights and / or speakers at positions in the vehicle associated with the vehicle position are controlled in zones according to the vehicle position in the driving status information.

2. The vehicle sound and light warning reminder method according to claim 1, characterized in that: The detecting, according to the driving state information, the danger information of the surrounding vehicles to the vehicle comprises: Detecting the speed, acceleration, and distance between any of the surrounding vehicles and the vehicle according to the driving state information; The danger information of any of the surrounding vehicles is determined based on the speed, acceleration, and vehicle distance.

3. The vehicle sound and light warning reminder method according to claim 2, characterized in that: The determining the danger information of any of the surrounding vehicles based on the speed, acceleration and vehicle distance includes: Determining a proximity level of any of the surrounding vehicles based on the vehicle distance and at least one preset distance range; The danger information is determined based on the speed, the acceleration and the proximity level.

4. The vehicle sound and light warning reminder method according to claim 2, characterized in that: Also includes: The danger information is determined according to the vehicle types and abnormal conditions of the surrounding vehicles.

5. The vehicle sound and light warning reminder method according to claim 1, characterized in that: The detecting, according to the driving state information, the danger information of the surrounding vehicles to the vehicle comprises: The high-risk driving habits of any of the surrounding vehicles are detected according to the driving state information, and the high-risk driving habits are determined as the danger information.

6. The vehicle sound and light warning reminder method according to claim 5, characterized in that: The detecting the high-risk driving habits of any of the surrounding vehicles according to the driving state includes: Acquire historical driving data from the cloud associated with any of the surrounding vehicles; By comparing the historical driving data with the driving status information, the high-risk driving habits and the number of occurrences of any of the surrounding vehicles are matched and determined.

7. The vehicle sound and light warning reminder method according to claim 1, characterized in that: The step of performing zone control on the ambient light and / or the speaker at a position in the vehicle associated with the vehicle position according to the vehicle position in the driving state information includes: Based on the vehicle position, the corresponding ambient light zone controller turns on the ambient light at the associated position for zone control; And / or, based on the vehicle orientation, speakers at associated positions are turned on and zone control is performed via corresponding speaker zone controllers.

8. The vehicle sound and light warning reminder method according to claim 7, characterized in that: The step of performing zone control on the ambient light and / or the speaker at a position in the vehicle associated with the vehicle position according to the vehicle position in the driving state information further includes: Ranking the surrounding vehicles by risk according to the number of occurrences of the high-risk driving habits of any of the surrounding vehicles in the risk information; Based on the risk ranking, the ambient lights and / or speakers at positions in the vehicle associated with the vehicle position are zoned and controlled according to the vehicle position of any of the surrounding vehicles.

9. The vehicle sound and light warning reminder method according to claim 1, characterized in that: Also includes: The head position of the occupants is detected in real time through the in-car sensors; The audio intensity of the speaker is dynamically adjusted according to the head position.

10. The vehicle sound and light warning reminder method according to claim 1, characterized in that: Also includes: According to the approach level in the danger information, controlling the change of the luminous parameters of the atmosphere light in a preset luminous mode; The luminous parameters include at least one of the following: luminous frequency, luminous brightness and luminous color; And / or, according to the proximity level in the danger information, the audio parameter change of the speaker is controlled in a corresponding preset audio mode; the audio parameter includes at least one of the following: audio intensity and sound effect.

11. A vehicle processor, characterized in that: include: An information acquisition module, used to acquire environmental information around the vehicle; An information detection module, used to detect driving status information of surrounding vehicles in the environmental information; The surrounding vehicles are vehicles in the same lane and / or adjacent lane as the vehicle; A danger detection module, used for detecting danger information of the surrounding vehicles to the vehicle according to the driving state information; The partition control module is used to perform partition control on the ambient light and / or speaker at a position in the vehicle associated with the vehicle position according to the vehicle position in the driving status information when the danger information is detected.

12. A vehicle, characterized in that: The method comprises an environment sensing device, a surround speaker group and / or a surround ambient light group, and a vehicle processor, wherein the vehicle processor is configured to run a computer program to execute the vehicle sound and light warning reminder method according to any one of claims 1 to 10.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the vehicle sound and light warning reminder method according to any one of claims 1 to 10 are implemented.

Images