Driving assistance methods and systems

Abstract

This invention provides a driving assistance method and system, applied in the field of vehicle control technology. The method includes: real-time monitoring of driver operation data; when the driver operation data matches a preset driving behavior type, determining a target music type corresponding to the monitored driving behavior type based on a first correspondence between preset music types and driving behavior types; playing target candidate music according to the target music type; if the driver operation data still matches the monitored driving behavior type while the target candidate music is playing or after a preset playback time, then determining whether the music performance elements of the target candidate music match the monitored driving behavior type based on a second correspondence between preset driving behavior types and music performance elements; if yes, outputting visual prompts; otherwise, controlling the volume. This invention can reduce traffic accidents caused by improper driving behavior.

Description

Technical Field

[0001] This invention relates to the field of vehicle control technology, and in particular to driving assistance methods and systems. Background Technology

[0002] With the increasing prevalence of vehicles, more and more people are driving. However, drivers are often prone to improper driving behavior due to their own poor condition. For example, when drivers are emotionally agitated or irritable, they are more likely to engage in aggressive driving behaviors such as speeding, sudden acceleration, and sudden deceleration. Conversely, when drivers have been driving for extended periods, they are more likely to engage in slow driving behaviors such as driving while fatigued.

[0003] Improper driving behavior is a major cause of traffic accidents. Therefore, how to provide driver assistance solutions that can adjust the driver's state in response to improper driving behavior is a technical problem that urgently needs to be solved. Summary of the Invention

[0004] The purpose of this invention is to provide a driving assistance method and system that can adjust the driver's state to address improper driving behavior, thereby reducing traffic accidents caused by improper driving. The specific technical solution is as follows:

[0005] In a first aspect, embodiments of the present invention provide a driving assistance method, the method comprising:

[0006] Real-time monitoring of driver operation data;

[0007] When driver operation data is detected to match a preset driving behavior type, a target music type corresponding to the detected driving behavior type is determined based on a first correspondence between preset music types and driving behavior types; wherein, the first correspondence includes: a first music type corresponds to a first driving behavior type, and a second music type corresponds to a second driving behavior type;

[0008] Play the target alternative music according to the target music type;

[0009] When the target candidate music is played or after a preset time, if the driver's operation data still matches the detected driving behavior type, then according to the preset second correspondence between the driving behavior type and the music performance elements, it is determined whether the music performance elements of the target candidate music match the detected driving behavior type; if yes, then visual prompt information is output; if no, then volume control is performed.

[0010] Optionally, the driver operation data matching driving behavior type includes:

[0011] If the driving speed in the driver's operation data is greater than a preset speed threshold and the duration is greater than a first preset duration, then the driver's operation data matches a first driving behavior type.

[0012] If the driving acceleration is positive and greater than the first acceleration threshold, and the duration is greater than the third preset duration, then the driver operation data matches the first driving behavior type.

[0013] If the driving acceleration is negative and less than the second acceleration threshold, and the duration is greater than the fourth preset duration, then the driver operation data matches the first driving behavior type.

[0014] When the driver's operation data meets the preset fatigue driving conditions, the driver's operation data is matched with the second driving behavior type.

[0015] Optionally, playing target alternative music according to the target music type includes:

[0016] Based on the current driver's account information, determine the target alternative music from at least one alternative music belonging to the target music type;

[0017] Play the target alternative music.

[0018] Optionally, before determining whether the musical performance elements of the target candidate music match the detected driving behavior type based on a preset second correspondence between driving behavior type and musical performance elements, the method further includes:

[0019] Based on the preset third correspondence between note information and musical expression elements, the musical expression elements corresponding to the note information of each frame of the target candidate music are determined as the musical expression elements of each frame of the target candidate music.

[0020] Optionally, the second correspondence is: the correspondence between driving behavior type and changes in musical expression elements;

[0021] The step of determining whether the musical performance elements of the target candidate music match the detected driving behavior type based on a preset second correspondence between driving behavior type and musical performance elements includes:

[0022] The changes in the musical expression elements of each note within the note group to which the note to be played is located are obtained; wherein, the note group contains a preset number of consecutive notes;

[0023] Based on the second correspondence, it is determined whether the detected driving behavior type matches the changes in the musical expression elements of each note within the note group of that frame.

[0024] Optionally, the step of determining whether the detected driving behavior type matches the changes in the musical expression elements of each note within the note group of the frame, based on the second correspondence, includes:

[0025] When the detected driving behavior type is the first driving behavior type, determine whether the change of musical expression elements of each note in the note group where the note in the frame is located is an enhancement or a sudden change. If so, it is determined to be a mismatch; otherwise, it is determined to be a match.

[0026] When the detected driving behavior type is the second driving behavior type, determine whether the change of the expressive elements of each note in the note group of that frame is unchanged, weakened, or gradually strengthened or weakened. If so, it is determined to be a mismatch; otherwise, it is determined to be a match.

[0027] Optionally, the volume control includes:

[0028] If the detected driving behavior type is the first driving behavior type, lower the music volume;

[0029] If the detected driving behavior type is the second type, increase the music volume.

[0030] Optionally, the step of outputting visual cues to the driver includes:

[0031] According to a control strategy based on musical expression elements pre-set for the light-emitting unit installed in the vehicle, the light-emitting unit is controlled based on the musical expression elements of the note in that frame.

[0032] Optionally, the method further includes: if the musical performance elements of the target candidate music do not match the detected driving behavior type, then according to the control strategy, the light-emitting unit is controlled based on the musical performance elements of the notes at the same position; wherein, the notes at the same position are notes in the previous note group whose positions are the same as the position of the note.

[0033] Optionally, the performance elements include speed and intensity; the light-emitting unit includes red, green, and yellow lights;

[0034] The control of the light-emitting unit based on the musical expression elements of the frame note, according to a pre-set control strategy for the light-emitting unit installed in the vehicle, includes:

[0035] According to a pre-set correspondence between speed and light intensity, the red light in the light-emitting unit is controlled by the light intensity corresponding to the speed of the note in that frame;

[0036] According to a pre-set correspondence between intensity and the light intensity of green and blue lights, the green light in the light-emitting unit is controlled by the light intensity of the green light corresponding to the intensity of the note in that frame, and the blue light in the light-emitting unit is controlled by the light intensity of the blue light corresponding to the intensity of the note in that frame.

[0037] Secondly, embodiments of the present invention provide a driving assistance system, the driving assistance system including a control terminal and a player;

[0038] The control terminal is used to monitor driver operation data in real time; when the driver operation data is detected to match a preset driving behavior type, a target music type corresponding to the detected driving behavior type is determined based on a first correspondence between preset music types and driving behavior types; wherein, the first correspondence includes: a first music type corresponding to a first driving behavior type, and a second music type corresponding to a second driving behavior type; and the target candidate music determined according to the target music type is sent to the player;

[0039] The player is used to receive and play the target candidate music sent by the control terminal;

[0040] The control terminal is also used to determine whether the music performance elements of the target candidate music match the detected driving behavior type if the driver's operation data still matches the detected driving behavior type when the player is playing the target candidate music or after a preset playback time; if so, it outputs visual prompt information; if not, it controls the volume of the player.

[0041] Optionally, the driving assistance system further includes: a light-emitting unit disposed in the vehicle;

[0042] The control terminal is specifically used to control the light-emitting unit according to a control strategy based on musical expression elements pre-set for the light-emitting unit, based on the musical expression elements of the note in that frame.

[0043] Optionally, the control terminal is further configured to control the light-emitting unit according to the control strategy based on the musical expression elements of the same position note if the musical expression elements of the target candidate music do not match the detected driving behavior type; wherein the same position note is a note in the previous note group whose position is the same as that note.

[0044] Optionally, the performance elements include speed and intensity; the light-emitting unit includes red, green, and yellow lights;

[0045] The control terminal is specifically used to control the red light in the light-emitting unit according to the light intensity corresponding to the speed of the note in the frame, based on a pre-set correspondence between speed and light intensity; and to control the green light in the light-emitting unit according to the light intensity of the green light corresponding to the intensity of the note in the frame, based on a pre-set correspondence between intensity and the light intensity of the green and blue lights, and to control the blue light in the light-emitting unit according to the light intensity of the blue light corresponding to the intensity of the note in the frame.

[0046] Beneficial effects of the embodiments of the present invention:

[0047] In the driving assistance method provided by this invention, when driver operation data is detected to match a preset driving behavior type, a target alternative music can be played based on a first correspondence between a preset music type and the driving behavior type. This target alternative music can adjust the driving state that causes the corresponding improper driving behavior, allowing the driver to adjust their driving state and change their improper driving behavior upon hearing it. Furthermore, if the driver operation data still matches the detected driving behavior type during or after the target alternative music is played for a preset time, visual prompts or volume control can be used to further enhance the adjustment of the driver's driving state. Therefore, this invention can reduce the occurrence of traffic accidents caused by improper driving behavior.

[0048] Of course, implementing any product or method of the present invention does not necessarily require achieving all of the advantages described above at the same time. Attached Figure Description

[0049] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other embodiments can be obtained based on these drawings without creative effort.

[0050] Figure 1 A flowchart of a driving assistance method provided in an embodiment of the present invention;

[0051] Figure 2 This is another flowchart of the driving assistance method provided in an embodiment of the present invention;

[0052] Figure 3 This is another flowchart of the driving assistance method provided in an embodiment of the present invention;

[0053] Figure 4 This is a schematic diagram of the structure of the driving assistance system provided in an embodiment of the present invention;

[0054] Figure 5 This is another structural schematic diagram of the driving assistance system provided in an embodiment of the present invention. Detailed Implementation

[0055] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0056] In order to address improper driving behavior and provide an assisted driving solution that can adjust the driver's state to reduce traffic accidents caused by improper driving behavior, embodiments of the present invention provide a driving assistance method and system.

[0057] The embodiments of the present invention can be applied to various electronic devices, such as personal computers, servers, smart mobile devices, and other devices with data processing capabilities. Furthermore, the driving assistance method provided by the embodiments of the present invention can be implemented through software, hardware, or a combination of both.

[0058] Optionally, in one embodiment, the driving assistance solution provided by this invention can be applied to the control terminal of a driving assistance system. Depending on different usage scenarios and requirements, the control terminal can be deployed in various ways. In one implementation, the control terminal can be deployed inside the vehicle. In this case, the control terminal can be a device such as an in-vehicle driving brain or an in-vehicle terminal. The in-vehicle terminal includes a vehicle infotainment head unit (IHU), an in-vehicle infotainment system (IVI), or any other in-vehicle information interaction terminal. In another implementation, the control terminal can be deployed outside the vehicle. In this case, the control terminal can be a cloud server deployed in the cloud or an edge server.

[0059] It should be noted that the application scenarios of this invention should include a player configured for the driver. This player can be a speaker built into the control terminal, or it can be a speaker that is separate from the control terminal and not inside the vehicle, such as a speaker built into the vehicle itself.

[0060] During driving, drivers are prone to agitation, excitement, and other impulsive behaviors due to emotional fluctuations, leading to aggressive driving behaviors such as speeding, sudden acceleration, and abrupt deceleration. Conversely, prolonged driving can result in fatigued driving. These aggressive or impulsive driving behaviors are significant causes of traffic accidents. Therefore, providing driver assistance solutions that can adjust driver state to address these improper driving behaviors is a pressing technical problem that needs to be solved.

[0061] To reduce traffic accidents caused by improper driving behavior, embodiments of the present invention provide a driving assistance method, including:

[0062] Real-time monitoring of driver operation data;

[0063] When driver operation data is detected to match a preset driving behavior type, a target music type corresponding to the detected driving behavior type is determined based on a first correspondence between preset music types and driving behavior types; wherein, the first correspondence includes: a first music type corresponds to a first driving behavior type, and a second music type corresponds to a second driving behavior type;

[0064] Play the target alternative music based on the target music genre;

[0065] If the driver's operation data still matches the detected driving behavior type when the target candidate music is playing or after a preset playing time, the system will determine whether the music performance elements of the target candidate music match the detected driving behavior type based on the preset second correspondence between driving behavior type and music performance elements. If yes, a visual prompt will be output; otherwise, the volume will be controlled.

[0066] In the above-described scheme of this embodiment, when the driver's operation data is detected to match a preset driving behavior type, a target alternative music can be played based on the first correspondence between the preset music type and the driving behavior type. This target alternative music can adjust the driving state that causes the corresponding irregular driving behavior, allowing the driver to adjust their driving state and change their irregular driving behavior after hearing the target alternative music. Furthermore, if the driver's operation data still matches the detected driving behavior type during or after the target alternative music is played for a preset time, visual prompts or volume control can be used to further enhance the adjustment of the driver's driving state. Therefore, this invention can reduce the occurrence of traffic accidents caused by irregular driving behavior.

[0067] The following description, in conjunction with the accompanying drawings, describes a driving assistance method provided by an embodiment of the present invention.

[0068] like Figure 1 As shown, a driving assistance method provided by an embodiment of the present invention may include the following steps:

[0069] S101, real-time monitoring of driver operation data;

[0070] The aforementioned driver operation data may include driving speed, vehicle acceleration, driver fatigue detection results, etc.

[0071] Driving speed refers to the speed at which the driver is driving the vehicle on the road. In this implementation, driving speed can be monitored in real time by reading a meter. Alternatively, when the electronic device that performs this invention includes a speed measurement sensor such as a gyroscope, driving data can also be monitored in real time by direct measurement.

[0072] It should be noted that, depending on the scenario or need, the driving speed monitored in real time can be the driving speed at the current moment, the driving speed over a period of time, or the driving speed monitored continuously, all of which are reasonable.

[0073] When the driver's operation data is the vehicle's acceleration, the vehicle's acceleration can be determined based on the driver's driving speed, or the vehicle's acceleration can be obtained in real time through an acceleration sensor, for example, by measuring the vehicle's acceleration using a gyroscope.

[0074] When determining vehicle acceleration based on driving speed, the vehicle's acceleration at each moment can be calculated by comparing the current driving speed with the driving speed of the driver at the previous moment. The interval between the current moment and the previous moment can be determined based on experience and requirements.

[0075] For example, acceleration a = (V 车当 -V 车前200ms ) / 200ms, where V 车当 V is the vehicle's current driving speed. 车前200ms This is the vehicle's driving speed in the first 200ms.

[0076] It should be noted that, similar to driving speed, depending on the scenario or need, the monitored acceleration can be the acceleration at the current moment, the acceleration over a period of time, or the acceleration that is continuously monitored, all of which are reasonable.

[0077] When the driver's operation data is the result of driver fatigue detection, one implementation method uses the driver's facial image and an algorithm to determine whether the driver is driving while fatigued. Optionally, fatigue detection can also be performed by fusing driver data.

[0078] Among them, fusion detection refers to fatigue driving detection methods that integrate multi-dimensional features, such as detection models that primarily use machine vision and secondarily use driving behavior. Based on facial images of the driver acquired through image sensors such as cameras, machine vision algorithms such as face detection and facial feature point localization are used to extract and analyze features of the driver's facial changes, such as eye opening and closing, mouth opening and closing, and head posture, thereby enabling the analysis and judgment of the driver's fatigue state.

[0079] Furthermore, driver fatigue detection can be achieved by combining physiological characteristics of the driver, such as electrocardiogram signals, electroencephalogram signals, body surface temperature, as well as comprehensive characteristics such as the pressure on the steering wheel from the driver's hands, changes in vehicle acceleration, vehicle swaying, and the degree of vehicle deviation from the driving lane.

[0080] S102, when it is detected that the driver's operation data matches the preset driving behavior type, the target music type corresponding to the detected driving behavior type is determined based on the first correspondence between the preset music type and the driving behavior type; wherein, the first correspondence includes: the first music type corresponds to the first driving behavior type, and the second music type corresponds to the second driving behavior type;

[0081] The preset driving behavior types include a first driving behavior type and a second driving behavior type. The first driving behavior is an aggressive driving behavior, and the second driving behavior is an excessively slow driving behavior. Aggressive driving behavior includes behaviors such as speeding, rapid acceleration, and rapid deceleration, while excessively slow driving behavior includes behaviors such as driving while fatigued.

[0082] In one implementation, driver operation data is matched with driving behavior types, including the following:

[0083] In the first case, if the driving speed in the driver's operation data is greater than the preset speed threshold and the duration is greater than the first preset duration, then the driver's operation data matches the first driving behavior type.

[0084] The preset speed threshold and the first preset duration can be determined based on needs and experience. For example, the preset speed threshold can be set to 120 km / h and the first preset duration can be 5 seconds. That is, if the driving speed exceeds 120 km / h and the duration is greater than 5 seconds, the driver's operation data is determined to match the first driving behavior type, that is, the driver's driving behavior is considered excessive driving behavior.

[0085] In the second scenario, if the driving speed in the driver's operation data is greater than a preset multiple of the road speed limit and the duration is greater than the second preset duration, then the driver's operation data matches the first driving behavior type.

[0086] The road speed limit refers to the speed limit of the road where the driver's vehicle is located. Road speed limits can be obtained based on location and navigation; that is, the driver's vehicle location is first determined, and then the road speed limit for that location is obtained from the navigation system.

[0087] The preset multiplier and the second preset duration can be determined based on needs and experience. For example, the preset multiplier is 1.1 times, and the second preset duration is 5 seconds. When the road speed limit is 60 km / h, if the driving speed is greater than 1.1 * 60 km / h = 66 km / h and the duration is greater than 5 seconds, then the driver's driving behavior is judged to be excessive driving behavior.

[0088] In the third case, if the driving acceleration is positive and greater than the first acceleration threshold, and the duration is greater than the third preset duration, then the driver's operation data matches the first driving behavior type.

[0089] The first acceleration threshold and the third preset duration can be determined based on needs and experience. For example, the first acceleration threshold can be set to 3 m / s², and the third preset duration can be 5 seconds. That is, if the acceleration of the vehicle driven by the driver is greater than 3 m / s² and the duration is greater than 5 seconds, the driver's driving behavior is judged to be excessive driving behavior.

[0090] In the fourth case, if the driving acceleration is negative and less than the second acceleration threshold, and the duration is greater than the fourth preset duration, then the driver's operation data matches the first driving behavior type.

[0091] The second acceleration threshold and the fourth preset duration can be determined based on needs and experience. For example, the first acceleration threshold can be set to -4.5 m / s², and the fourth preset duration can be 5 seconds. That is, if the acceleration of the vehicle driven by the driver is less than -4.5 m / s² and the duration is greater than 5 seconds, the driver's driving behavior is judged to be excessive driving behavior.

[0092] In the fifth scenario, if the driver's operation data meets the preset fatigue driving conditions, then the driver's operation data is matched with the second driving behavior type.

[0093] The aforementioned fatigue driving condition is determined by whether the fatigue detection result in the driving operation data indicates driver fatigue. If the fatigue detection result indicates that the driver is in a state of driver fatigue, then the preset fatigue driving condition is met; otherwise, if the fatigue detection result indicates that the driver is not in a state of driver fatigue, then the preset fatigue driving condition is not met.

[0094] The aforementioned first correspondence includes: the first music type corresponds to the first driving behavior type, and the second music type corresponds to the second driving behavior type.

[0095] As can be seen from the above, the first driving behavior is an overly aggressive driving behavior, and the second driving behavior is an overly slow driving behavior.

[0096] The music type corresponding to each driving behavior is as follows: playing music of that type can adjust the driving state that caused the corresponding driving behavior. That is, playing music of the first type can adjust the driving state that caused the first type of driving behavior, thereby changing the driver's first driving behavior. Playing music of the second type can adjust the driving state that caused the second type of driving behavior, thereby changing the driver's second driving behavior.

[0097] The music genres include calming and energetic types. To ensure that the music can adjust the driving state that causes the corresponding driving behavior type, the music genre corresponding to the first driving behavior type is calming music, and the music genre corresponding to the second driving behavior type is energetic music.

[0098] Optionally, in one implementation, the music type can be determined based on the music files of the candidate music files. The music files include the music file itself and music attachments, wherein the music attachments include: lyrics files, sheet music files, and MIDI (Musical Instrument Digital Interface) files, and the sheet music files can be in the format of MusicXML (Music Extensible Markup Language).

[0099] Optionally, the music genre can be determined by the ratio of the total number of whole notes, quarter notes, and half notes to the total number of notes in the score file.

[0100] In one implementation, if the total number of whole notes, quarter notes, and half notes in a musical score file exceeds 80% of the total number of notes, the music is classified as an energetic type. If the total number of whole notes, quarter notes, and half notes in a musical score file is less than 50% of the total number of notes, the music is classified as a calm type.

[0101] S103, play the target alternative music according to the target music type.

[0102] In one implementation, a target candidate music can be selected from at least one candidate music belonging to the target music type. Optionally, the target candidate music can be selected from at least one candidate music belonging to the target music type in a conceptual manner.

[0103] In another implementation, the target music can be determined from at least one alternative music option belonging to the target music genre, based on the current driver's account information.

[0104] The current driver's account information includes the permissions for the candidate music tracks. For the current driver's account, each candidate track can be categorized into two types: tracks with playback permissions and tracks without playback permissions. Therefore, after determining the target music type, candidate tracks belonging to that type can be pre-filtered to obtain tracks with playback permissions for the driver's account. Finally, the target backup music can be selected from the pre-filtered tracks.

[0105] After identifying the target alternative music, the target alternative music can be played. Optionally, the alternative music indicated in the target music description information can be played through speakers installed around the driver's cab.

[0106] S104. When the target candidate music is playing or after a preset playback time, if the driver's operation data still matches the detected driving behavior type, then according to the preset second correspondence between the driving behavior type and the music performance elements, it is determined whether the music performance elements of the target candidate music match the detected driving behavior type; if yes, then visual prompt information is output; if no, then volume control is performed.

[0107] This step includes two scenarios: first, during the playback of the target candidate music, real-time detection is performed to check whether the driver's operation data matches the detected driving behavior type; second, after a preset time following the start of the target candidate music playback, the driver's operation data is checked to check whether it matches the detected driving behavior type. The preset time can be determined based on specific needs and experience; for example, the preset time can be 1 minute.

[0108] If the driver's operation data still matches the monitored driving behavior type, it means that simply playing the target alternative music has not achieved the expected adjustment of the driver's driving state. Therefore, further measures need to be taken to adjust the driver's driving state, namely, to determine whether the musical performance elements of the target alternative music match the monitored driving behavior type. If yes, a visual prompt message is output; if no, the volume is controlled.

[0109] The specific implementation method for determining whether the musical expression elements of the candidate music match the monitored driving behavior type will be described in detail in subsequent embodiments, and will not be repeated here.

[0110] Because different colors can affect the human endocrine system through vision, leading to increases or decreases in hormones and changes in mood, lighting can also be used to adjust the driver's driving state. If the musical elements of the target candidate music match the monitored driving behavior type, visual cues are then provided to the driver.

[0111] Optionally, the light-emitting unit can be controlled according to a control strategy based on musical expression elements pre-set for the light-emitting unit installed in the vehicle, based on the musical expression elements of the note in that frame.

[0112] The music is composed of multiple frames of notes, and playing the music is the process of playing the notes frame by frame in time-stamp order. The aforementioned light-emitting units include red, green, and yellow lights; optionally, they can also be units with red, green, and blue LEDs arranged in an alternating pattern, or units encapsulated with red, green, and blue LEDs. The light-emitting units can be positioned along the edge of the driver's side and / or passenger side window.

[0113] Different performance elements can have the same or different control strategies. When the performance elements include intensity and speed, and the light-emitting units include red, green, and yellow lights, the above-mentioned control strategy based on the music performance elements preset for the light-emitting units installed in the vehicle, based on the music performance elements of that frame of notes, controls the light-emitting units and may include steps 1-2:

[0114] Step 1: According to the pre-set correspondence between speed and light intensity, control the red light in the light-emitting unit with the light intensity corresponding to the speed of the note in that frame;

[0115] Optionally, the above correspondence between speed and light intensity is as follows: slow speed corresponds to red light off, medium speed corresponds to red light with weak light intensity, and fast speed corresponds to red light with strong light intensity.

[0116] Step 2: According to the pre-set correspondence between intensity and green and blue light intensity, control the green light in the light-emitting unit with the light intensity of the green light corresponding to the intensity of the note in that frame, and control the blue light in the light-emitting unit with the light intensity of the blue light corresponding to the intensity of the note in that frame.

[0117] Optionally, the above correspondence between intensity and light intensity is as follows: very weak intensity corresponds to blue light off, very weak intensity corresponds to blue light with weak light intensity, weak intensity corresponds to blue light with strong light intensity, relatively weak intensity corresponds to green light off, relatively strong intensity corresponds to green light with weak light intensity, very strong intensity corresponds to green light with strong light intensity, even stronger intensity corresponds to blue light with weak light intensity and green light with strong light intensity, and very strong intensity corresponds to blue light with strong light intensity and green light with weak light intensity.

[0118] If the musical elements of the target candidate music do not match the detected driving behavior type, the control of the light-emitting unit may further include:

[0119] According to the control strategy, the light-emitting unit is controlled based on the musical expression elements of notes in the same position; where a note in the same position is a note in the previous note group whose position is the same as that note.

[0120] Specifically, a preset number of consecutive notes are grouped into a single note group. This preset number can be determined based on needs and experience. For example, the preset number could be 4, meaning the notes of the target candidate music are divided into groups of four, resulting in multiple note groups.

[0121] For example, when the musical elements in the first note group match the detected driving behavior type, and the light control strategy in the first note group is blue off, green off, and red light on, after the first note group finishes playing, the second note group is played. If it is determined that the musical elements in the second note group do not match the detected driving behavior type, then when the second note group is played, the light control strategy remains the same as the first note group, i.e., blue off, green off, and red light on.

[0122] If the musical elements of the target candidate music do not match the detected driving behavior type, volume control will be applied. The volume control includes:

[0123] If the detected driving behavior type is the first driving behavior type, lower the music volume;

[0124] If the detected driving behavior type is the second type, increase the music volume.

[0125] Specifically, when the detected driving behavior type is the first type (aggressive driving), the corresponding volume control strategy is a volume reduction strategy, such as reducing the volume by 5 decibels. When the driving behavior type is the second type (slow driving), the corresponding volume control strategy is a volume increase strategy, such as increasing the volume by 5 decibels. After adjusting the default volume according to the correct volume control strategy, the target candidate music is played at the adjusted volume.

[0126] In the above-described scheme of this embodiment, when the driver's operation data is detected to match a preset driving behavior type, a target alternative music can be played based on the first correspondence between the preset music type and the driving behavior type. This target alternative music can adjust the driving state that causes the corresponding irregular driving behavior, allowing the driver to adjust their driving state and change their irregular driving behavior after hearing the target alternative music. Furthermore, if the driver's operation data still matches the detected driving behavior type during or after the target alternative music is played for a preset time, visual prompts or volume control can be used to further enhance the adjustment of the driver's driving state. Therefore, this invention can reduce the occurrence of traffic accidents caused by irregular driving behavior.

[0127] Optionally, another embodiment of the driving assistance method provided by the present invention may further include, before S104:

[0128] Based on the pre-defined third correspondence between note information and musical expression elements, the musical expression elements corresponding to the note information of each frame of the target candidate music are determined as the musical expression elements of each frame of the target candidate music.

[0129] The musical expressive elements include at least one of dynamics and tempo.

[0130] When the musical expression element is velocity, the third correspondence between the preset note information and the musical expression element can include: the correspondence between velocity values ​​and velocity in the MIDI protocol.

[0131] Velocity refers to the variation in loudness or softness of musical content. Calm music requires subtle changes in velocity, while energetic music requires a wider range of velocity variations. In the MIDI protocol, velocity values ​​range from 0 to 127, divided into 8 levels, represented in hexadecimal as 00-7F, including ppp (0-20), pp (21-40), p (41-50), mp (51-64), mf (65-70), f (71-80), ff (81-90), and fff (91-127). The velocity values ​​are 0, 1, 2, 3, 4, 5, 6, and 7, with the following correspondence: 0 corresponds to ppp (very soft); 1 to pp (very soft); 2 to p (soft); 3 to mp (soft); 4 to mf (strong); 5 to f (very strong); 6 to ff (stronger); and 7 to fff (very strong).

[0132] When the musical expression element is tempo, the third correspondence between the preset note information and the musical expression element can include: the correspondence between notes and tempo in the score file.

[0133] The above speed is calculated according to the rhythm of the music. Moderate speed is adopted for calm type of music. Fast and slow changing speeds are coordinated for passionate type of music. In the score file, in the staff notation, a quarter note is a solid oval note head plus a stem without a flag. The note length of a quarter note is one quarter of that of a whole note. In the staff notation, an eighth note is represented as a solid oval note head plus a stem with a flag-like tail. A sixteenth note refers to a note with a black face and two tails. When played at the normal rate: that is, each quarter note occupies one beat, and each beat occupies 0.5 seconds, and this 0.5 seconds is the "beat time"; an eighth note occupies half a beat, and a sixteenth note occupies 1 / 4 beat. Therefore, the speed or speed level can be obtained by transforming each frame of notes in the score file. Among them, the speed is divided into 0 (slow), corresponding to the whole note and the half note; 1 (medium), corresponding to the quarter note; 2 (fast), corresponding to the eighth note and the sixteenth note.

[0134] At this time, as Figure 2 shown, for the driving assistance method provided by another embodiment of the present invention, in addition to Figure 1 the steps S101 - S103 in the embodiment shown, in the above step S104, according to the preset second correspondence between the driving behavior type and the music performance elements, determining whether the music performance elements of the target alternative music match the monitored driving behavior type may include:

[0135] S201, obtaining the change situation of the music performance elements of each note in the note group where the current note to be played is located; wherein, the note group contains a preset number of consecutive notes;

[0136] Among them, the second correspondence is the correspondence between the driving behavior type and the change situation of the music performance elements.

[0137] It can be known from the foregoing content that the preset number can be determined according to requirements and experience. For each note group, the change situation of the performance elements of the note group can be determined according to the performance elements of each note in the note group.

[0138] The change situation of the performance elements of each note in the above note group represents the relationship between the sizes of each note in the note group. The following takes a note group composed of 4 notes as an example for illustration. Assume that the note group contains four notes A, B, C, and D in the playing order, then:

[0139] When A = B = C = D, the change situation of the performance elements of each note in the note group is unchanged;

[0140] When A < B < C < D, the change situation of the performance elements of each note in the note group is getting stronger;

[0141] When A > B > C > D, the change of the performance elements of each note within the note group is a diminuendo;

[0142] When A > B > C < D or A > B = C < D or A > B < C < D, the change of the performance elements of each note within the note group is a diminuendo and then a crescendo

[0143] When A C>D or A<B=C> D or A <c>At time D, the expressive elements of each note within the note group change from crescendo to diminuendo.

[0144] The changes in the expressive elements of each note within the note group corresponding to the major-minor relationship between the remaining four notes A, B, C, and D are abrupt changes.

[0145] S202, based on the second correspondence, determine whether the detected driving behavior type matches the changes in the musical expression elements of each note in the note group where the note in that frame is located.

[0146] In one implementation, when the detected driving behavior type is the first driving behavior type, it is determined whether the change of the musical expression elements of each note in the note group of the note in that frame is an enhancement or a sudden change. If so, it is determined to be a mismatch; otherwise, it is determined to be a match.

[0147] That is, when the driving behavior is excessive driving behavior, it is determined whether the change of the expressive elements of each note in the note group of that frame is enhanced or abrupt. If so, it is determined to be a mismatch; otherwise, it is determined to be a match.

[0148] In one implementation, when the detected driving behavior type is the second driving behavior type, it is determined whether the change of the expressive elements of each note in the note group of the note in that frame is unchanged, weakened, or gradually strengthened or weakened. If so, it is determined to be a mismatch; otherwise, it is determined to be a match.

[0149] When the driving behavior is excessively slow, it is determined whether the expressive elements of each note in the note group of that frame remain unchanged, decrease, or gradually increase or decrease. If so, it is determined to be a mismatch; otherwise, it is determined to be a match.

[0150] In the above-described scheme of this embodiment, when the driver's operation data is detected to match a preset driving behavior type, a target alternative music can be played based on the first correspondence between the preset music type and the driving behavior type. This target alternative music can adjust the driving state that causes the corresponding irregular driving behavior, allowing the driver to adjust their driving state and change their irregular driving behavior after hearing the target alternative music. Furthermore, if the driver's operation data still matches the detected driving behavior type during or after the target alternative music is played for a preset time, visual prompts or volume control can be used to further enhance the adjustment of the driver's driving state. Therefore, this invention can reduce the occurrence of traffic accidents caused by irregular driving behavior.

[0151] To more clearly illustrate the driving assistance system provided in the embodiments of the present invention, such as Figure 3 As shown in the figure, an embodiment of the present invention also provides a flowchart of another driving assistance method, including:

[0152] S301: Obtain vehicle speed and navigation speed limit information to determine if the driver is engaging in improper driving behavior. If yes, proceed to S302. If no, end the process.

[0153] Among them, non-standard driving behavior refers to driving behaviors of preset types, including excessive and excessive behaviors.

[0154] S302: Based on the driving misbehavior, control the audio playback device to play music that alleviates the driving misbehavior.

[0155] S303: Determine if the music has finished playing. If not, proceed to S304.

[0156] If so, after the music playback is complete, wait 200ms to 5s before re-entering S301.

[0157] S304: Convert the analysis and performance elements (musical dynamics and tempo) of the synchronous MIDI file M1 and the score file F1 corresponding to music D1 into a data stream D2 of performance elements. The data stream D2 includes: dynamics L1, dynamics change L2, tempo T1, tempo change T2, and enters S305.

[0158] In this step, velocity L1 records the velocity level of each frame of notes, velocity change L2 records the velocity changes of each note in each group, tempo T1 records the tempo level of each frame of notes, and tempo change T2 records the tempo changes of each note in each group.

[0159] S305: Compare each element of the data stream D2 of the performance element with the measures for non-standard driving behavior. If the handling measures are consistent, proceed to S306; otherwise, proceed to S307.

[0160] Each element represents the change in dynamics for each note group within dynamics variation L2, and the change in speed for each note group within tempo variation L2. When the irregular driving behavior matches the change in the expressive elements of each note within a note group, it indicates that the required handling measures are consistent; otherwise, it indicates that the required handling measures are inconsistent.

[0161] S306: Adjust the light to remind the user, while keeping the volume unchanged.

[0162] The brightness of the light-emitting unit is adjusted while the volume remains constant.

[0163] S307: Perform volume compensation, and maintain the light intensity of the light-emitting unit in the same state as the previous element.

[0164] In the above-described solution of this embodiment, when a driver's improper driving behavior is detected, a preset driving behavior type matching the detected driver's operation data can be played. Based on a first correspondence between preset music types and driving behavior types, target alternative music can be played according to the target music type. The target alternative music can adjust the driving state that caused the corresponding improper driving behavior, allowing the driver to adjust their driving state and change their improper driving behavior after hearing the target alternative music. Furthermore, if the driver's operation data still matches the detected driving behavior type during or after the target alternative music is played for a preset time, visual prompts or volume control can be used to further enhance the adjustment of the driver's driving state. Therefore, this invention can reduce the occurrence of traffic accidents caused by improper driving behavior.

[0165] Based on the above method, embodiments of the present invention also provide a driving assistance system. For example... Figure 4 As shown, a driving assistance system provided in this embodiment of the invention may include a control terminal 401 and a player 402;

[0166] The control terminal 401 is used to monitor driver operation data in real time. When the driver operation data is detected to match a preset driving behavior type, the control terminal determines the target music type corresponding to the detected driving behavior type based on a first correspondence between preset music types and driving behavior types. The first correspondence includes: a first music type corresponding to a first driving behavior type and a second music type corresponding to a second driving behavior type. The control terminal 401 sends the target alternative music determined according to the target music type to the player.

[0167] Player 402 is used to receive and play target alternative music sent by the control terminal;

[0168] The control terminal 401 is also used to determine whether the music performance elements of the target candidate music match the detected driving behavior type if the driver's operation data still matches the detected driving behavior type when the player is playing the target candidate music or after the preset playback time; if yes, it outputs visual prompt information; if no, it controls the volume of the player.

[0169] Optionally, in one embodiment, the driving assistance system further includes: a light-emitting unit disposed in the vehicle;

[0170] The control unit is specifically used to control the light-emitting unit according to a control strategy based on musical expression elements that is pre-set for the light-emitting unit, based on the musical expression elements of the note in that frame.

[0171] Optionally, in one embodiment, the control terminal is further configured to control the light-emitting unit according to the control strategy based on the musical expression elements of the same position note if the musical expression elements of the target candidate music do not match the detected driving behavior type; wherein, the same position note is a note in the previous note group whose position is the same as that note.

[0172] Optionally, in one embodiment, the performance elements include speed and intensity; the light-emitting unit includes a red light, a green light, and a yellow light;

[0173] The control unit is specifically used to control the red light in the light-emitting unit according to the light intensity corresponding to the speed of the note in the frame, based on a pre-set correspondence between speed and light intensity; and to control the green light in the light-emitting unit according to the light intensity of the green light corresponding to the intensity of the note in the frame, based on a pre-set correspondence between intensity and the light intensity of the green and blue lights, and to control the blue light in the light-emitting unit according to the light intensity of the blue light corresponding to the intensity of the note in the frame.

[0174] In the above-described scheme of this embodiment, when the driver's operation data is detected to match a preset driving behavior type, a target alternative music can be played based on the first correspondence between the preset music type and the driving behavior type. This target alternative music can adjust the driving state that causes the corresponding irregular driving behavior, allowing the driver to adjust their driving state and change their irregular driving behavior after hearing the target alternative music. Furthermore, if the driver's operation data still matches the detected driving behavior type during or after the target alternative music is played for a preset time, visual prompts or volume control can be used to further enhance the adjustment of the driver's driving state. Therefore, this invention can reduce the occurrence of traffic accidents caused by irregular driving behavior.

[0175] To more clearly illustrate the driving assistance system provided in the embodiments of the present invention, such as Figure 5 As shown in the figure, this embodiment of the invention also provides a schematic diagram of the result of a driving assistance system combined with a real-world usage scenario, including:

[0176] Vehicle speed is transmitted to the infotainment system's processor via CAN (Controller Area Network). The storage module is connected to the processor via I2S (Inter-IC Sound).

[0177] The GPS (Global Positioning System) antenna transmits GPS information to the GPS module via hardware. The GPS module processes and analyzes the current road speed limit information and provides it to the processor via I2S.

[0178] The processor needs to produce sound, which is transmitted to the power amplifier via I2S, and the speakers are controlled via A2B (Automotive Audio Bus).

[0179] The processor controls the ambient lighting control module via LIN (Local Interconnect Network), and the ambient lighting control module is connected to the display driver circuit via hardwired connection, and to the ambient lights controlled by the ambient lights via hardwired connection.

[0180] The various embodiments in this specification are described in a related manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the device, equipment, and system embodiments are basically similar to the method embodiments, so the descriptions are relatively simple; relevant parts can be referred to the descriptions of the method embodiments.

[0181] The above are merely preferred embodiments of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention are included within the scope of protection of the present invention.< / c> ​

Claims

1. A driving assistance method, characterized in that, The method includes: Real-time monitoring of driver operation data; When driver operation data is detected to match a preset driving behavior type, a target music type corresponding to the detected driving behavior type is determined based on a first correspondence between preset music types and driving behavior types; wherein, the first correspondence includes: a first music type corresponds to a first driving behavior type, and a second music type corresponds to a second driving behavior type; the driving behavior corresponding to the first driving behavior type is an aggressive driving behavior, and the driving behavior corresponding to the second driving behavior type is an overly lenient driving behavior; Play the target alternative music according to the target music type; When the target candidate music is played or after a preset playback time, if the driver's operation data still matches the detected driving behavior type, then based on the preset third correspondence between note information and musical performance elements, the musical performance element corresponding to the note information of each frame of the target candidate music is determined as the musical performance element of each frame of the target candidate music; according to the preset second correspondence between driving behavior type and musical performance element, it is determined whether the musical performance element of the target candidate music matches the detected driving behavior type; if yes, a visual prompt is output; if no, volume control is performed. The second correspondence is: the correspondence between driving behavior types and changes in musical expression elements; the step of determining whether the musical expression elements of the target candidate music match the monitored driving behavior types based on the preset second correspondence between driving behavior types and musical expression elements includes: The changes in the musical expression elements of each note within the note group to which the note to be played is located are obtained; wherein, the note group contains a preset number of consecutive notes; When the detected driving behavior type is the first driving behavior type, determine whether the change of musical expression elements of each note in the note group where the note in the frame is located is an enhancement or a sudden change. If so, it is determined to be a mismatch; otherwise, it is determined to be a match. When the detected driving behavior type is the second driving behavior type, it is determined whether the changes in the musical expression elements of each note in the note group of that frame are unchanged, weakened, or gradually increasing or decreasing. If so, it is determined to be a mismatch; otherwise, it is determined to be a match.

2. The method according to claim 1, characterized in that, The driver operation data is matched with driving behavior types including: If the driving speed in the driver's operation data is greater than a preset speed threshold and the duration is greater than a first preset duration, then the driver's operation data matches a first driving behavior type. If the driving speed in the driver's operation data is greater than a preset multiple of the road speed limit and the duration is greater than a second preset duration, then the driver's operation data matches the first driving behavior type. If the driving acceleration is positive and greater than the first acceleration threshold, and the duration is greater than the third preset duration, then the driver operation data matches the first driving behavior type. If the driving acceleration is negative and less than the second acceleration threshold, and the duration is greater than the fourth preset duration, then the driver operation data matches the first driving behavior type. When the driver's operation data meets the preset fatigue driving conditions, the driver's operation data is matched with the second driving behavior type.

3. The method according to claim 1 or 2, characterized in that, Playing target candidate music according to the target music type includes: Based on the current driver's account information, determine the target alternative music from at least one alternative music belonging to the target music type; Play the target alternative music.

4. The method according to claim 1, characterized in that, The volume control includes: If the detected driving behavior type is the first driving behavior type, lower the music volume; If the detected driving behavior type is the second type, increase the music volume.

5. The method according to claim 1, characterized in that, The output visual cue information includes: According to a control strategy based on musical expression elements pre-set for the light-emitting unit installed in the vehicle, the light-emitting unit is controlled based on the musical expression elements of the note in that frame.

6. The method according to claim 5, characterized in that, The method further includes: If the musical expression elements of the target candidate music do not match the detected driving behavior type, the light-emitting unit is controlled according to the control strategy based on the musical expression elements of the notes in the same position; wherein, the notes in the same position are notes in the previous note group whose positions are the same as the notes in that note.

7. The method according to claim 6, characterized in that, The performance elements include speed and intensity; the light-emitting units include red, green, and yellow lights; The control of the light-emitting unit based on the musical expression elements of the frame note, according to a pre-set control strategy for the light-emitting unit installed in the vehicle, includes: According to a pre-set correspondence between speed and light intensity, the red light in the light-emitting unit is controlled by the light intensity corresponding to the speed of the note in that frame; According to a pre-set correspondence between intensity and the light intensity of green and blue lights, the green light in the light-emitting unit is controlled by the light intensity of the green light corresponding to the intensity of the note in that frame, and the blue light in the light-emitting unit is controlled by the light intensity of the blue light corresponding to the intensity of the note in that frame.

8. A driving assistance system, characterized in that, The driving assistance system includes a control terminal and a player; The control terminal is used to monitor driver operation data in real time; When driver operation data is detected to match a preset driving behavior type, a target music type corresponding to the detected driving behavior type is determined based on a first correspondence between preset music types and driving behavior types. The first correspondence includes: a first music type corresponding to a first driving behavior type, and a second music type corresponding to a second driving behavior type; the driving behavior corresponding to the first driving behavior type is aggressive driving behavior, and the driving behavior corresponding to the second driving behavior type is sluggish driving behavior. The target candidate music determined according to the target music type is then sent to the player. The player is used to receive and play the target candidate music sent by the control terminal; The control terminal is further configured to, when the player is playing the target candidate music or after a preset playback time, if the driver's operation data still matches the detected driving behavior type, determine the musical performance element corresponding to the note information of each frame of the target candidate music based on a preset third correspondence between note information and musical performance elements, and use this as the musical performance element of each frame of the target candidate music; and determine whether the musical performance element of the target candidate music matches the detected driving behavior type according to a preset second correspondence between driving behavior type and musical performance elements; if yes, output visual prompt information; if no, control the volume of the player. The second correspondence is the correspondence between driving behavior type and changes in musical expression elements; the control terminal is specifically used to acquire changes in the musical expression elements of each note within the note group where the currently played note is located; wherein, the note group contains a preset number of consecutive notes; when the detected driving behavior type is the first driving behavior type, it is determined whether the changes in the musical expression elements of each note within the note group where the note in that frame is located are an enhancement or a sudden change; if so, it is determined to be a mismatch, otherwise, it is determined to be a match; when the detected driving behavior type is the second driving behavior type, it is determined whether the changes in the musical expression elements of each note within the note group where the note in that frame is located are unchanged, weakened, or gradually increasing or decreasing; if so, it is determined to be a mismatch, otherwise, it is determined to be a match.

9. The system according to claim 8, characterized in that, The driving assistance system also includes: a light-emitting unit disposed in the vehicle; The control terminal is specifically used to control the light-emitting unit according to a control strategy based on musical expression elements pre-set for the light-emitting unit, based on the musical expression elements of the note in that frame.

10. The system according to claim 9, characterized in that, The control terminal is also used to control the light-emitting unit according to the control strategy based on the musical expression elements of the same position note if the musical expression elements of the target candidate music do not match the detected driving behavior type; wherein the same position note is a note in the previous note group whose position is the same as the position of the note.

11. The system according to claim 10, characterized in that, The performance elements include speed and intensity; the light-emitting units include red, green, and yellow lights; The control terminal is specifically used to control the red light in the light-emitting unit according to the light intensity corresponding to the speed of the note in the frame, based on a pre-set correspondence between speed and light intensity; and to control the green light in the light-emitting unit according to the light intensity of the green light corresponding to the intensity of the note in the frame, based on a pre-set correspondence between intensity and the light intensity of the green and blue lights, and to control the blue light in the light-emitting unit according to the light intensity of the blue light corresponding to the intensity of the note in the frame.

Images