A control method, device and apparatus for audio playback, and a storage medium

By acquiring vehicle speed and road conditions, determining the driver's emotional state, and dynamically adjusting music playback, the problem of in-car music applications being unable to adapt to driving conditions is solved, thus improving driving safety and experience.

CN113535111BActive Publication Date: 2026-05-01TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
TENCENT TECHNOLOGY (SHENZHEN) CO LTD
Filing Date
2020-11-27
Publication Date
2026-05-01

AI Technical Summary

Technical Problem

Existing in-car music applications cannot dynamically adjust the music played based on the driver's driving status, resulting in music that is unsuitable for the current driving situation, affecting the driver's experience and safety.

Method used

By acquiring the vehicle's speed and road conditions, the driver's emotional attributes are determined, and a suitable target audio set is selected from the audio set for playback. The audio set is divided according to the audio attribute information.

Benefits of technology

It improves driving safety and the driver's audio listening experience by dynamically adjusting the music to adapt to the driving state, thus enhancing the driver's emotional management.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113535111B_ABST
    Figure CN113535111B_ABST
Patent Text Reader

Abstract

An audio playing control method and device, equipment and storage medium are provided in the embodiments of the present application, relating to the technical field of computer, and the method comprises: obtaining a driving speed and a driving road condition of a vehicle, and then determining an emotional attribute of a driver according to the driving speed and the driving road condition; obtaining a target audio set for adjusting the emotional attribute of the driver from each audio set, wherein each audio set is divided according to attribute information of audio; and then playing audio in the target audio set. Based on the driving speed and the driving road condition of the vehicle, the emotional attribute of the driver is determined, and then the corresponding target audio set is obtained from each audio set to adjust the emotional attribute of the driver, so as to assist the driver to drive through audio, thereby improving the driving safety on one hand and improving the experience of the driver listening to audio on the other hand.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a control method, apparatus, device and storage medium for audio playback. Background Technology

[0002] With the rapid development of connected vehicles, more and more car manufacturers are integrating music players into the central control screens of their cars. Drivers can listen to music as a form of relaxation, or use music to relieve driving fatigue.

[0003] The playlists in relevant music apps are pre-set with relatively fixed songs, so sometimes they may play songs that are not suitable for the driver's current driving state, thus affecting the experience. Summary of the Invention

[0004] This application provides an audio playback control method, apparatus, device, and storage medium for assisting driving with audio and improving the driver's audio listening experience.

[0005] On one hand, embodiments of this application provide an audio playback control method, the method comprising:

[0006] Obtain vehicle speed and road conditions;

[0007] The driver's emotional attributes are determined based on the driving speed and road conditions.

[0008] From various audio sets, a target audio set for adjusting the driver's emotional attributes is obtained, wherein each audio set is divided according to the attribute information of the audio.

[0009] Play the audio from the target audio set.

[0010] On one hand, embodiments of this application provide an audio playback control device, the device comprising:

[0011] The acquisition module is used to acquire the vehicle's speed and road conditions.

[0012] The recognition module is used to determine the driver's emotional attributes based on the driving speed and the road conditions.

[0013] The matching module is used to obtain a target audio set for adjusting the driver's emotional attributes from various audio sets, wherein each audio set is divided according to the attribute information of the audio.

[0014] The playback module is used to play audio from the target audio set.

[0015] Optionally, the identification module is specifically used for:

[0016] Obtain the driver's vital signs information;

[0017] The driver's emotional attributes are determined based on the driver's physical characteristics, driving speed, and road conditions.

[0018] Optionally, the identification module is specifically used for:

[0019] The driver's physical characteristics, driving speed, and road conditions are quantified to obtain the influencing factors corresponding to the driver's physical characteristics, driving speed, and road conditions, respectively.

[0020] The driver's emotional attributes are determined based on the driver's physical characteristics, the driving speed, and the influencing factors corresponding to the road conditions.

[0021] Optionally, the identification module is specifically used for:

[0022] From each range of human physical signs, a target range of human physical signs that matches the driver's physical signs information is obtained, and the influence factor corresponding to the target range of human physical signs is used as the influence factor corresponding to the driver's physical signs information.

[0023] From each speed range, obtain the target speed range that matches the driving speed, and use the influence factor corresponding to the target speed range as the influence factor corresponding to the driving speed;

[0024] From the various road condition levels, obtain the target road condition level that matches the driving road condition, and use the influence factor corresponding to the target road condition level as the influence factor corresponding to the driving road condition.

[0025] Optionally, the acquisition module is specifically used for:

[0026] The vehicle's location information is obtained using a positioning module;

[0027] The vehicle's time information is obtained using a timing module;

[0028] The vehicle's speed is obtained based on its location information and time information.

[0029] Optionally, the driving conditions include the smoothness of the road surface and the congestion of the road segment;

[0030] The acquisition module is specifically used for:

[0031] A road surface smoothness detection module is used to obtain the smoothness status of the driving road surface;

[0032] Obtain the congestion status of the driving section from the traffic server.

[0033] Optionally, the various audio sets are divided according to the frequency of the audio signal corresponding to the audio.

[0034] Optionally, the playback module is specifically used for:

[0035] The audio files in the target audio set are played sequentially according to their arrangement order. The arrangement order of the audio files is determined by the order of their scores from high to low, and the scores of the audio files are determined based on the degree of influence of the audio files on the driver's emotional attributes.

[0036] Optionally, the playback module is further configured to:

[0037] When the vehicle's speed or road conditions meet preset conditions, a safety prompt voice will be played.

[0038] On one hand, embodiments of this application provide a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the steps of the above-described audio playback control method.

[0039] On one hand, embodiments of this application provide a computer-readable storage medium storing a computer program executable by a computer device, which, when run on the computer device, causes the computer device to perform the steps of the above-described audio playback control method.

[0040] In this embodiment, the driver's emotional attributes are determined based on the vehicle's speed and road conditions. Then, a corresponding target audio set is obtained from various audio sets to adjust the driver's emotional attributes, thereby enabling audio-assisted driving. This improves both driving safety and the driver's audio listening experience. Attached Figure Description

[0041] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0042] Figure 1 A schematic diagram of a system architecture provided for an embodiment of this application;

[0043] Figure 2 A flowchart illustrating an audio playback control method provided in an embodiment of this application;

[0044] Figure 3 A schematic diagram of a system architecture provided for an embodiment of this application;

[0045] Figure 4 A flowchart illustrating an audio playback control method provided in an embodiment of this application;

[0046] Figure 5 A flowchart illustrating an audio playback control method provided in an embodiment of this application;

[0047] Figure 6 This is a schematic diagram of the structure of an audio playback control device provided in an embodiment of this application;

[0048] Figure 7 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0049] To make the objectives, technical solutions, and beneficial effects of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

[0050] The design concept of the embodiments of this application will be introduced below.

[0051] In music applications installed on in-vehicle devices, playlists are usually pre-set with relatively fixed songs. However, a driver's driving state changes with factors such as road conditions and driving speed. Therefore, music applications sometimes play music that is not suitable for the driver's current driving state, thus affecting the experience.

[0052] Analysis revealed that high-excitement, fast-paced negative music is more likely to lead to high-speed driving, while low-excitement, slow-paced positive music is more likely to give drivers a variety of speed options and is more conducive to speed control. Furthermore, when drivers are in a tense, stressful, or negative emotional state, playing soothing, gentle music can help them react more quickly to problems. Conversely, when drivers are relaxed and in a less stressful, positive emotional state, playing rhythmic music can maintain that positive mood. Recommending different types of music based on different driving states can achieve music-assisted driving, providing effective musical support for safe driving while enhancing the driver's listening experience.

[0053] In view of this, embodiments of this application provide an audio playback control method, which specifically involves: acquiring the vehicle's driving speed and road conditions, and then determining the driver's emotional attributes based on the driving speed and road conditions; then obtaining a target audio set for adjusting the driver's emotional attributes from various audio sets, wherein each audio set is divided according to the audio's attribute information; and finally playing the audio from the target audio set.

[0054] In this embodiment, the driver's emotional attributes are determined based on the vehicle's speed and road conditions. Then, a corresponding target audio set is obtained from various audio sets to adjust the driver's emotional attributes, thereby enabling audio-assisted driving. This improves both driving safety and the driver's audio listening experience.

[0055] refer to Figure 1 This is a system architecture diagram applicable to the embodiments of this application. The system architecture includes at least an in-vehicle terminal device 101 and an application server 102.

[0056] The in-vehicle terminal device 101 is a device embedded in a vehicle, and an audio application is pre-installed on the in-vehicle terminal device 101. The audio application can be a pre-installed client application, web application, mini-program, etc. The type of audio application can be an in-vehicle music application, an in-vehicle radio application, an in-vehicle voice live streaming application, etc. The audio playback control method in this embodiment can be applied to the above-mentioned types of audio applications for personalized audio recommendations. For example, the audio playback control method in this embodiment can be applied to an in-vehicle music application for background music recommendations or personalized radio station music recommendations.

[0057] The in-vehicle terminal device 101 may include one or more processors 1011, a memory 1012, an I / O interface 1013 for interacting with the application server 102, and a display panel 1014, etc. The in-vehicle terminal device 101 may be a navigation device, an autonomous driving device, a smartphone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, etc., but is not limited to these.

[0058] Application server 102 is the backend server for the audio application, providing services to the audio application. Application server 102 may include one or more processors 1021, memory 1022, and I / O interfaces 1023 for interacting with the vehicle terminal device 101. Furthermore, application server 102 may be configured with a database 1024. Application server 102 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms. The vehicle terminal device 101 and application server 102 can be directly or indirectly connected via wired or wireless communication, which is not limited herein.

[0059] The audio playback control method can be executed by the vehicle terminal device 101, or by the interaction between the vehicle terminal device 101 and the application server 102.

[0060] In the first scenario, the audio playback control method is executed by the vehicle-mounted terminal device 101.

[0061] The vehicle-mounted terminal device 101 acquires the vehicle's speed and road conditions, and then determines the driver's emotional attributes based on these parameters. It then obtains a target audio set from locally stored audio sets, where each audio set is categorized based on its attribute information. Finally, it plays audio from the target audio set.

[0062] In the second scenario, the audio playback control method is executed interactively between the vehicle terminal device 101 and the application server 102.

[0063] The vehicle-mounted terminal device 101 acquires the vehicle's speed and road conditions, and then sends these data to the application server 102. The application server 102 determines the driver's emotional attributes based on the vehicle's speed and road conditions. It then obtains a target audio set from various audio sets, where each audio set is categorized based on its attribute information, to adjust the driver's emotional attributes. The target audio set is then sent to the vehicle-mounted terminal device 101. The vehicle-mounted terminal device 101 plays the audio from the target audio set.

[0064] In the third scenario, the audio playback control method is executed interactively between the vehicle terminal device 101 and the application server 102.

[0065] The vehicle-mounted terminal device 101 acquires the vehicle's speed and road conditions, and then determines the driver's emotional attributes based on these parameters. The vehicle-mounted terminal device 101 sends the driver's emotional attributes to the application server 102. The application server 102 obtains a target audio set from various audio sets, where each audio set is categorized based on its attribute information. The application server 102 sends the target audio set to the vehicle-mounted terminal device 101. The vehicle-mounted terminal device 101 plays the audio from the target audio set.

[0066] based on Figure 1 The system architecture diagram shown in this application illustrates the flowchart of an audio playback control method. Figure 2 As shown, the process of this method can be executed by a computer device, which can be an in-vehicle terminal device 101 or an application server 102, and includes the following steps:

[0067] Step S201: Obtain the vehicle's speed and road conditions.

[0068] Specifically, vehicle speed can be the vehicle's real-time speed or its average speed over a period of time. Road conditions include the smoothness of the road surface and the congestion of the road segment.

[0069] Step S202: Determine the driver's emotional attributes based on driving speed and road conditions.

[0070] Specifically, emotional attributes include at least the type of emotion and the different degrees corresponding to each type of emotion. For example, the types of emotions include tension, relaxation, happiness, sadness, etc. For the emotion of tension, there are different degrees such as very tense and moderately tense.

[0071] A pre-defined mapping relationship between driving speed, road conditions, and emotional attributes is established. Upon obtaining the vehicle's current speed and road conditions, the pre-defined mapping relationship is queried to determine the driver's emotional attributes.

[0072] Step S203: Obtain the target audio set for adjusting the driver's emotional attributes from the various audio sets.

[0073] Specifically, audio can be music, broadcasts, live audio, etc. Each audio set is divided based on its attribute information, which includes the audio type, audio name, and the frequency of the corresponding audio signal.

[0074] A pre-defined mapping relationship between audio sets and emotional attributes is established, with each audio set used to adjust the corresponding emotional attribute. When the driver's emotional attributes are acquired during vehicle operation, the pre-defined mapping relationship is queried based on the driver's emotional attributes to determine the target audio set used to adjust the driver's emotional attributes.

[0075] Step S204: Play the audio from the target audio set.

[0076] Specifically, it is possible to play all audio in the target audio set, or to play a portion of the audio in the target audio set. Furthermore, when playing audio in the target audio set, it is possible to play a segment of the audio or the entire audio; this application does not specifically limit this.

[0077] In this embodiment, the driver's emotional attributes are determined based on the vehicle's speed and road conditions. Then, a corresponding target audio set is obtained from various audio sets to adjust the driver's emotional attributes, thereby enabling audio-assisted driving. This improves both driving safety and the driver's audio listening experience.

[0078] Optionally, in step S201 above, the positioning module is used to obtain the vehicle's location information, the timing module is used to obtain the vehicle's time information, and then the vehicle's speed is obtained based on the vehicle's location information and time information.

[0079] Specifically, the positioning module can be an in-vehicle Global Positioning System (GPS), an in-vehicle BeiDou Navigation Satellite System (BDS), etc. The positioning module can be an internal module of the in-vehicle terminal device or a device independent of the in-vehicle terminal device. When the positioning module is independent of the in-vehicle terminal device, it is pre-bound to the in-vehicle terminal device, and the positioning module is activated when the vehicle starts. The positioning module and the in-vehicle terminal device communicate via communication protocols such as Bluetooth.

[0080] The timing module can be an in-vehicle timer, an internal module of the in-vehicle terminal device, or a device independent of the in-vehicle terminal device. When the timing module is independent of the in-vehicle terminal device, it is pre-bound to the in-vehicle terminal device. When the vehicle starts, the timing module starts accordingly, and the timing module and the in-vehicle terminal device communicate with each other via communication protocols such as Bluetooth.

[0081] The vehicle-mounted terminal device determines the vehicle's travel distance based on the location information obtained from the two positioning operations, and then obtains the vehicle's speed based on the travel distance and the interval between the two positioning operations.

[0082] Optionally, in step S201 above, the driving conditions include the smoothness of the driving road surface and the congestion of the driving segment. The smoothness of the driving road surface is obtained by using a road surface smoothness detection module, and the congestion of the driving segment is obtained from the road condition server.

[0083] Specifically, the surface smoothness detection module can be a vehicle-mounted bump accumulator. The vehicle-mounted bump accumulator includes a counting circuit that uses a contact-type microswitch and an electromagnetic counter for counting. If the number of consecutive counts within a preset time exceeds a preset threshold, the road surface is determined to be uneven; otherwise, the road surface is determined to be smooth.

[0084] Multiple counting threshold intervals can also be preset, each corresponding to a smooth state. Then, from each counting threshold interval, a target counting threshold interval that matches the number of consecutive counts within a preset time period is determined, and the smooth state corresponding to the target counting threshold interval is taken as the smooth state of the road surface on which the vehicle travels.

[0085] For example, four smooth road conditions are preset: smooth road surface, bumpy road surface, muddy and bumpy road surface, and severe uphill / downhill slope. The counting threshold range for smooth road surface is 1-50 times, for bumpy road surface is 50-100 times, for muddy and bumpy road surface is 100-150 times, and for severe uphill / downhill slope is 150-200 times. If the vehicle-mounted bump accumulator counts 80 times consecutively within a preset time period, then the smooth road surface condition is determined to be bumpy road surface.

[0086] The road surface smoothness detection module can be an internal module of the vehicle-mounted terminal device or a device independent of the vehicle-mounted terminal device. When the road surface smoothness detection module is an independent device, it is pre-bound to the vehicle-mounted terminal device. When the vehicle starts, the road surface smoothness detection module starts accordingly, and the road surface smoothness detection module and the vehicle-mounted terminal device communicate with each other via communication protocols such as Bluetooth.

[0087] The traffic server stores real-time congestion status for road segments at various locations. The vehicle-mounted terminal device sends a congestion status retrieval request to the traffic server, which includes the vehicle's current location. Based on the vehicle's current location, the traffic server determines the vehicle's travel segment, obtains the congestion status of that segment, and then sends the congestion status of that segment to the vehicle-mounted terminal device.

[0088] For example, the congestion status of road segments is pre-divided into four levels: smooth, moderately congested, congested, and very congested. The traffic server stores the congestion status of road segments A, B, C, and D respectively, where road segment A is congested, road segment B is moderately congested, road segment C is moderately congested, and road segment D is smooth.

[0089] The vehicle-mounted terminal device obtains the vehicle's current location and then sends a congestion status request carrying the vehicle's current location to the traffic condition server. Based on the vehicle's current location, the traffic condition server determines that the vehicle is traveling on road segment A and sends the congestion status of road segment A to the vehicle-mounted terminal device, thus notifying the vehicle-mounted terminal device that the road segment where the vehicle is currently located is congested.

[0090] Optionally, in step S202 above, this application embodiment provides at least the following implementation methods to determine the driver's emotional attributes:

[0091] Implementation Method 1: Determine the driver's emotional attributes based on driving speed and road conditions.

[0092] Specifically, driving speed and road conditions are quantified to obtain the influencing factors corresponding to driving speed and road conditions respectively. Then, based on the influencing factors corresponding to driving speed and road conditions respectively, the driver's emotional attributes are determined.

[0093] When quantifying driving speed, first obtain the target speed range that matches the driving speed from each speed range, and then use the influence factor corresponding to the target speed range as the influence factor corresponding to the driving speed.

[0094] In practice, the driving speed is pre-divided into different speed ranges based on the maximum speed limit for different scenarios specified in the national motor vehicle driver's license, and an influence factor is set for each speed range. Specifically, the influence factor for each speed range can be set based on the principle that the higher the driving speed, the higher the corresponding influence factor; alternatively, it can be set based on the principle that the higher the driving speed, the lower the corresponding influence factor. This application does not impose any specific limitations on this.

[0095] After acquiring the vehicle's speed, it is compared with various speed ranges to determine a target speed range that matches the vehicle's speed. The influencing factor corresponding to the target speed range is then used as the influencing factor for the vehicle's speed. Additionally, a safety warning voice prompt is played when the vehicle's speed meets preset conditions. For example, a speeding warning voice prompt is played when the vehicle's speed exceeds a preset safe speed.

[0096] Road conditions include the smoothness of the road surface and the congestion of the road segment. Correspondingly, road condition levels include smoothness level and congestion level. When quantifying road conditions, firstly, a target smoothness level matching the smoothness of the road surface is obtained from each smoothness level. Then, the influencing factor corresponding to the target smoothness level is used as the influencing factor corresponding to the smoothness of the road surface. Similarly, from each congestion level, a target congestion level matching the congestion of the road segment is obtained. Then, the influencing factor corresponding to the target congestion level is used as the influencing factor corresponding to the congestion of the road segment.

[0097] In practice, multiple smoothness levels can be set according to the smoothness of the road surface, and then an influence factor corresponding to each smoothness level can be set. Specifically, the influence factor for each smoothness level can be obtained based on the principle that the smoother the road surface, the larger the corresponding influence factor; alternatively, the influence factor for each smoothness level can be obtained based on the principle that the more uneven the road surface, the larger the corresponding influence factor. This application does not impose any specific limitations on this.

[0098] Multiple congestion levels are set based on the degree of congestion on the road segment, and then an impact factor is set for each congestion level. Specifically, the impact factor for each congestion level can be determined based on the principle that the more congested the road segment, the larger the corresponding impact factor; alternatively, it can be determined based on the principle that the more uncongested the road segment, the larger the corresponding impact factor. This application does not impose any specific limitations on this approach.

[0099] After obtaining the smoothness of the driving road surface, the smoothness of the driving road surface is compared with various smoothness levels to determine the target smoothness level that matches the smoothness of the driving road surface. The influence factor corresponding to the target smoothness level is then used as the influence factor corresponding to the smoothness of the driving road surface.

[0100] Once the congestion status of the travel segment is obtained, it is compared with various congestion levels to determine the target congestion level that matches the congestion status of the travel segment. The influencing factor corresponding to the target congestion level is then used as the influencing factor corresponding to the congestion status of the travel segment.

[0101] Additionally, when the vehicle's road conditions meet preset criteria, a safety alert voice prompt will be played. For example, if the target smoothness level of the road surface is greater than the preset smoothness level, an alert about uneven road surface will be played. If the target congestion level of the road segment is greater than the preset congestion level, an alert about road congestion will be played.

[0102] Furthermore, based on the weights corresponding to vehicle speed, road surface smoothness, and road congestion, the influencing factors corresponding to these factors are weighted and summed to obtain the driver's emotional impact value. Then, based on the driver's emotional impact value, a preset emotional attribute lookup table is consulted to determine the driver's emotional attribute.

[0103] For example, as shown in Table 1, the driving speed is divided into 5 speed ranges: speed range 1 (0–30 km / h), speed range 2 (30–40 km / h), speed range 3 (40–70 km / h), speed range 4 (70–120 km / h), and speed range 5 (above 120 km / h). The influence factor for speed range 1 is 1, for speed range 2 it is 2, for speed range 3 it is 3, for speed range 4 it is 4, and for speed range 5 it is 5.

[0104] Table 1.

[0105]

[0106] Four smoothness levels are preset, as shown in Table 2: smoothness level 1 (smooth road surface), smoothness level 2 (bumpy road surface), smoothness level 3 (muddy and bumpy road surface), and smoothness level 4 (severe uphill and downhill slopes). The influence factor corresponding to smoothness level 1 is 1, the influence factor corresponding to smoothness level 2 is 3, the influence factor corresponding to smoothness level 3 is 5, and the influence factor corresponding to smoothness level 4 is 7.

[0107] Table 2.

[0108]

[0109] Four congestion levels were pre-set, as shown in Table 3: congestion level 1 (smooth), congestion level 2 (moderately congested), congestion level 3 (congested), and congestion level 4 (very congested). The impact factor for congestion level 1 was 2, for congestion level 2 it was 4, for congestion level 3 it was 6, and for congestion level 4 it was 8.

[0110] Table 3.

[0111]

[0112] If the vehicle's speed is 35 km / h, then by referring to Table 1, the target speed range matching the speed is speed range 2 (30-40 km / h), with a corresponding influence factor of 2. If the road surface is smooth, then by referring to Table 2, the target smoothness level matching the road surface smoothness is smoothness level 1, with a corresponding influence factor of 1. If the road segment is congested but not congested, then by referring to Table 3, the target congestion level matching the congestion level is congestion level 1, with a corresponding influence factor of 2.

[0113] The weights for vehicle speed, road surface smoothness, and road congestion are set at 0.6, 0.2, and 0.2 respectively. The influence factors corresponding to vehicle speed, road surface smoothness, and road congestion are then weighted and summed according to these preset weights to obtain the emotional impact value of driver M.

[0114] 0.6×2+0.2×1+0.2×2=1.8.

[0115] The emotional attribute comparison table is shown in Table 4:

[0116] Table 4.

[0117] Emotional Influence Value 0~2 2~4 4~6 Emotional attributes Low driving stress Less driving stress High driving stress

[0118] In Table 4, the larger the emotional impact value, the more the emotional attribute leans towards a negative emotional attribute; conversely, the smaller the emotional impact value, the more the emotional attribute leans towards a positive emotional attribute. Based on the emotional impact value of driver M, referring to the emotional attribute comparison table shown in Table 4, driver M's emotional attribute is determined to be low driving stress.

[0119] Implementation Method 2: Obtain the driver's physical characteristics information, and then determine the driver's emotional attributes based on the driver's physical characteristics information, driving speed, and road conditions.

[0120] Specifically, the driver's physical characteristics, driving speed, and road conditions are quantified to obtain the influencing factors corresponding to each factor. Then, based on these influencing factors, the driver's emotional attributes are determined.

[0121] When quantifying the driver's physical characteristics information, a target physical characteristics interval that matches the driver's physical characteristics information can be obtained from various physical characteristics intervals, and the influence factor corresponding to the target physical characteristics interval can be used as the influence factor corresponding to the driver's physical characteristics information.

[0122] In practice, human vital signs information includes indicators such as pulse and blood pressure, which can be obtained through a vital signs detection module embedded in the vehicle. For example, a heart rate sensor can be embedded in the vehicle's steering wheel, and when the driver's hands touch the steering wheel, the heart rate sensor detects and obtains the driver's human vital signs information.

[0123] Human vital signs information can also be obtained through vital sign detection devices independent of the vehicle. These devices can be various wearable devices, such as smartwatches and smart bracelets. In practice, the vital sign detection devices are pre-linked to the in-vehicle terminal. The vital sign detection devices monitor the driver's vital signs in real time and send this information to the in-vehicle terminal.

[0124] When human vital signs differ, the corresponding human state also differs. For example, if a person's pulse is rapid and blood pressure is high, the person may be in a state of tension; if the pulse and blood pressure are at normal levels, the person may be in a state of relaxation. Based on this, in this embodiment, different human vital sign intervals are pre-defined, each interval corresponding to a pulse range and a blood pressure range. Then, an influencing factor is set for each interval. Specifically, the influencing factor for each interval can be determined based on the principle that higher values ​​of the vital signs correspond to larger influencing factors; alternatively, it can be determined based on the principle that lower values ​​of the vital signs correspond to larger influencing factors. This application does not impose specific limitations on this approach.

[0125] After obtaining the driver's physical characteristics information, the driver's physical characteristics information is compared with various physical characteristics intervals to determine the target physical characteristics interval that matches the driver's physical characteristics information, and the influence factor corresponding to the target physical characteristics interval is used as the influence factor corresponding to the driver's physical characteristics information.

[0126] The specific process of quantifying driving speed and road conditions to obtain the influencing factors corresponding to driving speed and road conditions has been described in detail in Implementation Method 1, and will not be repeated here.

[0127] Furthermore, based on the weights corresponding to the driver's physical characteristics, vehicle speed, road surface smoothness, and road congestion, the influencing factors corresponding to these factors are weighted and summed to obtain the driver's emotional impact value. Then, based on the driver's emotional impact value, a preset emotional attribute lookup table is consulted to determine the driver's emotional attribute.

[0128] Exemplarily, as shown in Table 5, different 3 human body sign intervals are divided based on human body sign information, namely human body sign interval 1 (relaxed), human body sign interval 2 (relatively tense), and human body sign interval 3 (tense). The pulse rate range corresponding to human body sign interval 1 is [a, b), the pulse rate range corresponding to human body sign interval 2 is [b, c), and the pulse rate range corresponding to human body sign interval 3 is [c, d], where a, b, c, and d are natural numbers and a < b < c < d. The blood pressure range corresponding to human body sign interval 1 is [e, f), the blood pressure range corresponding to human body sign interval 2 is [f, g), and the blood pressure range corresponding to human body sign interval 3 is [g, h], where e, f, g, and h are natural numbers and e < f < g < h. The influencing factor corresponding to human body sign interval 1 is 2, the influencing factor corresponding to human body sign interval 2 is 3, and the influencing factor corresponding to human body sign interval 3 is 4.

[0129] Table 5.

[0130]

[0131] As shown in Table 1, the driving speed is divided into 5 speed intervals, namely speed interval 1 (0 - 30 km / h), speed interval 2 (30 - 40 km / h), speed interval 3 (40 - 70 km / h), speed interval 4 (70 - 120 km / h), and speed interval 5 (above 120 km / h). Among them, the influencing factor corresponding to speed interval 1 is 1, the influencing factor corresponding to speed interval 2 is 2, the influencing factor corresponding to speed interval 3 is 3, the influencing factor corresponding to speed interval 4 is 4, and the influencing factor corresponding to speed interval 5 is 5.

[0132] 4 flatness levels are preset, as shown in Table 2, namely flatness level 1 (smooth road surface), flatness level 2 (bumpy road surface), flatness level 3 (muddy and bumpy road surface), and flatness level 4 (steep uphill and downhill), where the influencing factor corresponding to flatness level 1 is 1, the influencing factor corresponding to flatness level 2 is 3, the influencing factor corresponding to flatness level 3 is 5, and the influencing factor corresponding to flatness level 4 is 7.

[0133] 4 congestion levels are preset, as shown in Table 3, namely congestion level 1 (unobstructed), congestion level 2 (relatively congested), congestion level 3 (congested), and congestion level 4 (extremely congested), where the influencing factor corresponding to congestion level 1 is 2, the influencing factor corresponding to congestion level 2 is 4, the influencing factor corresponding to congestion level 3 is 6, and the influencing factor corresponding to congestion level 4 is 8.

[0134] If the vehicle's speed is 100 km / h, then by referring to Table 1, the target speed range matching the speed is speed range 4 (70-120 km / h), with a corresponding influence factor of 4. If the road surface is smooth, then by referring to Table 2, the target smoothness level matching the smoothness of the road surface is smoothness level 1, with a corresponding influence factor of 1. If the traffic congestion on the road segment is clear, then by referring to Table 3, the target congestion level matching the ...

[0135] The weights for driver W's physical characteristics are set to 0.2, vehicle speed to 0.6, road surface smoothness to 0.1, and road congestion to 0.1. Then, the influencing factors corresponding to driver W's physical characteristics, vehicle speed, road surface smoothness, and road congestion are weighted and summed according to these preset weights to obtain the emotional impact value of driver W.

[0136] 0.2×4+0.6×4+0.1×1+0.1×2=3.5.

[0137] The emotional attribute reference table is shown in Table 6:

[0138] Table 6.

[0139] Emotional Influence Value 0~2 2~3 3~4 4~6 Emotional attributes Low driving stress Less driving stress Driving is stressful High driving stress

[0140] In Table 6, the larger the emotional impact value, the more the emotional attribute leans towards a negative emotional attribute; conversely, the smaller the emotional impact value, the more the emotional attribute leans towards a positive emotional attribute. Based on driver W's emotional impact value, referring to the emotional attribute comparison table in Table 6, driver W's emotional attribute is determined to be high driving stress.

[0141] In this embodiment, when determining the driver's emotional attributes, both the driver's physical characteristics and the vehicle's speed and road conditions are acquired. Then, the multi-dimensional feature information is integrated to determine the driver's emotional attributes, thereby improving the accuracy of determining the driver's emotional attributes and subsequently improving the accuracy of recommending audio to the driver based on the emotional attributes.

[0142] It should be noted that the implementation methods for determining the driver's emotional attributes in this application are not limited to the above-mentioned methods. The driver's emotional attributes can be determined based on any one of the four dimensions of characteristics: the driver's physical characteristics, the vehicle's speed, the smoothness of the road surface, and the congestion of the road segment. The driver's emotional attributes can also be determined by a combination of multiple dimensions of characteristics. This application does not make any specific limitations in this regard.

[0143] Optionally, in step S203 above, each audio set is divided according to the frequency of the audio signal corresponding to the audio.

[0144] Specifically, the audio in the audio library is first converted into audio signals, specifically Pulse Code Modulation (PCM) data. Then, a Fast Fourier Transform (FFT) is used to obtain the frequency distribution of the audio signals. By comparing the frequency distributions of different audio tracks, the audio in the audio library is divided into multiple audio sets. For any given audio track, the corresponding audio signal frequency can be the average frequency of the entire audio track or the average frequency of the audio signal corresponding to a specific audio segment. The audio in the audio library is then further divided into multiple audio sets according to the audio signal frequencies.

[0145] For example, first, the songs in the car music library are obtained, then the songs in the car music library are converted into audio signals, the frequency distribution in the audio signals is obtained through fast Fourier transform, and then the average frequency of the audio signals corresponding to the whole song is obtained according to the frequency distribution of the audio signals corresponding to the whole song, and the average frequency of the audio signals corresponding to the whole song is used as the frequency of the audio signals corresponding to the song.

[0146] The songs in the in-vehicle music library are divided into four song sets according to the audio signal frequency, as shown in Table 7. The four song sets are song set 1, song set 2, song set 3, and song set 4. Among them, the audio signal frequency range of song set 1 is 100Hz to 200Hz, the audio signal frequency range of song set 2 is 200Hz to 300Hz, the audio signal frequency range of song set 3 is 300Hz to 400Hz, and the audio signal frequency range of song set 4 is 400Hz to 500Hz.

[0147] Table 7.

[0148] Song Collection Audio signal frequency range Song Collection 1 100Hz~200Hz Song Collection 2 200Hz~300Hz 3 Song Collection 3 300Hz~400Hz Song Collection 4 400Hz~500Hz

[0149] Since the tempo of an audio track is reflected in the frequency of the corresponding audio signal, dividing the audio in the audio library into multiple audio sets based on the frequency of the audio signal can effectively distinguish audio with different rhythms, making it easier to accurately recommend music to drivers later.

[0150] It should be noted that the embodiments of this application are not limited to dividing the audio set according to the frequency of the audio information signal, but can also divide the audio set according to factors such as the type and name of the audio. This application does not make specific limitations in this regard.

[0151] Furthermore, a pre-set audio set is used to adjust each emotional attribute, and the mapping relationship between each emotional attribute and its corresponding audio set is saved. When a driver is in a tense, stressful, or negative emotional state, playing soothing, gentle music can help them react more quickly to problems. Conversely, when a driver is relaxed and in a less stressful, positive emotional state, playing rhythmic music can maintain that positive mood. Therefore, when setting the mapping relationship between emotional attributes and audio sets, a fast-paced audio set (i.e., a set of high-frequency audio signals) can be assigned to positive emotional attributes, and a slow-paced audio set (i.e., a set of low-frequency audio signals) can be assigned to negative emotional attributes. Once the driver's emotional attribute is obtained, the mapping relationship between the emotional attribute and the music set can be queried to obtain the target audio set used to adjust the driver's emotional attribute.

[0152] For example, the mapping relationship between emotion attributes and music sets is shown in Table 8:

[0153] Table 8.

[0154] Emotional attributes Low driving stress Less driving stress Driving is stressful High driving stress Song Collection Song Collection 4 Song Collection 3 Song Collection 2 Song Collection 1

[0155] In Table 8 above, the audio signal frequency range corresponding to song set 1 is 100Hz to 200Hz, the audio signal frequency range corresponding to song set 2 is 200Hz to 300Hz, the audio signal frequency range corresponding to song set 3 is 300Hz to 400Hz, and the audio signal frequency range corresponding to song set 4 is 400Hz to 500Hz.

[0156] If it is determined that the driver W's emotional attribute is high driving stress, by querying the mapping relationship between emotional attributes and music sets shown in Table 8, the target music set for adjusting the driver's emotional attribute can be obtained as song set 2.

[0157] In this embodiment, audio that can adjust the driver's emotional attributes is recommended based on the driver's emotional attributes. This achieves both audio-assisted driving and improved listening experience for the driver.

[0158] Optionally, in step S204 above, the audio files in the target audio set are played sequentially according to their arrangement order. Specifically, the arrangement order of the audio files is determined according to their scores from highest to lowest, and the audio scores can be determined using at least the following methods:

[0159] Implementation Method 1: The audio score is determined based on the degree to which the audio affects the driver's emotional attributes.

[0160] In practice, after playing an audio clip, the driver's emotional attributes are continuously monitored. When the driver's emotional attributes change towards a positive state, it indicates that the audio clip can improve the driver's emotional attributes, so the score of the audio clip is increased. The specific increase in score is determined based on the degree of change in the driver's emotional attributes towards a positive state. When the driver's emotional attributes change towards a negative state, it indicates that the audio clip worsens the driver's emotional attributes, so the score of the audio clip is decreased. The specific decrease in score is determined based on the degree of change in the driver's emotional attributes towards a negative state. When the driver's emotional attributes do not change, the score of the audio clip is not adjusted.

[0161] Implementation Method 2: The audio score can be determined based on the degree of influence of the audio on the driver's physical characteristics.

[0162] In practice, after playing an audio clip, the driver's vital signs are continuously monitored. When the driver's vital signs change towards a relaxed state, it indicates that the audio clip can improve the driver's vital signs, so the score of the audio clip is increased. The specific increase in score is determined based on the degree of change in the driver's vital signs towards a relaxed state. When the driver's vital signs change towards a tense state, it indicates that the audio clip worsens the driver's vital signs, so the score of the audio clip is decreased. The specific decrease in score is determined based on the degree of change in the driver's vital signs towards a tense state. When the driver's vital signs do not change, the score of the audio clip is not adjusted.

[0163] Implementation Method 3: The audio score can be determined based on the degree of influence of the audio on the vehicle's speed.

[0164] In practice, after playing an audio clip, the vehicle's speed is continuously monitored. If the vehicle's current speed is greater than a preset safe speed, and playing the audio clip reduces the speed, it indicates that the audio clip improves the vehicle's speed, so the audio clip's score is increased. The specific increase in score is determined based on the degree to which the vehicle's speed is reduced. If the vehicle's speed increases, it indicates that the audio clip worsens the vehicle's speed, so the audio clip's score is decreased. The specific decrease in score is determined based on the degree to which the vehicle's speed is improved. If the vehicle's speed does not change, the audio clip's score is not adjusted.

[0165] Implementation Method Four: The audio scores are determined based on the driver's preference for the audio. In practice, the number of times or the duration of each audio track is determined from the driver's audio listening records. The more times the driver listens to an audio track or the longer the listening time, the higher the corresponding score; conversely, the fewer times the driver listens to an audio track or the shorter the listening time, the lower the corresponding score.

[0166] It should be noted that the implementation methods for determining the audio score in this application are not limited to the above-mentioned methods, but may also be other implementation methods. For example, any combination of the above-mentioned implementation methods can be used to determine the audio score. This application does not make any specific limitations on this.

[0167] Optionally, when playing audio from the target audio set, the vehicle's speed, road conditions, and driver's vital signs can be re-collected every preset time interval. Then, based on the collected information, the driver's emotional attributes are determined, and a target audio set is obtained to adjust the driver's emotional attributes. If the re-determined target audio set differs from the previously determined one, the audio from the re-determined set is played; otherwise, the audio from the previously determined set continues to play.

[0168] When playing audio from the target audio set, the vehicle's speed, road conditions, and driver's vital signs can be re-collected within a preset duration before each audio clip ends. Based on this information, the driver's emotional attributes are determined, and a target audio set is obtained to adjust those attributes. If the re-determined target audio set differs from the previously determined one, audio from the re-determined set is played; otherwise, audio from the previously determined set continues to play.

[0169] When switching between different audio, if the previous audio has not finished playing, the previous audio is stopped by gradually decreasing the volume, and the next audio is introduced by gradually increasing the volume. This gradual decrease and increase in volume achieves a natural transition when switching audio, thereby improving the driver's listening experience.

[0170] To more clearly describe the technical solutions of the embodiments of this application, the following describes an audio playback control method provided by the embodiments of this application in conjunction with specific implementation scenarios. The system architecture to which this method is applicable is as follows: Figure 3 As shown, the system includes a vehicle 301, a traffic condition server 302, and an application server 303. The vehicle is equipped with an in-vehicle terminal device that runs an in-vehicle music application. The application server 303 is the backend server for the in-vehicle music application. The in-vehicle terminal is connected to the traffic condition server 302 and the application server 303 via a wireless network.

[0171] based on Figure 3 The system architecture shown in this application provides a flowchart of an audio playback control method, as illustrated in the embodiment. Figure 4 As shown, it includes the following steps:

[0172] Step S401: The vehicle terminal device enables the Bluetooth protocol.

[0173] Step S402: Bind the vehicle terminal device to the vehicle-mounted GPS, vehicle-mounted heart rate sensor, and vehicle-mounted bump accumulator.

[0174] When the vehicle starts, the onboard GPS, onboard heart rate sensor, and onboard bump accumulator are activated accordingly. The onboard GPS collects the vehicle's location information and sends it to the onboard terminal device; the onboard heart rate sensor collects the driver's vital signs information and sends it to the onboard terminal device; the onboard bump accumulator sends the count results for a preset time period to the onboard terminal device.

[0175] In step S403, the vehicle terminal device determines whether the vehicle is in motion. If so, step S404 is executed; otherwise, step S413 is executed.

[0176] In step S404, the vehicle-mounted terminal device acquires the vehicle's driving speed, the smoothness of the road surface, and the driver's physical characteristics.

[0177] Specifically, the vehicle-mounted terminal equipment determines the vehicle's speed based on its location information and the duration of the timer. It also determines the smoothness of the road surface based on the counting results of the vehicle-mounted bump accumulator.

[0178] Step S405: The vehicle terminal device obtains the congestion status of the driving route from the traffic condition server.

[0179] In step S406, the vehicle terminal device determines the driver's emotional attributes based on the driver's physical characteristics, vehicle speed, road surface smoothness, and traffic congestion.

[0180] In step S407, the vehicle terminal device sends the driver's emotional attributes to the application server.

[0181] In step S408, the application server obtains the target music set for adjusting the driver's emotional attributes from various music sets.

[0182] Step S409: The application server retrieves the highest-rated target music from the target music set.

[0183] In step S410, the application server sends the target music to the vehicle terminal device.

[0184] Step S411: The vehicle-mounted terminal device plays the target music and executes step S703.

[0185] Step S412, End.

[0186] based on Figure 3 The system architecture shown in this application provides a flowchart of another audio playback control method, as illustrated in this embodiment. Figure 5 As shown, it includes the following steps:

[0187] Step S501: The vehicle terminal device enables the Bluetooth protocol.

[0188] Step S502: Bind the vehicle terminal device to the vehicle-mounted GPS, vehicle-mounted heart rate sensor, and vehicle-mounted bump accumulator.

[0189] In step S503, the vehicle terminal device determines whether the vehicle is in motion. If so, step S404 is executed; otherwise, step S413 is executed.

[0190] In step S504, the vehicle-mounted terminal device acquires the vehicle's driving speed, the smoothness of the road surface, and the driver's physical characteristics.

[0191] Step S505: The vehicle terminal device obtains the congestion status of the driving route from the traffic condition server.

[0192] In step S506, the vehicle terminal device sends the driver's vital signs information, the vehicle's speed, the smoothness of the road surface, and the congestion status of the road segment to the application server.

[0193] In step S507, the application server determines the driver's emotional attributes based on the driver's physical characteristics, vehicle speed, road surface smoothness, and traffic congestion.

[0194] In step S508, the application server obtains the target music set for adjusting the driver's emotional attributes from various music sets.

[0195] Step S509: The application server retrieves the highest-rated target music from the target music set.

[0196] In step S510, the application server sends the target music to the vehicle terminal device.

[0197] Step S511: The vehicle-mounted terminal device plays the target music and executes step S703.

[0198] Step S512, End.

[0199] In this embodiment, the driver's emotional attributes are determined based on the vehicle's speed and road conditions. Then, a corresponding target audio set is obtained from various audio sets to adjust the driver's emotional attributes, thereby enabling audio-assisted driving. This improves both driving safety and the driver's audio listening experience.

[0200] Based on the same technical concept, embodiments of this application provide an audio playback control device, such as... Figure 6 As shown, the device 600 includes:

[0201] The acquisition module 601 is used to acquire the vehicle's speed and road conditions.

[0202] The recognition module 602 is used to determine the driver's emotional attributes based on the driving speed and the road conditions.

[0203] The matching module 603 is used to obtain a target audio set for adjusting the driver's emotional attributes from various audio sets, wherein each audio set is divided according to the attribute information of the audio.

[0204] The playback module 604 is used to play audio from the target audio set.

[0205] Optionally, the identification module 602 is specifically used for:

[0206] Obtain the driver's vital signs information;

[0207] The driver's emotional attributes are determined based on the driver's physical characteristics, driving speed, and road conditions.

[0208] Optionally, the identification module 602 is specifically used for:

[0209] The driver's physical characteristics, driving speed, and road conditions are quantified to obtain the influencing factors corresponding to the driver's physical characteristics, driving speed, and road conditions, respectively.

[0210] The driver's emotional attributes are determined based on the driver's physical characteristics, the driving speed, and the influencing factors corresponding to the road conditions.

[0211] Optionally, the identification module 602 is specifically used for:

[0212] From each range of human physical signs, a target range of human physical signs that matches the driver's physical signs information is obtained, and the influence factor corresponding to the target range of human physical signs is used as the influence factor corresponding to the driver's physical signs information.

[0213] From each speed range, obtain the target speed range that matches the driving speed, and use the influence factor corresponding to the target speed range as the influence factor corresponding to the driving speed;

[0214] From the various road condition levels, obtain the target road condition level that matches the driving road condition, and use the influence factor corresponding to the target road condition level as the influence factor corresponding to the driving road condition.

[0215] Optionally, the acquisition module 601 is specifically used for:

[0216] The vehicle's location information is obtained using a positioning module;

[0217] The vehicle's time information is obtained using a timing module;

[0218] The vehicle's speed is obtained based on its location information and time information.

[0219] Optionally, the driving conditions include the smoothness of the road surface and the congestion of the road segment;

[0220] The acquisition module 601 is specifically used for:

[0221] A road surface smoothness detection module is used to obtain the smoothness status of the driving road surface;

[0222] Obtain the congestion status of the driving section from the traffic server.

[0223] Optionally, the various audio sets are divided according to the frequency of the audio signal corresponding to the audio.

[0224] Optionally, the playback module 604 is specifically used for:

[0225] The audio files in the target audio set are played sequentially according to their arrangement order. The arrangement order of the audio files is determined by the order of their scores from high to low, and the scores of the audio files are determined based on the degree of influence of the audio files on the driver's emotional attributes.

[0226] Optionally, the playback module 604 is further configured to:

[0227] When the vehicle's speed or road conditions meet preset conditions, a safety prompt voice will be played.

[0228] In this embodiment, the driver's emotional attributes are determined based on the vehicle's speed and road conditions. Then, a corresponding target audio set is obtained from various audio sets to adjust the driver's emotional attributes, thereby enabling audio-assisted driving. This improves both driving safety and the driver's audio listening experience.

[0229] Based on the same technical concept, embodiments of this application provide a computer device, such as... Figure 7 As shown, it includes at least one processor 701 and a memory 702 connected to at least one processor. In this embodiment, the specific connection medium between the processor 701 and the memory 702 is not limited. Figure 7 Taking the connection between the processor 701 and the memory 702 via a bus as an example, the bus can be divided into address bus, data bus, control bus, etc.

[0230] In this embodiment of the application, the memory 702 stores instructions that can be executed by at least one processor 701. By executing the instructions stored in the memory 702, at least one processor 701 can perform the steps included in the above-described audio playback control method.

[0231] The processor 701 is the control center of the computer device. It can connect to various parts of the computer device using various interfaces and lines, and performs audio playback control by running or executing instructions stored in the memory 702 and calling data stored in the memory 702. Optionally, the processor 701 may include one or more processing units. The processor 701 may integrate an application processor and a modem processor. The application processor mainly handles the operating system, user interface, and applications, while the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 701. In some embodiments, the processor 701 and the memory 702 may be implemented on the same chip; in some embodiments, they may also be implemented on separate chips.

[0232] The processor 701 can be a general-purpose processor, such as a central processing unit (CPU), digital signal processor, application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), or other programmable logic device, discrete gate or transistor logic device, or discrete hardware component, capable of implementing or executing the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly manifested as being executed by a hardware processor, or executed by a combination of hardware and software modules within the processor.

[0233] Memory 702, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules. Memory 702 may include at least one type of storage medium, such as flash memory, hard disk, multimedia card, card-type memory, random access memory (RAM), static random access memory (SRAM), programmable read-only memory (PROM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), magnetic storage, magnetic disk, optical disk, etc. Memory 702 can be any other medium capable of carrying or storing desired program code in the form of instructions or data structures that can be accessed by a computer, but is not limited thereto. In the embodiments of this application, memory 702 can also be a circuit or any other device capable of implementing storage functions for storing program instructions and / or data.

[0234] Based on the same inventive concept, embodiments of this application provide a computer-readable storage medium storing a computer program executable by a computer device, which, when run on the computer device, causes the computer device to perform the steps of the above-described audio playback control method.

[0235] Those skilled in the art will understand that embodiments of the present invention can be provided as methods or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0236] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0237] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0238] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0239] Although preferred embodiments of the invention have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including both the preferred embodiments and all changes and modifications falling within the scope of the invention.

[0240] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.

Claims

1. A method for controlling audio playback, characterized in that, include: The audio in the audio library is converted into audio signals, and the frequency distribution in each audio signal is obtained through fast Fourier transform. For any audio signal, the average frequency of the audio signal is obtained based on the frequency distribution of the corresponding audio signal; and the average frequency of the audio signal is taken as the audio signal frequency. The audio files in the audio library are divided into multiple audio sets according to the frequency of the audio signal. Set up an audio set for adjusting each emotional attribute, and save the mapping relationship between each emotional attribute and the corresponding audio set; It obtains the vehicle's speed and road conditions, as well as the driver's vital signs. The driving conditions include the smoothness of the road surface and the congestion of the road segment; From each range of human physical signs, a target range of human physical signs that matches the driver's physical signs information is obtained, and the influence factor corresponding to the target range of human physical signs is used as the influence factor corresponding to the driver's physical signs information. From each speed range, obtain the target speed range that matches the driving speed, and use the influence factor corresponding to the target speed range as the influence factor corresponding to the driving speed; when the vehicle's driving speed is greater than the preset safe speed, play an overspeed warning voice message; From each road condition level, obtain the target road condition level that matches the driving road condition, and use the influence factor corresponding to the target road condition level as the influence factor corresponding to the driving road condition; The driver's emotional attributes are determined based on the driver's physical characteristics, the driving speed, and the influencing factors corresponding to the road conditions. From the various audio sets, obtain the target audio set for adjusting the driver's emotional attributes; The audios in the target audio set are played sequentially according to their arrangement order. The arrangement order of the audios is determined by the order of their scores from high to low. The scores of the audios are determined based on the degree of influence of the audios on the driver's emotional attributes. After an audio recording is played, the driver's emotional attributes are continuously monitored. When the driver's emotional attributes change towards positive emotional attributes, the score of the audio is increased according to the degree of change in the driver's emotional attributes towards positive emotional attributes. When the driver's emotional attribute changes towards a negative emotional attribute, the score of the audio is reduced according to the degree of the change in the driver's emotional attribute towards a negative emotional attribute. The audio score is not adjusted when the driver's emotional attributes do not change.

2. The method as described in claim 1, characterized in that, The acquisition of the vehicle's speed includes: The vehicle's location information is obtained using a positioning module; The vehicle's time information is obtained using a timing module; The vehicle's speed is obtained based on its location information and time information.

3. The method as described in claim 2, characterized in that, The acquisition of vehicle road conditions includes: A road surface smoothness detection module is used to obtain the smoothness status of the driving road surface; Obtain the congestion status of the driving section from the traffic server.

4. The method as described in claim 3, characterized in that, Also includes: When the driving conditions meet the preset requirements, a safety prompt voice will be played.

5. An audio playback control device, characterized in that, include: The matching module is used to convert audio in the audio library into audio signals and obtain the frequency distribution of each audio signal through fast Fourier transform; for any audio, the average frequency of the audio signal is obtained according to the frequency distribution of the corresponding audio signal; and the average frequency of the audio signal is used as the audio signal frequency of the audio; the audio in the audio library is divided into multiple audio sets according to the audio signal frequency; Set up an audio set for adjusting each emotional attribute, and save the mapping relationship between each emotional attribute and the corresponding audio set; The acquisition module is used to acquire the vehicle's speed and road conditions, as well as the driver's vital signs. The driving conditions include the smoothness of the road surface and the congestion of the road segment; The identification module is used to obtain the target human physical sign interval that matches the driver's human physical sign information from various human physical sign intervals, and use the influence factor corresponding to the target human physical sign interval as the influence factor corresponding to the driver's human physical sign information. From each speed range, obtain the target speed range that matches the driving speed, and use the influence factor corresponding to the target speed range as the influence factor corresponding to the driving speed; when the vehicle's driving speed is greater than the preset safe speed, play an overspeed warning voice message; From each road condition level, obtain the target road condition level that matches the driving road condition, and use the influence factor corresponding to the target road condition level as the influence factor corresponding to the driving road condition; The driver's emotional attributes are determined based on the driver's physical characteristics, the driving speed, and the influencing factors corresponding to the road conditions. The matching module is also used to obtain a target audio set for adjusting the driver's emotional attributes from various audio sets, wherein each audio set is divided according to the attribute information of the audio. The playback module is used to play the audios in the target audio set sequentially according to the arrangement order of each audio in the target audio set. The arrangement order of each audio is determined according to the order of the scores of each audio from high to low. The scores of each audio are determined according to the degree of influence of the audio on the driver's emotional attributes. After an audio recording is played, the driver's emotional attributes are continuously monitored. When the driver's emotional attributes change towards positive emotional attributes, the score of the audio is increased according to the degree of change in the driver's emotional attributes towards positive emotional attributes. When the driver's emotional attribute changes towards a negative emotional attribute, the score of the audio is reduced according to the degree of the change in the driver's emotional attribute towards a negative emotional attribute. The audio score is not adjusted when the driver's emotional attributes do not change.

6. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the steps of the method according to any one of claims 1 to 4.

7. A computer-readable storage medium, characterized in that, It stores a computer program executable by a computer device, which, when run on the computer device, causes the computer device to perform the steps of the method according to any one of claims 1 to 4.

Citation Information

Patent Citations

  • Vehicle-mounted intelligent music player and music playing method thereof

    CN104409085A

  • Vehicle owner emotion recognition and adjustment method, storage medium and vehicle-mounted system

    CN109190459A

  • Driving-data-based multimedia playing control method, storage medium and terminal

    CN109785861A