Sound automatic adjustment method, device, equipment and storage medium

Abstract

Embodiments of the present application relate to the technical field of sound adjustment, and disclose a sound automatic adjustment method, device, equipment and storage medium, the method comprising: collecting a current physiological index of a user in real time; confirming target sound attribute data corresponding to the current physiological index based on a correspondence between pre-stored physiological index and sound attribute data; and adjusting parameters of a sound playing device worn by the user according to the target sound attribute data. Embodiments of the present application collect a current physiological index of a user in real time when sound is played, and adjust parameters of a sound playing device according to the current physiological index, so that the sound played by the sound playing device is most suitable for the user, and the auditory experience of the user is improved.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of sound adjustment, and in particular to a sound automatic adjustment method, device, equipment and storage medium. BACKGROUND

[0002] Currently, the on-site sound effects of movie theaters, concerts and the like are all adopted by professional equipment, and the surround sound effects are a good entertainment choice for many young people in their leisure time. However, at the same time, such special sound effects, although very exciting, very powerful, very stress-relieving and very live in the perception of young people, are not friendly to young children and the elderly. First, the sensory experience of the elderly cannot withstand the special sound effects that are too passionate, and second, the hearing system of children will be worried about being damaged, so almost no young or elderly consumers are seen in these places. And for young consumers, the two or three hours of movies and concerts will also cause physiological discomfort such as auditory fatigue during the viewing process, resulting in a decrease in viewing experience. SUMMARY

[0003] In view of the above problems, embodiments of the present application provide a sound automatic adjustment method, device, equipment and storage medium, which are used to solve the problem that the existing sound playing equipment cannot adapt to the needs of users of different ages.

[0004] According to an aspect of an embodiment of the present application, a sound automatic adjustment method is provided, which includes: collecting a current physiological index of a user in real time; confirming target sound attribute data corresponding to the current physiological index based on a pre-stored corresponding relationship between physiological indexes and sound attribute data; and adjusting parameters of a sound playing equipment worn by the user according to the target sound attribute data.

[0005] In an optional manner, the method further includes: confirming emotional information contained in sound content currently played by the sound playing equipment; obtaining a predicted mental state of the user according to a prediction based on the emotional information; judging the mental state of the user based on a preset emotional algorithm in combination with the current physiological index to confirm an actual mental state of the user; comparing the predicted mental state and the actual mental state, and adjusting the parameters of the sound playing equipment according to a comparison result.

[0006] In an optional manner, the comparison of the predicted mental state and the actual mental state and the adjustment of the parameters of the sound playing device according to the comparison result comprises: confirming a first emotion category set corresponding to the predicted mental state and a second emotion category set corresponding to the actual mental state based on the preset emotion level and emotion direction; judging whether the first emotion category set and the second emotion category set are the same; if yes, confirming that the user appears valid positive co-emotion, maintaining the current parameters of the sound playing device; if not, confirming that the user appears invalid or negative co-emotion, and adjusting the parameters of the sound playing device to reduce the emotional influence and emotional duration of the invalid or negative co-emotion.

[0007] In an optional manner, the adjustment of the parameters of the sound playing device to reduce the emotional influence and emotional duration of the invalid or negative co-emotion comprises: obtaining an initial physiological indicator of the user collected in advance; confirming an initial mental state of the user according to the initial physiological indicator and the preset emotion algorithm, and confirming a third emotion category set corresponding to the initial mental state based on the preset emotion level and emotion direction; confirming a difference emotion category set composed of different emotion categories between the first emotion category set and the second emotion category set; removing the emotion categories appearing in the third emotion category set from the difference emotion category set, and taking the remaining emotion categories as target emotion categories of invalid or negative co-emotion; adjusting the parameters of the sound playing device to reduce the emotional influence and emotional duration of the target emotion categories to below the corresponding preset emotion threshold.

[0008] In an optional manner, before the real-time collection of the current physiological indicator of the user, the method further comprises: collecting an initial physiological indicator of the user; confirming an initial mental state of the user according to the initial physiological indicator and the preset emotion algorithm; confirming a fourth emotion category set corresponding to the initial mental state based on the preset emotion level and emotion direction; and prompting the user to adjust his / her emotion when the emotional influence of an emotion category in the fourth emotion category set exceeds a preset perception threshold.

[0009] In an optional manner, the method further comprises: obtaining a heart rate variation trend and a breathing frequency data variation trend of the user according to the current physiological indicator of the user; and adjusting the parameters of the sound playing device to increase the emotional influence of the sound on the user when the user enters a fatigue state according to the heart rate variation trend and the breathing frequency data variation trend.

[0010] In an optional manner, the method further comprises: receiving a sound adjustment request input by the user; and adjusting the parameters of the sound playing device according to the sound adjustment request.

[0011] According to another aspect of the embodiments of the present application, provided is a sound automatic adjustment device, which comprises: a collection module, configured to collect a current physiological index of a user in real time; a confirmation module, configured to confirm target sound attribute data corresponding to the current physiological index based on a pre-stored correspondence between physiological indexes and sound attribute data; and an adjustment module, configured to adjust parameters of a sound playing device worn by the user according to the target sound attribute data.

[0012] According to another aspect of the embodiments of the present application, provided is a sound automatic adjustment device, which comprises: a processor, a memory, a communication interface and a communication bus, the processor, the memory and the communication interface complete communication with each other through the communication bus; the memory is configured to store at least one executable instruction, and the executable instruction causes the processor to perform operations of the sound automatic adjustment method according to any one of the above.

[0013] According to another aspect of the embodiments of the present application, provided is a sound automatic adjustment device, which comprises: a processor, a memory, a communication interface and a communication bus, the processor, the memory and the communication interface complete communication with each other through the communication bus; the memory is configured to store at least one executable instruction, and the executable instruction causes the processor to perform operations of the sound automatic adjustment method according to any one of the above.

[0014] The embodiments of the present application can obtain a current physiological index of a user in real time, query sound attribute data most suitable for the user according to the current physiological index of the user, and adjust parameters of a sound playing device of the user according to the sound attribute data, so that users of different ages can enjoy auditory experiences corresponding to their physiological indexes, personalized auditory settings are realized for users with different physiological indexes, and user experience is improved.

[0015] The above description is only a summary of the technical solutions of the embodiments of the present application, in order to more clearly understand the technical means of the embodiments of the present application, the embodiments of the present application can be implemented according to the content of the description, and in order to make the above and other purposes, characteristics and advantages of the embodiments of the present application more obvious and easy to understand, the specific embodiments of the present application are described below. BRIEF DESCRIPTION OF DRAWINGS

[0016] The accompanying drawings are included to provide a further understanding of the embodiments of the present application, and are not considered as limitations of the present application. Moreover, the same reference numerals are used to represent the same components throughout the accompanying drawings. In the drawings:

[0017] Figure 1 A flowchart of a sound automatic adjustment method provided by a first embodiment of the present application is shown;

[0018] Figure 2 A flowchart of a sound automatic adjustment method provided by a second embodiment of the present application is shown;

[0019] Figure 3A structural schematic diagram of the sound automatic adjustment device provided by the embodiment of the present application is shown.

[0020] Figure 4 A structural schematic diagram of the sound automatic adjustment device provided by the embodiment of the present application is shown. DETAILED DESCRIPTION

[0021] Exemplary embodiments of the present application will be described in detail with reference to the drawings. Although exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments set forth herein.

[0022] Figure 1 A flow chart of the first embodiment of the sound automatic adjustment method of the present application is shown, which is executed by the sound automatic adjustment device. As shown in the figure, the method comprises the following steps: Figure 1

[0023] Step 101: Real-time collection of the current physiological index of the user.

[0024] It should be noted that the sound automatic adjustment method of the present application can be applied to various different scenarios, for example, movie theaters, concert venues, music halls and the like, and secondly, it can also be applied to music playing devices such as earphones, home audio, car audio and the like.

[0025] In this embodiment, in order to be suitable for users of different ages, the physiological index information of the user needs to be collected to facilitate adjustment of the parameters of the sound playing device according to the physiological index of the user, wherein the physiological index is obtained by a pre-set physiological index collector. For example, when the user wears the earphone device, the physiological index collector can be set on the earphone, and when the user wears the earphone, the physiological index of the user can be collected by the physiological index collector.

[0026] In step 101, in order to effectively adjust the sound heard by the user, the current physiological index of the user needs to be collected in real time, and the sound heard by the user is adjusted in real time according to the real-time collected index data.

[0027] Step 102: Confirmation of the target sound attribute data corresponding to the current physiological index based on the pre-stored corresponding relationship between the physiological index and the sound attribute data.

[0028] It should be noted that the corresponding relationship between the physiological index and the sound attribute data in this embodiment is set by pre-acquired historical sample data. The corresponding relationship between the physiological index and the sound attribute data can be pre-stored in the memory of the sound playing device worn by the user.

[0029] ​In step 102, after obtaining the current physiological index of the user, the target sound attribute data corresponding to the current physiological index can be confirmed by querying the corresponding relationship between the physiological index and the sound attribute data, and the target sound attribute data is the sound attribute data most suitable for the user under the current physiological index.

[0030] Step 103: adjusting the parameters of the sound playing device worn by the user according to the target sound attribute data.

[0031] Generally, the user's comfortable sound effect is measured from the user's psychological perception to the loudness, tone and timbre three attribute indexes, and the adjustment of the sound usually includes the adjustment of the sound, audio and sound wave.

[0032] In step 103, after obtaining the target sound attribute data, the sound playing parameters of the sound playing device worn by the user can be adjusted according to the target sound attribute data, and the sound playing parameters of the sound playing device worn by the user can be adjusted according to the target sound attribute data, so as to adjust the sound, audio and sound wave three parameters, so as to make the user hear the sound with better hearing experience.

[0033] The first embodiment of the application can make users of different ages enjoy the hearing experience corresponding to their physiological indexes by acquiring the current physiological index of the user in real time, querying the sound attribute data most suitable for the user according to the current physiological index of the user, and adjusting the parameters of the sound playing device of the user according to the sound attribute data, thereby realizing the personalized hearing setting for users with different physiological indexes and improving the user experience.

[0034] Figure 2 The flow chart of the second embodiment of the sound automatic adjustment method of the application is shown, and the method is executed by a sound automatic adjustment device. Figure 2 As shown in the figure, the method comprises the following steps:

[0035] Step 201: confirming the emotional information contained in the sound content currently played by the sound playing device.

[0036] It should be understood that effective emotional resonance can greatly improve the user experience, for example, when watching a movie, the user's emotions can be aroused by the emotions contained in the sound, so as to resonate with the emotions in the movie, which can greatly improve the user's viewing experience. Therefore, in order to improve the user's hearing experience, the emotions contained in the sound content played by the sound playing device can be resonated with the user's voice to improve the user experience. It should be noted that the sound content refers to the text content, not the sound information, and the emotional information contained in the sound content can be obtained by analyzing the sound content.

[0037] In step 201, when the sound playing device plays the sound, the emotional information contained therein is calculated according to the content of the played sound. The emotional information is the emotion that the expected user can experience carried in the played sound.

[0038] Step 202: According to the emotional information, the predicted mental state of the user is obtained.

[0039] In step S202, the emotional information is used to predict the mental state that the user should have, for example, when the emotional information in the sound is happiness, it is predicted that the reaction of the mental state of the user should be excited, happy, happy, etc.

[0040] Step 203: Based on the preset emotional algorithm, the mental state of the user is judged in combination with the current physiological index, and the actual mental state of the user is confirmed.

[0041] It should be noted that the preset emotional algorithm is preset. At present, the theory of "emotional computing" has been widely studied, and the relationship mapping between the mental state and the physiological index can be realized by various different algorithms, such as particle swarm algorithm, K nearest neighbor algorithm, discriminant function analysis method, Marquardt back propagation and support vector machine algorithm. In this embodiment, the preset emotional algorithm can be realized based on any one of the above algorithms.

[0042] In step 203, after obtaining the predicted mental state of the user, the current physiological index of the user is collected, and the actual mental state of the user is calculated by combining the preset emotional algorithm.

[0043] Step 204: Compare the predicted mental state and the actual mental state, and adjust the parameters of the sound playing device according to the comparison result.

[0044] In step 204, the predicted mental state is the mental state of the user after hearing the currently played sound, and by comparing the predicted mental state with the current actual mental state of the user, it can be confirmed whether the user has the corresponding emotion after hearing the sound played by the sound playing device. When the user does not have the corresponding emotion, it means that the emotion of the user has not been well mobilized, and has not resonated with the sound content. At this time, the parameters of the sound playing device can be adjusted to improve the infectivity of the played sound to the user's emotion.

[0045] In this embodiment, in order to improve the user's experience, the resonance of the user's emotion and the emotion of the sound content also needs to be considered. The adjustment of the parameters of the sound playing device through the physiological indicators has good user experience in some scenarios, such as operators and student learning scenarios, but this kind of adjustment cannot effectively adjust the emotion in a diversified manner, and cannot further improve the user's experience. Effective emotional resonance depends on the ability to recognize emotions from auditory stimuli and respond appropriately. Research has found that emotional information conveyed by sound is involved in brain regions, but some acoustic characteristics of sounds expressing certain emotions can vary significantly with changes in the sound produced, regardless of the sound source. These brain regions respond in the same way to different emotions in specific situations. Analysis by physiological indicator sensors shows that the activity patterns of the primary and secondary auditory cortices, the posterior insula, and the caput superior can predict the emotional information of different sound content sounds. In addition, experiments have shown that the classification accuracy within the anterior insula is related to behavioral measures of empathy. These brain regions have emotion-specific patterns that are common in sounds with different acoustic characteristics. Similarly, people with higher empathy have more unique neural patterns related to perceiving emotions, which expands previous knowledge about how the human brain extracts emotional meaning from auditory stimuli and enables us to effectively understand and connect with others. Similarly, for each individual, their empathy and emotional experience are different, and it is necessary to effectively adjust their excessive generalized emotions without disrupting their normal empathetic emotions to empathize with the sound content. This is a problem that needs to be solved in this embodiment. Therefore, on this basis, this embodiment combines the data of the user's primary and secondary auditory cortices, the posterior insula, and the caput superior to determine the user's emotion. The data of the user's primary and secondary auditory cortices, the posterior insula, and the caput superior can be obtained using physiological indicator sensors. After obtaining the user's emotion, it is compared with the predicted emotion obtained from the sound content, and the parameters of the sound playing device are modified according to the comparison result to improve the possibility of the user empathizing with the sound content.

[0046] Further, step 204 specifically includes:

[0047] 1. Confirming the first emotion category set corresponding to the predicted mental state and the second emotion category set corresponding to the actual mental state based on the pre-set emotion level and emotion direction.

[0048] For the convenience of understanding, the emotional information can be divided into at least two emotion levels, wherein the first-level emotion is defined as a basic emotion or a direct emotion, such as happiness, sadness, fear and the like, and the second-level emotion is defined as an indirect emotion, such as surprise, shock, lament, depression, tension, restlessness and the like. The emotion level is intended to distinguish the influence of the emotion, and the influence of the first-level emotion is greater than that of the second-level emotion. The emotion bearing capacity of different users is pre-set to an average level. Further, the emotion bearing capacity obtained by the pre-training of multiple samples can be different for different people, and when the emotion influence exceeds the emotion bearing capacity, the sound property adjustment operation can be triggered. The emotion direction includes positive emotion, neutral emotion and negative emotion. The emotion direction is intended to distinguish the sustainable time of the emotion, that is, the time allowed for the emotion of the user in different directions, and the neutral emotion is longer than the positive emotion, and the positive emotion is longer than the negative emotion. As above, the emotion bearing time of different users is pre-set to an average level, and the emotion bearing time obtained by the pre-training of multiple samples can also be different for different people. When the actual emotion duration exceeds the emotion bearing time, the sound property adjustment operation can be triggered. When the emotion level and the emotion direction are combined, six emotion categories are obtained, including first-level positive emotion, first-level negative emotion, first-level neutral emotion, second-level positive emotion, second-level negative emotion and second-level neutral emotion.

[0049] Specifically, after obtaining the predicted mental state and the actual mental state, the predicted mental state and the actual mental state are confirmed, so as to obtain a first emotion category set corresponding to the predicted mental state and a second emotion category set corresponding to the actual mental state. It should be understood that the first emotion category set and the second emotion category set each contain at least one emotion category.

[0050] 2. Determine whether the first emotion category set and the second emotion category set are the same.

[0051] Specifically, after obtaining the first emotion category set and the second emotion category set, the emotion categories in the first emotion category set and the second emotion category set are compared one by one, so as to confirm whether they are the same.

[0052] 3. If yes, it is confirmed that the user has valid positive co-emotion, and the current parameters of the sound playing device are maintained.

[0053] Specifically, when the first emotion category set and the second emotion category set are exactly the same, it means that the user has generated valid positive co-emotion with the sound content at this time, and there is no need to adjust the sound. Therefore, the current parameters of the sound playing device are maintained without adjustment.

[0054] 4. If no, it is confirmed that the user has invalid or negative co-emotion, and the parameters of the sound playing device are adjusted to reduce the emotion influence and emotion duration of the invalid or negative co-emotion.

[0055] Specifically, when the first emotion category set and the second emotion category set are not the same or only partially the same, it indicates that at this time the user has invalid or negative co-emotion with the sound content, at this time the parameters of the sound playing device need to be adjusted, so that after the user hears the sound, the brain of the user forms a positive stimulus, so as to reduce the emotional influence and emotional duration of invalid or negative co-emotion, so that the user can gradually produce positive co-emotion and improve the user's experience.

[0056] Further, in some embodiments, when the user has a certain emotional state before using the sound playing device to play sound, it will affect the adjustment of the user's emotion, therefore, the step of confirming that the user has invalid or negative co-emotion and adjusting the parameters of the sound playing device to reduce the emotional influence and emotional duration of invalid or negative co-emotion specifically includes:

[0057] 4.1, obtaining the initial physiological indicators of the user collected in advance.

[0058] Specifically, when the user starts to use the sound playing device, the initial physiological indicators of the user are collected.

[0059] 4.2, confirming the initial mental state of the user according to the initial physiological indicators and the preset emotion algorithm, and confirming the third emotion category set corresponding to the initial mental state based on the preset emotion level and emotion direction.

[0060] Specifically, after obtaining the initial physiological indicators, the initial mental state of the user can be confirmed by using the preset emotion algorithm, and the third emotion category set corresponding thereto can be confirmed in combination with the preset emotion level and emotion direction.

[0061] 4.3, confirming the difference emotion category set composed of different emotion categories between the first emotion category set and the second emotion category set.

[0062] Specifically, by comparing the first emotion category set and the second emotion category set, the difference emotion category set composed of different emotion categories between the two sets is obtained, for example, the first emotion category set includes: first-level positive emotion, second-level positive emotion, and the second emotion category set includes: first-level neutral emotion, second-level neutral emotion, and second-level positive emotion, then the difference emotion category set includes: first-level positive emotion, first-level neutral emotion, and second-level neutral emotion.

[0063] 4.4, eliminating the emotion categories in the third emotion category set from the difference emotion category set, and taking the remaining emotion categories as the target emotion categories of invalid or negative co-emotion.

[0064] Specifically, after obtaining the distinguished emotion category set, the distinguished emotion category set is compared with the third emotion category set, and the emotion categories in the distinguished emotion category set that appear in the third emotion category set are removed, and the remaining emotion categories are the target emotion categories of the user in the sound playing process that are invalid or negative empathy.

[0065] 4.5, adjusting the parameters of the sound playing device to reduce the emotional influence and emotional duration of the target emotion category to below the corresponding preset emotion threshold.

[0066] It should be noted that the preset emotion threshold includes a preset influence threshold and a preset duration threshold. The purpose of adjusting the parameters of the sound playing device is to make the emotional influence of the target emotion category below the preset influence threshold and the emotional duration below the preset duration threshold.

[0067] Specifically, the parameters of the sound playing device are adjusted for the obtained target emotion category, so that the emotional influence and emotional duration of the target emotion category are reduced to below the corresponding preset emotion threshold, and the influence of this kind of emotion category on the user's emotion is reduced.

[0068] The second embodiment of the present application is based on the first embodiment, and the predicted mental state of the user is predicted through emotional information in the sound content, and is compared with the actual mental state obtained according to the physiological indicators of the user. When the two are different, the parameters of the sound playing device are adjusted, so that the sound played after adjustment can more greatly drive the user's emotion, so that the user's emotional experience is more intense, and the user's auditory experience is further improved.

[0069] Further, on the basis of the first embodiment, in other embodiments, in order to avoid the initial emotional state of the user causing too much emotional influence on the user, before step 101, the method further comprises:

[0070] 1, collecting the initial physiological indicators of the user.

[0071] 2, confirming the initial mental state of the user according to the initial physiological indicators and a preset emotion algorithm.

[0072] 3, confirming a fourth emotion category set corresponding to the initial mental state based on a preset emotion level and an emotion direction.

[0073] 4, when the emotional influence of the emotion categories in the fourth emotion category set exceeds a preset perception threshold, prompting the user to adjust his / her emotion.

[0074] The embodiment confirms the initial emotion of the user according to the initial physiological index of the user before the user uses the sound playing device to play sound, and prompts the user to adjust the emotion of the user when the initial emotion of the user is too intense, so that the user can quickly form empathy with the sound content subsequently.

[0075] Further, on the basis of the first embodiment, in other embodiments, in order to avoid user auditory fatigue and reduce the use experience, the embodiment further comprises:

[0076] 1. Obtain the heart rate variation trend and the breathing frequency data variation trend of the user according to the current physiological index of the user.

[0077] 2. When the user enters a fatigue state according to the heart rate variation trend and the breathing frequency data variation trend, adjust the parameters of the sound playing device to improve the emotional influence of sound on the user.

[0078] Specifically, after obtaining the current physiological index of the user, the heart rate variation trend and the breathing frequency data variation trend of the user are extracted therefrom. When the heart rate variation trend and the breathing frequency data variation trend are both in a stable state, it indicates that the user has less feedback to the sound played by the current sound player, and the user may enter a fatigue state. At this time, the parameters of the sound playing device can be adjusted to improve the emotional influence of sound on the user, so that the user experience is better. The embodiment confirms the heart rate variation trend and the breathing frequency data variation trend of the user according to the physiological index of the user collected in real time, and confirms whether the user enters a fatigue state according to the heart rate variation trend and the breathing frequency data variation trend. If yes, the parameters of the sound playing device are adjusted, and the emotion of the user is mobilized, so that the user can continuously maintain a high-quality auditory experience.

[0079] Further, on the basis of the first embodiment, in other embodiments, in order to further improve the user experience, the embodiment further comprises:

[0080] 1. Receive the sound adjustment request input by the user;

[0081] 2. Adjust the parameters of the sound playing device according to the sound adjustment request.

[0082] The embodiment adjusts the parameters of the sound playing device according to the individualized demand proposed by the user, so as to adapt to the individualized pursuit of the user, and further improve the user experience.

[0083] Figure 3 The structure schematic diagram of the sound automatic adjustment device embodiment of the application is shown. As shown in the figure, Figure 3 the device 300 comprises an acquisition module 301, a confirmation module 302 and an adjustment module 303.

[0084] The collection module 301 is configured to collect a current physiological index of a user in real time.

[0085] The confirmation module 302 is configured to confirm target sound attribute data corresponding to the current physiological index based on a correspondence between the physiological index and the sound attribute data.

[0086] The adjustment module 303 is configured to adjust a parameter of a sound playing device worn by the user according to the target sound attribute data.

[0087] In an optional manner, the adjustment module 303 is further configured to: confirm emotional information contained in sound content currently played by the sound playing device; obtain a predicted mental state of the user according to a prediction based on the emotional information; judge an actual mental state of the user based on a preset emotional algorithm in combination with the current physiological index, and confirm the actual mental state of the user; compare the predicted mental state with the actual mental state, and adjust the parameter of the sound playing device according to a comparison result.

[0088] In an optional manner, the adjustment module 303 performs the operation of comparing the predicted mental state with the actual mental state and adjusting the parameter of the sound playing device according to a comparison result, and the operation specifically includes: confirming a first emotional category set corresponding to the predicted mental state and a second emotional category set corresponding to the actual mental state based on a preset emotional level and an emotional direction; judging whether the first emotional category set and the second emotional category set are the same; if yes, confirming that the user has valid positive co-emotion, and maintaining the current parameter of the sound playing device; and if no, confirming that the user has invalid or negative co-emotion, and adjusting the parameter of the sound playing device to reduce emotional influence and emotional duration of the invalid or negative co-emotion.

[0089] In an optional manner, the adjustment module 303 performs the operation of adjusting the parameter of the sound playing device to reduce the emotional influence and the emotional duration of the invalid or negative co-emotion, and the operation specifically includes: obtaining an initial physiological index of the user collected in advance; confirming an initial mental state of the user according to the initial physiological index and the preset emotional algorithm, and confirming a third emotional category set corresponding to the initial mental state; confirming a difference emotional category set composed of different emotional categories between the first emotional category set and the second emotional category set; removing emotional categories appearing in the third emotional category set from the difference emotional category set, and taking remaining emotional categories as target emotional categories of the invalid or negative co-emotion; and adjusting the parameter of the sound playing device to reduce the emotional influence and the emotional duration of the target emotional categories to below corresponding preset emotional thresholds.

[0090] In an optional mode, before the operation of collecting the current physiological index of the user by the collecting module 301, the method further includes: collecting an initial physiological index of the user; confirming an initial mental state of the user according to the initial physiological index and a preset emotion algorithm; confirming a fourth emotion category set corresponding to the initial mental state based on a preset emotion level and emotion direction; and prompting the user to adjust his / her emotion when an emotion influence of an emotion category in the fourth emotion category set exceeds a preset perception threshold.

[0091] In an optional mode, the adjusting module 303 is further configured to: acquire a heart rate variation trend and a breathing frequency data variation trend of the user according to the current physiological index of the user; and adjust the parameter of the sound playing device to increase the emotion influence of the sound on the user when the user enters a fatigue state according to the heart rate variation trend and the breathing frequency data variation trend.

[0092] In an optional mode, the adjusting module 303 is further configured to: receive a sound adjustment request input by the user; and adjust the parameter of the sound playing device according to the sound adjustment request.

[0093] Figure 4 The structure of the sound automatic adjustment device is shown in the structural schematic diagram of the embodiment of the sound automatic adjustment device, and the embodiment of the present application does not limit the specific implementation of the sound automatic adjustment device.

[0094] As shown in Figure 4 The sound automatic adjustment device can include a processor 402, a communications interface 404, a memory 406, and a communications bus 408.

[0095] The processor 402, the communications interface 404, and the memory 406 can communicate with each other through the communications bus 408. The communications interface 404 is configured to communicate with network elements such as clients or other servers. The processor 402 is configured to execute the program 410, and specifically can execute the related steps in the above-mentioned sound automatic adjustment method embodiment.

[0096] Specifically, the program 410 can include program code including computer executable instructions.

[0097] The processor 402 can be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to perform the embodiments of the present application. The sound automatic adjustment device includes one or more processors, which can be the same type of processor, such as one or more CPUs; or can be different types of processors, such as one or more CPUs and one or more ASICs.

[0098] The memory 406 is used to store programs 410. The memory 406 can include a high-speed RAM memory, and can also include a non-volatile memory, such as at least one disk memory.

[0099] The programs 410 can be specifically called by the processor 402 to make the sound automatic adjustment device perform the following operations:

[0100] Real-time acquisition of the current physiological indicators of the user;

[0101] Based on the pre-stored corresponding relationship between the physiological indicators and the sound attribute data, the target sound attribute data corresponding to the current physiological indicators is confirmed;

[0102] Adjusting the parameters of the sound playing device worn by the user according to the target sound attribute data.

[0103] The embodiments of the present application can obtain the current physiological indicators of the user in real time, query the sound attribute data most suitable for the user according to the current physiological indicators of the user, and then adjust the parameters of the sound playing device of the user according to the sound attribute data, so that users of different ages can enjoy the auditory experience corresponding to their own physiological indicators, and the individualized auditory setting for users with different physiological indicators is realized, and the user experience is improved.

[0104] The embodiments of the present application provide a computer readable storage medium, which stores at least one executable instruction, and the executable instruction makes the sound automatic adjustment device / device perform the sound automatic adjustment method in any method embodiment described above when running on the sound automatic adjustment device / device.

[0105] The executable instruction can be specifically used to make the sound automatic adjustment device / device perform the following operations:

[0106] Real-time acquisition of the current physiological indicators of the user;

[0107] Based on the pre-stored corresponding relationship between the physiological indicators and the sound attribute data, the target sound attribute data corresponding to the current physiological indicators is confirmed;

[0108] Adjust a parameter of a sound playing device worn by the user according to the target sound property data.

[0109] The embodiment of the present application can make different age groups of users enjoy the hearing experience corresponding to their physiological indicators by acquiring the current physiological indicators of the user in real time, querying the sound property data most suitable for the user according to the current physiological indicators of the user, and adjusting the parameter of the sound playing device of the user according to the sound property data, thereby realizing the personalized hearing setting for users with different physiological indicators and improving the user experience.

[0110] The algorithms and displays presented herein are not inherently related to any particular computer, virtual system, or other apparatus. Various general purpose systems can be used with these teachings, or with modifications thereto. In accordance with the foregoing description, various aspects of the present application are implemented in hardware and / or software, including but not limited to the best mode. Those skilled in the art will recognize that the exemplary embodiments of the present application as described herein can be implemented in a suitably programmed general purpose computer, virtual system, or microprocessor, or in software and / or firmware applications.

[0111] In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the application can be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been described in detail in order to not obscure the understanding of this description.

[0112] Similarly, it is to be understood that the embodiments of the present application can be used in other ways, and that the application can have other embodiments, without departing from the scope of the present application. For example, the present application can be used in a variety of other applications, including but not limited to the applications described above. Similarly, it is to be understood that, in order to simplify the present application and to help understand one or more of the inventive aspects, various features of the embodiments of the present application are sometimes grouped together in a single embodiment, figure, or description of related features. However, the disclosed approach should not be interpreted as reflecting an intention that the claimed application requires more features than are explicitly recited in each claim. Rather, inventive aspects lie in less than all features of a single disclosed embodiment. Thus, the claims following, which reflect the inventive aspects, are hereby expressly incorporated into this detailed description, with each claim acting as a separate embodiment of this application. Accordingly, the claims are seen to cover all supported combinations of features recited in the claims.

[0113] Those skilled in the art will appreciate that the modules in the apparatuses in the embodiments can be adapted and placed in one or more apparatuses other than the embodiments. The modules or units or components in the embodiments can be combined into one module or unit or component, and further can be divided into more sub-modules or sub-units or sub-components. Any combination of all the features disclosed in the present specification (including the accompanying claims, abstract and drawings), and any method or apparatus of any combination of the features disclosed in the present specification (including the accompanying claims, abstract and drawings) can be taken, except that at least some of such features and / or processes or units are mutually exclusive. Unless explicitly stated otherwise, each feature disclosed in the present specification (including the accompanying claims, abstract and drawings) can be replaced by alternative features providing the same, equivalent or similar functionality.

[0114] Further, those skilled in the art will appreciate that a combination of features of different embodiments means that such combination is within the scope of the application and forms a different embodiment. For example, in the following claims, any of the claimed embodiments can be used in any combination.

[0115] It should be noted that the above-mentioned embodiments illustrate rather than limit the application, and that one skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word 'comprising' does not exclude the presence of elements or steps other than those listed in a claim. The word 'a' or 'an' preceding an element does not exclude the presence of a plurality of such elements. The application can be implemented by means of both hardware and software, and any combination thereof. In a unit claim, several devices can be listed, comprising means for performing a certain function. The means performed by one device can also be performed by one and the same device, if the function permits. The use of the word at the beginning of the claim does not exclude the presence of a plurality of such elements. The application can be implemented by means of both hardware and software, and any combination thereof. In a unit claim, several devices can be listed, comprising means for performing a certain function. The means performed by one device can also be performed by one and the same device, if the function permits. The use of the word at the beginning of the claim does not exclude the presence of a plurality of such elements. The application can be implemented by means of both hardware and software, and any combination thereof. In a unit claim, several devices can be listed, comprising means for performing a certain function. The means performed by one device can also be performed by one and the same device, if the function permits. The use of the word at the beginning of the claim does not exclude the presence of a plurality of such elements. The application can be implemented by means of both hardware and software, and any combination thereof. In a unit claim, several devices can be listed, comprising means for performing a certain function. The means performed by one device can also be performed by one and the same device, if the function permits. The use of the word at the beginning of the claim does not exclude the presence of a plurality of such elements. The application can be implemented by means of both hardware and software, and any combination thereof. In a unit claim, several devices can be listed, comprising means for performing a certain function. The means performed by one device can also be performed by one and the same device, if the function permits. The use of the word at the beginning of the claim does not exclude the presence of a plurality of such elements.

Claims

1. A method of automatic sound adjustment, characterized in that, The method comprises: real-time acquisition of current physiological indicators of a user; confirming emotional information contained in current sound content played by a sound playing device, wherein the sound content is text content; predicting a predicted mental state of the user according to the emotional information; judging the mental state of the user based on preset emotional algorithms and the current physiological indicators to confirm an actual mental state of the user; confirming a first emotional category set corresponding to the predicted mental state and a second emotional category set corresponding to the actual mental state based on preset emotional levels and emotional directions; judging whether the first emotional category set and the second emotional category set are the same; if yes, confirming that the user has valid positive co-emotion, and maintaining current parameters of the sound playing device; if no, confirming that the user has invalid or negative co-emotion, and adjusting parameters of the sound playing device to reduce emotional influence and emotional duration of invalid or negative co-emotion.

2. The method of automatically adjusting sound of claim 1, wherein, The adjustment of the parameters of the sound playing device to reduce the emotional influence and the emotional duration of invalid or negative co-emotion comprises: acquiring initial physiological indicators of the user collected in advance; confirming an initial mental state of the user according to the initial physiological indicators and the preset emotional algorithms, and confirming a third emotional category set corresponding to the initial mental state based on preset emotional levels and emotional directions; confirming a difference emotional category set composed of different emotional categories between the first emotional category set and the second emotional category set; eliminating emotional categories appearing in the third emotional category set from the difference emotional category set, and taking remaining emotional categories as target emotional categories of invalid or negative co-emotion; adjusting the parameters of the sound playing device to reduce emotional influence and emotional duration of the target emotional categories to below corresponding preset emotional thresholds.

3. The method of automatically adjusting sound of claim 1, wherein, Before the real-time acquisition of the current physiological indicators of the user, the method further comprises: acquiring initial physiological indicators of the user; confirming an initial mental state of the user according to the initial physiological indicators and preset emotional algorithms; confirming a fourth emotional category set corresponding to the initial mental state based on preset emotional levels and emotional directions; when emotional influence of an emotional category in the fourth emotional category set exceeds a preset perception threshold, prompting the user to adjust his / her own emotion.

4. The method of automatically adjusting sound of claim 1, wherein, The method further comprises: acquiring heart rate variation trends and breathing frequency data variation trends of the user according to the current physiological indicators of the user; when the user enters a fatigue state according to the heart rate variation trends and the breathing frequency data variation trends, adjusting the parameters of the sound playing device to improve emotional influence of sound on the user.

5. The method of automatically adjusting sound of claim 1, wherein, The method further comprises: receiving a sound adjustment request input by the user; adjusting the parameters of the sound playing device according to the sound adjustment request.

6. A sound automatic adjustment device, characterized by, The device comprises: an acquisition module configured to acquire current physiological indicators of a user in real time; An adjusting module is configured to confirm emotional information contained in a sound content currently played by a sound playing device, wherein the sound content is text content; predict a predicted mental state of the user according to the emotional information; judge a real mental state of the user based on a preset emotional algorithm and the current physiological index; confirm a first emotional category set corresponding to the predicted mental state and a second emotional category set corresponding to the real mental state based on a preset emotional level and emotional direction; judge whether the first emotional category set and the second emotional category set are the same; if yes, confirm that the user has valid positive co-emotion, and maintain a current parameter of the sound playing device; if not, confirm that the user has invalid or negative co-emotion, and adjust the parameter of the sound playing device to reduce emotional influence and emotional duration of invalid or negative co-emotion.

7. A sound automatic adjustment device characterized by comprising: Comprise: a processor, a memory, a communication interface and a communication bus, the processor, the memory and the communication interface complete communication with each other through the communication bus; The memory is used to store at least one executable instruction, and the executable instruction makes the processor execute the operation of the sound automatic adjusting method in any one of claims 1-5.

8. A computer-readable storage medium, characterized in that, The storage medium has at least one executable instruction stored therein, and the executable instruction makes the sound automatic adjusting device / apparatus execute the operation of the sound automatic adjusting method in any one of claims 1-5 when the sound automatic adjusting device / apparatus runs.

Images