Multi-device cooperative control method and device based on spatial audio perception and electronic device

Abstract

The invention provides a multi-device cooperative control method and device for spatial audio perception and electronic equipment, and relates to the technical field of audio processing, and the technical scheme is characterized in that spatial audio scene information is acquired, and the spatial audio scene information comprises identity information of a user in a room and spatial distribution information of audio equipment; determining audio requirements of different users in a room according to the spatial audio scene information; calculating sound box volume adjustment parameters for reducing audio interference among users and guaranteeing audio privacy according to audio requirements of the users; and based on the sound box volume adjustment parameter, adjusting the sound box volume according to a preset smooth volume control strategy. The multi-device cooperative control method and device based on spatial audio perception and the electronic device provided by the invention have the advantage of realizing intelligent cooperative control of various audio playing devices in different rooms in a complex audio demand scene in which multiple members and multiple rooms coexist in a family.

Description

Technical Field

[0001] The present application relates to the field of audio processing technology, and more specifically, to a multi-device collaborative control method, apparatus, and electronic device for spatial audio perception. Background Art

[0002] In a modern family environment, family members often carry out various audio activities in different rooms. For example, some members may use headphones in the study to participate in remote meetings and focus on work communication; at the same time, some members play light music through smart speakers in the living room to create a relaxing home atmosphere. In order to ensure that each family member can get an independent and undisturbed audio experience, the application of spatial audio perception technology becomes crucial.

[0003] However, in the current complex audio demand scenarios where there are multiple family members and multiple rooms, various audio playback devices, including headphones and speakers, often lack effective collaborative control mechanisms. Existing audio devices usually work independently and cannot sense and respond to changes in the audio needs of family members in different spaces. For example, when a user wearing headphones moves from one room to another, the smart speaker in the room cannot automatically adjust the volume or sound field to avoid interfering with the headphone user, and it is also difficult to ensure that the normal audio experience of users in other rooms is not affected.

[0004] This audio interference problem is particularly prominent in a home environment, seriously affecting the audio experience of each family member and the harmony of family life.

[0005] In view of the above problems, the existing technology needs to be improved urgently. Summary of the invention

[0006] The purpose of this application is to provide a spatial audio-aware multi-device collaborative control method, apparatus, and electronic device, which has the advantage of being able to achieve intelligent collaborative control of multiple audio playback devices in different rooms in a complex audio demand scenario with multiple family members and multiple rooms, ensuring that each user obtains an independent and undisturbed audio experience while avoiding the fragmentation of user experience caused by frequent start and stop of devices and sudden volume changes.

[0007] This application provides a multi-device collaborative control method for spatial audio perception, and the technical solution is as follows: The method comprises the following steps: obtaining spatial audio scene information, wherein the spatial audio scene information includes identity information of users in a room and spatial distribution information of audio equipment; determining audio requirements of different users in the room according to the spatial audio scene information; calculating, according to the audio requirements of the users, speaker volume adjustment parameters for reducing audio interference between users and ensuring audio privacy; and adjusting the speaker volume according to a preset smooth volume control strategy based on the speaker volume adjustment parameters.

[0008] Furthermore, the present application also proposes that the step of calculating the speaker volume adjustment parameters for reducing audio interference between users and ensuring audio privacy based on the user's audio needs includes: determining the audio priority of each user based on the user's audio needs; calculating the audio interference threshold of each user in the current scenario based on the audio priority; and calculating the speaker volume adjustment parameters based on the audio interference threshold.

[0009] Furthermore, the present application also proposes that the step of determining the audio priority of each user based on the user's audio needs includes: determining the current audio activity status of each user based on the user's audio needs; judging the user's audio activity type based on the audio activity status; and determining the audio priority of each user based on the audio activity type and in combination with preset audio activity priority rules.

[0010] Furthermore, the present application also proposes that the step of determining the audio needs of different users in the room based on the spatial audio scene information includes: determining the current audio scene feature information of each user based on the spatial audio scene information, the audio scene feature information including the user activity type, the user location, and the user's audio activity status; matching the audio scene feature information with a preset audio scene rule library to obtain a matching result; and determining the audio needs of each user based on the matching result.

[0011] Furthermore, the present application also proposes that the step of determining the audio needs of each user based on the matching results of the audio scene rule library includes: obtaining multiple rule matching items in the matching results of the audio scene rule library; performing conflict detection on the multiple rule matching items; when a rule conflict is detected, obtaining the duration of the audio activity state corresponding to each rule matching item; based on the duration, selecting the rule matching item with the longest duration as the final rule matching result; and determining the audio needs of each user based on the final rule matching result.

[0012] Furthermore, the present application also proposes that the step of calculating the speaker volume adjustment parameters for reducing audio interference between users and ensuring audio privacy also includes: obtaining the user's location information and movement trajectory information; based on the location information and movement trajectory information, calculating the relative distance and relative movement trend between the user and each speaker device in the room; predicting the user's target movement area based on the relative distance and relative movement trend; based on the target movement area, determining the volume adjustment parameters of the speaker devices within the target movement area and the volume adjustment parameters of the speaker devices outside the target movement area.

[0013] Furthermore, the present application also proposes that the step of determining the volume adjustment parameters of the speaker device within the target moving area and the volume adjustment parameters of the speaker device outside the target moving area based on the target moving area includes: obtaining the current volume parameters of the speaker device within the target moving area and the current volume parameters of the speaker device outside the target moving area; calculating the volume difference between the speaker device within the target moving area and the speaker device outside the target moving area according to the current volume parameters of the speaker device within the target moving area and the current volume parameters of the speaker device outside the target moving area; when the volume difference is greater than a preset threshold, adjusting the volume adjustment parameters of the speaker device within the target moving area and the volume adjustment parameters of the speaker device outside the target moving area in segments so that the volume of the speaker device within the target moving area and the volume of the speaker device outside the target moving area gradually transition; when the volume difference is less than or equal to the preset threshold, directly determining the volume adjustment parameters of the speaker device within the target moving area and the volume adjustment parameters of the speaker device outside the target moving area.

[0014] Furthermore, the present application also proposes that the step of determining, based on the target moving area, the volume adjustment parameters of the speaker devices within the target moving area and the volume adjustment parameters of the speaker devices outside the target moving area includes: obtaining the spatial distribution information of the speaker devices within the target moving area and the spatial distribution information of the speaker devices outside the target moving area; based on the spatial distribution information, determining the relative position relationship between the speaker devices within the target moving area and the relative position relationship between the speaker devices outside the target moving area; dividing the speaker devices within the target moving area into multiple speaker device groups and dividing the speaker devices outside the target moving area into multiple speaker device groups according to the relative position relationship; and determining the volume adjustment parameters of each speaker device group respectively.

[0015] Furthermore, the present application also proposes a spatial audio-aware multi-device collaborative control device, including: a scene information acquisition module, used to obtain spatial audio scene information, the spatial audio scene information including identity information of users in the room and spatial distribution information of audio equipment; a demand determination module, used to determine the audio requirements of different users in the room based on the spatial audio scene information; a parameter calculation module, used to calculate, based on the user's audio requirements, speaker volume adjustment parameters for reducing audio interference between users and ensuring audio privacy; a volume adjustment module, used to adjust the speaker volume according to a preset smooth volume control strategy based on the speaker volume adjustment parameters.

[0016] Furthermore, the present application also proposes an electronic device, including a processor and a memory, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the steps in the above method are executed.

[0017] From the above, it can be seen that the present application provides a spatial audio-aware multi-device collaborative control method, apparatus and electronic device, which obtains spatial audio scene information, determines the audio needs of different users, calculates speaker volume adjustment parameters, and adjusts the speaker volume according to a smooth volume control strategy, thereby realizing intelligent collaborative control of multiple audio playback devices in different rooms, thereby ensuring that each user obtains an independent and undisturbed audio experience while avoiding the problem of user experience fragmentation caused by frequent start and stop of equipment and sudden changes in volume. It has the advantage of being able to realize intelligent collaborative control of multiple audio playback devices in different rooms in complex audio demand scenarios with multiple family members and multiple rooms, ensuring that each user obtains an independent and undisturbed audio experience while avoiding the problem of user experience fragmentation caused by frequent start and stop of equipment and sudden changes in volume. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 A flowchart of a multi-device collaborative control method for spatial audio perception provided in this application.

[0019] Figure 2 A schematic diagram of the structure of a multi-device collaborative control device for spatial audio perception provided in this application.

[0020] In the figure: 210, scene information acquisition module; 220, demand determination module; 230, parameter calculation module; 240, volume adjustment module. DETAILED DESCRIPTION

[0021] The technical solutions in the present application will be clearly and completely described below in conjunction with the drawings in the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. The components of the present application generally described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the present application for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0022] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0023] In modern home environments, in complex audio demand scenarios with multiple users and multiple devices, how to achieve multi-device collaborative control of spatial audio perception to reduce audio interference between users and ensure audio privacy has become a technical problem that needs to be solved urgently. Existing audio devices usually work independently, lack an effective collaborative control mechanism, and cannot perceive and respond to changes in audio needs of family members in different spaces. This leads to the problem of audio interference between users, which seriously affects the audio experience of each family member and the harmony of family life. Especially when users carry headphones and move between different rooms, the existing system is difficult to achieve smooth dynamic adjustment of the speaker volume or sound field direction, and cannot maintain the consistency and immersion of the audio experience of other family members in their respective spaces while ensuring the concentration of users wearing headphones. In addition, traditional volume control technology often uses abrupt volume drops or rises. This volume change not only interrupts the user's immersive experience, but also lacks smoothness and naturalness, resulting in a poor user experience.

[0024] In this regard, refer to Figure 1 , the present application proposes a multi-device collaborative control method for spatial audio perception, the method comprising the following steps: S110, obtaining spatial audio scene information, where the spatial audio scene information includes identity information of users in the room and spatial distribution information of audio devices; S120, determining audio requirements of different users in the room according to the spatial audio scene information; S130, calculating a speaker volume adjustment parameter for reducing audio interference between users and ensuring audio privacy according to the user's audio needs; S140: Based on the speaker volume adjustment parameter, adjust the speaker volume according to a preset smooth volume control strategy.

[0025] Among them, spatial audio scene information refers to data that describes the identity of users and the distribution of audio devices in the room. It can be obtained using sensor networks and user identification technology. This information provides a basis for subsequent audio demand analysis and volume adjustment.

[0026] Among them, the user's audio needs refer to the specific requirements of each user for the audio experience in a specific scenario, which can be determined by analyzing user behavior and preferences, which helps the system to make personalized volume adjustments.

[0027] Among them, the speaker volume adjustment parameters refer to numerical indicators used to control the changes in speaker volume, which can be generated through calculation algorithms based on user needs and spatial distribution. These parameters directly affect the actual output volume of the speaker.

[0028] Among them, the smooth volume control strategy refers to a method of gradually adjusting the volume, which can be implemented by using a volume gradient algorithm. This strategy can avoid the negative impact of sudden volume changes on user experience.

[0029] The core innovation of this application is to obtain spatial audio scene information, analyze the user's audio needs, calculate the volume adjustment parameters, and use a smooth volume control strategy to adjust the speaker volume. This method can effectively reduce audio interference between users and improve the audio experience in a multi-user, multi-device environment.

[0030] The working principle of this application can be described in detail as follows: First, the system obtains spatial audio scene information through a network of sensors distributed throughout the room. These sensors may include cameras, microphone arrays, and Bluetooth beacons. The camera is used to capture the user's location, movement trajectory, and user identity, the microphone array is used to identify the source of the sound, and the Bluetooth beacon is used to locate the spatial distribution of audio devices. These data are transmitted to the central processing unit in real time for integration and analysis.

[0031] Next, the system determines the audio needs of different users in the room based on the acquired scene information. For example, the system may recognize that one user is in a video conference while another user is listening to music. The system predicts the user's audio needs based on the user's identity information and the spatial distribution information of the audio device, and then generates an audio needs profile for each user.

[0032] Then, based on these audio demand profiles, the system calculates the speaker volume adjustment parameters to reduce audio interference between users and ensure audio privacy. This calculation process needs to balance the needs of multiple users while taking into account the spatial distribution and sound field characteristics of the speakers, and can generate a set of parameters for each speaker, including volume, frequency response, and sound field direction.

[0033] Finally, the system adjusts the speaker volume according to the calculated volume adjustment parameters and the preset smooth volume control strategy. This strategy can use a volume gradient algorithm to gradually adjust the volume over a certain period of time instead of changing it suddenly. The adjustment of the sound field direction can be achieved through beamforming technology. This smooth adjustment can be achieved at the audio output end through digital signal processing technology.

[0034] As a preferred implementation, the present application can be implemented in a smart home system: For example, when user A moves from the living room to the study, and user A is wearing a Bluetooth headset, the camera in the living room detects that the user has left and immediately transmits this information to the central processing unit. User A moves from the living room to the study, and the Bluetooth headset he wears is used as an audio device, and the position of the audio device will also move accordingly.

[0035] Based on the identity information of user A and the spatial distribution information of the audio device (referring to the movement of the position of the audio device), combined with the image analysis of the camera or the microphone array analysis, it is inferred that user A is wearing headphones for a video conference, that is, it is determined that the user's audio need is a video conference.

[0036] Based on this information, the system calculates new volume adjustment parameters. For example, the volume of the speakers in operation on the path from the living room to the study is gradually reduced to 50% of the original volume. If there is a speaker in operation in the study, its volume will be reduced to a near-silent state to avoid interfering with user A's meeting.

[0037] These adjustments are performed using a preset smooth volume control strategy. Specifically, the system may use a logarithmic decay curve to adjust the volume, for example, once every 100 milliseconds.

[0038] In this way, while ensuring the audio privacy needs of user A, the interference with the audio experience of other family members can be minimized, and multi-device collaborative control of spatial audio perception can be achieved.

[0039] In some of the above embodiments of the present application, it is proposed to calculate the speaker volume adjustment parameters for reducing audio interference between users and protecting audio privacy according to the audio needs of the users to adjust the speaker volume. However, in this process, how to accurately calculate the speaker volume adjustment parameters according to the audio needs of different users to achieve the goal of effectively reducing audio interference between users and protecting audio privacy still remains a challenge. Especially in multi-user scenarios, how to balance the audio needs of different users and convert these needs into specific speaker volume adjustment parameters requires a more detailed and targeted processing method.

[0040] In this regard, the present application further proposes to determine the audio priority of each user based on the user's audio needs; calculate the audio interference threshold of each user in the current scenario based on the audio priority; and calculate the speaker volume adjustment parameter based on the audio interference threshold.

[0041] This application provides a more accurate and targeted method for calculating speaker volume adjustment parameters by introducing the concepts of audio priority and audio interference threshold.

[0042] First, the audio priority of each user is determined according to the user's audio needs, where the audio priority can be determined based on various factors, such as the user's identity (such as parent, child, guest, etc.), the type of activity currently being performed (such as work meeting, leisure and entertainment, learning, etc.), and personal preferences set by the user.

[0043] Furthermore, the determination of audio priority can adopt a dynamic adjustment mechanism. For example, the system can monitor the user's audio activity status in real time, and automatically increase the user's audio priority when it detects that the user is conducting an important audio activity (such as a video conference). At the same time, the system can also consider time factors and automatically adjust the priority of certain users or activity types during specific time periods (such as working hours).

[0044] Then, based on these priorities, the audio interference threshold for a specific scenario is calculated for each user. The calculation of the audio interference threshold may take into account multiple factors, including but not limited to: the user's audio priority, the background noise level of the current environment, the physical distance between users, and the acoustic characteristics of the room. For example, for high-priority users, the system may set a lower audio interference threshold to ensure that they can get a better audio experience.

[0045] Specifically, the audio interference threshold can be calculated using the following formula: Audio interference threshold = basic threshold * (1 - priority factor) + environmental factor + distance factor.

[0046] Among them, the basic threshold is a preset standard value, the priority coefficient is a value between 0 and 1 determined according to the user's audio priority, the environmental factor takes into account the background noise level of the current environment, and the distance factor is adjusted based on the distance between the user and the speaker.

[0047] Finally, these audio interference thresholds are used to calculate the speaker volume adjustment parameters. The calculation of the volume adjustment parameters needs to comprehensively consider the audio interference thresholds of all users to ensure that the adjusted volume can meet the needs of high-priority users without excessively affecting the audio experience of other users.

[0048] Therefore, the technical solution of the present application effectively solves the problem of how to accurately calculate the speaker volume adjustment parameters in a multi-user scenario by gradually refining and quantifying the audio needs of users. It not only takes into account the differences in audio needs between users, but also provides a more objective and quantifiable basis for volume adjustment by introducing the concept of audio interference threshold. This method can better balance the audio needs of different users, while reducing audio interference between users, it can also better protect audio privacy, thereby improving the accuracy and effectiveness of multi-device collaborative control.

[0049] As a preferred implementation, the method of the present application can be implemented in a smart home system. The system first obtains spatial audio scene information through various sensors (such as cameras, microphone arrays, motion sensors, etc.), including the identity information of users in the room and the spatial distribution information of audio devices. Based on this information, the system can identify different users in the room and determine their locations and current activities.

[0050] For example, the system detects two users in the living room, one watching TV and the other studying on a tablet. At the same time, the system also recognizes that another user is walking from the study to the living room and is wearing headphones for a video conference.

[0051] Based on this scenario information, the system determines the audio needs of each user. In this example, the system determines that the audio needs of the user walking from the study to the living room have the highest priority because they are performing work activities that require high concentration.

[0052] Next, the system determines the audio priority of each user based on these audio needs. Assume that the system uses a priority scale of 1 to 10, with 10 being the highest priority. In this scenario, the system might assign a priority of 9 to the user doing a video conference, 7 to the user studying on a tablet, and 5 to the user watching TV.

[0053] Then, the audio interference threshold for each user is calculated based on these priorities. Assuming the formula mentioned above is used: Audio Interference Threshold = Basic Threshold * (1 - Priority Factor) + Environmental Factor + Distance Factor. If the basic threshold is set to 50 decibels, the priority factor is the priority divided by 10, the environmental factor is the current background noise level (assuming it is 30 decibels), and the distance factor is determined based on the distance between the user and the nearest speaker. The mapping relationship can be preset (assuming that the user in the video conference is 2 meters away from the nearest speaker, the corresponding distance factor is -5 decibels), then the audio interference threshold can be calculated as follows: Audio interference threshold = 50 * (1 - 9 / 10) + 30 + (-5) = 30 dB; Finally, the system calculates the speaker volume adjustment parameters based on these audio interference thresholds. The system may decide to adjust the volume of the living room speakers to a level that does not exceed the audio interference threshold of the user in the video conference, while meeting the audio needs of other users as much as possible. For example, the system may set the volume of the living room speakers to 28 decibels, which is lower than the audio interference threshold of the video conference user and will not cause obvious interference to the video conference, while ensuring that other users can hear their respective audio content.

[0054] In this way, the technical solution of this application can accurately calculate and dynamically adjust the volume of the speaker in complex multi-user scenarios, effectively reducing audio interference between users, while ensuring the audio privacy and experience quality of each user. This method not only improves the overall harmony of the home audio environment, but also enhances the humanization and intelligence level of the smart home system.

[0055] In some of the above embodiments of the present application, it is proposed to determine the audio priority of each user according to the user's audio needs to calculate the speaker volume adjustment parameter. However, in this process, there is a lack of specific consideration of the user's current audio activity state, and it is impossible to accurately reflect the actual priority needs of different users under different audio activities. This may lead to the inability to effectively distinguish and process the audio priorities of each user in a complex home multi-user scenario, thereby affecting the accuracy and rationality of the speaker volume adjustment.

[0056] In this regard, the present application further proposes to determine the current audio activity status of each user based on the user's audio needs; judge the user's audio activity type based on the audio activity status; and determine the audio priority of each user based on the audio activity type and in combination with preset audio activity priority rules.

[0057] This technical solution determines the user's audio priority by determining the user's current audio activity status, judging the audio activity type, and combining the preset priority rules. This method takes into account the user's actual audio activity situation and can more accurately reflect the priority requirements of different users under different audio activities.

[0058] Specifically, the current audio activity state of the user is determined by the user's audio needs. In addition, the audio activity state can be preliminarily determined by detecting the type of audio device the user is using (such as headphones, speakers, TVs, etc.). Furthermore, the activity state can be determined more accurately by analyzing the characteristics of the audio content (such as voice, music, ambient sound, etc.). In addition, contextual data such as the user's location information and time information can also be combined to assist in the judgment.

[0059] Judging the user's audio activity type based on the audio activity status is a key step in this solution. You can set a variety of activity types here, such as work meeting, entertainment viewing, background music, etc. For example, if it is detected that the user is using headphones and the audio content is mainly human voice conversation, it may be judged as a work meeting type.

[0060] When determining the audio priority of a user based on the type of audio activity, it is necessary to combine the preset audio activity priority rules. These rules can be customized according to different scenarios and needs. For example, a work meeting can be set to have a higher priority than background music, but lower than emergency notifications. Priority rules can be static or dynamically adjusted to suit different usage scenarios and user preferences.

[0061] In this way, the system can dynamically identify and distinguish the audio activity types of different users, and assign appropriate priority to each activity type according to the preset priority rules. This can more accurately adjust the speaker volume, while ensuring the audio experience of high-priority users (such as users in important work meetings), it can also take into account the needs of other users, achieving more intelligent and humane audio environment management.

[0062] In practical applications, this solution can be combined with other audio control technologies to further enhance the overall audio experience. For example, it can be combined with spatial audio positioning technology to dynamically adjust the volume and sound field direction of the speaker according to the user's position and movement. It can also be combined with intelligent scene recognition technology to automatically identify the current home scene (such as working hours, rest time, etc.) and adjust the audio activity priority rules accordingly.

[0063] As a preferred implementation, a specific audio activity priority rule may be designed as follows: Emergency notifications / alarms: Priority 10 (highest); Important work meetings: Priority 9; Online education courses: Priority 8; Phone calls: Priority 7; Video conferences: Priority 6; Movie and TV viewing: Priority 5; Game audio: Priority 4; Music listening: Priority 3; Podcasts / audiobooks: Priority 2; Background music: Priority 1 (lowest).

[0064] In some of the above-mentioned embodiments of the present application, it is proposed to determine the audio needs of different users in the room based on spatial audio scene information to achieve multi-device collaborative control. However, in this process, there is a lack of accurate identification and analysis of the user's current audio scene characteristics, resulting in an inability to accurately match the user's actual audio needs.

[0065] In this regard, the present application further proposes the steps of determining the audio needs of different users in the room based on the spatial audio scene information, including: determining the current audio scene feature information of each user based on the spatial audio scene information, the audio scene feature information including the user activity type, the user location, and the user's audio activity status; matching the audio scene feature information with a preset audio scene rule library to obtain a matching result; and determining the audio needs of each user based on the matching result.

[0066] The technical solution proposed in this application effectively solves the problems that existed in determining the audio needs of users through scene analysis and rule matching mechanism. Specifically, the solution first analyzes the spatial audio scene information to identify the current audio scene characteristics of each user.

[0067] The audio scene feature information includes the user activity type, user location, and the user's audio activity status. The user activity type may include, but is not limited to, work, study, leisure, entertainment, etc. For example, by analyzing the user's device usage, time period, location and other information, it is possible to determine whether the user is performing work-related activities. User location information can be obtained through indoor positioning technology or device connection status, accurate to the room or even a specific area in the room. The user's audio activity status may include using headphones, using speakers, making a voice call, etc.

[0068] Furthermore, the identified audio scene features are matched with the scene modes in the preset audio scene rule library. The audio scene rule library may contain multiple predefined scene modes, each corresponding to a specific audio requirement setting. For example, "work mode" may require a low background volume and high privacy protection, while "entertainment mode" may allow a higher volume and a more open audio environment.

[0069] Therefore, based on the matching results of the rule library, the system can accurately determine the specific audio needs of each user. This method not only takes into account the user's current state, but also combines the preset audio scene rules, so that it can more intelligently and accurately meet the audio needs of different users in different scenarios.

[0070] As a preferred implementation, user feedback and usage data may be collected to continuously adjust and improve the scene modes and corresponding audio requirement settings in the rule library.

[0071] Specifically, when a user is detected using a laptop in the living room with headphones connected, and the user's schedule shows a video conference, the system will match this information with the "remote conference mode" in the audio scene rule library. After a successful match, the system will automatically set high-priority audio requirements for the user, including reducing the surrounding volume and enhancing audio privacy protection.

[0072] At the same time, for other users in the same space, the system will make corresponding adjustments based on their activity type and audio needs. For example, if it detects that another user is watching TV in the same room, the system will automatically lower the TV volume or suggest that the user use headphones to reduce interference to users in remote meetings.

[0073] In practical applications, the technical solution of the present application can be integrated into a smart home system. For example, in a scenario of a family of four, the audio needs of multiple users can be handled simultaneously. When the father is holding a remote meeting in the study, the audio environment of the study will be automatically optimized to a high-privacy, low-interference mode. At the same time, if the mother is watching TV in the living room, the system will automatically adjust the TV volume to ensure that it does not interfere with the meeting in the study. For children studying in the bedroom, the system may suggest using headphones or lowering the volume of background music to create an environment suitable for learning.

[0074] In addition, audio settings can be dynamically adjusted based on the user's movement. For example, when a father who is conducting a remote meeting moves from the study to the living room, the system will adjust the audio environment of the living room in real time, perhaps temporarily lowering the TV volume to ensure that the meeting is not disturbed.

[0075] In this way, the technical solution of this application not only solves the problem of complex audio needs of multiple family members and multiple rooms, but also improves the personalization and intelligence of the audio experience. It can ensure that each user obtains an independent audio experience without interfering with each other, while avoiding the fragmentation of user experience caused by frequent device startup and shutdown and sudden volume changes.

[0076] In some of the above embodiments of the present application, it is proposed to determine the audio needs of each user based on the matching results of the audio scene rule library to meet the audio needs of different users in different scenarios. However, in this process, multiple rule matching items may conflict with each other, resulting in an inability to accurately determine the actual audio needs of the user. This conflict may affect the accuracy of the system's judgment of the user's audio needs, thereby affecting the subsequent speaker volume adjustment effect.

[0077] In this regard, the present application further proposes to obtain multiple rule matching items from the matching results of the audio scene rule library; perform conflict detection on multiple rule matching items; when a rule conflict is detected, obtain the duration of the audio activity state corresponding to each rule matching item; based on the duration, select the rule matching item with the longest duration as the final rule matching result; and determine the audio needs of each user based on the final rule matching result.

[0078] This technical solution effectively solves the problem of possible conflicts among multiple rule matches by introducing a conflict detection and resolution mechanism. Specifically, multiple rule matches are first obtained, and then conflict detection is performed on these matches. When a conflict is detected, the solution compares the duration of the audio activity state corresponding to each rule match and selects the rule match with the longest duration as the final result.

[0079] In actual applications, conflict detection can be implemented in many ways. For example, a conflict matrix can be set to predefine the conflict relationship between different rules. When the system obtains multiple rule matches, it can query the conflict matrix to determine whether there is a conflict between these rules. Another method is to dynamically determine the conflict by analyzing the attributes and scope of influence of the rules. For example, if two rules both require adjusting the volume of the same speaker, but in opposite directions, it can be considered that the two rules are in conflict.

[0080] When a rule conflict is detected, the system obtains the duration of the audio activity state corresponding to each rule match. The duration here can be obtained and calculated in a variety of ways. For example, you can record the timestamp when the user starts an audio activity, and then compare it with the current time to get the duration. Alternatively, you can set a timer that starts when the user starts an audio activity and continues to record the time until the activity ends or changes.

[0081] Based on the obtained duration, the system selects the rule match with the longest duration as the final rule match result. This selection method is based on a reasonable assumption: audio activities with longer duration are more likely to reflect the user's real needs. For example, if the user has been watching a movie for two hours and just started to answer a phone call, the system will tend to think that watching a movie is the user's current main audio need.

[0082] In addition, the priorities of the matching items that may conflict may also be predefined. Taking the above example, it can be predefined that the priority of phone calls is higher than the priority of watching movies.

[0083] Based on the final rule matching results, the system can more accurately determine the audio needs of each user. This approach not only solves the problem of rule conflicts, but also improves the accuracy and adaptability of system judgments. For example, if the system determines that the user's main audio need is to watch a movie, it will adjust the volume and sound effect settings of the speaker accordingly to provide the best viewing experience.

[0084] In this way, the system can make more accurate and reasonable judgments when faced with complex and potentially conflicting audio scenarios.

[0085] In some of the above embodiments of the present application, it is proposed to calculate the speaker volume adjustment parameters according to the user's audio needs to reduce audio interference between users and ensure audio privacy. However, in this process, the audio needs of users based solely on static conditions may not be able to fully adapt to the user's movement and position changes in the space, resulting in the speaker volume adjustment being not precise and dynamic enough. In particular, when the user moves in the room, how to adjust the speaker volume in real time to continuously ensure audio privacy and reduce interference becomes a problem that needs to be solved urgently.

[0086] In this regard, the present application further proposes to also include obtaining the user's location information and movement trajectory information; based on the location information and movement trajectory information, calculating the relative distance and relative movement trend between the user and each speaker device in the room; predicting the user's target movement area based on the relative distance and relative movement trend; based on the target movement area, determining the volume adjustment parameters of the speaker devices within the target movement area and the volume adjustment parameters of the speaker devices outside the target movement area.

[0087] This application achieves dynamic perception of the user's spatial position by obtaining the user's location information and movement trajectory information. This dynamic perception can be achieved in many ways, such as using an indoor positioning system, camera image analysis, or a position sensor of a wearable device. The location information may include the specific coordinates of the user in the room, while the movement trajectory information may include the sequence of the user's position changes within a certain period of time.

[0088] Based on the acquired location information and movement trajectory information, the application calculates the relative distance and relative movement trend between the user and each speaker device in the room. The relative distance can be calculated by the Euclidean distance between the user's current position and the fixed position of each speaker. The relative movement trend can be determined by analyzing the relationship between the user's movement trajectory and the speaker position, for example, to determine whether the user is approaching or moving away from a certain speaker. This step enables the system to grasp the changes in the spatial relationship between the user and the speaker in real time.

[0089] Based on the calculated relative distance and relative movement trend, the present application further predicts the user's target movement area. The prediction method can use a variety of algorithms, such as linear regression, etc. The prediction result can be the area range that the user may reach within a certain period of time in the future.

[0090] Finally, based on the predicted target moving area, the volume adjustment parameters of the speaker devices in the target moving area and the volume adjustment parameters of the speaker devices outside the target moving area are determined respectively. This distinction can achieve precise and differentiated control of the speaker volume. For example, for the speakers in the target moving area, a larger volume adjustment may be required to adapt to the user's approach; while for the speakers outside the target moving area, only a slight adjustment or maintaining the current volume may be required.

[0091] This method can effectively solve the problem that static volume adjustment cannot adapt to user movement. The system can continuously ensure audio privacy and reduce interference during user movement. For example, when a user moves from one room to another with headphones, the system can predict the user's movement path and reduce the volume of the speakers in the area the user is about to pass in advance, while appropriately adjusting the volume of speakers in other areas to ensure the consistency and comfort of the overall audio experience.

[0092] Among them, the user's movement path can be predicted based on the user's historical habits.

[0093] Furthermore, the technical solution of the present application can be combined with the existing audio demand analysis and volume adjustment strategies to form a more comprehensive audio environment control system. For example, when determining the volume adjustment parameters of the speaker devices inside and outside the target moving area, the user's audio priority and audio interference threshold can be considered at the same time. This combination can ensure dynamic response to user movement while taking into account the differences in audio needs of different users.

[0094] As a preferred implementation, the present application can be implemented in a smart home system. Specifically, the system may include multiple smart speakers distributed throughout the room, smart devices worn by users (such as smart watches or headphones), and a central control unit. The smart speakers are responsible for playing audio and performing volume adjustment, the smart wearable devices are responsible for collecting the user's location and movement information, and the central control unit is responsible for processing data, executing prediction algorithms, and issuing volume adjustment instructions.

[0095] For example, when a user moves around the house wearing smart headphones, the smart headphones will report the user's location information to the central control unit in real time. The central control unit analyzes this information and predicts that the user may move to the living room. Based on this prediction, the system lowers the volume of the smart speaker in the living room by 20% in advance, and gradually restores the volume of the speaker in the room where the user is originally located to normal levels. This pre-adjustment can create a more suitable audio environment before the user actually enters the living room, avoiding interference to the user caused by sudden volume changes.

[0096] Through this method, the present application not only improves the accuracy and real-time performance of volume adjustment, but also provides users with a more intelligent and personalized audio experience. The system can automatically adjust the audio environment according to the user's movement pattern without manual intervention by the user, greatly improving the user's convenience and comfort. At the same time, this dynamic adjustment method also helps to optimize the overall home audio environment, reduce audio interference between different areas, and create a more harmonious audio space for each family member.

[0097] In some of the above embodiments of the present application, it is proposed to determine the speaker volume adjustment parameters based on the target moving area to reduce audio interference between users and ensure audio privacy. However, in this process, there may be a situation where the volume difference of the speaker devices inside and outside the target moving area is too large. This volume difference may cause the user to feel an abrupt volume change during the movement, affecting the user experience. In addition, directly adjusting the volume may not achieve a smooth transition, resulting in a sense of fragmentation in the audio experience.

[0098] In this regard, the present application further proposes the steps of determining the volume adjustment parameters of the speaker device within the target moving area and the volume adjustment parameters of the speaker device outside the target moving area based on the target moving area, including: obtaining the current volume parameters of the speaker device within the target moving area and the current volume parameters of the speaker device outside the target moving area; calculating the volume difference between the speaker device within the target moving area and the speaker device outside the target moving area according to the current volume parameters of the speaker device within the target moving area and the current volume parameters of the speaker device outside the target moving area; when the volume difference is greater than a preset threshold, adjusting the volume adjustment parameters of the speaker device within the target moving area and the volume adjustment parameters of the speaker device outside the target moving area in segments so that the volume of the speaker device within the target moving area and the volume of the speaker device outside the target moving area gradually transition; when the volume difference is less than or equal to the preset threshold, directly determining the volume adjustment parameters of the speaker device within the target moving area and the volume adjustment parameters of the speaker device outside the target moving area.

[0099] The technical solution of the present application obtains the current volume parameters of the speaker devices inside and outside the target moving area, calculates the volume difference, and adopts different volume adjustment strategies according to the comparison result of the volume difference and the preset threshold. Specifically, when the volume difference is greater than the preset threshold, a segmented adjustment method is used to achieve a gradual transition of the volume, avoiding the impact of sudden volume changes on the user experience. When the volume difference is less than or equal to the preset threshold, the volume adjustment parameters are directly determined, simplifying the adjustment process.

[0100] Furthermore, the process of calculating the volume difference can be implemented in a variety of ways. For example, the absolute value of the difference between the average volume of the speaker device in the target moving area and the average volume of the speaker device outside the target moving area can be calculated. Alternatively, the difference between the maximum volume of the speaker device in the target moving area and the minimum volume of the speaker device outside the target moving area can be calculated. In addition, a weighted average method can be used to weight the volume parameters according to factors such as the location and frequency of use of the speaker device, and then calculate the weighted volume difference.

[0101] The setting of the preset threshold can be adjusted according to the actual application scenario and user experience requirements. As a preferred embodiment, the preset threshold can be set to 5-10 decibels. The volume change within this range usually does not cause obvious discomfort to the user. Of course, the preset threshold can also be set as an adjustable parameter, allowing the user to customize the setting according to personal preferences.

[0102] When the volume difference is greater than the preset threshold, the specific implementation of segmented adjustment can adopt multiple strategies. For example, the volume adjustment can be divided into multiple levels, each level corresponds to a fixed volume change amplitude. The system can determine how many levels are required to complete the gradual transition of the volume based on the size of the volume difference. Another way is to use an exponential decay function to make the volume change faster at the beginning and then gradually slow down, thereby achieving a smoother transition effect.

[0103] The time control of volume gradient transition can be dynamically adjusted according to the user's movement speed and the size of the volume difference. For example, when the user moves faster, the gradient transition time can be appropriately shortened to ensure that the volume is adjusted in place when the user enters a new area. Conversely, when the user moves slower, the gradient transition time can be extended to provide a smoother volume change experience.

[0104] In addition, the technical solution of the present application can also be combined with spatial audio technology. While adjusting the volume, the system can adjust the spatial positioning of the audio, so that the sound source gradually shifts from one area to another, further enhancing the natural sense of audio transition.

[0105] Through the above technical solution, the present application can effectively solve the problem of excessive volume difference between speaker devices inside and outside the target moving area. By introducing the calculation of the volume difference and the comparison of the preset threshold, the system can intelligently determine whether a gradual transition is required. When a gradual transition is required, a segmented adjustment method is adopted to ensure the smoothness of the volume change and enhance the user's audio experience during movement. At the same time, for situations where the volume difference is small, directly adjusting the volume can improve the system response speed and ensure the real-time nature of audio control.

[0106] The technical solution of the present application realizes intelligent and dynamic volume adjustment by introducing the concepts of volume difference and preset threshold. By comparing the volume difference and the preset threshold, the system can adaptively select the appropriate volume adjustment strategy, which not only ensures the smoothness of volume adjustment, but also takes into account the response speed of the system. This method can not only reduce audio interference between users and protect audio privacy, but also provide a more natural and coherent audio experience, especially suitable for complex home audio environments with multiple users and multiple devices.

[0107] In some of the above embodiments of the present application, it is proposed to determine the speaker volume adjustment parameters based on the target moving area to reduce audio interference between users and protect audio privacy. However, in this process, there may be uneven or complex distribution of speaker devices. Simply making uniform adjustments to the speakers inside and outside the entire target moving area may not meet the refined volume control requirements of different spatial locations, thereby affecting the user's audio experience and privacy protection effect.

[0108] In this regard, the present application further proposes obtaining spatial distribution information of speaker devices within the target moving area and spatial distribution information of speaker devices outside the target moving area; based on the spatial distribution information, determining the relative position relationship between the speaker devices within the target moving area and the relative position relationship between the speaker devices outside the target moving area; dividing the speaker devices within the target moving area into multiple speaker device groups, and dividing the speaker devices outside the target moving area into multiple speaker device groups according to the relative position relationship; and determining the volume adjustment parameters of each speaker device group respectively.

[0109] This technical solution obtains the spatial distribution information of the speaker devices inside and outside the target moving area, determines the relative position relationship between the speaker devices, and divides the speaker devices into multiple device groups accordingly, thereby achieving refined grouping control of speakers in different spatial positions. This grouping strategy takes into account the spatial distribution characteristics of the speaker devices and can better adapt to complex indoor environments.

[0110] Specifically, spatial distribution information can be obtained in a variety of ways. For example, indoor positioning technologies such as Bluetooth Low Energy (BLE) beacons, ultra-wideband (UWB) positioning, or visual SLAM technology can be used to obtain the precise location coordinates of the speaker device. Another method is to use the microphone array and speaker of the speaker device itself to determine the relative position between devices through acoustic positioning technology.

[0111] Based on the acquired spatial distribution information, the system can calculate the distance, angle and other parameters between the speaker devices to determine their relative position relationship. This step can use clustering algorithms, such as K-means or DBSCAN, to group similar speaker devices in space. For example, a distance threshold, such as 3 meters, can be set to group devices with a distance less than the threshold into the same group.

[0112] When dividing speaker devices into groups, the system not only considers the distance between devices, but also the influence of obstacles such as room layout and walls. For example, a ray tracing algorithm can be used to simulate the propagation path of sound waves and divide devices separated by the same wall into different groups, even if their straight-line distance is very close.

[0113] For each speaker device group, the system can determine the volume adjustment parameters based on the number, distribution density and relative position of the devices in the group. For example, for a densely distributed device group, a smaller volume adjustment range can be used to avoid excessive volume changes; while for a sparsely distributed device group, a larger adjustment range can be used to ensure that the volume change effect is obvious.

[0114] By dividing the speaker devices into multiple groups and determining the volume adjustment parameters for each speaker device group, the solution can achieve more accurate and flexible volume control. This group adjustment strategy can adopt differentiated volume adjustment strategies for speaker devices in different spatial locations, thereby more effectively reducing audio interference between users and better protecting users' audio privacy.

[0115] The implementation process of this technical solution can be described as follows: First, the system obtains the spatial distribution information of all speaker devices inside and outside the target moving area. This can be achieved through a pre-set positioning system or real-time positioning technology. The information obtained includes the three-dimensional coordinates, orientation and other data of each speaker device.

[0116] Next, the system calculates the relative position relationship between the speaker devices based on this spatial distribution information. This step can use vector calculation methods to calculate the distance matrix and angle matrix between devices. For example, a reference point can be set to calculate the azimuth and elevation of each device relative to the reference point.

[0117] Then, the system uses a clustering algorithm to divide the speaker devices into multiple groups based on the calculated relative position relationship. In this process, the system can set some division rules, such as giving priority to grouping devices in the same room, or grouping them according to the audio characteristics of the devices (such as subwoofers and tweeters).

[0118] Finally, the system determines the volume adjustment parameters for each speaker device group. These parameters can include the magnitude, rate, and direction of the volume adjustment. For example, for a device group close to the user, the volume may need to be reduced more significantly; while for a device group far from the user, it may only need to be adjusted slightly or remain unchanged.

[0119] Through this method, the system can achieve fine-grained control of speaker devices in complex indoor environments. For example, in a large open office, when a user is wearing headphones for a video conference, the system can identify the speaker devices within 3 meters around the user as one group and reduce their volume to 30% of the original; the devices within 3-6 meters are another group, and the volume is reduced to 50%; and the devices beyond 6 meters may keep the original volume unchanged. This gradient volume adjustment can effectively reduce interference to users wearing headphones, and ensure that the audio experience of users in other areas will not be greatly affected.

[0120] The core invention of this technical solution is to intelligently group spatial speaker devices and make refined volume adjustments based on the groups. Compared with simple overall adjustments, this method can better adapt to complex indoor environments and diverse user needs, and improve the accuracy and flexibility of volume adjustment. At the same time, this group adjustment strategy also helps to achieve a smoother and more natural volume transition, reducing the impact of volume adjustment on user experience.

[0121] In addition, in some embodiments, the present application also proposes obtaining the audio priority, expected volume requirement, audio interference threshold, location information, and movement trajectory information of each user; predicting the distance between each user and each speaker at different times based on the location information and movement trajectory information; determining the set of speakers serving each user at each time; and establishing an objective function, which is expressed as the weighted audio interference sum of all users at all times: ∑t ∑i Prio_i(t) * ∑j≠Intended(i,t) V_j(t) / Dist_ij(t)^2; where t represents the time, i represents the user, j represents the speaker, Prio_i(t) represents the audio priority of user i at time t, V_j(t) represents the volume adjustment parameter of speaker j at time t, Dist_ij(t) represents the distance between user i and speaker j at time t, and Intended(i,t) represents the set of speakers serving user i at time t; establish constraints: for each user i and each time t, the volume of the speaker serving the user is not less than the user's expected volume requirement: V_Intended(i,t)(t) ≥ D_i(t); for each user i and each time t, the interference from non-service speakers does not exceed the user audio interference threshold: ∑j≠Intended(i,t) V_j(t) / Dist_ij(t)^2 ≤ T_i(t); for each speaker j and each time t, the volume adjustment parameter is non-negative: V_j(t) ≥ 0; for each speaker j and each moment t (t>0), the volume change between adjacent moments does not exceed the preset maximum step size: |V_j(t) - V_j(t-1)| ≤ ΔV; solve the optimal solution of the objective function under the constraints to obtain the volume adjustment parameter V_j(t) of each speaker at each moment.

[0122] The method first obtains each user's audio priority, expected volume requirement, audio interference threshold, location information, and movement trajectory information. This information provides basic data for subsequent calculations. Among them, the audio priority reflects the importance of the user's audio needs, the expected volume requirement indicates the volume the user wants to hear, and the audio interference threshold defines the maximum level of interference that the user can accept. The location information and movement trajectory information are used to predict the dynamic distance relationship between the user and the speaker.

[0123] Next, based on the user's location information and movement trajectory information, the distance between each user and each speaker at different times is predicted. This step takes into account the user's movement in space, allowing the system to dynamically adapt to changes in the user's position. Prediction can be done using a variety of methods, such as linear extrapolation, Kalman filtering, or machine learning algorithms.

[0124] Then, determine the set of speakers that serve each user at each moment. This step can be determined based on the distance between the user and the speakers, the coverage of the speakers, and the audio needs of the user. For example, you can select the speakers closest to the user, or select a speaker combination that can provide the best audio experience.

[0125] Next, establish the objective function, which is expressed as the sum of weighted audio interference of all users at all times: ∑t ∑iPrio_i(t) * ∑j≠Intended(i,t) V_j(t) / Dist_ij(t)^2; This objective function takes into account multiple factors: By summing over all time instants t, the audio interference over the entire time period is taken into account.

[0126] Summing over all users i ensures that every user’s experience is taken into account.

[0127] Prio_i(t) represents the audio priority of user i at time t, reflecting the importance of different users at different times.

[0128] V_j(t) represents the volume adjustment parameter of speaker j at time t.

[0129] The physical property of sound intensity attenuation with distance is simulated through Dist_ij(t)^2 (the square of the distance between user i and speaker j at time t).

[0130] ∑j≠Intended(i,t) means that only speakers that do not serve user i are considered, and the sounds produced by these speakers are regarded as interference.

[0131] The objective function is designed to minimize the overall weighted audio interference while taking into account the user's priority and spatial location relationship.

[0132] In order to ensure the rationality and practicality of the system operation, this application also establishes a series of constraints: The volume of the service speakers meets the demand: V_Intended(i,t)(t) ≥ D_i(t), where V_Intended(i,t)(t) represents the volume adjustment parameter of the set of speakers serving user i at time t, and D_i(t) represents the expected volume demand of user i at time t; This ensures that the speaker volume serving each user is no less than the user's desired volume requirement.

[0133] Non-service speaker interference control: ∑j≠Intended(i,t) V_j(t) / Dist_ij(t)^2 ≤ T_i(t), T_i(t) represents the audio interference threshold of user i at time t; This limits interference from non-serving speakers to no more than the user-set audio interference threshold.

[0134] The volume is non-negative: V_j(t) ≥ 0; This is a basic physical constraint that ensures that the volume adjustment parameter is always non-negative.

[0135] Volume change smoothness: |V_j(t) - V_j(t-1)| ≤ ΔV, where ΔV is the preset maximum volume change step size; This limits the volume change between adjacent moments to no more than the preset maximum step size, ensuring smoothness of volume adjustment and avoiding abrupt volume changes that affect user experience.

[0136] Finally, by solving the optimal solution of the objective function under these constraints, the volume adjustment parameter V_j(t) of each speaker at each moment is obtained. This optimization problem can be solved using linear programming, quadratic programming or other appropriate optimization algorithms, and the specific choice depends on the specific form of the objective function and constraints.

[0137] This method takes into account factors such as multiple users, multiple devices, and dynamic space, and can minimize overall audio interference while ensuring the audio needs of each user.

[0138] Second, refer to Figure 2 , the present application further proposes a multi-device collaborative control device for spatial audio perception, comprising: A scene information acquisition module 210 is used to acquire spatial audio scene information, where the spatial audio scene information includes identity information of users in the room and spatial distribution information of audio devices; A demand determination module 220, for determining the audio demands of different users in the room according to the spatial audio scene information; A parameter calculation module 230, for calculating, according to the audio requirements of the user, a speaker volume adjustment parameter for reducing audio interference between users and ensuring audio privacy; The volume adjustment module 240 is used to adjust the speaker volume according to a preset smooth volume control strategy based on the speaker volume adjustment parameter.

[0139] By obtaining spatial audio scene information, determining the audio needs of different users, calculating speaker volume adjustment parameters, and adjusting the speaker volume according to the smooth volume control strategy, intelligent collaborative control of multiple audio playback devices in different rooms is achieved, thereby ensuring that each user has an independent and undisturbed audio experience while avoiding the problem of user experience fragmentation caused by frequent start and stop of equipment and sudden volume changes. It has the advantage of being able to achieve intelligent collaborative control of multiple audio playback devices in different rooms in complex audio demand scenarios with multiple family members and multiple rooms, ensuring that each user has an independent and undisturbed audio experience while avoiding the problem of user experience fragmentation caused by frequent start and stop of equipment and sudden volume changes.

[0140] In a third aspect, the present application further proposes an electronic device, comprising a processor and a memory, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the steps in the above method are executed.

[0141] Through the above technical solution, the processor and the memory are interconnected and communicate with each other through a communication bus and / or other forms of connection mechanisms (not marked), and the memory stores computer-readable instructions executable by the processor. When the electronic device is running, the processor executes the computer-readable instructions to execute the method in any optional implementation of the above embodiment to achieve the following functions: obtaining spatial audio scene information, the spatial audio scene information includes identity information of users in the room and spatial distribution information of audio devices; determining audio requirements of different users in the room according to the spatial audio scene information; calculating speaker volume adjustment parameters for reducing audio interference between users and ensuring audio privacy according to the user's audio requirements; adjusting the speaker volume according to a preset smooth volume control strategy based on the speaker volume adjustment parameters.

[0142] The above description is only an embodiment of the present application and is not intended to limit the protection scope of the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A multi-device collaborative control method for spatial audio perception, characterized in that: The method comprises the following steps: Acquire spatial audio scene information, where the spatial audio scene information includes identity information of users in the room and spatial distribution information of audio devices; Determining audio requirements of different users in the room according to the spatial audio scene information; According to the user's audio needs, calculate the speaker volume adjustment parameters used to reduce audio interference between users and ensure audio privacy; Based on the speaker volume adjustment parameter, the speaker volume is adjusted according to a preset smooth volume control strategy.

2. The multi-device collaborative control method for spatial audio perception according to claim 1, characterized in that: The step of calculating the speaker volume adjustment parameter for reducing audio interference between users and ensuring audio privacy according to the audio requirements of the users comprises: Determine the audio priority of each user based on their audio needs; Calculating the audio interference threshold of each user in the current scenario according to the audio priority; Based on the audio interference threshold, the speaker volume adjustment parameter is calculated.

3. The multi-device collaborative control method for spatial audio perception according to claim 2, characterized in that: The step of determining the audio priority of each user according to the audio requirements of the user comprises: Determine the current audio activity status of each user based on the user's audio needs; Determining the audio activity type of the user according to the audio activity state; Based on the audio activity type and in combination with a preset audio activity priority rule, an audio priority for each user is determined.

4. The multi-device collaborative control method for spatial audio perception according to claim 1, characterized in that: The step of determining the audio requirements of different users in the room according to the spatial audio scene information includes: Determine current audio scene feature information of each user according to the spatial audio scene information, wherein the audio scene feature information includes user activity type, user location, and user audio activity state; According to the audio scene feature information, matching is performed with a preset audio scene rule library to obtain a matching result; Based on the matching results, the audio needs of each user are determined.

5. The multi-device collaborative control method for spatial audio perception according to claim 4, characterized in that: The step of determining the audio requirement of each user based on the matching result of the audio scene rule library includes: Acquire multiple rule matching items in the matching results of the audio scene rule library; Performing conflict detection on the multiple rule matching items; When a rule conflict is detected, the duration of the audio activity state corresponding to each rule matching item is obtained; Based on the duration, selecting the rule matching item with the longest duration as the final rule matching result; The audio requirement of each user is determined according to the final rule matching result.

6. The multi-device collaborative control method for spatial audio perception according to claim 1, characterized in that: The steps for calculating the speaker volume adjustment parameters for reducing audio interference between users and ensuring audio privacy include: Obtain user location information and movement trajectory information; Based on the position information and movement trajectory information, calculate the relative distance and relative movement trend between the user and each speaker device in the room; Predicting a target movement area of ​​the user according to the relative distance and the relative movement trend; Based on the target movement area, volume adjustment parameters of the speaker equipment within the target movement area and volume adjustment parameters of the speaker equipment outside the target movement area are determined.

7. The multi-device collaborative control method for spatial audio perception according to claim 6, characterized in that: The step of determining, based on the target moving area, the volume adjustment parameters of the speaker equipment within the target moving area and the volume adjustment parameters of the speaker equipment outside the target moving area comprises: Acquire current volume parameters of the speaker device in the target moving area and current volume parameters of the speaker device outside the target moving area; Calculating a volume difference between the speaker device in the target moving area and the speaker device outside the target moving area according to the current volume parameter of the speaker device in the target moving area and the current volume parameter of the speaker device outside the target moving area; When the volume difference is greater than a preset threshold, the volume adjustment parameters of the speaker device in the target moving area and the volume adjustment parameters of the speaker device outside the target moving area are adjusted in sections, so that the volume of the speaker device in the target moving area and the volume of the speaker device outside the target moving area are gradually transitioned; When the volume difference is less than or equal to a preset threshold, the volume adjustment parameters of the speaker device within the target moving area and the volume adjustment parameters of the speaker device outside the target moving area are directly determined.

8. The multi-device collaborative control method for spatial audio perception according to claim 6, characterized in that: The step of determining, based on the target moving area, the volume adjustment parameters of the speaker equipment within the target moving area and the volume adjustment parameters of the speaker equipment outside the target moving area comprises: Acquire spatial distribution information of the speaker devices within the target moving area and spatial distribution information of the speaker devices outside the target moving area; Based on the spatial distribution information, determining the relative position relationship between the speaker devices in the target moving area and the relative position relationship between the speaker devices outside the target moving area; According to the relative position relationship, the speaker devices in the target moving area are divided into a plurality of speaker device groups, and the speaker devices outside the target moving area are divided into a plurality of speaker device groups; Determine the volume adjustment parameters for each speaker device group separately.

9. A multi-device collaborative control device for spatial audio perception, characterized in that: include: A scene information acquisition module, used to acquire spatial audio scene information, wherein the spatial audio scene information includes identity information of users in the room and spatial distribution information of audio devices; A demand determination module, used to determine the audio demands of different users in the room according to the spatial audio scene information; A parameter calculation module, used to calculate, according to the audio requirements of the user, a speaker volume adjustment parameter for reducing audio interference between users and ensuring audio privacy; The volume adjustment module is used to adjust the speaker volume according to a preset smooth volume control strategy based on the speaker volume adjustment parameter.

10. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, the steps in the method according to any one of claims 1 to 8 are executed.

Images