Method and device for controlling three-dimensional surround sound of intelligent equipment and intelligent equipment

Abstract

The invention relates to a control method and device for stereo surround sound of intelligent equipment and the intelligent equipment, and the method comprises the steps: determining the audio position information of a first wearing position relative to an ear position based on the first wearing position of a first intelligent wearing component and the ear position of a current user, the first intelligent wearing component is the intelligent wearing component currently worn on the human body in the at least one intelligent wearing component; based on the audio position information, performing sound channel distribution on the audio signal, and determining an audio sound channel corresponding to each first intelligent wearable component; splitting the audio signal to obtain audio sub-signals correspondingly played by each audio channel; and playing the corresponding audio sub-signal through the first intelligent wearable component to obtain the three-dimensional surround sound of the intelligent wearable device relative to the human ear. According to the control method for the stereo surround sound of the intelligent device, the technical problem that multiple intelligent wearable devices cannot give out the stereo surround sound in a linkage mode can be solved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of intelligent devices, and in particular to a control method and device for three-dimensional surround sound of an intelligent device and the intelligent device. BACKGROUND

[0002] With the continuous progress and development of technology, the functions of intelligent devices are becoming more and more rich and diversified. At present, we can see various smart wearable devices on the market, which include not only smart watches and health trackers, but also smart glasses, smart bracelets and various wearable devices. These devices not only have a fashionable appearance, but also integrate many advanced technologies, bringing great convenience to our daily life.

[0003] Although there are more and more smart wearable devices and rich functions, most of them are used as a single unit, such as smart watches and audio glasses, which are used as a single unit to emit sound and cannot be linked to emit three-dimensional surround sound. When multiple smart wearable devices are used at the same time, the user experience is not good.

[0004] Therefore, there is an urgent need in the art for a new technical solution to solve the above technical problems. SUMMARY

[0005] The present application provides a control method and device for three-dimensional surround sound of an intelligent device and the intelligent device to solve the technical problem that multiple smart wearable devices cannot be linked to emit three-dimensional surround sound.

[0006] In a first aspect, the present application provides a control method for three-dimensional surround sound of an intelligent device, the intelligent device being worn on a human body and including at least one smart wearable component, the method comprising:

[0007] determining audio position information of a first smart wearable component relative to a human ear position of a current user based on a first wearing position of the first smart wearable component and the human ear position, the first smart wearable component being a smart wearable component currently worn on the human body among the at least one smart wearable component;

[0008] based on the audio position information, performing channel allocation on an audio signal to determine an audio channel corresponding to each of the first smart wearable components;

[0009] splitting the audio signal to obtain an audio sub-signal corresponding to the playback of each of the audio channels;

[0010] playing the corresponding audio sub-signal through the first smart wearable component to obtain three-dimensional surround sound of the smart wearable device relative to the human ear.

[0011] In a possible implementation, after the corresponding audio sub-signals are played by the first smart wearable component to obtain the surround sound of the smart wearable device relative to the human ear, the method further includes:

[0012] In the case that the first smart wearable component is worn, the smart wearable component is added or deleted to obtain a second smart wearable component;

[0013] Based on the second smart wearable component, the surround sound is adjusted.

[0014] In a possible implementation, in the case that the smart wearable component is added to obtain the second smart wearable component, the adjusting of the surround sound based on the second smart wearable component includes:

[0015] Based on the added wearing position of the added smart wearable component and the position of the human ear, added position information of the added wearing position relative to the position of the human ear is determined;

[0016] A third smart wearable component adjacent to the added smart wearable component is determined.

[0017] Based on the added position information, a split audio channel corresponding to the added smart wearable component is split from an audio channel corresponding to the third smart wearable component;

[0018] The surround sound is adjusted by playing an audio sub-signal corresponding to the split audio channel through the added smart wearable component.

[0019] In a possible implementation, the splitting of the split audio channel corresponding to the added smart wearable component from the audio channel corresponding to the third smart wearable component based on the added position information includes:

[0020] An added orientation relationship between the added position information and audio position information corresponding to the third smart wearable component is determined.

[0021] Referring to the added orientation relationship, the audio channel corresponding to the third smart wearable component is processed to obtain an initial split channel.

[0022] In the case that a channel direction of the initial split channel matches a channel direction corresponding to the added position information, the initial split channel is taken as the split audio channel.

[0023] In the case that the channel direction of the initial split channel does not match the channel direction corresponding to the added position information, the channel direction of the initial split channel is adjusted based on the added position information to obtain the split audio channel.

[0024] In a possible implementation, in a case where the smart wearable component is deleted to obtain the second smart wearable component, the adjusting the surround sound based on the second wearing position of the second smart wearable component comprises:

[0025] determining, based on the to-be-deleted wearing position of the to-be-deleted smart wearable component and the human ear position, deletion position information of the to-be-deleted wearing position relative to the human ear position;

[0026] determining a fourth smart wearable component adjacent to the to-be-deleted smart wearable component;

[0027] based on the deletion position information, merging an audio channel corresponding to the to-be-deleted smart wearable component into an audio channel corresponding to the fourth smart wearable component to obtain a merged audio channel corresponding to the fourth smart wearable component;

[0028] playing, through the fourth smart wearable component, an audio sub-signal corresponding to the merged audio channel to adjust the surround sound.

[0029] In a possible implementation, the merging, based on the deletion position information, of the audio channel corresponding to the to-be-deleted smart wearable component into the audio channel corresponding to the fourth smart wearable component to obtain the merged audio channel corresponding to the fourth smart wearable component comprises:

[0030] merging the audio channel corresponding to the to-be-deleted smart wearable component into the audio channel corresponding to the fourth smart wearable component to obtain an initial merged channel;

[0031] adjusting, based on the deletion position information, a channel direction of the initial merged channel to obtain the merged audio channel.

[0032] In a possible implementation, after the playing, through the first smart wearable component, of the corresponding audio sub-signal to obtain the surround sound of the smart wearable device relative to the human ear, the method further comprises:

[0033] obtaining sound effect direction information formed by the audio channel corresponding to the first smart wearable component;

[0034] comparing the sound effect direction information with preset direction information to obtain a sound effect direction comparison result;

[0035] in a case where the sound effect direction comparison result indicates that the sound effect direction information does not match the preset direction information, determining direction offset information between the sound effect direction information and the preset direction information;

[0036] adjusting the audio channel corresponding to the first smart wearable component according to the direction offset information.

[0037] In a second aspect, the embodiments of the present application provide a control device for a smart device for a three-dimensional surround sound, the smart device being worn on a human body and comprising at least one smart wearable component, the device comprising:

[0038] an audio position determination module configured to determine audio position information of a first wearable position of a first smart wearable component relative to a human ear position of a current user based on the first wearable position and the human ear position, the first smart wearable component being a smart wearable component of the at least one smart wearable component that is currently worn on the human body;

[0039] a channel allocation module configured to perform channel allocation on an audio signal based on the audio position information to determine an audio channel corresponding to each of the first smart wearable components;

[0040] an audio signal splitting module configured to split the audio signal to obtain an audio sub-signal corresponding to a playback of each of the audio channels;

[0041] an audio playback module configured to play the corresponding audio sub-signal through the first smart wearable component to obtain a three-dimensional surround sound of the smart wearable device relative to the human ear.

[0042] In a third aspect, the embodiments of the present application provide a smart device comprising a control component, a smart wearable component, and a sound pickup component to perform the control method for a three-dimensional surround sound of the smart device as claimed in claims 1 to 7, the control component, the smart wearable component, and the sound pickup component being wirelessly connected.

[0043] In a possible implementation, the smart wearable component comprises at least one or more of audio glasses, a smart watch, a smart bracelet, an audio necklace, and an audio hat.

[0044] The control method for a three-dimensional surround sound of a smart device provided by the embodiments of the present application can dynamically adjust the output effect of the three-dimensional surround sound of the smart wearable device relative to the human ear by monitoring and intelligently analyzing the specific position information of the smart wearable device worn on the human body, including but not limited to the head, neck, wrist, and other parts, and the sound information in the environment, such as environmental noise, sound frequency, and other parameters, to automatically optimize the propagation direction, volume, and sound quality of the sound according to the actual wearing state and use environment of the user, thereby significantly improving the auditory experience and device use comfort of the user in various scenarios. This intelligent sound control method not only considers ergonomic factors, but also fully combines environmental acoustic characteristics, so that the output of the three-dimensional surround sound is more in line with human auditory perception rules, and finally realizes personalized and intelligent high-quality audio experience. BRIEF DESCRIPTION OF DRAWINGS

[0045] The accompanying drawings, which are incorporated herein and constitute part of the specification, illustrate embodiments consistent with the present application and, together with the description, further serve to explain the principles of the application.

[0046] In order to more clearly illustrate the technical solutions of the embodiments of the present application or the prior art, the accompanying drawings needed to be used in the embodiments or prior art description will be briefly introduced as follows. Obviously, for those of ordinary skill in the art, the other drawings can also be obtained based on these drawings without any creative work.

[0047] One or more embodiments are illustrated by way of example in the drawings that are not intended to be limiting of the application, and the same or similar reference numerals designate similar components throughout the drawings and their corresponding detailed description, which is meant to be illustrative only and not restrictive of the application, unless otherwise specified herein. The drawings are not necessarily drawn to scale.

[0048] Figure 1 The flow of the control method of the smart device stereo surround sound provided by the embodiments of the present application Figure 1 .

[0049] Figure 2 The flow of the control method of the smart device stereo surround sound provided by the embodiments of the present application Figure 2 .

[0050] Figure 3 The flow of the control method of the smart device stereo surround sound provided by the embodiments of the present application Figure 3 .

[0051] Figure 4 The flow of the control method of the second and third smart wearable devices provided by the embodiments of the present application Figure 1 .

[0052] Figure 5 The use flowchart of the second smart wearable device provided by the embodiments of the present application.

[0053] Figure 6 The flow of the control method of the second and third smart wearable devices provided by the embodiments of the present application Figure 2 .

[0054] Figure 7 The flowchart of the control method of the fourth smart wearable device provided by the embodiments of the present application.

[0055] Figure 8 The schematic diagram of the control device of the smart device stereo surround sound provided by the embodiments of the present application.

[0056] Figure 9 The schematic diagram of the smart device provided by the embodiments of the present application. DETAILED DESCRIPTION

[0057] In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative work belong to the scope of protection of the present application.

[0058] At present, there are various kinds of intelligent wearable devices on the market, and the functions are increasingly rich and diverse. However, most of these devices are used as independent individuals. For example, smart watches, audio glasses and the like independently emit sound, and lack linkage between each other. Therefore, they cannot achieve the effect of stereo surround sound. When a user attempts to use multiple intelligent wearable devices at the same time, due to the lack of synergy, the overall use experience is often unsatisfactory.

[0059] Embodiments of the present application aim to at least make up for the defects of the above-mentioned intelligent wearable devices, and therefore a control method and device for stereo surround sound of intelligent devices and intelligent devices are proposed to solve the technical problem that multiple intelligent wearable devices cannot emit stereo surround sound in linkage.

[0060] Specifically, as shown in the figure, Figure 1 The embodiments of the present application provide a control method for stereo surround sound of intelligent devices. The intelligent devices are worn on the human body and include at least one intelligent wearable component. The method includes the following steps:

[0061] S1: determining audio position information of a first wearable position relative to a human ear position based on the first wearable position of a first intelligent wearable component and the human ear position of a current user, the first intelligent wearable component being an intelligent wearable component currently worn on the human body among the at least one intelligent wearable component;

[0062] S2: performing channel allocation on an audio signal based on the audio position information to determine an audio channel corresponding to each first intelligent wearable component;

[0063] S3: splitting the audio signal to obtain an audio sub-signal corresponding to the playback of each audio channel;

[0064] S4: playing the corresponding audio sub-signal through the first intelligent wearable component to obtain stereo surround sound of the intelligent wearable device relative to the human ear.

[0065] Specifically, the embodiments of the present application propose an innovative method for controlling the three-dimensional surround sound of intelligent devices, which is particularly suitable for intelligent device systems worn on the human body. The intelligent device system includes one or more intelligent wearable components, which create an immersive three-dimensional sound experience for the user through precise spatial positioning and audio processing technology.

[0066] In a specific example, the specific implementation steps of the method are as follows:

[0067] First, the system will perform precise spatial position calculation based on the specific wearing position of the first intelligent wearable component currently worn on the user, combined with the current actual ear position information of the user obtained through the sensor. This step will determine the three-dimensional spatial coordinate relationship of the first wearable component relative to the user's ears, thereby obtaining key audio position parameters, including distance, azimuth angle, and elevation angle, etc. Among them, the first intelligent wearable component refers to any one or more intelligent wearable components that are currently actually worn on the user.

[0068] After obtaining the accurate audio position information, the system will use audio processing algorithms to perform intelligent channel allocation processing on the input audio signals according to these spatial parameters. This process will consider the sound source positioning principle and human ear hearing characteristics to allocate the most suitable audio channel configuration for each first intelligent wearable component, ensuring the accuracy of sound spatial positioning.

[0069] After completing the channel allocation, the system will perform fine splitting processing on the original audio signal. Through digital signal processing technology, the composite audio signal is decomposed into multiple independent audio sub-signals, each sub-signal corresponds to a specific audio channel allocated before, and the corresponding sound effect optimization processing is performed for the spatial position of the channel.

[0070] Finally, the system will control each first intelligent wearable component to play its corresponding optimized audio sub-signal synchronously. Through precise time control and phase adjustment, these wearable components distributed at different positions on the user's body can work cooperatively to form a three-dimensional surround sound field with precise spatial positioning in the user's ears, providing the user with an immersive auditory experience.

[0071] In an additional example, in order to further enhance the three-dimensional surround sound effect, the system will monitor the user's head movement and position changes in real time. Through integrated sensors such as accelerometers, gyroscopes, etc., the intelligent device can capture the user's head movements in real time and feed these data back to the audio processing unit. The audio processing unit will dynamically adjust the parameters of the audio signal, including volume, pitch, and time delay, etc., according to the head movement data, to ensure that the user can maintain accurate spatial positioning of the sound regardless of how the head moves. This dynamic adjustment mechanism enables the user to experience a coherent and consistent surround sound effect during movement.

[0072] In addition, the system can also automatically adjust the audio output according to the user's personal hearing preferences and environmental noise levels. Through the built-in environmental noise detector and user interface, users can set their personal hearing preferences, such as bass enhancement, treble boost, etc., and the system will adjust the audio output accordingly to meet the individual needs of different users.

[0073] To achieve a more advanced user experience, the smart device can also wirelessly connect to external audio sources such as smartphones, tablets, or home theater systems. Through Bluetooth, Wi-Fi, or other wireless technologies, users can easily synchronize external audio content to the smart device and enjoy seamless multi-device audio experiences.

[0074] To ensure the stability and durability of the device, the control method of the smart device also includes self-diagnosis and maintenance functions. The system will regularly check the working status of each component, including battery level, connection status, and audio output quality, and provide warnings or automatically perform repair procedures when any potential problems are detected.

[0075] Through these steps, the smart device stereo surround sound control method provided by the embodiments of the present application not only provides high-quality audio experience, but also adapts to the dynamic changes of users, ensuring consistent auditory enjoyment in various environments.

[0076] In one possible implementation, as shown in Figure 2 After step S4: playing the corresponding audio sub-signal through the first smart wearable component to obtain the stereo surround sound of the smart wearable device relative to the human ear, the method further includes:

[0077] S5: In the case of wearing the first smart wearable component, add or delete smart wearable components to obtain a second smart wearable component;

[0078] S6: Adjust the surround stereo based on the second smart wearable component.

[0079] In one specific example, first, in the case of the user continuously wearing the first smart wearable component, the system can dynamically add or delete smart wearable components according to actual use requirements, thereby forming a second smart wearable component configuration. Specifically, when it is necessary to enhance the surround sound effect, additional smart wearable components can be added; conversely, when it is necessary to simplify the device configuration, some smart wearable components can be removed. This flexible component adjustment method allows the system to adapt to different use scenarios and user preferences.

[0080] Subsequently, the system will intelligently adjust the original surround sound effect based on the newly formed second smart wearable component configuration. This adjustment process includes but is not limited to recalculating the distribution ratio of audio signals, optimizing sound field positioning algorithms, and calibrating the cooperative working parameters between components. Through this dynamic adjustment mechanism, the system can ensure that the user can enjoy the best surround sound experience under any component configuration, while maintaining the coherence and stability of the sound effect.

[0081] In addition, the process of adjusting the surround sound also involves fine processing of audio signals to ensure the clarity and accuracy of sound positioning. The system will redistribute the intensity and phase of audio sub-signals according to the layout and number of the second smart wearable components to achieve more accurate sound positioning. For example, if the newly added smart wearable component is located at the back of the user, the system will adjust the intensity and delay of the rear audio signal accordingly to ensure that the sound can be emitted from the correct position, thereby enhancing the user's immersion.

[0082] During the adjustment process, the system may also use advanced audio processing techniques such as Head-Related Transfer Function (HRTF) models to simulate the effect of sound on the human ear when emitted from different positions. In this way, the system can provide users with a more natural and realistic auditory experience. In addition, the system may also integrate machine learning algorithms to automatically optimize the surround sound settings by analyzing the user's auditory feedback and preferences, achieving personalized customization.

[0083] Finally, through the above steps, the system can ensure that the user can still enjoy high-quality surround sound effects after the change of smart wearable components. This adaptive audio processing mechanism not only improves the flexibility and comfort of user experience, but also opens up new possibilities for the application of smart wearable devices in the audio field.

[0084] In one possible implementation, as shown in Figure 4 When a new smart wearable component is added, resulting in a second smart wearable component, step S6: adjusting the surround sound based on the second smart wearable component includes:

[0085] S6-1: based on the new wearing position of the new smart wearable component and the position of the human ear, determine the new position information of the new wearing position relative to the position of the human ear;

[0086] S6-2: determine the third smart wearable component adjacent to the new smart wearable component;

[0087] S6-3: based on the new position information, split the split audio channel corresponding to the new smart wearable component from the audio channel corresponding to the third smart wearable component;

[0088] S6-4: Play the audio sub-signals corresponding to the split audio channels through the newly added smart wearable component, and adjust the surround sound.

[0089] In one specific example, when the system detects the addition of a new smart wearable component and successfully builds a second smart wearable component, the adjustment process in step S6 for surround sound can be detailed as follows:

[0090] First, the system accurately calculates the spatial relationship between the specific wearing position of the newly added smart wearable component and the human ear, obtains detailed orientation data of the new wearing position relative to the human ear position through three-dimensional spatial positioning technology, including distance, angle, and height difference, and other new position information; Next, the system intelligently identifies the third smart wearable component closest to the new component and with audio output function as the reference benchmark; Then, the system will use advanced audio signal processing algorithms to separate the split audio channels suitable for the new component to play from the original audio channels corresponding to the third smart wearable component according to the previously obtained new position space information; Finally, the system will coordinate the control of the newly added smart wearable component to accurately play the audio sub-signals corresponding to the split audio channels allocated to it. Through this dynamic allocation and collaborative playback mechanism, the self-adaptive optimization adjustment of the entire surround sound field is realized, ensuring that users can still obtain the best immersive audio experience after adding wearable devices.

[0091] In an additional example, the embodiments of the present application also provide the following control method:

[0092] Evaluate the surround sound effect by capturing the user's current auditory feedback through the built-in microphone array, analyze the balance and positioning accuracy of the surround sound field, and ensure that the addition of the new smart wearable component does not negatively affect the overall sound field;

[0093] According to the evaluation results, dynamically adjust the audio signal processing parameters such as gain, delay, and equalizer settings to optimize the sound propagation path and frequency response, ensuring the clarity and consistency of the sound in different positions;

[0094] Implement real-time feedback loop, continuously monitor user experience of surround sound, use machine learning algorithms to continuously learn user preferences and environmental changes, and automatically fine-tune audio output to adapt to user's auditory habits and dynamic changes in the space environment;

[0095] When necessary, exchange data with other smart wearable components through wireless communication technology, share intermediate results and final adjustment parameters of audio processing, realize the collaborative work of the entire smart wearable device ecosystem, and ensure the continuity and consistency of surround sound, regardless of user movement or changes in wearing position.

[0096] Through these steps, the system not only can adapt to the addition of a single smart wearable component, but also can ensure that the entire surround sound system continuously provides a high-quality audio experience in a dynamically changing environment. This ability of self-adaptation and self-optimization makes the smart wearable device more flexible and efficient in providing personalized audio experiences.

[0097] In one possible implementation, as shown in FIG. 6, the method comprises the following steps: Figure 5 In step S6-3, based on the new position information, the third smart wearable component corresponding audio channel is split to obtain the split audio channel corresponding to the new smart wearable component, which includes:

[0098] S6-3-1: Determine the new orientation relationship between the new position information and the audio position information corresponding to the third smart wearable component;

[0099] S6-3-2: Referring to the new orientation relationship, the third smart wearable component corresponding audio channel is split to obtain the initial split channel;

[0100] S6-3-3: In the case that the channel direction of the initial split channel matches the channel direction corresponding to the new position information, the initial split channel is taken as the split audio channel;

[0101] S6-3-4: In the case that the channel direction of the initial split channel does not match the channel direction corresponding to the new position information, the channel direction of the initial split channel is adjusted based on the new position information to obtain the split audio channel.

[0102] In one specific example, in step S6-3, the following operation steps are specifically included:

[0103] First, the spatial orientation relationship between the position information of the new device and the audio position information currently recorded by the third smart wearable component needs to be accurately calculated and determined, including but not limited to relative distance, angle, height difference and other spatial parameters, which constitute a complete description of the new orientation relationship;

[0104] According to the specific parameters of the new orientation relationship calculated above, the corresponding audio signal processing algorithm is used to perform intelligent channel separation processing on the multi-channel audio data currently recorded by the third smart wearable component, and the initial split channel corresponding to the new device is preliminarily generated through spatial audio reconstruction technology;

[0105] The directionality of the initially generated initial split channel is verified, and when it is detected that the spatial direction attribute of the initial split channel completely matches the ideal channel direction required by the position information of the new device, the initial split channel is directly determined as the final available split audio channel;

[0106] If it is found that the actual directional characteristics of the initial split sound channel deviate from or do not match the ideal sound channel direction required by the new position information, directional adjustment and optimization processing of the initial split sound channel based on the specific position parameters of the new device need to be performed using an audio spatial correction algorithm, and the final split audio sound channel that meets the requirements is obtained after accurate calibration.

[0107] In one specific example of the present embodiment, for example, the existing smart wearable components include a smart watch and an audio necklace, and the newly added smart wearable component is an audio hat. When the user wears the newly added audio hat, the system will split an initial split sound channel corresponding to the audio hat based on the existing multi-channel audio data of the audio necklace. Subsequently, the initial split sound channel is verified based on the relative position information of the audio hat and the audio necklace. When it is detected that the spatial directional attributes of the initial split sound channel completely match the ideal sound channel direction required by the position information of the audio hat, the initial split sound channel is directly determined as the final available split audio sound channel. If it is found that the actual directional characteristics of the initial split sound channel deviate from or do not match the ideal sound channel direction required by the position information of the audio hat, directional adjustment and optimization processing of the initial split sound channel based on the specific position parameters of the audio hat need to be performed using an audio spatial correction algorithm, and the final split audio sound channel that meets the requirements is obtained after calibration. For example, the audio hat is located directly above the audio necklace, and directional adjustment of the initial split sound channel in the upward direction is required to match the ideal sound channel of the audio hat.

[0108] In an additional example, during the adjustment of the direction of the initial split sound channel, the propagation characteristics of sound in different environments also need to be considered, such as the attenuation and reflection characteristics of sound in open environments and closed spaces are different. Therefore, environmental adaptability adjustment of the split sound channel is required to ensure the authenticity and naturalness of sound in a specific environment;

[0109] In addition, in order to further improve the user experience, advanced audio enhancement technologies such as 3D sound effect rendering technology can be used for in-depth processing of the split audio sound channel to enhance the spatial sense and immersion of the sound, so that the user can experience stable and coherent audio experience even during movement;

[0110] After the above steps are completed, a series of test verifications need to be performed to ensure that the quality of the split audio sound channel meets the predetermined technical standards and user expectations. This includes but is not limited to sound clarity tests, spatial positioning accuracy tests, and sound compatibility tests between different devices;

[0111] Finally, the adjusted and verified split audio channels are merged with the original audio data to form a complete multi-channel audio output. This process needs to ensure a smooth transition between the new and old audio data, avoiding any jarring auditory effects, thus providing a seamless audio experience for the user.

[0112] In one possible implementation, as shown in FIG. 6, in the case of deleting the smart wearable component to obtain a second smart wearable component, in step S6: adjusting the surround sound based on the second wearing position of the second smart wearable component includes: Figure 6

[0113] S6-5: determining, based on the to-be-deleted wearing position of the to-be-deleted smart wearable component and the human ear position, deletion position information of the to-be-deleted wearing position relative to the human ear position;

[0114] S6-6: determining a fourth smart wearable component adjacent to the to-be-deleted smart wearable component;

[0115] S6-7: based on the deletion position information, merging the audio channel corresponding to the to-be-deleted smart wearable component into the audio channel corresponding to the fourth smart wearable component to obtain a merged audio channel corresponding to the fourth smart wearable component;

[0116] S6-8: playing, by the fourth smart wearable component, an audio sub-signal corresponding to the merged audio channel to adjust the surround sound.

[0117] In one specific example, when the system needs to delete a certain smart wearable component and obtain a second smart wearable component, first, the system accurately calculates the spatial position relationship of the to-be-deleted component relative to the human ear, i.e., the deletion position information, based on the specific wearing position of the to-be-deleted smart wearable component and the actual position of the user's ear. Then, the system intelligently identifies the fourth smart wearable component adjacent to the to-be-deleted component. After obtaining these key information, the system intelligently merges the audio channel originally responsible for the to-be-deleted component with the audio channel corresponding to the fourth component to generate a merged audio channel exclusive to the fourth component. Finally, the system plays the merged audio sub-signal through the fourth smart wearable component to dynamically adjust and optimize the original surround sound field, ensuring that the user can still obtain a high-quality surround sound experience even with fewer wearable devices.

[0118] In one additional example, after completing the above steps, the system further performs the following operations to ensure that the adjustment of the surround sound reaches the best effect:

[0119] ​Firstly, the system analyzes the acoustic characteristics of the current environment, including the size and shape of the room, as well as the sound-absorbing properties of the interior decoration materials, to appropriately compensate and adjust the audio signals. Then, the system dynamically adjusts the delay and intensity of the audio signals based on the user's auditory preferences and head movement data, to simulate a more natural and accurate sound field positioning.

[0120] In addition, the system also monitors the user's activity state in real time, such as walking, sitting or lying down, and fine-tunes the surround sound according to different activity states to adapt to the user's auditory needs in different scenarios. For example, when the user changes from standing to lying down, the system automatically adjusts the propagation direction and intensity of the audio signals to simulate a sound field effect that is more consistent with the auditory perception in the lying-down state.

[0121] To further enhance user experience, the system may also incorporate artificial intelligence algorithms to automatically optimize the processing parameters of the audio signals by learning the user's listening habits and preferences. In this way, over time, the system can provide more accurate personalized surround sound experience for the user.

[0122] Finally, the system provides a user interface that allows the user to manually adjust various parameters of the surround sound, such as volume balance, bass and treble adjustment, etc., to ensure that the user can make detailed personalized settings according to personal preferences. Through this combination of automatic adjustment and manual fine-tuning, the system can ensure that the user can enjoy the best surround sound effect in any situation.

[0123] In one possible implementation, as shown in FIG. 6, in step S6-7, based on the deletion position information, the audio channel corresponding to the smart wearable component to be deleted is merged into the audio channel corresponding to the fourth smart wearable component, to obtain a merged audio channel corresponding to the fourth smart wearable component, which includes: Figure 7

[0124] S6-7-1: Merge the audio channel corresponding to the smart wearable component to be deleted into the audio channel corresponding to the fourth smart wearable component to obtain an initial merged channel;

[0125] S6-7-2: Adjust the channel direction of the initial merged channel based on the deletion position information to obtain the merged audio channel.

[0126] In one specific example, in step S6-7, the specific operation steps are as follows:

[0127] First, the audio channel data of the smart wearable component to be deleted and the original audio channel data of the fourth smart wearable component are obtained, and the two audio channels are preliminarily mixed by an audio signal processing algorithm to generate an initial merged channel, which contains the audio feature information of the component to be deleted and the fourth component;​

[0128] Then according to the pre-acquired spatial coordinate information of the deleted position, the spatial orientation parameters of the initial merged audio channel are recalculated and adjusted, the directivity of the channel is optimized through spatial audio processing technology, and finally a merged audio channel meeting the spatial audio positioning requirements is generated, ensuring that the merged audio channel can accurately reflect the spatial position relationship of the fourth smart wearable component in the system.

[0129] In one specific example of the present embodiment, for example, existing smart wearable components include smart watches and audio necklaces. When the existing audio necklace is lost, the system deletes the audio channel data of the existing audio necklace and looks for a new audio necklace to replace it. The deleted audio channel data is directly copied to the new audio necklace, and the original audio channel data copied from the deleted audio necklace is merged with the new audio necklace to obtain a new audio channel data as the initial merged audio channel of the new audio necklace. Based on the deleted position information, if the initial merged audio channel matches the channel requirements of the deleted position information, no adjustment of the channel is needed, and the initial merged audio channel can be directly used as the merged audio channel. If the initial merged audio channel does not match the channel requirements of the deleted position information, the initial merged audio channel is adjusted based on the deleted position information, for example, the new audio necklace is positioned to the left of the original audio necklace, and the initial merged audio channel is adjusted to the left, i.e., the channel requirements of the new audio necklace are met.

[0130] In addition, when the lost audio necklace is found again, the system automatically identifies and reassigns the original audio channel data to the found audio necklace, without the need for re-calibration.

[0131] In an additional example, the embodiments of the present application can also perform audio quality optimization processing on the merged audio channel to ensure the clarity and naturalness of the sound. This step includes equalizer adjustment of the merged channel to balance the loudness of different frequency components, and application of noise reduction algorithms to remove possible background noise or unnecessary interference, thereby improving the purity of the auditory experience. The embodiments of the present application can also integrate the optimized merged audio channel with other audio content in the system, ensuring that when played, the merged audio channel can be consistent with environmental sound effects, background music and other audio elements, thereby providing a coherent and immersive auditory environment for the user. The integration process may involve volume balancing, time synchronization and other techniques to ensure that all audio elements are harmonious and unified in time and volume.

[0132] Through the above steps, it can be ensured that after deleting a specific smart wearable component, the audio channel of the fourth smart wearable component can effectively absorb and integrate the audio information of the deleted component, while maintaining the audio quality and maintaining the coherence of the overall auditory experience.

[0133] In a possible implementation, as shown in Figure 3 After the step S4 of playing the corresponding audio sub-signals through the first smart wearable component to obtain the stereo surround sound of the smart wearable device relative to the human ear, the method further includes:

[0134] S7: obtaining the sound effect direction information formed by the audio channels corresponding to the first smart wearable component;

[0135] S8: comparing the sound effect direction information with the preset direction information to obtain a sound effect direction comparison result;

[0136] S9: in the case that the sound effect direction comparison result indicates that the sound effect direction information does not match the preset direction information, determining the direction offset information between the sound effect direction information and the preset direction information;

[0137] S10: adjusting the audio channels corresponding to the first smart wearable component according to the direction offset information.

[0138] In a specific example, the following specific operation steps are further included:

[0139] Real-time collection and analysis of the sound effect direction data actually produced by each audio channel corresponding to the first smart wearable component to obtain the specific sound effect direction information formed in the current audio playing process;

[0140] Accurate comparison of the actually obtained sound effect direction information with the system preset standard direction information, calculation of the difference between the two through an algorithm, and thus obtaining the detailed sound effect direction comparison result;

[0141] When the sound effect direction comparison result clearly shows that there is a significant deviation between the actual sound effect direction information and the preset standard direction information, the specific direction offset between the two is further calculated and determined, including the detailed information such as the horizontal direction offset angle and the vertical direction offset angle;

[0142] Based on the calculated direction offset information, the audio channels corresponding to the first smart wearable component are dynamically adjusted, including but not limited to adjusting the channel delay time, volume balance, phase parameter, etc., to ensure that the finally output sound effect direction completely matches the preset standard direction.

[0143] In the specific example of the present embodiment, the sound effect of one first smart wearable component can be adjusted, such as taking a smart watch as the first smart wearable component. When the direction information of the smart watch does not match the preset information, for example, the direction is left, the channel data of the smart watch should be adjusted according to the angle and direction of the direction offset to obtain the required audio channel. The angle and direction adjustment can be adjusted according to the actual situation, which will not be described here.

[0144] In addition, the example can also combine adjacent first smart wearable components, and adjust the overall sound effect of multiple first smart wearable components, such as a smart watch and a smart ring as a group of first smart wearable components, compare the overall direction information of the combination with the preset information, and then perform the above adjustment to obtain an audio channel that meets the overall sound effect.

[0145] In one additional example, after adjusting the audio channel corresponding to the first smart wearable component, the adjusted sound effect direction information is continuously monitored to ensure that the adjustment achieves the desired effect.

[0146] If the monitoring result shows that the adjusted sound effect direction information still deviates from the preset direction information, steps S8 to S10 are repeated until the sound effect direction information matches the preset direction information.

[0147] After confirming that the sound effect direction information matches the preset direction information, the next step is entered to ensure the continuous stability of the sound effect.

[0148] Real-time monitoring of environmental factors such as user head movement, external noise level changes, etc., which may affect the accuracy of the sound effect direction;

[0149] According to the real-time monitored environmental factors, the preset direction information is dynamically adjusted to adapt to environmental changes and maintain the accuracy and stability of the sound effect direction.

[0150] If the environmental factors change and the preset direction information needs to be updated, steps S7 to S10 are re-executed to ensure that even in the case of environmental changes, the sound effect direction information can be consistent with the updated preset direction information.

[0151] After all adjustments are completed, the system will automatically record the current adjustment parameters to quickly reproduce the same sound effect direction effect in a similar environment, improving the coherence and comfort of the user experience.

[0152] Finally, the system will enter a continuous monitoring mode to continuously optimize and fine-tune the audio channel settings to ensure that the stereo surround sound effect provided by the smart wearable device is always in the best state.

[0153] The embodiments of the present application further provide a stereo surround sound control device for a smart device, as shown in Figure 8 The smart device is designed as a wearable device system that can be worn on the human body, which includes at least one smart wearable functional component. Specifically, the control device is composed of the following core functional modules:

[0154] An audio position pinpointing module, which is specially used to calculate the three-dimensional audio positioning data of the first smart wearable component relative to the human ear through a spatial positioning algorithm according to the real-time positional relationship between the actual wearing position of the first smart wearable component and the user's ears, wherein the first smart wearable component refers to any one of the smart wearable components currently worn by the user;

[0155] A smart sound channel distribution module, which is used to perform smart sound channel distribution processing on the input multi-channel audio signal by using advanced audio processing technology based on the aforementioned audio position information, so as to determine the most suitable audio output channel for each first smart wearable component in the wearing state;

[0156] An audio signal smart processing module, which is responsible for performing accurate digital splitting processing on the original audio signal, and decomposing the composite audio signal into independent audio sub-signal streams corresponding to each sound channel through a specific signal processing algorithm;

[0157] An audio playing module, which plays the processed audio sub-signal through the high-fidelity loudspeaker system built in the first smart wearable component, so as to realize the immersive stereo surround sound experience with precise spatial positioning effect at the user's ear position.

[0158] The embodiment of the present application also provides a complete smart device, as shown in the accompanying drawings. Figure 9 As shown in the accompanying drawings, the system is composed of a smart control unit, a wearable device component and an environment pickup device, and the components are interconnected through stable wireless communication protocols, and jointly complete the entire functional process of the above-mentioned smart device stereo surround sound control method.

[0159] In the specific embodiment, the smart wearable component can adopt various forms of smart wearable devices, including but not limited to: smart glasses with audio function, smart watches with audio output capability, smart bracelets integrated with loudspeakers, smart necklaces with audio modules, smart hats with built-in audio systems, and one or more combinations of the above devices. These wearable devices can be flexibly matched according to the actual needs of the user to jointly build a personalized stereo surround sound system.

[0160] According to the method for controlling the intelligent device stereo surround sound provided by the embodiment of the present application, the specific wearing position information of the intelligent wearable device on the human body is monitored in real time and analyzed in depth by using an artificial intelligence algorithm. The position information includes, but is not limited to, key parts such as the head (such as the wearing angle of earphones), the neck (such as a neck-mounted device), or the wrist (such as a smartwatch). At the same time, multi-dimensional sound information parameters in the environment are combined, such as environmental noise decibel values, sound frequency distribution characteristics, sound field reflection conditions, and various acoustic indicators. Based on the complex data collected in real time, the system can intelligently and dynamically adjust the stereo surround sound output effect of the intelligent wearable device relative to the human ear, including key parameters such as sound field positioning accuracy and sound propagation path optimization. The method innovatively realizes automatic optimization of the propagation direction vector, volume size gradient, and sound quality effect parameters (including high-frequency extension and low-frequency depth) of sound according to the real-time changes in the actual wearing state (such as wearing tightness and wearing angle) of the user and the use environment (such as indoor, outdoor, noisy, or quiet scenes), thereby significantly improving the auditory immersion and device wearing comfort of the user in various scenes such as mobile office, entertainment and leisure, and sports and fitness. This intelligent sound regulation method not only fully considers ergonomic factors (such as the reflection of the auricle structure on sound), but also deeply integrates environmental acoustic characteristics (such as space reverberation time and sound absorption coefficient), so that the output of stereo surround sound is more in line with the physiological and psychological laws of human auditory perception, and finally realizes personalized customization, adaptive adjustment, and intelligent high-quality audio experience, greatly improving the user's satisfaction and product competitiveness.

[0161] It is to be understood that the terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. The terms "comprises", "comprising", "includes", "including" and "has" are inclusive and therefore specify the presence of stated features, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and / or groups thereof. The method steps, processes, and operations described herein are not to be construed as necessarily requiring their performance in the particular order in which they are described, unless specifically indicated as such. It is also to be understood that additional or alternative steps can be employed.

[0162] The foregoing is considered as illustrative only of the principles of the application. Numerous modifications and changes will readily occur to those skilled in the art, and it is intended to embrace all such modifications and changes that fall within the scope of the application. Accordingly, the application is not to be restricted in scope to the specific embodiments disclosed herein but is to be accorded the full scope that the principles and novel features request appropriately granted.

Claims

1. A method for controlling stereo surround sound in a smart device, the smart device being worn on the human body and comprising at least one smart wearable component, characterized in that... The method includes: Based on the first wearing position of the first smart wearable component and the current ear position of the user, the audio position information of the first wearing position relative to the ear position is determined, wherein the first smart wearable component is the smart wearable component currently worn on the human body among the at least one smart wearable component. Based on the audio location information, the audio signal is channel-assigned to determine the audio channel corresponding to each of the first smart wearable components; The audio signal is split to obtain the audio sub-signal played for each audio channel; By playing the corresponding audio sub-signal through the first smart wearable component, the smart wearable device obtains stereo surround sound relative to the human ear.

2. The control method for stereo surround sound in intelligent devices according to claim 1, characterized in that, After obtaining stereo surround sound relative to the human ear by playing the corresponding audio sub-signal through the first smart wearable component, the method further includes: While wearing the first smart wearable component, adding or deleting the smart wearable component yields a second smart wearable component. The surround sound is adjusted based on the second smart wearable component.

3. The control method for stereo surround sound in intelligent devices according to claim 2, characterized in that, When the second smart wearable component is obtained by adding the new smart wearable component, adjusting the surround sound based on the second smart wearable component includes: Based on the new wearing position of the newly added smart wearable component and the position of the human ear, determine the new position information of the new wearing position relative to the position of the human ear; Identify the third smart wearable component adjacent to the newly added smart wearable component; Based on the newly added location information, the split audio channel corresponding to the newly added smart wearable component is obtained by splitting the audio channel corresponding to the third smart wearable component. The newly added smart wearable component plays the audio sub-signals corresponding to the split audio channels, thereby adjusting the stereo surround sound.

4. The control method for stereo surround sound in intelligent devices according to claim 3, characterized in that, The step of obtaining the split audio channel corresponding to the newly added smart wearable component from the audio channel corresponding to the third smart wearable component based on the newly added location information includes: Determine the new directional relationship between the newly added location information and the audio location information corresponding to the third smart wearable component; Referring to the newly added directional relationship, the audio channel corresponding to the third smart wearable component is split to obtain the initial split audio channel; If the channel direction of the initial split channel matches the channel direction corresponding to the newly added position information, the initial split channel is used as the split audio channel. If the channel direction of the initial split channel does not match the channel direction corresponding to the newly added position information, the channel direction of the initial split channel is adjusted based on the newly added position information to obtain the split audio channel.

5. The control method for stereo surround sound in intelligent devices according to claim 2, characterized in that, In the case of deleting the smart wearable component to obtain the second smart wearable component, adjusting the surround sound based on the second wearing position of the second smart wearable component includes: Based on the wear position to be deleted of the smart wearable component and the position of the human ear, the deletion position information of the wear position to be deleted relative to the position of the human ear is determined; Identify the fourth smart wearable component adjacent to the smart wearable component to be deleted; Based on the deletion location information, the audio channel corresponding to the smart wearable component to be deleted is merged into the audio channel corresponding to the fourth smart wearable component to obtain the merged audio channel corresponding to the fourth smart wearable component. The fourth smart wearable component plays the audio sub-signal corresponding to the merged audio channel to adjust the stereo surround sound.

6. The control method for stereo surround sound in intelligent devices according to claim 5, characterized in that, Based on the deletion location information, the audio channel corresponding to the smart wearable component to be deleted is merged into the audio channel corresponding to the fourth smart wearable component to obtain the merged audio channel corresponding to the fourth smart wearable component, including: The audio channel corresponding to the smart wearable component to be deleted is merged into the audio channel corresponding to the fourth smart wearable component to obtain the initial merged channel; Based on the deletion location information, the channel direction of the initial merged audio channel is adjusted to obtain the merged audio channel.

7. The control method for stereo surround sound in intelligent devices according to claim 1, characterized in that, After obtaining stereo surround sound relative to the human ear by playing the corresponding audio sub-signal through the first smart wearable component, the method further includes: Obtain the sound effect direction information formed by the audio channel corresponding to the first smart wearable component; The sound effect direction information is compared with the preset direction information to obtain the sound effect direction comparison result; If the sound effect direction comparison result indicates that the sound effect direction information does not match the preset direction information, determine the direction offset information between the sound effect direction information and the preset direction information; The audio channel corresponding to the first smart wearable component is adjusted according to the directional offset information.

8. A control device for stereo surround sound in a smart device, the smart device being worn on the human body, comprising at least one smart wearable component, characterized in that... The device includes: An audio location determination module is configured to perform an audio location determination based on a first wearable location of a first smart wearable component and the current user's ear location, wherein the first smart wearable component is the smart wearable component currently worn on the human body among the at least one smart wearable components. The channel allocation module is configured to perform channel allocation of the audio signal based on the audio location information, and determine the audio channel corresponding to each of the first smart wearable components; An audio signal splitting module is configured to split the audio signal to obtain audio sub-signals for each audio channel. The audio playback module is configured to play corresponding audio sub-signals through the first smart wearable component to obtain stereo surround sound of the smart wearable device relative to the human ear.

9. A smart device, characterized in that, It includes a control component, a smart wearable component, and a sound pickup component to perform the control method for stereo surround sound of a smart device as described in claims 1 to 7, wherein the control component, the smart wearable component, and the sound pickup component are all wirelessly connected.

10. The intelligent device according to claim 9, characterized in that, The smart wearable components include at least one or more of the following: audio glasses, smartwatches, smart bracelets, audio necklaces, and audio hats.

Images