Immersive AI interaction and voiceprint recognition methods, devices, and media for the Sound Intelligence Film

Abstract

The present invention provides a method and device for immersive AI interaction and voiceprint recognition of a sound-intelligence membrane, wherein the method includes: in response to the current user wearing the current interactive device, determining whether there is a device matching relationship with the current interactive device based on obtaining the current voiceprint information; when it is determined that there is a device matching relationship, capturing elements based on user interest for spatial elements existing in the current visual interface corresponding to the current interactive device, and determining the obtained spatial elements as interest elements based on the capture results; in response to the disappearance of the interest elements from the current visual interface, determining the collaborative visual interface of each collaborative interactive device that has a collaborative interconnection relationship with the current interactive device, and sending the interest elements to the current interactive device for display if the interest elements exist in the collaborative visual interface. The present invention can continuously and synchronously display the interest elements obtained based on element capture within the sound-intelligence membrane space.

Description

Technical Field

[0001] The present invention relates to data processing technology, and in particular to a method, device, and medium for immersive AI interaction and voiceprint recognition using a sound intelligence membrane. Background Art

[0002] Modern multimedia sound-intelligence membrane spaces primarily utilize high-strength flexible membrane materials (such as PVDF-coated polyester fiber and PTFE fiberglass membrane) as the primary load-bearing component. By continuously applying a slight positive pressure to the interior, a load-bearing shell structure is formed. The core principle is to utilize air pressure differentials to taut the membrane, replacing the traditional beam-column system of architecture to achieve unsupported, long-span coverage. This structure offers advantages such as lightweight, short construction cycles, and high space utilization, making it widely used in sports stadiums, cultural exhibition halls, and environmental protection facilities.

[0003] With the expansion of AR technology, users have higher demands for the personalization and continuity of immersive interaction. In the existing technology, in the application scenario where users use corresponding interactive devices in the sound intelligent membrane space to display augmented reality, the acquisition of interest elements based on user interest in spatial elements located in the sound intelligent membrane space is limited to a single device, which has corresponding limitations and lacks content relay based on field of view association, and cannot solve the interaction fault problem caused by user perspective movement.

[0004] Therefore, how to continuously and synchronously display the elements of interest obtained based on element capture in the sound intelligence membrane space in real time has become an urgent problem that needs to be solved. Summary of the Invention

[0005] Based on the above problems, the present invention is proposed to provide a method, device and medium for immersive AI interaction and voiceprint recognition of the sound intelligent membrane that overcomes the above problems or at least partially solves the above problems.

[0006] According to one aspect of the present invention, a method for immersive AI interaction and voiceprint recognition using a sound intelligence membrane is provided, comprising the following steps:

[0007] In response to a current user in the sound intelligence membrane space wearing a current interactive device, determining whether a device matching relationship exists between the current interactive device and the current interactive device based on the acquired current voiceprint information corresponding to the current user;

[0008] When it is determined that there is a device matching relationship, the spatial elements existing in the current field of view interface corresponding to the current interactive device are captured based on the user's interest, and the obtained spatial elements are determined as interest elements based on the capture results;

[0009] In response to the disappearance of the interest element from the current field of view interface, a collaborative field of view interface corresponding to each collaborative interactive device having a collaborative interconnection relationship with the current interactive device is determined, and if the interest element exists in the collaborative field of view interface, the interest element carrying sound data is sent to the current interactive device for display.

[0010] Optionally, in the method according to the present invention, in response to a current user located in the sound intelligence membrane space wearing a current interactive device, determining whether a device matching relationship exists with the current interactive device based on the acquired current voiceprint information corresponding to the current user includes:

[0011] When it is determined that the distance monitoring value output by the distance acquisition device set on the current interactive device is less than the preset distance value, the current interactive device is controlled to acquire an image of the corresponding eyeball acquisition area to obtain an eyeball acquisition image;

[0012] Binarization is performed on the eyeball captured image, and in response to the presence of eye black pixel points corresponding to eye black pixel values ​​in the obtained binary image, point connection is performed on corresponding adjacent positions of all eye black pixel points to obtain an eye black area;

[0013] In response to a region similarity between the black eye region and the retrieved preset comparison region being greater than a preset similarity, determining that the current device is worn on the current interactive device;

[0014] Control the current interactive device to output voice collection prompt information and collect voiceprints to obtain the current voiceprint information corresponding to the current user;

[0015] Determine whether a device matching relationship exists with the current interactive device based on the current voiceprint information.

[0016] Optionally, in the method according to the present invention, determining whether there is a device matching relationship with the current interactive device based on the current voiceprint information includes:

[0017] Retrieving pre-stored voiceprint information corresponding to the current interactive device;

[0018] In response to the current voiceprint information being identical to the pre-stored voiceprint information, determining that there is a device matching relationship with the current interactive device;

[0019] In response to the current voiceprint information being different from the pre-stored voiceprint information, retrieving an authority level tree, wherein the authority level tree includes authority nodes corresponding to different authority levels;

[0020] In response to the current voiceprint information being identical to the node voiceprint information corresponding to any authority node, determining the authority level corresponding to the authority node as the target level, and determining the authority level corresponding to the current interactive device as the device level;

[0021] In response to the target level being greater than the device level, it is determined that a device matching relationship exists with the current interactive device.

[0022] Optionally, in the method according to the present invention, capturing spatial elements existing in the current field of view interface corresponding to the current interactive device based on user interest, and determining the obtained spatial elements as interest elements based on the capture results, includes:

[0023] Determine the elements based on the current visual field interface corresponding to the current interactive device, and obtain each spatial element of the thin sound quality space corresponding to the current visual field interface of the current interactive device;

[0024] Obtaining the center point of the interface corresponding to the current field of view interface, and establishing a capture area of ​​a corresponding preset size with the center point of the interface as the center;

[0025] In response to any spatial element being located in the capture area, the spatial element is aggregated into an interest screening group, and a timed task corresponding to a preset retention time is established based on the interest screening group;

[0026] Based on the timed task, determine that any spatial element in the interest screening group is located in the capture area for the preset retention time, obtain the element distance between the spatial element and the center point of the interface, and determine the spatial element with the smallest corresponding element distance as the interest element.

[0027] Optionally, in the method according to the present invention, the method further comprises:

[0028] Determining, based on the current visual interface, that the element of interest moves to a position outside the capture area, generating an external marking frame surrounding the element of interest, and determining, based on pixelation processing of the current visual interface, all interface pixel points that are away from the element of interest and corresponding to adjacent positions of the external marking frame;

[0029] An interface pixel value corresponding to each interface pixel point is obtained, the interface pixel value is adjusted based on a preset pixel adjustment strategy, and pixel rendering is performed on the external marking frame based on the obtained updated pixel value.

[0030] Optionally, in the method according to the present invention, adjusting the interface pixel value based on a preset pixel adjustment strategy includes:

[0031] In response to the interface pixel value being less than a preset first pixel value, summing the interface pixel value and a reference pixel value to obtain an adjusted updated pixel value;

[0032] In response to the interface pixel value being greater than a preset second pixel value, performing a difference calculation between the interface pixel value and a reference pixel value to obtain an adjusted updated pixel value;

[0033] In response to the interface pixel value being located in a preset pixel interval consisting of a preset first pixel value and a preset second pixel value, the interface pixel value is determined as an updated pixel value.

[0034] Optionally, in the method according to the present invention, when the interest element exists in the collaborative vision interface, sending the interest element carrying sound data to the current interactive device for display includes:

[0035] In response to the presence of the interest element in the collaborative view interface of any collaborative interaction device, aggregating the collaborative view interface into a collaborative determination group;

[0036] Determine the presence ratio of the interest element corresponding to each collaborative AR interface in the collaborative determination group, and determine the collaborative field of view interface with the largest corresponding presence ratio as the target field of view interface;

[0037] In response to obtaining an overlay display request input by the current user based on the current interactive device, the target visual field interface is sent to the current interactive device to overlay the current visual field interface;

[0038] In response to obtaining an independent display request input by the current user based on the current interactive device, the target field of view interface is intercepted based on the interest element, and the obtained interest interception content carrying sound data is sent to the current interactive device to fill the current field of view interface.

[0039] Optionally, in the method according to the present invention, performing interface interception based on the interest element on the target field of view interface, and sending the obtained interest interception content to the current interactive device to fill the current field of view interface, includes:

[0040] Establishing a device coordinate system with the current interactive device as the coordinate origin, wherein the axis extension direction of the Y axis of the device coordinate system is the same as the device orientation corresponding to the current interactive device;

[0041] Determining a device coordinate point of the corresponding collaborative interaction device in the device coordinate system based on a relative positional relationship between the collaborative interaction device corresponding to the target visual field interface and the current interaction device;

[0042] Dividing the current visual field interface to obtain a primary display area and secondary display areas surrounding the primary display area, and performing grid processing on the secondary display areas to obtain sliding display windows of a preset window size arranged in a line;

[0043] Establishing an interface coordinate system with the center point of the interface corresponding to the current field of view interface as the coordinate origin, and establishing a coordinate mapping relationship between the interface coordinate system and the device coordinate system;

[0044] Establishing a coordinate connection line between the device coordinate point and the coordinate origin, and forming a sliding indication line on the current field of view interface based on the coordinate mapping relationship;

[0045] The sliding display window pointed to by the sliding indicator line is determined as the target display window, and the target field of view interface is intercepted based on the interest element corresponding to the preset window size, and the obtained interest intercepted content is filled into the target display window.

[0046] Optionally, in the method according to the present invention, determining the sliding display window pointed to by the sliding indicator line as the target display window, performing an interface capture of the target field of view interface corresponding to the preset window size based on the interest element, and filling the target display window with the obtained interest capture content includes:

[0047] In response to the indicating endpoint of the sliding indicating line being located at the window outline of any sliding display window, determining the sliding display window as a target display window, and determining the sliding display windows located on both sides of the target display window as a first side window and a second side window;

[0048] Clearing the contents of the target display window, the first side window, and the second side window based on the current visual field interface to form a blank combined window consisting of the target display window, the first side window, and the second side window;

[0049] The target field of view interface is captured with a preset window size centered on the interest element, and the obtained interest capture content is filled into the blank combination window, wherein the content center point corresponding to the interest capture content and the indication endpoint are in the same vertical position.

[0050] According to another aspect of the present invention, a sound intelligent membrane immersive AI interaction and voiceprint recognition device is provided, comprising:

[0051] a matching determination module configured to, in response to a current user in the sound intelligence membrane space wearing a current interactive device, determine whether a device matching relationship exists with the current interactive device based on the acquired current voiceprint information corresponding to the current user;

[0052] The interest capture module is configured to, when determining that a device matching relationship exists, capture spatial elements existing in the current field of view interface corresponding to the current interactive device based on user interest, and determine the obtained spatial elements as interest elements based on the capture results;

[0053] The collaborative display module is configured to respond to the disappearance of the interest element from the current field of view interface, determine the collaborative field of view interface corresponding to each collaborative interactive device that has a collaborative interconnection relationship with the current interactive device, and when the interest element exists in the collaborative field of view interface, send the interest element carrying sound data to the current interactive device for display.

[0054] According to another aspect of the present invention, a readable storage medium storing program instructions is provided. When the program instructions are read and executed by a computing device, the computing device executes the above-mentioned immersive AI interaction and voiceprint recognition method of the Sound Intelligence Membrane.

[0055] According to the solution of the present invention, the present invention has a full-process design of voiceprint recognition, element of interest capture, and multi-device collaborative display, which can specifically include the following beneficial effects: First, determining the device matching relationship through voiceprint information can replace traditional password input or manual authorization, realizing "wear and use" contactless authentication, significantly improving the interaction efficiency of users wearing interactive devices. At the same time, the uniqueness of voiceprint as a biometric feature can effectively ensure the security of device usage permissions and prevent unauthorized users from using the device. Next, when the device matching relationship is determined, the spatial elements of the current field of view interface are captured based on the user's interest. By setting the capture area with the center of the interface as the core and a timed task mechanism, the user's visual focus can be accurately located and interference elements can be filtered out, ensuring that the captured element of interest truly reflects the content that the user continues to pay attention to. Finally, when the element of interest disappears from the current field of view interface, the collaborative field of view interface of the collaborative interactive device is determined and sent to the current device for display when the element of interest exists. This can compensate for the limitations of the field of view of a single device, ensure that the element of interest focused on by the user is not interrupted by the movement of the viewing angle, and realize real-time synchronous display of the element of interest, significantly improving the naturalness, continuity and personalized experience of AR interaction, and enhancing the interactive coherence and spatial immersion when multiple devices are linked. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] Figure 1 A flowchart of a method for immersive AI interaction and voiceprint recognition using a sound intelligent film according to an embodiment of the present invention is shown;

[0057] Figure 2 Schematic diagram of the device coordinate system in this embodiment is shown;

[0058] Figure 3 A schematic diagram of filling the current field of view with the captured content of interest in this embodiment is shown;

[0059] Figure 4 A structural block diagram of a sound-intelligence film immersive AI interaction and voiceprint recognition device according to another embodiment of the present invention is shown. DETAILED DESCRIPTION

[0060] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0061] To address the aforementioned problems in the prior art, the inventors have proposed the present invention. One embodiment of the present invention provides a method for immersive AI interaction and voiceprint recognition using a sound-inspired membrane. This method can be executed on a computing device, which can be understood as a terminal with data processing capabilities, such as a mobile phone or computer.

[0062] Figure 1 A flowchart of a method for immersive AI interaction and voiceprint recognition using a sound intelligent membrane according to an embodiment of the present invention is shown. Figure 1 As shown, the method starts at step S1, and in step S1, includes the following contents:

[0063] In response to the current user in the sound intelligent membrane space wearing the current interactive device, it is determined whether there is a device matching relationship with the current interactive device based on the current voiceprint information corresponding to the current user.

[0064] For example, in this embodiment, after the current user enters the sound intelligent membrane space, in order to improve the current user's immersive experience in the sound intelligent membrane space, he or she may choose to wear the relevant current interactive device. Here, the current interactive device and the subsequently mentioned collaborative interactive device can be understood as corresponding terminals with augmented reality display functions, such as AR glasses; after the current user completes wearing the current interactive device, he or she can improve the augmented reality experience for participating in or visiting the sound intelligent membrane space, and in order to improve the customization for each current user, a device matching relationship between the current user and the corresponding current interactive device can be established in advance, that is, it is necessary to ensure that there is a device association relationship between the current interactive device worn by the current user and the current interactive device before the current user can start using the corresponding current interactive device.

[0065] Therefore, when the current user enters the audio-visual membrane space and selects any current interactive device to wear, the server will respond to this wearing action and actively obtain the current voiceprint information of the current user. It can be explained that the acquisition of the current voiceprint information is based on the core link of biometric identification. Its function is to identify each person through their unique voiceprint characteristics. The server can then determine whether there is a device matching relationship between the current voiceprint information and the current interactive device based on the current voiceprint information, thereby realizing contactless identity authentication through voiceprint recognition, avoiding the tedious process of traditional password input or manual authorization, and improving the interaction efficiency of users wearing interactive devices; at the same time, voiceprints are unique as biometric features, which can effectively ensure the security of device usage rights and prevent unauthorized users from using the device.

[0066] Furthermore, in this embodiment, the above-mentioned "response to the current user in the sound intelligent membrane space wearing the current interactive device, and determining whether there is a device matching relationship with the current interactive device based on the current voiceprint information obtained corresponding to the current user" may also include the following steps:

[0067] When it is determined that the distance monitoring value output by the distance acquisition device set on the current interactive device is less than the preset distance value, the current interactive device is controlled to acquire an image of the corresponding eyeball acquisition area to obtain an eyeball acquisition image;

[0068] Binarization is performed on the eyeball captured image, and in response to the presence of eye black pixel points corresponding to eye black pixel values ​​in the obtained binary image, point connection is performed on corresponding adjacent positions of all eye black pixel points to obtain an eye black area;

[0069] In response to a region similarity between the black eye region and the retrieved preset comparison region being greater than a preset similarity, determining that the current device is worn on the current interactive device;

[0070] Control the current interactive device to output voice collection prompt information and collect voiceprints to obtain the current voiceprint information corresponding to the current user;

[0071] Determine whether a device matching relationship exists with the current interactive device based on the current voiceprint information.

[0072] For example, in this embodiment, the process of confirming that the current user is wearing the current interactive device and determining whether a device matching relationship exists can be specifically implemented based on the following method steps:

[0073] First, when the current user in the Sound Intelligence Membrane space attempts to wear the current interactive device, the distance acquisition device installed on the current interactive device monitors the distance between the current user and the current interactive device in real time. If the output distance monitoring value is less than the preset distance value (such as the safe distance close to the face), the first step is triggered: the current interactive device is controlled to capture an image of the eyeball acquisition area to obtain the original eyeball image. The purpose of this step is to preliminarily determine whether the wearing action has occurred based on the distance threshold to avoid false triggering when the user is not wearing the device.

[0074] Then, the eyeball collection image is binarized to convert the eyeball collection image into a black and white pixel matrix. If there are eye black pixel points with corresponding eye black pixel values ​​in the binary image, it indicates that the eyeball collection area may have the eye features corresponding to the current user. In this case, all the eye black pixel points can be connected to form a complete eye black area.

[0075] Next, the system retrieves a preset comparison area (e.g., a standard black eye area model stored in the device) and calculates the similarity between the current black eye area and the preset comparison area. If the regional similarity is greater than a preset similarity (e.g., 80%), the user is determined to have successfully worn the current interactive device. This step improves the accuracy of wear detection through physiological feature matching and avoids false positives caused by simple distance detection (e.g., when the user holds the device close to them but is not wearing it).

[0076] Then, after confirming the wearing status, the server can further control the current interactive device to output voice collection prompt information (such as "Please speak the verification voice"), and simultaneously start the voiceprint collection function to obtain the current voiceprint information of the current user. It can be explained that the role of voiceprint collection is to use biometrics for identity identification and provide a unique identity credential for subsequent device matching;

[0077] Finally, based on the current voiceprint information collected, the logic of determining the device matching relationship can be executed to improve interaction efficiency and security. In scenarios where multiple people share interactive devices (for example, the sound intelligent membrane space corresponds to an opera house, stadium, etc.), different users can be automatically distinguished and given corresponding permissions to prevent unauthorized access, which meets the interaction needs of "wear and use, safe and convenient" in intelligent scenarios.

[0078] Furthermore, in this embodiment, the above-mentioned “determining whether there is a device matching relationship with the current interactive device based on the current voiceprint information” may further include the following steps:

[0079] Retrieving pre-stored voiceprint information corresponding to the current interactive device;

[0080] In response to the current voiceprint information being identical to the pre-stored voiceprint information, determining that there is a device matching relationship with the current interactive device;

[0081] In response to the current voiceprint information being different from the pre-stored voiceprint information, retrieving an authority level tree, wherein the authority level tree includes authority nodes corresponding to different authority levels;

[0082] In response to the current voiceprint information being identical to the node voiceprint information corresponding to any authority node, determining the authority level corresponding to the authority node as the target level, and determining the authority level corresponding to the current interactive device as the device level;

[0083] In response to the target level being greater than the device level, it is determined that a device matching relationship exists with the current interactive device.

[0084] For example, in this embodiment, after obtaining the current voiceprint information corresponding to the current user, it is possible to further determine whether there is a device matching relationship with the current interactive device based on the following method steps:

[0085] First, the server can retrieve the pre-stored voiceprint information corresponding to the current interactive device (i.e., the device's preset authorized user voiceprint library) based on the collected current voiceprint information corresponding to the current user, and compare the voiceprints of the two;

[0086] Then, the server determines whether the current voiceprint information is the same as the pre-stored voiceprint information. If they are the same, it directly determines that there is a device matching relationship between the current user and the current interactive device, and allows access to all functions of the device;

[0087] If the current voiceprint information is different from the pre-stored voiceprint information, the server can further call the preset permission level tree (a tree structure that stores permission nodes of different permission levels). The introduction of the permission level tree is intended to handle scenarios where unregistered users have specific permissions, avoiding the rigid matching logic of "either white or black";

[0088] Next, the server can traverse all the permission nodes in the permission level tree to find whether there is a node voiceprint information that matches the current voiceprint information. If any matching node voiceprint information is found, it will indicate that the current user corresponds to the permission node. At this time, the permission level corresponding to the permission node can be determined as the target level, and the permission level of the current interactive device itself (that is, the highest permission level that the device can open) can be obtained simultaneously;

[0089] Finally, the server compares the target level with the device level: if the target level is greater than the device level, it is still determined that there is a device matching relationship. For example, in the same company team, when an employee with a higher authority level uses a current interactive device with a lower authority level, even if the pre-stored voiceprint information of the current interactive device is different from the current voiceprint information obtained of the employee with a higher authority level, the device access right can still be obtained. At the same time, the device only opens a subset of functions that matches its level to allow temporary authorization or cross-authority access based on the authority level tree.

[0090] In step S2, the following contents are included:

[0091] When it is determined that there is a device matching relationship, the spatial elements existing in the current field of view interface corresponding to the current interactive device are captured based on the user's interest, and the obtained spatial elements are determined as interest elements based on the capture results.

[0092] For example, in this embodiment, after determining that there is a corresponding device matching relationship between the current user and the current interactive device, the current user can perform corresponding augmented reality display through the current interactive device, and can also perform element capture based on user interest for the spatial elements displayed in the current field of view interface of the current interactive device (that is, the real scene elements existing in the sound intelligent membrane space, for example, when the sound intelligent membrane space corresponds to an opera house, the real scene elements may include violinists, pianists, singers, etc.); it can be explained that the essence of element capture is to analyze the user's visual attention tendencies in the field of view interface, and filter out the objects that the user is actually interested in from many spatial elements, so as to avoid users from manually marking or searching for target content through automated interest element capture, thereby greatly improving the convenience of AR interaction.

[0093] Furthermore, in this embodiment, the above-mentioned "capturing spatial elements existing in the current field of view interface corresponding to the current interactive device based on user interest, and determining the obtained spatial elements as interest elements based on the capture results" may also include the following steps:

[0094] Determine the elements based on the current visual field interface corresponding to the current interactive device, and obtain each spatial element of the thin sound quality space corresponding to the current visual field interface of the current interactive device;

[0095] Obtaining the center point of the interface corresponding to the current field of view interface, and establishing a capture area of ​​a corresponding preset size with the center point of the interface as the center;

[0096] In response to any spatial element being located in the capture area, the spatial element is aggregated into an interest screening group, and a timed task corresponding to a preset retention time is established based on the interest screening group;

[0097] Based on the timed task, determine that any spatial element in the interest screening group is located in the capture area for the preset retention time, obtain the element distance between the spatial element and the center point of the interface, and determine the spatial element with the smallest corresponding element distance as the interest element.

[0098] For example, in this embodiment, capturing elements based on the current visual field interface to obtain corresponding elements of interest may specifically include the following method steps:

[0099] First, the server can identify and determine all spatial elements in the corresponding thin sound space displayed in the current visual interface of the current interactive device, including obtaining basic information such as the element position and element type of each spatial element;

[0100] Then, the server obtains the center point of the current field of view interface and establishes a capture area of ​​a preset size (e.g., a rectangular area) with the center point of the interface as the center. It should be noted that the capture area is determined based on the center point of the interface because, in human visual perception, the center area is generally the focus area. Therefore, the capture area can be used to effectively narrow the screening range of elements of interest;

[0101] Next, if any spatial element is within the capture area, the server aggregates it into an interest screening group and creates a scheduled task with a preset retention time (e.g., 5 seconds) for this group. The purpose of the scheduled task is to filter out interfering elements that enter the capture area instantaneously, ensuring that only persistent elements are included as candidates.

[0102] Finally, when the scheduled task confirms that a spatial element in the interest filtering group is continuously in the capture area for the preset retention time, the server can calculate the distance between the spatial element and the element at the center point of the interface, and determine the spatial element with the smallest distance as the interest element. It can be explained that distance is used as the final screening criterion because the closer the element is to the visual center, the higher the user's attention. This logic conforms to the laws of human visual cognition.

[0103] In addition, based on the above content, it can be known that the corresponding element of interest can be determined by setting a corresponding capture area, and the capture area is located at the center of the current field of view interface, that is, the focus area of ​​the current user (that is, the center area of ​​the field of view). Therefore, the current user can quickly locate the element of interest; it can be explained that since the current user can move on his own when wearing the current interactive device, the position of each spatial element located in the current field of view interface can also be synchronously transformed during the movement. If the current user causes the element of interest to be located outside the capture area due to movement, it corresponds to the edge of the current field of view interface, that is, the non-focus area of ​​the user (that is, the edge area of ​​the field of view). At this time, in order to assist the current user in quickly locating the corresponding element of interest in this case, in this embodiment, the following steps may also be included:

[0104] Determining, based on the current visual interface, that the element of interest moves to a position outside the capture area, generating an external marking frame surrounding the element of interest, and determining, based on pixelation processing of the current visual interface, all interface pixel points that are away from the element of interest and corresponding to adjacent positions of the external marking frame;

[0105] An interface pixel value corresponding to each interface pixel point is obtained, the interface pixel value is adjusted based on a preset pixel adjustment strategy, and pixel rendering is performed on the external marking frame based on the obtained updated pixel value.

[0106] For example, in this embodiment, marking the interest element when the interest element moves outside the capture area can be specifically implemented based on the following method steps:

[0107] First, when the server determines that the element of interest has moved outside the capture area based on the current field of view interface, it can generate an external marker frame surrounding the element of interest. The function of the external marker frame is to visually highlight the element of interest and distinguish it from the background, so that the user can quickly locate it.

[0108] Then, the server may further perform pixelation processing on the current visual field interface, decompose the image into pixel units, and determine all interface pixel points that are away from the element of interest and adjacent to the external marking frame;

[0109] Finally, the pixel value of each interface pixel point can be obtained, and the pixel value can be adjusted based on the preset pixel adjustment strategy, and the pixel rendering of the external marker box can be performed based on the adjusted updated pixel value. It can be explained that the adjacent pixel points far away from the element of interest are selected for processing in order to contrast the marker box by adjusting the visual features of the background area, avoid the fusion of the marker box and the background, and make the marker box form a clear visual boundary in the field of view.

[0110] Furthermore, in this embodiment, the above-mentioned “adjusting the pixel value of the interface based on a preset pixel adjustment strategy” may further include the following steps:

[0111] In response to the interface pixel value being less than a preset first pixel value, summing the interface pixel value and a reference pixel value to obtain an adjusted updated pixel value;

[0112] In response to the interface pixel value being greater than a preset second pixel value, performing a difference calculation between the interface pixel value and a reference pixel value to obtain an adjusted updated pixel value;

[0113] In response to the interface pixel value being located in a preset pixel interval consisting of a preset first pixel value and a preset second pixel value, the interface pixel value is determined as an updated pixel value.

[0114] For example, in this embodiment, the process of adjusting the interface pixel value can be implemented based on the following method steps:

[0115] For example, the preset first pixel value, the preset second pixel value, and the reference pixel value can all be set by the user. It can be explained that, since the pixel value range is 0 to 256, the reference pixel value can be 50, the preset first pixel value is 90 to 100, and the preset second pixel value is 190 to 200. In this embodiment, the interface pixel value can be adjusted based on the comparison between the interface pixel value and the preset first pixel value and the preset second pixel value, and based on the comparison results, the preset first pixel value is less than the preset second pixel value.

[0116] Specifically, if the pixel value of the interface is less than the preset first pixel value, the pixel value is summed with the reference pixel value to obtain the updated pixel value after brightening. This step is used to improve the visual contrast by brightening the dark area and preventing the marker box from blending with the dark background.

[0117] If the interface pixel value is greater than the preset second pixel value, the interface pixel value is subtracted from the reference pixel value to obtain the updated pixel value after darkening. This operation can prevent the bright background area from visually interfering with the mark frame and highlight the mark boundary by reducing the background brightness;

[0118] If the pixel value of the interface is within the interval formed by the preset first pixel value and the preset second pixel value (i.e., the neutral tone area), the original pixel value is directly determined as the updated pixel value to avoid excessive adjustment of the neutral tone area and causing image distortion;

[0119] It can be explained that differentiated processing is adopted for backgrounds of different brightness. Without destroying the overall texture of the original picture, the visual contrast between the marking box and the background is significantly enhanced, which can ensure that the elements of interest always maintain high recognition in various environments, reduce the problem of users losing their targets due to background interference, and improve the smoothness and reliability of AR interaction.

[0120] In step S3, the following contents are included:

[0121] In response to the disappearance of the interest element from the current field of view interface, a collaborative field of view interface corresponding to each collaborative interactive device having a collaborative interconnection relationship with the current interactive device is determined, and if the interest element exists in the collaborative field of view interface, the interest element carrying sound data is sent to the current interactive device for display.

[0122] For example, in this embodiment, it can be explained that when the current user is wearing the current interactive device and moving in the sound-intelligent membrane space, the elements of interest in the field of view may disappear due to changes in perspective. Based on this, when the server detects that the determined elements of interest in the current field of view interface of the current interactive device disappear, it will respond to this event, automatically search for all collaborative interactive devices that have a collaborative interconnection relationship with the current interactive device, and obtain the collaborative field of view interfaces of these collaborative devices to further detect whether the element of interest still exists in any collaborative field of view interface. If so, the element of interest carrying sound data will be sent to the current interactive device for redisplay; thereby, through the field of view collaboration between multiple devices, the limitations of the field of view of a single device are compensated, ensuring that the elements of interest that the user is concerned about will not be interrupted due to the movement of perspective, thereby improving the continuity and immersion of AR interaction, reducing the operating cost of users manually switching perspectives or searching for targets, and realizing the "seamless relay" of elements of interest through collaborative interconnection between devices, thereby enhancing the smoothness and intelligence of the user experience.

[0123] It can be explained that the sound data can be understood as the relevant sound generated in the collaborative vision interface where the interest element is located.

[0124] Furthermore, in this embodiment, the above-mentioned “when the interest element exists in the collaborative vision interface, sending the interest element carrying sound data to the current interactive device for display” may also include the following steps:

[0125] In response to the presence of the interest element in the collaborative view interface of any collaborative interaction device, aggregating the collaborative view interface into a collaborative determination group;

[0126] Determine the presence ratio of the interest element corresponding to each collaborative AR interface in the collaborative determination group, and determine the collaborative field of view interface with the largest corresponding presence ratio as the target field of view interface;

[0127] In response to obtaining an overlay display request input by the current user based on the current interactive device, the target visual field interface is sent to the current interactive device to overlay the current visual field interface;

[0128] In response to obtaining an independent display request input by the current user based on the current interactive device, the target field of view interface is intercepted based on the interest element, and the obtained interest interception content carrying sound data is sent to the current interactive device to fill the current field of view interface.

[0129] For example, in this embodiment, sending the interest element present in the collaborative vision interface to the current interactive device for display can be specifically implemented based on the following method steps:

[0130] First, when an interesting element is found in the collaborative view interface of any collaborative interaction device, the server aggregates the collaborative view interface into a collaborative determination group to establish a set of collaborative interfaces to be screened, providing a data basis for subsequent precise positioning of the optimal display interface.

[0131] Then, the server calculates the presence ratio of the interest element in each collaborative AR interface within the collaborative determination group (i.e., the area or pixel ratio of the element in the interface), and determines the collaborative field of view interface with the largest presence ratio as the target field of view interface. It can be shown that by selecting the interface with the largest presence ratio, the complete information of the interest element can be displayed to the greatest extent;

[0132] Next, the server can further perform different operations based on the type of request input by the current user through the current interactive device:

[0133] If an overlay display request is received (for example, the user wants to view the element of interest in full screen), the target field of view interface is sent to the current interactive device, directly covering the current field of view interface to achieve full-screen highlighting of the element of interest;

[0134] If an independent display request is received (for example, the user wants to keep other content in the current interface), the target field of view interface is intercepted based on the interest element, and the intercepted content of interest carrying sound data is sent to the current interactive device and filled into the current field of view interface;

[0135] That is, this embodiment can support two display modes: overlay / independent, adapting to the user's interaction needs in different scenarios (such as focused viewing or multitasking), improving the flexibility and immersion of AR interaction, and avoiding the loss of elements of interest due to the limited field of view of the device.

[0136] Furthermore, in this embodiment, the above-mentioned "interface interception of the target field of view interface based on the interest element, and sending the obtained interest interception content to the current interactive device to fill the current field of view interface" may also include the following steps:

[0137] Establishing a device coordinate system with the current interactive device as the coordinate origin, wherein the axis extension direction of the Y axis of the device coordinate system is the same as the device orientation corresponding to the current interactive device;

[0138] Determining a device coordinate point of the corresponding collaborative interaction device in the device coordinate system based on a relative positional relationship between the collaborative interaction device corresponding to the target visual field interface and the current interaction device;

[0139] Dividing the current visual field interface to obtain a primary display area and secondary display areas surrounding the primary display area, and performing grid processing on the secondary display areas to obtain sliding display windows of a preset window size arranged in a line;

[0140] Establishing an interface coordinate system with the center point of the interface corresponding to the current field of view interface as the coordinate origin, and establishing a coordinate mapping relationship between the interface coordinate system and the device coordinate system;

[0141] Establishing a coordinate connection line between the device coordinate point and the coordinate origin, and forming a sliding indication line on the current field of view interface based on the coordinate mapping relationship;

[0142] The sliding display window pointed to by the sliding indicator line is determined as the target display window, and the target field of view interface is intercepted based on the interest element corresponding to the preset window size, and the obtained interest intercepted content is filled into the target display window.

[0143] For example, in this embodiment, filling the captured content of interest obtained by interface capture into the current field of view interface can be specifically implemented based on the following method steps:

[0144] First, a device coordinate system is established with the current interactive device as the coordinate origin. The Y-axis extends in the same direction as the device orientation. This provides a benchmark for the subsequent unified description of the spatial positions of multiple devices, ensuring that the relative positions of different devices can be quantified and calculated.

[0145] Then, based on the relative positional relationship between the collaborative interaction device corresponding to the target field of view interface and the current interaction device, the device coordinate point of the collaborative interaction device is determined in the device coordinate system. That is, by locating the coordinate point, the spatial position of the collaborative interaction device can be converted into a specific value in the coordinate system, laying the foundation for subsequent interface mapping;

[0146] Next, the current field of view interface can be divided into a primary display area (for displaying the current core content) and a secondary display area surrounding it. The secondary display area is then grid-processed to form a sliding display window arranged in a row and presenting a preset window size. This can provide supplementary display space for external elements of interest without blocking the main content, adapting to multi-tasking interaction needs.

[0147] Afterwards, an interface coordinate system is established with the center point of the current field of view interface as the origin, and a coordinate mapping relationship is established between the interface coordinate system and the device coordinate system. Here, through coordinate mapping, the position information in the device space can be converted into pixel coordinates on the interface, achieving accurate conversion from device space to the display interface;

[0148] Next, a coordinate connection line is established between the device coordinate point and the origin of the coordinate system. Based on the coordinate mapping relationship, a sliding indicator line is generated on the current field of view interface. It can be explained that the role of the sliding indicator line is to intuitively reflect the relative position relationship between the collaborative device and the current device on the current field of view interface, providing visual guidance for the user.

[0149] Finally, the sliding display window pointed by the sliding indicator line is determined as the target display window, and the target field of view interface is intercepted with the interest element as the center corresponding to the preset window size, so that the interest intercepted content can be filled into the target display window accordingly, thereby realizing the precise conversion of the spatial position of the interest element between multiple devices, ensuring the relevance of the intercepted content to the user's current perspective, and the sliding display window and the interest intercepted content correspond to the same preset window size, and realize proportional content filling. The design of the corresponding sliding display window and the sliding indicator line not only avoids information overload of the main interface, but also provides users with an intuitive cross-device content navigation method, which can help users quickly obtain the interest element information captured by other devices without switching the main field of view, thereby improving the efficiency and accuracy of cross-device interaction.

[0150] For example, Figure 2 Schematic diagram of the device coordinate system in this embodiment is shown, where: Figure 2 The coordinate connection line connecting the collaborative coordinate point and the coordinate origin of the corresponding device coordinate point (that is, the current VR device) is shown in FIG.

[0151] Furthermore, in this embodiment, the above-mentioned "determining the sliding display window pointed to by the sliding indicator line as the target display window, and performing an interface capture of the target field of view interface corresponding to the preset window size based on the interest element, and filling the target display window with the obtained interest capture content" may further include the following steps:

[0152] In response to the indicating endpoint of the sliding indicating line being located at the window outline of any sliding display window, determining the sliding display window as a target display window, and determining the sliding display windows located on both sides of the target display window as a first side window and a second side window;

[0153] Clearing the contents of the target display window, the first side window, and the second side window based on the current visual field interface to form a blank combined window consisting of the target display window, the first side window, and the second side window;

[0154] The target field of view interface is captured with a preset window size centered on the interest element, and the obtained interest capture content is filled into the blank combination window, wherein the content center point corresponding to the interest capture content and the indication endpoint are in the same vertical position.

[0155] For example, in this embodiment, the process of filling the target display window with the intercepted content of interest based on the determination of the target display window can be specifically performed based on the following method steps:

[0156] First, when the indicating endpoint of the sliding indicator line is located at the window outline of any sliding display window, the server can determine the sliding display window as the target display window and simultaneously determine the sliding display windows on both sides of it as the first side window and the second side window. That is, through the spatial position relationship between the sliding indicator line and the window outline of the corresponding sliding display window, the target display area is accurately positioned to ensure that the display position of the element of interest is consistent with the spatial orientation of the collaborative device;

[0157] Then, the server may clear the contents of the target display window, the first side window, and the second side window based on the current field of view interface, forming a blank combined window consisting of three windows. Here, the purpose of clearing the original content is to avoid information overlap, provide an undisturbed display space for the complete display of the element of interest, and enhance the visual focus effect;

[0158] Finally, the server can capture the target field of view interface with a preset window size centered on the element of interest, and fill the captured content of interest into the blank combination window, wherein the content center point of the captured content of interest must be in the same vertical position as the indicated endpoint.

[0159] It can be explained that by constructing a display area corresponding to the spatial position of the collaborative device in the current field of view, layout confusion is avoided when displaying information on multiple devices. Moreover, by making the content center point and the indication endpoint correspond to the same vertical position, the content layout in the current field of view interface and the relative position of the physical device can be intuitively associated, further strengthening the mapping relationship between virtual content and physical space, reducing the spatial cognitive burden of the current user, and improving the immersive experience for the current user.

[0160] For example, Figure 3 A schematic diagram of filling the current visual field with the captured content of interest in this embodiment is shown, wherein based on Figure 3 and Figure 2 By comparison, it can be determined that Figure 2 The coordinate line connecting the Figure 3 The sliding indicator line has a corresponding mapping relationship.

[0161] In summary, this embodiment, through the full-process design of voiceprint recognition, interest element capture and multi-device collaborative display, can specifically include the following beneficial effects: First, the device matching relationship is determined by voiceprint information, which can replace the traditional password input or manual authorization, and realize the "wear and use" contactless identity authentication, which greatly improves the interaction efficiency of users wearing interactive devices. At the same time, the uniqueness of voiceprint as a biometric feature can effectively protect the security of device usage rights and prevent unauthorized users from using the device; then, when it is determined that there is a device matching relationship, the spatial elements of the current field of view interface are captured based on user interests, and the interface center is used as the core. The capture area setting and timing task mechanism can accurately locate the user's visual focus and filter out interference elements, ensuring that the captured elements of interest truly reflect the user's continued attention to the content; finally, when the element of interest disappears from the current field of view interface, by determining the collaborative field of view interface of the collaborative interactive device and sending it to the current device for display when the element of interest exists, it can make up for the limitations of the field of view of a single device, ensure that the elements of interest that the user is paying attention to will not be interrupted by the movement of the perspective, and realize the real-time synchronous display of the elements of interest, significantly improving the naturalness, continuity and personalized experience of AR interaction, and enhancing the interactive coherence and spatial immersion when multiple devices are linked.

[0162] Another embodiment of the present invention provides an immersive AI interaction and voiceprint recognition device. Figure 4 For its corresponding device block diagram, such as Figure 4 As shown, the device includes:

[0163] a matching determination module configured to, in response to a current user in the sound intelligence membrane space wearing a current interactive device, determine whether a device matching relationship exists with the current interactive device based on the acquired current voiceprint information corresponding to the current user;

[0164] The interest capture module is configured to, when determining that a device matching relationship exists, capture spatial elements existing in the current field of view interface corresponding to the current interactive device based on user interest, and determine the obtained spatial elements as interest elements based on the capture results;

[0165] The collaborative display module is configured to respond to the disappearance of the interest element from the current field of view interface, determine the collaborative field of view interface corresponding to each collaborative interactive device that has a collaborative interconnection relationship with the current interactive device, and when the interest element exists in the collaborative field of view interface, send the interest element carrying sound data to the current interactive device for display.

[0166] Another embodiment of the present invention provides a readable storage medium storing program instructions. When the program instructions are read and executed by a computing device, the computing device executes the immersive AI interaction and voiceprint recognition method of the Sound Intelligence Membrane as mentioned in the above embodiment.

[0167] In the description provided herein, the algorithms and displays are not inherently related to any particular computer, virtual system, or other device. Various general-purpose systems may also be used in conjunction with the examples of the present invention. Based on the above description, it is apparent that the structure required for constructing such systems is well understood. In addition, the present invention is not directed to any specific programming language. It should be understood that various programming languages ​​may be utilized to implement the present invention described herein, and the description of specific languages ​​above is provided for the purpose of disclosing preferred embodiments of the present invention.

[0168] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures, and techniques are not shown in detail so as not to obscure the understanding of this description.

[0169] Similarly, it should be understood that in order to streamline the disclosure and aid in understanding one or more of the various inventive aspects, in the above description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together into a single embodiment, figure, or description thereof.

[0170] Those skilled in the art will appreciate that the modules, units, or components of the devices in the examples disclosed herein may be arranged in the device described in the embodiment, or alternatively may be located in one or more devices different from the devices in the examples. The modules in the foregoing examples may be combined into one module or further divided into multiple submodules.

[0171] Those skilled in the art will appreciate that the modules in the devices of the embodiments can be adaptively changed and installed in one or more devices different from the embodiments. The modules, units, or components in the embodiments can be combined into one module, unit, or component, and furthermore, they can be divided into multiple submodules, subunits, or subcomponents.

[0172] Furthermore, those skilled in the art will appreciate that although some embodiments described herein include certain features and not other features included in other embodiments, the combination of features from different embodiments is intended to be within the scope of the invention and to form different embodiments.

[0173] In addition, some of the embodiments are described herein as methods or combinations of method elements that can be implemented by a processor of a computer system or by other devices that perform the functions described. Thus, a processor having the necessary instructions for implementing the method or method element forms a device for implementing the method or method element. Furthermore, the elements described herein of the device embodiments are examples of devices for implementing the functions performed by the elements for the purpose of implementing the invention.

[0174] As used herein, unless otherwise specified, the use of ordinal numbers "first," "second," "third," etc. to describe common objects merely indicates that different instances of similar objects are involved and are not intended to imply that the objects so described must have a given order in time, space, ranking, or in any other manner.

[0175] Although the present invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of the foregoing description, will appreciate that other embodiments are contemplated within the scope of the invention thus described. Furthermore, it should be noted that the language used in this specification has been selected primarily for readability and instructional purposes and is not selected to explain or limit the subject matter of the present invention.

Claims

1. A method for immersive AI interaction and voiceprint recognition using a sound intelligence membrane, characterized in that: The following steps are involved: In response to a current user in the sound intelligence membrane space wearing a current interactive device, determining whether a device matching relationship exists between the current interactive device and the current interactive device based on the acquired current voiceprint information corresponding to the current user; When it is determined that there is a device matching relationship, the spatial elements existing in the current field of view interface corresponding to the current interactive device are captured based on the user's interest, and the obtained spatial elements are determined as interest elements based on the capture results; In response to the disappearance of the interest element from the current visual interface, determining a collaborative visual interface corresponding to each collaborative interactive device having a collaborative interconnection relationship with the current interactive device; In response to the presence of the interest element in the collaborative view interface of any collaborative interaction device, aggregating the collaborative view interface into a collaborative determination group; Determine the presence ratio of the interest element corresponding to each collaborative AR interface in the collaborative determination group, and determine the collaborative field of view interface with the largest corresponding presence ratio as the target field of view interface; In response to obtaining an overlay display request input by the current user based on the current interactive device, the target visual field interface is sent to the current interactive device to overlay the current visual field interface; In response to obtaining an independent display request input by the current user based on the current interactive device, the target field of view interface is intercepted based on the interest element, and the obtained interest interception content carrying sound data is sent to the current interactive device to fill the current field of view interface.

2. The method for immersive AI interaction and voiceprint recognition using the smart sound film according to claim 1, characterized in that: In response to a current user in the sound intelligence membrane space wearing a current interactive device, determining whether a device matching relationship exists with the current interactive device based on the acquired current voiceprint information corresponding to the current user, including: When it is determined that the distance monitoring value output by the distance acquisition device set on the current interactive device is less than the preset distance value, the current interactive device is controlled to acquire an image of the corresponding eyeball acquisition area to obtain an eyeball acquisition image; Binarization is performed on the eyeball captured image, and in response to the presence of eye black pixel points corresponding to eye black pixel values ​​in the obtained binary image, point connection is performed on corresponding adjacent positions of all eye black pixel points to obtain an eye black area; In response to a region similarity between the black eye region and the retrieved preset comparison region being greater than a preset similarity, determining that the current device is worn on the current interactive device; Control the current interactive device to output voice collection prompt information and collect voiceprints to obtain the current voiceprint information corresponding to the current user; Determine whether a device matching relationship exists with the current interactive device based on the current voiceprint information.

3. The method for immersive AI interaction and voiceprint recognition using a sound intelligence membrane according to claim 1, characterized in that: Capturing spatial elements existing in the current visual field interface corresponding to the current interactive device based on user interest, and determining the obtained spatial elements as interest elements based on the capture results, including: Determine the elements based on the current visual field interface corresponding to the current interactive device, and obtain each spatial element of the thin sound quality space corresponding to the current visual field interface of the current interactive device; Obtaining the center point of the interface corresponding to the current field of view interface, and establishing a capture area of ​​a corresponding preset size with the center point of the interface as the center; In response to any spatial element being located in the capture area, the spatial element is aggregated into an interest screening group, and a timed task corresponding to a preset retention time is established based on the interest screening group; Based on the timed task, determine that any spatial element in the interest screening group is located in the capture area for the preset retention time, obtain the element distance between the spatial element and the center point of the interface, and determine the spatial element with the smallest corresponding element distance as the interest element.

4. The method for immersive AI interaction and voiceprint recognition using the smart sound film according to claim 3, characterized in that: The method further comprises: Determining, based on the current visual interface, that the element of interest moves to a position outside the capture area, generating an external marking frame surrounding the element of interest, and determining, based on pixelation processing of the current visual interface, all interface pixel points that are away from the element of interest and corresponding to adjacent positions of the external marking frame; An interface pixel value corresponding to each interface pixel point is obtained, the interface pixel value is adjusted based on a preset pixel adjustment strategy, and pixel rendering is performed on the external marking frame based on the obtained updated pixel value.

5. The method for immersive AI interaction and voiceprint recognition using the smart sound film according to claim 4, characterized in that: Adjusting the pixel value of the interface based on a preset pixel adjustment strategy includes: In response to the interface pixel value being less than a preset first pixel value, summing the interface pixel value and a reference pixel value to obtain an adjusted updated pixel value; In response to the interface pixel value being greater than a preset second pixel value, performing a difference calculation between the interface pixel value and a reference pixel value to obtain an adjusted updated pixel value; In response to the interface pixel value being located in a preset pixel interval consisting of a preset first pixel value and a preset second pixel value, the interface pixel value is determined as an updated pixel value.

6. The method for immersive AI interaction and voiceprint recognition using a sound intelligence membrane according to claim 1, characterized in that: Intercepting the target visual interface based on the interest element, and sending the obtained interest intercepted content to the current interactive device to fill the current visual interface, including: Establishing a device coordinate system with the current interactive device as the coordinate origin, wherein the axis extension direction of the Y axis of the device coordinate system is the same as the device orientation corresponding to the current interactive device; Determining a device coordinate point of the corresponding collaborative interaction device in the device coordinate system based on a relative positional relationship between the collaborative interaction device corresponding to the target visual field interface and the current interaction device; Dividing the current visual field interface to obtain a primary display area and secondary display areas surrounding the primary display area, and performing grid processing on the secondary display areas to obtain sliding display windows of a preset window size arranged in a line; Establishing an interface coordinate system with the center point of the interface corresponding to the current field of view interface as the coordinate origin, and establishing a coordinate mapping relationship between the interface coordinate system and the device coordinate system; Establishing a coordinate connection line between the device coordinate point and the coordinate origin, and forming a sliding indication line on the current field of view interface based on the coordinate mapping relationship; The sliding display window pointed to by the sliding indicator line is determined as the target display window, and the target field of view interface is intercepted based on the interest element corresponding to the preset window size, and the obtained interest intercepted content is filled into the target display window.

7. The method for immersive AI interaction and voiceprint recognition using a sound intelligence membrane according to claim 6, characterized in that: The method includes: determining the sliding display window pointed to by the sliding indicator line as the target display window, performing an interface capture of the target field of view interface corresponding to the preset window size based on the interest element, and filling the obtained interest capture content into the target display window, including: In response to the indicating endpoint of the sliding indicating line being located at the window outline of any sliding display window, determining the sliding display window as a target display window, and determining the sliding display windows located on both sides of the target display window as a first side window and a second side window; Clearing the contents of the target display window, the first side window, and the second side window based on the current visual field interface to form a blank combined window consisting of the target display window, the first side window, and the second side window; The target field of view interface is captured with a preset window size centered on the interest element, and the obtained interest capture content is filled into the blank combination window, wherein the content center point corresponding to the interest capture content and the indication endpoint are in the same vertical position.

8. A sound intelligent membrane immersive AI interaction and voiceprint recognition device, characterized in that: include: a matching determination module configured to, in response to a current user in the sound intelligence membrane space wearing a current interactive device, determine whether a device matching relationship exists with the current interactive device based on the acquired current voiceprint information corresponding to the current user; The interest capture module is configured to, when determining that a device matching relationship exists, capture spatial elements existing in the current field of view interface corresponding to the current interactive device based on user interest, and determine the obtained spatial elements as interest elements based on the capture results; a collaborative display module configured to, in response to the disappearance of the element of interest from the current visual interface, determine a collaborative visual interface corresponding to each collaborative interactive device having a collaborative interconnection relationship with the current interactive device, and, if the element of interest exists on the collaborative visual interface, send the element of interest carrying the sound data to the current interactive device for display; In response to the presence of the interest element in the collaborative view interface of any collaborative interaction device, aggregating the collaborative view interface into a collaborative determination group; Determine the presence ratio of the interest element corresponding to each collaborative AR interface in the collaborative determination group, and determine the collaborative field of view interface with the largest corresponding presence ratio as the target field of view interface; In response to obtaining an overlay display request input by the current user based on the current interactive device, the target visual field interface is sent to the current interactive device to overlay the current visual field interface; In response to obtaining an independent display request input by the current user based on the current interactive device, the target field of view interface is intercepted based on the interest element, and the obtained interest interception content carrying sound data is sent to the current interactive device to fill the current field of view interface.

9. A readable storage medium storing program instructions, characterized in that: When the program instructions are read and executed by a computing device, the computing device is caused to perform the method according to any one of claims 1 to 7.

Images