Method, device and electronic equipment for forming sub-conferences in a conference

Abstract

The application discloses an implementation method and device for organizing sub-conferences in a conference and electronic equipment, and belongs to the electronic technical field. The method comprises the following steps: during the participation of a first user in a first conference, in response to a first input of the first user, a second user is invited or added to participate in a second conference; the first user participates in the first conference and the second conference simultaneously, a first audio signal of the first conference is transmitted through a first audio channel, and a second audio signal of the second conference is transmitted through a second audio channel.

Description

Technical Field

[0001] This application belongs to the field of electronic technology, and specifically relates to a method, apparatus and electronic device for setting up sub-conferences in a conference. Background Technology

[0002] With the development of technology, online meetings are being used more and more widely in remote collaboration. Existing technology has achieved the function of sound shielding for the voices of people other than the two people in the meeting. By isolating the audio streams of the two people from the surrounding sound field, their conversation is independent of external interference, creating a private communication space.

[0003] However, using sound blocking in online meetings completely isolates group members from the main body of the meeting, turning what should be a large multi-person meeting into a series of small, isolated sessions, failing to meet the needs of collective communication in multi-person meetings. Thus, existing sound isolation mechanisms in multi-person meetings offer limited flexibility. Summary of the Invention

[0004] The purpose of this application is to provide a method, apparatus, electronic device, storage medium, and program product for setting up sub-conferences in a conference, which can improve the flexibility of sound isolation mechanisms in multi-person conferences.

[0005] In a first aspect, embodiments of this application provide a method for setting up sub-conferences within a conference. The method includes: during a first user's participation in a first conference, in response to a first input from the first user, inviting or adding a second user to join a second conference; the first user simultaneously participates in both the first and second conferences, with a first audio signal from the first conference transmitted through a first audio channel and a second audio signal from the second conference transmitted through a second audio channel.

[0006] Secondly, embodiments of this application provide an apparatus for setting up sub-conferences within a conference. This apparatus includes an invitation module. The invitation module is used to, in response to a first input from a first user participating in a first conference, invite or add a second user to the second conference. The first user participates in both the first and second conferences simultaneously. A first audio signal from the first conference is transmitted through a first audio channel, and a second audio signal from the second conference is transmitted through a second audio channel.

[0007] Thirdly, embodiments of this application provide an electronic device including a processor and a memory, wherein the memory stores programs or instructions executable on the processor, and the programs or instructions, when executed by the processor, implement the steps of the method described in the first aspect.

[0008] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method described in the first aspect.

[0009] Fifthly, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the method as described in the first aspect.

[0010] In a sixth aspect, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the method described in the first aspect.

[0011] In this embodiment, during the participation of a first user in a first meeting, in response to the first user's first input, a second user can be invited or added to the second meeting. The first user participates in both the first and second meetings simultaneously. The first audio signal of the first meeting is transmitted through a first audio channel, and the second audio signal of the second meeting is transmitted through a second audio channel. In this solution, since the audio signals of the two meetings can be transmitted separately through two independent audio channels even when the target user is simultaneously participating in both meetings, the connection status of the target user in both meetings can be preserved, ensuring that the user does not completely lose awareness of either meeting and improving the flexibility of the sound isolation mechanism in multi-person meetings. Attached Figure Description

[0012] Figure 1 This is one of the flowcharts for the implementation method of forming sub-conferences in a conference provided in the embodiments of this application;

[0013] Figure 2 This is one of the schematic diagrams of the virtual meeting interface provided in the embodiments of this application;

[0014] Figure 3 This is a schematic diagram of a special gesture provided in an embodiment of this application;

[0015] Figure 4 This is one of the schematic diagrams of the virtual meeting interface provided in the embodiments of this application;

[0016] Figure 5 This is a second schematic diagram of the virtual meeting interface provided in the embodiments of this application;

[0017] Figure 6 This is the second flowchart of the method for creating sub-conferences in a conference provided in the embodiments of this application;

[0018] Figure 7 This is a flowchart of an attention-switching meeting provided in an embodiment of this application;

[0019] Figure 8 This is the third schematic diagram of the virtual meeting interface provided in the embodiments of this application;

[0020] Figure 9 This is the fourth schematic diagram of the virtual meeting interface provided in the embodiments of this application;

[0021] Figure 10 This is the fifth schematic diagram of the virtual meeting interface provided in the embodiments of this application;

[0022] Figure 11 This is the sixth schematic diagram of the virtual meeting interface provided in the embodiments of this application;

[0023] Figure 12 This is the seventh schematic diagram of the virtual meeting interface provided in the embodiments of this application;

[0024] Figure 13 This is the eighth schematic diagram of the virtual meeting interface provided in the embodiments of this application;

[0025] Figure 14 This is a schematic diagram of the private message system invitation prompt provided in an embodiment of this application;

[0026] Figure 15 This is a schematic diagram of the conflict prompt provided in the embodiments of this application;

[0027] Figure 16 This is the third flowchart of the method for creating sub-conferences in a conference provided in the embodiments of this application;

[0028] Figure 17 This is a schematic diagram of the settings icon provided in an embodiment of this application;

[0029] Figure 18 This is one of the schematic diagrams of the volume adjustment control provided in the embodiments of this application;

[0030] Figure 19 This is a second schematic diagram of the volume adjustment control provided in the embodiments of this application;

[0031] Figure 20 This is a schematic diagram illustrating the execution process of the method for creating sub-conferences in a conference, as provided in an embodiment of this application.

[0032] Figure 21 This is a schematic diagram of an implementation device for setting up sub-conferences in a conference, provided in an embodiment of this application;

[0033] Figure 22 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application;

[0034] Figure 23This is a schematic diagram of the hardware structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0035] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0036] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0037] The terms "at least one," "at least one," etc., in this application refer to any one, any two, or a combination of two or more of the included objects. For example, at least one of a, b, and c can mean: "a," "b," "c," "a and b," "a and c," "b and c," and "a, b, and c," where a, b, and c can be single or multiple. Similarly, "at least two" refers to two or more, and its meaning is similar to that of "at least one."

[0038] The following description, in conjunction with the accompanying drawings, details the implementation method, apparatus, electronic device, storage medium, and program product for setting up sub-conferences in a conference, provided by the embodiments of this application, through specific implementations and application scenarios.

[0039] The embodiments of this application can be applied to scenarios where users switch and interact between multiple meetings.

[0040] The following examples, using specific scenarios from embodiments of this application, illustrate the implementation method for forming sub-conferences within a conference provided by embodiments of this application.

[0041] Scenario 1: Multi-task collaborative meeting

[0042] In remote collaboration within an enterprise, employees may participate in multiple meetings simultaneously, such as a main meeting and an ad-hoc discussion group. In this situation, employees need to be able to switch flexibly between the main meeting and the group discussion while remaining aware of the content of both meetings.

[0043] Scenario 2: Online Education Interactive Classroom

[0044] In online education platforms, students may participate in both main lectures and group discussions simultaneously. Students need to switch between the main lectures and group discussions to better engage with the content and understand the material.

[0045] Scenario 3: Remote Medical Consultation

[0046] In telemedicine scenarios, doctors may participate in multiple consultations simultaneously, including communicating with patients and discussing treatment plans with other experts. Doctors need to switch quickly between different consultations while ensuring they don't miss any important information.

[0047] It should be noted that scenarios 1 to 3 above are merely exemplary examples of some scenarios that may be applied to the embodiments of this application. In actual implementation, the embodiments of this application can also be applied to any possible scenario where there is a need to form sub-conferences in a meeting. The embodiments of this application are not limited here.

[0048] This application provides a method, apparatus, electronic device, storage medium, and program product for setting up sub-conferences in a conference. Since the audio signals of the two conferences can be transmitted separately through two independent audio channels when the target user participates in the first conference and the second conference at the same time, the connection status of the target user in the two conferences can be preserved, ensuring that the user does not completely lose awareness of either conference, and improving the flexibility of the sound isolation mechanism in multi-person conferences.

[0049] The execution entity of the method for establishing sub-conferences within a conference provided in this application embodiment can be an implementation device for establishing sub-conferences within a conference. This implementation device can be an electronic device, or a functional module or functional entity within an electronic device. The following uses an electronic device as an example to illustrate the technical solution provided in this application embodiment.

[0050] Figure 1 The flowchart illustrates an implementation method for creating sub-conferences within a conference, as provided in an embodiment of this application. Figure 1 As shown, the implementation method for setting up sub-conferences in a conference provided in this application embodiment may include the following step 201.

[0051] Step 201: During the first user's participation in the first meeting, the electronic device responds to the first user's first input by inviting or adding a second user to join the second meeting.

[0052] In some embodiments of this application, the first user participates in both a first conference and a second conference simultaneously. The first audio signal of the first conference is transmitted through a first audio channel, and the second audio signal of the second conference is transmitted through a second audio channel.

[0053] In some embodiments of this application, the first input is used to trigger an electronic device to invite or add a second user to a second meeting. The second meeting refers to a meeting in which the target user wishes to invite a second user to join; it can be a newly created meeting or an existing meeting.

[0054] In some embodiments of this application, the aforementioned second meeting can be a private speaking system meeting. Here, a private speaking system refers to selecting specific individuals within the meeting to create a separate communication space, isolating them from the external meeting, while allowing those within the communication space to simultaneously hear the content of the external meeting. A private speaking system meeting can be simply referred to as a private speaking group.

[0055] In some embodiments of this application, the aforementioned conference refers to a specific, user-participatory interactive environment or communication instance used to enable real-time audio, video, or other forms of information exchange between multiple parties. A conference is a basic unit for user communication and collaboration, with clearly defined participants and communication channels.

[0056] In some embodiments of this application, the aforementioned meeting can be a VR virtual meeting, or simply a virtual meeting. It refers to a meeting in which people in different physical spaces can access a pre-built virtual meeting scene and have a virtual identity in the scene. Virtual meetings allow people in different physical spaces to meet as if they were in the same space.

[0057] It should be noted that current sound masking technology has achieved the function of sound masking for sounds other than those of two people within the metaverse scene of XR. By isolating the audio streams of two people from the surrounding environmental sound field, their conversation is independent of external interference, creating a private communication space. However, this technology is not suitable for VR virtual meetings. In VR virtual meeting scenarios where group discussions are required, using sound masking will completely isolate group members from the main meeting, turning what should be a large multi-person meeting into a series of small, independent meetings, failing to meet the needs of collective communication in a multi-person meeting. The method for creating sub-meetings within a meeting provided in this application embodiment can be applied to virtual meeting scenarios, solving this problem.

[0058] In some embodiments of this application, the virtual meeting scene may display virtual avatars or meeting member identifiers of the meeting members participating in the first meeting, and users can interact with the meeting members through these virtual avatars or meeting member identifiers.

[0059] In some embodiments of this application, the aforementioned virtual avatar refers to a three-dimensional or two-dimensional graphic representing a meeting member in a virtual meeting scenario. The virtual avatar can be a user-defined avatar, a virtual character model, or other form of graphic representation, used to provide intuitive visual identification and help users recognize and distinguish different meeting members.

[0060] In some embodiments of this application, the aforementioned meeting member identifiers refer to other visual elements used to identify meeting members, such as names, avatars, role tags, etc. These identifiers can be used in conjunction with virtual avatars to further enhance the user's recognition ability.

[0061] In some embodiments of this application, the electronic device can create a virtual meeting scene. For example, in a VR virtual meeting, the electronic device generates a virtual meeting room where users can see the virtual avatars of other participants through VR devices.

[0062] In some embodiments of this application, the electronic device can display at least two avatars in a virtual meeting scenario. For example, in a VR virtual meeting, the electronic device can display a virtual meeting table and display the virtual avatars of each meeting member around the meeting table.

[0063] In this way, electronic devices can create virtual meeting scenarios and display at least two meeting members in them, providing users with an intuitive and immersive interactive environment and enhancing their ability to identify meeting members.

[0064] In some embodiments of this application, the aforementioned participants refer to users who participate in the meeting through electronic devices, and these users access the meeting and interact in some way. For example, participants can be attendees in a meeting, students and teachers in an online classroom, doctors and patients in telemedicine, etc.

[0065] In some embodiments of this application, the aforementioned communication channel refers to a specific communication channel used for transmitting audio, video, or other data in a conference. These channels can be software-defined logical channels or physical channels based on network protocols.

[0066] In some embodiments of this application, the first meeting mentioned above refers to the meeting that the target user is currently participating in.

[0067] For example, in a remote collaboration meeting within a company, the first meeting might be the main meeting where all participants discuss the project together.

[0068] For example, in an online education scenario, the first meeting might be the teacher's main lecture class.

[0069] In some embodiments of this application, the aforementioned target user refers to a participant currently attending the first meeting.

[0070] In some embodiments of this application, participation refers to a target user accessing and being in a meeting through some means, and being able to interact with other participants.

[0071] In some embodiments of this application, after inviting or adding a second user to the second meeting, the electronic device can switch to the second meeting.

[0072] In some embodiments of this application, the aforementioned switching refers to the process by which an electronic device, based on a user's operation instruction, such as a first input, shifts the audio focus from a currently engaged first meeting to a second meeting. This process involves dynamic adjustment of the audio signal to ensure that the user can seamlessly switch from one meeting to another, while optimizing audio processing and user experience.

[0073] In some embodiments of this application, depending on whether the second meeting is a newly created meeting, the first input can include two cases: one is the input to switch the audio focus from the first meeting to the already created second meeting, and the other is the input to switch the audio focus from the first meeting to the newly created second meeting, that is, first create a new meeting as the second meeting, and then switch to the second meeting.

[0074] In some embodiments of this application, when a target user participates in a first meeting, the target user can make a first input to the electronic device to trigger the electronic device to subsequently establish a sub-meeting within the meeting.

[0075] In some embodiments of this application, if a target user needs to create a new meeting and switch to that meeting while participating in the first meeting, the target user can create a second meeting and switch to that second meeting through the first input.

[0076] In some embodiments of this application, when the first input is an input to switch the audio focus from a first meeting to a newly created second meeting, the first input can be a gaze input and a gesture input to a first control, wherein the first control is a control that triggers the electronic device to create a new meeting, the gaze input is used to select the first control, and the gesture input is used to confirm triggering the first control. The possible operation methods of the first input are described in detail below with specific examples.

[0077] In some embodiments of this application, the startup of the whispering system is not merely a user interface operation, but a complete technical process combining audio and video channel initialization, motion channel isolation, and artificial intelligence (AI) virtualization generation. This resolves the conflict between voice input and visual input the instant the user enters the whispering session. Electronic devices can launch the whispering system in two ways: conventional hand-eye interaction startup and special gesture recognition startup. The following uses a virtual meeting as an example to illustrate conventional hand-eye interaction startup and special gesture recognition startup.

[0078] 1. Hand-eye interaction initiation: For example, such as Figure 2 As shown, the electronic device displays a floating start icon 11 in the virtual meeting interface 10, integrated with the menu bar. Users can select the icon through eye tracking and confirm the start by pinching or using a controller, instantly completing the initialization of the electronic device.

[0079] 2. Special Gesture Recognition Activation: For example, a user can trigger the activation action by performing a preset "whisper" gesture and holding it for two seconds, such as... Figure 3 As shown. After the electronic device detects the gesture, a confirmation prompt appears, and the user confirms access to the private electronic device. The technical innovation of this method lies in:

[0080] (1) Initialization of the combined gesture recognition and intent judgment channel: The electronic device analyzes the user's action intent through a deep learning gesture recognition model, and immediately initializes the private meeting audio and video channel and the action isolation mechanism.

[0081] (2) Automatic conflict control: At the moment the gesture is triggered, the electronic device will automatically weaken the audio of the first conference channel and virtualize the action, while simultaneously enabling the full audio, video and action transmission of the relevant working channels of the second conference to ensure the privacy of the user's voice and actions.

[0082] (3) Fast and seamless switching: This startup method avoids the delay caused by traditional interface click operation, realizes the user's almost instantaneous switching from the first meeting to the second meeting, and at the same time maintains the normal operation of the multi-channel parallel perception and attention-driven switching mechanism.

[0083] In some embodiments of this application, through the two startup methods described above, the electronic device can complete a series of complex operations such as audio and video channel isolation, motion channel isolation, AI virtualization generation, and attention-driven switching initialization the moment the user enters the private meeting, thereby completely solving the core technical problems of voice input conflict and screen conflict in multi-meeting scenarios.

[0084] In some embodiments of this application, all members participating in the second meeting are some of the members participating in the first meeting; or, some members participating in the second meeting are different from some members participating in the first meeting.

[0085] In some embodiments of this application, all members participating in the second meeting may be some of the members participating in the first meeting. In this case, the members of the second meeting are a subset of the members of the first meeting.

[0086] For example, in a remote collaboration meeting, the second meeting might be a temporary discussion group whose members are selected from the participants in the original remote collaboration meeting.

[0087] In some embodiments of this application, some of the meeting members participating in the second meeting may be different from some of the meeting members participating in the first meeting. In this case, there is some overlap between the members of the second meeting and the members of the first meeting, but there are also some different members.

[0088] For example, in an online education course, the second meeting could be a breakout session with members including some of the students and teachers participating in the online course, as well as other participants who are not participating in the online course, such as teaching assistants who specifically lead the breakout sessions to help teachers share the teaching workload so that teachers can focus on the online education course.

[0089] In some embodiments of this application, the second meeting is another meeting that the target user participates in simultaneously with the first meeting. For example, in a remote enterprise collaboration meeting, the second meeting might be a temporary discussion group for small-scale discussions of specific topics. The second meeting can be newly created by the target user or it can already exist.

[0090] In some embodiments of this application, when a target user is simultaneously participating in a first meeting and a second meeting, the electronic device can receive a first input from the user. In this case, the second meeting is an already created meeting, so the first input is an input for switching to the created second meeting.

[0091] In this way, electronic devices can receive user input to select the second meeting when the target user is simultaneously participating in the first and second meetings, thereby directly switching to the second meeting, simplifying the meeting switching process and improving operational efficiency.

[0092] In some embodiments of this application, the first input is used to switch to a meeting in which the meeting members participating in the second meeting are present, i.e., to switch to the second meeting.

[0093] In some embodiments of this application, the aforementioned first input includes, but is not limited to: touch input by the user through a touch device such as a finger or stylus, or voice commands input by the user, or specific gestures input by the user, or other feasible inputs. The specific input can be determined according to actual usage needs, and this application does not limit it.

[0094] In some embodiments of this application, the above-mentioned touch input can be single-click input, double-click input, or any number of clicks, or it can be long-press input or short-press input.

[0095] In some embodiments of this application, the specific gesture mentioned above can be any one of a single-click gesture, a swipe gesture, a drag gesture, a pressure recognition gesture, a long-press gesture, an area change gesture, a double-press gesture, or a double-tap gesture.

[0096] In some embodiments of this application, the first input described above may be the user's gaze point input and gesture input to the second user's member identifier.

[0097] In some embodiments of this application, the first input described above may also be a click input by the user on the member identifier of the second user.

[0098] In some embodiments of this application, the first audio signal mentioned above includes a first output signal output by the first conference to the first user.

[0099] In some embodiments of this application, the second audio signal mentioned above includes a second output signal output by the second conference to the first user.

[0100] In some embodiments of this application, the volume levels of the first output signal and the second output signal are different; and / or, the output orientations of the first output signal and the second output signal are different.

[0101] In some embodiments of this application, the first audio channel is used to transmit a first audio signal of a first conference, and the second audio channel is used to transmit a second audio signal of a second conference.

[0102] In some embodiments of this application, the aforementioned audio signal is an audio data stream transmitted through a conference channel, containing sounds heard and emitted by the user during the conference.

[0103] In some embodiments of this application, in a multi-conference scenario, each conference has an independent audio channel to ensure independent processing and transmission of signals during the conference.

[0104] In some embodiments of this application, the signal strength of the aforementioned audio signal refers to the intensity or amplitude of the audio signal, which can be expressed in decibels (dB). Signal strength adjustment can be achieved through techniques such as gain control and attenuation processing.

[0105] In some embodiments of this application, after receiving the user's first input, the electronic device can adjust the signal strength of the first audio signal transmitted through the first conference channel to reduce it. At the same time, the electronic device keeps the signal strength of the audio signal transmitted through the second conference channel unchanged or higher, so that the signal strength of the adjusted first audio signal is less than the signal strength of the audio signal transmitted through the second conference channel of the second conference. In this way, by adjusting the audio signal strength, audio interference in the first conference is reduced, ensuring that the user can hear the content of the second conference more clearly.

[0106] In some embodiments of this application, after receiving the user's first input, the electronic device can perform distance attenuation and filtering on the first conference audio, and weaken the distant first conference sound source without it disappearing through a spatial acoustic rendering algorithm, so that the user can perceive the overall conference environment without affecting the small meeting communication.

[0107] In some embodiments of this application, the electronic device can perform sound spatial rendering, enabling users to simultaneously hear weakened sounds from the first and second meetings, achieving multi-channel parallel perception without interfering with the normal auditory experience of other participants.

[0108] In some embodiments of this application, to avoid sound field jumps when users switch, the method for creating sub-conferences within a conference provided in this application employs spatial acoustic rendering technology, specifically including:

[0109] (1) Dynamically adjust the sound direction according to the user's gaze direction;

[0110] (2) Real-time attenuation processing based on the proximity of the meeting participants;

[0111] (3) Filter and weaken non-interesting meeting audio so that users can naturally perceive "attention shift".

[0112] If the direction of gaze is inconsistent with the direction of sound, it is determined to be "ambient browsing", and the electronic device will not trigger the switching logic.

[0113] In some embodiments of this application, when the first input is for creating a new conference, the electronic device can create a new conference, namely a second conference, and then adjust the signal strength of the first audio signal transmitted through the first conference channel to reduce it. At the same time, the electronic device can keep the signal strength of the audio signal transmitted through the second conference channel unchanged or higher, so that the signal strength of the adjusted first audio signal is less than the signal strength of the audio signal transmitted through the second conference channel of the second conference.

[0114] In this way, electronic devices can reduce audio interference in the first meeting by lowering the strength of the first audio signal, ensuring that users can hear the content of the second meeting more clearly.

[0115] This application provides a method for setting up sub-conferences within a meeting. Since the audio signals of the two meetings can be transmitted separately through two independent audio channels when a target user is simultaneously participating in both meetings, the user's connection status in both meetings can be preserved, ensuring that the user does not completely lose awareness of either meeting. Furthermore, the audio signal of a particular meeting can be adjusted individually, thus achieving a smooth shift of attention between meetings and avoiding the disruption to meeting flow caused by directly isolating meetings. This enhances the flexibility of the sound isolation mechanism in multi-person meetings.

[0116] In some embodiments of this application, the method for setting up sub-conferences in a conference provided by the embodiments of this application further includes the following step 301.

[0117] Step 301: The electronic device transmits microphone audio signals based on the current working audio channel.

[0118] In some embodiments of this application, the microphone audio signal is obtained through a microphone, and the working audio channel includes a first audio channel and a second audio channel.

[0119] In some embodiments of this application, when the current working audio channel is the first audio channel, the microphone audio signal and the first audio signal are transmitted through the first audio channel, and the second audio signal is transmitted through the second audio channel: the volume of the first audio signal is greater than the volume of the second audio signal; and / or, the first audio signal is a near-field audio signal, and the second audio signal is a far-field audio signal.

[0120] In some embodiments of this application, when the current working audio channel is the second audio channel, the first audio signal is transmitted through the first audio channel, and the microphone audio signal and the second audio signal are transmitted through the second audio channel: the volume of the second audio signal is greater than the volume of the first audio signal; and / or, the second audio signal is a near-field audio signal, and the first audio signal is a far-field audio signal.

[0121] In some embodiments of this application, the aforementioned working audio channel refers to the audio channel to which the audio signal collected by the microphone needs to be transmitted, which is the audio channel of the meeting currently being followed by the user. For example, if the current user is following the first meeting, then the working audio channel is the first audio channel.

[0122] In some embodiments of this application, the first audio signal transmitted through the first audio channel refers to the audio signal of the audio content input by the target user through the microphone of the electronic device.

[0123] In some embodiments of this application, when the working audio channel for the first input to collect audio signals from the microphone is switched from the first audio channel to the second audio channel, the electronic device can adjust the signal strength of the first audio signal transmitted through the first audio channel to reduce it, thereby reducing the impact of the target user's first audio signal on participants outside the second meeting and protecting the privacy of the user's speech in the second meeting.

[0124] In some embodiments of this application, the specific reduction range when the electronic device adjusts the signal strength can be determined according to actual usage needs, and this application does not impose any limitations. For example, if the privacy level of the second meeting is not high, the reduction range can be set to 50%; if the privacy level of the second meeting is high, the reduction range can be set to 100%.

[0125] In some embodiments of this application, to resolve voice input conflicts, the electronic device can establish independent audio and video channels for the first conference and the second conference respectively, and perform dynamic routing control on the user's microphone input: when a user speaks in the second conference, their voice signal is transmitted only through the audio channel of the second conference, and the speaking intention is analyzed by voice source localization and deep learning model, and the first conference channel is dynamically blocked from receiving the audio, so as to ensure that the speech in the second conference is not leaked to the first conference.

[0126] In this way, the electronic device can dynamically adjust the strength of the first audio signal sent through the first audio channel when the user switches the audio focus, effectively solving the pain point that users need to manually switch microphones when multiple conferences are in parallel. This not only eliminates the risk of voice leakage caused by forgetting to switch, but also avoids the interruption of interaction caused by frequent manual operation.

[0127] In some embodiments of this application, the first video signal of the first conference is transmitted through the first video channel, and the second video signal of the second conference is transmitted through the second video channel.

[0128] In some embodiments of this application, the video signal is used to support screen sharing functionality, including a data stream containing screen-shared content, enabling users to view and edit the shared content in real time during a meeting.

[0129] In some embodiments of this application, the electronic device can simultaneously render the content of a second meeting and a first meeting in virtual space, including the video screens of both meetings, virtual avatars of participants, and virtual avatars of speakers. When a user looks at a screen, the electronic device can automatically enlarge, brighten, and enhance the rendering clarity of that screen to prompt the user's current focus. This rendering transition is visually continuous and without abrupt changes, thereby enhancing the immersive experience.

[0130] For example, such as Figure 4As shown, users simultaneously participate in both the first and second meetings, and electronic devices display the screen 18 of the first meeting and the screen 19 of the second meeting in the virtual meeting interface 10. Combined with... Figure 4 ,like Figure 5 As shown, after a user switches to the second meeting, the electronic device can zoom in on the screen 19 of the second meeting and zoom out on the screen 18 of the first meeting.

[0131] In some embodiments of this application, the method for setting up sub-conferences in a conference provided in this application further includes the following step 302.

[0132] Step 302: The electronic device transmits the real-time attitude information of the first user based on the current working attitude channel.

[0133] In some embodiments of this application, the real-time posture information is obtained through a camera module, and the working posture channel includes a first posture channel connected to the first conference and a second posture channel connected to the second conference.

[0134] In some embodiments of this application, when the current working posture channel is the first posture channel, the real-time posture information of the first user is transmitted through the first posture channel, and the participants of the first meeting obtain the real-time posture information of the first user.

[0135] In some embodiments of this application, when the current working posture channel is the second posture channel, the real-time posture information of the first user is transmitted through the second posture channel, and the participants of the second meeting obtain the real-time posture information of the first user.

[0136] In some embodiments of this application, the aforementioned real-time posture information is posture information related to the first user. This data is used to generate a virtual image of the first user and display it in a virtual meeting scenario.

[0137] In some embodiments of this application, the aforementioned real-time posture information refers to the real-time action and behavior data of the first user, which may include the user's limb movements, facial expressions, head rotation, etc. Using this data, the electronic device can generate a dynamic virtual avatar that reflects the first user's behavior in real time.

[0138] In some embodiments of this application, the electronic device can collect real-time posture and behavior data of a first user through sensors, and generate posture information of the first user, i.e., real-time posture information, based on the collected real-time posture and behavior data.

[0139] In some embodiments of this application, after generating real-time posture information, the electronic device can transmit the generated real-time posture information through the current working posture channel so that other participants' devices can display a virtual image that accurately reflects the user's current behavior.

[0140] In this way, electronic devices can display virtual avatars that accurately reflect the current behavior of the target user, enhancing the naturalness of meeting communication.

[0141] In some embodiments of this application, the method for setting up sub-conferences in a conference provided by the embodiments of this application further includes the following step 303.

[0142] Step 303: The electronic device generates alternative posture information for the first user based on AI.

[0143] In some embodiments of this application, when the current working posture channel is the first posture channel, the alternative posture information of the first user is transmitted through the second posture channel, and the participants of the second meeting obtain the alternative posture information of the first user.

[0144] In some embodiments of this application, when the current working posture channel is the second posture channel, the alternative posture information of the first user is transmitted through the first posture channel, and the participants of the first meeting obtain the alternative posture information of the first user.

[0145] In some embodiments of this application, the aforementioned alternative posture information is generated based on the target user's historical posture behavior data.

[0146] In some embodiments of this application, historical posture and behavior data refers to the posture and behavior data of the target user over a past period of time. This data may include the user's body movements, facial expressions, head rotations, etc., over the past period. Using this data, the electronic device can generate a static or dynamic virtual avatar that reflects the target user's past behavioral patterns.

[0147] In some embodiments of this application, the electronic device can acquire the target user's historical posture and behavior data, and generate virtual image data that cannot accurately reflect the target user's current behavior, i.e., alternative posture information, based on the collected historical posture and behavior data.

[0148] In some embodiments of this application, electronic devices can transmit generated alternative posture information through a first conference channel for devices of conference members who are participating in the first conference but not in the second conference to display virtual images that do not accurately reflect the user's current behavior.

[0149] In some embodiments of this application, when a target user switches from a first meeting to a second meeting, the electronic device can transmit the first virtual image data and alternative posture information of the third display object through the first meeting channel. This enables the devices of meeting members who participated in the first meeting but not the second meeting to display a virtual image that does not accurately reflect the target user's current behavior, and enables the devices of meeting members who participated in the second meeting to display a virtual image that accurately reflects the target user's current behavior.

[0150] In some embodiments of this application, to address the issue of screen conflict, the electronic device can use an action channel isolation mechanism to independently transmit the user's actions, gestures, and facial expressions during a private conversation, presenting them only in the private conversation channel. In the first meeting channel, the electronic device generates alternative actions through AI virtualization, maintaining the natural continuity of the virtual character in the first meeting scenario, thereby preventing the private conversation actions from being observed externally, while ensuring the realism and smoothness of the virtual image. Furthermore, users can adjust the blurring level of the external character and the AI ​​virtualization strategy in the settings interface, including whether to display alternative actions, facial expressions, or posture changes, thus providing a flexible privacy protection solution.

[0151] In this way, electronic devices can display a virtual avatar that accurately reflects the target user's current behavior before switching to the second meeting. After switching to the second meeting, the virtual avatar that accurately reflects the target user's current behavior is only displayed in the second meeting, while a virtual avatar that does not accurately reflect the target user's current behavior is displayed outside the second meeting. This can effectively protect the user's privacy and security in a multi-meeting environment, prevent meeting members outside the second meeting from inferring their true behavioral intentions through the virtual avatar, such as micro-expressions or gestures during private discussions, reduce the risk of information leakage, and at the same time ensure the naturalness and credibility of key interactions by maintaining the continuity of the real virtual avatar within the second meeting.

[0152] In some embodiments of this application, combined with Figure 1 ,like Figure 6 As shown, after step 201 above, the implementation method for forming sub-conferences in a conference provided in this application embodiment further includes the following step 202.

[0153] Step 202: The electronic device determines the working audio channel, working video channel, or working posture channel based on the target working conference.

[0154] In some embodiments of this application, the target working session is switched based on at least one of the following:

[0155] If the first user focuses on the first participant and the focus lasts for more than a preset threshold, the target work meeting will be switched to the meeting to which the first participant belongs.

[0156] The first user focuses on the direction of the first audio source and switches the target work meeting to the meeting corresponding to the direction of the first audio source.

[0157] The first user is the speaker in the meeting, and the target work meeting is switched based on the content of the first user's speech.

[0158] The first user's conference switch input has been received.

[0159] In some embodiments of this application, attention-based meeting switching is one of the most innovative and technically advanced aspects of the method for creating sub-meetings within a meeting. Its core lies in enabling users to intelligently and automatically switch between the first and second meetings through eye tracking and attention recognition. At the same time, it utilizes speech intent recognition, spatial acoustic rendering, and dynamic switching technology of motion channels to solve the problems of voice and video conflicts when multiple meetings are held in parallel.

[0160] In some embodiments of this application, the electronic device can obtain the user's gaze point position in real time through an eye-tracking module, and determine whether the user wants to switch meetings based on the following strategies:

[0161] (1) Fixation stability analysis: Fixation must be stable for more than a set threshold, such as 350ms, to be considered a valid intent;

[0162] (2) Speaker detection: The electronic device uses voice source localization and skeletal animation detection to confirm whether the object of gaze is the current speaker. If the object of gaze is the speaker, the electronic device can prompt the user to make a slight gesture, such as pinching the finger, to confirm, so as to avoid accidentally switching when quickly browsing other people and scenes.

[0163] (3) Detection of speech content: When a user speaks, the electronic device can analyze the intention of the speech through voice source localization and deep learning model to determine whether to switch the meeting.

[0164] (4) Meeting switching input: When a user's meeting switching input is received, the meeting switching is triggered.

[0165] In some embodiments of this application, when the electronic device confirms that the user is looking at the speaker of the first conference, it can automatically lower the audio of the smaller conference and enhance the audio of the first conference, and vice versa, to achieve seamless switching.

[0166] In some embodiments of this application, the electronic device can determine the target work meeting, i.e., the meeting the user is currently in, based on attention, and dynamically select to transmit the user's real-time posture information to a first posture channel or a second posture channel. When focusing on the second meeting, the user's motion data is transmitted to the second meeting channel, and AI virtualization is used as a substitute posture information in the first meeting channel. When focusing on the first meeting, the user's motion data is switched to the first meeting channel, and the second meeting channel can use AI virtualization as a substitute posture information. This ensures that even if the user frequently switches between these channels, it will not lead to motion leakage or motion gaps.

[0167] In some embodiments of this application, Figure 7 A flowchart of an attention-switching meeting provided for an embodiment of this application. For example... Figure 7 As shown, the process of an attention-switching meeting may include steps 10 to 18 below.

[0168] Step 10: Enable automatic switching.

[0169] Step 11: Fixation point identification.

[0170] Step 12: Gesture confirmation.

[0171] Step 13: Confirm the audio location.

[0172] Step 14: Switch the meeting?

[0173] If yes, proceed to steps 15, 16, and 17; otherwise, proceed to step 18.

[0174] Step 15: Switch between real and virtual sound / character on screen.

[0175] Step 16: Failed to pay attention to the recording of the meeting content.

[0176] Step 17: Display missed meeting content.

[0177] Step 18: Maintain the original state.

[0178] The overall process logic is as follows: first, complete the automatic switching in sequence → gaze recognition → gesture confirmation → audio location confirmation; then, based on the decision branch of whether to switch the meeting, decide whether to perform the switching-related operations or maintain the original state.

[0179] In this way, through intelligent channel switching, users can more naturally shift focus between different meetings and achieve a smooth transition without interrupting the current communication, thereby improving the interaction efficiency and user experience in complex meeting environments.

[0180] In some embodiments of this application, the method for setting up sub-conferences in a conference provided in this application further includes the following step 304.

[0181] Step 304: When the second user is participating in both the first and second meetings, the electronic device will distinguish the second user from other members who are not participating in the second meeting in the virtual meeting scenario of the first meeting.

[0182] In some embodiments of this application, when a second user participates in both the first and second meetings, the electronic device can re-render the virtual image of the second user in the virtual meeting scene of the first meeting. The display parameters of the re-rendered virtual image of the second user are different from the display parameters of the virtual images of all meeting members participating in the second meeting, thereby distinguishing the second user from other members who are not participating in the second meeting.

[0183] In some embodiments of this application, the aforementioned display parameters refer to the visual attributes of the virtual avatar, such as color, size, position, transparency, and animation effects. By adjusting the display parameters, the electronic device can change the appearance of the virtual avatar to provide visual feedback.

[0184] In some embodiments of this application, after receiving the user's first input, the electronic device can re-render the virtual image of the second user in the virtual meeting scene, so that the display parameters of the virtual image of the second user in the virtual meeting scene are different from the display parameters of the virtual images of all meeting members participating in the second meeting.

[0185] For example, such as Figure 8 As shown, the user is participating in a regular online meeting. The electronic device displays a virtual meeting interface 10, which includes virtual avatars 12, 13, 14, 15, 16, and 17. Simultaneously, the user is participating in a second meeting, which consists of the user and the meeting members corresponding to virtual avatars 14 and 15. After the user switches to the second meeting, as shown... Figure 9 As shown, the electronic device can keep virtual avatars 14 and 15 as they are, and adjust the display parameters of virtual avatars 12, 13, 16, and 17 to highlight virtual avatars 13, 14, and 15.

[0186] In some embodiments of this application, when a user switches their target work meeting to a second meeting, the electronic device can apply semi-transparency or virtualization processing to the virtual images of participants in the first meeting who are not participating in the second meeting, in order to distinguish or highlight participants who are simultaneously participating in the first and second meetings.

[0187] In this way, electronic devices can help users quickly identify and distinguish different meeting members by re-rendering the virtual avatar of a second user, providing users with intuitive visual feedback.

[0188] In some embodiments of this application, the method for setting up sub-conferences in a conference provided by the embodiments of this application further includes the following steps 401 or 402.

[0189] Step 401: If the first user participates in both the first and second meetings simultaneously, and the working audio channel is the first audio channel, record the audio data stream, video data stream, and posture data stream of the second meeting to generate the first recording file.

[0190] Step 402: If the first user participates in both the first and second meetings simultaneously, and the working audio channel is the second audio channel, the electronic device records the audio data stream, video data stream, and posture data stream of the first meeting to generate a second recording file.

[0191] In some embodiments of this application, the electronic device can provide independent content recording channels for the first meeting and the second meeting respectively. When a user misses a meeting due to a shift in attention, the electronic device automatically provides the user with a playback experience through methods such as video recording, audio recording, and motion data caching, achieving a "no missed meetings" experience.

[0192] The implementation method for setting up sub-conferences in a meeting provided in this application also designs an attention-based intelligent meeting switching mechanism. By identifying the user's gaze focus through eye tracking and confirming the target work meeting with gestures, the second meeting is automatically switched to the first meeting, thereby automatically switching the corresponding work audio channel, work video channel, or work posture channel. The meeting content of non-target work meetings can be automatically recorded, including video, audio, and posture information, for users to play back at any time, ensuring information integrity.

[0193] In this way, users can have efficient discussions in sub-meetings without missing important information from the main conference, while ensuring the security and privacy of private meeting content.

[0194] In some embodiments of this application, the method for setting up sub-conferences in a conference provided by the embodiments of this application further includes the following steps 501 and 502.

[0195] Step 501: Upon receiving a meeting invitation message from a third user for a third meeting, the electronic device caches the meeting status information of the first meeting.

[0196] In some embodiments of this application, the above-mentioned meeting status information includes at least one of the following: the current posture information of the first user, the alternative posture information of the first user, and the audio attenuation parameters of the first audio channel.

[0197] In some embodiments of this application, the aforementioned current posture information of the first user refers to the information of the first user's current real-time posture.

[0198] In some embodiments of this application, the aforementioned alternative posture information of the first user refers to the setting information of the virtual posture that replaces the real posture in the first meeting when the user switches to the third meeting.

[0199] In some embodiments of this application, the audio attenuation parameter of the first audio channel refers to the technical parameter that controls the intensity of the audio signal in the first audio channel.

[0200] Step 502: Upon receiving confirmation of the invitation input from the first user, the electronic device adds the first user to the third meeting and updates the first user's meeting status in the third meeting based on the meeting status information.

[0201] In some embodiments of this application, the aforementioned confirmation invitation input is used to join a third meeting.

[0202] In some embodiments of this application, the first user can confirm the invitation input of the meeting invitation message, the initiated electronic device will add the first user to the third meeting, and update the first user's meeting status in the third meeting based on the meeting status information.

[0203] The implementation method for creating sub-conferences within a meeting provided in this application offers a private message system invitation mechanism. This mechanism not only enables participants to join, but more importantly, it synchronously handles audio / video channel initialization, motion channel redirection, and AI virtualization strategy switching during the invitation process. This ensures that invitees, upon entering the second meeting, immediately receive the same privacy protection as the initiator, while preventing their voice and actions from interfering with the first meeting before they join. The electronic device provides two invitation methods: eye-tracking selection based on spatial positioning, and a menu-based invitation method based on a list. These two invitation methods are described below.

[0204] 1. Eye-tracking selection invitation based on spatial positioning:

[0205] In some embodiments of this application, after the user confirms that the invitation mode is enabled, the electronic device first enters the "invitation preprocessing stage". In this stage, the electronic device temporarily activates the target user's multi-channel state simulation module to display the state changes that the user will exhibit after being invited to the private meeting.

[0206] For example, such as Figure 10As shown, the user simultaneously participates in the first and second meetings. The electronic device displays virtual avatars 23, 24, 25, and 26 in the virtual meeting interface 10. These virtual avatars represent meeting members participating in the second meeting and are displayed in a semi-transparent state. When the user focuses their gaze on virtual avatar 24 using eye movement, as shown... Figure 11 As shown, the electronic device can restore the virtual avatar 24 from a semi-transparent state to a normal rendering state, indicating that it is the current object of attention. At the same time, the background electronic device will prepare in advance the working audio channel, working video channel, or working posture channel that the meeting member corresponding to the virtual avatar 24 needs to activate after joining the second meeting, such as the second audio channel, the second posture channel, and the second video channel, and suspend the first posture channel of the first meeting from capturing or transmitting the real-time posture information of the first user, in preparation for privacy isolation after entering the second meeting.

[0207] Furthermore, by way of example, in combination Figure 11 ,like Figure 12 As shown, after the user confirms the interaction by pinching the screen, the electronic device can display a "plus" sign 25 next to the virtual avatar 24 and pop up a secondary confirmation interface 26 to prevent accidental touches. Before the secondary confirmation, the electronic device will not activate any working audio channels, working video channels, or working gesture channels of the second meeting, ensuring that the invitation process itself does not interfere with the normal flow of audio and video data of the first meeting.

[0208] In some embodiments of this application, the advantage of eye-tracking invitation based on spatial positioning lies in its intuitiveness and strong spatial correspondence logic, allowing users to directly look at and invite people around them, just like in a real meeting.

[0209] In some embodiments of this application, eye-tracking localization may be affected by occlusion for characters obscured by other virtual characters or located in densely populated areas, such as... Figure 13 As shown. To address this issue, the implementation method for creating sub-meetings within a meeting provided in this application employs a spatial reconstruction algorithm. By reconstructing the three-dimensional position of a person using a depth map and the skeletal position of the participant, occluded objects can also be locked through eye-tracking focus prediction and spatial compensation mechanisms, thereby improving the accuracy and reliability of the invitation operation.

[0210] 2. List-based menu-style invitations:

[0211] In some embodiments of this application, the electronic device also provides a list-based invitation method. In this mode, the user brings up a window of the attendee list, selects a specific name using eye movement, and confirms the invitation with a gesture. The advantage of this method is that it does not rely on spatial location; even if people are obstructed or out of sight, the invitee can be quickly located.

[0212] In some embodiments of this application, to resolve the conflict between voice and action, list-based invitations can also trigger a channel pre-allocation process: before the invitee confirms, the electronic device establishes an independent "mini-meeting state cache" for them, including the freeze point of their current action data, AI virtualization strategy configuration, and attenuation parameters of the first meeting channel audio. Once the invitee confirms joining the second meeting, the electronic device immediately switches their channel permissions.

[0213] (1) Attitude Channel: The actual motion is only transmitted to the second attitude channel of the second conference;

[0214] (2) Audio Channel: Microphone input is marked as private meeting only and will no longer be transmitted to the first meeting;

[0215] (3) Virtual character images or alternative posture information of participants: AI-generated alternative actions are displayed in the first posture channel of the first meeting to avoid information leakage;

[0216] (4) Audio rendering: The first audio signal of the first conference is automatically weakened in the far field, while the second audio signal of the second conference remains normal.

[0217] In some embodiments of this application, the list-based invitation's secondary confirmation mechanism allows users to correct erroneous operations during both the selection and confirmation stages, avoiding unintentional invitations to participants with the same name or those they are unfamiliar with. After user confirmation, the electronic device immediately merges the data synchronization states of both sides, placing it in a privacy-protected environment consistent with other meeting members.

[0218] In some embodiments of this application, after an invitee confirms joining the second meeting, the electronic device immediately executes the following key technical processes: the first audio channel of the first meeting enters a weakened mode, and the second audio channel of the second meeting enables bidirectional transmission. User speech is only transmitted through the second audio channel and no longer enters the first meeting channel, fundamentally resolving the voice conflict problem. User actions, gestures, and expressions are set to be visible only to other members of the smaller meeting. AI automatically generates natural alternative actions on the first meeting side to resolve visual conflicts. The virtual avatar of the newly joined user instantly switches to a semi-transparent first meeting image or AI virtualization mode, maintaining consistency with other members of the smaller meeting.

[0219] In this way, by pre-caching the complete state information of the first meeting, the system can retain the context of the original session when the user switches to the second meeting, quickly initialize the state of the second meeting based on the cached data, and ensure that the user can seamlessly continue the previous interactive experience after joining the second meeting.

[0220] In some embodiments of this application, the method for setting up sub-conferences in a conference provided by the embodiments of this application further includes the following step 305.

[0221] Step 305: If the electronic device receives a second invitation message when the first user participates in the second meeting, the electronic device will display the first prompt message.

[0222] In some embodiments of this application, the first notification message is used to prompt the first user to exit the second meeting; the second invitation message includes the meeting identifier of the third meeting.

[0223] In some embodiments of this application, the invitee will receive an invitation prompt for a second meeting in their menu interface, such as... Figure 14-21 As shown. To ensure that the invitation process does not interrupt the experience of participating in the first meeting, the implementation method for creating sub-meetings in a meeting provided in this application adopts a "non-blocking prompt mechanism", that is, the prompt is presented in the form of a non-intrusive floating window, which will not cover the main speaker or shared screen in the current field of view.

[0224] In some embodiments of this application, the electronic device may only join one whispering system at a time to avoid multi-channel interference caused by multiple states.

[0225] In some embodiments of this application, when a user receives an invitation from another smaller meeting, namely a third meeting, while attending the first and second meetings, a conflict warning can be displayed, such as... Figure 15-22 As shown, the electronic device can trigger the collision detection module, prompting the user to exit the second meeting before joining the third meeting, based on the "single-channel uniqueness principle".

[0226] This avoids issues such as multi-channel voice conflicts, multi-source action control conflicts, AI virtualization state confusion, and abnormal sound rendering when users are present in multiple private meetings at the same time, thus ensuring the stability and privacy of the overall system.

[0227] In some embodiments of this application, combined with Figure 1 ,like Figure 16 As shown, after step 201 above, the implementation method for forming sub-conferences in a conference provided in this application embodiment further includes the following steps 203 and 204.

[0228] Step 203: The electronic device initializes the second audio channel, the second video channel, and the second posture channel of the second conference.

[0229] In some embodiments of this application, the second audio channel, the second video channel, and the second posture channel are isolated from the first audio channel, the first video channel, and the first posture channel.

[0230] Step 204: Configure the sound field parameters corresponding to the second audio channel in the electronic device.

[0231] In some embodiments of this application, the output orientation of the second output signal of the second audio channel after the above configuration corresponds to the spatial location of the second conference.

[0232] In some embodiments of this application, the aforementioned sound field parameters are a set of core configuration parameters used to construct a spatial audio environment in a virtual conference system. By precisely controlling the physical characteristics of the audio signal, an acoustic environment that conforms to human auditory perception can be reconstructed in virtual space.

[0233] In some embodiments of this application, the electronic device can simultaneously perform the following technical operations:

[0234] (1) Audio and video channel initialization: Automatically create independent audio and video channels for the private meeting, configure sound field parameters, and activate the attenuation and spatial rendering processing of the audio channel. The voice of the user speaking in the meeting is transmitted only through the private meeting channel. The electronic device dynamically shields the microphone audio signal of the first user received by the first audio channel of the first meeting through the voice source localization and deep learning model, ensuring that the microphone audio signal of the first user is transmitted only through the second audio channel of the second meeting and will not be leaked to the first meeting.

[0235] (2) Action channel isolation and virtualization generation: The user's actions, gestures and facial expressions in the private meeting are bound to the private meeting channel. At the same time, AI virtualized actions or semi-transparent alternative actions are displayed in the first meeting channel to ensure that the first user's posture and actions in the second meeting will not be observed by the outside, while maintaining the continuity and naturalness of the first user's actions displayed in the first meeting.

[0236] (3) Attention-driven switching preparation: During the startup process, the electronic device initializes the eye tracking and gaze detection modules to prepare for the subsequent intelligent switching between the first meeting and the first meeting state, ensuring that users can switch freely between the two types of meetings without conflict.

[0237] In this way, the startup method not only completes the interface interaction, but also realizes the real-time synchronous startup of the private voice channel, the action channel, and the AI ​​replacement mechanism, solving the problem of voice and screen conflict from the source and improving user experience and privacy protection.

[0238] In some embodiments of this application, the fourth user is the initiator of the second meeting. The method for establishing sub-meetings within a meeting provided in this application also includes the following steps 601 and 602.

[0239] Step 601: The electronic device receives the first user's first exit input for the second conference.

[0240] In some embodiments of this application, the first exit input is used to exit the second meeting if the first user is not the meeting initiator of the second meeting.

[0241] Step 602: In response to the first exit input, the electronic device closes the second audio channel and transmits the first audio signal and the microphone audio signal through the first audio channel.

[0242] In some embodiments of this application, the user identifier of the first user in the member list of other participants in the second meeting is removed.

[0243] In some embodiments of this application, the member list of the second meeting mentioned above includes user identifiers of all meeting members participating in the second meeting.

[0244] In some embodiments of this application, the aforementioned user identifier refers to information used to identify meeting members, typically including the member's name, avatar, role, etc. In the member list, the user identifier helps the user identify members participating in the first meeting. For example, in the member list, each participant's name or avatar is displayed next to their video window.

[0245] In some embodiments of this application, when the first user is not the initiator of the second meeting and the first user leaves the second meeting, the electronic device will immediately execute the following technical process:

[0246] (1) Close the second audio channel of the first user and use the first audio signal of the first audio channel as the working audio channel for normal rendering;

[0247] (2) Close the second attitude channel of the first user and use the first attitude channel as the working attitude channel to transmit the real-time attitude information of the first user;

[0248] (4) Stop distinguishing the participants of the second meeting in the first meeting, so that the participants who participate in both the first and second meetings are displayed in the same state as the participants who only participate in the first meeting, and restore the normal rendering mode;

[0249] (4) Update the list of participants in the second meeting to remove the first user without affecting the normal progress of the second meeting.

[0250] In some embodiments of this application, after exiting, the first user will no longer be able to obtain audio signals, video signals, posture information, or other related data from the second meeting. If they need to rejoin, they must be invited again to ensure that access to private meetings is strictly controlled.

[0251] In this way, when the non-meeting initiator leaves, the electronic device releases resources and restores its state, ensuring the stable operation of the second meeting and protecting privacy by closing the second audio channel.

[0252] In some embodiments of this application, the first user is the initiator of the second meeting. The method for establishing sub-meetings within a meeting provided in this application also includes steps 701 to 704 as described below.

[0253] Step 701: If the first user is simultaneously participating in the first meeting and the second meeting, the electronic device receives the first user's second exit input for the second meeting.

[0254] In some embodiments of this application, the aforementioned second exit input is used to exit the second meeting if the first user is the meeting initiator of the second meeting.

[0255] Step 702: The electronic device responds to the second exit input and displays the first prompt window.

[0256] In some embodiments of this application, the aforementioned first prompt window is used to prompt the first user whether to disband the second meeting.

[0257] Step 703: If the first user does not disband the second meeting, the electronic device will transfer management authority to the first participant who joined the second meeting earliest, and mark the first participant as the meeting controller.

[0258] In some embodiments of this application, the meeting controller is a participant with meeting management authority.

[0259] Step 704: The electronic device adds the first user to the third meeting.

[0260] In some embodiments of this application, the electronic device, within the exit and suspension mechanism of the private chat system, not only handles the switching of user states but also simultaneously manages the closure of audio and video channels, the redirection of action channels, the restoration of AI virtualization states, and the revocation of privacy protection policies. This ensures that no voice or action leaks occur after the user leaves the private chat session. Furthermore, to guarantee the stability of the chat session process, the implementation method for creating sub-conferences within a meeting, provided in the embodiments of this application, incorporates a private chat lifecycle management mechanism, allowing the chat session to continue under controllable logic even when the initiator exits.

[0261] In some embodiments of this application, when the first user, as the initiator of the second meeting, performs an exit operation, the electronic device first triggers the "private meeting lifecycle detection module." A prompt window pops up on the display interface of the first user's virtual display device, asking the first user whether to disband the second meeting. If the first user chooses not to disband, the electronic device automatically transfers management authority to the earliest invited person to join the second meeting and marks that invited person as the "meeting controller." Specifically, the transfer of management authority includes the following steps:

[0262] (1) Channel permission redirection: The invitee will take over the synchronization rights of the audio and video channels of the meeting, ensuring that the electronic device can still maintain stable audio synthesis and action synchronization after the first user leaves.

[0263] (2) AI virtualization strategy adjustment: After the first user exits, the first user's working posture channel is switched to the first posture channel. The virtual character in the first meeting will immediately resume the normal motion capture mode provided by the electronic device, and will no longer use the private meeting's motion isolation strategy.

[0264] (3) Voice input route restoration: The working audio channel of the first user is switched to the first audio channel. The microphone audio signal is transmitted through the first audio channel, while the second audio channel is cut off or released to prevent voice residue from being leaked in the private channel.

[0265] In this way, electronic devices improve the reliability of meeting organization and the consistency of user experience in a multi-session parallel environment through automated permission inheritance and state transition.

[0266] In some embodiments of this application, the electronic device also provides a suspension function, which allows users to temporarily exit a sub-meeting. However, the electronic device must ensure that no information leakage occurs during the suspension period, whether in terms of voice or gestures. The method for establishing sub-meetings within a meeting provided in this application achieves secure suspension through the following technical means.

[0267] In some embodiments of this application, the method for setting up sub-conferences in a conference provided by the embodiments of this application further includes the following steps 801 and 802.

[0268] Step 801: The electronic device receives the first user's suspend input for the second conference.

[0269] Step 802: In response to the suspend input, the electronic device switches the working audio channel from the second audio channel to the first audio channel and sends an empty action frame to the second attitude channel.

[0270] In some embodiments of this application, the real-time attitude information of the first user is transmitted through a second attitude channel.

[0271] In some embodiments of this application, the aforementioned empty action frame is a special data frame used in a virtual conference system to maintain session connectivity, and is used to keep the data transmission channel active without containing real user action data.

[0272] In some embodiments of this application, the electronic device can perform dual silence processing on the actions and voice of a suspended user. In the suspended state, the electronic device can freeze the second posture channel of the first user and send an empty action frame to the second posture channel, while simultaneously transmitting the microphone audio signal to the first audio channel, thus preventing the user from speaking or exposing their real-time posture to the second conference.

[0273] In this way, by isolating voice input and hiding motion data, the risk of information being leaked from private conversations to the outside world is eliminated while the user is suspended.

[0274] In some embodiments of this application, the method for setting up sub-conferences in a conference provided in this application further includes the following step 803.

[0275] Step 803: In response to the suspend input, the electronic device re-renders the conference view of the first conference.

[0276] In some embodiments of this application, the display parameters of the virtual images corresponding to all participants in the above-described meeting view are the same.

[0277] In some embodiments of this application, when the second meeting is suspended and the first user returns to the first meeting, the electronic device needs to restore the display interface of the first user's first meeting to the normal rendering mode. That is, the display interface of the first user's first meeting stops distinguishing the participants of the second meeting in the first meeting, so that the participants who participate in both the first and second meetings are displayed in the same state as the participants who only participate in the first meeting, ensuring that they can regain the complete environment of the first meeting.

[0278] In this way, electronic devices can restore the meeting view of the first meeting, allowing users to quickly re-enter the visual environment of the first meeting the moment the second meeting is suspended.

[0279] In some embodiments of this application, the method for setting up sub-conferences in a conference provided by the embodiments of this application further includes the following steps 804 and 805.

[0280] Step 804: In response to the suspend input, the electronic device saves the meeting view information of the first user in the second meeting.

[0281] In some embodiments of this application, the above-mentioned conference view information includes at least one of the following: the position of the virtual screen in the second conference, the view state of the first user in the second conference, and the current posture information of the first user.

[0282] In some embodiments of this application, the aforementioned view state refers to the display state of elements such as interfaces and objects in the scene.

[0283] Step 805: When the first user re-enters the second meeting, the electronic device switches the working audio channel from the first audio channel to the second audio channel and continues to render the meeting view of the second meeting based on the meeting view information.

[0284] In some embodiments of this application, the electronic device can establish a mechanism for immediate resumption when suspended. The electronic device can retain the user's audio and video position, view state, and action synchronization point in the second meeting. When the user chooses to re-enter the second meeting, the previous meeting content can be resumed immediately.

[0285] In this way, electronic devices can cache the view information of the second meeting, allowing users to quickly reintegrate into the visual environment of the second meeting when they return to it.

[0286] In some embodiments of this application, users access the system settings interface through a settings icon in the virtual interface, where they can operate functions such as adjusting the volume of the second and first meeting channels, the blurring degree of meeting participants, and AI virtualization action strategies. The electronic device employs spatial acoustic rendering and a real-time action channel isolation algorithm. When the first meeting is displayed as a non-target work meeting in a semi-transparent state, the first audio signal of the first meeting is attenuated and filtered to achieve weakening rather than complete muting; when the first meeting is the target work meeting, the second audio signal of the second meeting stops outputting, ensuring that the content of the second meeting is completely shielded from the first meeting, while allowing users to perceive a continuous meeting environment both visually and aurally.

[0287] For example, such as Figure 17 As shown, users participate in the first and second meetings via electronic devices, with a settings icon 20 displayed on the electronic device. Users can click on the settings icon 20 to input information, such as... Figure 18 As shown, the electronic device is triggered to display a first volume control 21 and a second volume control 22. The first volume control 21 is used to control the volume of the second meeting, and the second volume control 22 is used to control the volume of the first meeting. When the user switches to the second meeting, as... Figure 19 As shown, the electronic device can reduce the volume of the first meeting and display the second volume control 22 in a semi-transparent state to prompt the user to reduce the volume of the first meeting.

[0288] This application provides a method for implementing a private speaking system in a virtual meeting, solving the problems of voice input and video conflict that occur when virtual meetings cannot conduct synchronous group discussions in the prior art. Through XR devices and technologies such as multi-channel audio and video processing, AI virtualization, and attention recognition, seamless coexistence of large-scale meetings and private whispered sessions is achieved, while ensuring user privacy and engagement.

[0289] The main purpose of the implementation method for setting up sub-conferences in a conference provided in this application embodiment is to provide a practical function in a conference to fill the application gap of the current conference lacking a private message system.

[0290] Improvement 1: Constructing a multi-channel whispering system within a meeting to achieve real-time isolation and parallel processing between the first and second meetings. Unlike existing technologies that simply overlay additional discussion groups onto the same audio source, this application proposes for the first time a whispering system architecture based on multi-stream separation and motion channel isolation. Under this architecture, while maintaining awareness of the content of the first meeting, users can temporarily create a small-scale whispering discussion group, i.e., create a second meeting. The audio, motion, and facial expression data within the second meeting are independently encoded and only propagated among the participants in the second meeting, remaining completely invisible to the outside world, thus avoiding audio input or motion conflicts. Through this architectural design, the method for creating sub-meetings within a meeting provided in this application achieves unrestricted expansion of the number of participants, discussion group members, spatial location, and even the number of discussion groups.

[0291] Improvement 2: A two-way voice conflict resolution technology for the first / second meeting is proposed to achieve intelligent switching of asynchronous voice sources. Existing systems cannot manage two interacting audio sources simultaneously. If a user speaks, it will simultaneously affect the first meeting and the second meeting (e.g., a private discussion group), causing voice conflicts. The implementation method for creating sub-meetings within a meeting, provided in this application's embodiments, proposes:

[0292] (1) Speaker-Context Binding: Electronic devices automatically bind the voice input channel according to the current meeting context of the user;

[0293] (2) Active channel switching mechanism based on gaze point and gesture: when a user looks at a speaker in a meeting and makes a confirmation gesture, the voice input channel automatically switches to the corresponding meeting;

[0294] (3) Audio differentiation rendering based on spatial sound field: Electronic devices generate different sound fields according to the spatial positioning of two meetings, so that users will not be confused even if they hear the sounds of two meetings at the same time.

[0295] Through the above-mentioned technology, the method for setting up sub-conferences in a meeting provided in this application embodiment completely solves the conflict problem between multiple real-time voice sources in a virtual meeting scenario, and improves the naturalness of multi-person collaboration.

[0296] Improvement 3: This invention proposes a completely isolated model where the video feeds from the first and second meetings are transmitted and rendered separately via independent video channels, resolving the occlusion and interference issues caused by multiple concurrent screens. Traditional solutions cannot simultaneously display the independent feeds of two meetings, leading to a cluttered interface and visual conflicts. The method for creating sub-meetings within a meeting, as provided in this application, proposes the following:

[0297] (1) The semi-transparent and dynamic blurring algorithm of the first meeting: when the target working meeting is the second meeting, the people in the first meeting are semi-transparent or blurred, and only the necessary action outlines are retained;

[0298] (2) In the case that the target working meeting is the second meeting, the second meeting displays the real posture information of the first user, while the first meeting displays alternative posture information based on AI virtual generation (such as automatic micro-movement, expression neutralization, posture mirroring).

[0299] (3) Dual-screen parallel display technology: The first video signal of the first conference (including the conference screen of the first conference, the posture of the participants of the first conference, etc.) and the second video signal of the second conference (including the conference screen of the second conference, the posture of the participants of the second conference, etc.) appear simultaneously in the display interface of the first user. The display priority of the two is switched by the gaze point to solve the problem of occlusion and overlapping interference.

[0300] The above design ensures that users can continue to follow the progress of the first meeting while participating in the second meeting, achieving a comfortable experience of dual screens and dual tasks.

[0301] Improvement 4: Proposes attention-based switching for target work meetings, achieving seamless shifting of meeting focus. To allow users to switch naturally between the first and second meetings, the implementation method for creating sub-meetings within a meeting, as provided in this application, proposes an attention-switching technology based on the coupling of eye tracking, spatial sound field perception, and speaker recognition, including:

[0302] (1) Determine whether the first user wants to switch meetings based on the matching degree between the first user's gaze point and the direction of the voice source;

[0303] (2) The scanning action of the first user (scanning without voice source matching) is automatically ignored to avoid accidental switching;

[0304] (3) When switching target work meetings, automatically adjust the work audio channel, work video channel or work posture channel to make the switching seamless;

[0305] (4) Automatically cache video and audio signals for non-target work meetings to provide users with "meeting frame tracking" capability.

[0306] This technology enhances the intelligence of virtual meetings, allowing users to automatically match the most important meetings based on their current attention without any user intervention.

[0307] Improvement 5: A suspended and transferable private message system management mechanism is proposed to support dynamic hosting of second meetings. The implementation method for creating sub-meetings within a meeting, provided in this application, innovatively proposes a private message system suspension and inheritance mechanism:

[0308] (1) When the first user, as the initiator of the second meeting, withdraws from the second meeting, he / she may choose to disband the second meeting or transfer the management rights of the second meeting to the first invited person of the second meeting;

[0309] (2) Participants who are simultaneously participating in the first meeting and the second meeting can switch the second meeting to the suspended state and switch the target work meeting to the first meeting. The second meeting in the suspended state will automatically save the second audio signal and / or the second video signal of the second meeting for the participant to view.

[0310] (3) When the second meeting is suspended, the second audio signal, second video signal and posture information of the second meeting are frozen or stopped from being output through the first user's virtual reality device, so that the first user can focus on participating in the first meeting.

[0311] This mechanism allows the second meeting to exist sustainably, much like a real "temporary meeting room," thus improving its practicality.

[0312] In some embodiments of this application, the entire process of the method for setting up sub-conferences in a conference provided by the embodiments of this application, from gaze detection, intent inference, channel switching to content recording, constitutes a complete attention-driven intelligent switching system for conferences.

[0313] Figure 20 This is a schematic diagram illustrating the execution process of a method for creating sub-meetings within a meeting, as provided in an embodiment of this application. Figure 20 As shown in the embodiments of this application, the method for setting up sub-conferences in a conference may include the following steps 20 to 28.

[0314] Step 20: Enter the whisper system.

[0315] Step 21: Fixation identification.

[0316] Step 22: Look at the speaker.

[0317] Step 23: Determine the target working meeting based on the first user's meeting switching input, the first user's gaze point, or the first user's speech content.

[0318] If the target working meeting is the second meeting, proceed to step 24; if the target working meeting is the first meeting, proceed to step 25.

[0319] Step 24: Enable the second audio channel of the second conference, weaken the first audio signal of the first conference, switch the working posture channel to the second posture channel, and output AI virtualized alternative posture information from the first posture channel of the first conference.

[0320] Step 25: Enhance the first audio signal of the first conference, transmit the microphone audio signal through the first audio channel, turn off or reduce or output the second audio signal of the second conference in the far field, switch the working posture channel to the first posture channel, and stop outputting the second posture channel of the second conference or output AI virtualized alternative posture information.

[0321] Step 26: Spatial acoustic rendering: Adjust the sound field according to the gaze direction, including sound source direction matching and audio attenuation for non-target work meetings.

[0322] Step 27: Automatically record the content of non-target work meetings, including video recordings, audio recordings, and action / speech buffers.

[0323] Step 28: Return to the main loop: continuously monitor user attention.

[0324] In some embodiments of this application, a multi-channel whispering system is constructed in a virtual meeting environment, achieving breakthroughs in many aspects of traditional virtual meeting technology and having the following significant beneficial effects:

[0325] 1. Fundamentally solve the technical problem of "large meetings and small meetings cannot be held in parallel" in virtual meetings.

[0326] The implementation method for setting up sub-conferences in a conference provided in this application embodiment proposes for the first time a signal isolation and rendering technology framework for parallel operation of dual conferences, including comprehensive isolation of three dimensions: voice signal stream, motion data stream, and screen rendering stream, enabling users to conduct the main conference and private small conferences simultaneously without conflict in the same virtual conference environment.

[0327] 2. Implement intelligent channel binding for voice input to completely avoid voice conflicts.

[0328] The method for setting up sub-conferences in a conference provided in this application adopts a voice input context binding algorithm. By combining the user's current conference status, gaze direction, gesture confirmation, and other conditions, the microphone input is automatically bound to the correct conference channel, so that the voice will not be mistakenly entered into the first conference or other second conferences.

[0329] This channel binding mechanism not only achieves voice isolation, but also significantly improves the user experience by eliminating the need for any explicit operations during meeting switching.

[0330] 3. Achieve uninterrupted coexistence between the main conference screen and the private conversation screen, avoiding visual conflicts.

[0331] Traditional technologies struggle to present two meeting screens within the same virtual space. The method for creating sub-meetings within a meeting, provided in this application embodiment, achieves this through:

[0332] (1) Making external meeting participants semi-transparent;

[0333] (2) AI-powered virtual compensation for posture and facial expressions;

[0334] (3) Dual-screen rendering in parallel;

[0335] (4) Dynamic layered occlusion processing.

[0336] When the target work meeting is the second meeting, the display of the first video signal of the first meeting will be automatically weakened so as not to interfere with the display of the second video signal of the second meeting. The first user can automatically switch the display priority of the two through eye movement or gesture input so as not to cause visual confusion due to scene overlap.

[0337] This solves the technical challenge of "rendering conflicts caused by multiple people overlapping spaces".

[0338] 4. Provide attention-based intelligent meeting switching to enhance the system's intelligence level.

[0339] The implementation method for creating sub-conferences within a conference provided in this application's embodiments introduces a fusion algorithm of eye-tracking, spatial acoustic localization, and speaker detection to achieve:

[0340] (1) Automatically switch conferences when the gaze and sound source direction are aligned;

[0341] (2) Automatic filtering of unintentional behaviors such as gazing and saccades;

[0342] (3) The sound field is updated in real time;

[0343] (3) Uninterrupted switching between audio and motion channels.

[0344] Users can "switch naturally" in complex meeting scenarios without manual operation, greatly improving efficiency and immersion.

[0345] 5. Automatically record unattended meeting streams to achieve full meeting frame tracking capability.

[0346] The method for creating sub-conferences within a meeting, provided in this application embodiment, combines the multi-stream recording mechanism of electronic devices to automatically cache the audio / video / motion streams of meetings that the user is not currently watching, allowing the user to review them at any time.

[0347] (1) The conference content will not be lost;

[0348] (2) The whispered content is completely preserved;

[0349] (3) Traceability of multiple concurrent meetings.

[0350] This capability significantly surpasses the possibilities of real-world offline meetings, representing a major innovation in the field of virtual meetings.

[0351] 6. Supports the suspension, inheritance, and persistent operation of the private messaging system, forming a new meeting organization model.

[0352] The suspension and management mechanism of the implementation method for forming sub-conferences in a conference provided by the embodiments of this application:

[0353] (1) The second meeting can be automatically inherited after the initiator withdraws, without interrupting the operation;

[0354] (2) Users can suspend the second meeting and return to the first meeting at any time;

[0355] (4) The content inside the whisper system is securely isolated during the suspension period.

[0356] This mechanism endows the second meeting room with the attributes of an "independent meeting room," providing a brand-new organizational method for complex meeting scenarios and significantly enhancing its applicability.

[0357] 7. Enhance the naturalness of meetings and surpass the offline meeting experience.

[0358] Through the above-described technology, the method for establishing sub-conferences within a conference provided in this application embodiment achieves the following capabilities:

[0359] (1) Attending multiple meetings simultaneously;

[0360] (2) Seamless and natural shifts in meeting focus;

[0361] (3) Automatic recording and frame tracking of unattended meetings;

[0362] (4) Privacy content is completely isolated within the same scenario;

[0363] (5) Parallel rendering of audio / video / action without synchronization interference.

[0364] It not only simulates traditional meeting scenarios, but also surpasses real-world meeting models in terms of information management, attention scheduling, and the ability to hold multiple meetings in parallel.

[0365] The virtual meeting whispering system provided in this application has unique and highly identifiable technical features in its architecture, signal channel division, meeting rendering process, and user interaction mechanism. Each key technical solution has significant infringement visibility, which facilitates identification and confirmation in subsequent comparison with actual products and infringement judgment. The specific description is as follows:

[0366] 1. The multi-channel voice input isolation mechanism can be directly detected in system behavior.

[0367] The implementation method for creating sub-conferences within a conference provided in this application defines an automatic binding and switching strategy between the first conference's audio channel and the private speaking system's audio channel. This includes functions such as audio input being collected only in the current focus conference and audio channel migration associated with gaze points and confirmation gestures. In a practical system, this mechanism will manifest as follows:

[0368] (1) When a user speaks in two meetings, the microphone data only flows to one meeting;

[0369] (2) The audio source changes automatically after gaze is triggered;

[0370] (3) There will be audio interference between the first meeting and the small meeting.

[0371] These can all be directly determined by comparing system behavior, recorded logs, and data flow, thus providing a high degree of visibility into infringement.

[0372] 2. The strategies of image isolation and rendering reduction have observable visual effects.

[0373] Upon entering the Whisper system, the initial meeting screen is made transparent, blurred, or weakened, and the actions of external figures are subject to AI virtual compensation, while the Whisper system itself maintains realistic rendering. This effect is clearly visible in the product and constitutes a typical, visually identifiable infringement feature.

[0374] 3. Attention-based automatic meeting switching behavior belongs to explicit and detectable action logic.

[0375] The attention switching mechanism of the implementation method for forming sub-conferences in a conference provided in this application embodiment includes:

[0376] (1) Users can switch focus meetings simply by looking at the speaker;

[0377] (2) Gazing at a non-matching sound source will not trigger a switch;

[0378] (3) Electronic devices will automatically track unattended meetings and generate retrievable content.

[0379] If a third-party product exhibits similar behavioral logic, infringement can be directly determined through behavioral observation, eye-tracking data response, and log debugging information.

[0380] 4. The whispering system's suspension, inheritance, and independent persistence capabilities possess structured functional characteristics.

[0381] The implementation method for creating sub-conferences within a meeting, provided in this application embodiment, supports automatic handover of management to the private messaging system after the initiator exits, and allows for suspension and resumption. This logic will manifest as a specific UI flow and system state transition in any product implementing this technology, which can be directly compared through functional operations.

[0382] 5. The bidirectional isolation between action flow and speech flow in the private speech system is a core structural feature and is easy to compare.

[0383] When a user enters the second meeting, their actions and voice stream are frozen or virtualized in the first meeting, but remain real in the second meeting. This type of behavior is clearly manifested in real-world systems, such as:

[0384] (1) The user's actions observed in the first meeting were neutral and generated by AI;

[0385] (2) The user seen in the second meeting maintains complete action.

[0386] This feature is exceptionally prominent in XR systems, making it extremely easy to detect and compare.

[0387] In summary, all the core technologies of the method for setting up sub-conferences in a conference provided in this application have high visibility, strong recognizability, and clear behavioral manifestations, which can be directly used as important technical features for infringement judgment, providing a clear basis for subsequent scope of protection definition and infringement comparison.

[0388] Although the private speaking system provided in this application embodiment can be flexibly adjusted in its specific implementation according to different device capabilities, operating system architecture or interaction methods, its core design ideas and technical routes are highly unavoidable.

[0389] On the one hand, the differences in appearance or UI level such as interface layout, interaction method, blur intensity, and volume control form in specific implementation schemes are implementation details that can be circumvented by different products through replacement. However, these do not constitute the substantial innovation of the implementation method of setting up sub-conferences in a meeting provided in the embodiments of this application, nor will they affect the identification of core capabilities.

[0390] On the other hand, the core idea of ​​the method for creating sub-conferences within a meeting provided in this application is to achieve parallel operation of the first meeting and the whispering sub-conference in the same virtual meeting environment. This is achieved through technologies such as voice channel isolation, motion flow isolation, rendering weakening, attention-driven meeting switching, and AI virtual compensation, enabling the two types of meetings to coexist without interference in the scenario. This represents an innovative capability at the structural, functional, and logical levels, and is the fundamental logic upon which the entire system can function. Any solution that achieves "multiple meetings running simultaneously in the same scenario" or "creating a whispering group within a meeting and maintaining isolation from the first meeting" inevitably requires:

[0391] (1) Independent voice input channel division;

[0392] (2) Dual-stream isolation for image / action rendering;

[0393] (3) User focus or attention is used as the basis for switching meetings;

[0394] (4) Synchronous management and conflict resolution of the first and second meeting systems;

[0395] (5) Handling of content from meetings that were not attended, including recording, one-way rendering, and downplaying.

[0396] These logics are not features that can be avoided at the UI level, but rather fundamental technical paths that cannot be replaced in implementing this system. Therefore, any product that attempts to achieve the function of "creating private sub-meetings in a virtual meeting without interfering with the main meeting" will inevitably fall within the technical concept scope of the implementation method for forming sub-meetings in a meeting provided in the embodiments of this application.

[0397] In summary, the specific implementation scheme of the method for setting up sub-conferences in a conference provided in this application can be replaced or modified, but its core idea and system architecture are unavoidable technical solutions with high unavoidability and good protection value.

[0398] The method for creating sub-conferences within a conference provided in this application, along with the proposed whispering system, primarily targets virtual conference scenarios. However, its technical approach to isolating, parallelizing, switching, and managing conflicts among multiple real-time conferences within the same digital environment is highly transferable and can be widely applied to more open metaverse spaces and traditional two-dimensional online conferencing systems. Specific details are as follows:

[0399] 1. Potential extensions in open metaverse scenarios

[0400] In a decentralized, multi-user, immersive metaverse space, the method for creating sub-conferences within a meeting, as provided in this application, can be naturally extended to more application scenarios, including but not limited to: intelligent space management with multiple social circles existing in parallel, audio and video stream management supporting mobile and multi-scene overlay, and asynchronous tracking and automatic recording functions supporting multiple meeting bodies. Specifically:

[0401] (1) Intelligent space management with multiple social circles coexisting

[0402] In scenarios such as open-air streets, virtual campuses, and virtual office buildings, users can instantly switch between different groups without leaving their current environment, for example:

[0403] a. Quickly switch to "Street Corner Whisper Mode" with friends while strolling through the virtual city.

[0404] b. Initiate a random group discussion in the virtual office free area.

[0405] c. Conduct one-on-one temporary communication with exhibitors or attendees in virtual exhibitions.

[0406] The channel isolation, rendering weakening, and attention switching techniques of the implementation method for forming sub-conferences in a conference provided in this application embodiment can be seamlessly extended to these free scenarios.

[0407] (2) Supports mobile, multi-scenario overlay audio and video stream management

[0408] Unlike traditional fixed meeting rooms, the open metaverse emphasizes the freedom of the scene.

[0409] The method for creating sub-conferences within a conference provided in this application embodiment can be extended to:

[0410] a. Users can hold meetings while walking around, or enter small-group discussions while exploring virtual city scenes.

[0411] b. Conduct multi-level command in multiplayer competitive and cooperative scenarios, including tactical squad discussions, a master command channel, and primary conference broadcasts.

[0412] c. Create "local listening zones" or "small group learning circles" in scenarios where large numbers of users gather, such as virtual concerts and classrooms.

[0413] This is a complex parallel structure that traditional voice systems cannot handle simultaneously. The implementation method for forming sub-conferences in a conference provided in the embodiments of this application offers a complete solution.

[0414] (3) Supports asynchronous tracking and automatic recording functions for multiple meetings.

[0415] The metaverse emphasizes the continuity of experience. The "automatic recording of unattended meetings" capability of the implementation method for creating sub-meetings within a meeting provided in this application embodiment can be implemented in the metaverse:

[0416] a. Multi-room meeting tracking

[0417] b. Event flow recap between characters

[0418] c. Replay of user movement trajectories across different scenarios

[0419] Upgrade the traditional frame-tracking function of meetings to a broader metaverse of "multi-threaded event recording".

[0420] 2. Application value in ordinary online meetings

[0421] Although the implementation method for forming sub-conferences in a conference provided in the embodiments of this application is geared towards XR scenarios, its technical concept is also applicable to 2D online conferences.

[0422] (1) Achieving parallel operation of multiple online meetings in a single-screen online meeting

[0423] Traditional online meetings do not allow users to create subgroups for discussion within the same meeting room. However, the implementation method for creating sub-meetings within a meeting, as provided in this application embodiment, can be transformed into a two-dimensional interface:

[0424] a. The first meeting screen is used as the main view.

[0425] b. Sub-meetings, or second meetings, are presented as sub-windows or sidebars.

[0426] c. Users can switch audio input channels via mouse clicks or intelligent recognition.

[0427] d. The content of the second meeting is not visible to those who attended the first meeting but did not attend the second meeting.

[0428] To enable "small meetings within small meetings" in a two-dimensional interface.

[0429] (2) Introducing a meeting switching mechanism based on attention and focus recognition, without the need for XR eye tracking, can also achieve a similar intelligent switching mechanism using mouse hover, camera gaze direction estimation, voice direction / speech tendency prediction, or window activity. This will add a "highly intelligent meeting diversion" capability to ordinary online meetings.

[0430] (3) The two-dimensional interface can also support dual-stream automatic recording, for example:

[0431] a. The first meeting was shrunk to a corner but recording continued.

[0432] b. While a user is joining the second meeting, the first meeting will automatically begin recording in the background.

[0433] c. After the meeting, the electronic device automatically generates a comparison document of the main meeting and the private meeting.

[0434] This is logically consistent with the XR solution, only the visual presentation is different.

[0435] Each of the above-described method embodiments, or various possible implementations of each method embodiment, can be executed individually or in combination of any two or more. The specific implementation can be determined according to actual usage requirements, and this application does not impose any restrictions on this.

[0436] The implementation method for creating sub-conferences within a conference provided in this application embodiment can be executed by an implementation device for creating sub-conferences within a conference. This application embodiment uses the implementation device for creating sub-conferences within a conference executing the implementation method as an example to illustrate the implementation device for creating sub-conferences within a conference provided in this application embodiment.

[0437] Figure 21 This illustration shows a possible structural diagram of an implementation apparatus for forming sub-conferences within a conference, as described in some embodiments of this application. For example... Figure 21 As shown, the device 70 for setting up sub-conferences in a conference may include an invitation module 71.

[0438] The invitation module 71 is used to invite or add a second user to the second meeting in response to the first user's first input during the first user's participation in the first meeting.

[0439] The aforementioned first user participates in both the first and second meetings simultaneously. The first audio signal of the first meeting is transmitted through the first audio channel, and the second audio signal of the second meeting is transmitted through the second audio channel.

[0440] In one possible implementation, the first audio signal includes a first output signal output by the first conference to the first user; the second audio signal includes a second output signal output by the second conference to the first user; the volume levels of the first output signal and the second output signal are different; and / or, the output orientations of the first output signal and the second output signal are different.

[0441] In one possible implementation, the above-described apparatus further includes: a transmission module; the transmission module is configured to transmit a microphone audio signal based on a current operating audio channel, the microphone audio signal being obtained through a microphone, the operating audio channel including a first audio channel and a second audio channel; when the current operating audio channel is the first audio channel, the microphone audio signal and the first audio signal are transmitted through the first audio channel, and the second audio signal is transmitted through the second audio channel: the volume of the first audio signal is greater than the volume of the second audio signal; and / or, the first audio signal is a near-field audio signal, and the second audio signal is a far-field audio signal; when the current operating audio channel is the second audio channel, the first audio signal is transmitted through the first audio channel, and the microphone audio signal and the second audio signal are transmitted through the second audio channel: the volume of the second audio signal is greater than the volume of the first audio signal; and / or, the second audio signal is a near-field audio signal, and the first audio signal is a far-field audio signal.

[0442] In one possible implementation, the first video signal of the first conference is transmitted through the first video channel, and the second video signal of the second conference is transmitted through the second video channel.

[0443] In one possible implementation, the above-mentioned device further includes: a transmission module; the transmission module is used to transmit real-time posture information of a first user based on a current working posture channel, the real-time posture information being obtained through a camera module, the working posture channel including a first posture channel connected to a first conference and a second posture channel connected to a second conference; when the current working posture channel is the first posture channel, the real-time posture information of the first user is transmitted through the first posture channel, and the participants of the first conference obtain the real-time posture information of the first user; when the current working posture channel is the second posture channel, the real-time posture information of the first user is transmitted through the second posture channel, and the participants of the second conference obtain the real-time posture information of the first user.

[0444] In one possible implementation, the above apparatus further includes: a generation module; the generation module is used to generate alternative posture information of a first user based on AI; when the current working posture channel is the first posture channel, the alternative posture information of the first user is transmitted through a second posture channel, and the participants of the second meeting obtain the alternative posture information of the first user; when the current working posture channel is the second posture channel, the alternative posture information of the first user is transmitted through the first posture channel, and the participants of the first meeting obtain the alternative posture information of the first user.

[0445] In one possible implementation, the above-mentioned device further includes: a determining module; the determining module is configured to, after inviting or adding a second user to join the second meeting, determine a working audio channel, a working video channel, or a working posture channel based on the target working meeting; switch the target working meeting based on at least one of the following: the first user looks at the first participant and the duration of the look exceeds a preset threshold, and the target working meeting is switched to the meeting to which the first participant belongs; the first user looks in the direction of the first audio source, and the target working meeting is switched to the meeting corresponding to the direction of the first audio source; the first user is a speaker in the meeting, and the target working meeting is switched according to the content of the first user's speech; and receive the meeting switching input from the first user.

[0446] In one possible implementation, the above-mentioned device further includes: a display module; the display module is used to distinguish the second user from other members who are not participating in the second meeting in the virtual meeting scenario of the first meeting when the second user participates in both the first meeting and the second meeting simultaneously.

[0447] In one possible implementation, the above apparatus further includes: a recording module; the recording module is configured to, when the first user is simultaneously participating in the first meeting and the second meeting, record the audio data stream, video data stream, and posture data stream of the second meeting, and generate a first recording file, if the working audio channel is the first audio channel; or, the recording module is configured to, when the first user is simultaneously participating in the first meeting and the second meeting, record the audio data stream, video data stream, and posture data stream of the first meeting, and generate a second recording file, if the working audio channel is the second audio channel.

[0448] In one possible implementation, the above apparatus further includes: a caching module and an update module; the caching module is used to cache the meeting status information of the first meeting upon receiving a meeting invitation message from a third user for a third meeting, the meeting status information including at least one of the following: the first user's current posture information, the first user's alternative posture information, and the audio attenuation parameter of the first audio channel; the update module is used to update the first user's meeting status in the third meeting based on the meeting status information when the first user joins the third meeting upon receiving a confirmation invitation input from the first user.

[0449] In one possible implementation, the above-mentioned device further includes: a display module; the display module is configured to display a first prompt message if a second invitation message is received when the first user participates in the second meeting, the first prompt message being used to prompt the first user to exit the second meeting; the second invitation message includes a meeting identifier for the third meeting.

[0450] In one possible implementation, the above-mentioned device further includes: an initialization module and a configuration module; the initialization module is used to initialize the second audio channel, the second video channel and the second posture channel of the second conference after inviting or adding a second user to join the second conference, the second audio channel, the second video channel and the second posture channel being isolated from the first audio channel, the first video channel and the first posture channel; the configuration module is used to configure the sound field parameters corresponding to the second audio channel, the output orientation of the second output signal output by the configured second audio channel corresponding to the spatial position of the second conference.

[0451] In one possible implementation, the fourth user is the initiator of the second conference, and the device further includes: a receiving module and a transmitting module; the receiving module is used to receive the first user's first exit input for the second conference; the transmitting module is used to, in response to the first exit input, close the second audio channel and transmit the first audio signal and the microphone audio signal through the first audio channel; the user ID of the first user is removed from the member list of other participants in the second conference.

[0452] In one possible implementation, the first user is the initiator of the second meeting; the device further includes a receiving module and an execution module; the receiving module is used to receive a second exit input from the first user for the second meeting if the first user is simultaneously participating in the first meeting and the second meeting; the display module is also used to display a first prompt window in response to the second exit input, the first prompt window being used to prompt the first user whether to disband the second meeting; the execution module is used to transfer management authority to the first participant who first joined the second meeting if the first user does not disband the second meeting, and to mark the first participant as the meeting controller; the invitation module 71 is also used for the first user to join the third meeting.

[0453] In one possible implementation, the above-mentioned device further includes: a receiving module and a switching module; the receiving module is used to receive a suspension input from a first user to the second conference; the switching module is used to switch the working audio channel from the second audio channel to the first audio channel in response to the suspension input, and send an empty motion frame to the second attitude channel; the real-time attitude information of the first user is transmitted through the second attitude channel.

[0454] In one possible implementation, the above apparatus further includes: a rendering module; the rendering module is configured to, upon receiving a suspension input from a first user for the second meeting, re-render the meeting view of the first meeting in response to the suspension input, wherein the display parameters of the virtual images corresponding to all participants in the meeting view are the same.

[0455] In one possible implementation, the above-described apparatus further includes a storage module. This storage module is configured to, upon receiving a suspend input from the first user for the second conference, save the first user's conference view information in the second conference in response to the suspend input. This conference view information includes at least one of the following: the position of the virtual screen in the second conference, the first user's view state in the second conference, and the first user's current posture information. The switching module is further configured to, upon the first user re-entering the second conference, switch the working audio channel from the first audio channel to the second audio channel, and continue rendering the conference view of the second conference based on the conference view information.

[0456] This application provides an implementation device for setting up sub-conferences within a conference. Since it can transmit the audio signals of the two conferences separately through two independent audio channels when a target user is simultaneously participating in both conferences, it can preserve the target user's connection status in both conferences, ensuring that the user does not completely lose awareness of either conference. Simultaneously, it allows for individual adjustment of the audio signal of a particular conference, thus achieving a smooth shift of attention between conferences and avoiding the disruption to conference flow caused by directly isolating the conference. This enhances the flexibility of the sound isolation mechanism in multi-person conferences.

[0457] The device for establishing sub-conferences within a conference in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the scope of the device.

[0458] The device for setting up sub-conferences within a conference in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system used.

[0459] The apparatus for setting up sub-conferences in a conference provided in this application embodiment can implement all the processes implemented in the above method embodiments, and will not be repeated here to avoid repetition.

[0460] Optionally, such as Figure 22 As shown, this application embodiment also provides an electronic device 1000, including a processor 1001 and a memory 1002. The memory 1002 stores a program or instructions that can run on the processor 1001. When the program or instructions are executed by the processor 1001, they implement the various steps of the above-described implementation method embodiment for forming sub-conferences in a conference and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0461] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.

[0462] Figure 23 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.

[0463] The electronic device 100 includes, but is not limited to, components such as: radio frequency unit 101, network module 102, audio output unit 103, input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, and processor 110.

[0464] Those skilled in the art will understand that the electronic device 100 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 110 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 23 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0465] The processor 110 is configured to, in response to the first user's first input, invite or add a second user to the second meeting during the first user's participation in the first meeting.

[0466] The aforementioned first user participates in both the first and second meetings simultaneously. The first audio signal of the first meeting is transmitted through the first audio channel, and the second audio signal of the second meeting is transmitted through the second audio channel.

[0467] Optionally, the first audio signal includes a first output signal output by the first conference to the first user; the second audio signal includes a second output signal output by the second conference to the first user; the volume levels of the first output signal and the second output signal are different; and / or, the output orientations of the first output signal and the second output signal are different.

[0468] Optionally, the network module 102 is configured to transmit a microphone audio signal based on the current operating audio channel. The microphone audio signal is obtained through a microphone, and the operating audio channel includes a first audio channel and a second audio channel. When the current operating audio channel is the first audio channel, the microphone audio signal and the first audio signal are transmitted through the first audio channel, and the second audio signal is transmitted through the second audio channel. The volume of the first audio signal is greater than the volume of the second audio signal. And / or, the first audio signal is a near-field audio signal, and the second audio signal is a far-field audio signal. When the current operating audio channel is the second audio channel, the first audio signal is transmitted through the first audio channel, and the microphone audio signal and the second audio signal are transmitted through the second audio channel. The volume of the second audio signal is greater than the volume of the first audio signal. And / or, the second audio signal is a near-field audio signal, and the first audio signal is a far-field audio signal.

[0469] Optionally, the first video signal of the first conference is transmitted through the first video channel, and the second video signal of the second conference is transmitted through the second video channel.

[0470] Optionally, the network module 102 is used to transmit real-time posture information of a first user based on the current working posture channel. This real-time posture information is obtained through a camera module. The working posture channel includes a first posture channel connected to a first conference and a second posture channel connected to a second conference. When the current working posture channel is the first posture channel, the real-time posture information of the first user is transmitted through the first posture channel, and the participants of the first conference obtain the real-time posture information of the first user. When the current working posture channel is the second posture channel, the real-time posture information of the first user is transmitted through the second posture channel, and the participants of the second conference obtain the real-time posture information of the first user.

[0471] Optionally, the processor 110 is used to generate alternative posture information of a first user based on AI; when the current working posture channel is the first posture channel, the alternative posture information of the first user is transmitted through the second posture channel, and the participants of the second meeting obtain the alternative posture information of the first user; when the current working posture channel is the second posture channel, the alternative posture information of the first user is transmitted through the first posture channel, and the participants of the first meeting obtain the alternative posture information of the first user.

[0472] Optionally, the processor 110 is configured to, after inviting or adding a second user to the second meeting, determine a working audio channel, a working video channel, or a working posture channel based on the target working meeting; switch the target working meeting based on at least one of the following: the first user looks at the first participant and the duration of the look exceeds a preset threshold, the target working meeting is switched to the meeting to which the first participant belongs; the first user looks in the direction of the first audio source, the target working meeting is switched to the meeting corresponding to the direction of the first audio source; the first user is a speaker in the meeting, the target working meeting is switched according to the content of the first user's speech; and receive meeting switching input from the first user.

[0473] Optionally, the display unit 106 is used to distinguish the second user from other members who are not participating in the second meeting in the virtual meeting scenario of the first meeting when the second user is simultaneously participating in the first meeting and the second meeting.

[0474] Optionally, the processor 110 is configured to, when the first user is simultaneously participating in the first meeting and the second meeting, record the audio data stream, video data stream, and attitude data stream of the second meeting and generate a first recording file if the working audio channel is the first audio channel; or, the processor 110 is configured to, when the first user is simultaneously participating in the first meeting and the second meeting, record the audio data stream, video data stream, and attitude data stream of the first meeting and generate a second recording file if the working audio channel is the second audio channel.

[0475] Optionally, the memory 109 is configured to cache the meeting status information of the first meeting upon receiving a meeting invitation message from a third user for a third meeting. The meeting status information includes at least one of the following: the first user's current posture information, the first user's alternative posture information, and the audio attenuation parameter of the first audio channel. The processor 110 is configured to, upon receiving a confirmation invitation input from the first user, allow the first user to join the third meeting and update the first user's meeting status in the third meeting based on the meeting status information.

[0476] Optionally, the display unit 106 is configured to display a first prompt message if a second invitation message is received when the first user participates in the second meeting. The first prompt message is used to prompt the first user to exit the second meeting; the second invitation message includes a meeting identifier for the third meeting.

[0477] Optionally, the processor 110 is used to initialize the second audio channel, the second video channel, and the second posture channel of the second conference after inviting or adding a second user to join the second conference. The second audio channel, the second video channel, and the second posture channel are isolated from the first audio channel, the first video channel, and the first posture channel. The processor 110 is used to configure the sound field parameters corresponding to the second audio channel. The output orientation of the second output signal of the configured second audio channel corresponds to the spatial position of the second conference.

[0478] Optionally, the fourth user is the initiator of the second meeting. The user input unit 107 is used to receive the first user's first exit input for the second meeting. The network module 102 is used to close the second audio channel in response to the first exit input and transmit the first audio signal and microphone audio signal through the first audio channel. The user ID of the first user is removed from the member list of other participants in the second meeting.

[0479] Optionally, the first user is the initiator of the second meeting; the user input unit 107 is used to receive a second exit input from the first user for the second meeting if the first user is simultaneously participating in the first meeting and the second meeting; the display unit 106 is also used to display a first prompt window in response to the second exit input, the first prompt window being used to prompt the first user whether to disband the second meeting; the processor 110 is used to transfer management authority to the first participant who first joined the second meeting if the first user does not disband the second meeting, and to mark the first participant as the meeting controller; the processor 110 is also used for the first user to join the third meeting.

[0480] Optionally, the user input unit 107 is used to receive a suspension input from the first user to the second conference; the processor 110 is used to switch the working audio channel from the second audio channel to the first audio channel in response to the suspension input, and send an empty motion frame to the second attitude channel; the real-time attitude information of the first user is transmitted through the second attitude channel.

[0481] Optionally, the processor 110 is configured to, upon receiving a suspend input from the first user for the second conference, re-render the conference view of the first conference in response to the suspend input, wherein the display parameters of the virtual avatars corresponding to all participants in the conference view are the same.

[0482] Optionally, the memory 109 is configured to, upon receiving a suspend input from the first user for the second conference, save the first user's conference view information in the second conference in response to the suspend input, the conference view information including at least one of the following: the position of the virtual screen in the second conference, the first user's view state in the second conference, and the first user's current posture information; the processor 110 is further configured to, upon the first user re-entering the second conference, switch the working audio channel from the first audio channel to the second audio channel, and continue rendering the conference view of the second conference based on the conference view information.

[0483] This application provides an electronic device that, when a target user is simultaneously participating in a first meeting and a second meeting, transmits the audio signals of the two meetings separately through two independent audio channels. This preserves the target user's connection status in both meetings, ensuring that the user does not completely lose awareness of either meeting. At the same time, the audio signal of a particular meeting can be adjusted individually, thereby achieving a smooth shift of attention between meetings and avoiding the disruption to the flow of meetings caused by direct isolation. This enhances the flexibility of the sound isolation mechanism in multi-person meetings.

[0484] The electronic device provided in this application embodiment can implement all the processes implemented in the above method embodiments and achieve the same technical effects. To avoid repetition, it will not be described again here. The beneficial effects of the various implementation methods in this embodiment can be found in the beneficial effects of the corresponding implementation methods in the above method embodiments. To avoid repetition, it will not be described again here.

[0485] It should be understood that, in this embodiment, the input unit 104 may include a graphics processing unit (GPU) 1041 and a microphone 1042. The GPU 1041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 107 includes at least one of a touch panel 1071 and other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.

[0486] The memory 109 can be used to store software programs and various data. The memory 109 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 109 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 109 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.

[0487] Processor 110 may include one or more processing units; optionally, processor 110 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 110.

[0488] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described implementation method embodiment for forming sub-conferences in a conference, and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0489] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0490] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface and the processor are coupled. The processor is used to run programs or instructions to implement the various processes of the above-described implementation method embodiment for forming sub-conferences in a conference, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0491] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0492] This application provides a computer program product stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-described implementation method embodiment for forming sub-conferences in a conference, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0493] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0494] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0495] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A method for setting up sub-conferences within a conference, applied to a virtual display device, characterized in that, include: During the first user's participation in the first meeting, in response to the first user's first input, invite or add a second user to join the second meeting; The first user participates in both the first meeting and the second meeting simultaneously. The first audio signal of the first meeting is transmitted through the first audio channel, and the second audio signal of the second meeting is transmitted through the second audio channel.

2. The method according to claim 1, characterized in that, The first audio signal includes a first output signal output by the first conference to the first user; The second audio signal includes a second output signal output by the second conference to the first user; The volume levels of the first output signal and the second output signal are different; and / or, the output orientations of the first output signal and the second output signal are different.

3. The method according to claim 1, characterized in that, The method further includes: The microphone audio signal is transmitted based on the current working audio channel, the microphone audio signal is obtained through a microphone, and the working audio channel includes the first audio channel and the second audio channel; When the current working audio channel is the first audio channel, the microphone audio signal and the first audio signal are transmitted through the first audio channel, and the second audio signal is transmitted through the second audio channel: the volume of the first audio signal is greater than the volume of the second audio signal; and / or, the first audio signal is a near-field audio signal, and the second audio signal is a far-field audio signal; When the current working audio channel is the second audio channel, the first audio signal is transmitted through the first audio channel, and the microphone audio signal and the second audio signal are transmitted through the second audio channel: the volume of the second audio signal is greater than the volume of the first audio signal; and / or, the second audio signal is a near-field audio signal, and the first audio signal is a far-field audio signal.

4. The method according to claim 1, characterized in that, The first video signal of the first conference is transmitted through the first video channel, and the second video signal of the second conference is transmitted through the second video channel.

5. The method according to claim 1, characterized in that, The method further includes: The real-time posture information of the first user is transmitted based on the current working posture channel. The real-time posture information is obtained through the camera module. The working posture channel includes a first posture channel connected to the first conference and a second posture channel connected to the second conference. When the current working posture channel is the first posture channel, the real-time posture information of the first user is transmitted through the first posture channel, and the participants of the first meeting obtain the real-time posture information of the first user. When the current working posture channel is the second posture channel, the real-time posture information of the first user is transmitted through the second posture channel, and the participants of the second meeting obtain the real-time posture information of the first user.

6. The method according to claim 5, characterized in that, The method further includes: The alternative posture information of the first user was generated based on AI. When the current working posture channel is the first posture channel, the alternative posture information of the first user is transmitted through the second posture channel, and the participants of the second meeting obtain the alternative posture information of the first user. When the current working posture channel is the second posture channel, the alternative posture information of the first user is transmitted through the first posture channel, and the participants of the first meeting obtain the alternative posture information of the first user.

7. The method according to any one of claims 1 to 6, characterized in that, After inviting or adding a second user to the second meeting, the method further includes: Based on the target work meeting, determine the work audio channel, work video channel, or work posture channel; The target work meeting will be switched based on at least one of the following: If the first user focuses on the first participant and the duration of the focus exceeds a preset threshold, the target work meeting will be switched to the meeting to which the first participant belongs. The first user gazes in the direction of the first audio source and switches the target work meeting to the meeting corresponding to the direction of the first audio source. The first user is the speaker at the meeting, and the target work meeting is switched based on the content of the first user's speech; The meeting switching input from the first user has been received.

8. The method according to claim 1, characterized in that, The method further includes: If the first user participates in both the first meeting and the second meeting simultaneously, and if the working audio channel is the first audio channel, the audio data stream, video data stream, and posture data stream of the second meeting are recorded to generate a first recording file; or, If the first user participates in both the first meeting and the second meeting simultaneously, and the working audio channel is the second audio channel, the audio data stream, video data stream, and posture data stream of the first meeting are recorded to generate a second recording file.

9. The method according to claim 1, characterized in that, The method further includes: If the first user participates in the second meeting and receives a second invitation message, a first prompt message is displayed. The first prompt message is used to prompt the first user to leave the second meeting. The second invitation message includes the meeting identifier of the third meeting.

10. The method according to claim 1, characterized in that, The first user is the meeting initiator of the second meeting, and the method further includes: If the first user is simultaneously participating in both the first meeting and the second meeting, receive the first user's second exit input for the second meeting; In response to the second exit input, a first prompt window is displayed, which prompts the first user whether to disband the second meeting; If the first user does not disband the second meeting, the management authority will be transferred to the first member who joined the second meeting earliest, and the first member will be marked as the meeting controller. The first user joins the third meeting.

11. The method according to claim 1, characterized in that, The method further includes: Receive the first user's input to suspend the second conference; In response to the suspend input, the working audio channel is switched from the second audio channel to the first audio channel, and an empty motion frame is sent to the second attitude channel; the real-time attitude information of the first user is transmitted through the second attitude channel.

12. An apparatus for setting up sub-conferences within a conference, applied to a virtual display device, characterized in that, include: Invitation module; The invitation module is used to invite or add a second user to join the second meeting in response to the first user's first input during the first user's participation in the first meeting. The first user participates in both the first meeting and the second meeting simultaneously. The first audio signal of the first meeting is transmitted through the first audio channel, and the second audio signal of the second meeting is transmitted through the second audio channel.

13. An electronic device, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the method for forming sub-conferences in a conference as described in any one of claims 1 to 11.

Images