Method and device for realizing range communication in virtual meeting

Abstract

The application relates to the VR technical field and provides a virtual meeting range communication implementation method and equipment, which are used for realizing free communication within a certain range in a virtual meeting scene. The method associates a target virtual meeting with a target meeting scene containing a main meeting area and a plurality of free discussion areas, generates a global RTC room and a global IM room for the main meeting area, and generates a local RTC room and a local IM room for each free discussion area. In this way, a current participant joins the global RTC room and the global IM room to participate in global communication of the target virtual meeting, and when the virtual image moves to a target discussion area, the participant joins the local RTC room and the local IM room to participate in range communication of the target discussion area. Like a real meeting scene, a plurality of other participants in the target virtual meeting can freely talk within a certain range, and user experience is effectively improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of virtual reality (VR), and provides a method and device for realizing range communication in a virtual meeting. BACKGROUND

[0002] In a real communication scene, when a user walks close to a group of people who are talking or discussing, the user can hear the content of the conversation or discussion of the group of people. At this time, the user can choose to pass by, can choose to stop and listen, and can also choose to participate in the conversation or discussion at any time.

[0003] In a virtual meeting communication, a participant can only make a full-field speech or establish one-on-one private communication with a certain participant. Such a fixed communication mode is quite different from a real communication scene for the participants. For example, a current participant cannot participate in a free discussion being conducted between other participants at any time, and other participants cannot participate in a free discussion between the current participant and surrounding participants at any time. The communication mode has certain limitations, resulting in poor user experience. SUMMARY

[0004] Embodiments of the present application provide a method and device for realizing range communication in a virtual meeting, for realizing free communication within a certain range in a virtual meeting scene.

[0005] In one aspect, the present application provides a method for realizing range communication in a virtual meeting, applied to a server device, comprising:

[0006] creating a plurality of meeting scenes, each meeting scene including a main conference area and a plurality of free discussion areas;

[0007] creating a target virtual meeting and associating the target virtual meeting with a target meeting scene, generating a global instant messaging (IM) room and a global real-time communication (RTC) room for the main conference area of the target virtual meeting, and generating a local IM room and a local RTC room for each free discussion area of the target virtual meeting; wherein each IM room is used to transmit control messages, and each RTC room is used to transmit conversation content;

[0008] receiving a virtual meeting joining request triggered by a meeting number input operation of a current participant, and sending meeting detail information of the target virtual meeting to a meeting terminal device of the current participant according to the meeting number;

[0009] receiving a first room joining request sent by the current participant based on the meeting detail information, and adding a virtual image of the current participant to the global IM room and the global RTC room according to the first room joining request, so that the current participant participates in global communication;

[0010] receiving a second room joining request sent by the current participant based on the conference detail information, and adding the virtual image into the local IM room and the local RTC room of the target discussion area according to the second room joining request, so that the current participant participates in the range communication of the target discussion area.

[0011] In another aspect, the embodiment of the present application provides a range communication implementation method in a virtual conference, applied to a conference terminal device, comprising:

[0012] sending a virtual conference joining request according to a conference number input by a current participant, and receiving conference detail information of a target virtual conference corresponding to the conference number; wherein the target virtual conference is associated with a target conference scene in a plurality of conference scenes, each conference scene comprises a main conference area and a plurality of free discussion areas, the main conference area of the target virtual conference corresponds to a global real-time communication (RTC) room and a global instant messaging (IM) room, and each free discussion area of the target virtual conference corresponds to a local RTC room and a local IM room, each RTC room is used for transmitting conversation content, and each IM room is used for transmitting control messages;

[0013] sending a first room joining request for adding a virtual image of the current participant into the global RTC room and the global IM room according to the conference detail information, so that the current participant participates in global communication;

[0014] when the virtual image moves to a target discussion area, sending a second room joining request for adding the current participant into a local RTC room and a local IM room of the target discussion area according to the conference detail information, so that the current participant participates in range communication of the target discussion area.

[0015] Optionally, the conference detail information comprises a first room number of the global IM room of the main conference area and a second room number of the global RTC room, and the sending of the first room joining request for adding the virtual image of the current participant into the global RTC room and the global IM room according to the conference detail information, so that the current participant participates in global communication, comprises:

[0016] sending a first joining request for adding the virtual image of the current participant into the global IM room corresponding to the first room number, and sending a second joining request for adding the virtual image of the current participant into the global RTC room corresponding to the second room number;

[0017] After the current participant is successfully added to the global room, a subscription request is sent to subscribe to the RTC stream of the target role in the target virtual conference according to the subscription operation of the current participant to receive the global voice stream of the target role and play, and the control state of the target role to each participant in the global IM room is received.

[0018] Optionally, the conference detail information includes a third room number of a local IM room of the target discussion area and a fourth room number of a local RTC room, and the second room joining request is sent to add the current participant to the local RTC room and the local IM room of the target discussion area according to the conference detail information to enable the current participant to participate in the range communication of the target discussion area, including:

[0019] The third joining request is sent according to the fourth room number, and after the joining is successful, a subscription request of the current participant to subscribe to the RTC stream of each participant in the target discussion area is sent;

[0020] The fourth joining request is sent according to the third room number, and the fourth joining request carries user information of the current participant, the user information is broadcasted in the local IM room corresponding to the third room number, so that other participants in the target discussion area receive a new user joining message and subscribe to the RTC stream of the current participant;

[0021] The current voice stream of the current participant is sent, and the current voice stream is sent to the conference terminals of other participants in the target discussion area who subscribe to the RTC stream of the current participant for playing;

[0022] Other voice streams sent by other participants in the target discussion area are received and played to the current participant.

[0023] Optionally, after the current participant participates in the range communication of the target discussion area, the method further includes:

[0024] The all-field speaking request is sent according to the speaking operation of the current participant;

[0025] After the all-field speaking request of the current participant is confirmed by the target role in the target virtual conference, the current voice stream of the current participant is sent, so that the current voice stream is played by the conference terminals of other participants in the global RTC room who subscribe to the RTC stream of the target role.

[0026] Optionally, after the virtual image leaves the target discussion area, the method further includes:

[0027] in response to the cancel subscription operation of the current participant, sending a first exit instruction for canceling subscription of RTC streams of other participants in the target discussion area to stop receiving sounds of other participants in the local RTC room;

[0028] sending a second exit instruction for exiting the local IM room sent by the current participant, the second exit instruction being broadcast in the local IM room to notify other participants to cancel subscription of the current participant exiting the range communication.

[0029] In another aspect, an embodiment of the present application provides a server device, comprising a processor, a memory, an RTC unit and an IM unit;

[0030] The IM unit, the RTC unit, the memory and the processor are connected through a bus;

[0031] The memory stores a computer program, and the processor executes the following operations according to the computer program:

[0032] creating a plurality of conference scenes, each conference scene containing a main conference area and a plurality of free discussion areas;

[0033] creating a target virtual conference and associating it with a target conference scene;

[0034] invoking the IM unit to generate a global IM room for the main conference area of the target virtual conference, and generating a local IM room for each free discussion area, and invoking the RTC unit to generate a global RTC room for the main conference area of the target virtual conference, and generating a local RTC room for each free discussion area; wherein each IM room is used to transmit control messages, and each RTC room is used to transmit conversation content;

[0035] receiving a virtual conference joining request triggered by a conference number input operation of a current participant, and sending conference detail information of the target virtual conference to a conference terminal device of the current participant according to the conference number;

[0036] receiving a first room joining request sent by the current participant based on the conference detail information, and according to the first room joining request, invoking the IM unit to add a virtual image of the current participant to the global IM room, and invoking the RTC unit to add the virtual image of the current participant to the global RTC room to enable the current participant to participate in global communication;

[0037] When the virtual image moves to the target discussion area, the second room joining request sent by the current participant based on the conference detail information is received, and according to the second room joining request, the IM unit is called to add the virtual image to the local IM room of the target discussion area, and the RTC unit is called to add the virtual image to the local RTC room of the target discussion area to enable the current participant to participate in the range communication of the target discussion area.

[0038] Optionally, the conference detail information includes a first room number of a global IM room and a second room number of a global RTC room of the main conference area, the processor receives a first room joining request sent by the current participant based on the conference detail information, and according to the first room joining request, the IM unit is called to add the virtual image of the current participant to the global IM room, and the RTC unit is called to add the virtual image of the current participant to the global RTC room to enable the current participant to participate in the global communication, and the specific operation is that:

[0039] The first joining request sent by the current participant based on the first room number is received, the IM unit is called to add the virtual image of the current participant to the global IM room, and the second joining request sent by the current participant based on the second room number is received, the RTC unit is called to add the virtual image of the current participant to the global RTC room;

[0040] After the communication room is successfully joined, the RTC unit is called to receive a subscription request for subscribing to the RTC stream of the target role in the target virtual conference sent by the current participant, and the global voice stream of the target role is sent to the conference terminal of each participant in the global RTC room for playing, and the IM unit is called to control the state of each participant in the global IM room.

[0041] Optionally, the conference detail information includes a third room number of a local IM room and a fourth room number of a local RTC room of the target discussion area, the processor receives a second room joining request sent by the current participant based on the conference detail information, and according to the second room joining request, the IM unit is called to add the virtual image to the local IM room of the target discussion area, and the RTC unit is called to add the virtual image to the local RTC room of the target discussion area to enable the current participant to participate in the range communication of the target discussion area, and the specific operation is that:

[0042] receive a third join request sent by the current participant based on the fourth room number, and after joining successfully, call the RTC unit to receive a subscription request sent by the current participant to subscribe to RTC streams of each participant in the local RTC room;

[0043] call the IM unit to receive a fourth join request sent by the current participant based on the third room number, and broadcast user information of the current participant in the local IM room corresponding to the third room number, so that other participants in the target discussion area receive a new user join message and subscribe to the RTC stream of the current participant;

[0044] When receiving the current voice stream sent by the current participant, call the RTC unit to send the current voice stream to the conference terminal of other participants in the target discussion area who subscribe to the RTC stream of the current participant for playing;

[0045] When receiving other voice streams sent by other participants in the target discussion area, call the RTC unit to send the other voice streams to the conference terminal of the current participant for playing.

[0046] Optionally, after the current participant participates in the range communication of the target discussion area, the processor further performs:

[0047] receive a full-field speech request sent by the current participant, and after receiving a confirmation message of the full-field speech request sent by the target role in the target virtual conference, open the speech permission of the current participant;

[0048] receive a current voice stream sent by the current participant, call the RTC unit to send the current voice stream to the conference terminal of other participants in the global RTC room who subscribe to the RTC stream of the target role for playing.

[0049] Optionally, after the virtual image leaves the target discussion area, the processor further performs:

[0050] call the RTC unit to receive a first exit instruction sent by the current participant to unsubscribe from the RTC streams of other participants in the local RTC room, and according to the first exit instruction, stop sending the sounds of other participants in the local RTC room to the conference terminal of the current participant;

[0051] call the IM unit to receive a second exit instruction sent by the current participant to exit the local IM room, and broadcast the second exit instruction in the local IM room to notify other participants to unsubscribe from the RTC stream of the current participant who exits the range communication.

[0052] In another aspect, an embodiment of the present application provides a conference terminal device, comprising a processor, a memory, a display and a communication interface, the communication interface, the display, the memory and the processor being connected through a bus;

[0053] The display is configured to display a virtual conference scene and a virtual image of a participant;

[0054] The memory stores a computer program, and the processor executes the following operations according to the computer program:

[0055] According to a conference number input by a current participant, the communication interface is called to send a virtual conference joining request, and conference detail information of a target virtual conference corresponding to the conference number is received; the target virtual conference is associated with a target conference scene in a plurality of conference scenes, each conference scene comprises a main conference area and a plurality of free discussion areas, the main conference area of the target virtual conference corresponds to a global real-time communication (RTC) room and a global instant messaging (IM) room, and each free discussion area of the target virtual conference corresponds to a local RTC room and a local IM room, each RTC room is configured to transmit conversation content, and each IM room is configured to transmit control messages;

[0056] According to the conference detail information, the communication interface is called to send a first room joining request for joining the virtual image of the current participant into the global RTC room and the global IM room, so that the current participant participates in global communication;

[0057] When the virtual image moves to a target discussion area, according to the conference detail information, the communication interface is called to send a second room joining request for joining the current participant into the local RTC room and the local IM room of the target discussion area, so that the current participant participates in range communication in the target discussion area.

[0058] Optionally, the conference detail information comprises a first room number of the global IM room of the main conference area and a second room number of the global RTC room, and the processor calls the communication interface to send a first room joining request for joining the virtual image of the current participant into the global RTC room and the global IM room according to the conference detail information, so that the current participant participates in global communication, and the specific operation is as follows:

[0059] The communication interface is called to send a first joining request for joining the virtual image of the current participant into the global IM room corresponding to the first room number, and to send a second joining request for joining the virtual image of the current participant into the global RTC room corresponding to the second room number;

[0060] After the current participant is successfully added to the global room, the communication interface is called to send a subscription request for subscribing to the RTC stream of the target role in the target virtual conference according to the subscription operation of the current participant, so as to receive the global voice stream of the target role and play, and the control state of the target role to each participant in the global IM room is received.

[0061] Optionally, the conference detail information includes a third room number of a local IM room of the target discussion area and a fourth room number of a local RTC room, and the processor calls the communication interface to send a second room joining request for adding the current participant to the local RTC room and the local IM room of the target discussion area according to the conference detail information, so that the current participant participates in the range communication of the target discussion area, and the specific operation is as follows:

[0062] The communication interface is called to send a third joining request according to the fourth room number, and after successful joining, a subscription request for subscribing to the RTC stream of each participant in the target discussion area is sent;

[0063] The communication interface is called to send a fourth joining request according to the third room number, and the fourth joining request carries user information of the current participant, which is broadcast in the local IM room corresponding to the third room number, so that other participants in the target discussion area receive the new user joining message and subscribe to the RTC stream of the current participant;

[0064] The communication interface is called to send the current voice stream of the current participant, which is sent to the conference terminal of other participants in the target discussion area who subscribe to the RTC stream of the current participant for playing;

[0065] The communication interface is called to receive and play other voice streams sent by other participants in the target discussion area to the current participant.

[0066] Optionally, after the current participant participates in the range communication of the target discussion area, the processor further performs:

[0067] The communication interface is called to send a full-field speaking request according to the speaking operation of the current participant;

[0068] After obtaining the confirmation of the full-field speaking request of the current participant by the target role in the target virtual conference, the communication interface is called to send the current voice stream of the current participant, so that the current voice stream is played by the conference terminal of other participants in the global RTC room who subscribe to the RTC stream of the target role.

[0069] Optionally, after the virtual image leaves the target discussion area, the processor further executes:

[0070] in response to the cancel subscription operation of the current participant, calling the communication interface to send a first exit instruction for canceling subscription of the RTC stream of the other participants in the target discussion area to stop receiving the sound of the other participants in the local RTC room;

[0071] calling the communication interface to send a second exit instruction for exiting the local IM room sent by the current participant, the second exit instruction being broadcast in the local IM room to notify the other participants to cancel subscription of the RTC stream of the current participant who exits the range communication.

[0072] In another aspect, the embodiment of the present application provides a computer readable storage medium, which stores computer executable instructions, and the computer executable instructions are used to make a computer device execute the steps of the range communication implementation method in a virtual conference provided by the embodiment of the present application.

[0073] The virtual conference range communication implementation method provided by the embodiment of the present application has the following beneficial effects:

[0074] The target virtual conference is associated with a target conference scene in a plurality of conference scenes. Since each conference scene includes a main conference area and a plurality of free discussion areas, a global RTC room and a global IM room for global communication can be generated for the main conference area of the target virtual conference, and a local RTC room and a local IM room for range communication can be generated for each free discussion area of the target virtual conference. In this way, for the current participant of the target virtual conference, the current participant can participate in the global communication of the target virtual conference by joining the global RTC room and the global IM room, and when the virtual image of the current participant moves to the target discussion area, the current participant can participate in the range communication in the free discussion area by joining the local RTC room and the local IM room, so that the global communication in the virtual conference scene and the free conversation within a certain range with other participants can be realized at the same time, the diversity of the virtual conference communication mode is improved, the communication mode of the real conference scene is more consistent, and the user experience is improved. On the other hand, each area corresponds to an RTC room and an IM room, wherein each RTC room is used to transmit conversation content, and each IM room is used to transmit control messages, so that the fluency of communication in the virtual conference is ensured.

[0075] Other features and advantages of the present application will be set forth in the following description, and in part will become apparent to those skilled in the art from the description, or can be learned by practice of the present application. The objects and other advantages of the present application can be realized and achieved by the structure particularly pointed out in the written description, claims, and drawings. Attached Figure Description

[0076] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0077] Figure 1 A flowchart illustrating a method for implementing communication within a virtual meeting space, as provided in this application embodiment;

[0078] Figure 2A This is a schematic diagram illustrating a method for dividing a meeting scenario according to an embodiment of this application;

[0079] Figure 2B This is a schematic diagram illustrating another method of area division for a meeting scenario provided in an embodiment of this application;

[0080] Figure 3 A timing diagram for creating a target virtual meeting provided in an embodiment of this application;

[0081] Figure 4 A schematic diagram of the interface for creating a virtual meeting;

[0082] Figure 5A A schematic diagram of the virtual meeting interface displayed on the conferencing devices;

[0083] Figure 5B A diagram illustrating the process of adding current participants to a target virtual meeting;

[0084] Figure 5C A schematic diagram of the prompt interface when the target virtual meeting is full;

[0085] Figure 6A A schematic diagram showing the current participants joining the target virtual meeting;

[0086] Figure 6B This is a diagram illustrating communication within a free discussion area.

[0087] Figure 7 A sequence diagram showing how current participants join the target virtual meeting and participate in and leave the scope of the discussion;

[0088] Figure 8 A structural diagram of the server-side device provided in the embodiments of this application;

[0089] Figure 9 A structural diagram of the conference terminal device provided in the embodiments of this application. Detailed Implementation

[0090] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments described in the present application document, all other embodiments obtained by those of ordinary skill in the art without creative labor fall within the scope of protection of the present application technical solutions.

[0091] With the development of virtual reality technology, the immersive experience of face-to-face communication of participants can be met by creating a virtual meeting. In the virtual meeting communication, the participants can only make a full-field speech or establish one-on-one private communication with a participant. This fixed communication mode has great differences from the real communication scene for the participants, has certain limitations, and leads to poor user experience.

[0092] In order to have a better communication experience for the participants, that is, the same as the real meeting scene, the participants can have a convenient communication of free discussion with multiple other participants at any time, the present application provides a range communication implementation method in a virtual meeting. The method divides a meeting scene into a main meeting area and a plurality of free discussion areas, and after a target virtual meeting is associated with a target meeting scene, generates a global RTC room and a global IM room for the main meeting area of the target virtual meeting, and generates a local RTC room and a local IM room for each free discussion area of the target virtual meeting. In this way, when the participant moves to a certain target discussion area, the participant participates in the small-range communication with multiple other participants in the free discussion area by joining the local RTC room and the local IM room, and participates in the global communication in the main meeting area by joining the global RTC room and the global IM room, which enriches the communication mode in the virtual meeting scene, realizes the same communication mode as the real meeting scene, and the participants can have free conversation within a certain range, thereby improving the user experience.

[0093] Referring to Figure 1 A flowchart of a virtual meeting range communication implementation method provided by the embodiments of the present application is shown in FIG. 1. The flowchart is executed by a server device and mainly includes the following steps:

[0094] S101: Create a plurality of meeting scenes, each of which includes a main meeting area and a plurality of free discussion areas.

[0095] In actual application, according to the characteristics of the meeting, a plurality of meeting scenes meeting the conversation requirements are generated, and each meeting scene is divided into a main meeting area and a plurality of free discussion areas.

[0096] Taking the map shape of the meeting as an example,Figure 2A and Figure 2B The conference scene schematic diagram of two different map shapes is shown.

[0097] It should be noted that the embodiments of the present application do not limit the shape of the main conference area and the free discussion area, and the number of free discussion areas.

[0098] In an example, random communication among participants is not allowed in the main conference area, and in most cases, a target role such as a conference host or a guest makes a full-field speech. When a participant wants to make a full-field speech in the main conference area, the participant needs to apply for a speech permission. The free discussion area is a relatively independent area, and the participants in the area are allowed to communicate freely. Meanwhile, the participants in the area can also hear the full-field speech of the target role in the main conference area.

[0099] S102: Create a target virtual conference and associate it with a target conference scene, generate a global IM room and a global RTC room for the main conference area of the target virtual conference, and generate a local IM room and a local RTC room for each free discussion area of the target virtual conference.

[0100] In an example, the conference parameters of the target virtual conference can be input by the manager of the virtual conference organizer in the management background, and the conference parameters are sent to the server device. The server device creates the target virtual conference according to the conference parameters, and associates the target virtual conference with a target conference scene. In this way, the target virtual conference is divided into a main conference area for global communication and a plurality of free discussion areas for range communication. Then, a local real-time communication (RTC) room and a local instant messaging (IM) room are generated for each free discussion area according to the number of free discussion areas configured in the target conference scene. Meanwhile, a global RTC room and a global IM room are generated for the main conference area, and the created target virtual conference is saved. Each RTC room is used to transmit conversation content (such as voice stream and video stream of participants), and each IM room is used to transmit control messages (such as messages of muting, unmuting, sitting in, entering, and exiting).

[0101] The timing diagram of creating the target virtual conference is shown in Figure 3 and mainly includes the following steps:

[0102] S1021: The management background sends the conference parameters for creating the target virtual conference to the business system.

[0103] Optionally, the conference parameters include, but are not limited to, fields such as conference name, start time, end time, conference scene ID, number of free discussion areas, and boundary coordinates of each free discussion area.

[0104] As shown in Figure 4 Fig. 1 is a schematic diagram of an interface for creating a virtual meeting, which is shown to the administrator by the management background, and the interface comprises at least one or more combinations of a meeting name input box, a meeting time input box, a meeting cover input box, a maximum number of participants input box, a number of free discussion areas input box, a meeting scene input box, a public display option, a participation restriction option, a host input box, a create button, and a cancel button.

[0105] The meeting name input box is used to determine the meeting name of the virtual meeting; the meeting time input box is used to determine the start time and end time of the virtual meeting; the meeting cover input box is used to determine the cover of the virtual meeting, which is not artificially set; the maximum number of participants input box is used to determine the maximum number of participants in the virtual meeting; the number of free discussion areas input box is used to determine the number of free discussion areas for small-scale communication in the virtual meeting; the meeting scene input box is used to determine the room background pattern corresponding to the virtual meeting, i.e., to determine the meeting scene ID associated with the virtual meeting; the public display option is used to determine whether the virtual meeting is publicly displayed, and the participation restriction option is used to determine whether a password verification is required to join the virtual meeting; the public display option is associated with the participation restriction option, and when the public display option is in a public state, the no restriction and password verification items provided by the participation restriction option are in a triggerable state; the host input box is used to determine the host of the virtual meeting, which can be changed; the create button is used to save the input meeting parameters; and the cancel button is used to exit the virtual meeting creation interface.

[0106] After the administrator inputs the meeting parameters of the target virtual meeting in the meeting creation interface, the administrator triggers a virtual meeting creation request by clicking the "save" button, and sends the meeting parameters in the virtual meeting creation request to the server device, so that the server device creates a room for global communication and a room for range communication.

[0107] S1022: The business system verifies the legality of the received meeting parameters.

[0108] S1023: After the parameter verification is passed, the business system generates a meeting number for the target virtual meeting.

[0109] The meeting number serves as a unique identifier for the virtual meeting, and subsequent participants can find the target virtual meeting by inputting the meeting number and join.

[0110] Next, communication rooms are created for the main conference area and the free discussion area of the target virtual meeting, wherein the creation process of the main conference area communication room is described in S1024-S1027, and the creation process of the free discussion area communication room is described in S1028-S10211.

[0111] S1024: The business system sends a request to the IM service for generating a global IM room for the target virtual conference.

[0112] S1025: The IM service creates the global IM room according to the request, and sends a first room number of the global IM room to the business system after the creation is successful.

[0113] S1026: The business system sends a request to the RTC service for generating a global RTC room for the target virtual conference.

[0114] S1027: The IM service creates the global RTC room according to the request, and sends a second room number of the global RTC room to the business system after the creation is successful.

[0115] S1028: The business system sends a request to the IM service for generating a local IM room for each free discussion area of the target virtual conference.

[0116] S1029: The IM service creates the local IM room according to the request, and sends a third room number of the local IM room to the business system after the creation is successful.

[0117] S10210: The business system sends a request to the RTC service for generating a local RTC room for each free discussion area of the target virtual conference.

[0118] S10211: The IM service creates the local RTC room according to the request, and sends a fourth room number of the local RTC room to the business system after the creation is successful.

[0119] S10212: The business system saves conference details information such as conference parameters, conference numbers, and room numbers to a database.

[0120] After the exchange rooms of the main conference area and the free discussion areas of the target virtual conference are created, the business system saves conference details information such as conference parameters, conference numbers, and room numbers to a database.

[0121] S10213: After the saving is successful, the business system sends the conference details information to a management platform.

[0122] Based on the global RTC room and the global IM room generated for the main conference area of the target virtual conference, and the local RTC room and the local IM room generated for each free discussion area of the target virtual conference, the participants can participate in the global exchange of the target virtual conference while communicating with other participants at any time, enriching the exchange mode of the virtual conference scene, and realizing the consistent exchange experience as in the real conference scene.

[0123] S103: Receive the virtual meeting join request triggered by the current participant's meeting ID input operation, and send the meeting details of the target virtual meeting to the current participant's meeting terminal device according to the meeting ID.

[0124] Once the target virtual meeting is created, it will be displayed on the participants' conference devices when the current time reaches the target virtual meeting's start time. Participants can join the target virtual meeting through their conference devices.

[0125] like Figure 5A The diagram shows a virtual meeting interface displayed on the conferencing device. It includes at least one virtual meeting option, which is sorted in order of the start time of each virtual meeting from early to late. Each virtual meeting option includes at least one item such as meeting cover, meeting name, meeting status, number of participants, limit on the number of participants, access method, and meeting number. Participants can select the target virtual meeting they want to join from the virtual meeting interface.

[0126] like Figure 5B As shown, taking the current participant joining the first target virtual meeting in the virtual meeting interface as an example, by entering the meeting number "65472813" in the virtual meeting interface of the meeting terminal device, a virtual meeting join request is sent to the server device. This request carries the meeting number of the target virtual meeting and the user identifier of the current participant. After receiving the virtual meeting join request, the server device returns a prompt message to the meeting terminal device so that the current participant can confirm whether to join "2023 XX New Product Launch Conference" to prevent entering the wrong meeting due to an incorrect meeting number. After the current participant confirms the prompt message, the server device verifies the meeting number and user identifier in the virtual meeting join request. If the verification is successful, the current participant is added to the target virtual meeting, and the server retrieves the meeting details information of the target virtual meeting from the database based on the meeting number and returns the retrieved meeting details information to the meeting terminal device for display.

[0127] In one example, meeting details include, but are not limited to, meeting name, meeting number, start time, end time, meeting host, meeting scenario ID, the first room number of the global IM room, the second room number of the global RTC room, and a list of free discussion areas (such as: the number of the free discussion area, the third room number of the local IM room, the fourth room number of the local RTC room, the boundary coordinates of the free discussion area, etc.).

[0128] In some embodiments, when the target virtual meeting that the current participant has joined is full, i.e., the maximum number of participants has been reached, the server device may return the following: Figure 5CThe prompt information is shown, and the current participant contacts the host of the target virtual conference according to the prompt information. The host expands the upper limit of the number of participants of the target conference on the management platform, so that the current participant can join the target virtual conference.

[0129] In the virtual conference scene, the participant presents in the virtual conference scene (communication room) in the form of a virtual image. The virtual image is displayed in the communication room, which means that the participant corresponding to the virtual image has joined the target virtual conference, thereby improving the sense of presence of the participant. In addition, the participant can control the movement of the virtual image in the virtual conference scene, that is, the participant can freely communicate with other participants during the meeting process, just like in the real conference scene.

[0130] S104: receiving a first room joining request sent by the current participant based on the conference detail information, and adding the virtual image of the current participant to the global IM room and the global RTC room according to the first room joining request to enable the current participant to participate in the global communication.

[0131] After the conference terminal device of the current participant receives the conference detail information returned by the server device, it participates in the global communication of the target virtual conference by joining the communication room of the main conference area. The process of joining the global communication includes the following steps:

[0132] S1401: receiving a first joining request sent by the current participant based on the first room number, adding the virtual image of the current participant to the global IM room, and receiving a second joining request sent by the current participant based on the second room number, adding the virtual image of the current participant to the global RTC room.

[0133] The current participant sends a first joining request to the server device through the conference terminal device according to the first room number of the global IM room in the conference detail information. The server device displays the virtual image of the current participant in the global IM room according to the first joining request, that is, adds the current participant to the global IM room. In addition, the current participant sends a second joining request to the server device through the conference terminal device according to the second room number of the global RTC room in the conference detail information. The server device displays the virtual image of the current participant in the global RTC room according to the second joining request, that is, adds the current participant to the global RTC room.

[0134] S1402: after successfully joining the communication room, receiving a subscription request sent by the current participant to subscribe to the RTC stream of the target role in the target virtual conference, and sending the global voice stream of the target role to the conference terminal of each participant in the main conference area for playing, and controlling the state of each participant in the global IM room.

[0135] Once a participant joins the global RTC room, the conference terminal device sends a subscription request to the server device for the RTC stream of the target role (such as the host and guest) based on the participant's subscription operation. In this way, when the target role is giving a speech in the main conference area, the target role's global audio stream will be sent to the conference terminal of each participant in the global RTC room for playback, so that each participant participates in the global communication of the target virtual conference. At the same time, the host in the target role can control the status of each participant in the global IM room (such as mute, mic on, seated, standing, near field, exit, etc.).

[0136] Upon entering the communication room, the current participant's conference terminal device renders the target virtual conference scene, delineates the free discussion areas based on the boundary coordinates of each free discussion area, and displays the target virtual conference interface.

[0137] like Figure 6A The image shown is a schematic diagram of the current participants joining the target virtual meeting. The meeting interface includes the virtual images (P1' to Pn') of all participants (P1 to Pn) currently joining the target virtual meeting, two free discussion areas, and a main meeting area. The main meeting area is the entire area except for the two free discussion areas. The maximum value of n is the number of participants (maximum number of participants).

[0138] S105: After the virtual avatar moves to the target discussion area, receive the second room join request sent by the current participant based on the meeting details information, and add the virtual avatar to the corresponding local IM room and local RTC room according to the second room join request so that the current participant can participate in the scope of communication in the target discussion area.

[0139] Once a participant enters the target virtual meeting, their virtual avatar can move freely within the meeting environment. When their avatar enters the open discussion area, they can participate in group discussions with other participants. The process of joining these discussions involves the following steps:

[0140] S1051: Receive the third join request sent by the current participant based on the fourth room number, and after the join is successful, receive the subscription request sent by the current participant to subscribe to the RTC stream of each participant in the local RTC room.

[0141] When the virtual image of the current participant moves to the target discussion area, the room information of the target discussion area is obtained from the conference details information, including the third room number of the local IM room of the target discussion area and the fourth room number of the local RTC room of the target discussion area. The current participant sends a third joining request to join the local RTC room to the server device according to the fourth room number of the local RTC room, and subscribes to the RTC stream of each participant in the local RTC room of the target discussion area, so as to hear the communication content of other participants in the free discussion area.

[0142] S1052: receiving the fourth joining request sent by the current participant based on the third room number, and broadcasting the user information of the current participant in the local IM room corresponding to the third room number, so that other participants in the target discussion area receive the new user joining message and subscribe to the RTC stream of the current participant.

[0143] After the virtual image of the current participant enters the local RTC room of the target discussion area, it also needs to join the local IM room of the target discussion area to notify other participants of its joining. Specifically, the current participant sends a fourth joining request to join the local IM room to the server device according to the third room number of the local IM room, and the server device sends a broadcast message in the local IM room according to the fourth joining request, the broadcast message carries the user information (such as user identifier, user nickname, etc.) of the current participant, so that the conference terminal device of other participants in the target discussion area receives the notification of the current participant joining the range communication, and subscribes to the RTC stream of the current participant in the local RTC room to hear the voice of the current participant.

[0144] S1053: When receiving the current voice stream sent by the current participant, the current voice stream is sent to the conference terminal of other participants in the target discussion area who subscribe to the RTC stream of the current participant for playing.

[0145] After the RTC stream subscription of the local RTC room is completed, when the current participant speaks, the server device will send its current voice stream to the conference terminal of other participants in the target discussion area who subscribe to the RTC stream of the current participant for playing, so that other participants can hear the voice of the current participant.

[0146] S1054: When receiving the other voice stream sent by other participants in the target discussion area, the other voice stream is sent to the conference terminal of the current participant for playing.

[0147] Similarly, when other participants in the target discussion area speak, the server device sends the voice streams of the other participants to the conference terminal of the current participant for playing, so that the current participant can hear the voices of the other participants in the target discussion area, thereby realizing free exchange as in the real conference scene.

[0148] As shown in FIG. 6, which is a schematic diagram of the range exchange in the free discussion area, the current participant can hear the voices of the other two participants, and the other two participants can also hear the voice of the current participant. Figure 6B

[0149] It should be noted that when the participants in the free discussion area perform range exchange, they can also hear the voices of the target roles such as the host and the guest.

[0150] In some embodiments, when the current participant wants to speak in the whole conference, i.e., the voice of the current participant can be heard by other participants outside the target discussion area, permission application is needed. Specifically, the conference terminal device sends a whole-conference speaking request to the server device based on the speaking operation of the current participant, the server device forwards the whole-conference speaking request to the conference terminal device of the target role (such as the host) in the target virtual conference, and opens the speaking permission of the current participant after receiving the confirmation message of the target role to the whole-conference speaking request of the current participant. After the current participant is opened the whole-conference speaking permission, the current voice stream sent by the conference terminal device of the current participant is forwarded by the server device to the conference terminal of other participants in the global RTC room that subscribes to the RTC stream of the target role for playing.

[0151] In some embodiments, after the current participant enters the range exchange in the target discussion area, the virtual image of the current participant can continue to move in the target virtual conference scene, thereby exiting the range exchange in the target discussion area. Specifically, when the virtual image of the current participant leaves the target discussion area, the conference terminal device sends a first exit instruction to the server device according to the cancel operation of the current participant, to cancel the subscription to the RTC streams of other participants in the local RTC room, and the server device stops sending the voices of other participants in the local RTC room of the target discussion area to the conference terminal device of the current participant after receiving the first exit request; then, the conference terminal device sends a second exit instruction to the server device, the second exit instruction carrying the user identifier of the current participant, and the server device broadcasts the second exit instruction in the local IM room of the target discussion area, and the conference terminal of other participants in the target discussion area receives the broadcast to show the other participants a notification that the current participant exits the range exchange, so that the other participants unsubscribe the RTC stream of the current participant to no longer receive the voice of the current participant.

[0152] Referring to Figure 7 ​The time sequence diagram for joining the target virtual conference by the current participant and participating in and exiting the range exchange mainly includes the following steps:

[0153] S700: The terminal 1 sends a virtual conference joining request to the service system according to the input operation of the current participant.

[0154] The virtual conference joining request carries the conference number of the target virtual conference and the user identifier of the current participant.

[0155] S701: The service system performs parameter verification on the conference number and the user identifier.

[0156] S702-S703: After the parameter verification passes, the service system queries the database according to the conference number to obtain conference detail information.

[0157] S704: The service system sends the conference detail information to the terminal 1 of the current participant.

[0158] The conference detail information includes but is not limited to the conference name, the conference number, the start time, the end time, the conference host, the conference scene ID, the first room number of the global IM room, the second room number of the global RTC room, and the free discussion area list (such as the number of the free discussion area, the third room number of the local IM room, the fourth room number of the local RTC room, the boundary coordinates of the free discussion area, etc.), and the like.

[0159] S705: The IM service receives the first joining request for joining the global IM room sent by the terminal 1, and adds the virtual image of the current participant into the global IM room.

[0160] S706-S707: The RTC service receives the second joining request for joining the global RTC room sent by the terminal 1, adds the virtual image of the current participant into the global RTC room, and returns a joining success notification to the terminal 1.

[0161] S708: The terminal 1 subscribes to the RTC stream of the host in the global RTC room.

[0162] S709: The terminal 1 renders the target virtual conference scene according to the conference detail information, and displays the boundaries of the free discussion areas.

[0163] S710: The terminal 1 moves the virtual image in the target conference scene according to the operation of the current participant.

[0164] S711: When the virtual image of the current participant enters the target discussion area, the third room number of the local IM room and the fourth room number of the local RTC room corresponding to the target discussion area are queried from the conference detail information.

[0165] S712-S713: The IM service receives the third join request of the terminal 1 to join the local RTC room, adds the virtual image of the current participant into the local RTC room, and returns a notification of successful joining.

[0166] S714: The terminal 1 subscribes to the RTC stream of each participant in the local RTC room.

[0167] S715: The IM service receives the fourth join request of the terminal 1 to join the local IM room, and adds the virtual image of the current participant into the local IM room.

[0168] S716: The terminal 1 broadcasts the user information of the current participant in the local IM room to notify other participants in the target discussion area that a new user joins the range communication.

[0169] S717-S718: The terminal 2 receives the message that the current participant joins the range communication, and subscribes to the RTC stream of the current participant in the local RTC room according to the user information of the current participant.

[0170] S719: When the current participant speaks, the terminal 1 sends the current voice stream of the current participant to the RTC service.

[0171] S720: The RTC service pushes the current voice stream of the current participant to the terminal 2 of other participants in the target discussion area, so that other participants in the target discussion area hear the voice of the current participant.

[0172] S721: When other participants in the target discussion area speak, the terminal 2 sends the other voice stream of the other participants to the RTC service.

[0173] S722: The RTC service pushes the other voice stream of the other participants to the current participant, so that the current participant hears the voice of other participants in the target discussion area.

[0174] S723: When the virtual image of the current participant leaves the target discussion area, the terminal 1 cancels the subscription to the RTC stream of other participants in the local RTC room according to the exit operation of the current participant to stop receiving the voice of other participants in the target discussion area.

[0175] S724-S725: The terminal 1 broadcasts the message that the current participant leaves the target discussion area to other participants in the local IM room, and exits the local IM room of the target discussion area.

[0176] S726-S727: After receiving the message that the current participant leaves the target discussion area, the terminal 2 cancels the subscription to the RTC stream of the current participant in the local RTC room according to the cancel operation of the other participants to stop receiving the voice of the current participant in the target discussion area.

[0177] The method for realizing range communication in a virtual conference provided by the embodiments of the present application divides a virtual conference scene into a main conference area and a plurality of free discussion areas, and creates an RTC room for transmitting conversation content and an IM room for transmitting control messages for each area. In this way, after a current participant joins a target virtual conference, the current participant receives speeches of target roles such as a host and a guest by joining a global RTC room and a global IM room of the main conference area, and thus participates in global communication of the target virtual conference. When the virtual image of the current participant moves to a target discussion area, the current participant receives sounds of other participants in the target discussion area by joining a local RTC room and a local IM room of the target discussion area, and thus participates in range communication of the target discussion area. That is, in the virtual conference scene, the same communication mode as in a real conference scene, that is, free conversation within a certain range, is realized, and the communication experience of a user in the virtual conference scene is effectively improved.

[0178] Based on the same technical concept, the embodiments of the present application provide a server device. The server device can be a single physical server, a server cluster composed of a plurality of physical servers, or a distributed system. The server device can also be a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content distribution networks (CDN), and big data and artificial intelligence platforms, but is not limited thereto. Based on the server device, the method for realizing range communication in a virtual conference can be implemented, and the same technical effects can be achieved. Details are not described herein again.

[0179] Referring to Figure 8 The server device includes a processor 801, a memory 802, an RTC unit 803, and an IM unit 804.

[0180] The IM unit 804, the RTC unit 803, the memory 802, and the processor 801 are connected through a bus 805.

[0181] The memory 802 stores a computer program, and the processor 801 performs the following operations according to the computer program:

[0182] Create a plurality of conference scenes, each conference scene including a main conference area and a plurality of free discussion areas;

[0183] Create a target virtual conference and associate the target virtual conference with a target conference scene;

[0184] The IM unit 804 is invoked to generate a global IM room for the main conference area of the target virtual conference, and a local IM room for each free discussion area. The RTC unit 803 is invoked to generate a global RTC room for the main conference area of the target virtual conference, and a local RTC room for each free discussion area. Each IM room is used to transmit control messages, and each RTC room is used to transmit conversation content.

[0185] The virtual conference joining request triggered by the conference number input operation of the current participant is received, and the conference detail information of the target virtual conference is sent to the conference terminal device of the current participant according to the conference number.

[0186] The first room joining request sent by the current participant based on the conference detail information is received, and the IM unit 804 is invoked to add the virtual image of the current participant to the global IM room, and the RTC unit 803 is invoked to add the virtual image of the current participant to the global RTC room, so that the current participant participates in global communication.

[0187] When the virtual image moves to the target discussion area, the second room joining request sent by the current participant based on the conference detail information is received, and the IM unit 804 is invoked to add the virtual image to the local IM room of the target discussion area, and the RTC unit 803 is invoked to add the virtual image to the local RTC room of the target discussion area, so that the current participant participates in the range communication of the target discussion area.

[0188] Optionally, the conference detail information includes a first room number of the global IM room of the main conference area and a second room number of the global RTC room. The processor 801 receives the first room joining request sent by the current participant based on the conference detail information, and invokes the IM unit 804 to add the virtual image of the current participant to the global IM room, and invokes the RTC unit 803 to add the virtual image of the current participant to the global RTC room, so that the current participant participates in global communication. The specific operation is as follows:

[0189] The first joining request sent by the current participant based on the first room number is received, the IM unit 804 is invoked to add the virtual image of the current participant to the global IM room, and the second joining request sent by the current participant based on the second room number is received, the RTC unit 803 is invoked to add the virtual image of the current participant to the global RTC room.

[0190] After the joining into the global RTC room succeeds, the processor 801 invokes the RTC unit 803 to receive a subscription request for subscribing to the RTC stream of the target role in the target virtual conference sent by the current participant, and sends the global voice stream of the target role to the conference terminal of each participant in the global RTC room for playing, and invokes the IM unit 804 to control the state of each participant in the global IM room.

[0191] Optionally, the conference detail information includes a third room number of a local IM room and a fourth room number of a local RTC room of the target discussion area, and the processor 801 receives a second room joining request sent by the current participant based on the conference detail information, and according to the second room joining request, invokes the IM unit 804 to add the virtual image into the local IM room of the target discussion area, and invokes the RTC unit 803 to add the virtual image into the local RTC room of the target discussion area to enable the current participant to participate in the range communication of the target discussion area, and the specific operation is as follows:

[0192] receives a third joining request sent by the current participant based on the fourth room number, and after the joining succeeds, invokes the RTC unit 803 to receive a subscription request for subscribing to the RTC stream of each participant in the local RTC room sent by the current participant;

[0193] invokes the IM unit 804 to receive a fourth joining request sent by the current participant based on the third room number, and broadcasts the user information of the current participant in the local IM room corresponding to the third room number, so that the other participants in the target discussion area receive the new user joining message and subscribe to the RTC stream of the current participant;

[0194] when receiving the current voice stream sent by the current participant, invokes the RTC unit 803 to send the current voice stream to the conference terminal of the other participants in the target discussion area who subscribe to the RTC stream of the current participant for playing;

[0195] when receiving the other voice stream sent by the other participant in the target discussion area, invokes the RTC unit 803 to send the other voice stream to the conference terminal of the current participant for playing.

[0196] Optionally, after the current participant participates in the range communication of the target discussion area, the processor 801 further performs the following operations:

[0197] receive a full-field speech request sent by the current participant, and start the speech right of the current participant after receiving a confirmation message of the full-field speech request sent by a target role in the target virtual conference;

[0198] receive a current voice stream sent by the current participant, and call the RTC unit 803 to send the current voice stream to the conference terminal of other participants in the global RTC room subscribing to the RTC stream of the target role for playing.

[0199] Optionally, after the virtual image leaves the target discussion area, the processor 801 further performs the following operations:

[0200] call the RTC unit 803 to receive a first exit instruction of canceling subscription to the RTC stream of other participants in the local RTC room sent by the current participant, and stop sending the sound of other participants in the local RTC room to the conference terminal of the current participant according to the first exit instruction;

[0201] call the IM unit 804 to receive a second exit instruction of exiting the local IM room sent by the current participant, and broadcast the second exit instruction in the local IM room to notify other participants to cancel subscription to the RTC stream of the current participant exiting the range communication.

[0202] It should be noted that, Figure 8 This is only an example, and only the necessary hardware for the server device to perform the steps of the range communication implementation method in the virtual conference provided by the embodiments of the present application is given.

[0203] Based on the same technical concept, the embodiments of the present application provide a conference terminal device, which is a virtual reality device, can implement the above-mentioned range communication implementation method in a virtual conference, and can achieve the same technical effects, which will not be repeated here.

[0204] Referring to Figure 9 The conference terminal device includes a processor 901, a memory 902, a display 903, and a communication interface 904, wherein the communication interface 904, the display 903, the memory 902, and the processor 901 are connected through a bus 905;

[0205] The display 903 is configured to display a virtual conference scene and a virtual image of a participant;

[0206] The memory 902 stores a computer program, and the processor 901 performs the following operations according to the computer program:

[0207] According to a conference number input by a current participant, the communication interface 904 is invoked to send a virtual conference joining request and receive conference detail information of a target virtual conference corresponding to the conference number; the target virtual conference is associated with a target conference scene in a plurality of conference scenes, each conference scene includes a main conference area and a plurality of free discussion areas, the main conference area of the target virtual conference corresponds to a global real-time communication (RTC) room and a global instant messaging (IM) room, and each free discussion area of the target virtual conference corresponds to a local RTC room and a local IM room, each RTC room is used to transmit conversation content, and each IM room is used to transmit control messages.

[0208] According to the conference detail information, the communication interface 904 is invoked to send a first room joining request for joining a virtual image of the current participant into the global RTC room and the global IM room, so that the current participant participates in global communication.

[0209] When the virtual image moves to a target discussion area, according to the conference detail information, the communication interface 904 is invoked to send a second room joining request for joining the current participant into a local RTC room and a local IM room of the target discussion area, so that the current participant participates in range communication in the target discussion area.

[0210] Optionally, the conference detail information includes a first room number of the global IM room of the main conference area and a second room number of the global RTC room, and the processor 901 invokes the communication interface 904 to send a first room joining request for joining a virtual image of the current participant into the global RTC room and the global IM room according to the conference detail information, so that the current participant participates in global communication, and the specific operation is as follows:

[0211] The communication interface 904 is invoked to send a first joining request for joining the virtual image of the current participant into the global IM room corresponding to the first room number, and send a second joining request for joining the virtual image of the current participant into the global RTC room corresponding to the second room number;

[0212] After successfully joining the communication room, according to a subscription operation of the current participant, the communication interface 904 is invoked to send a subscription request for subscribing to an RTC stream of a target role in the target virtual conference to receive a global voice stream of the target role and play, and receive a control state of each participant in the global IM room by the target role.

[0213] Optionally, the conference detail information comprises a third room number of a local IM room and a fourth room number of a local RTC room of the target discussion area, and the processor 901 invokes the communication interface 904 to send a second room join request for joining the current participant to the local RTC room and the local IM room of the target discussion area according to the conference detail information, so that the current participant participates in the range communication of the target discussion area, and the specific operation is as follows:

[0214] The communication interface 904 is invoked to send a third join request according to the fourth room number, and after the joining succeeds, a subscription request for subscribing to the RTC stream of each participant in the target discussion area is sent.

[0215] The communication interface 904 is invoked to send a fourth join request according to the third room number, and the fourth join request carries user information of the current participant, which is broadcast in the local IM room corresponding to the third room number, so that other participants in the target discussion area receive a new user join message and subscribe to the RTC stream of the current participant.

[0216] The communication interface 904 is invoked to send the current voice stream of the current participant, and the current voice stream is sent to the conference terminal of other participants in the target discussion area who subscribe to the RTC stream of the current participant for playing.

[0217] The communication interface 904 is invoked to receive other voice streams sent by other participants in the target discussion area and play them to the current participant.

[0218] Optionally, after the current participant participates in the range communication of the target discussion area, the processor 901 further performs the following operations:

[0219] According to the speaking operation of the current participant, the communication interface 904 is invoked to send a full-field speaking request.

[0220] After obtaining the confirmation of the target role in the target virtual conference to the full-field speaking request of the current participant, the communication interface 904 is invoked to send the current voice stream of the current participant, so that the current voice stream is played by the conference terminal of other participants in the global RTC room who subscribe to the RTC stream of the target role.

[0221] Optionally, after the virtual image leaves the target discussion area, the processor 901 further performs the following operations:

[0222] In response to the cancel subscription operation of the current participant, the communication interface 904 is invoked to send a first exit instruction to cancel subscription of RTC streams of other participants in the target discussion area to stop receiving the sound of other participants in the local RTC room;

[0223] The communication interface 904 is invoked to send a second exit instruction sent by the current participant to exit the local IM room, and the second exit instruction is broadcasted in the local IM room to notify other participants to cancel subscription of the RTC stream of the current participant who exits the range communication.

[0224] In which, Figure 8 And Figure 9 The memory in the above-mentioned devices can be a volatile memory, such as a random-access memory (RAM); the memory can also be a non-volatile memory, such as a read-only memory, a flash memory, a hard disk drive (HDD) or a solid-state drive (SSD); or the memory can be any other medium capable of carrying or storing desired computer programs in the form of instructions or data structures and capable of being accessed by a computer, but not limited to the above. The memory can be a combination of the above-mentioned memories;

[0225] The processor can include one or more central processing units (CPUs) or be a general-purpose processor, a graphics processing unit (GPU), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof.

[0226] It should be noted that, Figure 9 This is only an example, and the conference terminal device shown only provides the necessary hardware for the conference terminal device to execute the virtual conference range communication implementation method steps provided by the embodiments of the present application. The conference terminal device not shown can also include a speaker, a microphone, a power supply, left and right eye lenses and other hardware of a conventional VR device.

[0227] The server device provided by the embodiments of the present application associates the target virtual conference with a target conference scene in the plurality of conference scenes. Since each conference scene includes a main conference area and a plurality of free discussion areas, a global RTC room and a global IM room for global communication can be generated for the main conference area of the target virtual conference, and a local RTC room and a local IM room for range communication can be generated for each free discussion area of the target virtual conference. Thus, for the current participants of the target virtual conference, the conference terminal device can interact with the server device, join the global RTC room and the global IM room to participate in the global communication of the target virtual conference, and when the virtual image moves to the target discussion area, join the local RTC room and the local IM room to participate in the range communication of the free discussion area, so that the global communication in the virtual conference room and the free communication with other participants in a certain range are realized, the diversity of the virtual conference communication mode is improved, the communication mode of the real conference scene is more consistent, and the user experience is improved. On the other hand, each area corresponds to an RTC room and an IM room, each RTC room is used to transmit the communication content, and each IM room is used to transmit the control message, so that the fluency of the communication in the virtual conference is ensured.

[0228] The embodiments of the present application also provide a computer readable storage medium for storing some instructions, which can complete the virtual conference range communication implementation method in the foregoing embodiments when executed.

[0229] The embodiments of the present application also provide a computer program product for storing a computer program, the computer program being used to execute the virtual conference range communication implementation method in the foregoing embodiments.

[0230] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can adopt a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer usable program codes.

[0231] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 one or more flow or blocks Figure 1 one or more flow or blocks

[0232] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart block or blocks. Figure 1 one or more flow or blocks Figure 1 one or more flow or blocks

[0233] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 one or more flow or blocks Figure 1 Figure 1 one or more flow or blocks

[0234] Obviously, numerous modifications and variations of the present application are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims and their equivalents, the application can be practiced otherwise than as specifically described.

Claims

1. A method for realizing range communication in a virtual meeting, characterized in that, The application is applied to a server device, comprising: creating a plurality of conference scenes, each conference scene including a main conference area and a plurality of free discussion areas; creating a target virtual conference and associating with a target conference scene, generating a global instant messaging (IM) room and a global real-time communication (RTC) room for the main conference area of the target virtual conference, and generating a local IM room and a local RTC room for each free discussion area of the target virtual conference; wherein each IM room is used for transmitting control messages, and each RTC room is used for transmitting conversation content; receiving a virtual conference joining request triggered by a conference number input operation of a current participant, and sending conference detail information of the target virtual conference to a conference terminal device of the current participant according to the conference number; receiving a first room joining request sent by the current participant based on the conference detail information, and adding a virtual image of the current participant to the global IM room and the global RTC room according to the first room joining request, so that the current participant participates in global communication; when the virtual image moves to a target discussion area, receiving a second room joining request sent by the current participant based on the conference detail information, and adding the virtual image to the local IM room and the local RTC room of the target discussion area according to the second room joining request, so that the current participant participates in range communication of the target discussion area.

2. The method of claim 1, wherein, The conference detail information includes a first room number of the global IM room of the main conference area and a second room number of the global RTC room, the receiving of the first room joining request sent by the current participant based on the conference detail information, and the adding of the virtual image of the current participant to the global IM room and the global RTC room according to the first room joining request, so that the current participant participates in global communication, comprising: receiving a first joining request sent by the current participant based on the first room number, adding the virtual image of the current participant to the global IM room, and receiving a second joining request sent by the current participant based on the second room number, adding the virtual image of the current participant to the global RTC room; after the communication room joining is successful, receiving a subscription request sent by the current participant to subscribe to an RTC stream of a target role in the target virtual conference, sending a global voice stream of the target role to a conference terminal of each participant in the global RTC room for playing, and controlling the state of each participant in the global IM room.

3. The method of claim 1, wherein, The conference detail information includes a third room number of the local IM room of the target discussion area and a fourth room number of the local RTC room, the receiving of the second room joining request sent by the current participant based on the conference detail information, and the adding of the virtual image to the corresponding local IM room and local RTC room according to the second room joining request, so that the current participant participates in range communication of the target discussion area, comprising: receiving a third join request sent by the current participant based on the fourth room number, and after joining successfully, receiving a subscription request sent by the current participant for subscribing to RTC streams of each participant in the local RTC room; receiving a fourth join request sent by the current participant based on the third room number, and broadcasting user information of the current participant in the local IM room corresponding to the third room number, so that other participants in the target discussion area receive a new user join message and subscribe to the RTC stream of the current participant; when receiving a current voice stream sent by the current participant, sending the current voice stream to a conference terminal of other participants in the target discussion area who subscribe to the RTC stream of the current participant for playing; when receiving other voice streams sent by other participants in the target discussion area, sending the other voice streams to a conference terminal of the current participant for playing.

4. The method of claim 1, wherein, After the current participant participates in the range communication of the target discussion area, the method further comprises: receiving a full-field speaking request sent by the current participant, and after receiving a confirmation message of the full-field speaking request sent by a target role in the target virtual conference, starting a speaking permission of the current participant; receiving a current voice stream sent by the current participant, and sending the current voice stream to a conference terminal of other participants in the global RTC room who subscribe to the RTC stream of the target role for playing.

5. The method of claim 1, wherein, After the virtual image leaves the target discussion area, the method further comprises: receiving a first exit instruction sent by the current participant for canceling subscription to RTC streams of other participants in the local RTC room, and according to the first exit instruction, stopping sending sounds of other participants in the local RTC room to a conference terminal device of the current participant; receiving a second exit instruction sent by the current participant for exiting the local IM room, and broadcasting the second exit instruction in the local IM room to notify other participants to cancel subscription to the RTC stream of the current participant who exits the range communication.

6. A method for realizing range communication in a virtual meeting, characterized in that, Applied to a conference terminal device, comprising: sending a virtual conference join request according to a conference number input by a current participant, and receiving conference detail information of a target virtual conference corresponding to the conference number; wherein the target virtual conference is associated with a target conference scene in a plurality of conference scenes, each conference scene includes a main conference area and a plurality of free discussion areas, a main conference area of the target virtual conference corresponds to a global real-time communication (RTC) room and a global instant messaging (IM) room, and each free discussion area of the target virtual conference corresponds to a local RTC room and a local IM room, each RTC room is used for transmitting conversation content, and each IM room is used for transmitting control messages; according to the conference detail information, sending a first room join request for joining a virtual image of the current participant to the global RTC room and the global IM room, so that the current participant participates in global communication; when receiving a current voice stream sent by the current participant, sending the current voice stream to a conference terminal of other participants in the target discussion area who subscribe to the RTC stream of the current participant for playing; When the virtual image moves to the target discussion area, a second room joining request is sent to join the current participant to the local RTC room and the local IM room of the target discussion area according to the conference detail information, so that the current participant participates in the range communication of the target discussion area.

7. The method of claim 6, wherein, The conference detail information includes a third room number of the local IM room and a fourth room number of the local RTC room of the target discussion area, and the second room joining request is sent to join the current participant to the local RTC room and the local IM room of the target discussion area according to the conference detail information, so that the current participant participates in the range communication of the target discussion area, including: A third joining request is sent according to the fourth room number, and after joining successfully, a subscription request of the current participant to subscribe to the RTC stream of each participant in the target discussion area is sent; A fourth joining request is sent according to the third room number, the fourth joining request carries user information of the current participant, the user information is broadcasted in the local IM room corresponding to the third room number, so that other participants in the target discussion area receive the new user joining message and subscribe to the RTC stream of the current participant; The current voice stream of the current participant is sent, and the current voice stream is sent to the conference terminal of other participants in the target discussion area who subscribe to the RTC stream of the current participant for playing; Other voice streams sent by other participants in the target discussion area are received and played to the current participant.

8. The method of claim 6, wherein, After the virtual image leaves the target discussion area, the method further includes: In response to the cancel subscription operation of the current participant, a first exit instruction is sent to cancel the subscription of the RTC stream of other participants in the target discussion area to stop receiving the sound of other participants in the local RTC room; A second exit instruction is sent to exit the local IM room, and the second exit instruction is broadcasted in the local IM room to notify other participants to cancel the subscription of the RTC stream of the current participant who exits the range communication.

9. A server device, comprising: The IM unit, the RTC unit, the memory and the processor are connected through a bus; The memory stores a computer program, and the processor executes the following operations according to the computer program: Create a plurality of conference scenes, each conference scene including a main conference area and a plurality of free discussion areas; A target virtual conference is created and associated with a target conference scene, The IM unit is called to generate a global IM room for the main conference area of the target virtual conference, and a local IM room for each free discussion area, and the RTC unit is called to generate a global RTC room for the main conference area of the target virtual conference, and a local RTC room for each free discussion area; wherein each IM room is used to transmit control messages, and each RTC room is used to transmit conversation content; ​ receive a virtual meeting join request triggered by a conference number input operation of a current participant, and send conference detail information of a target virtual meeting to a conference terminal device of the current participant according to the conference number; receive a first room join request sent by the current participant based on the conference detail information, and according to the first room join request, call the IM unit to add a virtual image of the current participant to a global IM room, and call the RTC unit to add the virtual image of the current participant to a global RTC room to enable the current participant to participate in global communication; when the virtual image moves to a target discussion area, receive a second room join request sent by the current participant based on the conference detail information, and according to the second room join request, call the IM unit to add the virtual image to a local IM room of the target discussion area, and call the RTC unit to add the virtual image to a local RTC room of the target discussion area to enable the current participant to participate in range communication of the target discussion area.

10. A conference end device, characterized by comprise a processor, a memory, a display and a communication interface, the communication interface, the display, the memory and the processor being connected through a bus; the display is configured to display a virtual meeting scene and a virtual image of a participant; the memory stores a computer program, and the processor executes the following operations according to the computer program: according to a conference number input by a current participant, call the communication interface to send a virtual meeting join request, and receive conference detail information of a target virtual meeting corresponding to the conference number; wherein the target virtual meeting is associated with a target conference scene in a plurality of conference scenes, each conference scene comprises a main conference area and a plurality of free discussion areas, a main conference area of the target virtual meeting corresponds to a global real-time communication (RTC) room and a global instant messaging (IM) room, and each free discussion area of the target virtual meeting corresponds to a local RTC room and a local IM room, each RTC room is configured to transmit conversation content, and each IM room is configured to transmit control messages; according to the conference detail information, call the communication interface to send a first room join request for adding a virtual image of the current participant to the global RTC room and the global IM room, to enable the current participant to participate in global communication; when the virtual image moves to a target discussion area, according to the conference detail information, call the communication interface to send a second room join request for adding the current participant to a local RTC room and a local IM room of the target discussion area, to enable the current participant to participate in range communication of the target discussion area.

Images