Realization method of range communication in virtual conference, display equipment and mobile terminal

Abstract

The invention discloses a method for realizing range communication in a virtual conference, a display device and a mobile terminal, the display device receives an operation of joining a target virtual conference by a current participant and sends a conference participation request to a server, and the server joins the participant in a group discussion group corresponding to the virtual conference. A virtual conference interface presented by the display device comprises a virtual communication room and virtual images corresponding to all participants joining the target virtual conference, and the display device displays the target virtual conference based on the current position information of the current virtual image in the virtual communication room. And generating a range communication discussion group based on the current participants in the group discussion group and at least one target participant satisfying the preset distance range. And the range communication message generated by the current participant is sent to each target participant end in the range communication discussion group, so that the participant can freely communicate with other participants anywhere and anytime within a certain social range, and the user experience is good.

Description

A method for realizing range communication in a virtual meeting, a display device, and a mobile terminal

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to the Chinese patent application filed with the China Patent Office on October 25, 2022, with application number 202211313577.9, and the Chinese patent application filed with the China Patent Office on March 14, 2023, with application number 202310244721.6, the entire contents of which are incorporated by reference into this application. Technical Field

[0003] The present application relates to the field of computer technology, and in particular to a method for implementing range communication in a virtual conference, a display device, and a mobile terminal. Background Art

[0004] With the rapid development of display devices, their functionality and performance are becoming increasingly rich and powerful. Currently, display devices include smart TVs, smartphones, computers, and products with smart display screens. In various scenarios using display devices, virtual conferencing systems can be configured within these devices. This allows for the creation of virtual meetings and allows multiple participants to join and communicate.

[0005] In virtual meetings, participants can only speak to the entire room or establish a one-on-one private conversation with a specific participant. This fixed communication model prevents free communication. For example, the current participant cannot readily participate in the private free discussion between other participants, and other participants cannot readily participate in the private free discussion between the current participant and other participants, resulting in a poor user experience.

[0006] Summary of the Invention

[0007] The present application provides a display device, comprising: a display configured to display an image and / or a user interface; a memory configured to store computer instructions and data related to the display; at least one processor connected to the display and the memory, the processor being configured to execute computer instructions so that the display device: receives an operation of a current participant joining a target virtual conference, requests a server to join the current participant to a group discussion group corresponding to the target virtual conference, and displays a virtual conference interface of the target virtual conference, wherein the group discussion group includes all participants joining the target virtual conference, and the virtual conference interface includes a virtual communication room corresponding to the group discussion group and a virtual room corresponding to the group discussion group. and the virtual images corresponding to all participants in the group discussion group, the virtual images corresponding to all participants are displayed in the virtual communication room; based on the current position information of the current virtual image in the virtual communication room, detecting whether there is a target virtual image within a preset distance range of the current virtual image, the current virtual image is the virtual image of the current participant, and the target virtual image is the virtual image of the target participant in the group discussion group; if there is at least one target virtual image within the preset distance range of the current virtual image, then filtering out the current participant and the target participant corresponding to the at least one target virtual image from the group discussion, and generating a range communication discussion group;

[0008] Receive the communication message generated by the current participant, and send the communication message to each target participant in the range communication discussion group.

[0009] The present application also provides a server, including: a processor, configured to: respond to a conference participation request sent by a display device, add a designated participant corresponding to the display device to a group discussion group corresponding to a target virtual conference, the group discussion group including all participants joining the target virtual conference; receive a communication message generated by the designated participant sent by the display device, the communication message carrying a communication identifier; if the communication identifier is a range communication identifier, send the communication message generated by the designated participant to at least one target participant end in a range communication discussion group with the same range communication identifier, the range communication discussion group including the designated participant and at least one target participant that meets a preset distance range with the designated participant; if the communication identifier is a full-field communication identifier, send the communication message generated by the designated participant to all participant ends of the group discussion group corresponding to the full-field communication identifier.

[0010] The present application also provides a method for implementing range communication in a virtual conference, which is applied to a display device, and the method includes: receiving an operation of a current participant to join a target virtual conference, requesting a server to add the current participant to a group discussion group corresponding to the target virtual conference, and displaying a virtual conference interface of the target virtual conference, wherein the group discussion group includes all participants who have joined the target virtual conference, the virtual conference interface includes a virtual communication room corresponding to the group discussion group and virtual images corresponding to all participants in the group discussion group, and the virtual images corresponding to all participants are displayed in the virtual communication room; based on the current virtual image in the target virtual conference room, the virtual image is added to the target virtual conference room. The current position information of the virtual communication room is detected, and whether there is a target virtual image within a preset distance range of the current virtual image, the current virtual image is the virtual image of the current participant, and the target virtual image is the virtual image of the target participant in the group discussion group; if there is at least one target virtual image within the preset distance range of the current virtual image, the current participant and the target participant corresponding to the at least one target virtual image are filtered out from the group discussion, and a range communication discussion group is generated; the communication message generated by the current participant is received, and the communication message is sent to each target participant end in the range communication discussion group.

[0011] The present application also provides a method for implementing range communication in a virtual conference, which is applied to a server, and the method includes: in response to a conference participation request sent by a display device, adding a designated participant corresponding to the display device to a group discussion group corresponding to a target virtual conference, wherein the group discussion group includes all participants joining the target virtual conference; receiving a communication message generated by the designated participant sent by the display device, wherein the communication message carries a communication identifier; if the communication identifier is a range communication identifier, sending the communication message generated by the designated participant to at least one target participant end in the range communication discussion group with the same range communication identifier, wherein the range communication discussion group includes the designated participant and at least one target participant that meets a preset distance range with the designated participant; if the communication identifier is a full-field communication identifier, sending the communication message generated by the designated participant to all participant ends of the group discussion group corresponding to the full-field communication identifier.

[0012] The present application also provides a computer non-volatile readable storage medium, which can store a program. When the program is executed, it can implement some or all of the steps in each embodiment of the method for implementing range communication in a virtual meeting provided by the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] FIG1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to some embodiments;

[0014] FIG2 shows a flow chart of a method for creating a virtual meeting according to some embodiments;

[0015] FIG3 illustrates a timing diagram for creating a virtual conference according to some embodiments;

[0016] FIG4 shows a schematic diagram of a conference creation interface according to some embodiments;

[0017] FIG5 shows a flowchart of a method for implementing range communication in a virtual meeting performed by a display device according to some embodiments;

[0018] FIG6 illustrates a timing diagram of participants joining a virtual conference according to some embodiments;

[0019] FIG7 shows a schematic diagram of a virtual conference selection interface according to some embodiments;

[0020] FIG8 shows a schematic diagram of a virtual conference interface according to some embodiments;

[0021] FIG9 shows a schematic diagram of an interface for joining a target virtual conference using a conference password according to some embodiments;

[0022] FIG10 shows a timing diagram of implementing range communication in a virtual communication room according to some embodiments;

[0023] FIG11 shows a top view schematic diagram of range communication area division according to some embodiments;

[0024] FIG12 shows a flow chart of a method for generating a scope exchange discussion group according to some embodiments;

[0025] FIG13( a ) shows a schematic diagram of a virtual conference interface on the host side according to some embodiments;

[0026] FIG13( b ) shows another schematic diagram of a virtual conference interface on the host side according to some embodiments;

[0027] FIG14 is a schematic diagram showing a speech type dialog box displayed on a participant side according to some embodiments;

[0028] FIG15 shows another timing diagram for implementing range communication in a virtual communication room according to some embodiments;

[0029] FIG16 shows another schematic top view of range communication area division according to some embodiments;

[0030] FIG17 shows a flow chart of a method for implementing range communication according to some embodiments;

[0031] FIG18 shows a flow chart of a method for implementing range communication in a virtual conference performed by a server according to some embodiments;

[0032] FIG19 shows another flow chart of a method for implementing range communication in a virtual conference performed by a server according to some embodiments;

[0033] FIG20 shows a block diagram of a hardware configuration of a display device 200 according to some embodiments;

[0034] FIG21 shows a block diagram of a hardware configuration of a mobile terminal 300 according to some embodiments;

[0035] FIG22 shows a schematic diagram of software configuration in the display device 200 or the mobile terminal 300 according to some embodiments;

[0036] FIG23 shows a schematic diagram of software interaction of a method for displaying a page based on device performance according to some embodiments;

[0037] FIG24 is a schematic flow chart showing a method for displaying a page based on device performance according to some embodiments;

[0038] FIG25 shows a flowchart of another method for displaying a page based on device performance according to some embodiments;

[0039] FIG26 shows a schematic diagram of a skeleton point composition graph according to some embodiments;

[0040] FIG27 shows a schematic diagram of a scenario of displaying a training page according to some embodiments;

[0041] FIG28 shows a schematic diagram of a scene showing a virtual human training screen according to some embodiments;

[0042] FIG29 shows a schematic diagram of a prompt scenario of a follow-up training page according to some embodiments;

[0043] FIG30 shows an interactive schematic diagram of a method for displaying a page based on device performance according to some embodiments. DETAILED DESCRIPTION

[0044] In order to make the purpose and implementation of this application clearer, the exemplary implementation of this application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of this application. Obviously, the described exemplary embodiments are only part of the embodiments of this application, not all of the embodiments.

[0045] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0046] The display device provided in the embodiments of the present application can have various implementation forms, for example, it can be a television, smart TV, computer, laser projection device, monitor, electronic bulletin board, electronic table, etc. Figure 1 shows a specific embodiment of the display device of the present application.

[0047] Figure 1 shows a schematic diagram of an operation scenario between a display device and a control apparatus according to some embodiments. As shown in Figure 1 , a user 100 can operate a display device 200 via a terminal device 300, or the user 100 can directly operate the display device 200.

[0048] In some embodiments, the terminal device 300 may be, for example, a mobile terminal, a tablet computer, a computer, a notebook computer, etc. For example, the display device 200 is controlled using an application running on the terminal device.

[0049] In some embodiments, the display device 200 may not use the aforementioned terminal device to receive commands, but may instead receive user control through touch or gestures. The display device 200 may also directly receive user voice command control through a module configured within the display device 200 for acquiring voice commands, or may receive user voice command control through a voice control device provided externally to the display device 200.

[0050] In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 may be connected to a local area network (LAN), a wireless local area network (WLAN), or other networks. The server 400 may provide various content and interactions to the display device 200. The server 400 may be a single cluster or multiple clusters, and may include one or more types of servers.

[0051] In some embodiments, a virtual conference system is configured in the display device 200 and may exist in the form of an application. The virtual conference system is used to create a virtual conference and allow multiple participants to join the virtual conference for communication.

[0052] In real-world scenarios, when a user approaches a group of people who are talking or discussing something, they can naturally hear what they are saying. They can choose to walk by, stop and listen, or join the discussion at any time.

[0053] In virtual meetings, participants can only speak to the audience or have a one-on-one private conversation with a specific participant. This fixed communication model is very different from real-life communication scenarios and cannot achieve free communication.

[0054] In order to give participants a better experience, that is, to be able to have private and free discussions with other participants at any time, just like attending a real meeting, an embodiment of the present application provides a display device 200, and is configured to perform an implementation method for range communication in a virtual meeting. In the virtual meeting provided by an embodiment of the present application, participants are presented in a virtual meeting scene (virtual communication room) in the form of virtual images, and the virtual images can roam in the virtual meeting scene. When entering a certain social range, the conversation voices of other virtual images corresponding to participants within this range can be heard by the current participant, and the current participant's speech can also be heard by other participants within the range, that is, just like in a real scene, within a certain social range, participants can communicate freely.

[0055] Figure 2 shows a flowchart of a method for creating a virtual meeting according to some embodiments; Figure 3 shows a timing diagram of creating a virtual meeting according to some embodiments. Embodiments of the present application provide a display device 200, comprising: a display configured to display a user interface, including but not limited to the virtual meeting interface, virtual meeting selection interface, and meeting creation interface shown herein; and a processor connected to the display, configured to perform the following steps when executing the method for creating a virtual meeting shown in Figures 2 and 3:

[0056] S01. Display a conference creation interface, which includes a creation button and at least one parameter input box. The at least one parameter input box is used for a user to input different types of parameters.

[0057] S02: receiving a user triggering a create button, obtaining different types of parameters input by the user based on at least one parameter input box, and generating a create request carrying create request parameters, where the create request parameters include different types of parameters.

[0058] S03: Send a creation request carrying creation request parameters to the server, where the creation request is used to instruct the server to create a virtual conference based on the creation request parameters.

[0059] The timing process of creating a virtual conference shown in FIG3 specifically includes the following steps:

[0060] S301. The administrator creates a meeting (including meeting name, meeting start and end time, meeting scenario ID, maximum number of participants, etc.) to the business server.

[0061] S302, the business server verifies parameters;

[0062] S303, the business server generates a conference number;

[0063] S304: The business server creates a group discussion group to the instant messaging server;

[0064] S305. The instant messaging server notifies the service server of successful creation and returns the group code.

[0065] S306. The business server saves the meeting information to the database;

[0066] S307: The business server receives a notification that the database has been successfully saved, and further notifies the administrator that the meeting has been successfully saved.

[0067] S308: The business server backend starts a scheduled scanning task to scan for newly created meetings;

[0068] S309: The business server reaches the conference start time and generates conference cache information;

[0069] S310, the business server saves the conference cache information to the cache server;

[0070] S311: The business server receives a notification of successful saving from the cache server.

[0071] In some embodiments, the subject who creates the virtual conference may be an administrator, and the conference creation interface is displayed on the display of the display device 200. On the administrator side, the user 100 in Figure 1 may be the administrator who creates the virtual conference, and the administrator side may be the display device operated by the administrator.

[0072] Figure 4 illustrates a schematic diagram of a conference creation interface according to some embodiments. In some embodiments, as shown in Figure 4 , the conference creation interface includes at least one parameter input box. The at least one parameter input box includes at least one or more of a conference name input box, a conference time input box, a conference cover input box, a maximum number of participants input box, a conference scene input box, a public display input box, a participation restriction input box, a host input box, a create button, and a cancel button.

[0073] The Meeting Name input box is used to specify the name of the virtual meeting. The Meeting Time input box is used to specify the start and end times of the virtual meeting. The Meeting Cover input box is used to specify the cover of the virtual meeting; this parameter is optional. The Maximum Number of Participants input box is used to determine the maximum number of participants in the virtual meeting. The Meeting Scene input box is used to specify the background image of the virtual communication room corresponding to the virtual meeting. This background image defaults to the meeting cover image, but you can also change the scene image. Selecting a meeting scene image determines the meeting scene ID. The Public Display input box is used to determine whether the virtual meeting is publicly available. The Participation Restriction input box is used to determine whether password verification is required to join the virtual meeting. The Public Display input box is linked to the Participation Restriction input box. When the Public Display input box is public, the unlimited and password verification options provided in the Participation Restriction input box are both enabled. If an administrator enables the unlimited option, no password is required to join the virtual meeting. If an administrator enables the password verification option, a password is required to join the virtual meeting. If the Public Display input box is disabled, the unlimited and password verification options provided in the Participation Restriction input box are disabled. The Moderator input box determines the moderator of the virtual meeting. The Create button is used to confirm the creation process of the virtual conference after the administrator sets the corresponding type of parameters. The Cancel button is used to cancel the creation process of the virtual conference.

[0074] The administrator sets different types of parameters in the parameter input boxes provided on the conference creation interface and triggers the Create button. The administrator's display device 200 generates a creation request carrying the creation request parameters, which include different types of parameters. The administrator's display device 200 sends the creation request carrying the creation request parameters to the server, which then requests the instant messaging server to create a virtual conference and its group discussion group based on the creation request parameters. The group discussion group is used to facilitate instant messaging and communication among all participants in the virtual conference.

[0075] Exemplarily, when password verification is required, the creation request parameters include at least one of the meeting name, meeting password, meeting start time, meeting end time, meeting scene ID and the maximum number of participants; when password verification is not required, the creation request parameters include at least one of the meeting name, meeting start time, meeting end time, meeting scene ID and the maximum number of participants.

[0076] It should be noted that the server described herein may be a business server. The process of the business server creating a virtual conference based on a creation request from the display device may refer to the contents of subsequent server embodiments and will not be described in detail here.

[0077] FIG5 illustrates a flow chart of a method for implementing range communication in a virtual meeting using a display device according to some embodiments. Embodiments of the present application provide a display device 200, which is used on a participant display device. When executing the method for implementing range communication in a virtual meeting shown in FIG5 , the processor of the participant display device 200 is configured to perform the following steps:

[0078] S11. Receive an operation of the current participant to join the target virtual conference, request the server to add the current participant to the group discussion group corresponding to the target virtual conference, and display the virtual conference interface of the target virtual conference.

[0079] The group discussion group includes all participants who join the target virtual conference, and the virtual conference interface includes a virtual communication room corresponding to the group discussion group and virtual images corresponding to all participants in the group discussion group. The virtual images corresponding to all participants are displayed in the virtual communication room.

[0080] In some embodiments, a virtual meeting corresponds to a group discussion group, which is used to achieve full communication among all participants joining the virtual meeting. The virtual communication room can be regarded as a visual presentation of the group discussion group of the virtual meeting. Therefore, the group code of the group discussion group can be equivalent to the group code used to characterize the virtual communication room. The group discussion group can be created by the business server based on the creation request of the administrator side, and then requesting the instant messaging server to create it. The process of the business server and the instant messaging server creating the group discussion group of the target virtual meeting can refer to the content of the subsequent server embodiment and will not be repeated here.

[0081] The appearance of an avatar in the virtual communication room indicates that the participant has joined the virtual meeting group. Avatars are a visual representation of participants in the virtual communication space. During virtual meetings, visually displaying participants can enhance their sense of participation and experience. Furthermore, participants can control the movement of their avatars within the virtual communication room, allowing them to freely communicate with other participants anywhere and at any time, just like in a real-life meeting.

[0082] After the administrator requests the service server to complete the creation of a virtual conference, when the current time reaches the target virtual conference's start time, participants can join the target virtual conference, and the virtual conference interface of the target virtual conference is displayed on the participant's display. The participant's terminal can be a display device operated by the participant. In this scenario, user 100 in Figure 1 can be a participant.

[0083] Figure 6 shows a timing diagram of a participant joining a virtual conference according to some embodiments. In some embodiments, as shown in Figure 6, the processor of the participant display device 200 is further configured to perform the following steps when receiving the current participant joining the target virtual conference and displaying the virtual conference interface of the target virtual conference:

[0084] Step 1: Display a virtual conference selection interface, where the virtual conference selection interface includes at least one virtual conference selection item.

[0085] Step 2: Receive the trigger of the current participant's selection of the target virtual conference and generate a conference request carrying conference request parameters.

[0086] Step 3: Send a conference request carrying conference request parameters to the server. The conference request is used to instruct the server to verify the user identifier and the conference number of the target virtual conference.

[0087] Step 4: receiving meeting details information of the target virtual meeting corresponding to the meeting number sent by the server after verification, and displaying the virtual meeting interface of the target virtual meeting based on the meeting details information.

[0088] The participant triggers the virtual conference system configured in the display device 200 to display the virtual conference selection interface on the display.

[0089] The sequential process of a participant joining a virtual conference shown in FIG6 specifically includes the following steps:

[0090] S601, participant S1 applies to the business server to join the conference (conference number + user ID + password);

[0091] S602: The business server receives the conference joining request and verifies the parameters;

[0092] S603: The service server queries the conference details from the cache;

[0093] S604: The business server receives the conference details information returned by the cache server;

[0094] S605: The business server verifies the meeting password;

[0095] S606: The participant terminal S1 receives a notification of failure to join the conference sent by the business server;

[0096] S607: The participant S1 ends the process.

[0097] S608: The business server passes verification;

[0098] S609: The business server adds the participant to the participant list;

[0099] S610: The service server sends a successful conference joining notification to the participant terminal S1 and returns conference details.

[0100] S611. The business server sends a conference joining notification to the instant messaging server.

[0101] S612. The instant messaging server sends a conference joining notification to other participants S2-Sn who have joined the conference.

[0102] S613, other participants S2-Sn who have joined update the local participant list;

[0103] S614, participant terminal S1 joins the group discussion group based on the group code;

[0104] S615, the participant terminal S1 queries the business server for a list of participants who have already attended the conference;

[0105] S616. The participant terminal S1 receives the participant list (user ID, user name, location information, etc.) returned by the business server;

[0106] S617: The participant terminal S1 saves the participant list locally.

[0107] FIG7 illustrates a schematic diagram of a virtual meeting selection interface according to some embodiments. As shown in FIG7 , the virtual meeting selection interface displays options for at least one virtual meeting that the participant is about to attend, with the at least one virtual meeting selection being sorted in descending order based on the start time of each virtual meeting. For example, the virtual meeting selection interface displays options for two virtual meetings scheduled today (October 10, 2022) and two virtual meetings scheduled on October 12, 2022.

[0108] The options for the virtual meeting include at least one of the following: meeting cover, meeting name, status, number of participants, limited number of participants, access method, and meeting number. The status may include types such as not started, in progress, and ended. The number of participants is used to represent the number of people who have currently joined the virtual meeting. The limited number of participants is the maximum number of participants in the virtual meeting. The access method is used to determine whether a password is required to join the corresponding virtual meeting. The meeting number is used to uniquely represent the virtual meeting. The meeting number can be 11 characters. The first digit is used to distinguish between multi-environment deployments (1-online environment, 2-test environment, etc.), the middle 6 digits are the year and date, and the following are 4 random numbers.

[0109] Take the example of participant P1 (current participant) joining the ongoing virtual conference A (target virtual conference). The name of virtual conference A is "2022 XX New Product Launch Conference", the access method is password-free, the number of participants is 2590, the limit is 3000, and the conference number is 1221010xxxx. The current participant P1 triggers the selection option of virtual conference A, and the display device S1 of participant P1 generates a conference request carrying conference request parameters and sends it to the business server. The conference request parameters include the user ID and the conference number of the target virtual conference. The user ID is used to represent the identity of the current participant P1.

[0110] In response to the conference join request sent by display device S1, the service server verifies the validity of the conference join request parameters carried in the conference join request, namely the user ID and the meeting number of the target virtual conference. If the verification passes, the service server obtains the meeting details of virtual conference A corresponding to the meeting number (1221010xxxx) from the cache server. The service server sends the meeting details of virtual conference A to display device S1. Next, display device S1 displays the virtual conference interface of virtual conference A on the display based on the meeting details.

[0111] Among them, the meeting details information includes at least one of the meeting name, meeting start time, meeting end time, meeting scene ID, meeting number, group code and maximum number of participants. The group code is used to identify the group discussion group of the target virtual meeting (equivalent to a virtual communication room), and the meeting scene ID is used to characterize the meeting scene.

[0112] Figure 8 illustrates a schematic diagram of a virtual conference interface according to some embodiments. In some embodiments, as shown in Figure 8 , the virtual conference interface includes a virtual communication room and avatars (P1'...Pn') corresponding to all participants (P1...Pn) joining the target virtual conference. The avatars corresponding to all participants are displayed in the virtual communication room. The maximum value of n is the number of participants (maximum number of participants).

[0113] The virtual communication room can be regarded as a full-field communication area, and each virtual image in the virtual communication room can move within the full-field communication area.

[0114] In some embodiments, to enhance the display quality of the virtual communication room, the processor of the participant's display device retrieves a meeting scene ID from the meeting details and obtains the meeting scene corresponding to the meeting scene ID. The meeting scene is then displayed in the background of the virtual communication room corresponding to the virtual meeting, allowing participants to experience the ambiance of a real-life new product launch, resulting in a better user experience.

[0115] In some embodiments, the processor of the participant display device is further configured to perform the following steps:

[0116] Step 5: Receive the successful conference joining notification returned by the server after verification.

[0117] Step 6: In response to the notification of successful participation, obtain the virtual image corresponding to the current participant.

[0118] Step 7: Based on the group code, the current participant is added to the group discussion group corresponding to the group code, and the virtual image of the current participant is displayed in the virtual communication room through the instant messaging server.

[0119] After verifying that the participation request of the participant display device is passed, the business server adds participant P1 to the participant list of virtual conference A based on the conference number. The participant list includes all participants who have joined the target virtual conference; the business server stores the participant list in the cache server. At the same time, the business server can also return a successful participation notification to the display device S1 of participant P1, and send the participation notification of participant P1 to other participant display devices through the instant messaging server. The other participant display devices respond to the participation notification, which updates the local participant list of the other participant display devices. The specific implementation content of the business server executing this process can refer to the content provided in the subsequent server embodiments and will not be repeated here.

[0120] In some embodiments, the participant list and the group discussion group have in common that both include all participants of the same virtual meeting. The difference between the two is that the group discussion group is created by the instant messaging server to facilitate the exchange of messages between participants, while the participant list is statistically generated by the business server to collect participant-related information. The group discussion group includes information such as the user ID and user name of each participant, but may not include location information. The participant list includes content such as the user ID, user name, and location information of each participant. Location information refers to the coordinate position of the participant's virtual image in the virtual communication room.

[0121] In response to the successful participation notification returned by the business server, the display device S1 of participant P1 adds participant P1 to the group discussion group corresponding to the group code of virtual conference A through the instant messaging server, and displays the virtual image P1' of participant P1 in the virtual communication room corresponding to virtual conference A.

[0122] In some embodiments, the display device S1 of participant P1 sends a query request to the service server, so that the service server obtains from the cache server a list of participants currently joining the virtual conference A. Based on the latest participant list returned by the service server, the display device S1 updates the participant list stored locally on the display device S1.

[0123] In some embodiments, if the target virtual meeting is accessed using a password, indicating that the administrator included a meeting password in the creation request parameters when creating the virtual meeting, then when a subsequent participant performs a join operation, the join request parameters include the user ID, the join password, and the meeting number of the target virtual meeting, and the meeting details include at least one of the meeting name, meeting password, meeting start time, meeting end time, meeting scenario ID, meeting number, group code, and the maximum number of participants. The join password refers to the meeting password entered by the participant when applying to join the target virtual meeting, and the subsequent service server needs to verify the consistency of the join password with the meeting password set by the administrator when the virtual meeting was created.

[0124] In some embodiments, referring to Figure 7 again, the virtual meeting selection interface includes an option for virtual meeting B. The name of virtual meeting B is "XXXX Ultra-Large Screen New Product Launch Conference", the meeting start time is 10:23 this morning, the access method is password-protected, the number of participants is 2,310, the limit is 6,000, and the meeting number is 1221010yyyy.

[0125] At 9:30 AM, the status of virtual meeting B is "Not Started." At 10:23 AM, the status of virtual meeting B switches to "In Progress." Next, participant P1 selects virtual meeting B, and a password entry screen pops up on the virtual meeting selection screen.

[0126] Figure 9 illustrates a schematic interface for joining a target virtual conference using a conference password, according to some embodiments. As shown in Figure 9(a), the password input interface includes a password input box, a confirmation control, and a cancel control. Participant P1 enters a password in the password input box and clicks the cancel control to cancel joining virtual conference B. Clicking the confirmation control confirms the password, and the processor determines whether the current number of participants has reached the maximum number of participants.

[0127] If the current number of participants reaches the maximum number of participants, as shown in Figure 9(b), the processor switches to displaying a prompt interface within the virtual conference selection interface. The prompt interface includes a prompt message and a confirmation control. The prompt message informs the current participant P1 that virtual conference B has reached the maximum number of participants and prompts the participant for the next steps. Clicking the confirmation control cancels the prompt interface and returns to the virtual conference selection interface.

[0128] If the current number of participants has not reached the maximum number of participants, as shown in Figure 9 (c), the processor switches the virtual conference selection interface to display a join conference prompt interface, which is used to prompt participant P1 that she is joining virtual conference B. After the processor adds participant P1 to virtual conference B, the join conference prompt interface is canceled and the virtual conference interface for virtual conference B (as shown in Figure 8) is switched to display.

[0129] When the participant triggers the option of the target virtual meeting that does not require a password, and when the participant triggers the option of the target virtual meeting that requires a password and enters the password and clicks the OK control, in the background, the processor generates a meeting request and sends it to the business server. The processor and the business server execute the corresponding content of steps one to seven and related steps above, which are not repeated here. The processor receives the meeting details information of the target virtual meeting returned by the business server, and the display device starts to render the meeting scene and displays the virtual meeting interface. At the same time, the processor displays the virtual image of the participant in the virtual communication room in the virtual meeting interface.

[0130] S12. Based on the current position information of the current avatar in the virtual communication room, detect whether there is a target avatar within a preset distance range of the current avatar.

[0131] The location information refers to the coordinates of the avatar in the virtual communication room. The current avatar is the avatar of the current participant, and the target avatar is the avatar of the target participant in the group discussion group.

[0132] Referring again to Figure 8 , a two-dimensional coordinate system is established within the virtual communication room. The coordinate origin 0 is located on the virtual floor of the virtual communication room. The x-axis runs from the left side to the right side of the virtual floor, and the y-axis runs from the inside to the outside of the virtual floor. The position of the avatar can be represented by the coordinate position of the avatar's bottom on the virtual floor. For example, the coordinate position of participant P1's avatar P1' is displayed as (x1, y1).

[0133] Figure 10 illustrates a timing diagram for implementing range communication in a virtual communication room according to some embodiments. In some embodiments, as shown in Figure 10 , the virtual communication room includes avatars of all participants joining the target virtual conference. Each participant can manipulate their corresponding avatar to move within the virtual communication room using their respective display devices. Participants can manipulate the movement of their avatars by clicking a mouse or by activating keyboard arrow keys, which is not specifically limited in this application.

[0134] Each display device sends its avatar information to other display devices in real time via the instant messaging server. Simultaneously, the instant messaging server sends the avatar information sent by each display device to the service server, which then updates the participant list based on the latest avatar information. The avatar (equivalent to the participant) information includes user ID, user name, and latest location information.

[0135] The business server stores the latest information about each participant's avatar and can send the latest participant list to the cache server for storage. The cache server has a fast response time, allowing for rapid and efficient data delivery when the display device needs to obtain data from the cache server.

[0136] After receiving the corresponding participant's avatar information from the other devices, each display device updates its local participant list. To enable range communication, it determines whether the avatars of other participants meet the range communication conditions based on the current location of the current participant's avatar. Participants manipulate their avatars to move within the virtual communication room, triggering range detection on the display device. Range detection is based on the latest local participant list.

[0137] The timing flow of implementing range communication in the virtual communication room shown in FIG10 specifically includes the following steps:

[0138] S1001, participant S1 controls the avatar to move in the virtual communication room;

[0139] S1002, the participant terminal S1 reports real-time location information (user ID, user name, latest location information) to the instant messaging server during movement;

[0140] S1003, other participant terminals S2-Sn receive the changed location information sent by the instant messaging server;

[0141] S1004: The business server system receives the changed location information sent by the instant messaging server;

[0142] S1005: The business server updates the location information of the corresponding participant in the participant list to the cache server;

[0143] S1006. Other participant terminals S2-Sn update their local participant lists;

[0144] S1007, the participant terminal S1 performs a virtual image movement trigger range perception detection;

[0145] S1008. The participant terminal S1 saves other participants within a range of x meters centered on the current participant to a range communication list;

[0146] S1009, the participant terminal S1 displays the user name in the range communication list on the corresponding virtual image;

[0147] S1010: The current participant clicks to speak, and the participant terminal S1 determines whether the conference has enabled the range communication function;

[0148] S1011, participant S1 creates a range communication discussion group to the instant messaging server;

[0149] S1012, the participant terminal S1 sends a message of joining the temporary discussion group to the participants in the range communication list via the instant messaging server;

[0150] S1013, participant terminal S1 receives a message from the instant messaging server to join the temporary discussion group, and joins the scope exchange discussion group;

[0151] S1014, participant terminal S1 subscribes to the voice streams of other participants in the group from the instant messaging server;

[0152] S1015: Participant S1 subscribes to the voice streams of other participants in the group from the instant messaging server;

[0153] S1016: Participant S1 starts speaking and starts streaming.

[0154] S1017: Participant S1 receives the streaming data and plays the audio.

[0155] S1018, participant S1 starts speaking and starts streaming;

[0156] S1019: Participant S1 receives the streaming data and plays the audio.

[0157] S1020. The participant S1 continues to operate the virtual image to move.

[0158] Figure 11 illustrates a top-down diagram of range communication area division according to some embodiments. As shown in Figure 11 , using the virtual image P1' of participant P1 as an example, the virtual images of other participants within a preset distance range centered on virtual image P1' are detected. For example, the preset distance range can be 1 meter.

[0159] Based on the coordinates (x, y) of each avatar, the distance between the other avatars and avatar P1' is calculated. If the calculated distance is within 1 meter, the corresponding participant meets the range communication condition; if the calculated distance is greater than 1 meter, the corresponding participant does not meet the range communication condition. In other words, the participants corresponding to the avatars within 1 meter of avatar P1' meet the range communication condition with participant P1, while other participants outside 1 meter do not meet the range communication condition with participant P1.

[0160] S13. If there is at least one target virtual image within a preset distance range of the current virtual image, target participants corresponding to the current participant and the at least one target virtual image are screened out from the group discussion, and a range communication discussion group is generated.

[0161] If avatars P3' and P5' meet the range communication conditions within a one-meter radius of avatar P1', the corresponding participants P3 and P5 will be selected for range communication with the current participant P1. The range communication list now includes information about participants P1, P3, and P5. The range communication participant information includes user IDs, user names, and the corresponding avatar's most recent location. The range communication discussion group includes P1, P3, and P5.

[0162] In some embodiments, the range communication area is smaller than or equal to the full communication area. The range communication limited by the central participant is realized in the range communication area, and the full communication of all participants in the virtual communication room is realized in the full communication area.

[0163] Members of a scoped discussion group are members of a group discussion group, but not all members of a group discussion group are members of a scoped discussion group. Each participant in a group discussion group can create at least one scoped discussion group. Scoped discussion groups are relatively isolated from each group discussion group, and each scoped discussion group is also relatively isolated from each other. Isolation means that messages between different discussion groups are generally not communicated with each other, and can only be communicated with each other when permitted.

[0164] FIG12 shows a flow chart of a method for generating a range communication discussion group according to some embodiments. In some embodiments, as shown in FIG12 , the processor of the participant display device is further configured to:

[0165] S131. Add the current participants in the group discussion and at least one target participant corresponding to the target virtual image to a range communication list.

[0166] S132: Receive a triggering of a speech button in the virtual conference interface by the current participant, and determine whether a range communication switch corresponding to the target virtual conference is turned on.

[0167] S133. If the range communication switch is on, a speech type dialog box is displayed in the virtual conference interface, where the speech type dialog box includes a range communication option.

[0168] S134: receiving a trigger of the scope communication option by the current participant, and creating a scope communication discussion group corresponding to the scope communication list through the instant messaging server, wherein the scope communication discussion group is used to implement scope communication between each participant in the scope communication list.

[0169] The current participant creates a corresponding range communication list based on the current participant. The range communication list includes the current participant's information and at least one target participant within a preset distance range. This information includes the user ID, user name, and the latest location of the corresponding avatar.

[0170] Whether or not a virtual meeting has a range communication function is controlled by the range communication switch. This switch is configured in the virtual meeting interface of the host of the target virtual meeting. The host is designated by the administrator when creating the virtual meeting. The host can be any participant in the target virtual meeting and has global control over the meeting.

[0171] Figure 13(a) illustrates a schematic diagram of a host-side virtual conference interface according to some embodiments. In some embodiments, as shown in Figure 13(a), the host-side virtual conference interface differs from the participant-side virtual conference interface in that the host-side virtual conference interface also includes management controls and list controls, while the rest of the interface content is the same. The host-side refers to the display device 200 used by the host, and the participant-side refers to the display device 200 used by the participant.

[0172] In response to the host triggering the management control, the host side displays the management interface in the host side virtual conference interface. The management interface includes managing a single user item and managing all user items. In the interface for managing a single user item (not shown in the figure), the participation rights of each participant can be individually controlled, such as mute operations, applause prohibition, etc.; in the interface for managing all user items, the participation rights of all participants can be globally controlled. For example, if the microphone is turned off, all participants cannot speak, and if it is turned on, they can speak. If the screen sharing function is turned off, all participants are not allowed to share the screen, and if it is turned on, they can share the screen. If the applause conference function is turned off, all participants are not allowed to applaud, and if it is turned on, they can applaud. If the all-seated function is turned off, all participants can control the movement of the virtual image in the virtual communication room and can communicate in a range; if it is turned on, the virtual images of all participants remain stationary and are not allowed to move, that is, they cannot communicate in a range.

[0173] Figure 13(b) illustrates another schematic diagram of a host-side virtual conference interface according to some embodiments. In some embodiments, as shown in Figure 13(b), the host-side displays a participant list interface within the host-side virtual conference interface in response to the host triggering a list control. The participant list interface displays a list of participants, with visual information including user avatars and user names.

[0174] In some embodiments, participant P1 triggers the speech button (microphone) in the participant-side virtual conference interface to determine whether the range communication switch corresponding to the target virtual conference is on, that is, whether the all-seating function on the host side is off. If the all-seating function is off, then the range communication switch is determined to be on, and the participant-side virtual conference interface displays a speech type dialog box.

[0175] FIG14 is a schematic diagram showing a speech type dialog box displayed on a participant side according to some embodiments. In some embodiments, as shown in FIG14 , the participant side virtual conference interface includes a speech button, such as a "microphone" control. In a range communication scenario, if the current participant needs to communicate, the speech button is triggered, and a speech type dialog box is displayed in the virtual conference interface to communicate with other target participants in the range communication list. Different content is displayed in the speech type dialog box based on the detection result of whether the range communication switch is turned on.

[0176] If the Range Communication switch is on, the Speech Type dialog box includes both Range Communication and Full Communication options. If the Range Communication switch is off, the Speech Type dialog box includes the Full Communication option.

[0177] Taking the scope communication among participants P1, P3, and P5 as an example, if the scope communication switch is on, the speech type dialog box displayed on the participant side S1 includes scope communication options and full-field communication options. When the current participant triggers the scope communication option, the current participant P1 can conduct scope communication with each target participant (P3 and P5) in the scope communication list. When the full-field communication option is triggered, the current participant P1 can conduct full-field communication with all participants in the participant list (P2 to Pn). If the scope communication switch is off, the speech type dialog box displayed on the participant side only includes the full-field communication option, but not the scope communication option. At this time, only full-field communication is possible.

[0178] In response to current participant P1 selecting the range communication option, participant S1 invokes the instant messaging server to create a temporary discussion group for the currently selected participants, namely the range communication discussion group. The range communication discussion group includes P1, P3, and P5. At the same time, participant S1 sends an instant message to the target participants (P3 and P5) in the range communication discussion group via the instant messaging server, notifying participants P3 and P5 that they have joined the range communication discussion group. After joining, each participant subscribes to the voice streams of the other target participants in the range communication discussion group to achieve range communication.

[0179] In some embodiments, in a virtual communication room where the virtual conference interface is presented to the current participant, only the user name of the current participant's avatar is displayed, while the corresponding user names of other participants are not displayed on their avatars. During range communication, the user name of the target participant can be displayed on the target avatar to show the current participant P1 which participants are within a 1-meter range.

[0180] The processor of participant P1's display device S1 obtains the user name of each target participant in the range communication list and displays each target participant's user name on each target avatar in the virtual communication room. For example, the user name "User 1" is displayed on avatar P1, the user name "User 3" is displayed on avatar P3, and the user name "User 5" is displayed on avatar P5.

[0181] It should be noted that the participant information corresponding to the range communication list is only displayed on the participant side conducting the range communication, and not on the other participant sides of the virtual communication room, so as to achieve the purpose of private and free communication.

[0182] FIG15 shows another timing diagram for implementing range communication in a virtual communication room according to some embodiments. In some embodiments, as shown in FIG15 , the processor of the participant display device is further configured to:

[0183] Receive preset operations triggered by the current participant and control the corresponding current virtual image to move in the virtual communication room.

[0184] Based on the position information of the current virtual image after movement, a new target virtual image that enters the preset distance range is obtained, and the original target participants located outside the preset distance range are screened out from all the original target participants corresponding to the range communication discussion group.

[0185] The new target participant corresponding to the new target virtual image is added to the range communication discussion group, and the original target participant in the range communication discussion group that is outside the preset distance range is removed to update the range communication discussion group.

[0186] The avatar corresponding to the current participant P1 can be moved to any location in the virtual communication room at any time. As the avatar corresponding to the current participant P1 moves in the virtual communication room, the processor again determines whether there is a new target avatar within the preset distance range of the current participant P1. If so, the range communication list and range communication discussion group are updated. The processor also determines whether the original target participant originally located in the range communication list (discussion group) is still within the range. If not, the target participant is removed.

[0187] Specifically, another sequential process for implementing range communication in a virtual communication room shown in FIG15 includes the following steps:

[0188] S1501, participant terminal S1 adds participants who have newly entered the x-meter range to the range communication list and displays the user name;

[0189] S1502, other participant terminals S2-Sn participant terminal S1 adds the new participant who has entered the range of x meters to the range communication list and displays the user name;

[0190] S1503, the participant terminal S1 sends a message of joining the temporary discussion group to the participants in the new communication list via the instant messaging server;

[0191] S1504. Other participant terminals S2-Sn receive the message of joining the temporary discussion group and join the scope exchange discussion group;

[0192] S1505. Other participant terminals S2-Sn subscribe to the voice streams of other participants in the group from the instant messaging server.

[0193] S1506: The participant terminal S1 subscribes to the voice stream of the newly joined participant from the instant messaging server;

[0194] S1507: Participant S1 starts speaking and starts streaming.

[0195] S1508: The participant terminal S1 receives the push stream data sent by the instant messaging server and plays the voice;

[0196] S1509, other participants S2-Sn start speaking and start streaming;

[0197] S1510, other participants S2-Sn receive the push data sent by the instant messaging server and play the voice;

[0198] S1511, participant terminal S1 removes participants who have left the range of x meters from the range communication list and cancels display of user names;

[0199] S1512. Other participant terminals S2-Sn remove participants who have left the range of x meters from the range communication list and cancel the display of user names.

[0200] S1513, the participant ends S1 and moves it out of the range of the discussion group;

[0201] S1514. Other participant terminals S2-Sn receive a notification of ending the range communication.

[0202] Figure 16 shows another top-down schematic diagram of range communication area division according to some embodiments. As shown in Figure 16, taking the example of participant P1's avatar P1' moving to another location, at this time, by determining that the target avatars within a 1-meter range of avatar P1' are P3' and P8', the updated range communication list (discussion group) includes P1, P3, and P8. That is, participant P1 is in range communication with participants P3 and P8, and the original target participant P5 is not within the 1-meter range of P1'. Therefore, participant P5 can no longer have range communication with participant P1.

[0203] The display device S1 of participant P1 notifies participant P8 to join the range communication discussion group through the instant messaging server, and at the same time removes participant P5 who has left the range from the range communication discussion group (list), and returns a notification of ending the range communication to the display device of participant P5. In order to facilitate the prompting of the current participant P1 that the participant with whom the range communication has changed, the processor displays the user name of each target participant on each target virtual image in the virtual communication room, and cancels the display of the user name on the target virtual image corresponding to the original target participant removed from the range communication list (discussion group). Exemplarily, the processor displays the corresponding user name of participant P8 who has newly entered the 1-meter range, and removes the user name display of participant P5 who has left the range, while continuing to display the user names of participant P1 and participant P3.

[0204] Based on this, as participant P1 moves in the virtual communication room, the range communication list (discussion group) is updated in real time, and the user names of the virtual avatars of each participant who meets the range communication conditions are refreshed and displayed in real time. When the current participant and certain participants enter the social range, each other's user names are displayed to each other. When they leave the social range, the user names are no longer displayed to each other. At the same time, the size of the social range can be configured by changing the preset distance range to provide a better user experience. Every time the virtual avatar of participant P1 moves to a location, it can communicate with participants who meet the range communication conditions, realizing free communication anytime, anywhere.

[0205] S14. Receive the communication message generated by the current participant, and send the communication message to each target participant in the range communication discussion group.

[0206] After establishing a scoped communication centered around the current participant, all target participants in the scoped communication discussion group can communicate in real time. Communication methods include real-time voice and text messages, and communication messages can include voice messages and text messages.

[0207] FIG17 is a flowchart of a method for implementing range communication according to some embodiments. In some embodiments, as shown in FIG17 , the processor of the participant terminal S1 receives a communication message generated by the current participant and sends the communication message to each target participant terminal in the range communication list, and is further configured to:

[0208] S141: Receive a scope communication message generated by the current participant. The scope communication message carries the scope communication identifier of the scope communication discussion group. Each participant in the same scope communication discussion group carries the same scope communication identifier.

[0209] S142. Send the scope communication message of the current participant to each target participant end in the scope communication discussion group with the same scope communication identifier through the instant messaging server, and do not send it to other participant ends in the group discussion group that do not have the same scope communication identifier.

[0210] In the same range communication discussion group, each participant (P1, P3, and P5) has the same range communication identifier. After the current participant P1 triggers the range communication option, he starts to speak and generates range communication information. The participant end S1 sends the range communication message of the current participant P1 to the participants P3 and P5 with the same range communication identifier through the instant messaging server. If a participant who is in the virtual communication room (group discussion group) but not in the corresponding range communication list (range communication discussion group) does not have the range communication identifier, the participant end S1 will not send the communication message of participant P1 to the participants (P2, P4, P6~Pn) ends.

[0211] For example, when a participant in a group chat begins speaking, that participant detects the microphone information and starts streaming the voice message to other participants in the group chat via the instant messaging server. The other participants receive the voice stream and begin playing it, thus achieving group chat. However, participants in the group chat but not in the group chat will not receive the voice stream.

[0212] In some embodiments, the current participant can conduct instant free communication with some of the participants. If there is a participant in the virtual communication room at this time to conduct a full-field communication, the participants in the range communication can also listen to the full-field speech of the participant.

[0213] During this process, the processor on the participant side is further configured to:

[0214] Step 151: When a specific participant who joins the target virtual conference generates specific communication information, a specific communication reminder is displayed in the virtual communication interface corresponding to the current participant.

[0215] Step 152: Receive a trigger of a specific communication reminder from the current participant, and receive specific communication information generated by the specific participant.

[0216] Among them, the specific participant refers to a participant who is in the virtual communication room (group discussion group) and is not in the same scope communication list (scope communication discussion group) as the current participant. For example, the specific participant is one of the participants (P2, P4, P6~Pn), and the specific participant can also be the host.

[0217] While participant P1 is engaged in a group chat, if a specific participant P2 initiates a full-room chat, participant P2's display device S2 sends a specific chat reminder to all other participants (P1, P3-Pn) via the instant messaging server. This specific chat reminder indicates that a specific participant in the virtual chat room is engaging in a full-room chat. It includes the user ID, user name, and user role type. The user role type indicates whether the user currently speaking to the full room is a participant or the moderator.

[0218] Participant P1's display device S1 receives a notification to start a full-room chat. It obtains the speaker's user ID from the notification and subscribes to the speaker's voice stream. At this point, participant P1 can hear both P3 and P5 speaking in the in-scope chat and P2 speaking in the full-room chat.

[0219] In some embodiments, when participant P1 wants to engage in full-audience communication, the processor of participant S1 is further configured to:

[0220] Step 161: When the current participant is conducting a full-audience communication in the virtual communication room, receiving a triggering of a speech button in the virtual conference interface by the current participant, and displaying a full-audience communication option in a speech type dialog box that pops up in the virtual conference interface.

[0221] Step 162: Receive the trigger of the full-room communication option by the current participant, and send a full-room communication request to the specific participant via the instant messaging server. The full-room communication request is used to instruct the specific participant to determine whether to allow the current participant to conduct full-room communication.

[0222] Step 163: In response to the instruction to allow full-field communication received from the specific participant end through the instant messaging server, receive the full-field communication message generated by the current participant, the full-field communication message carries the full-field communication identifier of the group discussion group, and each participant in the group discussion group carries the same full-field communication identifier.

[0223] Step 164: Send the full-field communication information generated by the current participant to all participant terminals in the group discussion group corresponding to the full-field communication identifier through the instant messaging server.

[0224] The moderator controls whether participants can participate in a full-room discussion. In this scenario, a specific participant is the moderator. When participant P1 wishes to participate in a full-room discussion, they trigger the Speak button on participant S1's virtual conference interface and select the Full-room Discussion option in the Speak Type dialog box that pops up. Next, participant S1 generates a full-room discussion request and sends it to the moderator via the instant messaging server.

[0225] At this point, a message pops up in the virtual conference interface on the host's side, and the microphone permission for participant P1 is enabled. At the same time, the host sends a full-room communication notification for participant P1 to all other participants in the virtual communication room. All other participant terminals receive the full-room communication notification from participant P1 and subscribe to the voice stream of full-room communication participant P1. After participant terminal S1 receives the full-room communication permission instruction returned by the host, participant P1 begins to speak, and participant P1's full-room communication message is sent to all other participant terminals via the instant messaging server. At this point, the current participant P1's speech can be heard by all participants in the conference (P2 to Pn).

[0226] The embodiment of the present application provides a display device 200, which receives an operation of the current participant to join the target virtual conference when executing the implementation method of the virtual conference range communication. The virtual conference interface includes a virtual communication room and virtual images corresponding to all participants who join the target virtual conference. Based on the current position information of the current virtual image in the virtual communication room, it is detected whether there is a target virtual image within a preset distance range of the current virtual image. If there is at least one target virtual image, a range communication group discussion group is generated based on the current participant and the target participant corresponding to the at least one target virtual image; the communication message generated by the current participant is received, and the communication message is sent to each target participant end in the range communication group discussion group to realize range communication. It can be seen that the display device 200 can realize that within a certain social range, participants can freely communicate with other participants anywhere and at any time, and the user experience is good.

[0227] FIG18 shows a flow chart of a method for implementing range communication in a virtual meeting performed by a server according to some embodiments. A server provided in an embodiment of the present application, applied to a business server, includes a processor. When executing the method for implementing range communication in a virtual meeting shown in FIG18 , the processor is configured to perform the following steps:

[0228] S21. In response to a creation request sent by a display device and carrying creation request parameters, a virtual conference is created based on the creation request parameters, where the creation request parameters include at least one of a conference name, a conference start time, a conference end time, a conference scene ID, and a maximum number of participants.

[0229] Referring again to the virtual conference creation sequence diagram shown in Figure 3 and the conference creation interface diagram shown in Figure 4, the administrator sets various parameters for the virtual conference based on the conference creation interface and generates a creation request that is sent to the service server. The administrator's implementation of setting various parameters for the virtual conference can be found in the aforementioned information provided by the display device and is not detailed here.

[0230] In some embodiments, the processor of the service server, in response to the creation request carrying the creation request parameters sent by the display device 200 and creating the virtual conference based on the creation request parameters, is further configured to:

[0231] Step 211: In response to receiving the creation request, verify the creation request parameters carried in the creation request.

[0232] Step 212: If the creation request parameter verification passes, a conference number is generated based on preset rules.

[0233] Step 213: Send a message group creation request carrying the conference number to the instant messaging server. The message group creation request is used to instruct the instant messaging server to create a virtual conference based on the conference number. The virtual conference includes a group discussion group with a group code.

[0234] Step 214: Receive the group code of the group discussion group sent by the instant messaging server, and generate the meeting information of the virtual meeting in combination with at least one of the meeting number, meeting name, meeting start time, meeting end time, meeting scene ID and the maximum number of participants, and store the meeting information of the virtual meeting in the database.

[0235] The business server verifies the validity of the creation request parameters carried in the creation request sent by the administrator. If the verification passes, a meeting number is generated based on preset rules.

[0236] In some embodiments, the meeting number can be an 11-digit string, and the preset generation rule is ${1}${yyMMdd}${four-digit random number}. The first digit is the system environment identifier, which is used to distinguish multi-environment deployments (1-online environment, 2-test environment, etc.), the middle 6 digits are the year and date, followed by a 4-digit random number. According to this rule, the system environment identifier, the current year and date, and the multi-digit random number are used in order to generate the meeting number to be verified. The meeting number to be verified is compared with the meeting number of the historical virtual meeting. If the meeting number to be verified is consistent with the meeting number of one of the historical virtual meetings, the preset characters are added to the end of the meeting number to be verified to generate the meeting number. If the meeting number to be verified is inconsistent with the meeting number of any historical virtual meeting, the meeting number to be verified is used as the meeting number. In this way, a unique meeting number can be obtained.

[0237] The service server requests the instant messaging server to create a group discussion group based on the conference ID, thereby obtaining a virtual conference. The virtual conference includes a group discussion group with a group code. The group discussion group is displayed as a virtual communication room in the virtual conference interface of the participant. Through the virtual communication room (group discussion group), all participants in the target virtual conference can communicate.

[0238] When password verification is not required, the service server generates meeting information for the virtual meeting based on at least one of the meeting number, meeting name, group code, meeting start time, meeting end time, meeting scenario ID, and the maximum number of participants. When password verification is required, the service server generates meeting information for the virtual meeting based on at least one of the meeting number, meeting name, meeting password, group code, meeting start time, meeting end time, meeting scenario ID, and the maximum number of participants.

[0239] Finally, the business server stores the virtual meeting information in the database and returns a successful meeting creation notification to the administrator.

[0240] In some embodiments, the processor of the server is further configured to:

[0241] Step 215: Start a scheduled scanning task, which is used to monitor the status of the virtual conference.

[0242] Step 216: In response to the scheduled scanning task scanning finding that the current time reaches the meeting start time, the state of the virtual meeting is set to an ongoing state, and detailed meeting information of the virtual meeting is generated based on the meeting information.

[0243] Step 217: Store the meeting details of the virtual meeting in the cache server.

[0244] When a password is required to join the meeting, the meeting details include at least one of the following: meeting name, meeting start time, meeting end time, meeting scenario ID, meeting number, group code, and maximum number of participants. When a password is not required to join the meeting, the meeting details include at least one of the following: meeting name, meeting password, meeting start time, meeting end time, meeting scenario ID, meeting number, group code, and maximum number of participants.

[0245] Different virtual conferences have different meeting start times. To change the status of each virtual conference in a timely manner, the business server monitors it through a scheduled scanning task.

[0246] If the scheduled scanning task scans to the current time but does not reach the meeting start time, the status of the virtual meeting is set to the not started state; if the scheduled scanning task scans to the current time but reaches the meeting start time, the status of the virtual meeting is set to the ongoing state; if the scheduled scanning task scans to the current time but reaches the meeting end time, the status of the virtual meeting is set to the ended state.

[0247] For ongoing virtual conferences, the service server stores the meeting information in a cache server to facilitate quick access by participants. The cache server offers fast response times, so when a participant requests the service server to join the target virtual conference, the service server can quickly retrieve the meeting details from the cache server and send them to the participant, improving efficiency.

[0248] S22 . In response to the conference participation request carrying the conference participation request parameter sent by the display device, add the participant corresponding to the display device to the participant list corresponding to the virtual conference.

[0249] The participant list includes all participants who have joined the virtual conference. All participants in the participant list are displayed as virtual images in the virtual communication room corresponding to the virtual conference presented by the display device 200. At the same time, all participants who have joined the virtual conference are added to the group discussion group corresponding to the target virtual conference through the instant messaging server for communication.

[0250] Referring again to the timing diagram of participants joining the virtual conference shown in Figure 6 and the interface diagram of the process of joining the target virtual conference through the conference password shown in Figure 9, when the participant applies to join the target virtual conference in the virtual conference interface, the joining conference interface of the business server is called. After the business server verifies the joining request parameters in the joining request, the participant is added to the target virtual conference.

[0251] When no password is required to join the meeting, the meeting request parameters include at least one of the user ID and the virtual meeting number. When password verification is required to join the meeting, the meeting request parameters include at least one of the user ID, the joining password and the virtual meeting number.

[0252] In some embodiments, the processor of the server, in response to the conference request sent by the display device and carrying the conference request parameter, adds the participant corresponding to the display device to the participant list corresponding to the virtual conference, and is further configured to:

[0253] Step 221: In response to receiving the conference joining request, verify the conference joining request parameters carried in the conference joining request, where the conference joining request parameters also include a conference joining password.

[0254] Step 222: If the conference request parameter verification passes, the detailed conference information of the virtual conference is obtained from the cache server based on the conference number, and the conference password generated by the participant is verified to be correct.

[0255] Step 223: If the password generated by the participant is entered correctly, the participant will be added to the participant list of the virtual meeting, and a successful joining notification and meeting details of the virtual meeting will be sent to the participant's display device 200, so that the participant's display device 200 will display the corresponding virtual meeting interface based on the meeting details of the virtual meeting in response to the successful joining notification. The virtual meeting interface includes a virtual communication room and virtual images of all participants located in the virtual communication room.

[0256] The business server first verifies whether the parameters of the conference request are legal. If not, it will not respond to the conference request and the participant will not join the target virtual conference. If it is legal, the business server obtains the conference details of the target virtual conference from the cache server based on the conference number.

[0257] Next, the service server verifies the correctness of the participant's entry password by comparing it with the conference password set by the administrator when creating the virtual conference. If the passwords do not match, the entry password verification is incorrect, and the service server will not join the participant to the target virtual conference. A notification indicating failed entry will be sent to the participant. If they match, the entry password verification is correct, and the service server will join the participant to the target virtual conference. A notification indicating successful entry and meeting details will be sent to the participant. Simultaneously, the service server sends a notification regarding the current participant's entry to other participants who have also joined the target virtual conference via the instant messaging server.

[0258] Referring again to Figure 10, a sequence diagram illustrating how to implement range communication in a virtual communication room, the service server adds the participant to the participant list of the target virtual conference. The participant's avatar is then displayed in the participant's virtual conference interface. The service server obtains the participant's location information within the virtual communication room and sends this information to the cache server for storage. To facilitate simultaneous rendering of the participant's avatar in their respective virtual conference interfaces on other participant terminals, the service server retrieves the participant's location information from the cache server and, in combination with the user ID and user name, generates a conference join notification.

[0259] The joining notification is generated by the business server based on the user identification, user name and location information corresponding to the participant. The other participant display device 200 responds to the joining notification, updates the local participant list of the other participant display device, and renders the virtual image of the participant in the virtual conference interface presented by the other participant display device 200.

[0260] Based on the participant's request and after verification, the business server adds the participant to the participant list. All participants corresponding to all participant terminals are displayed as avatars in the virtual communication room corresponding to the virtual conference presented by their respective display devices 200. Each participant can communicate with other participants within a preset distance range based on the current location information of the avatar of the participant in the virtual communication room. The details of implementing range communication on the participant terminal can be referred to the corresponding content provided in the above embodiment of the display device 200 and will not be repeated here.

[0261] The embodiment of the present application provides a server that responds to a creation request with creation request parameters sent by the display device 200, creates a virtual conference based on the creation request parameters; responds to a participation request with participation request parameters sent by the display device 200, adds the participant corresponding to the display device 200 to the participant list (group discussion group) corresponding to the virtual conference, and the participant list (group discussion group) includes all participants who have joined the virtual conference. All participants in the participant list are displayed in the virtual communication room corresponding to the virtual conference presented by the display device 200 in the form of virtual images. Each participant can communicate with other participants who meet the preset distance range based on the current location information of the virtual image of the entity in the virtual communication room, so that within a certain social range, participants can freely communicate with other participants anywhere and at any time, and the user experience is good.

[0262] FIG19 shows another flow chart of a method for implementing range communication in a virtual meeting executed by a server according to some embodiments. The server provided in an embodiment of the present application is applied to an instant messaging server and includes a processor. When executing the method for implementing range communication in a virtual meeting shown in FIG19 , the processor is configured to perform the following steps:

[0263] S31. In response to the conference participation request sent by the display device, add the designated participant corresponding to the display device to the group discussion group corresponding to the target virtual conference.

[0264] The group discussion group includes all participants who have joined the target virtual conference. The designated participants refer to the current participants used in the display device embodiment and the business server embodiment.

[0265] Referring again to the sequence diagram of a participant joining a virtual conference shown in FIG6 , after the service server allows a designated participant to join the target virtual conference, the display device uses the group code to add the designated participant to the group discussion group corresponding to the target virtual conference via the instant messaging server. The process of the instant messaging server creating the group discussion group corresponding to the target virtual conference can be found in the aforementioned service server embodiment and will not be further described here.

[0266] S32: Receive a communication message generated by a designated participant and sent by the display device, where the communication message carries a communication identifier.

[0267] Designated participants can communicate based on the virtual conference interface presented by their display device. Communication methods can include local communication and full-field communication. Communication messages generated by the display device may carry a local communication identifier or a full-field communication identifier. Based on the communication message sent by the designated participant, the instant messaging server identifies the communication identifier type carried in the message and sends the message to the corresponding other participant terminals based on the different communication identifier types.

[0268] S33: If the communication identifier is a range communication identifier, the communication message generated by the designated participant is sent to at least one target participant terminal in the range communication discussion group having the same range communication identifier.

[0269] The range communication discussion group includes a designated participant and at least one target participant who is within a preset distance range from the designated participant.

[0270] Referring again to FIG. 10 , a timing diagram illustrating implementing a range communication in a virtual communication room, if the instant messaging server recognizes a range communication identifier in a communication message sent by the display device, indicating that the designated participant is a member of the range communication, the communication message is a range communication message. The instant messaging server then sends the range communication message to other participants in the same range communication discussion group as the designated participant, but not to participants who are not in the same range communication discussion group as the designated participant.

[0271] S34. If the communication identifier is a full-field communication identifier, the communication message generated by the designated participant is sent to all participant terminals of the group discussion group corresponding to the full-field communication identifier.

[0272] If the instant messaging server recognizes the full-room communication identifier in the communication message sent by the display device, it means that the designated participant is a member of the full-room communication and the communication message is a full-room communication message. Then, the instant messaging server sends the full-room communication message to all participants in the same group discussion group as the designated participant.

[0273] The implementation process of specifying the participant end to generate a range communication discussion group and generate communication messages carrying different communication identifiers can refer to the contents disclosed in the aforementioned display device embodiment and business server embodiment, which will not be repeated here.

[0274] In some embodiments, the business server and the instant messaging server can be two relatively independent servers, or the business server and the instant messaging server can be the same central server. The central server can implement the process of creating a virtual meeting and implementing conference communication, which can be referred to the content disclosed in the aforementioned business server embodiment and instant messaging server embodiment, and will not be repeated here.

[0275] The embodiment of the present application provides a server, which responds to the conference request sent by the display device 200, adds the designated participant corresponding to the display device to the group discussion group corresponding to the target virtual conference, receives the communication message generated by the designated participant sent by the display device, and if the communication message carries a range communication identifier, sends the communication message to at least one target participant end in the range communication discussion group with the same range communication identifier; if the communication message carries a full-field communication identifier, sends the communication message to all participant ends of the group discussion group corresponding to the full-field communication identifier. It can be seen that the instant messaging server can send the communication message to the corresponding participant end based on the different communication identifiers carried in the communication message, so as to realize the full-field communication and / or range communication of the participants, and realize that within a certain social scope, the participants can freely communicate with other participants anywhere and at any time, and the user experience is good.

[0276] FIG5 shows a flow chart of a method for implementing range communication in a virtual meeting by a display device according to some embodiments. As shown in FIG5 , the present application also provides a method for implementing range communication in a virtual meeting, which is applied to a display device 200 and includes:

[0277] S11. Receive an operation from a current participant to join a target virtual conference, request the server to add the current participant to a group discussion group corresponding to the target virtual conference, and display a virtual conference interface of the target virtual conference, wherein the group discussion group includes all participants who have joined the target virtual conference, and the virtual conference interface includes a virtual communication room corresponding to the group discussion group and virtual avatars corresponding to all participants in the group discussion group, wherein the virtual avatars corresponding to all participants are displayed in the virtual communication room;

[0278] S12. Based on the current position information of the current virtual image in the virtual communication room, detecting whether there is a target virtual image within a preset distance range of the current virtual image, the current virtual image being the virtual image of the current participant, and the target virtual image being the virtual image of a target participant in the group discussion group;

[0279] S13. If there is at least one target virtual image within a preset distance range of the current virtual image, filter out the target participants corresponding to the current participant and the at least one target virtual image from the group discussion, and generate a range communication discussion group;

[0280] S14: Receive the communication message generated by the current participant, and send the communication message to each target participant in the range communication discussion group.

[0281] Figure 18 shows a flow chart of a method for implementing range communication in a virtual meeting by a server according to some embodiments. As shown in Figure 18, the present application also provides a method for implementing range communication in a virtual meeting, which is applied to a business server, and the method includes:

[0282] S21. In response to a creation request sent by a display device and carrying creation request parameters, create a virtual conference based on the creation request parameters, where the creation request parameters include at least one of a conference name, a conference start time, a conference end time, a conference scenario ID, and a maximum number of participants;

[0283] S22. In response to a participation request sent by a display device and carrying participation request parameters, the participant corresponding to the display device is added to a participant list corresponding to the virtual conference, wherein the participation request parameters include at least one of a user identifier and a conference number of the virtual conference, and the participant list includes all participants who have joined the virtual conference. All participants in the participant list are displayed in the form of virtual images in a virtual communication room corresponding to the virtual conference presented by the display device, and each of the participants can communicate with other participants who meet a preset distance range based on the current position information of the virtual image of the body in the virtual communication room.

[0284] Figure 19 shows another flow chart of a method for implementing a range communication in a virtual meeting executed by a server according to some embodiments. As shown in Figure 19, the present application also provides a method for implementing a range communication in a virtual meeting, which is applied to an instant messaging server, and the method includes:

[0285] S31. In response to a conference joining request sent by a display device, adding a designated participant corresponding to the display device to a group discussion group corresponding to a target virtual conference, where the group discussion group includes all participants who have joined the target virtual conference;

[0286] S32: receiving a communication message generated by a designated participant and sent by the display device, wherein the communication message carries a communication identifier;

[0287] S33. If the communication identifier is a range communication identifier, sending the communication message generated by the designated participant to at least one target participant in a range communication discussion group having the same range communication identifier, where the range communication discussion group includes the designated participant and at least one target participant within a preset distance range from the designated participant.

[0288] S34. If the communication identifier is a full-field communication identifier, the communication message generated by the designated participant is sent to all participant terminals of the group discussion group corresponding to the full-field communication identifier.

[0289] In a specific implementation, the present application further provides a non-volatile computer-readable storage medium, wherein the non-volatile computer-readable storage medium may store a program that, when executed, may include some or all of the steps of each embodiment of the method for implementing range communication in a virtual meeting provided in the present application. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0290] Those skilled in the art will clearly understand that the technology in the embodiments of the present application can be implemented by means of software plus a necessary general-purpose hardware platform. Based on this understanding, the technical solutions in the embodiments of the present application, or the portion that contributes to the prior art, can be embodied in the form of a software product, which can be stored in a non-volatile computer-readable storage medium.

[0291] In this specification, references to the same or similar parts between the various embodiments are sufficient. In particular, the embodiment of the method for implementing range communication in a virtual meeting is relatively simple to describe because it is basically similar to the display device and server embodiment. For relevant parts, references to the description of the display device and server embodiment are sufficient.

[0292] In addition to the above embodiments, this application also provides other embodiments to implement a scenario where a terminal device and a display device are in a joint screen training scenario, where the display device sends performance parameters to the mobile terminal and receives training video data matched by the mobile terminal based on the performance parameters of the display device, so that the display device can play the training video and the training video normally under the performance of the current device, thereby preventing the video played by the display device from being stuck or stopped. The specific details are as follows:

[0293] FIG20 shows a hardware configuration block diagram of a display device 200 in an exemplary embodiment. As shown in FIG20 , the display device 200 includes a tuner / demodulator 210, a communication interface 220, a detector 230, an external device interface 240, a processor 250, a display 260, an audio output interface 270, a memory, a power supply, and the like. The processor 250 includes a central processing unit (CPU), a video processor, an audio processor, a graphics processor, RAM, ROM, and first to nth interfaces for input / output. The display 260 can be at least one of a liquid crystal display (LCD), an OLED display, a touchscreen display, and a projection display, and can also be a projection device and projection screen. The tuner / demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals. The detector 230 is used to collect signals from the external environment or external interactions. The processor 250 and the tuner / demodulator 210 may be located in different separate devices, that is, the tuner / demodulator 210 may also be located in an external device of the main device where the processor 250 is located, such as an external set-top box.

[0294] In some embodiments, the processor 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The processor 250 controls the overall operation of the display device 200. A user can enter user commands through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input commands through the graphical user interface (GUI). Alternatively, the user can enter user commands by inputting specific sounds or gestures, and the user input interface recognizes the sounds or gestures through sensors to receive the user input commands.

[0295] an output interface (display 260 and / or audio output interface 270 ), configured to output user interaction information;

[0296] The communication interface 220 is used to communicate with the server 400 or other devices.

[0297] In some embodiments, the display 260 is configured to display a user interface; the processor 250 is configured to: obtain a training video identifier and a follow-up training page identifier; determine the follow-up training page data corresponding to the follow-up training page identifier, and obtain the corresponding training video data from the server according to the training video identifier; obtain the target performance parameters of the display device, the target performance parameters including: CPU occupancy rate, and / or memory occupancy rate; control the communication interface to send the target performance parameters to the mobile terminal; receive the follow-up training video data sent by the mobile terminal that matches the target performance parameters, the follow-up training video data including: the target video data collected by the mobile terminal, and / or the target video data collected from the target terminal. The first human skeleton point information obtained from the target video data; controlling the display 260 to display the follow-up practice page based on the follow-up practice page data, the training video data and the follow-up practice video data, wherein the follow-up practice page includes a first window and a second window, the training video data is displayed in the first window, and the follow-up practice video data is displayed in the second window. The communication interface 220 is configured to send the target performance parameters to the mobile terminal; receiving the follow-up practice video data sent by the mobile terminal that matches the target performance parameters, the follow-up practice video data including: the target video data collected by the mobile terminal, and / or the first human skeleton point information obtained from the target video data.

[0298] In some embodiments, when the target performance parameter is less than or equal to the first preset performance parameter, the follow-up video data includes: the target video data collected by the mobile terminal, and the first human skeleton point information obtained from the target video data. The processor 250 is further configured to: obtain the second human skeleton point information from the training video data; generate evaluation information based on the matching parameters between the first human skeleton point information and the second human skeleton point information; and display the target video data and the evaluation information in the second window.

[0299] In some embodiments, when the target performance parameter is greater than the second preset performance parameter, the follow-up training video data includes: first human skeleton point information obtained from the target video data, excluding the target video data processor 250, and is also configured to: generate virtual follow-up training video data based on the first human skeleton point information, the virtual follow-up training video data including a virtual human follow-up training screen; and display the virtual follow-up training video data in the second window.

[0300] In some embodiments, the processor 250 is further configured to: obtain second human skeleton point information from the training video data; generate evaluation information based on the matching parameters between the first human skeleton point information and the second human skeleton point information; and display the virtual follow-up video data and the evaluation information in the second window.

[0301] FIG21 shows a hardware configuration block diagram of a mobile terminal 300 in an exemplary embodiment. As shown in FIG21 , the mobile terminal 300 includes: a processor 110, a detector 120, a communication interface 130, a user input / output interface (also referred to as a user interface) 140, a display 150, as well as a memory, a power supply, etc. The communication interface 130 is used for external communication and includes at least one of a WIFI chip, a Bluetooth module, NFC, or an alternative module. The user interface 140 includes at least one of a microphone, a speaker, a touchpad, a sensor, a camera, or an alternative module. The display 150 is used to display a user interface.

[0302] As an optional implementation of the embodiment of the present application, the detector 120 is configured to: collect target video data; the processor 110 is configured to: control the communication interface to send follow-up video data that matches the target performance parameters to the display device, and the follow-up video data includes: target video data collected by the mobile terminal, and / or, the first human skeleton point information obtained from the target video data; the communication interface 130 is configured to: receive the target performance parameters sent by the display device, and the target performance parameters include: CPU occupancy rate, and / or memory occupancy rate. As an optional implementation of the embodiment of the present application, the user interface 140 is configured to: receive the user's joint screen follow-up operation for the training video;

[0303] As an optional implementation of the embodiment of the present application, the processor 110 is configured to: when the target performance parameter is less than or equal to the first preset performance parameter, control the communication interface 130 to send the target video data collected by the mobile terminal and the first human skeleton point information to the display device;

[0304] When the target performance parameter is less than or equal to the second preset performance parameter and greater than the first preset performance parameter, controlling the communication interface 130 to send the target video data collected by the mobile terminal to the display device without sending the first human skeleton point information; and the second preset performance parameter is greater than the first preset performance parameter;

[0305] In a case where the target performance parameter is greater than the second preset performance parameter, the communication interface 130 is controlled to send the first human skeleton point information to the display device, and the target video data is not sent.

[0306] As an optional implementation of the embodiment of the present application, the processor 110 is further configured to: obtain the remaining power of the mobile terminal; control the communication interface 130 to send follow-up video data matching the target performance parameters and the remaining power to the display device.

[0307] As an optional implementation of the embodiment of the present application, the processor 110 is configured to: when the target performance parameter is less than or equal to the first preset performance parameter and the remaining power is greater than or equal to the first preset power parameter, control the communication interface 130 to send the target video data collected by the mobile terminal and the first human skeleton point information to the display device;

[0308] When the target performance parameter is less than or equal to the second preset performance parameter and greater than or equal to the first preset performance parameter, and the remaining power is less than the first preset power parameter and greater than or equal to the second preset power parameter, controlling the communication interface 130 to transmit the target video data captured by the mobile terminal to the display device, and the second preset power parameter is less than the first preset power parameter;

[0309] When the target performance parameter is greater than the second preset performance parameter and the remaining power is less than the second preset power parameter, the communication interface 130 is controlled to send the first human skeleton point information to the display device.

[0310] As an optional implementation of an embodiment of the present application, the follow-up video data includes the first human skeleton point information and does not include the target video data collected by the mobile terminal. The processor 110 is also configured to: control the display screen to display the target video data, and control the brightness of the display screen to be greater than a first preset brightness.

[0311] The follow-up video data includes target video data collected by the mobile terminal. The processor 110 is further configured to: control the brightness of the display screen to be less than or equal to a second preset brightness, or control the display screen to be off.

[0312] As shown in Figure 22, Figure 22 is a schematic diagram of the software configuration of the display device 200 or the mobile terminal 300 according to one or more embodiments of the present application. As shown in Figure 22, the system is divided into four layers, which are respectively the application layer (referred to as "application layer"), the application framework layer (referred to as "framework layer"), the Android runtime and the system library layer (referred to as "system runtime layer"), and the kernel layer from top to bottom. The kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc. The display device, mobile terminal and device performance-based page display method provided in the embodiments of the present application can be implemented based on the above software configuration. Among them, the system can be an Android system.

[0313] As shown in Figure 23, a software interaction diagram of the mobile terminal and display device provided in the embodiment of the present application to implement the page display method based on device performance in the embodiment of the present application is shown. The application framework, system library layer and kernel layer in the mobile terminal can be collectively referred to as the Android system layer. The application framework, system library layer and kernel layer can be collectively referred to as the Android system layer, which can be represented as a mobile terminal APP in Figure 23. The mobile terminal APP includes an APP application layer and a software development kit (Software Development Kit, SDK) layer, wherein the SDK layer includes a playback SDK and an interactive SDK, wherein the playback SDK encapsulates some common playback logic to decouple the upper-layer application from the playback, and the interactive SDK is responsible for the communication and data transmission between the mobile terminal and the display device, and supports the mobile terminal to control the display device. The APP application layer is responsible for completing the user interface (User Interface, UI) display of the follow-up service on the mobile terminal and various interactive operations, and reading the system power from the Android system layer to obtain the power data of the mobile terminal. The application framework, system library layer, and kernel layer in the display device can be collectively referred to as the display device platform layer (which is an Android system customized for the display device and may differ from the Android system of the mobile terminal). In the embodiment of the present application, the application layer can run an application (Application, APP) that provides multimedia resources in the display device, which is shown as the display device APP in Figure 23. The display device APP includes an APP application layer and a software development kit (SDK) layer. The SDK layer includes a playback SDK and an interactive SDK. The playback SDK encapsulates some common playback logic to decouple the upper-layer application from the playback. The interactive SDK is responsible for communication data transmission between the display device and the mobile terminal. The APP application layer is responsible for completing the display of the user interface (UI) of the display device with the training service. It can be seen that the interactive SDK in the APP application layer in the mobile terminal can read the training video data matched by the mobile terminal according to the performance parameters of the display device from the Android system layer, as well as the training video identifier triggered by the user, and send it to the interactive SDK in the APP application layer in the display device. After receiving the data, the display device can display the training page based on the training data.

[0314] In order to illustrate this solution in more detail, the following will be explained in an exemplary manner in conjunction with Figure 24. It can be understood that the steps involved in Figure 24 may include more steps or fewer steps in actual implementation, and the order of these steps may also be different, so as to implement the page display method based on device performance provided in the embodiment of the present application.

[0315] FIG24 is a flow chart of a method for displaying a page based on device performance according to an embodiment of the present application. The method may include but is not limited to the following steps:

[0316] 2401. The mobile terminal receives a user's screen-linked training operation for a training video.

[0317] The above-mentioned training video may be a fitness video or a dance video, etc.

[0318] In an embodiment of the present application, the linked-screen follow-up operation refers to an operation that triggers the display device to enter the linked-screen follow-up mode. In the linked-screen follow-up mode, the media resources selected in the media resource platform (an application that provides multimedia resources) can be played on the display device, and the follow-up video data can be obtained through the mobile terminal and played on the display device. The display device is a device that is on the same WiFi network as the mobile terminal.

[0319] In some embodiments, the mobile terminal may be installed with an application program that provides multimedia resources, and correspondingly, the display device may also be installed with the application program that provides multimedia resources. The training video may be displayed on a page of the application program.

[0320] The user can trigger a joint screen follow-up operation for the training video through an application that provides multimedia resources installed on the mobile terminal. In some embodiments, the application can provide a joint screen follow-up details page for the training video. After the user clicks the "Start" control on the page, the mobile terminal receives the user's joint screen follow-up operation for the training video.

[0321] In the embodiment of the present application, the mobile terminal and the display device can be connected through the same WiFi network.

[0322] 2402. The mobile terminal determines the training video identifier and the training page identifier corresponding to the training video in response to the received linked-screen training operation.

[0323] In the embodiment of the present application, each multimedia resource may be provided with an identifier, and the training video identifier (Video ID) is used to uniquely identify the training video.

[0324] The above-mentioned follow-up practice page identifier is used to indicate the follow-up practice page set based on the training video. The follow-up practice page identifier is a page number (Type Code), which can indicate the follow-up practice playback mode page, where the follow-up practice playback mode page can be a full-screen follow-up practice playback mode page or a non-full-screen follow-up practice playback mode page.

[0325] In some embodiments, in response to a linked-screen follow-up operation received through a user interface, the mobile terminal may determine, in addition to the training video identifier and the follow-up page identifier corresponding to the training video, a media resource identifier (Media ID) corresponding to the training video. The media resource identifier may indicate media information corresponding to the training video, which may include media information such as the title and poster of the training video.

[0326] In some embodiments, the mobile terminal may generate an operation instruction in response to the linked-screen training operation received by the user interface and send it to the display device. The operation instruction includes the above-mentioned training video identifier and the training page identifier.

[0327] In some embodiments, the operation instruction may include the training video identifier, the training page identifier, and the media asset identifier. In some embodiments, the operation instruction may include the Video ID, Type Code, Media ID, and an execution operation (Action).

[0328] Among them, Action is used to indicate the execution of page jump, jumping to the follow-up practice page corresponding to the training video.

[0329] In the case where the above-mentioned operation instruction includes the above-mentioned media resource identifier, after receiving the operation instruction, the display device can display some media resources of the training video while displaying the training video when displaying the follow-up training page.

[0330] 2403. The mobile terminal sends the training video identifier and the follow-up training page identifier to the display device.

[0331] In some embodiments, when the mobile terminal sends the training video identifier and the follow-up training page identifier to the display device, the mobile terminal may send them together to the display device through the same message, or may send them to the display device separately.

[0332] In some embodiments, the display device may obtain the training video identifier and the follow-up training page identifier sent by the mobile terminal.

[0333] In some embodiments, the mobile terminal can first send the training video identifier, the follow-up practice page identifier, and the target video data collected by the mobile terminal to the display device, so that the display device first displays the follow-up practice page according to the training video identifier, the follow-up practice page identifier, and the target video data, and notifies the mobile terminal that the follow-up practice page is successfully displayed. After the mobile terminal receives the notification, the terminal device obtains the target performance data of the display device, and then sends the follow-up practice video data that matches the target performance parameters to the display device.

[0334] In some embodiments, the mobile terminal can also be used only as a camera. In this scenario, an application that provides multimedia resources can be installed on the mobile terminal. Correspondingly, the application that provides multimedia resources can also be installed on the display device. The above-mentioned training video can be displayed on the page of this application. In this scenario, the display device can receive the user's screen-linked practice operation for the training video, and determine the training video identifier, practice page identifier and media asset identifier corresponding to the training video, generate a target QR code based on the training video identifier, practice page identifier and media asset identifier, and display the target QR code. After the mobile terminal scans the target QR code, it can trigger the mobile terminal to obtain the target video data through the camera, and send these target video data to the display device. The display device can determine the practice page data corresponding to the practice page identifier, obtain the corresponding training video data from the server according to the training video identifier, and display the practice page based on the practice page data, training video data and practice video data.

[0335] In some embodiments, the mobile terminal sends the follow-up training video, the training video identifier, the follow-up training page identifier, and the battery data of the mobile terminal to the display device.

[0336] In an embodiment of the present application, the terminal device and the display device establish a data transmission channel through the above-mentioned same WiFi network, and realize the transmission of training video identification, follow-up page identification, target video data, and power data of the mobile terminal through the data transmission channel.

[0337] In some embodiments, the follow-up video data is a continuous video stream transmitted in real time to facilitate display of the local video image on the display device. The power data may be transmitted periodically at predetermined intervals to reduce the load on the mobile device and display device. The predetermined interval may be 3 minutes, 5 minutes, etc., which is much longer than the time between two frames of the follow-up video.

[0338] In some embodiments, the local video captured by the mobile terminal can be directly transmitted to the display device without being displayed on the mobile terminal.

[0339] In some embodiments, after establishing a video transmission connection, the mobile terminal turns off the screen and enables the application that provides multimedia resources (such as a fitness APP) to work in the background, so as to reduce the power consumption of the mobile terminal while achieving local video capture and transmission.

[0340] In some embodiments, the transmission of the local video captured by the mobile terminal (i.e., the transmission of the above-mentioned target video data) and the transmission of the power data are two different transmission channels. For example, video transmission requires encoding and transmitting the video data according to the video format protocol, and the power data can be sent to the display device in the form of a broadcast message.

[0341] 2404. The display device determines the follow-up training page data corresponding to the follow-up training page identifier, and obtains the corresponding training video data from the server according to the training video identifier.

[0342] The server can store various multimedia data corresponding to the multimedia resources in the application. The display device can determine the follow-up training page data in the server according to the follow-up training page identifier, and obtain the corresponding training video data from the server according to the video identifier.

[0343] In some embodiments, the display device may first determine the follow-up practice page data corresponding to the follow-up practice page identifier, and then obtain the corresponding training video data from the server based on the training video identifier. Alternatively, the display device may first obtain the corresponding training video data from the server based on the training video identifier, and then determine the follow-up practice page data corresponding to the follow-up practice page identifier. Alternatively, the display device may simultaneously perform the steps of determining the follow-up practice page data corresponding to the follow-up practice page identifier and obtaining the corresponding training video data from the server based on the training video identifier. This is not limited in the embodiments of the present application. In some embodiments, determining the follow-up practice page data corresponding to the follow-up practice page identifier may include: different page identifiers are set for different pages. After obtaining the follow-up practice page identifier (Type code), the display device may obtain the follow-up practice page data corresponding to the set Type code. The follow-up practice page data may include format information of the follow-up practice page (e.g., color, page size, window size in the page, window position, etc.), layout information of the follow-up practice page, etc. The layout information of the follow-up practice page may indicate the source of data displayed by the first window and the second window. In the embodiment of the present application, it may indicate that the first window is used to display the training video data obtained from the server, and the second window is used to display the follow-up practice video data. After obtaining the practice page data, it can also be combined with the practice video data obtained from the mobile terminal.

[0344] In some embodiments, in the case where the mobile terminal triggers the display device to display the follow-up practice page, when the mobile terminal sends follow-up practice video data to the display device, the display device prioritizes the follow-up practice video data sent by the mobile terminal to be displayed in the second window. If the display device does not receive the follow-up practice video data sent by the mobile terminal, the camera of the display device can be turned on to obtain the follow-up practice video data and display it in the second window.

[0345] Exemplarily, the situation in which the mobile terminal triggers the display device to display the follow-up practice page may include: for example, the mobile terminal receives the user's linked screen follow-up practice operation for the training video, and the mobile terminal responds to the received linked screen follow-up practice operation, collects the follow-up practice video data, and sends it to the display device; for another example, the display device can receive the user's linked screen follow-up practice operation for the training video, and determine the training video identifier, follow-up practice page identifier and media asset identifier corresponding to the training video, generate a target QR code based on the training video identifier, follow-up practice page identifier and media asset identifier, and display the target QR code. After the mobile terminal scans the target QR code, it can trigger the mobile terminal to obtain the follow-up practice video data through the camera, and send these follow-up practice video data to the display device.

[0346] In some embodiments, obtaining corresponding training video data from a server based on a training video identifier may include: different video identifiers and different video data are correspondingly stored in the server. After obtaining the training video identifier, the server can determine whether the training video identifier exists from the stored video identifiers. If so, the server further obtains the training video data stored corresponding to the training video identifier.

[0347] In some embodiments, the corresponding training video data can also be obtained from the server in combination with the media asset identifier and the training video identifier corresponding to the training video. The server also stores different media asset identifiers and media asset information in correspondence. The media asset information includes media information (for example, titles, posters, and other media information) and multiple video data. After the server obtains the media asset identifier corresponding to the training video, it can first determine whether the media asset identifier corresponding to the training video exists in the stored media asset identifiers. If so, it can further determine the video data stored corresponding to the training video identifier from multiple video data as the training video data based on the training video identifier.

[0348] 2405. The display device obtains target performance parameters.

[0349] Target performance parameters include: CPU usage, and / or memory usage. Among them, CPU is the abbreviation of Central Processing Unit. The central processing unit is a very large-scale integrated circuit, which is the computing core and control core of a computer. Its main function is to interpret computer instructions and process data in computer software. The central processing unit mainly includes an arithmetic unit and a cache memory, as well as a data, control and status bus that connects them. It is collectively referred to as the three core components of an electronic computer together with the internal memory and input / output devices. The CPU relies on instructions from the computing and control system. Each CPU is designed with a series of instruction systems that match its hardware circuits. The strength of instructions is also an important indicator of the CPU. The instruction set is one of the most effective tools to improve the efficiency of the microprocessor.

[0350] Memory, also known as internal memory or main memory, is a crucial component of a computer. It temporarily stores data processed by the CPU and exchanges data with external storage devices such as hard drives. It serves as a bridge between external memory and the CPU. All computer programs run in memory, and memory performance impacts the overall performance of the computer. As soon as the computer starts running, the operating system transfers data from memory to the CPU for computation. Once the computation is complete, the CPU transmits the results. The performance of memory determines the overall speed of the computer. A memory module consists of memory chips, circuit boards, and gold fingers.

[0351] In some embodiments, the display device obtains performance parameters based on the Android system's getprop and dumpsys commands. The getprop command simply reads configuration and performance information from various system configuration files. When the Android system boots, a large number of services are started. The dumpsys command can be used to monitor the operating status of each service and determine the display device's performance parameters based on the service's operating status.

[0352] 2406. The display device sends the target performance parameters to the mobile terminal.

[0353] In some embodiments, the display device obtains performance data once every preset collection time and sends it back to the mobile terminal. When the mobile terminal detects a change in the power level or performance status of the display device, it dynamically adjusts the follow-up video data sent to the display device. The above-mentioned preset collection time can be 5s or 10s, which is not limited in the embodiments of the present application. The value of the preset collection time can be set and determined according to actual needs.

[0354] 2407. The mobile terminal receives the target performance parameters sent by the display device.

[0355] 2408. The mobile terminal sends the follow-up training video data that matches the target performance parameters to the display device.

[0356] In some embodiments, the mobile terminal determines, based on the target performance parameters, follow-up training video data that matches the target performance parameters. In one embodiment, the follow-up training video data includes: the target video data captured by the mobile terminal and the first human skeletal point information obtained from the target video data; in another embodiment, the follow-up training video data includes: the target video data captured by the mobile terminal and the first human skeletal point information obtained from the target video data; in yet another embodiment, the follow-up training video data includes: the target video data captured by the mobile terminal and the first human skeletal point information obtained from the target video data.

[0357] In some embodiments, when the target performance parameter is less than or equal to the first preset performance parameter, it indicates that the current performance of the display device is relatively high. At this time, the control communication interface sends the target video data collected by the mobile terminal and the first human skeleton point information to the display device.

[0358] The first preset parameter is a performance threshold value configured for the mobile terminal, and the first preset performance parameter includes a preset CPU occupancy parameter and a memory occupancy parameter.

[0359] For example, if the first preset parameters set by the mobile terminal show that the CPU occupancy is 40% and the memory occupancy is 400MB, and the target performance parameters received by the mobile terminal show that the CPU occupancy is 30% and the memory occupancy is 300MB, it can be seen through comparison that the target performance parameters are less than the first preset performance parameters. At this time, the mobile terminal sends the target video and the first human skeleton point information to the display device.

[0360] In the above embodiment, when the target performance parameter is less than the first preset parameter, it means that the performance of the current display device is relatively high. At this time, the display device can normally display the follow-up video data containing a large amount of data information. Then the follow-up video data that matches the target performance parameter includes: target video data and the first human skeleton point information. In this way, while ensuring that the video picture played by the display device will not be stuck or stopped during the linked screen follow-up process, the integrity of the video picture can be guaranteed to the greatest extent. That is to say, in the subsequent linked screen follow-up page process, the picture generated based on the target video data can be played, and the picture generated based on the first human skeleton point information can also be played.

[0361] In some embodiments, when the target performance parameter is less than or equal to the second preset performance parameter and greater than the first preset performance parameter, the communication interface is controlled to send the target video data collected by the mobile terminal to the display device; wherein the second preset performance parameter is greater than the first preset performance parameter.

[0362] For example, if the second preset performance parameters set by the mobile terminal are that the CPU occupancy is 50% and the memory occupancy is 500MB, and the target performance parameters received by the mobile terminal are that the CPU occupancy is 45% and the memory occupancy is 450MB, it can be seen from the comparison that at this time the target performance parameters are less than or equal to the second preset performance parameters, and the mobile terminal sends the target video data to the display device.

[0363] In the above embodiment, when the target performance parameter is less than or equal to the second preset performance parameter and greater than the first preset performance parameter, it indicates that the current display device has moderate performance. At this point, the display device can normally display the follow-up training video data containing a large amount of data information. The follow-up training video data that matches the target performance parameter includes the target video data. This ensures that the video playback on the display device does not freeze or stop during the linked-screen follow-up training process, while also ensuring the integrity of the video image to the greatest extent possible.

[0364] In some embodiments, when the target performance parameter is greater than the second preset performance parameter, the communication interface is controlled to send the first human skeleton point information to the display device.

[0365] For example, if the third preset performance parameters set by the mobile terminal include a CPU occupancy rate of 60% and a memory occupancy rate of 600MB, and the target performance parameters received by the mobile terminal include a CPU occupancy rate of 85% and a memory occupancy rate of 700MB, it can be seen through comparison that the target performance parameters are greater than the third preset performance parameters. At this time, it can be considered that the performance of the display device is low, and the mobile terminal only sends the first human skeleton point information to the display device.

[0366] At this point, the display device can normally display the training video data containing less data information. The training video data that matches the target performance parameter includes the first human skeletal point information. This ensures that the video playback on the display device does not freeze or stop during the linked-screen training, while also ensuring the integrity of the video image to the greatest extent possible.

[0367] In the above embodiment, when the target performance parameter is greater than the second preset performance parameter, it can indicate that the current display device performance is insufficient. In this case, the display device can normally display the follow-up training video data containing less data information. The follow-up training video data that matches the target performance parameter then includes: the first human skeletal point information. This ensures that during the linked-screen follow-up training, when the display device performance is insufficient, the video playback of the display device will not freeze or stop.

[0368] In some embodiments, before sending the follow-up video data to the display device, the mobile terminal will also obtain the remaining power of the mobile terminal. The mobile terminal matches the follow-up video data according to the remaining power of the mobile terminal and the target performance parameters of the display device and sends it to the display device.

[0369] In some embodiments, the mobile terminal can obtain power data of the mobile terminal through the battery management module (Battery Manager) in the Android system layer. The power data may include the remaining power and the remaining power percentage or the remaining power percentage. For example, the remaining power can be expressed as: 1000mA remaining power, and the remaining power percentage can be expressed as: 20% remaining power.

[0370] In some embodiments, when the target performance parameter is less than or equal to the first preset performance parameter and the remaining power of the mobile terminal is greater than or equal to the preset first power parameter, the control communication interface sends the target video data collected by the mobile terminal and the first human skeleton point information to the display device.

[0371] The first preset power parameter may be expressed as a percentage, such as 20%, which is not limited in the embodiment of the present application. The value of the first preset power parameter may be determined according to actual needs.

[0372] That is to say, in the above situation, it can be considered that the display device has high performance and the mobile phone has sufficient power, which means that the display device can receive follow-up video data containing a large amount of information. At this time, the mobile terminal can determine the follow-up video data to be sent to the display device based on the performance parameters of the current display device and the remaining power of the mobile terminal. The follow-up video data that matches the target performance parameters include: target video data collected by the mobile terminal, and the first human skeleton point information. In this way, while ensuring that the video screen played by the display device will not be stuck or stopped during the joint screen follow-up process, the integrity of the video screen can be guaranteed to the greatest extent. That is to say, in the subsequent joint screen follow-up page process, the screen generated based on the target video data can be played, and the screen generated based on the first human skeleton point information can also be played.

[0373] In some embodiments, when the target performance parameter is less than or equal to the second preset performance parameter, and the target performance parameter is greater than or equal to the first preset performance parameter, and the remaining power of the mobile terminal is greater than or equal to the second preset power parameter, the communication interface is controlled to send the target video data collected by the mobile terminal to the display device, wherein the second preset power parameter is less than the first preset power parameter.

[0374] That is, in the above situation, it can be assumed that the display device has medium performance and the mobile terminal has a relatively sufficient battery. The mobile terminal can determine the follow-up training video data to send to the display device based on the current performance parameters of the display device and the battery level of the mobile terminal. In this case, the follow-up training video data that matches the target performance parameters includes the target video data. This ensures that during the joint screen follow-up training process, the display device receives the follow-up training video data and displays it normally under the current performance parameters.

[0375] In some embodiments, when the target performance parameter is greater than the third preset performance parameter and the remaining power of the mobile terminal is less than or equal to the second preset power parameter, the communication interface is controlled to send the first human skeleton point information to the display device.

[0376] That is, in the above situation, it can be considered that the remaining power of the mobile terminal is insufficient and the performance of the display device is low. The mobile terminal can determine the follow-up video data to be sent to the display device based on the current performance parameters of the display device and the power level of the mobile terminal. In this case, the follow-up video data only includes the first human skeleton point information obtained from the target video data. The display device receives the follow-up video data and displays the follow-up video data normally under the current performance parameters. This ensures that the display device will not stop or freeze during video playback.

[0377] In some embodiments, when the follow-up video data sent by the mobile terminal to the display device only includes the first human skeleton point information and does not include the target video data collected by the mobile terminal, the display screen of the mobile terminal displays the target video data and controls the brightness of the display screen to be greater than the first preset brightness, wherein the first preset brightness is a screen brightness parameter set by the mobile terminal, which is not limited in the embodiment of the present application, and the value of the first preset brightness can be set and determined according to actual needs. In other words, when the target follow-up video data received by the display device only includes human skeleton point information, the display device follow-up page displays the virtual person follow-up picture, the mobile terminal adjusts the screen brightness, and the user can watch the real person follow-up picture captured by the camera on the display screen of the mobile terminal.

[0378] In some embodiments, when the follow-up training video data transmitted by the mobile terminal to the display device includes target video data captured by the mobile terminal, the mobile terminal controls the brightness of the display screen to be less than or equal to a second preset brightness, or controls the mobile terminal display screen to be turned off, where the first preset brightness is greater than the second preset brightness. In other words, in this case, the display device's follow-up training page displays the live follow-up training video data, and the user watches the live follow-up training video on the display device, while the mobile terminal reduces the screen brightness or turns off the screen to save power.

[0379] 2409. The display device receives the follow-up training video data that matches the target performance parameters and is sent by the mobile terminal.

[0380] In some embodiments, the follow-up video data includes target video data collected by the mobile terminal, and / or first human skeleton point information obtained from the target video data.

[0381] In some embodiments, when the follow-up video data received by the display device is obtained from the target video data and the first human skeleton point information, the display device generates real-person follow-up video data based on the target video data and the first human skeleton point information, wherein the real-person video data includes: the real-person follow-up picture captured by the camera and the evaluation information of the follow-up.

[0382] In some embodiments, when the follow-up video data received by the display device is target video data, the display device generates real-person follow-up video data based on the target video data, wherein the real-person follow-up video data is a real-person follow-up picture captured by a mobile terminal camera.

[0383] In some embodiments, when the follow-up video data received by the display device is first human skeleton point information obtained from the target video data, the display device generates virtual follow-up video data based on the first human skeleton point information, wherein the virtual follow-up video data includes a virtual human follow-up screen.

[0384] 2410. The display device displays the follow-up practice page based on the follow-up practice page data, the training video data, and the follow-up practice video data.

[0385] The follow-up practice page includes a first window and a second window. The first window displays the training video data, and the second window displays the follow-up practice video data.

[0386] In some embodiments, the display device can first draw the frame portion of the follow-up practice page based on the follow-up practice page data, the training video data and the follow-up practice video data in the process of displaying the follow-up practice page, which includes drawing the first window and the second window in the follow-up practice page, and then drawing the training video data in the first window, and drawing the follow-up practice video data in the second window, so that the complete follow-up practice page can be displayed. It should be noted that the training video data displayed in the first window in the follow-up practice page can be updated as the playback progress of the training video, and the content displayed in the second window in the follow-up practice page can be updated according to the follow-up practice video data obtained from the terminal device in real time. In other words, the display device needs to render the follow-up practice page in real time based on the follow-up practice page data, the training video data and the follow-up practice video data, and display the follow-up practice page.

[0387] In the above embodiment, the display device sends target performance parameters to the mobile terminal and receives the follow-up training video data matched by the mobile terminal according to the target performance parameters. Based on the obtained follow-up training video data, the display device determines whether the type of the follow-up training video data is real-person follow-up training video data or virtual follow-up training video data. Based on the type of the follow-up training video data, the display device dynamically adjusts the follow-up training screen. Thus, in the scenario of joint screen follow-up training, when the received follow-up training video data changes from real-person follow-up training video data to virtual-person follow-up training video data, if the display device performance is insufficient, the follow-up training screen of the display device is dynamically switched from the real-person follow-up training screen to the virtual-person follow-up training screen. When the received follow-up training video data changes from virtual-person follow-up training video data to real-person follow-up training video data, if the display device performance is high, the follow-up training screen of the display device is switched from the virtual-person follow-up training screen to the real-person follow-up training screen. This enables the display device to play the training video and the follow-up training video simultaneously, preventing freezes or stops during the follow-up training process.

[0388] In some embodiments, after the mobile terminal obtains the target performance parameters of the display device, the application layer of the mobile terminal matches the follow-up video data with the target performance parameters according to the target performance parameters, and sends the follow-up data to the display device, while controlling the display of the screen brightness of the mobile terminal.

[0389] For example, an embodiment of the present application provides a method for displaying a page based on device performance, as shown in FIG25 . The steps of the method include but are not limited to the following steps:

[0390] 701. The mobile terminal receives a user's screen-linked training operation for a training video.

[0391] 702. The mobile terminal determines the training video identifier and the training page identifier corresponding to the training video in response to the received linked-screen training operation.

[0392] 703. The mobile terminal sends the training video identifier and the follow-up training page identifier to the display device.

[0393] 704. The display device determines the follow-up training page data corresponding to the follow-up training page identifier, and obtains the corresponding training video data from the server according to the training video identifier.

[0394] 705. The display device obtains target performance parameters.

[0395] 706. The display device sends the target performance parameter to the mobile terminal.

[0396] 707. The mobile terminal receives the target performance parameters sent by the display device.

[0397] For the description of the above steps 701 to 708, please refer to steps 2401 to 2408 in Figure 24, which will not be repeated here.

[0398] 708. The mobile terminal determines the performance of the display device according to the target performance parameter.

[0399] In some embodiments, the mobile terminal may determine a performance level corresponding to the performance of the display device according to target performance parameters of the display device, for example, high level, medium level, or low level.

[0400] Exemplarily, when the target performance parameter is less than or equal to the first preset performance parameter, and the mobile terminal sends the target video data collected by the mobile terminal and the first human skeleton point information to the display device, the corresponding performance level of the display device is advanced.

[0401] Exemplarily, when the target performance parameter is less than or equal to the second preset performance parameter and greater than the first preset performance parameter, the mobile terminal sends the target video data collected by the mobile terminal to the display device; when the second preset performance parameter is greater than the first preset performance parameter, the corresponding performance of the display device is intermediate.

[0402] Exemplarily, when the target performance parameter is greater than the second preset performance parameter, when the mobile terminal sends the first human skeleton point information to the display device, the corresponding performance of the display device is low.

[0403] 709. The mobile terminal sends the target video data and the first human skeleton point information data to the display device.

[0404] In some embodiments, when the performance of the display device is determined to be advanced, the mobile terminal sends follow-up video data that matches the target parameters to the display device, that is, executing: step S713: the display device receives the follow-up video data that matches the target performance parameters sent by the mobile terminal; and step S714: the display device displays the tracking page based on the tracking page data, training video data and tracking video data.

[0405] The follow-up training video data includes target video data and first human skeletal point information data. The determination of the follow-up training video data can be referred to above in step 2408 and will not be repeated here. After the mobile terminal sends the follow-up training video data that matches the target parameters, step 712a is executed to reduce the screen brightness of the mobile terminal, thereby saving power on the mobile terminal.

[0406] 710. The mobile terminal sends target video data to the display device.

[0407] In some embodiments, when the performance of the display device is determined to be intermediate, the mobile terminal sends follow-up video data that matches the target parameters to the display device, that is, executing: step S713: the display device receives the follow-up video data that matches the target performance parameters sent by the mobile terminal; and step S714: the display device displays the tracking page based on the tracking page data, training video data and tracking video data.

[0408] The training video data includes target video data. The determination of the training video data is described in step 2408 above and will not be repeated here.

[0409] 711. The mobile terminal sends first human skeleton point information to a display device.

[0410] In some embodiments, when the performance of the display device is determined to be low, the mobile terminal sends follow-up video data that matches the target parameters to the display device, that is, executes: step S713: the display device receives the follow-up video data that matches the target performance parameters sent by the mobile terminal; and step S714: the display device displays the tracking page based on the tracking page data, training video data and tracking video data.

[0411] The follow-up video data is the first human skeleton point information. For the determination of the follow-up video data, refer to the above step 2408 and will not be repeated here.

[0412] 712. Determine the battery level of the mobile terminal.

[0413] In some embodiments, when the performance of the display device is determined to be intermediate, after the mobile terminal launches the follow-up video data that matches the target parameters, the power level of the mobile terminal is determined. When the remaining power of the mobile terminal is sufficient, step 712b is executed to control the mobile terminal screen to always be on. When the remaining power of the mobile terminal is insufficient, step 712a is executed to control the mobile terminal to reduce the screen brightness to save power of the mobile terminal.

[0414] 712a. Reduce the screen brightness of the mobile terminal.

[0415] 712b. Control the mobile terminal screen to remain on.

[0416] In the above embodiment, the screen brightness of the mobile terminal is intelligently controlled according to the power of the mobile terminal and the performance of the display device, thereby realizing intelligent control of the mobile terminal screen and ensuring that when the follow-up video screen generated by the display device based on the first skeleton point information is a virtual person follow-up screen, the real person follow-up screen can be viewed through the mobile terminal. When the follow-up screen in the follow-up window of the display device is a real person follow-up screen, the screen brightness of the mobile terminal is reduced, thereby saving power of the mobile terminal.

[0417] In some embodiments, after obtaining corresponding training video data from a server based on the training video identifier, second human skeletal point information is obtained from the training video screen. The display device generates evaluation information based on matching parameters between the first human skeletal point information and the second human skeletal point information; the evaluation information is used to evaluate the degree of matching between the follow-up movement and the character movement in the training video. The evaluation information can be a special effect or a percentage of a matching parameter, where the matching parameter can be expressed as a percentage. When the matching parameters between the character movement in the training video data and the character movement in the follow-up video are 90%, the follow-up movement can be considered standard, and the evaluation information is displayed in a second window on the follow-up video page.

[0418] In the above embodiment, through the interaction between the mobile terminal and the display device, when the follow-up practice page is displayed, the user can watch the displayed training video data and practice, and the mobile terminal will continue to collect the follow-up practice video data of the user and transmit it to the display device. The display device will display the follow-up practice video data and the training video data together in the display of the display device through different windows, so that the user can compare the training movements in the follow-up practice video data and the training video data, which is convenient for the user to correct the movements.

[0419] As shown in Figure 26, it is a schematic diagram of a skeleton point composition graph provided in an embodiment of the present application. Regarding the degree of matching in terms of skeleton point similarity. As shown in Figure 26, assuming that the first human skeleton point information includes: head skeleton point 81, right arm and shoulder connection skeleton point 82, left arm and shoulder connection skeleton point 83, these three human skeleton points can be connected to form a triangle, and the second human skeleton point information includes: head skeleton point 84, right arm and shoulder connection skeleton point 85, left arm and shoulder connection skeleton point 86, these three human skeleton points can be connected to form another triangle, and the similarity of these two triangles can be calculated as a matching parameter. For example, Figure 26 uses the calculated similarity of 75% as an example for explanation, and "75% accuracy" is displayed in the follow-up practice page as shown in Figure 26 80 to inform the user that the current follow-up practice action has a matching degree of 75% with the standard action in the training video data.

[0420] In the above embodiment, the display device determines the matching parameters of the first human skeleton point information and the second human skeleton point information, and outputs the matching parameters, so that the user who is following the training can view the matching parameters on the screen of the display device, so as to know the degree of matching between himself and the standard movements in the training video data during the following training, thereby improving the human-computer interaction performance during the following training process.

[0421] Figure 27 shows a schematic diagram of a scenario for displaying a follow-up practice page according to an embodiment of the present application. In Figure 27, mobile terminal 92 collects follow-up practice video data and sends it to display device 91. After display device 91 determines the follow-up practice page data and training video data based on the training video identifier and follow-up practice page identifier sent by the mobile terminal, it can display the follow-up practice page on the display screen of display device 91. The follow-up practice page includes two windows, one of which displays training video data 911 and the other displays follow-up practice page data 912.

[0422] As shown in FIG28 , a schematic diagram of a scene for displaying a virtual human training screen provided by an embodiment of the present application is provided. In FIG28 , when the video training data received by the display device is the first skeletal point information obtained from the target video captured by the mobile terminal, the performance of the display device is low at this time. The training video in the second window of the training page is a virtual human training screen generated based on the first skeletal point information. At this time, the screen brightness can be increased on the mobile terminal to view the real-person training screen on the mobile terminal interface. The display device generates evaluation information based on the matching parameters between the first human skeletal point information and the second human skeletal point information. In FIG28 , the title bar 1001 is used to describe the video content of the current joint-screen training, the training video window 1002 is used to display the training video data, the training video window 1003 is used to play the training video data and the evaluation effects of the training, and the prompt window 1004 is used to prompt the user when switching from the real-person training screen to the virtual-person training screen. The prompt message is "The current device performance is insufficient and has automatically switched to the virtual-person training for you."

[0423] In some embodiments, when the mobile terminal has sufficient battery power and the display device performance changes from low to high, the follow-up training video data sent by the mobile terminal switches from the first skeletal point information data to the target video data and the first human skeletal point information. The follow-up training data in the display device's follow-up training window switches from virtual follow-up training video data to real-person follow-up training video data. At this time, the follow-up training screen of the display device switches from the virtual human follow-up training screen to the real-person follow-up training screen, and the user is prompted based on the content of the follow-up training video switch. For example, as shown in FIG29, a prompt scene diagram of a follow-up training page is shown. In FIG29, title bar 1101 is used to describe the current video content of the joint screen follow-up training, training video window 1102 is used to display the training video data, follow-up training video window 1103 is used to play the follow-up training video data and the evaluation effects of the follow-up training, and prompt window 1104 is used to prompt the user when the virtual human follow-up training screen switches to the real-person follow-up training screen. The prompt message is "The current battery is sufficient and the switch to real-person follow-up training has been automatically switched for you." The prompt window can be manually canceled or automatically canceled based on the preset prompt countdown of the display device. The preset prompt countdown can be 10 seconds. The embodiment is not limited thereto, and the value of the preset reminder countdown can be set and determined according to actual needs.

[0424] For example, assuming that the mobile terminal is a mobile phone and the display device is a television (TV), when interacting based on the software interaction diagram shown in Figure 23, it involves the interaction between the mobile phone application layer, the mobile phone interactive SDK, the television application layer and the television interactive SDK. The following is based on the interaction between the mobile phone application layer, the mobile phone interactive SDK, the television application layer and the television interactive SDK to illustrate the page display method based on device performance provided in the embodiment of the present application.

[0425] Figure 30 is an interactive diagram of a method for displaying a page based on device performance provided by an embodiment of the present application. The method includes but is not limited to the following steps:

[0426] 1. The mobile phone receives the user's click operation on the mobile app to enter the linked screen fitness details page and initiates the linked screen fitness.

[0427] In this embodiment, a fitness training scenario is used as an example. The mobile application layer and mobile interaction SDK are set for mobile APPs, while the TV application layer and TV interaction SDK are set for TV APPs.

[0428] 2. After the mobile APP receives the user's operation, it notifies the mobile application layer (i.e., the APP application layer). The mobile application layer calls the data sending (Send Data) interface provided by the mobile interactive SDK to send the operation instruction to the mobile interactive SDK.

[0429] 3. The mobile phone interactive SDK transmits operation instructions to the TV interactive SDK.

[0430] The content of the operation instruction includes: the above-mentioned Media ID, Video Id, Type Code (page number - full-screen practice playback mode page), and Action (execution operation - page jump).

[0431] 4. The TV interactive SDK transmits operation instructions to the TV application layer.

[0432] 5. The application layer on the TV side receives the operation instruction, opens the practice page, and collects target performance parameters such as the CPU usage and memory usage of the TV side at preset collection time intervals.

[0433] 6. The TV application layer continuously transmits the target performance parameters to the TV interaction SDK. The phone interaction SDK receives the target performance parameters and transmits them to the mobile phone interaction SDK.

[0434] 8. After receiving the target performance parameters, the mobile interactive SDK continuously transmits the target performance parameters back to the mobile application layer.

[0435] 9. The mobile phone application layer collects the target video data captured by the camera and obtains the first human skeleton point information in the target video data.

[0436] 10. The mobile application layer obtains the remaining power of the current mobile device through the Android battery management module.

[0437] 11. The mobile application layer determines the performance of the TV device based on the target performance parameters received from the mobile interactive SDK layer.

[0438] 12. After determining the performance of the TV, the mobile application layer intelligently adjusts the screen brightness of the mobile phone according to the remaining power of the mobile phone and / or the performance of the TV.

[0439] For the description of steps 9 to 12 above, please refer to steps 708 to 712, which will not be repeated here.

[0440] 13. The mobile application layer determines the follow-up training video data that matches the target performance parameters based on the target performance parameters and the mobile phone power level, and transmits the follow-up training data to the mobile phone interactive SDK in real time.

[0441] 14. After the mobile interactive SDK receives the follow-up video data sent by the mobile application layer, it transmits the follow-up data to the TV interactive SDK in real time.

[0442] 15. The TV interactive SDK receives the practice video data sent by the mobile interactive SDK, and determines whether to practice with a real person or a virtual person based on the type of the practice video data.

[0443] Among them, when the follow-up video data contains the target video data and the first human skeleton point information collected by the mobile phone camera, or the follow-up video data only contains the target video data collected by the mobile phone camera, the follow-up mode is real-person follow-up; when the follow-up video data only contains the first human skeleton point information, the follow-up mode is virtual-human follow-up.

[0444] In some embodiments, when the follow-up training mode is live training, the mobile phone transmits target video data and first human skeletal point information to the television. The mobile phone encodes the target video data and transmits it to the television. The television needs to re-decode the target video data transmitted by the mobile phone and render it on the display. This consumes a lot of CPU and memory on the television.

[0445] In some embodiments, when the training mode is virtual, the phone only transmits the first human skeleton point information to the TV. The TV does not decode the target video data and only draws a stick figure on the display based on the first human skeleton point information. The drawing area is smaller than the target video data. In this case, the TV's CPU usage and memory usage are low. Furthermore, virtual training can reduce data transmission by over 90% compared to real-person training and reduces the logic of encoding and transmitting the target video data to the TV, which can reduce the phone's power consumption.

[0446] 16. The TV application layer receives the practice mode command sent by the TV interactive SDK in real time, and displays the corresponding practice screen on the practice page according to the practice mode command, and prompts the user when the practice mode is switched.

[0447] In the above embodiment, in the scenario of linked-screen follow-up training, the display device sends target performance parameters to the mobile terminal and receives follow-up training video data that matches the target performance parameters sent by the mobile terminal, so that the display device can play the training video and follow-up training video normally under the performance of the current device, thereby preventing the video played by the display device from being stuck or stopped. Furthermore, during the follow-up training process, the mobile terminal intelligently adjusts the screen brightness to save mobile phone power. And the mobile terminal sends different follow-up training video data according to the performance of the display device, so that the display device can display different follow-up training pictures on the follow-up training page based on the received follow-up training video data that matches the target performance parameters under the current performance.

[0448] An embodiment of the present application provides a computer non-volatile readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the various processes of the device performance-based page display method executed by the above-mentioned mobile terminal and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0449] An embodiment of the present application provides a computer non-volatile readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the various processes of the page display method based on device performance performed by the above-mentioned display device and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0450] The computer non-volatile readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0451] An embodiment of the present application provides a computer program product, which includes a computer program. When the computer program is run on a computer, the computer implements the various processes of the page display method based on device performance performed by the above-mentioned mobile terminal, or implements the various processes of the page display method based on device performance performed by the above-mentioned display device.

[0452] For ease of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are intended to better explain the content of the embodiments of the present application, thereby enabling those skilled in the art to better use the embodiments.

Claims

1. A display device, comprising: a display configured to display images and / or a user interface; a memory configured to store computer instructions and data associated with the display; at least one processor coupled to the display and the memory, the processor being configured to execute computer instructions to cause the display device to: Receiving an operation from a current participant to join a target virtual conference, requesting a server to add the current participant to a group discussion group corresponding to the target virtual conference, and displaying a virtual conference interface of the target virtual conference, wherein the group discussion group includes all participants who have joined the target virtual conference, the virtual conference interface includes a virtual communication room corresponding to the group discussion group and virtual avatars corresponding to all participants in the group discussion group, and the virtual avatars corresponding to all participants are displayed in the virtual communication room; Based on the current position information of the current virtual image in the virtual communication room, detecting whether there is a target virtual image within a preset distance range of the current virtual image, the current virtual image being the virtual image of the current participant, and the target virtual image being the virtual image of the target participant in the group discussion group; If there is at least one target virtual image within a preset distance range of the current virtual image, filtering out the target participants corresponding to the current participant and the at least one target virtual image from the group discussion, and generating a range communication discussion group; Receive the communication message generated by the current participant, and send the communication message to each target participant in the range communication discussion group.

2. The display device according to claim 1 , wherein the processor is further configured to execute computer instructions so that the display device: adding the current participant in the group discussion and the target participant corresponding to the at least one target avatar to a range communication list; receiving a triggering of a speech button in the virtual conference interface by the current participant, and determining whether a range communication switch corresponding to the target virtual conference is turned on; If the range communication switch is in the on state, a speech type dialog box is displayed in the virtual conference interface, the speech type dialog box including a range communication option; A triggering of the range communication option by the current participant is received, and a range communication discussion group corresponding to the range communication list is created through an instant messaging server.

3. The display device according to claim 2, wherein the processor is further configured to execute computer instructions so that the display device: receiving a preset operation triggered by the current participant, and controlling the corresponding current virtual image to move in the virtual communication room; Based on the position information of the current virtual image after movement, a new target virtual image is obtained that enters the preset distance range, and original target participants that are outside the preset distance range are screened from all original target participants corresponding to the communication and discussion group within the range; The new target participant corresponding to the new target virtual image is added to the range communication discussion group, and the original target participant in the range communication discussion group that is outside the preset distance range is removed to update the range communication discussion group.

4. The display device according to claim 3, wherein the processor is further configured to execute computer instructions so that the display device: Obtain the user name of each target participant in the scope communication list; The user name of each target participant is displayed on each target virtual image in the virtual communication room, and the user name of the target virtual image corresponding to the original target participant removed from the range communication list is canceled.

5. The display device according to claim 2, wherein when the processor receives the communication message generated by the current participant and sends the communication message to each target participant in the range communication discussion group, the processor is further configured to execute computer instructions so that the display device: receiving a range communication message generated by the current participant, wherein the range communication message carries the range communication identifier of the range communication discussion group, and each participant in the same range communication discussion group carries the same range communication identifier; The scope communication message of the current participant is sent to each target participant end in the scope communication discussion group with the same scope communication identifier through the instant messaging server, and is not sent to other participant ends in the group discussion group that do not have the same scope communication identifier.

6. The display device according to claim 1 , wherein the processor is further configured to execute computer instructions so that the display device: When a specific participant who joins the target virtual conference generates specific communication information, a specific communication reminder is displayed in the virtual communication interface corresponding to the current participant. The specific participant refers to a participant who is in the group discussion group and is not in the same communication discussion group as the current participant. The specific communication reminder is used to indicate that the specific participant in the group discussion group is conducting a full-time communication; Receive the triggering of the specific communication reminder by the current participant, and receive the specific communication information generated by the specific participant.

7. The display device according to claim 6, wherein the processor is further configured to execute computer instructions so that the display device: When the current participant is conducting a full-field communication in the virtual communication room, receiving a triggering of a speech button in the virtual conference interface by the current participant, and displaying a full-field communication option in a speech type dialog box that pops up in the virtual conference interface; receiving a trigger of the full-room communication option by the current participant, and sending a full-room communication request to a specific participant terminal via an instant messaging server, wherein the full-room communication request is used to instruct the specific participant to determine whether to allow the current participant to conduct full-room communication; In response to receiving a full-room communication permission instruction returned by the specific participant via the instant messaging server, receiving a full-room communication message generated by the current participant, the full-room communication message carrying the full-room communication identifier of the group discussion group, and each participant in the group discussion group carrying the same full-room communication identifier; The full-field communication information generated by the current participant is sent to all participant terminals in the group discussion group corresponding to the full-field communication identifier through the instant messaging server.

8. The display device according to claim 1, wherein the processor is further configured to execute computer instructions to enable the display device to: obtain a training video identifier and a follow-up training page identifier; Determine the follow-up training page data corresponding to the follow-up training page identifier, and obtain the corresponding training video data from the server according to the training video identifier; Acquire target performance parameters of the display device, where the target performance parameters include: CPU occupancy rate and / or memory occupancy rate; Controlling the communication interface to send the target performance parameter to the mobile terminal; receiving follow-up training video data sent by the mobile terminal that matches the target performance parameter, the follow-up training video data including: the target video data collected by the mobile terminal, and / or first human skeleton point information obtained from the target video data; The display is controlled to display a follow-up training page based on the follow-up training page data, the training video data and the follow-up training video data, wherein the follow-up training page includes a first window and a second window, wherein the training video data is displayed in the first window and the follow-up training video data is displayed in the second window.

9. The display device according to claim 8, wherein when the target performance parameter is less than or equal to the first preset performance parameter, the training video data comprises: Target video data collected by the mobile terminal, and first human skeleton point information obtained from the target video data; The processor is further configured to execute computer instructions to enable the display device to: obtain second human skeleton point information from the training video data; generating evaluation information according to matching parameters between the first human skeleton point information and the second human skeleton point information; The target video data and the evaluation information are displayed in the second window.

10. The display device according to claim 8, wherein when the target performance parameter is greater than a second preset performance parameter, the follow-up training video data comprises: First human skeleton point information obtained from the target video data, excluding the target video data; The processor is further configured to execute computer instructions to enable the display device to: generate virtual training video data based on the first human skeleton point information, wherein the virtual training video data includes a virtual human training picture; The second window displays the virtual training video data.

11. The display device according to claim 10, wherein the processor is further configured to execute computer instructions to enable the display device to: obtain second human skeleton point information from the training video data; generating evaluation information according to matching parameters between the first human skeleton point information and the second human skeleton point information; The second window displays the virtual training video data and the evaluation information.

12. A mobile terminal, comprising: The detector is configured to: collect target video data; The processor is configured to: control the communication interface to receive a target performance parameter sent by the display device, wherein the target performance parameter includes: CPU occupancy rate and / or memory occupancy rate; The control communication interface sends the follow-up video data matching the target performance parameters to the display device, wherein the follow-up video data includes: the target video data collected by the mobile terminal, and / or the first human skeleton point information obtained from the target video data.

13. The mobile terminal according to claim 12, wherein the processor is further configured to execute computer instructions to cause the display device to: When the target performance parameter is less than or equal to the first preset performance parameter, controlling the communication interface to send the target video data collected by the mobile terminal and the first human skeleton point information to the display device; When the target performance parameter is less than or equal to the second preset performance parameter and greater than the first preset performance parameter, controlling the communication interface to send the target video data collected by the mobile terminal to the display device without sending the first human skeleton point information; The second preset performance parameter is greater than the first preset performance parameter; When the target performance parameter is greater than the second preset performance parameter, the communication interface is controlled to send the first human skeleton point information to the display device, and the target video data is not sent.

14. The mobile terminal according to claim 13, wherein the processor is further configured to execute computer instructions to cause the display device to: Obtaining the remaining power of the mobile terminal; The processor is specifically configured to: control the communication interface to send the follow-up training video data that matches the target performance parameter and the remaining power to the display device.

15. The mobile terminal of claim 14, wherein the processor is further configured to execute computer instructions to cause the display device to: When the target performance parameter is less than or equal to a first preset performance parameter and the remaining power is greater than or equal to the first preset power parameter, controlling the communication interface to send the target video data collected by the mobile terminal and the first human skeleton point information to the display device; When the target performance parameter is less than or equal to the second preset performance parameter and greater than or equal to the first preset performance parameter, and the remaining power is less than the first preset power parameter and greater than or equal to the second preset power parameter, controlling the communication interface to send the target video data collected by the mobile terminal to the display device, wherein the second preset power parameter is less than the first preset power parameter; When the target performance parameter is greater than the second preset performance parameter and the remaining power is less than the second preset power parameter, the communication interface is controlled to send the first human skeleton point information to the display device.

16. The mobile terminal according to claim 12, The training video data includes the first human skeleton point information and does not include the target video data collected by the mobile terminal. The processor is further configured to: control the display screen to display the target video data, and control the brightness of the display screen to be greater than a first preset brightness; The training video data includes target video data collected by the mobile terminal, and the processor is further configured to: Control the brightness of the display screen to be less than or equal to a second preset brightness, or control the display screen to be off.

17. A method for implementing range communication in a virtual conference, applied to a display device, the method comprising: Receiving an operation from a current participant to join a target virtual conference, requesting a server to add the current participant to a group discussion group corresponding to the target virtual conference, and displaying a virtual conference interface of the target virtual conference, wherein the group discussion group includes all participants who have joined the target virtual conference, the virtual conference interface includes a virtual communication room corresponding to the group discussion group and virtual avatars corresponding to all participants in the group discussion group, and the virtual avatars corresponding to all participants are displayed in the virtual communication room; Based on the current position information of the current virtual image in the virtual communication room, detecting whether there is a target virtual image within a preset distance range of the current virtual image, the current virtual image being the virtual image of the current participant, and the target virtual image being the virtual image of the target participant in the group discussion group; If there is at least one target virtual image within a preset distance range of the current virtual image, filtering out the target participants corresponding to the current participant and the at least one target virtual image from the group discussion, and generating a range communication discussion group; Receive the communication message generated by the current participant, and send the communication message to each target participant in the range communication discussion group.

18. A method for displaying a page based on device performance, applied to a display device, the method comprising: Get the training video ID and follow-up training page ID; Determine the follow-up training page data corresponding to the follow-up training page identifier, and obtain the corresponding training video data from the server according to the training video identifier; Acquire target performance parameters of the display device, where the target performance parameters include: CPU occupancy rate and / or memory occupancy rate; Sending the target performance parameter to a mobile terminal; receiving training video data sent by the mobile terminal that matches the target performance parameter, the training video data including: target video data collected by the mobile terminal, and / or first human skeleton point information obtained from the target video data; The display is controlled to display a follow-up training page based on the follow-up training page data, the training video data and the follow-up training video data, wherein the follow-up training page includes a first window and a second window, wherein the training video data is displayed in the first window and the follow-up training video data is displayed in the second window.

19. A method for displaying a page based on device performance, applied to a mobile terminal, the method comprising: Collect target video data; Receiving target performance parameters sent by the display device, the target performance parameters including: CPU occupancy and / or memory occupancy; The control communication interface sends the follow-up video data matching the target performance parameters to the display device, wherein the follow-up video data includes: the target video data collected by the mobile terminal, and / or the first human skeleton point information obtained from the target video data.

Images