Business data processing method, device, computer equipment, and storage medium

Abstract

An embodiment of the present application provides a method, apparatus, computer device, and storage medium for processing service data. The method includes: responding to a trigger operation for a target service in an instant messaging application, and displaying a service display page matching the target service; in an auxiliary area of the service display page, displaying at least two interactive users; responding to a confirmation operation for the auxiliary area, and determining a main interactive user from the at least two interactive users; and displaying the main interactive user in a main area of the service display page, where the main area is used to display the interactive behavior data of the main interactive user in the target service. By adopting the embodiment of the present application, the interactive methods in the instant messaging application can be enriched.

Description

[0001] This application is a divisional application of the Chinese patent application with the application number 202010512719.9 and the application title "Business Data Processing Method, Device, Computer Equipment and Storage Medium", which was filed with the Chinese Patent Office on June 8, 2020. The entire content is incorporated herein by reference. Technical Field

[0002] This application relates to the field of Internet technologies, and in particular to a business data processing method, device, computer equipment and storage medium. Background Art

[0003] With the continuous development of multimedia technologies and the emergence of various social application software, more and more users use social application software for entertainment activities. For example, users can communicate and interact in social applications.

[0004] In existing instant messaging applications, multiple users can interact through a conversation window, specifically in a text-based manner. Moreover, each user can only interact in a fixed area of the conversation window, resulting in a single interaction method in instant messaging applications. Summary of the Invention

[0005] Embodiments of this application provide a business data processing method, device, computer equipment and storage medium, which can enrich the interaction methods in instant messaging applications.

[0006] On the one hand, embodiments of this application provide a business data processing method, including:

[0007] Respond to a trigger operation for a target business in an instant messaging application, and display a business display page that matches the target business;

[0008] In an auxiliary area of the business display page, display at least two interactive users;

[0009] Respond to a confirmation operation for the auxiliary area, and determine a main interactive user from at least two interactive users;

[0010] Display the main interactive user in the main area of the business display page; the main area is used to display the interaction behavior data of the main interactive user in the target business.

[0011] On the one hand, embodiments of this application provide a business data processing method, including:

[0012] Obtain the multimedia data corresponding to at least two interactive users in the target business respectively;

[0013] Send the multimedia data corresponding to at least two interactive users to the terminal device respectively, so that the terminal device displays the multimedia data corresponding to at least two interactive users respectively in the auxiliary area of the service display page;

[0014] Determine the main interactive user from at least two interactive users;

[0015] Send a region replacement instruction to the terminal device, instructing the terminal device to display the main interactive user in the main region of the service display page according to the region replacement instruction; the main region is used to display the interactive behavior data of the main interactive user in the target service.

[0016] Among them, the task content includes image task content;

[0017] Obtain the interactive behavior data of the main interactive user for the task content, and generate an interactive result corresponding to the task content according to the interactive behavior data, including:

[0018] Obtain the interactive behavior data of the main interactive user for the image task content, perform facial expression recognition on the interactive video data included in the interactive behavior data, and obtain a facial expression recognition result corresponding to the interactive behavior data;

[0019] When the facial expression recognition result matches the image task content, determine that the interactive result corresponding to the task content is an interactive success result;

[0020] When the facial expression recognition result does not match the image task content, determine that the interactive result corresponding to the task content is an interactive failure result.

[0021] Among them, the main interactive user includes a first interactive user and a second interactive user, and both the first interactive user and the second interactive user belong to at least two interactive users;

[0022] Obtain the interactive behavior data of the main interactive user for the task content, and generate an interactive result corresponding to the task content according to the interactive behavior data, including:

[0023] Obtain the interactive behavior data of the first interactive user and the second interactive user for the task content respectively;

[0024] Obtain the third audio data in the interactive behavior data corresponding to the first interactive user, perform speech recognition on the third audio data, and obtain a third converted text corresponding to the third audio data;

[0025] Obtain the fourth audio data in the interactive behavior data corresponding to the second interactive user, perform speech recognition on the fourth audio data, and obtain a fourth converted text corresponding to the fourth audio data;

[0026] When the third converted text matches the answer information corresponding to the task content and the acquisition time of the third audio data is earlier than the acquisition time of the fourth audio data, determine that the interaction result corresponding to the task content is an interaction success result for the first interaction user;

[0027] When the fourth converted text matches the answer information and the acquisition time of the fourth audio data is earlier than the acquisition time of the third audio data, determine that the interaction result corresponding to the task content is an interaction success result for the second interaction user;

[0028] When neither the third converted text nor the fourth converted text matches the answer information, determine that the interaction result corresponding to the task content is an interaction failure result.

[0029] Among them, the service display page includes an operation area;

[0030] The method further includes:

[0031] Obtain the voting information for the interaction behavior data sent by the device to which the secondary interaction user belongs; the voting information is generated by the device to which the secondary interaction user belongs in response to the voting trigger operation in the operation area, and the secondary interaction user refers to the interaction user other than the primary interaction user among at least two interaction users;

[0032] Count the number of votes for the interaction behavior data according to the voting information, generate an interaction result according to the number of votes, and send the interaction result to the terminal device so that the terminal device displays a prompt message associated with the interaction result on the service display page.

[0033] An embodiment of the present application provides a service data processing device on the one hand, including:

[0034] The first display module is used to respond to the trigger operation for the target service in the instant messaging application and display a service display page matching the target service;

[0035] The second display module is used to display at least two interaction users in the secondary area of the service display page;

[0036] The first determination module is used to respond to the confirmation operation for the secondary area and determine the primary interaction user from at least two interaction users;

[0037] The third display module is used to display the primary interaction user in the primary area of the service display page; the primary area is used to display the interaction behavior data of the primary interaction user in the target service.

[0038] An embodiment of the present application provides a service data processing device on the one hand, including:

[0039] The acquisition module is used to acquire the multimedia data corresponding to at least two interaction users in the target service;

[0040] A first sending module, configured to send multimedia data corresponding to at least two interactive users to a terminal device respectively, so that the terminal device displays the multimedia data corresponding to at least two interactive users respectively in an auxiliary area of a service display page;

[0041] A second determining module, configured to determine a main interactive user from at least two interactive users;

[0042] A second sending module, configured to send an area replacement instruction to the terminal device, instructing the terminal device to display the main interactive user in a main area of the service display page according to the area replacement instruction; the main area is used to display the interactive behavior data of the main interactive user in the target service.

[0043] An embodiment of the present application provides a computer device on the one hand, including a memory and a processor. The memory stores a computer program. When the computer program is executed by the processor, the processor executes the steps of the method in the embodiment of the present application on the one hand.

[0044] An embodiment of the present application provides a computer-readable storage medium on the one hand. The computer-readable storage medium stores a computer program. The computer program includes program instructions. When the program instructions are executed by a processor, the steps of the method in the embodiment of the present application on the one hand are executed.

[0045] In the embodiment of the present application, a service display page for a target service in an instant messaging application may include a main area and an auxiliary area. The auxiliary area may be used to display interactive users participating in the target service, and the main area may be used to display the interactive behavior data of a selected user (i.e., the main interactive user). After determining the main interactive user from the target service, the main interactive user may be displayed in the main area, that is, the main interactive user may interact with other users in the main area, thereby enriching the interaction methods in the instant messaging application. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required to be used in the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on these drawings.

[0047] Figure 1 is a network architecture diagram provided by an embodiment of the present application;

[0048] Figure 2 is a schematic diagram of a service data processing scenario provided by an embodiment of the present application;

[0049] Figure 3It is a schematic flowchart of a service data processing method provided by an embodiment of the present application;

[0050] Figure 4 It is a schematic interface diagram of inviting users to join a target service provided by an embodiment of the present application;

[0051] Figure 5 It is a schematic flowchart of a service data processing method provided by an embodiment of the present application;

[0052] Figures 6a to 6c It is a schematic interface diagram of a service data processing provided by an embodiment of the present application;

[0053] Figure 7 It is a schematic interface display diagram of a video interaction provided by an embodiment of the present application;

[0054] Figure 8 It is a schematic flowchart of a service data processing method provided by an embodiment of the present application;

[0055] Figures 9a to 9d It is a schematic diagram of a service page provided by an embodiment of the present application;

[0056] Figure 10a and Figure 10b It is a schematic interface diagram of a service data processing provided by an embodiment of the present application;

[0057] Figure 11 It is a schematic flowchart of a service data processing method provided by an embodiment of the present application;

[0058] Figure 12a and Figure 12b It is a schematic interface diagram of a service data processing provided by an embodiment of the present application;

[0059] Figure 13 It is a schematic interface display diagram of an expression interaction provided by an embodiment of the present application;

[0060] Figure 14 It is a schematic timing diagram of a service data processing method provided by an embodiment of the present application;

[0061] Figure 15 It is a schematic flowchart of selecting a main interaction user provided by an embodiment of the present application;

[0062] Figure 16 It is a schematic flowchart of generating an interaction result provided by an embodiment of the present application;

[0063] Figure 17a and Figure 17b It is a schematic diagram of a service processing framework provided by an embodiment of the present application;

[0064] Figure 18 It is a schematic structural diagram of a service data processing device provided by an embodiment of the present application;

[0065] Figure 19 It is a schematic structural diagram of a service data processing device provided by an embodiment of the present application;

[0066] Figure 20 It is a schematic structural diagram of a computer device provided by an embodiment of the present application;

[0067] Figure 21 It is a schematic structural diagram of a computer device provided by an embodiment of the present application. Detailed implementation manners

[0068] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0069] Please refer to Figure 1 , Figure 1 It is a network architecture diagram provided by an embodiment of the present application. The network architecture includes a server 10d and multiple terminal devices (as Figure 1 shown, specifically, it may include a terminal device 10a, a terminal device 10b, and a terminal device 10c, etc.). Among them, an instant messaging application can be installed on each terminal device, the server 10d can be a background server corresponding to the instant messaging application, and each terminal device can perform data transmission with the server 10d through the client corresponding to the instant messaging application.

[0070] In the service interaction scenario of the instant messaging application, after the target service is enabled, each terminal device corresponding to each user in the target service can collect user data (such as voice data, video data, etc.), and transmit the collected user data to the server 10d. The server 10d can send the received user data to each terminal device, so that each terminal device can obtain the user data corresponding to each user in the target service. Furthermore, in the service display page corresponding to the target service, the user data corresponding to each user is output. All users included in the target service can be displayed in the auxiliary area of the service display page. The service display page can also include a main area, which can be used to display the interaction behavior data of the main interaction user. The main interaction user refers to the user selected from all users participating in the service according to user operations or background instructions. After the main interaction user is determined, the main interaction user can be displayed in the main area.

[0071] Understandably, the service data processing solution proposed in this application can be completed by a system composed of a terminal device and a server, or executed by a computer program (including program code) in a computer device. For example, the service data processing solution is executed by an application software. The client of the application software can display the video images corresponding to each user in the service. The client can also collect the behavior data of the user (which can include at least one of audio data and video data), and upload the behavior data to the background server of the application software. The background server of the application software can process the behavior data of the user and send the data processing result to the client.

[0072] Among them, the terminal device 10a, the terminal device 10b, the terminal device 10c, etc. can all include mobile phones, tablet computers, laptop computers, palmtop computers, mobile internet devices (MID), wearable devices (such as smart watches, smart bracelets, etc.), and other devices with video functions.

[0073] Please refer to Figure 2 , Figure 2 FIG. is a schematic diagram of a service data processing scenario provided by an embodiment of the present application. Taking the terminal device 10a as an example, the service data processing solution proposed in the embodiment of the present application will be described. As Figure 2As shown in the figure, in the game interaction scenario of an instant messaging application, the target user can open the instant messaging application in the terminal device 10a, and select the game entrance in the instant messaging application to enter the game home page 20a; in the game home page 20a, the icons corresponding to the games included in the instant messaging application can be displayed, such as the icon of Game 1, the icon of Game 2, the icon of Game 3, etc. The target user can select the game icon of interest from the game home page 20a to enter the game corresponding to the game icon. When the target user selects the icon corresponding to Game 2 on the game home page 20a, the terminal device 10a can respond to the selection trigger operation (such as click, double-click, etc.) of the target user for the Game 2 icon, create a game room 20b for the target user in Game 2, and in the session page of the game room 20b, the following can be displayed: the room number 123456 corresponding to the game room 20b, the description information 20c corresponding to Game 2 (such as information such as the game name and game rules), and the video picture of the target user. At this time, only the target user is included as a member in the game room 20b, that is, the target user is the first member in the game room 20b, and the terminal device 10a can display the video picture of the target user at the first position in the user area 20d (i.e., the position corresponding to Member 1). Optionally, the game room 20b can include an exit function control, a video function control, a volume function control, a microphone function control, etc. If the target user selects the exit function control, the terminal device 10a can exit the target user from the game room 20b and close the game room 20b; the video function control can be used to turn on or off the camera function in the terminal device 10a, the volume function control is used to adjust the output volume in the Game 2, and the microphone function control is used to turn on or off the audio acquisition function in the terminal device 10a.

[0074] It can be understood that as an interactive game, Game 2 has a limit on the number of members. When the number of members in the game room 20b reaches the preset number (such as 8), the game can start. Therefore, the target user needs to invite more friends to join the game room 20b. The game room 20b also includes an "Invite" function control. The target user can trigger the terminal device to pull the friend list of the target user from the instant messaging application by triggering the "Invite" function control in the game room 20b, and display the pulled friend list in the game room 20b; the target user can select the friends who want to invite to join the game from the friend list, and the terminal device 10a can respond to the selection operation for the friend list and send an invitation message to the friends selected by the target user.

[0075] If the target user's friend agrees to join the game room 20b through the invitation information, the terminal device 10a can display the friend's video screen in the user area 20d. The video screens displayed in the user area 20d are all video screens corresponding to the members who have successfully joined the game room 20b. The arrangement order of the video screens in the user area 20d is related to the time when the members joined the game room 20b. The earlier the members joined the game room 20b, the higher the order of the member's video screen in the user area 20d. For example, if user A joins the game room 20b as the second member after the target user, the video screen of user A can be displayed at the second position in the user area 20d (that is, the position corresponding to member 2). And so on, the video screens of the members who joined the game room 20b will be displayed in the user area 20d in sequence. It should be noted that the video screen displayed in the user area 20d may refer to the server (as mentioned above). Figure 1 The server 10d) in the corresponding embodiment is generated according to the video data uploaded by the terminal device held by each member, that is, the device held by each member can collect the video data of the corresponding member and upload the video data to the server.

[0076] When the number of members included in the user area 20d reaches a preset number, the target user can click the "start game" function control to enter the game display page matching the game 2, and the game display page can display the video images corresponding to all members in the game room 20b, as well as the game task content during the game and other information. The terminal device 10a can respond to the target user's click trigger operation on the "start game" function control, determine the game type corresponding to the game 2 according to the description information 20c of the game 2, and then display the game display page matching the game type in the instant messaging application.

[0077] When the game type of Game 2 is a type of performance taking turns on stage (such as Game 2 is a game such as "You Act and I Guess", "You Guess Better than Me", "You Sing and I Guess" and "You Draw and I Guess", etc.), the game display page displayed after the game starts may include a main area 20e and an auxiliary area 20f. The auxiliary area 20f can display video images of all members in the game room 20b, such as the video images corresponding to members 1 to 8 respectively; the terminal device 10a can select a performing user (also called a main interactive user) from all members, such as member 1, and switch the video image of member 1 from the auxiliary area 20f to the main area 20e. The order of selecting the performing users can be determined by the arrangement order of the video images of each member in the auxiliary area 20f.

[0078] When the game type of Game 2 is the type of sitting in a circle (such as games like "Truth or Dare", "Big Adventure", etc.), the game display page 20k displayed after the game starts may include an operation area and an auxiliary area (the remaining area in the game display page 20k except the operation area can be called the auxiliary area). The auxiliary area can be divided into 8 display areas according to the number of members in the game room 20b, and each display area can be used to display the video picture of a member. The operation area may include a "Start" function control. By triggering the "Start" function control, the terminal device polls and traverses the 8 members in the auxiliary area, and takes the member indicated when the polling traversal stops as the performing user. For example, Member 4, and the display area of Member 4 in the auxiliary area can be highlighted, and the highlighted display area is called the main area in the game display page.

[0079] When the game type of Game 2 is the type of grouped confrontation (such as games like "Quiz Competition", etc.), the terminal device 10a can divide the 8 members in the game room 20b into 2 teams, such as Team A and Team B. Among them, Team A can include Member 1, Member 2, Member 3, and Member 4, and Team B can include Member 5, Member 6, Member 7, and Member 8. The game display page displayed after the game starts may include a main area 20g, an auxiliary area 20h, a main area 20i, and an auxiliary area 20j. The auxiliary area 20h can be used to display the video pictures of the members of Team A, and the auxiliary area 20j can be used to display the video pictures of the members of Team B. When the terminal device 10a selects Member 1 from Team A as the performing user (also called the answering user) and selects Member 5 from Team B as the performing user, the video picture of Member 1 can be switched from the auxiliary area 20h to the main area 20g, and the video picture of Member 5 can be switched from the auxiliary area 20j to the main area 20i. For the questions in the game, Member 1 and Member 5 can compete in a rush to answer. The member who successfully rushes to answer can continue to answer the question, and the member who fails to rush to answer returns to the auxiliary area and re - selects a member from the team as the performing user.

[0080] In the game interaction scenario of an instant messaging application, different game types can display different game display pages, that is, according to the game type, the cutting method of the member video pictures can be adjusted adaptively, thereby enriching the display form of the video pictures.

[0081] Please refer to Figure 3 , Figure 3 which is a schematic flowchart of a service data processing method provided by an embodiment of the present application. As Figure 3 shown, the service data processing method may include the following steps:

[0082] Step S101, in response to a trigger operation for a target service in an instant messaging application, display a service display page matching the target service.

[0083] Specifically, in the business interaction scenario of an instant messaging application, a target user can create a business session associated with a target business in the instant messaging application (such as the game room 20b in the corresponding embodiment above), and invite friends in the instant messaging application to join the business session. When the number of users included in the business session reaches a preset number, the target user can start the target business, enabling the target user and friends in the business session to conduct business interactions. Therefore, before responding to a trigger operation for a target business in the instant messaging application, the terminal device can respond to a session creation operation in the instant messaging application, create a business session corresponding to the target business for the target user in the instant messaging application, and display business description information corresponding to the target business (such as the description information 20c in the corresponding embodiment above) and the target user in the business session. The target user, as the creator of the business session, can join the business session corresponding to the target business as the first interaction user. Among them, the terminal device can refer to the user terminal held by the target user, and the target business can be an interactive game using video chat, or a business using video chat functions such as a video conference, etc., such as games like "You Act I Guess", "Truth or Dare", "Question and Answer", etc., as well as meetings of the type where leaders take turns speaking, group discussion meetings, multi-party debate meetings, etc. Figure 2 The target user can also invite friends in the instant messaging application to join the business session corresponding to the target business. When the target user triggers the invitation function control in the business session, the terminal device can respond to the invitation operation in the business session and send the invitation information corresponding to the target business to the candidate users selected by the invitation operation. Here, the candidate users can be represented as the friends selected by the target user from the friend list of the instant messaging application; after receiving the invitation information corresponding to the target business, the candidate users can join the business session corresponding to the target business through the invitation information. When the candidate users confirm to join the business session through the invitation information, the terminal device can detect the confirmation participation request of the invitation information returned by the server, add the candidate users as interaction users to the business session corresponding to the target business, and display the candidate users in the business session. At this time, both the target user and the candidate users can be determined as interaction users in the target business. Figure 2

[0084]

[0085] Optionally, the target user can also enter the service navigation page from the group chat page of the instant messaging application. The service navigation page may include services that the members in the group have joined. The target user can select a target service from the services displayed on the service navigation page, trigger the terminal device to create a service session associated with the target service in the instant messaging application, and send the invitation information corresponding to the service session to the group. The members in the group can join the service session created by the target user by clicking on the invitation information. That is, when the terminal device receives the confirmation participation request for the invitation information returned by the background of the instant messaging application, it can add the group members associated with the confirmation participation request to the service session. It should be noted that in the embodiments of the present application, the interactive user corresponding to the current terminal device is defaulted to the target user, and the target user can also be the local terminal user. The service data processing process in the embodiments of the present application can be executed by the terminal device held by the target user.

[0086] Please refer to Figure 4 , Figure 4 FIG. [FIG. number] is a schematic diagram of an interface for inviting a user to join a target service provided by an embodiment of the present application. Taking the target service as the "You Act I Guess" game as an example, the process of inviting a user to join the target service will be described in detail. As Figure 4 shown, user A can open the instant messaging application in the terminal device 10a, and select the game entry in the instant messaging application to enter the game home page 30a; the icons of the games included in the instant messaging application can be displayed on the game home page 30a, such as the icon of the "You Draw I Guess" game, the icon of the "You Act I Guess" game, the icon of the "You Sing I Guess" game, the icon of the "Truth or Dare" game, and the icon of the "Dare" game, etc. User A can select the game that he wants to play from the game home page 30a and click on the corresponding icon of the game to create a game room (at this time, A is the above-mentioned target user). For example, after user A clicks on the icon of the "You Act I Guess" game, the terminal device 10a can respond to the click operation of user A on the icon of the "You Act I Guess" game, and create a game room 30b for user A. The description information 30c of the "You Act I Guess" game (such as each person takes turns performing the topic, and during the process, language and body movements can be used to describe, but any words containing the answer cannot be mentioned) and the user area 30d can be displayed in the game room 30b; among them, the user area 30d can be used to display the members in the game room 30b (such as at least one of the user's video picture, avatar, nickname, etc.), and the sorting of the members in the user area 30d is associated with the time when the corresponding members join the game room 30b. For example, the earlier a member joins the game room 30b, the more forward the display position of the member in the user area 30d. At this time, only user A is included in the game room 30b, so user A can be displayed at the first display position in the user area 30d.

[0087] User A can trigger the invitation function control in game room 30b. The terminal device 10a responds to the invitation operation for the invitation function control, pulls the friend list of User A from the instant messaging application, and displays the friend list on the friend selection page 30e. It should be understood that the friend list of User A can be directly displayed in a certain area of game room 30b, or can be independently displayed from game room 30b, or can be jumped from game room 30b to the friend selection page 30e and displayed on the friend selection page 30e.

[0088] The terminal device 10a can select friends from the friend list to join game room 30b. If User A selects User B, User C, User D, User E, User F, User G, and User H from the friend list and clicks "OK", then the terminal device 10a can send invitation messages for the "You Act I Guess" game to User B, User C, User D, User E, User F, User G, and User H respectively. If User B, User C, User D, User E, User F, User G, and User H all agree to join game room 30b, then the above users can send confirmation participation requests to the terminal device 10a through the invitation messages. After the terminal device 10a detects the above confirmation participation requests, it can display User B, User C, User D, User E, User F, User G, and User H in the user area 30d.

[0089] Further, when the number of users in an interactive session reaches a preset number (e.g., the preset number is 8, or 4, etc.), the start function control in the business session can be switched from an inactive state to an active state, and the target user can trigger the start function control to start the target business. When the target user triggers the start function control, the terminal device can respond to the trigger operation for the start function control and display a business display page matching the target business. Among them, the area division method in the business display page is related to the business type of the target business, and different business types can have different page display forms. For example, when the business type is a type of taking turns to perform on stage, the business display page can include a main area and a secondary area, such as the target business being games like "You draw I guess", "You act I guess", "You sing I guess", etc., or a meeting of the type of taking turns to speak; when the business type is a type of sitting in a circle, the business display page can include an operation area and a secondary area, and the secondary area can be divided into multiple unit areas, and each unit area can display the video picture of an interactive user, that is, the number of unit areas is the same as the number of interactive users in the target business, such as the target business being games like "Truth or Dare", "Big Adventure", etc., or a meeting of the type of group discussion; when the business type is a type of grouped confrontation, the business display page can include at least two main areas and at least two secondary areas, and the number of secondary areas is the same as the number of teams, such as games like "Question and Answer PK", etc., or a meeting of the type of multi-party debate; for the specific description of the business display pages corresponding to different business types, reference can be made to the Figure 2 corresponding embodiments described above, which will not be elaborated here.

[0090] Step S102, in the secondary area of the business display page, display at least two interactive users.

[0091] Specifically, after starting the target business, the terminal device can obtain all the users included in the target business and display all the users in the secondary area of the business display page. Among them, the users displayed in the secondary area can be displayed in the form of real-time video pictures, avatars, nicknames, etc. In the embodiments of the present application, the real-time video picture is taken as an example for specific description, that is, the interactive users are all displayed in the form of video pictures in the secondary area.

[0092] After the local end - user (which can be understood as the holder of the terminal device) joins the target service, the camera in the terminal device can be turned on. Therefore, the terminal device can use the camera to collect the video frame data of the local end - user in real - time. Furthermore, the collected video frame data of the local end - user can be rendered using an open - source graphics library (such as OpenGL) to generate the video picture corresponding to the local end - user, and the video picture corresponding to the local end - user is displayed in the auxiliary area of the service display page. The terminal device can also send the collected video frame data associated with the local end - user to the server (such as the server 10d in the corresponding embodiment above Figure 1 so that the server sends the video frame data of the local end - user to the user terminals corresponding to the remaining interactive users (i.e., the remaining interactive users other than the local end - user among at least two interactive users). Similarly, the user terminals corresponding to the remaining interactive users can also use the camera to collect the video frame data of the corresponding interactive users and send the collected video frame data to the server. Then, the server can send the video frame data of the remaining interactive users to the local terminal device. After receiving the video frame data corresponding to the remaining interactive users, the terminal device can use the open - source graphics library to render the received video frame data of the remaining interactive users to generate the video pictures corresponding to the remaining interactive users, and display the video pictures corresponding to the remaining interactive users in the auxiliary area of the service display page.

[0093] Optionally, the terminal device can send the collected video frame data of the local end - user to the server, and the user terminals corresponding to the remaining interactive users can also send the collected video frame data of each of them to the server. The server can render the received video frame data to generate the video pictures corresponding to the local terminal device and the remaining interactive users respectively. That is, the server can receive the video frame data corresponding to each interactive user in the target service and generate the video pictures corresponding to each interactive user in the target service. The server can send the video picture corresponding to each interactive user to the current terminal device. After receiving the video pictures corresponding to each interactive user respectively, the terminal device can separately display the video pictures corresponding to each interactive user in the auxiliary area of the service display page. In short, the video pictures displayed in the auxiliary area of the service display page can be the pictures obtained by the terminal device using the open - source graphics library to render the video frame data corresponding to each interactive user respectively, or the pictures obtained by the server rendering the video frame data corresponding to each interactive user first.

[0094] Optionally, in the target service, the terminal device can also obtain the network status of the current device in real time and perform traffic management based on the network status of the current device. When the network status is good, a higher-quality video image is displayed in the secondary area, enabling local terminal users to more clearly see the behaviors of other interactive users, such as increasing the clarity, resolution, etc. of the video image; when the network status is poor, a video image with reduced quality can be displayed in the secondary area, making the video on the service display page smoother and preventing situations such as freezing, such as reducing the clarity, resolution, etc. of the video image.

[0095] Step S103: In response to the confirmation operation for the secondary area, determine the primary interactive user from at least two interactive users.

[0096] Specifically, after starting the target service, the terminal device can, in response to the confirmation operation for the secondary area, select the primary interactive user from at least two interactive users of the target service. Among them, the confirmation operation can refer to the confirmation behavior operation detected by the terminal device associated with the target user, or the confirmation instruction sent by the server to the terminal device, which is not specifically limited here.

[0097] Optionally, after the target service is started, the server can detect that the target service is in the started state, and then can send a confirmation instruction to the terminal device to instruct the terminal device to select the primary interactive user from at least two interactive users displayed in the secondary area. Optionally, the service display page corresponding to the target service can include an operation control, and the local terminal user can trigger the terminal device to select the primary interactive user from the secondary area through the operation control in the service display page.

[0098] Step S104: Display the primary interactive user in the primary area of the service display page; the primary area is used to display the interactive behavior data of the primary interactive user in the target service.

[0099] Specifically, after the terminal device determines the primary interactive user from the secondary area, it can pull the primary interactive user to the primary area of the service display page for display. Among them, the primary area and the secondary area in the service display page can overlap or not overlap. When there is an overlap between the primary area and the secondary area, it can mean that the primary area is a part of the secondary area. For example, in the game display page 20k of the corresponding embodiment above, the display area of the selected member 4 (i.e., the primary interactive user) can be called the primary area, and the remaining area of the game display page 20k except the operation area can be called the secondary area. When the next selected member is member 5, the primary area can be updated from the display area of member 4 to the display area of member 5, that is, the display position of the primary area in the service display page can be not fixed; when the primary area and the secondary area do not overlap, it can mean that the primary area and the secondary area are two independent areas in the service display page, such as the above Figure 2 In the game display page 20k, the display area of the selected member 4 (i.e., the primary interactive user) can be called the primary area, and the remaining area of the game display page 20k except the operation area can be called the secondary area. When the next selected member is member 5, the primary area can be updated from the display area of member 4 to the display area of member 5, that is, the display position of the primary area in the service display page can be not fixed; when the primary area and the secondary area do not overlap, it can mean that the primary area and the secondary area are two independent areas in the service display page, such as the aboveFigure 2 The main area 20e and the secondary area 20f in the corresponding embodiment, wherein the main area can have a fixed display position on the service display page. When the performer (i.e., the main interactive user) is changed in the target service, the display position of the main area remains unchanged.

[0100] It can be understood that after the terminal device displays the main interactive user in the main area, it can continue to display the main interactive user in the secondary area, or temporarily not display the main interactive user in the secondary area. For example, the terminal device can display the video picture of the main interactive user in the main area and continue to display it in the form of an avatar in the secondary area; or after the terminal device displays the video picture of the main interactive user in the main area, it temporarily does not display the main interactive user in the secondary area.

[0101] Among them, the main area on the service display page can be used to display the interactive behavior data of the main interactive user in the target service. The interactive behavior data can refer to at least one of video data and audio data, such as the body movements and voices of the main interactive user. The task content in the target service can be displayed on the service display page, and the main interactive user can interact with the other interactive users for the task content, that is, the terminal device can output the interactive behavior data of the main interactive user for the task content in the main area, and the interactive behavior data can also be called interactive content.

[0102] Optionally, during the interaction of the target service, the terminal device can obtain the real-time progress information corresponding to the target service through the heartbeat mechanism, obtain the display progress information corresponding to the service display page. When the real-time progress information is inconsistent with the display progress information, the content of the service display page can be updated according to the real-time progress information. The heartbeat mechanism means that the terminal device can send a request data packet to the server at a fixed time interval. After receiving the request data packet sent by the terminal device, the server can return a response data packet to the terminal device, and the response data packet can include the real-time progress information corresponding to the target service. It should be understood that the data type and data structure of the heartbeat data packet, as well as the data result that should be returned in the response data packet, etc. can be preset in the heartbeat mechanism. For example, the heartbeat data packet in the embodiment of the present application is used to obtain the real-time progress information of the target service from the server, that is, the response data packet returned by the server can include the real-time progress information of the target service.

[0103] Among them, both the real-time progress information and the displayed progress information can be represented by the progress seq (a list of numbers that increment automatically according to certain rules in the database system). The real-time progress information can refer to the real-time progress of the target service, and the displayed progress information can refer to the displayed progress in the service display page corresponding to the local terminal user. Due to reasons such as latency, the displayed progress in the service display page corresponding to the local terminal user may lag behind the real-time progress of the target service. At this time, the terminal device needs to update the content of the service display page according to the real-time progress. For example, if the real-time progress seq value of the target service is 8 (indicating that the second main interactive user in the target service is interacting in the main area), and the displayed progress seq value of the service display page is 7 (indicating that the video image of the first main interactive user is in the main area of the service display page), it can be determined that the real-time progress information of the target service is inconsistent with the displayed progress information of the service display page. The terminal device can pull the video image of the second main interactive user and display the video image of the second main interactive user in the main area.

[0104] After the target service ends, the terminal device can detect that the target service is in the service end state at this time. The terminal device can obtain the interaction behavior data corresponding to the main interactive user and count the interaction success results (such as the number of correct answers of the interactive user in a quiz game, etc.) corresponding to each interactive user in the target service. Generate a result sorted list according to the interaction success results, and display the interaction behavior data and the result sorted list in the service result page. The service result page can also include a sharing function control. The local terminal user can trigger the sharing function control to trigger the terminal device to share the result sorted list and the interaction behavior data displayed in the service result page to the information publishing platform, so that the devices in the information publishing platform can access the result sorted list and the interaction behavior data. For example, when the target service is a quiz game, the terminal device can, after each game ends, obtain the answering video of the local terminal user as the main interactive user during the game process, and count the scores of each interactive user in this quiz game (such as the number of correctly answered questions, etc.) in each game; then it can sort the scores corresponding to each interactive user respectively to obtain a result sorted list, and display the result sorted list and the answering video in the result page of the quiz game. The local terminal user can trigger the sharing function control to make the terminal device share the result sorting and the answering video displayed in the result page to the information publishing platform or the friend terminal in the instant messaging application.

[0105] In an embodiment of the present application, the service display page for a target service in an instant messaging application may include a main area and a secondary area. The secondary area may be used to display interactive users participating in the target service, and the main area may be used to display the interactive behavior data of the selected user (i.e., the main interactive user). After determining the main interactive user from the target service, the main interactive user can be displayed in the main area, that is, the main interactive user can interact with other users in the main area, thereby enriching the interaction methods in the instant messaging application.

[0106] Please refer to Figure 5 , Figure 5 which is a schematic flowchart of a service data processing method provided by an embodiment of the present application. As Figure 5 shown, the service data processing method may include the following steps:

[0107] Step S201, in response to a trigger operation for a target service in an instant messaging application, display a service display page matching the target service, and display at least two interactive users in the secondary area of the service display page.

[0108] Specifically, in the service interaction scenario of the instant messaging application, a local terminal user can start a target service in the instant messaging application. When the local terminal user selects the target service and starts it, the terminal device can respond to the trigger operation for the target service in the instant messaging application, obtain the description information of the target service, such as the name of the target service, service execution rules, etc. information, determine the service type of the target service according to the description information, and display a service display page matching the service type. Different service types may correspond to different service display pages. In an embodiment of the present application, taking the service type as the type of taking turns to perform on stage as an example, the processing process of the target service is specifically described.

[0109] It can be understood that the target service is an interactive type of service, and the target service may have a limit on the number of members. When the number of users participating in the target service reaches the minimum limit, the local terminal user can start the target service to achieve the purpose of interacting with other users in the target service. Therefore, before starting the target service, the local terminal user also needs to invite other users to participate in the target service. The process of inviting users to join the target service can refer to step S101 in the corresponding embodiment above Figure 3 and will not be elaborated here.

[0110] When the service type of the target service is the type of taking turns to perform on stage, the service display page may include a secondary area and a main area (as described above Figure 2the secondary area 20f and the primary area 20e) in the corresponding embodiment. After starting the target service, the terminal device can display at least two interactive users in the secondary area of the service display page, and the at least two interactive users in the secondary area can be displayed in the form of video pictures. Among them, the secondary area can have a fixed display position in the service display page, and all the video pictures displayed in the secondary area can have the same display size; the at least two interactive users are all users who have joined the target service, and the display position of the video picture of the interactive user in the secondary area can be determined by the time when the interactive user joins the target service. The earlier the interactive user joins the target service, the more forward the display position in the secondary area. For example, if the local terminal user is the first member in the target service, that is, the local terminal user is the first interactive user to join the target service, the video picture of the local terminal user can be displayed in the first position of the secondary area. Of course, the display position of the video picture of the interactive user in the secondary area can also be random, and no specific limitation is made here. The primary area is only used to display the interactive behavior data of the primary interactive user (which can be understood as the interactive user selected from at least two interactive users) in the target service. Before the primary interactive user is selected, no video picture of any interactive user may be displayed in the primary area of the service display page. The primary area can also have a fixed display position in the service display page. The primary area and the secondary area can be two non-overlapping independent areas in the service display page.

[0111] Step S202: In response to the confirmation operation for the secondary area, determine the primary interactive user from at least two interactive users, and display the primary interactive user in the primary area of the service display page.

[0112] Specifically, for the video pictures respectively corresponding to the at least two interactive users displayed in the secondary area, the terminal device can, in response to the confirmation operation for the secondary area, select the first interactive user in the secondary area as the primary interactive user from at least two interactive users. Among them, the confirmation operation can refer to the confirmation instruction sent by the server to the terminal device. For example, after starting the target service, the server can detect that the state of the target service has changed from the unstarted state to the started state, and then can send a confirmation instruction to the terminal device. After receiving the confirmation instruction sent by the server, the terminal device can determine the primary interactive user from at least two interactive users of the target service according to the confirmation instruction. It can be understood that the at least two interactive users in the target service can be sequentially selected as the primary interactive user according to the display order in the secondary area. For example, the first interactive user in the secondary area can be used as the first primary interactive user in the target service. When the first interactive user completes the interaction in the target service, the second interactive user in the secondary area can be used as the next primary interactive user, and so on.

[0113] After determining the primary interactive user from at least two interactive users, the terminal device can switch the video image of the primary interactive user in the secondary area to the corresponding avatar of the primary interactive user, and switch the video image of the primary interactive user from the secondary area to the primary area in the service display page, where the size of the video image displayed in the primary area is larger than that displayed in the secondary area, that is, at this time, both the primary area and the secondary area in the service display page can display the primary interactive user. It can be understood that when the first interactive user displayed in the secondary area is selected as the primary interactive user and the video image of the primary interactive user is displayed in the primary area, the primary interactive user can still be displayed in the secondary area in the form of an avatar, and the display position remains unchanged.

[0114] Optionally, the display positions of at least two interactive users in the target service in the secondary area can be continuously updated. For example, before selecting the primary interactive user, the display positions of at least two interactive users in the secondary area can be determined by the time when the interactive users join the target service. After the terminal device selects the first interactive user as the primary interactive user and switches the video image of the primary interactive user from the secondary area to the primary area, the primary interactive user can be temporarily not displayed in the secondary area, and the interactive users behind the primary interactive user in the secondary area can be moved forward in order; when the primary interactive user finishes the interaction and returns to the secondary area, the video image of the primary interactive user can be displayed at the end of the secondary area, and so on, to update the display positions of at least two interactive users in the secondary area. For example, if there are 4 interactive users in the target service, namely User 1, User 2, User 3, and User 4, before selecting the primary interactive user, the display order of the above 4 users in the secondary area is: User 1 - User 2 - User 3 - User 4. When User 1 is selected as the primary interactive user, the video image of User 1 can be switched from the secondary area to the primary area. At this time, the display order of the users in the secondary area is: User 2 - User 3 - User 4. When User 1 finishes the interaction, User 1 can exit from the primary area and return to the secondary area. At this time, the display order of the users in the secondary area is: User 2 - User 3 - User 4 - User 1.

[0115] Step S203: Output the interaction behavior data of the primary interactive user for the task content in the target service, and the feedback behavior data of the secondary interactive user for the interaction behavior data.

[0116] Specifically, when the primary interactive user is a local terminal user, the terminal device can obtain the task content for the local terminal user in the target service and display the task content in the primary area. The terminal device can collect the interactive behavior data of the local terminal user for the task content in real time and output the interactive behavior data of the local terminal user for the task content in the target service. At the same time, the secondary interactive user in the target service can give feedback on the interactive behavior data of the local terminal user. The user terminal corresponding to the secondary interactive user can also collect the feedback behavior data of the secondary interactive user for the interactive behavior data in real time and send the feedback behavior data to the server. The server can send the received feedback behavior data to the local terminal device, and then output the feedback behavior data of the secondary interactive user in the target service. Among them, the secondary interactive user refers to the interactive user other than the primary interactive user among at least two interactive users in the target service. The task content can be the performance topic of the primary interactive user in the target service. The task content can be text content, or image content, or audio content, etc. The interactive behavior data can be at least one of video frame data (such as the body movement picture of the local terminal user for the task content) and audio data (such as the voice description of the local terminal user for the task content). The feedback behavior data can be audio data (such as the answer to the task content given by the secondary interactive user according to the interactive behavior data).

[0117] For example, if the target service is the "You Act I Guess" game and the task content is "The baby is angry", the local terminal user can use expressions, body language, and language hints (without saying the task content) to perform the task content. The secondary interactive user can see the expressions, body language, and language hints of the local terminal user from the primary area and conduct a quick answer based on the information such as the expressions, body language, and language hints of the local terminal user. When the secondary interactive user conducts a quick answer, they can directly use their voice. At this time, the information such as the expressions, body language, and language hints of the local terminal user for the task content is the interactive behavior data, and the voice quick answer of the secondary interactive user for the task content is the feedback behavior data.

[0118] Step S204: Send the collected interactive behavior data to the server and receive the interaction result determined by the server based on the interactive behavior data and the feedback behavior data.

[0119] Specifically, the terminal device can send the collected interactive behavior data for the task content to the server, and the server can receive the interactive behavior data of the local terminal user for the task content, as well as the feedback behavior data of the auxiliary interactive user for the interactive behavior data. According to the interactive behavior data and the feedback behavior data, the interactive result corresponding to the task content can be obtained, and the final interactive result can be sent to the terminal device. Among them, the interactive result can include an interactive success result, an interactive failure result, and a replacement task. When the interactive behavior data contains the above-mentioned task content, the server can determine that the interactive result corresponding to the task content is a replacement task, that is, the task content has been invalidated and a new task content needs to be obtained; when there is an auxiliary interactive user corresponding to the feedback behavior data that is the same as the task content, the server can determine that the interactive result corresponding to the task content is an interactive success result, that is, the auxiliary interactive user has given the correct result of the task content; when there is no auxiliary interactive user feedback behavior data in the target business that is the same as the task content, the server can determine that the interactive result corresponding to the task content is an interactive failure result, that is, the auxiliary interactive user has not given the correct result of the task content within the specified time.

[0120] As in the above example, if the local terminal user accidentally says the five words "the baby is angry", it means that the interaction result corresponding to the task content is changing the task; if there is an auxiliary interactive user in the target business who says the five words "the baby is angry", it means that the interaction result corresponding to the task content is a successful interaction result, that is, there is an auxiliary interactive user who successfully answers the question; if there is no auxiliary interactive user in the target business who says the five words "the baby is angry", it means that the interaction result corresponding to the task content is a failed interaction result, that is, all auxiliary interactive users in the target business failed to answer the question successfully.

[0121] Step S205: display prompt information associated with the interaction result in the business display page, and update the task content in the target business according to the prompt information.

[0122] When the terminal device receives the interactive result returned by the server, the prompt information associated with the interactive result can be displayed on the business display page, and the task content displayed in the main area can be updated. If the interactive result received by the terminal device is a successful interactive result, it means that there is an auxiliary interactive user in the target business who successfully answers the correct answer to the above task content within the specified time (each task content can be limited to a time, and answering the correct answer within the specified time is considered a successful answer). The prompt information associated with the successful interactive result can be displayed on the business display page. The prompt information may include cheering effects, the correct answer corresponding to the above task content, and the user information of the auxiliary interactive user who said the correct answer, etc., and then the task content can be updated, and the interaction with the auxiliary interactive user in the main area can continue. If the interaction result received by the terminal device is an interaction failure result, it means that no auxiliary interactive user in the target business has successfully answered the correct answer to the above task content within the specified time. The prompt information associated with the interaction failure result can be displayed on the business display page. The prompt information may include the correct answer corresponding to the above task content, etc. That is, when no auxiliary interactive user answers the correct answer, the terminal device can present the correct answer, and then the task content can be updated, and the interaction with the auxiliary interactive user in the main area can continue. If the interaction result received by the terminal device is a task replacement, it means that the target user gave the correct answer to the above task content during the interaction process. The prompt information associated with the task replacement can be displayed on the business display page. The prompt information can be "xx accidentally gave the correct answer, skip to the next question", and then the task content can be updated, and the interaction with the auxiliary interactive user in the main area can continue.

[0123] It can be understood that at least two interactive users included in the target business can be selected as main interactive users in turn, and the interaction time of the main interactive users can be pre-set, such as the interaction time of each main interactive user is 120s. After the local terminal user interacts in the main area for 120s, the next main interactive user can be selected from the auxiliary area, and the video screen of the next main interactive user can be switched from the auxiliary area to the main area. When at least two interactive users in the target business are selected as main interactive users, the prompt message "Business ended" can be displayed on the business display page, that is, the target business is in the business ended state at this time.

[0124] Optionally, after the target service is started, the terminal device can start a timer (such as a Timer timer) and use the timer to check for updates to the service data in the target service, driving the service display page to show different scenarios and page information. Among them, the service data can include task content, function control icons, prompt messages, cheering animations, and other information in the target service. For example, when the interaction time of the local terminal user in the main area reaches 120s, the video image of the local terminal user needs to be switched from the main area to the secondary area, and the timer is used to drive the terminal device to obtain the video image of the next main interaction user and display the video image of the next main interaction user in the main area. If the terminal device fails to obtain the interaction behavior data of the next main interaction user within the agreed time after the video image of the local terminal user is switched to the secondary area, it indicates that the terminal device fails to obtain data, and the local terminal user can be prompted with a network exception on the service display page.

[0125] Optionally, in the target service, when the local terminal user interacts as the main interaction user in the main area, the terminal device can record the interaction behavior data of the local terminal user output in the target service. During video recording, the content of the frame buffer object (FBO) is read through shared memory. At the same time, the prompt message corresponding to the successful interaction result during the interaction process of the local terminal user is converted into a bitmap texture, and the interaction behavior data and the bitmap texture are fused to obtain an interaction video associated with the local terminal user. After the target service ends, the interaction video recorded by the local terminal user during the interaction can be obtained, and a result sorted list associated with at least two interaction users in the target service can be obtained, and the interaction video and the result sorted list are displayed on the service result page, and the service result page can also be shared with friends in the instant messaging application.

[0126] Please also refer to Figures 6a to 6c , Figures 6a to 6c is a schematic diagram of an interface for processing service data provided by an embodiment of the present application. Taking the target service as the "You Act I Guess" game as an example, the data processing process in the target service of the type of taking turns to perform on stage is specifically described. As Figure 6aAs shown, when user A creates a game room (which can also be called a business session) in the instant messaging application of terminal device 40a (user A can be called the local terminal user corresponding to terminal device 40a), and invites users B, C, D, E, F, G, and H to successfully join the game room, user A can click to trigger the "Start Game" function control in the game room. As a result, terminal device 40a can respond to the trigger operation for the "Start Game" function control and display a business display page in the instant messaging application that matches the "You Act and I Guess" game. This business display page can include a main area 40b and a secondary area 40c. Terminal device 40a can obtain the video images corresponding to each user in the game room and display the video images corresponding to each user in secondary area 40c. When user A clicks to trigger the "Start Game" function control, the background server of the instant messaging application can detect that the "You Act and I Guess" game has switched from the unstarted state to the started state, and can send a confirmation instruction to the terminal device to instruct terminal device 40a to sequentially select user A as the main interaction user from secondary area 40c and switch the video image of user A from secondary area 40c to be displayed in main area 40b. At this time, the video image of user A can be displayed in main area 40b, and the avatar 40g of user A can be displayed at the display position of user A in secondary area 40c. It can be understood that the process of selecting user A as the main interaction user from all users and switching the video image of user A to be displayed in main area 40b is completed by terminal device 40a in a very short time.

[0127] After pulling the video image of user A into main area 40b, the game can enter a countdown (such as a 5-second countdown), and a prompt message 40d (such as "User A gives the first question, and the guessing starts after a 5-second countdown") and countdown numbers such as 5, 4, 3, 2, 1 are displayed in main area 40b of terminal device 40a. During the countdown, user A can preview their own video image in main area 40b of terminal device 40a to make preparations and confirm before answering the question. After the countdown ends, the question 40f (which can also be called the task content) given for user A can be displayed in main area 40b of terminal device 40a, and this question 40f can be "Face life with a smile". Among them, each main interaction user can have 120s of interaction time (which can also be called the performance time), and each question can also have a time limit. For example, the answering time for each question is 15 seconds. The other users in the game except user A (which can also be called the secondary interaction users) need to rush to answer within the time limit. Therefore, the remaining performance time of the main interaction user can also be displayed in main area 40b.

[0128] It should be understood that only the main interactive user can see the content of the questions in the game, and the rest of the users cannot see the question content. That is, the question 40f can be displayed in the main area 40b corresponding to user A, and the question 40f will not be displayed in the main areas corresponding to the rest of the users. As Figure 6b shown, the business display page of the rest of the users also includes the main area 40b and the secondary area 40c. When user A is selected as the first main interactive user in the game and the game enters the countdown, the avatar 40g of user A can be displayed at the display position of user A in the secondary area 40c of the rest of the users. However, only the prompt message 40d (such as "User A sets the first question, and the guessing starts after a 5-second countdown") and the countdown numbers 5, 4, 3, 2, 1, etc. will be displayed in the main area 40b, and the video picture of user A will not be displayed temporarily. After the countdown ends, the video picture of user A and the performance time of user A can be displayed in the main area 40b.

[0129] As Figure 6a shown, the main area 40b of the terminal device 40a can output the performance data (i.e., interactive behavior data) of user A for the question 40f. The rest of the users can conduct a rush to answer during the performance of user A. Through voice recognition technology, the rush-to-answer voices of the rest of the users can be recognized in real time to detect whether the keywords in the question 40f are hit. If it is detected that the rest of the users hit the keywords in the question 40f within the specified time, it means that the rush to answer is successful, and a prompt message 40j indicating the successful rush to answer can be displayed on the business display page. The prompt message 40j can include: the correct answer to the question 40f, the avatar or video picture of the user F who successfully rushed to answer, and cheering special effects, etc. The user who successfully rushes to answer can obtain points. For example, if a question is successfully rushed to answer, 100 points can be obtained; if it is detected that the rest of the users do not hit the keywords in the question 40f within the specified time, it means that the rush to answer fails, and a prompt message 40k indicating the failed rush to answer can be displayed on the business display page, and the correct answer to the question 40f will be given in the prompt message 40k.

[0130] The terminal device 40a can also collect the voice data of user A and send the collected voice data to the background server. The background server can perform real-time recognition on the voice of user A. If user A accidentally says the correct answer to the question 40f, a prompt message 40h (such as "You accidentally said the answer. Skip to the next question") can be displayed in the main area 40b to notify user A that it will jump to the next question 40i (such as "Staring in disbelief"), and the rest of the users can continue to conduct a rush to answer for the question 40i based on the performance of user A.

[0131] When the performance of User A ends, that is, after the performance time of User A reaches 120 seconds, the video image of User A can be retrieved and displayed in the secondary area 40c. Then, continue to select User B in the secondary area 40c as the next active user, switch the video image of User B from the secondary area 40c to the main area 40b, display the avatar 40m of User B at the position where User B is shown in the secondary area 40c, and the performance data of User B can be output in the main area 40b of the terminal device 40a. User A can perform a quick answer based on the performance data of User B.

[0132] In this game, users in the secondary area 40c can be sequentially selected as the main interactive users. For example, Figure 6c as shown, when the performance of the last user in the secondary area 40c ends, a prompt message 40n (such as "The game is over") can be displayed in the main area 40b, and then jump from the service display page to the service result page 40p. In the service result page 40p, a personal highlight clip video 40q (i.e., the above-mentioned interactive video, the wonderful moments of each user during the performance) and a game leaderboard 40r (i.e., a list of users sorted according to the scores of each user, such as the first place is User A with a score of 12000; the second place is User E with a score of 900, and the third place is User D with a score of 800, etc.) can be displayed. User A can download the clip video 40q to the local of the terminal device 40a. The service result page 40p also includes a "Share" function control. User A can trigger the "Share" function control in the service result page 40p, so that the terminal device 40a shares the service result page 40p in the form of an H5 dynamic web page with friends.

[0133] Optionally, in the "You Act and I Guess" game, the questions for the main interactive user can be various emoji pictures. The main interactive user can imitate the expressions represented by the emoji pictures in the questions. Each emoji picture can correspond to expression description text, such as the expression description text corresponding to a certain emoji picture is "Smile", etc.; the other users can perform a quick answer based on the performance of the main interactive user. The background server can perform real-time recognition on the voices of the other users. If it is detected that the other users hit the expression description text corresponding to the emoji picture within the specified time, it means the quick answer is successful, and a prompt message for successful quick answer can be displayed on the service display page. The user who answers successfully can obtain points; if it is detected that the other users do not hit the expression description text corresponding to the emoji picture within the specified time, it means the quick answer fails, and a prompt message for failed quick answer can be displayed on the service display page and the expression description text corresponding to the emoji picture in the question can be given.

[0134] Optionally, in the target service of the type of taking turns to perform on stage, the questions for the main interactive user can be various meme pictures. The main interactive user can imitate the expressions shown in the meme pictures in the questions. The background server can perform real-time expression recognition on the video image of the main interactive user. If it is detected that the video image of the main interactive user matches the meme picture in the question, it means that the main interactive user's performance is successful and can obtain points; if it is detected that the video image of the main interactive user does not match the meme picture in the question within the specified time, it means that the main interactive user's performance fails and cannot obtain points.

[0135] Optionally, based on the service display page corresponding to the type of taking turns to perform on stage, an interactive video game can be carried out. All interactive users in the interactive video game can conduct a voice vote on the played video. According to the number of votes of the interactive users for the played video, the plot direction of the video can be determined. Please refer to Figure 7 , Figure 7 is an interface display diagram of video interaction provided by an embodiment of the present application. As Figure 7 shown, when the game room includes user Xia A (user Xia A can be called the local terminal user corresponding to the terminal device 50a), user Xia B, user Xia C, user Xia D, user Xia E, user Xia F, user Xia G, and user Xia H, user Xia A can start an interactive video game in the instant messaging application of the terminal device 50a. The terminal device 50a can respond to the trigger operation of user Xia A and display a service display page associated with the interactive video game in the instant messaging application. The service display page can include a main area and a secondary area 50b. The secondary area 50b can be used to display the video images corresponding to user Xia A, user Xia B, user Xia C, user Xia D, user Xia E, user Xia F, user Xia G, and user Xia H respectively; the video 50c to be played can be obtained and played in the main area. When the video 50c plays to the plot selection node, multiple plot options can be displayed in the area 50d of the service display page. For example, option A is: use superpowers, option B is to call friends for help, and option C is: get injured. Among them, the area 50d can belong to the main area, and the plot selection node can be set in advance. For example, a 5-minute duration can be used as the plot selection period, the 5-minute time point can be used as the plot selection node, and the 10-minute time point can also be used as the plot selection node. That is, when the video 50c plays to 5 minutes, the video 50c can be paused and multiple plot options can be displayed in the area 50d of the service display page. Different plot options indicate that the subsequent playing plot of the video 50c will be different.

[0136] Users included in the secondary area 50b can discuss together and conduct a voice vote to select the plot option with the most votes as the subsequent plot direction of the video 50c. For example, users Xiaof, Xiaoe, Xiaoh, and Xiaoc in the secondary area 50b all select plot option A as the subsequent plot direction of the video 50c, users Xiaoa and Xiaod both select plot option B as the subsequent plot direction of the video 50c, and users Xiaob and Xiaog both select plot option C as the subsequent plot direction of the video 50c. The plot option with the highest number of votes (the number of votes for plot option A is 4, the number of votes for plot option B is 2, and the number of votes for plot option C is 2) is used as the subsequent plot development direction of the video 50c, that is, the video 50c is continued to be played in the main area according to the plot development in plot option A. Discussing the video plot together through video chat can enhance the user's immersion.

[0137] In the embodiment of the present application, the service display page for the target service in the instant messaging application may include a main area and a secondary area. The secondary area may be used to display interactive users participating in the target service, and the main area may be used to display the interactive behavior data of the selected user (i.e., the main interactive user). After determining the main interactive user from the target service, the main interactive user can be displayed in the main area, that is, the main interactive user can interact with the remaining users in the main area, thereby enriching the interaction methods in the instant messaging application; after selecting the main interactive user from the interactive users, the video screen of the main interactive user can be switched from the secondary area to the main area for display, and the size of the video screen displayed in the main area is larger than the size of the video screen displayed in the secondary area, so that the interactive users in the target service can quickly locate the video screen of the main interactive user and view the interactive content output in the video screen of the main interactive user, which can reduce the probability of requiring the main interactive user to provide the same interactive content again, thereby saving data traffic.

[0138] Please refer to Figure 8 , Figure 8 is a schematic flowchart of a service data processing method provided by an embodiment of the present application. As Figure 8 shown, the service data processing method may include the following steps:

[0139] Step S301, in response to a trigger operation for a target service in the instant messaging application, display a service display page matching the target service.

[0140] Specifically, in the embodiment of the present application, taking the service type as the sitting-in-a-circle type as an example, the processing process of the target service is specifically described.

[0141] When the service type of the target service is the type of sitting in a circle, the service display page may include an operation area and an auxiliary area. The operation area may be used to display operation controls in the target service, and the auxiliary area may be used to display video images corresponding to at least two interactive users in the target service. The operation area and the auxiliary area are two independent areas in the service display page without overlap, and the display sizes of the operation area and the auxiliary area in the service display page are associated with the number of interactive users in the target service.

[0142] Step S302, determine the display size corresponding to the auxiliary area in the service display page according to the total number of at least two interactive users. Divide the auxiliary area into at least two unit auxiliary areas according to the total number of users and the display size corresponding to the auxiliary area, and display at least two interactive users in at least two unit auxiliary areas respectively.

[0143] Specifically, the terminal device can obtain the total number of at least two interactive users in the target service, and can determine the display sizes corresponding to the auxiliary area and the operation area respectively according to the total number of users. Furthermore, the auxiliary area can be divided into at least two unit auxiliary areas according to the total number of users and the display size corresponding to the auxiliary area. The number of corresponding unit auxiliary areas is the same as the total number of users. The terminal device can display the operation area in the service display page according to the display size corresponding to the operation area, and display the video images of at least two interactive users in at least two unit auxiliary areas respectively, that is, the video image of one interactive user can be displayed in each unit auxiliary area.

[0144] It can be understood that the target service may have a limit on the number of members. For example, the lower limit of the members of the target service can be 4, and the upper limit can be 8. That is, when the total number of interactive users in the target service does not reach 4, the target service cannot be started and needs to wait for the addition of other users; when the total number of interactive users reaches 4, the target service can be started. After the total number of interactive users reaches 8, the number of interactive users included in the target service has reached the upper limit, and other users cannot join the target service anymore. The total number of interactive users is different, and the display sizes of the video images displayed in the auxiliary area of the service display page will be different. When the total number of interactive users is 8, reference can be made to the Figure 2 game display page corresponding to the type of sitting in a circle in the corresponding embodiment described above, which will not be elaborated here.

[0145] Please refer to Figures 9a to 9d , Figures 9a to 9d which is a schematic diagram of a service page provided by an embodiment of the present application. As Figure 9aAs shown, when the total number of interactive users in the target service is 4, the service display page shown on the terminal device 60a may include: area 60b, area 60c, area 60d, area 60e, and operation area 60f. Among them, areas 60b, 60c, 60d, and 60e may jointly form the auxiliary area in the service display page. Areas 60b, 60c, 60d, and 60e can all be referred to as unit auxiliary areas. Area 60b is used to display the video image of interactive user 1 in the target service, area 60c is used to display the video image of interactive user 2 in the target service, area 60d is used to display the video image of interactive user 3 in the target service, area 60e is used to display the video image of interactive user 4 in the target service, and the operation area 60f can be used to display the operation controls in the target service, such as the "start" operation control, etc. The "start" operation control can be used to trigger the terminal device to determine and select the main interactive user from all the interactive users in the target service.

[0146] Optionally, as Figure 9b As shown, when the total number of interactive users in the target service is 5, the service display page shown on the terminal device 60a may include: area 60g, area 60h, area 60i, area 60j, area 60k, and operation area 60f. Among them, areas 60g, 60h, 60i, 60j, and 60k may jointly form the auxiliary area in the service display page. Areas 60g, 60h, 60i, 60j, and 60k can all be referred to as unit auxiliary areas. Area 60g is used to display the video image of interactive user 1 in the target service, area 60h is used to display the video image of interactive user 2 in the target service, area 60i is used to display the video image of interactive user 3 in the target service, area 60j is used to display the video image of interactive user 4 in the target service, area 60k is used to display the video image of interactive user 5 in the target service, and the operation area 60f can be used to display the operation controls in the target service.

[0147] Optionally, as Figure 9cAs shown, when the total number of interactive users in the target service is 6, the service display page shown on the terminal device 60a may include: area 60m, area 60n, area 60p, area 60q, area 60r, area 60s, and an operation area. Among them, area 60m, area 60n, area 60p, area 60q, area 60r, and area 60s may jointly form the auxiliary area in the service display page. Area 60m, area 60n, area 60p, area 60q, area 60r, and area 60s may all be referred to as unit auxiliary areas. Area 60m is used to display the video image of interactive user 1 in the target service, area 60n is used to display the video image of interactive user 2 in the target service, area 60p is used to display the video image of interactive user 3 in the target service, area 60q is used to display the video image of interactive user 4 in the target service, area 60r is used to display the video image of interactive user 5 in the target service, area 60s is used to display the video image of interactive user 6 in the target service, and the operation area may be used to display the operation controls in the target service.

[0148] Optionally, as Figure 9d shown, when the total number of interactive users in the target service is 7, the service display page shown on the terminal device 60a may include: area 60t, area 60u, area 60v, area 60w, area 60x, area 60y, area 60z, and an operation area. Among them, area 60t, area 60u, area 60v, area 60w, area 60x, area 60y, and area 60z may jointly form the auxiliary area in the service display page. Area 60t, area 60u, area 60v, area 60w, area 60x, area 60y, and area 60z may all be referred to as unit auxiliary areas. Area 60t is used to display the video image of interactive user 1 in the target service, area 60u is used to display the video image of interactive user 2 in the target service, area 60v is used to display the video image of interactive user 3 in the target service, area 60w is used to display the video image of interactive user 4 in the target service, area 60x is used to display the video image of interactive user 5 in the target service, area 60y is used to display the video image of interactive user 6 in the target service, area 60z is used to display the video image of interactive user 7 in the target service, and the operation area may be used to display the operation controls in the target service.

[0149] Step S303, in response to the start instruction for the operation control, perform a polling traversal on at least two interactive users in the auxiliary area.

[0150] Specifically, the operation area on the service display page includes operation controls. The confirmation operation can include a start instruction and a stop instruction. When a local terminal user triggers an operation control, the terminal device can respond to the start instruction for the operation control and poll at least two interactive users in the secondary area. Herein, both the start instruction and the stop instruction can be an instruction generated according to a user operation, or an instruction generated according to a user voice, or an instruction sent by a server, etc. The polling method can be clockwise rotation polling or counterclockwise rotation polling.

[0151] Optionally, the operation control can include a "start" function control. The way to trigger the "start" function control can be click trigger, long press (i.e., the terminal device detects through a pressure sensor that the duration of the local terminal user pressing the terminal screen reaches a duration threshold, such as 2 seconds, etc.) trigger, voice trigger (such as detecting that the local terminal user shouts "start"), etc. For example, when there are 8 interactive users in the target service, the operation area can be located in the central area of the service display page, and the secondary area is the remaining area outside the operation area on the service display page. In the secondary area, the video images of the 8 interactive users can be displayed around the operation area. When the local terminal user clicks to trigger the "start" function control, the terminal device can respond to the click trigger operation for the "start" function control and poll at least two interactive users in the secondary area in a clockwise rotation manner.

[0152] Step S304: Respond to the stop instruction for the operation control, stop polling at least two interactive users in the secondary area, and determine the interactive user pointed to when the polling stops as the main interactive user.

[0153] Specifically, during the process of polling at least two interactive users in the secondary area, the terminal device can respond to the stop instruction for the operation control, stop polling at least two interactive users in the secondary area, and use the interactive user indicated when the polling stops as the main interactive user. For example, when the interactive user indicated when the polling stops is interactive user 5 in the target service, interactive user 5 can be determined as the main interactive user.

[0154] Optionally, the operation control can include a "stop" function control. The way to trigger the "stop" function control can also be click trigger, long press trigger, voice trigger (such as detecting that the local terminal user shouts "stop"), etc. As in the previous example, in the secondary area, the video images of the 8 interactive users can be displayed around the operation area. When the local terminal user triggers the "stop" function control by voice, the terminal device can respond to the voice trigger operation for the "stop" function control, stop polling at least two interactive users in the secondary area, and determine the interactive user 5 indicated when the polling stops as the main interactive user.

[0155] Optionally, when the operation controls in the service display page include a "start" function control and a "stop" function control, the "start" function control and the "stop" function control can be displayed in the operation area simultaneously, that is, in the target service, the "start" function control and the "stop" function control can always be displayed in the operation area; or the "start" function control and the "stop" function control can also be staggeredly displayed in the operation area. For example, first display the "start" function control in the operation area. After the terminal device polls and traverses at least two interactive users in the secondary area in response to the start instruction for the "start" function control, the "start" function control displayed in the operation area can be hidden, and the "stop" function control can be displayed in the operation area. Then, in response to the stop instruction for the "stop" function control, the interactive user pointed to when the polling traversal stops can be determined as the main interactive user, and the video picture corresponding to the main interactive user can be determined as the target video picture. Optionally, the "start" function control and the "stop" function control can also not be displayed in the operation area. The user can trigger the "start" function control and the "stop" function control in a voice-triggered manner, or only the "start" function control is displayed in the operation area and the "stop" function control is hidden. The user can trigger the "stop" function control in a voice-triggered manner, etc. There is no specific limitation here.

[0156] Step S305: Highlight the display area of the main interactive user in the secondary area, and determine the highlighted display area as the main area in the service display page.

[0157] Specifically, the terminal device can highlight the display area of the main interactive user in the secondary area, that is, highlight the unit secondary area corresponding to the video picture of the main interactive user, and determine the highlighted unit secondary area as the main area in the service display page. It can be understood that in this service display page, the video pictures of the interactive users displayed in the secondary area can be located around the operation area. After selecting the main interactive user through the polling traversal method, the display area of the main interactive user in the secondary area can be used as the main area in the target service. When the main interactive user in the target service changes, the main area in the service display page can also change accordingly. At this time, the main area in the service display page is a part of the secondary area. When the video picture of the main interactive user is displayed in the main area, visually, the display form of the main interactive user in the service display page has changed (highlighted), but the display position of the main interactive user in the service display page and the display size corresponding to the video picture of the main interactive user have not changed.

[0158] Step S306: Display the task content in the main area, and output the interactive behavior data of the main interactive user for the task content.

[0159] Specifically, after displaying the main interactive user in the main area, the terminal device can obtain the task content for the main interactive user and display the task content in the main area. The terminal device can obtain the interactive behavior data of the main interactive user for the task content and output the interactive behavior data corresponding to the main interactive user in the target service. Among them, the task content may refer to the performance topic of the main interactive user in the target service, and the interactive behavior data may include the body movements, voice data, facial expression movements, etc. of the main interactive user for the task content.

[0160] Optionally, when the main interactive user is the local terminal user, the terminal device can use the camera and microphone to collect the interactive behavior data of the local terminal user for the task content, output the interactive behavior data of the local terminal user for the task content in the target service, and the local terminal user can send the interactive behavior data to the server, and the server can transmit the interactive behavior data corresponding to the local terminal user to the user terminal corresponding to the secondary interactive user. Among them, the secondary interactive user refers to the interactive user other than the main interactive user among at least two interactive users in the target service. When the main interactive user is not the local terminal user, the terminal device can receive the interactive behavior data of the main interactive user for the task content sent by the server and output the interactive behavior data of the main interactive user in the target service.

[0161] Step S307: Obtain the number of votes of the secondary interactive user for the interactive behavior data. When the number of votes is greater than or equal to the quantity threshold, reselect the main interactive user from the secondary area; when the number of votes is less than the quantity threshold, output the updated interactive behavior data of the main interactive user for the task content in the main area.

[0162] Specifically, the secondary interactive users in the target service can vote on the main interactive user according to the interactive behavior data of the main interactive user, that is, the secondary interactive users can act as judges for the main interactive user. When the secondary interactive user is satisfied with the interactive behavior data of the main interactive user for the task content, the secondary interactive user can vote for the main interactive user; when the secondary interactive user is not satisfied with the interactive behavior data of the main interactive user for the task content, the secondary interactive user can refrain from voting for the main interactive user.

[0163] Optionally, a voting function control can be included in the operation area corresponding to the secondary interaction user. The secondary interaction user can vote on the interaction behavior data of the primary interaction user for the task content by triggering the voting function control. When the local terminal user is the secondary interaction user, if the local terminal user is satisfied with the interaction behavior data of the primary interaction user for the task content, the voting function control in the operation area can be triggered. The terminal device can respond to the trigger operation for the voting function control, send the voting information of the local terminal user to the server. The server can count the number of votes for the primary interaction user based on the received voting information of the secondary interaction user, and return the number of votes to the terminals corresponding to each interaction user in the target service. Therefore, the terminal device can receive the number of votes for the primary interaction user returned by the server. When the number of votes is greater than or equal to the quantity threshold (for example, the quantity threshold can be one-half of the number of secondary interaction users), it indicates that more than the quantity threshold of secondary interaction users in the target service are satisfied with the interaction behavior data of the primary interaction user for the task content, and it can be determined that the primary interaction user has passed the task content. The terminal device can re-select the primary interaction user from the secondary area and continue the interaction in the target service. When the number of votes is less than the quantity threshold, it indicates that less than the quantity threshold of secondary interaction users in the target service are satisfied with the interaction behavior data of the primary interaction user for the task content, and it can be determined that the primary interaction user has not passed the task content. The terminal device can output the updated interaction behavior data of the primary interaction user for the task content in the target service, where the updated interaction behavior data can be understood as the behavior data of the primary interaction user performing the task content again.

[0164] Please refer to Figure 10a and Figure 10b , Figure 10a and Figure 10b are schematic diagrams of an interface for processing service data provided by an embodiment of the present application. Taking the target service as the "Truth or Dare" game as an example, the data processing process in the target service of the type sitting in a circle is specifically described. As Figure 10aAs shown in the figure, when the game room corresponding to the "Truth or Dare" game includes user A (user A can be referred to as the local terminal user corresponding to terminal device 70a), user B, user C, user D, user E, user F, user G, and user H, user A can click to trigger the "Start Game" function control in the game room, so that terminal device 70a displays a service display page matching the "Truth or Dare" game in the instant messaging application. The service display page can include an operation area and an auxiliary area. In the auxiliary area, the video image 70b of user A, the video image 70c of user B, the video image 70d of user C, the video image 70e of user D, the video image 70f of user E, the video image 70g of user F, the video image 70h of user G, and the video image 70i of user H can be displayed.

[0165] Since user A is the user who created the game room, that is, user A is the first user to join the game, and user A can be the first user to select a person in this game. Therefore, a "Start" function control can be displayed in the operation area corresponding to user A. When user A clicks (or uses voice) to trigger the "Start" function control, terminal device 70a can respond to the trigger operation for the "Start" function control and perform a polling traversal of the 8 interactive users in the auxiliary area, that is, perform a polling traversal of the video images of the 8 interactive users displayed in the auxiliary area, such as polling through video image 70b, video image 70c, video image 70d, video image 70e, video image 70f, video image 70g, video image 70h, and video image 70i in sequence. During the polling traversal process, a prompt message "Shout 'Stop' to immediately stop the rotation" can be displayed in the operation area. That is, user A can trigger the terminal device to stop the polling traversal by saying the voice "Stop", and use the interactive user indicated when the polling traversal stops as the main interactive user. Optionally, the polling traversal in this game can also be pre-set with a time limit, such as 10 seconds. When user A does not shout "Stop" within 10 seconds, a countdown can be entered, and countdown numbers such as 5, 4, 3, 2, 1, etc. can be displayed in the service display page. After the countdown ends, use the user G (i.e., the interactive user corresponding to video image 70h) indicated when the polling traversal stops as the main interactive user.

[0166] Terminal device 70a can determine the display area of the video image 70h of user G in the auxiliary area as the main area. That is, when user G is the main interactive user, the display area corresponding to video image 70h is the main area in the service display page at this time, and the video image 70h can be highlighted in the main area, such as highlighted display.

[0167] The terminal device 70a can obtain the task content 70j for user Little G (such as "Who do you like the most?"), and display the task content 70j in the main area. The terminal device 70a can obtain the performance data of user Little G for the task content 70j (i.e., interactive behavior data, such as the answer to the task content 70j "Who do you like the most?"), and output the performance data of user Little G for the task content 70j in the main area. At this time, user Little A is a secondary interactive user in this game. In the operation area corresponding to user Little A, a "pass" function control 70k (i.e., a voting function control) can be displayed. Hint information such as "Little G is answering" can also be displayed in this operation area. User Little A can determine whether to vote for user Little G based on the performance data of user Little G. If user Little A is satisfied with user Little G's answer to the task content 70j "Who do you like the most?", the "pass" function control 70k can be triggered to vote for user Little G; if user Little A is not satisfied with user Little G's answer to the task content 70j "Who do you like the most?", the "pass" function control 70k does not need to be triggered. When more than half of the secondary interactive users vote for user Little G, that is, more than half of the secondary interactive users are satisfied with user Little G's answer, the next round of the game can be entered. It can be understood that the next round of the game can be triggered by the main interactive user in the previous round to select a person by clicking the "start" function control in the operation area. That is, in the next round of the game, user Little G triggers the "start" function control to select the main interactive user in the next round of the game. When user Little G does not trigger the "start" function control, a hint message "Waiting to start..." can be displayed in the operation area of user Little A. In other words, when user Little G does not trigger the "start" function control, the "start" function control can be displayed in the operation area of user Little G, and the hint message "Waiting to start..." can be displayed in the operation areas of all other users except user Little G.

[0168] Optionally, when user Little G is selected as the main interactive user in the game, user Little G can have multiple opportunities to change the task content (the number of times to change the task content can be pre-set. For example, when set to 3 times, it means that each main interactive user has 3 opportunities to change the task content). Such as Figure 10bAs shown, the terminal device 70m is the user terminal held by user Xiaog. After user Xiaog is selected as the main interactive user, the task content 70p "Sing a love song" can be displayed in the display area (i.e., the main area) of the video screen 70h of user Xiaog, and the "Change Question" function control 70n can be displayed in the corresponding operation area of user Xiaog. If user Xiaog does not want to perform the task content 70p "Sing a love song", the "Change Question" function control 70n can be triggered. When user Xiaog clicks on the "Change Question" function control 70n, the terminal device 70m can respond to the click operation on the "Change Question" function control 70n, change the task content for user Xiaog, and switch the displayed task content 70p "Sing a love song" in the main area to the task content 70j "Who do you like the most?". If user Xiaog still does not want to answer the task content 70j "Who do you like the most?", the "Change Question" function control 70n can be triggered again to change the task content. When the number of times user Xiaog changes the task content is used up, user Xiaog cannot change the task content again.

[0169] In the embodiments of the present application, the service display page for the target service in the instant messaging application may include a main area and a secondary area. The secondary area can be used to display the interactive users participating in the target service, and the main area can be used to display the interactive behavior data of the selected user (i.e., the main interactive user). After determining the main interactive user from the target service, the main interactive user can be displayed in the main area, that is, the main interactive user can interact with the other users in the main area, thereby enriching the interaction methods in the instant messaging application; after selecting the main interactive user from the interactive users, the display area of the main interactive user in the secondary area can be determined as the main area, and the main area can be highlighted, so that the interactive users in the target service can quickly locate the video screen of the main interactive user and view the interactive content output in the video screen of the main interactive user, which can reduce the probability of requiring the main interactive user to provide the same interactive content again, thereby saving data traffic.

[0170] Please refer to Figure 11 , Figure 11 is a schematic flowchart of a service data processing method provided by the embodiments of the present application. As Figure 11 shown, the service data processing method may include the following steps:

[0171] Step S401, in response to a trigger operation for the target service in the instant messaging application, display a service display page matching the target service.

[0172] Specifically, in the embodiments of the present application, taking the service type as the group confrontation type as an example, the processing process of the target service is specifically described.

[0173] When the service type of the target service is a team confrontation type, the service display page may include a first secondary area, a second secondary area, a first primary area, and a second primary area (such as the secondary area 20h, the secondary area 20g, the primary area 20g, and the primary area 20i in the corresponding embodiment described above). In the target service of the team confrontation type, there may be at least two teams (which may also be referred to as user groups). Taking two teams as an example, each team may correspond to a secondary area and a primary area. The secondary area may be used to display the video images of the interactive users included in the corresponding team, and the primary area may be used to output only the interactive behavior data of the primary interactive user in the target service in the corresponding team. For example, if team A corresponds to the first secondary area and the first primary area, the first secondary area may be used to display the video images of the interactive users included in team A, and the first primary area may be used to output only the interactive behavior data of the primary interactive user in team A in the target service. Figure 2

[0174] Step S402: Group at least two interactive users according to the group identifiers respectively corresponding to the at least two interactive users to obtain a first user group and a second user group.

[0175] Specifically, in the target service of the team confrontation type, when an interactive user joins the target service, the interactive user can choose the team (i.e., user group) he wants to join by himself, or the terminal device can assign a team to the interactive user. Therefore, the terminal device can divide at least two interactive users in the target service according to the group identifier (such as information such as team name and team number) corresponding to the interactive user. Interactive users with the same group identifier can be divided into the same user group. When the group identifiers corresponding to at least two interactive users are of two types, the terminal device can divide the at least two users into two user groups, namely a first user group and a second user group.

[0176] Optionally, when the number of types of the group identifiers corresponding to at least two interactive users is greater than two, each type of group identifier corresponding interactive users can be divided into a user group, that is, the number of user groups can be a value greater than 2. For example, when the number of types of group identifiers is three, the terminal device can divide at least two interactive users into three user groups according to the group identifier; when the number of types of group identifiers is four, the terminal device can divide at least two interactive users into four user groups according to the group identifier. In the service display page, each user group may correspond to a secondary area and a primary area. The page display form when there are more than two user groups in the target service is similar to the page display form when there are two user groups. In the embodiments of the present application, hereinafter, the business data processing process proposed in the present application will be specifically described taking two user groups as an example.

[0177] ​Step S403: Display the interactive users included in the first user group in the first secondary area, and display the interactive users included in the second user group in the second secondary area.

[0178] Specifically, after the terminal device divides at least two interactive users into two user groups, it can display the video images corresponding to the interactive users included in the first user group in the first secondary area of the service display page, and display the video images corresponding to the interactive users included in the second user group in the second secondary area of the service display page. For example, when the first user group includes User 1, User 2, and User 3, the video images corresponding to User 1, User 2, and User 3 can be displayed in the first secondary area respectively. When the second user group includes User 4, User 5, and User 6, the video images corresponding to User 4, User 5, and User 6 can be displayed in the second secondary area respectively.

[0179] Optionally, in the service display page, the first secondary area and the second secondary area can have the same display size, and the video images of the interactive users displayed in the first secondary area and the second secondary area can also have the same display size.

[0180] Step S404: In response to the confirmation operation for the secondary area, determine the first interactive user from the first user group and determine the second interactive user from the second user group.

[0181] Specifically, in the target service of the grouped confrontation type, one main interactive user can be selected from each of the first user group and the second user group. That is, the main interactive users in the target service can include the first interactive user in the first user group and the second interactive user in the second user group. The terminal device can determine the first interactive user from the first user group displayed in the first secondary area and determine the second interactive user from the second secondary area according to the confirmation operation. Among them, the confirmation operation can refer to the confirmation instruction sent by the server to the terminal device. It can be understood that the interactive users included in the first user group can be alternately selected as the main interactive user (i.e., the first interactive user) in the first user group in turn, and the interactive users included in the second user group can be alternately selected as the main interactive user (i.e., the second interactive user) in the second user group in turn.

[0182] Step S405: Display the first interactive user in the first main area and display the second interactive user in the second main area.

[0183] Specifically, the terminal device can pull the video images of the first interactive user in the first secondary area to the first primary area for display, and pull the video images of the second interactive user in the second secondary area to the second primary area for display. It should be noted that the display positions of the interactive users included in the first user group in the first secondary area can be changed. Before selecting the first interactive user, the display positions of the interactive users in the first user group in the first secondary area can be determined by the time when the interactive users join the target service, or the display positions of the interactive users in the first user group in the first secondary area can be randomly determined. The display positions at this time can be referred to as the initial display positions of the interactive users in the first user group in the first secondary area. After the terminal device selects the main interactive user (i.e., the first interactive user) from the first user group and switches the video image of the first interactive user from the first secondary area to the first primary area for display, the first interactive user can be temporarily not displayed in the first secondary area, and the interactive users located behind the main interactive user in the first secondary area can be moved in sequence; when the first interactive user completes the interaction and returns to the first secondary area, the video image of the first interactive user can be displayed at the end of the first secondary area, and so on, to update the display positions of the interactive users in the first secondary area.

[0184] Similarly, the display positions of the interactive users included in the second user group in the second secondary area can also be changed, and the change process is the same as that of the interactive users included in the first secondary area, which will not be elaborated here.

[0185] Step S406, display the task content on the service display page, and output the interactive behavior data of the first interactive user and the second interactive user respectively for the task content.

[0186] Specifically, the terminal device can obtain the task content for the first interactive user and the second interactive user in the target service, and display the task content on the service display page. The task content can be independently displayed in the first primary area and the second primary area. The terminal device can also obtain the interactive behavior data of the first interactive user for the task content, and the interactive behavior data of the second interactive user for the task content, and output the interactive behavior data of the first interactive user for the task content, and the interactive behavior data of the second interactive user for the task content in the target service. For example, when the task content is the question "Is a whale a fish?", the interactive behavior data of the first interactive user for the task content can be: the voice answer given by the first interactive user, and the interactive behavior data of the second interactive user for the task content can be: the voice answer given by the second interactive user.

[0187] Optionally, the interactive behavior data output by the terminal device in the target service can be the behavior data collected locally by the terminal device or the behavior data received from the server. When the local terminal user is the main interactive user in the target service, such as the first interactive user, the terminal device can use the camera and microphone to collect the interactive behavior data of the first interactive user for the task content in real time and output the interactive behavior data corresponding to the first interactive user. The interactive behavior data can be the video data of the first interactive user (such as a video frame containing the expression of the first interactive user) or the voice data of the first interactive user (such as the answer related to the task content spoken by the first interactive user). The terminal device can send the interactive behavior data corresponding to the first interactive user to the server so that the server can send the received interactive behavior data corresponding to the first interactive user to the other interactive users except the first interactive user in the target service. Of course, at this time, the terminal device can receive the interactive behavior data of the second interactive user for the task content sent by the server. After receiving the interactive behavior data corresponding to the second interactive user, the terminal device can output the interactive behavior data corresponding to the second interactive user in the target service. Optionally, when the local terminal user is the secondary interactive user in the target service, the terminal device can receive the interactive behavior data of the first interactive user for the task content and the interactive behavior data of the second interactive user for the task content sent by the server.

[0188] Step S407: Receive the interaction result determined by the server according to the interaction behavior data corresponding to the first interactive user and the second interactive user respectively.

[0189] Specifically, after the server receives the interaction behavior data corresponding to the first interactive user and the interaction behavior data corresponding to the second interactive user, it can determine the interaction result with the task content according to the interaction behavior data corresponding to the first interactive user and the second interactive user respectively, and send the interaction result to the terminal device. Among them, when the interaction behavior data corresponding to the first interactive user contains the answer information of the task content, it can be determined that the interaction result of this task is: the interaction success result for the first interactive user; when the interaction behavior data corresponding to the second interactive user contains the answer information of the task content, it can be determined that the interaction result of this task content is: the interaction success result for the second interactive user; when neither the interaction behavior data corresponding to the first interactive user nor the interaction behavior data corresponding to the second interactive user contains the interaction result of this task content is: the interaction failure result. As in the previous example, the task content is the question "Is a whale a fish?", when the first interactive user first says the answer "No", the interaction result is: the interaction success result for the first interactive user; when the second interactive user first says the answer "No", the interaction result is: the interaction success result for the second interactive user; when neither the first interactive user nor the second interactive user says the answer "No" within the specified time, the interaction result is: the interaction failure result.

[0190] Step S408, according to the interaction result, update and display the first interactive user in the first main area and the second interactive user in the second main area respectively.

[0191] Specifically, the terminal device can update the main interactive users in the first user group and the second user group according to the interaction result returned by the server. Further, when the interaction result is the interaction success result corresponding to the first interactive user, the terminal device can switch the video picture of the second interactive user from the second main area to the second secondary area, and select the next interactive user from the second secondary area as the updated second interactive user, and display the video picture of the updated second interactive user in the second main area; when the interaction result is the interaction success result corresponding to the second interactive user, the terminal device can switch the video picture of the first interactive user from the first main area to the first secondary area, and select the next interactive user from the first secondary area as the updated first interactive user, and display the video picture of the updated first interactive user in the first main area. In other words, in the target service, the video pictures of the main interactive users who have successfully interacted between the first interactive user and the second interactive user can continue to be displayed in the main area, and the main interactive users who have failed to interact need to return to the secondary area to re-select the updated main interactive users except.

[0192] Optionally, when the interaction result is the interaction failure result corresponding to the task content, the terminal device may switch the video picture of the first interacting user from the first main area to the first secondary area, select the next interacting user from the first secondary area as the updated first interacting user, and display the video picture of the updated first interacting user in the first main area. At the same time, it is also necessary to switch the video picture of the second interacting user from the second main area to the second secondary area, select the next interacting user from the second secondary area as the updated second interacting user, and display the video picture of the updated second interacting user in the second main area. In other words, when both the first interacting user and the second interacting user fail in the target service, both the first interacting user and the second interacting user need to exit from the main area and return to their respective corresponding secondary areas.

[0193] Please refer to Figure 12a and Figure 12b , Figure 12a and Figure 12b FIG. 11 and FIG. 12 are schematic diagrams of an interface for processing service data provided by an embodiment of the present application. Taking the target service as the "Question and Answer PK" game as an example, the data processing process in the target service of the grouped confrontation type will be specifically described. As Figure 12a shown in FIG. 11, when the game room 80b corresponding to the "Question and Answer PK" game includes two teams, namely Team A (i.e., the first user group) and Team B (i.e., the second user group), the members of Team A may include: User A, User B, User C, and User D, and the video pictures of the members of Team A may be displayed in the area 80d of the game room 80b; the members of Team B may include: User E, User F, User G, and User H, and the video pictures of the members of Team B may be displayed in the area 80e of the game room 80b.

[0194] User A can click to trigger the "Start Game" function control in the game room, enabling the terminal device 80a to respond to the trigger operation for the "Start Game" function control and display a service display page matching the "Q&A PK" game in the instant messaging application. This service display page can include a main area 80h, a main area 80i, a secondary area 80f, and a secondary area 80g. The terminal device 80a can display the video images of all members of Team A in the secondary area 80f and the video images of all members of Team B in the secondary area 80g. When User A clicks to trigger the "Start Game" function control, the background server of the instant messaging application can detect that the "Q&A PK" game has switched from the unstarted state to the started state and send a confirmation instruction to the terminal device to instruct the terminal device 80a to sequentially select User A as the main interaction user from the secondary area 80f and switch the video image of User A from the secondary area 80f to the main area 80h. At this time, User A may not be temporarily displayed in the secondary area 80f, and User B temporarily becomes the first member in the secondary area 80f. Similarly, when the background server sends a confirmation instruction to the terminal device, it can also instruct the terminal device 80a to sequentially select User E as the main interaction user from the secondary area 80g and switch the video image of User E from the secondary area 80g to the main area 80i. At this time, User E may not be temporarily displayed in the secondary area 80g, and User F temporarily becomes the first member in the secondary area 80g.

[0195] After pulling the video image of User A to the main area 80h for display, the score obtained by User A in this game can also be displayed in the main area 80h. When the game has not officially started, the score of User A is 0; after pulling the video image of User E to the main area 80i for display, the score obtained by User E in this game can also be displayed in the main area 80i. When the game has not officially started, the score of User E is also 0. Of course, each game can have a time limit, and the time limit information of this game can be displayed in the main area 80h or the main area 80i, such as the time limit for each game is 120 seconds, etc.

[0196] The terminal device 80a can obtain the question 80j (such as "How does a dandelion spread its seeds") in the "Question and Answer PK" game and display the question 80j on the service display page. The question 80j can be independently displayed in the main area 80h and the main area 80i, or can be displayed at the intersection of the main area 80h and the main area 80i. Both user A and user E can rush to answer the question 80j. The rush-answer voice data corresponding to user A and user E can be collected respectively, and real-time recognition can be performed on the rush-answer voice data corresponding to user A and user E respectively through voice recognition technology. If the rush-answer voice data of user A hits the correct answer "wind" of the question 80j, that is, the answer spoken by user A is the correct answer, it means that user A has successfully rushed to answer, and a prompt message 80k can be displayed in the main area 80h. The prompt message 80k can be a reward prompt message after successfully rushing to answer. At this time, the score of user A in this game can be updated to 100. As the party that has successfully rushed to answer, user A can continue to answer questions in the main area 80h.

[0197] Since user E fails to rush to answer, the terminal device 80a can switch the video picture of user E from the main area 80i to the secondary area 80g. After user E returns to the secondary area 80g, the video picture of user E can be displayed at the end of the secondary area 80g. The terminal device 80a can select user F from the members of Team B as the next main interaction user and switch the video picture of user F from the secondary area 80g to the main area 80i. The terminal device 80a can obtain a new question 80m (such as "Guess the song name from the prelude") again and display the question 80m on the service display page. Both user A and user F can rush to answer the question 80m. The rush-answer voice data corresponding to user A and user F can be collected respectively, and real-time recognition can also be performed on the rush-answer voice data corresponding to user A and user F respectively through voice recognition technology. If within the specified time (each question can be time-limited, such as the answering time for each question is 15 seconds, and user A and user F need to rush to answer within 15 seconds, and exceeding the time means failure to rush to answer), the rush-answer voice data of user A and the rush-answer voice data of user E do not hit the correct answer of the question 80m, that is, both user A and user E fail to rush to answer, a prompt message 80n can be displayed on the service display page. The prompt message 80n can be the correct answer to the question 80m. At this time, both user A and user F need to exit the main area and replace with new members to answer questions, and so on, until the answering time exceeds 120s, and this game ends. Optionally, during the game, the audio data of the secondary interaction users (also called viewing users) in the secondary area 80f and the secondary area 80g can be output, but the background server will not perform voice recognition on the audio data of the secondary interaction users, that is, even if the secondary interaction users say the correct answer, it is invalid.

[0198] As Figure 12b shown, when the answering time of this game reaches 120s, a prompt message 80p (such as "The game is over") can be displayed on the service display page, and the page can jump from the service display page to the service result page 80q. On the service result page 80q, the total scores of Team A and Team B in this game (such as the final total score of Team A is: 9600, and the final total score of Team B is: 4000) and the user ranking list 80r can be displayed (the ranking can be based on the number of questions answered correctly by each user in this game, such as the first place is user A, who answered 24 questions correctly; the second place is user E, who answered 18 questions correctly, and the third place is user D, who answered 16 questions correctly, etc.). The service result page 80q also includes a "Share" function control. User A can trigger the "Share" function control on the service result page 80q, so that the terminal device 80a shares the service result page 80q with friends in the form of an H5 dynamic web page.

[0199] Optionally, in the target service of the grouped confrontation type, the questions in the target service can be emoticon pictures or words describing emotions. The first interactive user and the second interactive user can make expressions according to the questions. The interactive behavior data corresponding to the first interactive user (which can include the expressions made by the first interactive user) can be output in the first main area, and the interactive behavior data corresponding to the second interactive user (which can include the expressions made by the second interactive user) can be output in the second main area. By performing expression recognition on the interactive behavior data corresponding to the first interactive user and the second interactive user respectively, the interactive user who is first recognized as matching the question is the winning party.

[0200] Please also refer to Figure 13 , Figure 13 which is an interface display diagram of an expression interaction provided by an embodiment of the present application. As Figure 13 shown, user A, user B, user C, and user D form Team 1, and user E, user F, user G, and user H form Team 2. The service display page of the terminal device 90a includes a main area 90d, a main area 90e, a secondary area 90b, and a secondary area 90c. User A is the main interactive user selected from Team 1, and user E is the main interactive user selected from Team 2. At this time, the video image of user A can be displayed in the main area 90d, the video image of user E can be displayed in the main area 90e, the video images of the other users in Team 1 except user A can be displayed in the secondary area 90b, and the video images of the other users in Team 2 except user E can be displayed in the secondary area 90c.

[0201] The terminal device 90a can obtain the question 90f in the target service. The question 90f is an emoji picture. User A and User E can make emojis according to the question 90f, and output the interaction behavior data of User A (i.e., video frame data including User A's emoji) in the main area 90d, and output the interaction behavior data of User E (i.e., video frame data including User E's emoji) in the main area 90e. The server can obtain the interaction behavior data corresponding to User A and User E in real time, and through the facial expression recognition technology, obtain the real-time facial expression recognition results corresponding to User A and User E respectively. When the real-time facial expression recognition result matches the emoji represented in the question 90f, it means that the rush answer is successful, and the user identified as matching the question 90f is the winning user and can obtain a score reward. The user who fails to rush answer needs to exit the main area and return to the secondary area to re-select the next main interaction user to answer the question and interact until the answer is completed and the game is exited.

[0202] In the embodiment of the present application, the service display page for the target service in the instant messaging application may include multiple main areas and multiple secondary areas. The secondary areas can be used to display the interaction users in each user group, and the main areas can be used to display the interaction behavior data of the selected user (i.e., the main interaction user). After determining the main interaction user from the target service, the main interaction user can be displayed in the main area, that is, the main interaction user can interact with the other users in the main area, thereby enriching the interaction methods in the instant messaging application; after selecting the main interaction user from the interaction users, the main interaction user can be displayed in the main area, and the size of the video screen displayed in the main area is larger than the size of the video screen displayed in the secondary area, so that the interaction users in the target service can quickly locate the video screen of the main interaction user and view the interaction content output in the video screen of the main interaction user, which can reduce the probability of requiring the main interaction user to provide the same interaction content again, thereby saving data traffic.

[0203] Please refer to Figure 14 , Figure 14 is a timing schematic diagram of a service data processing method provided by an embodiment of the present application. As Figure 14 shown, the service data processing method may include the following steps:

[0204] Step S501, obtain the multimedia data corresponding to at least two interaction users in the target service respectively.

[0205] Specifically, in the service interaction scenario of using video chat, when there are at least two interaction users in the target service and the target service is in the startup state, the server can obtain the multimedia data corresponding to at least two interaction users in the target service respectively. The multimedia data includes but is not limited to: video screen, avatar, user nickname.

[0206] When the multimedia data is an avatar or a user nickname, the server can obtain the avatars or user nicknames corresponding to at least two interacting users in the target service from the background database of the instant messaging application; when the multimedia data is a video image, the server can render the video frame data corresponding to each interacting user respectively to obtain the video images corresponding to each interacting user respectively. Among them, the video frame data may refer to the video data associated with the corresponding interacting user uploaded by the user terminal to which the interacting user belongs in the target service. For example, the user terminal to which user 1 belongs uploads the video data of user 1 collected in real time to the server; after the server receives the video data uploaded by the user terminal to which user 1 belongs, it converts the received video data into video frame data, and through the Open Graphics Library, renders the video frame data to generate a video image for display on the terminal screen; similarly, the server can render the video frame data corresponding to each interacting user respectively to obtain the video images corresponding to each interacting user in the target service.

[0207] Step S502: Send the multimedia data corresponding to at least two interacting users respectively.

[0208] Specifically, the server can send the multimedia data corresponding to each interacting user respectively to the user terminal to which each interacting user belongs, so that the user terminal corresponding to each interacting user can receive the multimedia data of all interacting users in the target service.

[0209] Step S503: Display the multimedia data corresponding to at least two interacting users respectively in the auxiliary area of the service display page.

[0210] Specifically, after the terminal device receives the multimedia data corresponding to at least two interacting users sent by the server, it can display the multimedia data of at least two interacting users respectively in the auxiliary area of the service display page. The display form of the multimedia data corresponding to the interacting user in the auxiliary area can refer to step S102 in the corresponding embodiment above, which will not be elaborated here. Figure 3 The corresponding embodiment is not described in detail here.

[0211] Step S504: Determine the main interacting user from at least two interacting users.

[0212] Specifically, the server can select the main interacting user from at least two interacting users according to the type of the target service and the display order of the multimedia data of at least two interacting users in the auxiliary area. For example, when the target service is a service of taking turns to perform on stage, the server can select the main interacting user from at least two interacting users in turn according to the display positions of at least two interacting users in the auxiliary area. When the server selects the main interacting user for the first time in the target service, it can determine the first interacting user in the auxiliary area as the main interacting user.

[0213] When the target service is a service of the type of sitting around in a circle, the server can obtain the audio data in the target service. If it is detected that there is an interactive user who shouts "stop", the server stops polling at least two interactive users in the sub-region for traversal, and selects the interactive user indicated at the position where the polling traversal stops in the at least two interactive users according to the position where the polling traversal stops in the secondary region, and determines the selected interactive user as the main interactive user.

[0214] Please also refer to Figure 15 , Figure 15 is a schematic flowchart of a process for selecting a main interactive user provided by an embodiment of the present application. As Figure 15 shown, in the target service of the type of sitting around in a circle, the selection process of the main interactive user can be implemented through steps S11 - step S13. In the target service, the interactive user who creates the service session can trigger the operation control in the operation area, so that the terminal device polls at least two interactive users in the secondary region for traversal. During the polling traversal, the server can execute step S11, that is, receive in real time the audio data corresponding to each interactive user in the target service, and perform noise reduction processing on the received audio data, such as eliminating background music in the audio data, etc. Then, the server can continue to execute step S12, that is, call the speech recognition service to perform text conversion processing on the obtained audio data to obtain the text conversion result corresponding to the audio data. When the text conversion result is the word "stop", step S13 can be executed, that is, stop polling at least two interactive users in the secondary region for traversal, and select the interactive user indicated at the position where the polling traversal stops as the main interactive user. Among them, the specific implementation process of speech recognition can refer to Figure 16 step S21 in the corresponding embodiment, which will not be elaborated here; the speech recognition service can be a function integrated in the server, or a speech recognition service called from an artificial intelligence cloud service through an application programming interface (API), and no specific limitation is made here.

[0215] Among them, the artificial intelligence cloud service is generally also referred to as AI as a Service (AIaaS). This is a current mainstream service method of an artificial intelligence platform. Specifically, the AIaaS platform will split several common AI services and provide independent or packaged services in the cloud. This service model is similar to opening an AI-themed mall: all developers can access and use one or more artificial intelligence services provided by the platform through the API interface, and some senior developers can also use the AI framework and AI infrastructure provided by the platform to deploy and operate their own exclusive cloud artificial intelligence services.

[0216] Step S505, send a region replacement instruction.

[0217] Specifically, the server may send an area change instruction to the terminal device, where the area change instruction is used to instruct the terminal device to switch the display of the main interactive user from the auxiliary area to the main area.

[0218] Step S506: Display the main interactive user in the main area of ​​the business display page according to the area change instruction.

[0219] The specific implementation process of step S506 can be found in the above Figure 3 Step S104 in the corresponding embodiment will not be described in detail here.

[0220] Furthermore, after the video screen of the main interactive user is pulled to the main area for display, the task content for the main interactive user can be displayed in the business display page, and the terminal device can collect the interactive behavior data of the main interactive user for the task content, and upload the interactive behavior data to the server. The server can obtain the interactive behavior data of the main interactive user for the task content, generate the interactive result corresponding to the task content according to the interactive behavior data, and the server can send the interactive result to the terminal device, so that the terminal device can display the prompt information associated with the interactive result in the business display page, such as prompt information of successful answering, prompt information of failed answering, etc.

[0221] Optionally, when the target business is a type of business in which performances are performed in turns, and the task content is a text task content, the server can obtain the interactive behavior data of the main interactive user for the text task content, perform voice recognition on the first audio data contained in the interactive behavior data, and obtain a first converted text corresponding to the interactive behavior data; obtain the second audio data of the auxiliary interactive user (an interactive user other than the main interactive user among at least two interactive users) for the interactive behavior data, perform voice recognition on the second audio data, and obtain a second converted text corresponding to the second audio data; when the first converted text matches the text task content, determine that the interactive result corresponding to the task content is a task change; when the first converted text does not match the text task content, and the second converted text matches the text task content, determine that the interactive result corresponding to the task content is an interactive success result; when both the first converted text and the second converted text do not match the text task content, determine that the interactive result corresponding to the task content is an interactive failure result. In other words, the server can receive the audio data uploaded by the user terminal of each interactive user in the target business, and call the speech recognition service to convert the audio data of each interactive user into text, obtain the converted text corresponding to the audio data, and determine the interactive result corresponding to the text task content according to the matching result between the text task content and the converted text. It should be noted that the text task content in the embodiment of the present application refers to the task in the target business that requires the interactive user to answer the voice.

[0222] Please refer to Figure 16 , Figure 16 which is a schematic flowchart of a process for generating an interaction result provided by an embodiment of the present application. As Figure 16 shown, taking a target service of the type of taking turns to perform on stage as an example, the generation process of the interaction result can be implemented through steps S20 - S23.

[0223] Step S20: In the target service, each user terminal to which each interactive user belongs can upload audio - video data (including the interactive behavior data corresponding to the main interactive user and the second audio data corresponding to the secondary interactive user) to the server, and the server can receive the audio data corresponding to each interactive user respectively. There may be background music and other noises in the target service. Therefore, the server can perform noise reduction processing on the received audio data to eliminate the background music and other noises in the audio data.

[0224] Step S21: The server can call a speech recognition service to perform text conversion on the noise - reduced audio data to obtain the conversion text corresponding to the audio data.

[0225] Among them, the specific process of speech recognition may include: The server can perform frame - splitting processing on the received audio data, cut the audio data into multiple frames of audio data, and then can perform feature extraction on each frame of audio data to obtain the acoustic features corresponding to each frame of audio data respectively, that is, convert each frame of audio signal (waveform) into a multi - dimensional vector containing sound information. Among them, the acoustic features may include features such as linear predictive cepstral coefficients, Mel cepstral coefficients, etc.

[0226] The server can obtain an acoustic model, which can be trained through speech data. The acoustic model can be used to represent the mapping relationship between acoustic features and phoneme information, that is, the input of the acoustic model is an acoustic feature vector, and the output is phoneme information. The server can input the acoustic features corresponding to each frame of audio data into the acoustic model, and through this acoustic model, the target phoneme information corresponding to each frame of audio data can be obtained. Among them, the acoustic model may include, but is not limited to: Hidden Markov Model (HMM), Long Short Term Memory (LSTM), Recurrent Neural Network (RNN).

[0227] The server can obtain the unit characters corresponding to the target phoneme information from the dictionary, input the unit characters corresponding to each frame of audio data into the language model, and obtain the probability of each unit character or adjacent unit characters through the language model, and determine the conversion text corresponding to the audio data according to the probability output by the language model. Among them, the dictionary can be used to represent the correspondence between characters or words and phonemes. In simple terms, the dictionary can be regarded as the correspondence between pinyin and Chinese characters. The language model can be obtained by training a large amount of text data. The input of the language model is text information, and the output is the probability of the correlation between single characters or words. The language model can include but is not limited to: Hidden Markov Model (HMM), Long Short Term Memory (LSTM), Recurrent Neural Network (RNN), n-gram language model.

[0228] For example, the audio data is a speech signal of "I am a robot". Assume that the acoustic features of the audio signal obtained through feature extraction are: [1, 2, 3, 4, 5, 6...], and the acoustic features [1, 2, 3, 4, 5, 6...] are input into the acoustic model. The acoustic model can output the target phoneme information matching the above acoustic features, such as: wosijiqirn. The dictionary can obtain unit characters matching the target phoneme information, such as: nest-wo, I-wo, is-si, machine-ji, instrument-qi, person-rn, level-ji, and ninja-rn. Then, the above unit characters are input into the language model, and the probabilities corresponding to the unit characters can be output respectively: the probability corresponding to "I": 0.0786, the probability corresponding to "is": 0.0546, the probability corresponding to "I am": 0.0898, the probability corresponding to "machine": 0.0967, and the probability corresponding to "robot": 0.6785. Therefore, the converted text of the audio data "I am a robot" can be obtained: I am a robot.

[0229] The server can obtain the converted text corresponding to the audio data of each interactive user through the acoustic model, dictionary and language model.

[0230] Step S22: The server can match the recognition result with the answer to the text task content. When the converted text in the secondary interactive users is the same as the answer to the text task content, it can be determined that the interaction result of the text task content is a successful interaction result; when the converted text corresponding to the primary interactive user is the same as the answer to the text task content, it can be determined that the interaction result of the text task content is to change the task, that is, the answer to this text task content has been spoken by the primary interactive user, and this text task content becomes invalid; when there is no converted text in the secondary interactive users that is the same as the answer to the text task content within the specified time, it can be determined that the interaction result of the text task content is a failed interaction result.

[0231] Step S23: The server can send the interaction result of the text task content to the terminal device to notify each interactive user (i.e., game member) in the target service of the interaction result of this text task content. For example, when the interaction result of the text task content is a successful interaction result, the successful interaction result can be sent to the terminal device, and a prompt message is displayed on the terminal device to notify each interactive user in the target service that the rush answer is successful.

[0232] Optionally, when the target service is a grouped confrontation type service and the task content is text task content, the server can obtain the interaction behavior data of the first interactive user and the second interactive user respectively for the task content; obtain the third audio data in the interaction behavior data corresponding to the first interactive user, perform speech recognition on the third audio data to obtain the third converted text corresponding to the third audio data; obtain the fourth audio data in the interaction behavior data corresponding to the second interactive user, perform speech recognition on the fourth audio data to obtain the fourth converted text corresponding to the fourth audio data; when the third converted text matches the answer information corresponding to the task content and the acquisition time of the third audio data is earlier than the acquisition time of the fourth audio data, it is determined that the interaction result corresponding to the task content is a successful interaction result for the first interactive user; when the fourth converted text matches the answer information and the acquisition time of the fourth audio data is earlier than the acquisition time of the third audio data, it is determined that the interaction result corresponding to the task content is a successful interaction result for the second interactive user; when neither the third converted text nor the fourth converted text matches the answer information, it is determined that the interaction result corresponding to the task content is a failed interaction result. In other words, the server can obtain the audio data corresponding to the primary interactive user in the target service, call the speech recognition service to convert the audio data into text, and determine the interaction result of the text task content according to the matching result between the converted text and the answer to the task content. The specific process of generating the interaction result can refer to the description in the corresponding embodiment above Figure 16 and will not be elaborated here.

[0233] Optionally, when the task content is image task content, the server can obtain the interaction behavior data of the primary interaction user for the image task content, perform facial expression recognition on the interaction video data included in the interaction behavior data, and obtain the facial expression recognition result corresponding to the interaction behavior data; when the facial expression recognition result matches the image task content, determine that the interaction result corresponding to the task content is an interaction success result; when the facial expression recognition result does not match the image task content, determine that the interaction result corresponding to the task content is an interaction failure result. Among them, the image task content may include facial expression pictures or words describing facial expressions.

[0234] The server can call the facial expression recognition service to perform facial expression recognition on the interaction video data corresponding to the primary interaction user, and obtain the facial expression recognition result corresponding to the interaction video data. Among them, the facial expression recognition service may be a function integrated in the server or a facial expression recognition service called from an artificial intelligence cloud service through an application programming interface (API), which is not specifically limited here.

[0235] The specific process of facial expression recognition may include: The server can perform frame division processing on the interactive video data of the primary interactive user to obtain at least two frames of video data, and each frame of video data can be regarded as image data; The server can obtain a facial expression recognition model, which can be trained through a large number of facial expression images, and this facial expression recognition model can be used to represent the mapping relationship between images and facial expression labels. This facial expression recognition model can be a convolutional neural network, a deep neural network, etc. Taking the convolutional neural network as an example, the server can select any one frame of video data from at least two frames of video data and input it into the facial expression recognition model. The convolutional layer in the facial expression recognition model extracts features from the input video data to obtain the facial expression attribute features corresponding to the input video data. Then, input the facial expression attribute features into the classifier to obtain the matching degree between the facial expression attribute features and various attribute features in the classifier, and determine the label information corresponding to the attribute feature with the largest matching degree as the facial expression label corresponding to the input video data. When the facial expression label matches the description words corresponding to the image task content, it can be determined that the interaction result of the image task content is an interaction success result, and there is no need to perform facial expression recognition on the remaining multiple frames of video data; When the facial expression label does not match the description words corresponding to the image task content, one frame of video data can be selected from at least two frames of video data again, and the facial expression recognition result can be obtained through the facial expression recognition model. If no video data matching the image task content is recognized within the specified time, it can be determined that the interaction result of the image task content is an interaction failure result. For example, if the image task content is a "smiling" facial expression image, when the facial expression label "smiling" is recognized in the interactive video data corresponding to the primary interactive user, it means that the primary interactive user's performance is successful, that is, the interaction result of the task content is: task success result; When the facial expression label "smiling" is not recognized in the interactive video data corresponding to the primary interactive user, it means that the primary interactive user's performance fails, that is, the interaction result of the task content is: task failure result.

[0236] Optionally, when the target service is a service of the type of sitting in a circle, the server may obtain the voting information for the interaction behavior data sent by the device to which the secondary interaction user belongs; the voting information is generated by the device to which the secondary interaction user belongs in response to the voting trigger operation in the operation area, and the secondary interaction user refers to the interaction user other than the primary interaction user among at least two interaction users; count the number of votes for the interaction behavior data according to the voting information, generate an interaction result according to the number of votes, and send the interaction result to the terminal device, so that the terminal device displays a prompt message associated with the interaction result on the service display page. In the service of the type of sitting in a circle, the secondary interaction user can judge the interaction behavior data corresponding to the primary interaction user. When the secondary interaction user is satisfied with the interaction behavior data of the primary interaction user for the task content, the secondary interaction user can trigger the voting function control in the operation area, so that the terminal device obtains the voting information of the secondary interaction user and sends it to the server. The server can count the received voting information, and the number of voting information is the number of votes for the interaction behavior data. When the number of votes reaches the quantity threshold (such as half of the number of secondary interaction users), it can be determined that the interaction result corresponding to the primary interaction user is: interaction success result; when the number of votes does not reach the quantity threshold, it can be determined that the interaction result corresponding to the primary interaction user is: interaction failure result. The server can send the interaction result to the terminal device, that is, inform the terminal device of the interaction result corresponding to the primary interaction user.

[0237] Please refer to Figure 17a and Figure 17b , Figure 17a and Figure 17b which is a schematic diagram of a service processing framework provided by an embodiment of the present application. As Figure 17a shown, taking the target service as an interactive game as an example, in the interactive game, when the server detects that the interactive game switches from the unstarted state to the started state, that is, when the game starts, it can pull the game content from the interactive game, and the game content may include task content, task pictures, interface pictures, special effects, and videos played in the game in the game. When the server detects the game heartbeat anomaly 100a, it can also pull the game content in the interactive game, where the game heartbeat anomaly 100a may refer to the inconsistency between the real-time progress information in the game and the display progress information on the service display page. For example, due to poor network, the content displayed on the service display page of the terminal device may lag behind the real-time progress of the game, that is, the background progress is inconsistent with the client progress.

[0238] The server can summarize the pulled game content to obtain game data 100c. Of course, the game data 100c can also include the data corresponding to the game event 100b pushed by the server. For example, after the interaction time of a certain user in the game ends, the server pushing the game event 100b can mean that the server pushes an instruction to switch to the next user for interaction to the terminal device, or pushes an instruction to end the game to the terminal device, etc. The server can perform data processing on the game state machine 100d according to the game data 100c. Among them, the game state machine 100d can include at least three types, namely taking turns to perform on stage 100e, sitting in a circle to play games 100f (which can also be called the sitting-in-a-circle type), and multi-person team confrontation 100g (which can also be called the grouped confrontation type).

[0239] As Figure 17b shown, the data processing process in the game state machine 100d can include the following steps S40 - step S44:

[0240] Step S40, the server can obtain the game data in the interactive game through the game content pulled at the start of the game, the game content pulled when the game heartbeat is abnormal 100a, and the data generated when the server pushes the game event 100b.

[0241] Step S41, the server can perform logical processing according to the game data. Among them, the business logic can be used to implement the functions in the game, and the business logic can include business judgment conditions, execution order, and execution methods, etc. in the game data processing process.

[0242] Step S42, during the game process, the server needs to process the notification event. Among them, the notification event can refer to the notification instruction sent by the server to the terminal device, such as outputting a prompt message on the business display page of the game, notifying the main interactive user to switch to the next question for performance, etc., or notifying each member in the game that the current question has been successfully answered by a rush answer, etc.

[0243] Step S43, the server can compare the game scene and the rendering scene, and draw the scene for display on the terminal screen according to the comparison result. Among them, the game scene can refer to the environment, props, etc. in the game. When the game type is different, the game scene will also be different. For example, the above three types of games, namely taking turns to perform on stage, sitting in a circle to play games, and multi-person team confrontation, have different game scenes. The rendering scene can refer to the currently rendered scene. When the game scene matches the rendering scene, it means that the game scene and the rendering scene belong to the same type of game, and content can be drawn on the basis of the existing rendering scene.

[0244] Step S44. When there are differences between the game scene and the rendering scene, it indicates that the game scene and the rendering scene belong to different types of games. In this case, the content that has been drawn can be cleared, and a new scene can be redrawn.

[0245] In the embodiment of the present application, the business display page for the target service in the instant messaging application may include a main area and a secondary area. The secondary area can be used to display the interactive users participating in the target service, and the main area can be used to display the interactive behavior data of the selected user (i.e., the main interactive user). After determining the main interactive user from the target service, the main interactive user can be displayed in the main area, that is, the main interactive user can interact with other users in the main area, thereby enriching the interaction methods in the instant messaging application; after selecting the main interactive user from the interactive users, the video image of the main interactive user can be switched from the secondary area to the main area, so that the interactive users in the target service can quickly locate the video image of the main interactive user and view the interactive content output in the video image of the main interactive user, which can reduce the probability of requiring the main interactive user to provide the same interactive content again, thereby saving data traffic; in the target service, the interactive users can directly complete the interaction process through voice communication without additional click operations, which is simple to operate, can improve the execution efficiency in the target service, and enhance the interest of the target service.

[0246] Please refer to Figure 18 , Figure 18 which is a schematic structural diagram of a service data processing device provided by an embodiment of the present application. As Figure 18 shown, the service data processing device 1 can correspond to any of the terminal devices in the above Figure 1 corresponding embodiments. The service data processing device 1 may include: a first display module 101, a second display module 102, a first determination module 103, and a third display module 104;

[0247] The first display module 101 is configured to respond to a trigger operation for the target service in the instant messaging application and display a service display page matching the target service;

[0248] The second display module 102 is configured to display at least two interactive users in the secondary area of the service display page;

[0249] The first determination module 103 is configured to respond to a confirmation operation for the secondary area and determine a main interactive user from at least two interactive users;

[0250] The third display module 104 is configured to display the main interactive user in the main area of the service display page; the main area is used to display the interactive behavior data of the main interactive user in the target service.

[0251] Among them, for the specific functional implementation manners of the first display module 101, the second display module 102, the first determination module 103, and the third display module 104, reference may be made to steps S101 - S104 in the corresponding embodiments above, which will not be elaborated here. Figure 3 The relevant content is as follows.

[0252] Please also refer to Figure 18 This service data processing device 1 may further include: a creation module 105, an invitation module 106, and an addition module 107;

[0253] The creation module 105 is configured to respond to a session creation operation in an instant messaging application and create a service session corresponding to a target service for a target user;

[0254] The invitation module 106 is configured to respond to an invitation operation in the service session and send invitation information corresponding to the target service to the server;

[0255] The addition module 107 is configured to, when receiving a confirmation participation request for the invitation information returned by the server, determine the target user and the candidate users associated with the confirmation participation request as at least two interactive users.

[0256] Among them, for the specific functional implementation manners of the creation module 105, the invitation module 106, and the addition module 107, reference may be made to step S101 in the corresponding embodiments above, which will not be elaborated here. Figure 3 The relevant content is as follows.

[0257] Please also refer to Figure 18 This service data processing device 1 may further include: a first data output module 109, a behavior data sending module 110, and a first result display module 111;

[0258] The first data output module 109 is configured to output the interaction behavior data of the main interactive user for the task content in the target service, and the feedback behavior data of the secondary interactive user for the interaction behavior data; the secondary interactive user refers to the interactive users other than the main interactive user among the at least two interactive users;

[0259] The behavior data sending module 110 is configured to send the collected interaction behavior data to the server and receive the interaction result determined by the server according to the interaction behavior data and the feedback behavior data; this interaction result is associated with the task content;

[0260] The first result display module 111 is configured to display a prompt message associated with the interaction result on the service display page and update the task content in the target service according to the prompt message.

[0261] Among them, for the specific functional implementation manners of the first data output module 109, the behavior data sending module 110, and the first result display module 111, reference may be made to the aboveFigure 5 Steps S203 - S205 in the corresponding embodiment will not be elaborated here.

[0262] Please refer to Figure 18 simultaneously. The second display module 102 may include: a size determination unit 1021, a region division unit 1022, and a screen display unit 1023;

[0263] The size determination unit 1021 is configured to determine the display size corresponding to the secondary region in the service display page according to the total number of user interaction users.

[0264] The region division unit 1022 is configured to divide the secondary region into at least two unit secondary regions according to the total number of users and the display size corresponding to the secondary region; the number of at least two unit secondary regions corresponds to the total number of users.

[0265] The screen display unit 1023 is configured to display at least two interactive users in at least two unit secondary regions respectively.

[0266] Among them, for the specific functional implementation manners of the size determination unit 1021, the region division unit 1022, and the screen display unit 1023, reference may be made to step S302 in the corresponding embodiment above, which will not be elaborated here. Figure 8 Steps S302 in the corresponding embodiment will not be elaborated here.

[0267] Please refer to Figure 18 simultaneously. When the service display page includes operation controls and the confirmation operation includes a start instruction and a stop instruction, the first determination module 103 may include: a traversal unit 1031 and a determination unit 1032;

[0268] The traversal unit 1031 is configured to perform a polling traversal on at least two interactive users in the secondary region in response to a start instruction for the operation control.

[0269] The determination unit 1032 is configured to stop the polling traversal on at least two interactive users in the secondary region in response to a stop instruction for the operation control, and determine the interactive user pointed to when the polling traversal stops as the main interactive user.

[0270] Then the third display module 104 is specifically configured to:

[0271] Highlight the display area of the main interactive user in the secondary region, and determine the highlighted display area as the main region in the service display page.

[0272] Among them, for the specific functional implementation manners of the traversal unit 1031, the determination unit 1032, and the third display module 104, reference may be made to steps S303 - S305 in the corresponding embodiment above, which will not be elaborated here. Figure 8 Steps S303 - S305 in the corresponding embodiment will not be elaborated here.

[0273] Please refer to Figure 18 as well. The service data processing device 1 may further include: a second data output module 113, a vote count acquisition module 114, a reselected user module 115, and an updated data output module 116;

[0274] The second data output module 113 is configured to display task content in the main area and output the interaction behavior data of the main interaction user with respect to the task content;

[0275] The vote count acquisition module 114 is configured to acquire the vote counts of the secondary interaction users with respect to the interaction behavior data; the secondary interaction users refer to the remaining users among at least two interaction users other than the main interaction user;

[0276] The reselected user module 115 is configured to reselect the main interaction user from the secondary area when the vote count is greater than or equal to the quantity threshold;

[0277] The updated data output module 116 is further configured to output the updated interaction behavior data of the main interaction user with respect to the task content in the main area when the vote count is less than the quantity threshold.

[0278] Among them, the specific functional implementation manners of the second data output module 113, the vote count acquisition module 114, the reselected user module 115, and the updated data output module 116 may refer to steps S306 - S307 in the corresponding embodiment above, which will not be elaborated here. Figure 8 The steps S306 - S307 in the corresponding embodiment above, which will not be elaborated here.

[0279] Please refer to Figure 18 as well. When the secondary area includes a first secondary area and a second secondary area, the second display module 102 may include: a user division unit 1024 and a grouped display unit 1025;

[0280] The user division unit 1024 is configured to group at least two interaction users according to the group identifiers respectively corresponding to the at least two interaction users, so as to obtain a first user group and a second user group;

[0281] The grouped display unit 1025 is configured to display the interaction users included in the first user group in the first secondary area and display the interaction users included in the second user group in the second secondary area.

[0282] Among them, the specific functional implementation manners of the user division unit 1024 and the grouped display unit 1025 may refer to steps S402 - S403 in the corresponding embodiment above, which will not be elaborated here. Figure 11 The steps S402 - S403 in the corresponding embodiment above, which will not be elaborated here.

[0283] Please refer to Figure 18, the main interactive users include the first interactive users in the first user group and the second interactive users in the second user group, and the main areas include the first main area and the second main area;

[0284] The third display module 104 is specifically used for:

[0285] The first interactive user is displayed in the first main area, and the second interactive user is displayed in the second main area.

[0286] The specific functional implementation of the third display module 104 can be found in the above Figure 11 Step S405 in the corresponding embodiment will not be described in detail here.

[0287] Please also see Figure 18 , the business data processing device 1 may further include: a task display module 117, a group data output module 118, a result receiving module 119, and a second result display module 120;

[0288] The task display module 117 is used to display the task content in the business display page; the task content is independently displayed in the first main area and the second main area;

[0289] The group data output module 118 is used to output the interactive behavior data of the first interactive user and the second interactive user respectively with respect to the task content;

[0290] A result receiving module 119 is used to receive the interaction result determined by the server according to the interaction behavior data corresponding to the first interactive user and the second interactive user respectively; the interaction result is associated with the task content;

[0291] The second result display module 120 is used to update and display the first interactive user in the first main area and the second interactive user in the second main area respectively according to the interaction results.

[0292] The specific functional implementation of the task display module 117, the group data output module 118, the result receiving module 119, and the second result display module 120 can be referred to in the above Figure 11 Steps S406 to S408 in the corresponding embodiment will not be described in detail here.

[0293] Please also see Figure 18 , the second result display module 120 may include: a first user replacement unit 1201, a second user replacement unit 1202;

[0294] The first user replacement unit 1201 is used to, when the interaction result is the interaction success result corresponding to the first interacting user, display the second interacting user from the second main area to the second secondary area, select the next interacting user from the second secondary area as the updated second interacting user, and display the interacting user of the updated second interacting user to the second main area.

[0295] The second user replacement unit 1202 is used to, when the interaction result is the interaction success result corresponding to the second interacting user, display the first interacting user from the first main area to the first secondary area, select the next interacting user from the first secondary area as the updated first interacting user, and display the interacting user of the updated first interacting user to the first main area.

[0296] Among them, for the specific functional implementation manners of the first user replacement unit 1201 and the second user replacement unit 1202, reference can be made to step S408 in the corresponding embodiment above, and details will not be elaborated here. Figure 11

[0297] Figure 18 Please also refer to This service data processing device 1 may further include: a result statistics module 121, a result page display module 122, a progress acquisition module 123, and a page update module 124.

[0298] The result statistics module 121 is used to, when the target service is in the service end state, acquire the interaction behavior data corresponding to the main interacting user and count the interaction success results corresponding to at least two interacting users.

[0299] The result page display module 122 is used to generate a result sorting list according to the interaction success results and display the interaction behavior data and the result sorting list on the service result page.

[0300] The progress acquisition module 123 is used to acquire the real-time progress information corresponding to the target service in real time through the heartbeat mechanism and acquire the display progress information corresponding to the service display page.

[0301] The page update module 124 is used to update the service display page according to the real-time progress information when the real-time progress information is inconsistent with the display progress information.

[0302] Figure 3 Among them, for the specific functional implementation manners of the result statistics module 121, the result page display module 122, the progress acquisition module 123, and the page update module 124, reference can be made to step S104 in the corresponding embodiment above, and details will not be elaborated here.

[0303] ​​In the embodiments of the present application, the service display page for a target service in an instant messaging application may include a main area and a secondary area. The secondary area may be used to display the interactive users participating in the target service, and the main area may be used to display the interactive behavior data of the selected user (i.e., the main interactive user). After determining the main interactive user from the target service, the main interactive user can be displayed in the main area, that is, the main interactive user can interact with other users in the main area, thereby enriching the interaction methods in the instant messaging application; the video image of the main interactive user can be displayed in the main area, so that the interactive users in the target service can quickly locate the video image of the main interactive user and view the interactive content output in the video image of the main interactive user, which can reduce the probability of requiring the main interactive user to provide the same interactive content again, thus saving data traffic.

[0304] Please refer to Figure 19 , Figure 19 which is a schematic structural diagram of a service data processing device provided by an embodiment of the present application. As Figure 19 shown, the service data processing device 2 may correspond to the server 10d in the corresponding embodiment above Figure 1 and the service data processing device 2 may include: an acquisition module 21, a first sending module 22, a second determination module 23, and a second sending module 24;

[0305] The acquisition module 21 is configured to acquire the multimedia data corresponding to at least two interactive users in the target service;

[0306] The first sending module 22 is configured to send the multimedia data corresponding to at least two interactive users to the terminal device, so that the terminal device displays the multimedia data corresponding to at least two interactive users in the secondary area of the service display page;

[0307] The second determination module 23 is configured to determine the main interactive user from at least two interactive users;

[0308] The second sending module 24 is configured to send a region replacement instruction to the terminal device, instructing the terminal device to display the main interactive user in the main area of the service display page according to the region replacement instruction; the main area is used to display the interactive behavior data of the main interactive user in the target service.

[0309] Among them, the specific function implementation manners of the acquisition module 21, the first sending module 22, the second determination module 23, and the second sending module 24 may refer to steps S501 - S506 in the corresponding embodiment above, and will not be elaborated here. Figure 14

[0310] Please refer to Figure 19 ​When the business display page includes task content, the business data processing device 2 may further include: a result generation module 25 and a result sending module 26;

[0311] The result generation module 25 is configured to obtain the interaction behavior data of the primary interaction user for the task content, and generate an interaction result corresponding to the task content according to the interaction behavior data;

[0312] The result sending module 26 is configured to send the interaction result to the terminal device, so that the terminal device displays a prompt message associated with the interaction result on the business display page.

[0313] Among them, for the specific function implementation manners of the result generation module 25 and the result sending module 26, reference may be made to the steps S506 in the corresponding embodiment above, which will not be elaborated here. Figure 14 The corresponding embodiment will not be elaborated here.

[0314] Please refer to Figure 19 When the task content includes text task content, the result generation module 25 may include: a first recognition unit 2501, a second recognition unit 2502, a first comparison unit 2503, a second comparison unit 2504, and a third comparison unit 2505;

[0315] The first recognition unit 2501 is configured to obtain the interaction behavior data of the primary interaction user for the text task content, perform speech recognition on the first audio data included in the interaction behavior data, and obtain a first converted text corresponding to the interaction behavior data;

[0316] The second recognition unit 2502 is configured to obtain the second audio data of the secondary interaction user for the interaction behavior data, perform speech recognition on the second audio data, and obtain a second converted text corresponding to the second audio data; the secondary interaction user refers to an interaction user other than the primary interaction user among at least two interaction users;

[0317] The first comparison unit 2503 is configured to determine that the interaction result corresponding to the task content is to replace the task when the first converted text matches the text task content;

[0318] The second comparison unit 2504 is configured to determine that the interaction result corresponding to the task content is an interaction success result when the first converted text does not match the text task content and the second converted text matches the text task content;

[0319] The third comparison unit 2505 is configured to determine that the interaction result corresponding to the task content is an interaction failure result when both the first converted text and the second converted text do not match the text task content.

[0320] Among them, for the specific functional implementation manners of the first recognition unit 2501, the second recognition unit 2502, the first comparison unit 2503, the second comparison unit 2504, and the third comparison unit 2505, reference can be made to step S506 in the corresponding embodiment above, which will not be elaborated here. Figure 14 When the task content includes image task content, the result generation module 25 may include: a third recognition unit 2506, a fourth comparison unit 2507, and a fifth comparison unit 2508.

[0321] Please refer to Figure 19 When the task content includes image task content, the result generation module 25 may include: a third recognition unit 2506, a fourth comparison unit 2507, and a fifth comparison unit 2508;

[0322] The third recognition unit 2506 is configured to obtain interaction behavior data of the main interaction user for the image task content, perform facial expression recognition on the interaction video data included in the interaction behavior data, and obtain a facial expression recognition result corresponding to the interaction behavior data;

[0323] The fourth comparison unit 2507 is configured to determine that the interaction result corresponding to the task content is a successful interaction result when the facial expression recognition result matches the image task content;

[0324] The fifth comparison unit 2508 is configured to determine that the interaction result corresponding to the task content is a failed interaction result when the facial expression recognition result does not match the image task content.

[0325] Among them, for the specific functional implementation manners of the third recognition unit 2506, the fourth comparison unit 2507, and the fifth comparison unit 2508, reference can be made to step S506 in the corresponding embodiment above, which will not be elaborated here. Figure 14 When the main interaction user includes a first interaction user and a second interaction user, and both the first interaction user and the second interaction user belong to at least two interaction users, the result generation module includes: a behavior data acquisition unit 2509, a fourth recognition unit 2510, a fifth recognition unit 2511, a sixth comparison unit 2512, a seventh comparison unit 2513, and an eighth comparison unit 2514;

[0326] Please refer to Figure 19 When the main interaction user includes a first interaction user and a second interaction user, and both the first interaction user and the second interaction user belong to at least two interaction users, the result generation module includes: a behavior data acquisition unit 2509, a fourth recognition unit 2510, a fifth recognition unit 2511, a sixth comparison unit 2512, a seventh comparison unit 2513, and an eighth comparison unit 2514;

[0327] The behavior data acquisition unit 2509 is configured to obtain the interaction behavior data of the first interaction user and the second interaction user for the task content respectively;

[0328] The fourth recognition unit 2510 is configured to obtain the third audio data in the interaction behavior data corresponding to the first interaction user, perform speech recognition on the third audio data, and obtain a third converted text corresponding to the third audio data;

[0329] The fifth recognition unit 2511 is configured to obtain fourth audio data in the interaction behavior data corresponding to the second interaction user, perform speech recognition on the fourth audio data, and obtain a fourth converted text corresponding to the fourth audio data;

[0330] The sixth comparison unit 2512 is configured to determine that the interaction result corresponding to the task content is an interaction success result for the first interaction user when the third converted text matches the answer information corresponding to the task content and the acquisition time of the third audio data is earlier than the acquisition time of the fourth audio data;

[0331] The seventh comparison unit 2513 is configured to determine that the interaction result corresponding to the task content is an interaction success result for the second interaction user when the fourth converted text matches the answer information and the acquisition time of the fourth audio data is earlier than the acquisition time of the third audio data;

[0332] The eighth comparison unit 2514 is configured to determine that the interaction result corresponding to the task content is an interaction failure result when both the third converted text and the fourth converted text do not match the answer information.

[0333] Among them, for the specific functional implementation manners of the behavior data acquisition unit 2509, the fourth recognition unit 2510, the fifth recognition unit 2511, the sixth comparison unit 2512, the seventh comparison unit 2513, and the eighth comparison unit 2514, reference may be made to step S506 in the corresponding embodiment above, which will not be elaborated here. Figure 14 For details, please refer to

[0334] Please also refer to Figure 19 When the service display page includes an operation area, the service data processing device 2 may further include: a voting information acquisition module 27 and a vote count statistics module 28;

[0335] The voting information acquisition module 27 is configured to acquire voting information for the interaction behavior data sent by the device of the secondary interaction user; the voting information is generated by the device of the secondary interaction user in response to a voting trigger operation in the operation area, and the secondary interaction user refers to an interaction user other than the primary interaction user among at least two interaction users;

[0336] The vote count statistics module 28 is configured to count the number of votes for the interaction behavior data according to the voting information, generate an interaction result according to the number of votes, and send the interaction result to the terminal device so that the terminal device displays a prompt message associated with the interaction result on the service display page.

[0337] Among them, for the specific functional implementation manners of the voting information acquisition module 27 and the vote count statistics module 28, reference may be made to step S506 in the corresponding embodiment above, which will not be elaborated here. Figure 14 For details, please refer to

[0338] In an embodiment of the present application, a business display page for a target business in an instant messaging application may include a main area and a secondary area. The secondary area may be used to display interactive users participating in the target business, and the main area may be used to display interactive behavior data of a selected user (i.e., the main interactive user). After the main interactive user is determined from the target business, the main interactive user may be displayed in the main area, i.e., the main interactive user may interact with other users in the main area, thereby enriching the interactive method in the instant messaging application; after the main interactive user is determined, the main interactive user may be displayed in the main area, so that interactive users in the target business can quickly locate the video screen of the main interactive user and watch the interactive content output in the video screen of the main interactive user, thereby reducing the probability of requiring the main interactive user to re-provide the same interactive content, thereby saving data traffic; in the target business, interactive users can directly complete the interactive process through voice communication without the need for additional click operations, which is simple to operate, can improve the execution efficiency in the target business, and enhance the fun of the target business.

[0339] See also Figure 20 , Figure 20 Schematic diagram of the structure of a computer device provided in an embodiment of the present application. Figure 20 As shown, the computer device 1000 may correspond to the above Figure 1 For any terminal device in the corresponding embodiment, the computer device 1000 may include: a processor 1001, a network interface 1004 and a memory 1005. In addition, the above-mentioned computer device 1000 may also include: a user interface 1003, and at least one communication bus 1002. Among them, the communication bus 1002 is used to realize the connection and communication between these components. Among them, the user interface 1003 may include a display screen (Display), a keyboard (Keyboard), and optionally, the user interface 1003 may also include a standard wired interface and a wireless interface. Optionally, the network interface 1004 may include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or it may be a non-volatile memory (non-volatile memory), such as at least one disk storage. Optionally, the memory 1005 may also be at least one storage device located away from the aforementioned processor 1001. As Figure 20 As shown, the memory 1005 as a computer-readable storage medium may include an operating system, a network communication module, a user interface module, and a device control application.

[0340] In such Figure 20In the computer device 1000 shown, the network interface 1004 can provide a network communication function; the user interface 1003 is mainly used to provide an input interface for the user; and the processor 1001 can be used to call the device control application stored in the memory 1005 to achieve:

[0341] In response to a trigger operation for a target service in an instant messaging application, a service display page matching the target service is displayed;

[0342] In the auxiliary area of ​​the business display page, at least two interactive users are displayed;

[0343] In response to a confirmation operation on the secondary area, determining a primary interactive user from at least two interactive users;

[0344] The main interactive user is displayed in the main area of ​​the business display page; the main area is used to display the interactive behavior data of the main interactive user in the target business.

[0345] It should be understood that the computer device 1000 described in the embodiment of the present application can execute the above Figure 3 The description of the business data processing method in the corresponding embodiment can also be performed as described above. Figure 18 The description of the service data processing device 1 in the corresponding embodiment will not be repeated here. In addition, the description of the beneficial effects of the same method will not be repeated here either.

[0346] In addition, it should be pointed out here that: the embodiment of the present application also provides a computer-readable storage medium, and the computer-readable storage medium stores a computer program executed by the business data processing device 1 mentioned above, and the computer program includes program instructions. When the processor executes the program instructions, it can execute the above-mentioned Figure 3 , Figure 5 , Figure 8 as well as Figure 11 The description of the business data processing method in any corresponding embodiment will not be repeated here. In addition, the description of the beneficial effects of the same method will not be repeated. For technical details not disclosed in the computer-readable storage medium embodiment involved in this application, please refer to the description of the method embodiment of this application. As an example, program instructions can be deployed on a computing device for execution, or on multiple computing devices located at one location, or on multiple computing devices distributed at multiple locations and interconnected by a communication network. Multiple computing devices distributed at multiple locations and interconnected by a communication network can constitute a blockchain system.

[0347] See also Figure 21 , Figure 21 Schematic diagram of the structure of a computer device provided in an embodiment of the present application. Figure 21As shown, the computer device 2000 may correspond to the server 10d in the corresponding embodiment described above. The computer device 2000 may include: a processor 2001, a network interface 2004, and a memory 2005. In addition, the computer device 2000 may further include: a user interface 2003 and at least one communication bus 2002. Among them, the communication bus 2002 is used to realize the connection and communication between these components. Among them, the user interface 2003 may include a display screen (Display) and a keyboard (Keyboard). Optionally, the user interface 2003 may further include a standard wired interface and a wireless interface. Optionally, the network interface 2004 may include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 2005 may be a high-speed RAM memory or a non-volatile memory, for example, at least one disk memory. Optionally, the memory 2005 may also be at least one storage device located far from the aforementioned processor 2001. As Figure 1 shown, as a computer-readable storage medium, the memory 2005 may include an operating system, a network communication module, a user interface module, and a device control application program. Figure 21 In the computer device 2000 as shown in

[0348] As shown in Figure 21 the network interface 2004 may provide network communication functions; while the user interface 2003 is mainly used to provide an input interface for users; and the processor 2001 may be used to call the device control application program stored in the memory 2005 to implement:

[0349] Obtain the multimedia data corresponding to at least two interactive users in the target service respectively;

[0350] Send the multimedia data corresponding to at least two interactive users to the terminal device respectively, so that the terminal device displays the multimedia data corresponding to at least two interactive users in the secondary area of the service display page;

[0351] Determine the main interactive user from at least two interactive users;

[0352] Send a region replacement instruction to the terminal device, instructing the terminal device to display the main interactive user in the main area of the service display page according to the region replacement instruction; the main area is used to display the interactive behavior data of the main interactive user in the target service.

[0353] It should be understood that the computer device 2000 described in the embodiments of the present application may execute the description of the service data processing method in the corresponding embodiments described above, and may also execute the above Figure 14 corresponding embodiments, and may also execute the above Figure 19The description of the service data processing device 2 in the corresponding embodiment will not be repeated here. In addition, the description of the beneficial effects of using the same method will not be repeated either.

[0354] In addition, it should be noted here that: The embodiments of the present application also provide a computer-readable storage medium, and the computer-readable storage medium stores the computer program executed by the aforementioned service data processing device 2, and the computer program includes program instructions. When the processor executes the program instructions, it can execute the Figure 14 description of the service data processing method in the corresponding embodiment mentioned above. Therefore, it will not be repeated here. In addition, the description of the beneficial effects of using the same method will not be repeated either. For the technical details not disclosed in the embodiments of the computer-readable storage medium involved in the present application, please refer to the description of the method embodiments of the present application. As an example, the program instructions can be deployed to be executed on a computing device, or on multiple computing devices located at one location, or on multiple computing devices distributed at multiple locations and interconnected through a communication network. The multiple computing devices distributed at multiple locations and interconnected through a communication network can form a blockchain system.

[0355] Those of ordinary skill in the art can understand that all or part of the processes in the above-described method embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the above-described method embodiments. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM), etc.

[0356] The foregoing disclosure is only for the preferred embodiments of the present application, and of course, it cannot be used to limit the scope of the rights of the present application. Therefore, equivalent changes made according to the claims of the present application still fall within the scope covered by the present application.

Claims

1. A method for processing service data, characterized in that, it includes: Responding to a trigger operation for a target service in an instant messaging application, determining a page display form corresponding to the target service according to the service type of the target service, and displaying a service display page indicated by the page display form; the page display form is used to characterize the area segmentation method of the service display page, and different service types have different page display forms; Displaying at least two interactive users in the auxiliary area of the service display page; The at least two interactive users interact through voice data in the target service; Determining a main interactive user and a secondary interactive user from the at least two interactive users, and displaying task content and a video picture corresponding to the main interactive user in the main area of the service display page; Outputting interactive behavior data of the main interactive user for the task content in the main area, and outputting feedback behavior data of the secondary interactive user for the interactive behavior data in the target service; the interactive behavior data includes a body movement picture and a voice description of the main interactive user for the task content, and the feedback behavior data includes voice data of the secondary interactive user.

2. The method according to claim 1, characterized in that, The determining a main interactive user and a secondary interactive user from the at least two interactive users includes: Determining the main interactive user from the at least two interactive users according to the display order of the at least two interactive users in the auxiliary area, and displaying the video picture of the main interactive user in the main area; Determining the interactive users other than the main interactive user among the at least two interactive users as the secondary interactive users.

3. The method according to claim 2, characterized in that, The outputting interactive behavior data of the main interactive user for the task content in the main area and outputting feedback behavior data of the secondary interactive user for the interactive behavior data in the target service includes: Collecting a body movement picture and a voice description of the main interactive user for the task content, determining the body movement picture and the voice description as the interactive behavior data, and outputting the interactive behavior data in the main area; Receiving the feedback behavior data of the secondary interactive user for the interactive behavior data sent by the server, and outputting the feedback behavior data in the target service.

4. The method according to claim 1, characterized in that, The displaying at least two interactive users in the auxiliary area of the service display page includes: Obtaining the total number of users corresponding to the at least two interactive users, and determining the display size corresponding to the auxiliary area according to the total number of users; Dividing the auxiliary area into at least two unit auxiliary areas according to the total number of users and the display size corresponding to the auxiliary area; the number of the at least two unit auxiliary areas is the same as the total number of users; Displaying the at least two interactive users in the at least two unit auxiliary areas respectively; one unit auxiliary area corresponds to one interactive user.

5. The method according to claim 4, characterized in that, The service display page further includes an operation area, the operation area includes operation controls, and the display size of the operation area is determined by the total number of users; Determining the primary interaction user and the secondary interaction user from the at least two interaction users includes: In response to a start instruction for the operation control, polling through the at least two interaction users in the secondary area; In response to a stop instruction for the operation control, stopping polling through the at least two interaction users, and determining the interaction user pointed to when the polling stops as the primary interaction user; the start instruction and the stop instruction are instructions generated based on user voice data Highlighting the unit secondary area where the primary interaction user is located, and determining the highlighted unit secondary area as the primary area of the service display page; Determining the interaction users other than the primary interaction user among the at least two interaction users as the secondary interaction users.

6. The method according to claim 5, wherein, further includes: Obtaining the number of votes of the secondary interaction user for the interaction behavior data; the number of votes is counted by the server based on the received voting information of the secondary interaction user; When the number of votes is greater than or equal to the quantity threshold, reselecting the primary interaction user from the at least two interaction users; When the number of votes is less than the quantity threshold, outputting the updated interaction behavior data of the primary interaction user for the task content in the primary area.

7. The method according to claim 5, wherein, The operation area includes a question-changing function control; The method further includes: In response to a trigger operation for the question-changing function control, replacing the task content in the primary area and displaying the replaced task content.

8. The method according to claim 1, wherein, The secondary area includes a first secondary area and a second secondary area; Displaying at least two interaction users in the secondary area of the service display page includes: Grouping the at least two interaction users according to the group identifiers respectively corresponding to the at least two interaction users to obtain a first user group and a second user group; Displaying the interaction users included in the first user group in the first secondary area, and displaying the interaction users included in the second user group in the second secondary area.

9. The method according to claim 8, wherein, The primary interaction user includes a first interaction user in the first user group and a second interaction user in the second user group, and the primary area includes a first primary area and a second primary area; Determining the primary interaction user and the secondary interaction user from the at least two interaction users includes: Determining the first interaction user from the first user group according to the display order of the interaction users included in the first user group in the first secondary area, and displaying the video picture of the first interaction user in the first primary area; Determine the second interactive user from the second user group according to the display order of the interactive users included in the second user group in the second secondary area, and display the video picture of the second interactive user in the first main area; Determine the secondary interactive users from the at least two interactive users other than the main interactive user.

10. The method according to claim 9, characterized in that, further comprising: Receiving an interaction result determined by the server according to the interaction behavior data corresponding to the first interactive user and the second interactive user respectively; The interaction result is associated with the task content; According to the interaction result, update and display the first interactive user in the first main area and the second interactive user in the second main area respectively.

11. The method according to claim 10, characterized in that, The updating and displaying the first interactive user in the first main area and the second interactive user in the second main area respectively according to the interaction result includes: When the interaction result is the interaction success result corresponding to the first interactive user, display the second interactive user from the second main area to the second secondary area, select the next interactive user from the second user group as the updated second interactive user, and display the video picture of the updated second interactive user in the second main area; When the interaction result is the interaction success result corresponding to the second interactive user, display the first interactive user from the first main area to the first secondary area, select the next interactive user from the first user group as the updated first interactive user, and display the video picture of the updated first interactive user in the first main area.

12. A service data processing device, characterized in that, comprising: A first display module, configured to respond to a trigger operation for a target service in an instant messaging application, determine a page display form corresponding to the target service according to the service type of the target service, and display a service display page indicated by the page display form; the page display form is used to characterize the area division method of the service display page, and different service types have different page display forms; A second display module, configured to display at least two interactive users in a secondary area of the service display page; The at least two interactive users interact through voice data in the target service; A first determination module, configured to determine a main interactive user and a secondary interactive user from the at least two interactive users, and display task content and a video picture corresponding to the main interactive user in a main area of the service display page; A first data output module, configured to output interaction behavior data of the main interactive user for the task content in the main area, and output feedback behavior data of the secondary interactive user for the interaction behavior data in the target service; the interaction behavior data includes a body movement picture and a voice description of the main interactive user for the task content, and the feedback behavior data includes voice data of the secondary interactive user.

13. A computer device, characterized in that, it includes a memory and a processor; the memory stores a computer program, and when the computer program is executed by the processor, the processor is caused to execute the method according to any one of claims 1-11.

14. A computer-readable storage medium, characterized in that, the computer-readable storage medium stores a computer program, the computer program includes program instructions, and when the program instructions are executed by the processor, the method according to any one of claims 1-11 is executed.

Images