Data processing method and device, electronic equipment and storage medium
By displaying reference actions on the live streaming interface and judging results based on similarity, combined with virtual prop operations, the interactive methods of online connection are enriched, and the interactive effect of PK scenes is improved.
Patent Information
- Application Number
- CN202410495244.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-04-23
- Publication Date
- 2025-11-04
- Estimated Expiration
- 2044-04-23
AI Technical Summary
Existing live streaming interaction methods are relatively rigid and monotonous in PK scenarios, resulting in poor human-computer interaction.
During the online interaction, reference actions are displayed on the live broadcast interface, and the similarity between the user's posed actions and the reference actions is obtained to determine the battle result. At the same time, virtual props are introduced to change, cover or blur the actions, enriching the interaction methods.
It has improved the diversity and effectiveness of live streaming interactions, and enhanced user engagement and interactive experience.
Smart Images

Figure CN118233702B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to the technical field of Internet, and particularly relates to a data processing method and device, electronic equipment and storage medium. BACKGROUND
[0002] With the rapid development of Internet technology, application programs (such as short video applications) with live streaming functions are becoming more and more popular among the public, and the live streaming modes are becoming increasingly diverse. For example, online interaction as a new live streaming mode has attracted widespread attention from users.
[0003] In the online interaction, a plurality of anchor users (usually two) jointly complete live streaming. In the online interaction process, the anchor users participating in the online interaction can initiate interactive PK, such as singing PK and product promotion PK.
[0004] However, the current interactive mode around the PK scene is relatively fixed and single, and the human-computer interaction effect is poor. SUMMARY
[0005] The present disclosure provides a data processing method, device, electronic equipment and storage medium. The technical solutions of the present disclosure are as follows:
[0006] According to a first aspect of an embodiment of the present disclosure, a data processing method is provided, comprising:
[0007] In the online interaction process, for a current game, a reference action is displayed in each region of a live streaming interface; wherein the number of regions included in the live streaming interface is the same as the number of accounts participating in the online interaction;
[0008] Obtaining a user action of each user account participating in the online interaction;
[0009] Based on the similarity between the user action of each user account and the corresponding reference action, a game result of the current game is displayed.
[0010] In some embodiments, the user accounts participating in the online interaction include a first user account and at least one second user account; and the displaying of a reference action in each region of the live streaming interface comprises:
[0011] In response to a third user account performing a numerical transfer operation on a virtual prop, a reference action is displayed in a target region of the live streaming interface based on the processing mode indicated by the virtual prop;
[0012] The third user account is a user account that enters a live streaming room of the first user account to watch live streaming.
[0013] In some embodiments, the response to the third user account performing the numerical transfer operation on the virtual prop, the reference action is displayed on the target region of the live interface based on the processing mode indicated by the virtual prop, including:
[0014] In response to the third user account performing the numerical transfer operation on the first virtual prop, the currently displayed reference action is replaced with a new reference action on the region corresponding to the first user account.
[0015] The first virtual prop is used to replace the reference action.
[0016] In some embodiments, the response to the third user account performing the numerical transfer operation on the virtual prop, the reference action is displayed on the target region of the live interface based on the processing mode indicated by the virtual prop, including:
[0017] In response to the third user account performing the numerical transfer operation on the second virtual prop, the reference action is displayed on the region corresponding to the second user account, which is blocked by a virtual special effect.
[0018] The second virtual prop is used to block the action outline.
[0019] In some embodiments, the response to the third user account performing the numerical transfer operation on the virtual prop, the reference action is displayed on the target region of the live interface based on the processing mode indicated by the virtual prop, including:
[0020] In response to the third user account performing the numerical transfer operation on the third virtual prop, the reference action is displayed on the region corresponding to the second user account, which is blurred or not displayed.
[0021] The third virtual prop is used to blur or hide the action outline.
[0022] In some embodiments, the method further includes:
[0023] After a preset time period, the reference action displayed on each region of the live interface is hidden.
[0024] In some embodiments, the reference action displayed on each region of the live interface is an action outline with missing parts; after one reference action is displayed on each region of the live interface, the method further includes:
[0025] For any user account participating in the current online interaction, an action prompt word is obtained.
[0026] The action prompt word is displayed in a display mode that does not block the live interface.
[0027] The action prompt word is used to prompt the user account to perform an action matching the corresponding reference action.
[0028] In some embodiments, the action prompt word is obtained by:
[0029] obtaining the action prompt word from a user comment; or,
[0030] obtaining the action prompt word from a question bank; wherein the question bank includes a plurality of questions, and each question includes a reference action and at least one action keyword.
[0031] In some embodiments, the method further comprises:
[0032] obtaining the reference action from a data source based on the number of accounts participating in the current live interaction;
[0033] wherein the data source includes a question bank and an image drawn by the target user account; and the question bank includes a plurality of questions, and each question includes a reference action.
[0034] In some embodiments, the user accounts participating in the current live interaction include a first user account and at least one second user account; the target user account is a third user account who enters a live room of the first user account to watch a live broadcast; and the method further comprises:
[0035] after obtaining the reference action corresponding to the first user account from the question bank, in response to the third user account performing a numerical transfer operation on a fourth virtual prop, obtaining an image drawn by the third user account, and displaying the image in a display manner that does not block the live interface;
[0036] wherein the image includes the reference action to be performed by the first user account.
[0037] In some embodiments, the method further comprises:
[0038] displaying a score board after the start of the current round of battle; wherein the score board displays round information, a current cumulative score of each user account, and an end countdown of the current round of battle.
[0039] In some embodiments, displaying user action poses in each region of the live interface respectively comprises:
[0040] displaying, in each region of the live interface, a corresponding user action pose and action comment information corresponding to the user action pose respectively.
[0041] In some embodiments, the similarity between the user posing action of each user account and the corresponding reference action is used to display the battle result of the current round of battle, including:
[0042] For any user account participating in the current online interaction, a live picture image of the user account is obtained; wherein the live picture image includes the user posing action of the user account and the corresponding reference action;
[0043] The human body in the live picture image is subjected to contour detection to obtain the posing action contour of the user account;
[0044] The similarity between the posing action contour and the action contour of the reference action is obtained;
[0045] Based on the similarity corresponding to each user account and the similarity threshold, the battle result of the current round of battle is displayed.
[0046] According to a second aspect of the embodiments of the present disclosure, a data processing method is provided, including:
[0047] During the online interaction, for the current round of battle, based on the live picture of each user account after merging in the current online interaction, the user posing action of each user account and the corresponding reference action are displayed on a live interface;
[0048] Wherein the user posing action and the reference action of different user accounts are displayed in different regions of the live interface; the number of regions included in the live interface is the same as the number of accounts participating in the current online interaction;
[0049] Based on the similarity between the user posing action of each user account and the corresponding reference action, the battle result of the current round of battle is displayed.
[0050] In some embodiments, the user accounts participating in the current online interaction include a first user account and at least one second user account; the method further includes:
[0051] A virtual prop panel is displayed; wherein the first virtual prop is included on the virtual prop panel, and the first virtual prop is used to replace the reference action;
[0052] In response to the third user account performing a numerical transfer operation on the first virtual prop, the currently displayed reference action is replaced with a new reference action in the region corresponding to the first user account, and first update signaling is issued to the first user account and the second user account;
[0053] The first update signaling is used to indicate that the currently displayed reference action is replaced by a new reference action in the area corresponding to the first user account; and the third user account is a user account that enters a live broadcast room of the first user account to watch a live broadcast.
[0054] In some embodiments, the method further includes:
[0055] displaying a virtual prop panel; wherein the virtual prop panel includes a second virtual prop for shielding the action outline;
[0056] In response to a numerical transfer operation performed by a third user account on the second virtual prop, displaying a reference action shielded by a virtual special effect on an area corresponding to the second user account, and issuing second update signaling to the first user account and the second user account;
[0057] The second update signaling is used to indicate that the reference action shielded by the virtual special effect is displayed on the area corresponding to the second user account; and the third user account is a user account that enters a live broadcast room of the first user account to watch a live broadcast.
[0058] In some embodiments, the method further includes:
[0059] displaying a virtual prop panel; wherein the virtual prop panel includes a third virtual prop for blurring or hiding the action outline;
[0060] In response to a numerical transfer operation performed by a third user account on the third virtual prop, blurring displaying or canceling displaying a reference action on an area corresponding to the second user account, and issuing third update signaling to the first user account and the second user account;
[0061] The third update signaling is used to indicate that the reference action is blurred displayed or canceled displayed on the area corresponding to the second user account; and the third user account is a user account that enters a live broadcast room of the first user account to watch a live broadcast.
[0062] In some embodiments, the method further includes:
[0063] displaying a virtual prop panel; wherein the virtual prop panel includes a fourth virtual prop for drawing an image;
[0064] In response to a numerical transfer operation performed by a third user account on the fourth virtual prop, displaying a drawing panel;
[0065] obtaining an image drawn by the third user account on the drawing panel, and issuing fourth update signaling to the first user account;
[0066] The fourth update signaling carries the image; the image includes a reference action that the first user account intends to perform; and the third user account is a user account that enters a live broadcast room of the first user account to watch a live broadcast.
[0067] According to a third aspect of the embodiments of the present disclosure, a data processing method is provided, including:
[0068] In the online interaction process, for a current round of competition, a number of questions consistent with a number of accounts participating in the online interaction is obtained; each question includes a reference action;
[0069] The obtained questions are sent to a first terminal; the first terminal is configured to display a reference action in each region of a live broadcast interface, and obtain a user action of each user account participating in the online interaction; the number of regions included in the live broadcast interface is the same as the number of accounts participating in the online interaction; and the first terminal is a terminal corresponding to the first user account participating in the online interaction.
[0070] Based on a similarity between the user action of each user account and the corresponding reference action, a competition result of the current round of competition is generated.
[0071] In some embodiments, the obtaining of the number of questions consistent with the number of accounts participating in the online interaction from the question bank includes:
[0072] When a preset condition is met, the number of questions consistent with the number of accounts participating in the online interaction is obtained from the question bank; the preset condition includes at least one of the following:
[0073] A version number of a target application installed on the first terminal and the second terminal is greater than a preset version number; and the second terminal is a terminal corresponding to the second user account.
[0074] The online interaction between the first user account and the second user account belongs to a preset online interaction type.
[0075] An initiation mode of the online interaction between the first user account and the second user account belongs to a preset initiation mode.
[0076] A number of fans of an online interaction initiator among the first user account and the second user account is greater than a threshold number of people.
[0077] Interaction scores of the first user account and the second user account are both greater than a score threshold.
[0078] In some embodiments, the similarity between the user posing action of each user account and the corresponding reference action is used to generate a battle result of a current round of battle, including:
[0079] For any user account participating in the current online interaction, a live picture image of the user account is obtained; wherein the live picture image includes the user posing action of the user account and the corresponding reference action;
[0080] Contour detection is performed on the human body in the live picture image to obtain a posing action contour of the user account;
[0081] The similarity between the posing action contour and the action contour of the corresponding reference action is determined;
[0082] In response to the obtained similarity being greater than a similarity threshold value and the action posing time of the user account being the shortest in the current round of battle, it is determined that the user account wins in the current round of battle, and a score value is accumulated for the user account in the current round of battle.
[0083] According to a fourth aspect of the embodiments of the present disclosure, a data processing apparatus is provided, including:
[0084] A first display module is configured to, during online interaction, for a current round of battle, display one reference action in each region of a live interface; wherein the number of regions included in the live interface is the same as the number of accounts participating in the current online interaction;
[0085] A second display module is configured to obtain a user posing action of each user account participating in the current online interaction; and based on the similarity between the user posing action of each user account and the corresponding reference action, display a battle result of the current round of battle.
[0086] In some embodiments, the user accounts participating in the current online interaction include a first user account and at least one second user account; and the first display module is configured to:
[0087] In response to a third user account performing a numerical transfer operation on a virtual prop, display a reference action on a target region of the live interface based on the processing mode indicated by the virtual prop;
[0088] The third user account is a user account that enters a live room of the first user account to watch live streaming.
[0089] In some embodiments, the first display module is configured to:
[0090] In response to the third user account performing a numerical transfer operation on the first virtual prop, a currently displayed reference action is replaced with a new reference action on the area corresponding to the first user account.
[0091] The first virtual prop is used to replace the reference action.
[0092] In some embodiments, the first display module is configured to:
[0093] In response to the third user account performing a numerical transfer operation on the second virtual prop, a reference action is displayed on the area corresponding to the second user account, which is blocked by a virtual special effect.
[0094] The second virtual prop is used to block the action outline.
[0095] In some embodiments, the first display module is configured to:
[0096] In response to the third user account performing a numerical transfer operation on the third virtual prop, a reference action is displayed on the area corresponding to the second user account, which is blurred or not displayed.
[0097] The third virtual prop is used to blur or hide the action outline.
[0098] In some embodiments, the first display module is further configured to:
[0099] After a preset time length, the reference action displayed on each area of the live interface is hidden.
[0100] In some embodiments, the reference action displayed on each area of the live interface is an action outline with missing parts; the first display module is further configured to:
[0101] After displaying one reference action on each area of the live interface, for any user account participating in the current live interaction, an action prompt word is obtained.
[0102] The action prompt word is displayed in a display mode that does not block the live interface.
[0103] The action prompt word is used to prompt the user account to perform an action matching the corresponding reference action.
[0104] In some embodiments, the first display module is configured to:
[0105] The action prompt word is obtained from user comments; or,
[0106] The action prompt word is obtained from a question bank, wherein the question bank includes a plurality of questions, and one of the questions includes a reference action and at least one action keyword.
[0107] In some embodiments, the apparatus further includes:
[0108] The second obtaining module is configured to obtain the reference action from a data source based on a number of accounts participating in the live online interaction.
[0109] The data source includes a question bank and an image drawn by the target user account, and the question bank includes a plurality of questions, and one of the questions includes a reference action.
[0110] In some embodiments, the user accounts participating in the live online interaction include a first user account and at least one second user account, and the target user account is a third user account entering a live broadcast room of the first user account to watch a live broadcast.
[0111] The second obtaining module is further configured to:
[0112] After obtaining the reference action corresponding to the first user account from the question bank, in response to the third user account performing a numerical transfer operation on a fourth virtual prop, an image drawn by the third user account is obtained.
[0113] The first display module is further configured to display the image in a manner that does not block the display of the live broadcast interface.
[0114] The image includes the reference action to be performed by the first user account.
[0115] In some embodiments, the second display module is further configured to:
[0116] After the start of the current round of the game, a score board is displayed, wherein the score board displays round information, a current cumulative score of each user account, and an end countdown of the current round of the game.
[0117] In some embodiments, the first display module is further configured to:
[0118] In each region of the live broadcast interface, a corresponding user action and action comment information for the user action are displayed.
[0119] In some embodiments, the second display module is configured to:
[0120] For any user account participating in the live online interaction, a live broadcast image of the user account is obtained, wherein the live broadcast image includes a user action of the user account and a corresponding reference action.
[0121] perform contour detection on the human body in the live picture image to obtain a pose contour of the action of the user account;
[0122] obtain a similarity between the pose contour of the action of the user account and the reference action;
[0123] display a battle result of a current round of battle based on the similarity corresponding to each user account and a similarity threshold.
[0124] According to a fifth aspect of the embodiments of the present disclosure, a data processing apparatus is provided, comprising:
[0125] a third display module configured to display, based on the live picture after the confluence of each user account participating in the current online interaction, the user action of each user account and the corresponding reference action on a live interface;
[0126] wherein the user action and the reference action of different user accounts are displayed in different regions of the live interface; the number of regions included in the live interface is the same as the number of accounts participating in the current online interaction;
[0127] a fourth display module configured to display a battle result of a current round of battle based on the similarity between the user action of each user account and the corresponding reference action.
[0128] In some embodiments, the user accounts participating in the current online interaction include a first user account and at least one second user account; the apparatus further comprises a second sending module;
[0129] The third display module is further configured to display a virtual prop panel; wherein the virtual prop panel includes a first virtual prop, and the first virtual prop is used to replace the reference action; in response to a numerical transfer operation of a third user account on the first virtual prop, the currently displayed reference action is replaced with a new reference action in the region corresponding to the first user account;
[0130] The second sending module is configured to, in response to the numerical transfer operation of the third user account on the first virtual prop, send first update signaling to the first user account and the second user account;
[0131] wherein the first update signaling is used to instruct to replace the currently displayed reference action with a new reference action in the region corresponding to the first user account; and the third user account is a user account that enters a live room of the first user account to watch live streaming.
[0132] In some embodiments, the third display module is further configured to display a virtual prop panel; wherein the virtual prop panel includes a second virtual prop, the second virtual prop being used to shield the action contour; and in response to a numerical transfer operation performed by a third user account on the second virtual prop, display a reference action shielded by a virtual special effect on a region corresponding to the second user account.
[0133] The second sending module is further configured to, in response to a numerical transfer operation performed by a third user account on the second virtual prop, send second update signaling to the second user account and the second user account.
[0134] The second update signaling is used to instruct display of a reference action shielded by a virtual special effect on a region corresponding to the second user account.
[0135] In some embodiments, the third display module is further configured to display a virtual prop panel; wherein the virtual prop panel includes a third virtual prop, the third virtual prop being used to blur or hide the action contour; and in response to a numerical transfer operation performed by a third user account on the third virtual prop, blur display or cancel display of a reference action on a region corresponding to the second user account.
[0136] The second sending module is further configured to, in response to a numerical transfer operation performed by a third user account on the third virtual prop, send third update signaling to the second user account and the second user account.
[0137] The third update signaling is used to instruct blur display or cancel display of a reference action on a region corresponding to the second user account.
[0138] In some embodiments, the third display module is further configured to display a virtual prop panel; wherein the virtual prop panel includes a fourth virtual prop, the fourth virtual prop being used to draw a prompt image; and in response to a numerical transfer operation performed by a third user account on the fourth virtual prop, display a drawing panel.
[0139] The second sending module is further configured to obtain an image drawn by the third user account on the drawing panel, and send fourth update signaling to the first user account.
[0140] The fourth update signaling carries the prompt image; and the prompt image is used to prompt the first user account to make a limb action matching the reference action.
[0141] According to a sixth aspect of the embodiments of the present disclosure, a data processing apparatus is provided, comprising:
[0142] The first obtaining module is configured to, in the process of the online interaction, obtain a number of questions consistent with a number of accounts participating in the online interaction for a current round of the game, wherein one of the questions comprises one reference action;
[0143] The first sending module is configured to send the obtained questions to a first terminal, wherein the first terminal is configured to display one reference action in each region of a live interface and obtain a user action of each user account participating in the online interaction, the number of regions included in the live interface is the same as the number of accounts participating in the online interaction, and the first terminal is a terminal corresponding to the first user account participating in the online interaction;
[0144] The processing module is configured to generate a game result of the current round of the game based on a similarity between the user action of each user account and the corresponding reference action.
[0145] In some embodiments, the first obtaining module is configured to:
[0146] In a case where a preset condition is met, obtain the same number of questions as the number of accounts participating in the online interaction from the question bank, wherein the preset condition comprises at least one of the following:
[0147] A version number of a target application installed on the first terminal and the second terminal is greater than a preset version number, and the second terminal is a terminal corresponding to the second user account;
[0148] The online interaction between the first user account and the second user account belongs to a preset online interaction type;
[0149] An initiation mode of the online interaction between the first user account and the second user account belongs to a preset initiation mode;
[0150] A number of fans of an online interaction initiator among the first user account and the second user account is greater than a threshold number of people;
[0151] Interaction scores of the first user account and the second user account are both greater than a score threshold.
[0152] In some embodiments, the processing module is configured to:
[0153] For any user account participating in the online interaction, obtain a live picture image of the user account, wherein the live picture image comprises a user action of the user account and a corresponding reference action;
[0154] Perform contour detection on a human body in the live picture image to obtain a posing action contour of the user account;
[0155] determine a similarity between the swing action contour and an action contour of a corresponding reference action;
[0156] In response to the obtained similarity being greater than a similarity threshold and the action swing time of the user account being the shortest in the current game, it is determined that the user account wins in the current game, and a score is accumulated for the user account in the current game.
[0157] According to a seventh aspect of the embodiments of the present disclosure, an electronic device is provided, which includes:
[0158] one or more processors;
[0159] a memory for storing the program code executable by the processor;
[0160] The processor is configured to execute the program code to implement the data processing method described above.
[0161] According to an eighth aspect of the embodiments of the present disclosure, a computer readable storage medium is provided, in which program code is executed by the processor of the electronic device, so that the electronic device can execute the data processing method described above.
[0162] According to a ninth aspect of the embodiments of the present disclosure, a computer program product is provided, which includes a computer program that is executed by the processor of the electronic device to implement the data processing method described above.
[0163] The data processing scheme provided by the embodiments of the present disclosure realizes a new online interaction mode around the PK scenario. In detail, in the online interaction process of multiple anchors, body interaction PK can be performed between each other, that is, each anchor fits the reference action (irregular contour line) given by the system by swinging the body action, and the PK result is determined according to the similarity between the user swing action and the reference action given by the system. In other words, the data processing scheme associates online interaction with action swing, enriches the interaction mode in the online interaction process, and has good live interaction effect.
[0164] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF DRAWINGS
[0165] The accompanying drawings incorporated in the specification and forming a part of it, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure without imposing undue limitation on the disclosure.
[0166] Figure 1is a schematic diagram of an implementation environment of a data processing method according to an exemplary embodiment.
[0167] Figure 2 is a whole execution flowchart of a data processing method according to an exemplary embodiment.
[0168] Figure 3 is a flowchart of a limb interaction PK according to an exemplary embodiment.
[0169] Figure 4 is a flowchart of a data processing method according to an exemplary embodiment.
[0170] Figure 5 is a flowchart of a data processing scheme according to an exemplary embodiment.
[0171] Figure 6 is a schematic diagram of a live interface according to an exemplary embodiment.
[0172] Figure 7 is a schematic diagram of another live interface according to an exemplary embodiment.
[0173] Figure 8 is a schematic diagram of another live interface according to an exemplary embodiment.
[0174] Figure 9 is a schematic diagram of another live interface according to an exemplary embodiment.
[0175] Figure 10 is a flowchart of another data processing method according to an exemplary embodiment.
[0176] Figure 11 is a flowchart of another data processing scheme according to an exemplary embodiment.
[0177] Figure 12 is a schematic diagram of another live interface according to an exemplary embodiment.
[0178] Figure 13 is a flowchart of another data processing scheme according to an exemplary embodiment.
[0179] Figure 14 is a schematic diagram of another live interface according to an exemplary embodiment.
[0180] Figure 15 is a schematic diagram of another live interface according to an exemplary embodiment.
[0181] Figure 16FIG. 6 is a schematic diagram of another live interface according to an example embodiment.
[0182] Figure 17 FIG. 7 is a schematic diagram of another live interface according to an example embodiment.
[0183] Figure 18 FIG. 8 is a flow diagram of another data processing scheme according to an example embodiment.
[0184] Figure 19 FIG. 9 is a schematic diagram of another live interface according to an example embodiment.
[0185] Figure 20 FIG. 10 is a schematic diagram of another live interface according to an example embodiment.
[0186] Figure 21 FIG. 11 is a schematic diagram of another live interface according to an example embodiment.
[0187] Figure 22 FIG. 12 is a flow diagram of another data processing method according to an example embodiment.
[0188] Figure 23 FIG. 13 is a flow diagram of another data processing scheme according to an example embodiment.
[0189] Figure 24 FIG. 14 is a flow diagram of another data processing method according to an example embodiment.
[0190] Figure 25 FIG. 15 is a block diagram of a data processing apparatus according to an example embodiment.
[0191] Figure 26 FIG. 16 is a block diagram of a data processing apparatus according to an example embodiment.
[0192] Figure 27 FIG. 17 is a block diagram of a data processing apparatus according to an example embodiment.
[0193] Figure 28 FIG. 18 is a block diagram of a terminal according to an example embodiment.
[0194] Figure 29 FIG. 19 is a block diagram of a server according to an example embodiment. DETAILED DESCRIPTION
[0195] In order for those skilled in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be described clearly and completely below with reference to the drawings.
[0196] It should be noted that the terms "first", "second", and the like in the description and claims of the present disclosure and above-described accompanying drawings are used to distinguish similar objects, and do not necessarily indicate a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present disclosure described herein can be implemented in other than the order illustrated or described herein. The implementation described in the following exemplary embodiments does not represent all the implementations consistent with the present disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of the present disclosure as detailed in the appended claims.
[0197] The information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data for analysis, stored data, displayed data, etc.) and signals involved in the present disclosure are authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.
[0198] Figure 1 is a schematic diagram of an implementation environment of a data processing method according to an exemplary embodiment.
[0199] Referring to Figure 1 The implementation environment includes a first terminal 101, a second terminal 102, a third terminal 103 and a server 104. The target application is installed on the first terminal 101, the second terminal 102 and the third terminal 103. Exemplarily, the target application is an instant messaging application with live streaming function, such as a short video application.
[0200] In some embodiments, the types of the first terminal 101, the second terminal 102 and the third terminal 103 are smartphones. In addition, those skilled in the art can know that the number of the above-mentioned terminals can be more or less. For example, the above-mentioned terminals can be only a few, or the above-mentioned devices are dozens or hundreds, or more, and the number and type of terminals are not limited in the embodiments of the present disclosure.
[0201] In other embodiments, the server 104 provides background services for the target application. In addition, the server 104 is connected to the first terminal 101, the second terminal 102 and the third terminal 103 through a wireless network or a wired network. In addition, the server involved in the embodiments of the present disclosure can also include other functional servers in order to provide more comprehensive and diversified services.
[0202] In some embodiments, the first user account is connected to the second user account through the first terminal 101, the first terminal 101 acquires multimedia data (usually in the form of a stream) of the first user account through a camera component, and then sends the acquired multimedia data of the first user account to the server 104 and receives the multimedia data of the second user account returned by the server 104. Based on the acquired multimedia data of the first user account and the received multimedia data of the second user account, the live broadcast interface of the first user account displayed on the first terminal 101 displays the live broadcast picture of the first user account and the live broadcast picture of the second user account. Illustratively, the camera component is built-in or externally connected to the first terminal 101, which is not limited in the present disclosure.
[0203] In some embodiments, the second user account is connected to the first user account through the second terminal 102, the second terminal 102 acquires multimedia data of the second user account through a camera component, and then sends the acquired multimedia data of the second user account to the server 104 and receives the multimedia data of the first user account returned by the server 104. Based on the acquired multimedia data of the second user account and the received multimedia data of the first user account, the live broadcast interface of the second user account displayed on the second terminal 102 displays the live broadcast picture of the first user account and the live broadcast picture of the second user account. Illustratively, the camera component is built-in or externally connected to the second terminal 102, which is not limited in the present disclosure.
[0204] In some embodiments, the third user account receives the multimedia data of the first user account and the multimedia data of the second user account sent by the server 104 through the third terminal 103, and displays the live broadcast picture of the first user account and the live broadcast picture of the second user account. In other words, the first user account and the second user account are connected to interact as anchor accounts, and the third user account enters the live broadcast room of the first user account to watch the live broadcast.
[0205] Based on the above implementation environment, see Figure 2 and Figure 3 The data processing scheme provided by the embodiments of the present disclosure involves users (anchors and users), terminals (first terminal, second terminal and third terminal) and servers (also referred to as background).
[0206] As Figure 2 and Figure 3As shown, the data processing scheme proposes a PK of body interaction between different anchors in the process of online interaction around the PK scenario. After the anchor triggers the start of interaction on the terminal, the terminal will request the server to start the interaction. After the server determines that the anchor has the permission to start the interaction, the server will issue an interaction start information. That is, the server will configure a question for the anchor as a background, and then the irregularly shaped action contour line will be presented on the live interface of the terminal side. Next, the terminal will obtain the action posed by the anchor and render the action posing information on the live interface.
[0207] In addition, the terminal will also perform image acquisition and upload to the server, and then the server will make a judgment through image analysis algorithm to enter the result determination process. In addition, if the terminal performance is high, the terminal can also make a judgment through image analysis algorithm, which is not limited by the present disclosure. Among them, the result determination process is responsible for determining whether the action posed by the anchor matches the prescribed action, that is, who can first reach the prescribed action in a PK, is considered to win this round. That is, as long as one anchor completes the prescribed action first before the end of the PK, the PK ends in advance. After the server completes the determination, it will issue a determination result notification to the terminal to render the determination result on the terminal side.
[0208] It should be noted that in the process of online interaction, the audience can also help the anchor of our side to pose the prescribed action or interfere with the anchor of the other side to pose the prescribed action by sending virtual props. In addition, the virtual props received will be rewarded, such as the PK progress bar of the anchor will be scored, that is, the PK progress bar will be lengthened. Exemplarily, the score of the PK progress bar is related to the value of the virtual props received by the anchor, which is not limited by the present disclosure.
[0209] The data processing scheme provided by the embodiments of the present disclosure will be introduced in detail through the following embodiments.
[0210] Figure 4 is a flowchart of a data processing method according to an exemplary embodiment, as Figure 4 shown, the data processing method is applied in an electronic device, such as Figure 1 the first terminal or the second terminal shown. The data processing method includes the following steps:
[0211] In 401, in the process of online interaction, for the current round of battle, the electronic device displays a reference action in each region of the live interface; wherein the number of regions included in the live interface is the same as the number of accounts participating in the online interaction.
[0212] In the embodiments of the present disclosure, the user accounts participating in the current online interaction include a first user account and at least one second user account, and a third user account is a user account entering a live broadcast room of the first user account to watch a live broadcast. The at least one second user account includes a case where the second user account is one and a case where the second user account is two or more. The embodiments of the present disclosure are exemplified by taking the case where the second user account is one.
[0213] In the embodiments of the present disclosure, the online interaction is completed by joint live broadcast of multiple anchor user accounts. During the online interaction, the multiple anchor accounts participating in the online interaction can initiate interactive PK. In addition, during the online interaction, the terminal corresponding to each user account participating in the current online interaction acts as a push stream end and pushes multimedia data to the server side in the form of a stream in real time.
[0214] Taking the audience end merging as an example, the third terminal corresponding to the audience account needs to pull the multimedia data from the anchor end, including the multimedia data of the first user account and the multimedia data of the second user account; then, the multimedia data is merged according to the pulled multimedia data, and the live broadcast pictures of the first user account and the second user account are displayed after the merging is completed.
[0215] Taking the anchor end merging as an example, assuming that the first terminal is responsible for merging, the first terminal merges after obtaining the multimedia data of the second user account, and pushes the merged data, so that other users (including the second user account and the audience account) can display the live broadcast pictures after pulling the merged data.
[0216] In addition to the audience end merging and the anchor end merging, the server end merging is also possible, which is not limited in the present disclosure.
[0217] It should be noted that the current online interaction usually includes multiple sessions of body interaction PK, and the multiple sessions of body interaction PK are referred to as a PK in the present disclosure. For a PK, each anchor is assigned a topic in each session (body interaction PK or action posing PK). One topic includes a reference action that needs to be posed by the anchor.
[0218] In addition, for the current session, the reference action is rendered on the respective live broadcast interface, that is, a reference action is displayed in the region corresponding to each user account on the live broadcast interface. Exemplarily, the reference action is in the form of a picture, and the picture region other than the reference action is transparent, which is not limited in the present disclosure.
[0219] In some embodiments, a reference action is displayed in each region of the live broadcast interface in the following manner:
[0220] In response to the third user account performing the numerical transfer operation on the virtual prop, a reference action is displayed on the target region of the live interface based on the processing manner indicated by the virtual prop.
[0221] It should be noted that the numerical transfer operation herein refers to a transaction operation or a purchase operation. In addition, in response to the third user account performing the numerical transfer operation on the virtual prop, how to display the reference action on the target region based on the processing manner indicated by the virtual prop will be described later Figure 10 Corresponding embodiments.
[0222] In some other embodiments, in order to add interest, the reference action will automatically disappear after being displayed for a period of time. That is, the embodiments of the present disclosure further include: hiding the reference action displayed on each region of the live interface after a preset time period.
[0223] In this way, the interactive PK manner is enriched, and the human-computer interaction effect is significantly improved. In addition, the preset time period can be 3 seconds or 5 seconds, and the present disclosure does not limit this.
[0224] In some other embodiments, in order to add interest, part of the lines of the reference action can also be displayed, and the missing part is guessed by the user. That is, the reference action displayed on each region of the live interface is an action outline with missing lines. In this way, the interactive PK manner is enriched, and the human-computer interaction effect is significantly improved.
[0225] For this way, after displaying one reference action on each region of the live interface, the embodiments of the present disclosure further support providing an action prompt word for the user to assist the user in shooting the reference action. That is, the embodiments of the present disclosure further include:
[0226] 1. For any user account participating in the current online interaction, an action prompt word is obtained; wherein the action prompt word is used to prompt the user to pose an action matching the corresponding reference action.
[0227] For example, the embodiments of the present disclosure support obtaining the action prompt word in the following way:
[0228] The action prompt word is obtained from user comments. That is, other users can output a prompt for the user participating in the interaction in the form of comments. Or, the action prompt word is obtained from a question bank. The question bank includes a plurality of questions, and each question includes a reference action and at least one action keyword. For example, the action keyword corresponding to the reference action stored in the question can be used as the action prompt word.
[0229] 2. The action prompt word is displayed in a display manner that does not block the live interface. For example, the action prompt word is displayed in a lower region (also referred to as an operation interface or operation area) of the live interface, and the present disclosure does not limit this.
[0230] In some embodiments, the reference action is obtained from a database or is customized by the user.
[0231] The reference action is obtained from a data source based on the number of accounts participating in the live online interaction, wherein the data source includes but is not limited to a database, an image drawn by a target user account, and the like, and the present disclosure does not limit the same.
[0232] Taking the target user account and the third user account as an example, after obtaining the reference action of the first user account from the database, in response to the third user account performing a numerical transfer operation on the fourth virtual prop, the first terminal displays the image drawn by the third user account in a display mode that does not block the live interface. The image includes the reference action that the first user account intends to perform. For detailed description of this point, please refer to the subsequent Figure 10 corresponding embodiments.
[0233] In 402, the electronic device obtains the user action of each user account participating in the live online interaction.
[0234] Taking the first terminal as an example, the first terminal obtains the multimedia data of the first user account through the camera component, and receives the multimedia data of the second user account sent by the server, and then obtains the user action of each user account participating in the live online interaction based on the locally obtained multimedia data and the received multimedia data.
[0235] In 403, the electronic device displays the battle result of the current round of battle based on the similarity between the user action of each user account and the corresponding reference action.
[0236] For example, the server determines the result based on the similarity between the user action of each user account and the corresponding reference action, and the anchor end and the audience end directly display the battle result of the current round of battle according to the determination result sent by the server, and the present disclosure does not limit the same. In addition, the terminal can also determine the result based on the similarity between the user action of each user account and the corresponding reference action. For example, the first terminal or the second terminal determines the result and sends a determination result notification to the terminal corresponding to the other user account.
[0237] As shown in Figure 5 During the live broadcast, the anchor end (the first terminal and the second terminal) collects multimedia data in real time. In addition, a PK is usually time-limited, so the anchor end first determines whether the current PK has ended. If the current PK has ended, the result determination process ends; otherwise, the result determination process is entered.
[0238] In some embodiments, for the result determination process, the anchor end initiatively calls a ready interface on the server side to inform the server that the current PK is ready. Illustratively, after the ready interface returns success to the anchor end, the anchor end starts image collection, i.e., collects live picture images. In addition, the anchor end collects the whole picture every second and uploads the collected live picture images to the server, which is not limited in the present disclosure. Correspondingly, the server uses image analysis algorithm to determine the result by the obtained live picture images and the corresponding question. In the determination, the server first determines the contour of the action performed by the anchor, and then compares the contour of the action performed by the anchor with the corresponding reference action. If the similarity between the two reaches a similarity threshold (such as 80%), it is determined that the action performed by the anchor is successful; otherwise, it is determined that the action performed by the anchor is failed. For detailed description of the result determination process, please refer to the following.
[0239] In other embodiments, for the result determination process, taking the first terminal as an example, for any user account participating in the current online interaction, the first terminal first obtains the live picture image of the user account; wherein the live picture image includes the user's action and the corresponding reference action; then, the first terminal performs contour detection on the human body in the live picture image of the user account to obtain the action contour of the user; next, the similarity between the action contour of the user and the reference action is obtained; finally, the first terminal generates and displays the battle result of the current game based on the similarity corresponding to each user account and the similarity threshold.
[0240] For detailed description of the result determination process, please refer to the following Figure 22 corresponding embodiments.
[0241] It should be noted that if the action currently performed by the anchor is failed, the current determination is ended, and the new round of determination process is returned before the current game is ended; if the action currently performed by the anchor is successful, and the anchor uses the shortest time before the current game is ended, the question state of the corresponding question in the database is updated. For example, it is marked that the question has been used, and the action performed by the anchor when executing the question is successful, which is not limited in the present disclosure.
[0242] In addition, as Figure 5As shown, after the end of the current round of battle, if there is a next question, the server sends a PKStatisc signaling to the anchor end and the audience end respectively, indicating to update the question, i.e. to render a new question on the live interface. If there is no next question, the server sends a PKend signaling to the anchor end and the audience end respectively, indicating to mark the anchor who wins the current PK. In addition, if the current PK ends, the server announces the final result of the current PK according to the performance of each anchor in the current PK.
[0243] In some embodiments, the method provided by the embodiments of the present disclosure further includes: based on the start time of the current round of battle, displaying a start countdown and a start prompt of the current round of battle on the live interface of the anchor end and the audience end. As shown in Figure 6 The start prompt can be "game start", which is not limited by the present disclosure.
[0244] In other embodiments, as shown in Figures 7-9 The method provided by the embodiments of the present disclosure further includes: after the start of the current round of battle, displaying a score board. The score board displays the round information (such as the first round), the current cumulative score of each user account (such as 1 point), and the end countdown (such as 90 seconds) of the current round of battle.
[0245] In other embodiments, the method provided by the embodiments of the present disclosure further includes: based on the end time of the current round of battle, displaying an end countdown and an end prompt of the current round of battle on the live interface of the anchor end and the audience end. As shown in Figure 8 The end countdown can be displayed on the live interface 3 seconds before the end of the current round of battle, which is not limited by the present disclosure.
[0246] In other embodiments, the user's posing action is displayed in each region of the live interface, including but not limited to the following ways: in each region of the live interface, the corresponding user's posing action and the action comment information for the user's posing action are displayed respectively. As shown in Figure 9 The action comment information can be "perfect!" or "still need to work hard", which is not limited by the present disclosure. In addition, the battle result of the current round of battle can refer to Figure 9 .
[0247] The data processing scheme provided by the embodiments of the present disclosure realizes a new way of online interaction around the PK scenario. In detail, in the online interaction process of multiple anchors, the anchors can interact with each other through body interaction PK, that is, each anchor poses a body action to match the reference action (such as an irregular contour line) given by the system, and the PK result is determined according to the similarity between the user's posing action and the reference action given by the system. In other words, the data processing scheme associates online interaction with action posing, enriches the interaction mode in the online interaction process, and achieves good live interaction effect.
[0248] In addition, the data processing scheme enriches the display form of the live picture by displaying the start prompt, the end prompt, the score board, the action comment information, and the like, improves the human-computer interaction efficiency, and further ensures the human-computer interaction effect.
[0249] Figure 10 Fig. 1 is a flowchart of a data processing method according to an example embodiment, as shown in Fig. 1, the data processing method is applied in an electronic device, such as a third terminal as shown in Fig. 2. Taking the anchor end confluence as an example, the data processing method includes the following steps: Figure 10 Figure 1 In 1001, in the online interaction process, for the current game, the electronic device displays the user posing action of each user account and the corresponding reference action on the live interface based on the live picture after the confluence of each user account participating in the online interaction.
[0250] In 1001, in the online interaction process, for the current game, the electronic device displays the user posing action of each user account and the corresponding reference action on the live interface based on the live picture after the confluence of each user account participating in the online interaction.
[0251] In 1001, in the online interaction process, for the current game, the electronic device displays the user posing action of each user account and the corresponding reference action on the live interface based on the live picture after the confluence of each user account participating in the online interaction.
[0252] In 1001, in the online interaction process, for the current game, the electronic device displays the user posing action of each user account and the corresponding reference action on the live interface based on the live picture after the confluence of each user account participating in the online interaction.
[0253] Taking the audience end confluence as an example, this step can be replaced by: receiving the multimedia data of each user account participating in the online interaction sent by the server, and performing confluence based on the received multimedia data, and displaying the reference action and the user posing action in each region of the live interface after the confluence is completed. For the audience end, the multimedia data of each user account participating in the online interaction sent by the server includes: the multimedia data of the first user account participating in the online interaction, and the multimedia data of at least one second user account participating in the online interaction.
[0254] In the embodiments of the present disclosure, the user posing action and the reference action of different user accounts are displayed in different areas of the live interface; the number of areas included in the live interface is the same as the number of accounts participating in the current online interaction. In other words, the electronic device displays one reference action and one user posing action in each area of the live interface based on the confluence data. The number of areas included in the live interface is the same as the number of accounts participating in the current online interaction.
[0255] The detailed description of this step can refer to the foregoing step 401, which will not be repeated here.
[0256] In 1002, the electronic device displays the battle result of the current round of battle based on the similarity between the user posing action of each user account and the corresponding reference action.
[0257] As shown in Figures 11-21 , during the online interaction, the audience can also help the anchor of the home team to pose the specified action or interfere with the anchor of the opposing team to pose the specified action by gifting virtual props. Exemplarily, the types of the virtual props include but are not limited to the topic changing prop, the interference prop, and the drawing board prop, etc., which are not limited in the present disclosure.
[0258] The topic changing tool will be introduced below.
[0259] Referring to Figure 12 , a virtual prop panel is displayed on the audience side; wherein the first virtual prop (also referred to as the topic changing prop) is included on the virtual prop panel, wherein the first virtual prop is used to change the reference action.
[0260] Exemplarily, after the third user account enters the live room of the first user account, if it is detected that the third user account triggers the operation of a specific control, the third terminal displays the virtual prop panel in a display manner that does not block the live interface, which is not limited in the present disclosure.
[0261] As shown in Figure 11 , the third user account can purchase the topic changing prop in the virtual prop panel; wherein the virtual prop panel shows the value of a single virtual prop. After the third user account purchases the topic changing prop, it first determines whether the current round of battle is over; if it is over, the process ends; if it is not over, it queries all the topic information from the topic library, and randomly selects a new topic after excluding the current topic information of the first user account, and updates the new topic information to the database pkInfos.
[0262] In the embodiments of the present disclosure, in response to the third user account performing the value transfer operation on the first virtual prop, the third terminal replaces the currently displayed reference action with a new reference action in the area corresponding to the first user account, and issues first update signaling to the first user account and the second user account.
[0263] Exemplarily, the third terminal replaces the currently displayed reference action with a new reference action in the area corresponding to the first user account, and issues first update signaling to the first user account and the second user account, including that the server constructs PK update signaling (also referred to as first update signaling), and sends the signaling to the first terminal, the second terminal and the third terminal, so that the anchor end and the audience end draw a new reference action for the first user account according to the new topic information after receiving the signaling. In addition, the server saves the prop transaction information of the third user account, and deducts the virtual resources of the third user account according to the value of the traded virtual prop.
[0264] In another expression, in response to the value transfer operation of the third user account on the first virtual prop, the third terminal sends first data transfer information to the server to request the server to issue first update signaling to the first user account, the second user account and the third user account, and the first update signaling is used to indicate that the currently displayed reference action is replaced with a new reference action in the area corresponding to the first user account, so as to realize the topic changing for the first user account, that is, replacing the reference action.
[0265] Taking the first terminal as an example, in response to the value transfer operation of the third user account on the first virtual prop, the first terminal replaces the currently displayed reference action with a new reference action in the area corresponding to the first user account.
[0266] The interference prop will be introduced below.
[0267] Taking the interference prop as an example, referring to Figure 14 and Figure 16 , the virtual prop panel displayed on the audience end also includes a second virtual prop and a third virtual prop; wherein the second virtual prop is used to shield the action contour, and the third virtual prop is used to blur or hide the action contour.
[0268] As shown in Figure 13 , the third user account can purchase interference props (such as the second virtual prop and the third virtual prop described above) in the virtual prop panel. After the third user account purchases the interference prop, the server first judges whether the current round of battle is over; if it is over, the process ends; if it is not over, the information of the interference prop is obtained from the prop library.
[0269] In the embodiments of the present disclosure, in response to the third user account performing the numerical transfer operation on the second virtual prop, the third terminal displays the reference action blocked by the virtual special effect on the area corresponding to the second user account, and issues second update signaling to the first user account and the second user account.
[0270] Illustratively, the third terminal displays the reference action blocked by the virtual special effect on the area corresponding to the second user account, and issues second update signaling to the first user account and the second user account, including: the server constructs PK update signaling (divided into second update signaling and third update signaling), and sends the constructed signaling to the first terminal, the second terminal and the third terminal, so that the anchor end and the audience end perform operations such as blocking, blurring or hiding the reference action on the area corresponding to the second user account on the live interface after receiving the signaling.
[0271] In addition, for the interference prop, the server will also save the prop transaction information, and deduct the virtual resources of the third user account according to the value of the traded virtual prop.
[0272] In another expression, in response to the third user account performing the numerical transfer operation on the second virtual prop, the third terminal sends second numerical transfer information to the server to request the server to issue second update signaling to the first user account, the second user account and the third user account; wherein the second update signaling is used to instruct to display the reference action blocked by the virtual special effect on the area corresponding to the second user account. Figure 15 For example, from the perspective of the second terminal, in response to the third user account performing the numerical transfer operation on the second virtual prop, the second terminal displays the reference action blocked by the virtual special effect on the area corresponding to the second user account.
[0273] In another expression, in response to the third user account performing the numerical transfer operation on the third virtual prop, the third terminal sends third numerical transfer information to the server to request the server to issue third update signaling to the first user account, the second user account and the third user account; wherein the third update signaling is used to instruct to blur display or cancel display of the reference action on the area corresponding to the second user account. For example, from the perspective of the second terminal, in response to the third user account performing the numerical transfer operation on the third virtual prop, the second terminal blurs display (not shown in Figure 17 ) or cancels display (as shown in Figure 17 ) of the reference action on the area corresponding to the second user account.
[0274] The drawing prop will be introduced below.
[0275] For example, taking the drawing prop as an example, referring to Figure 19The fourth virtual prop (also referred to as a drawing tool) is further included on the virtual prop panel displayed on the audience side, and the fourth virtual prop is used to draw a prompt image.
[0276] As shown in Figure 18 , the third user account can purchase a drawing prop in the virtual prop panel. After the third user account purchases the drawing prop, the server first determines whether the current round of the battle is over. If the current round of the battle is over, the process ends. If the current round of the battle is not over, the audience can draw an image locally. Then, the third terminal sends fourth update signaling to the first user account.
[0277] Exemplarily, the third terminal sends fourth update signaling to the first user account, including sending the image to the server. The server carries the image in the PK update signaling (also referred to as fourth update signaling) and sends the signaling to the first terminal, so that the first terminal displays the prompt image after receiving the signaling. In addition, for the drawing prop, the server also saves the prop transaction information and deducts the virtual resource of the third user account according to the value of the traded virtual prop.
[0278] In another expression, referring to Figure 20 , in response to the numerical transfer operation of the third user account on the fourth virtual prop, the audience side displays a drawing panel. Then, the audience side obtains an image drawn by the third user account on the drawing panel and sends the image to the server to request the server to send fourth update signaling to the first user account. The fourth update signaling carries the image, and the image is used to prompt the first user account to pose a body action matching the reference action. As shown in Figure 21 , in response to the numerical transfer operation of the third user account on the fourth virtual prop, the image drawn by the third user account is displayed in a manner that does not block the live interface.
[0279] The data processing scheme provided by the embodiments of the present disclosure realizes a new online interaction mode around the PK scene. In detail, in the online interaction process of multiple anchors, body interaction PK can be performed between each other, that is, each anchor poses a body action to match the reference action (such as an irregular contour line) given by the system, and the similarity between the user's posing action and the reference action given by the system is used to determine the PK result. In other words, the data processing scheme associates online interaction with action posing, enriches the interaction mode in the online interaction process, and has good live interaction effect.
[0280] In addition, by giving virtual props in the body interaction PK, the interaction mode of the audience side is enriched, and the live interaction effect is further ensured.
[0281] Figure 22is a flowchart of a data processing method according to an exemplary embodiment, as Figure 22 shown, the data processing method is applied in an electronic device, such as Figure 1 shown. The data processing method comprises the following steps:
[0282] In 2201, in the process of live interaction, for the current game, the electronic device obtains the number of questions consistent with the number of accounts participating in the live interaction from the question bank; wherein one question includes one reference action.
[0283] In some embodiments, the live interaction can be initiated by the first user account or the second user account. Taking the first user account as the initiator of the live interaction as an example, the starting process of a live interaction includes:
[0284] The first terminal sends an interaction request to the server based on the logged-in first user account, wherein the interaction request is used for live interaction with the second user account; the server forwards the interaction request to the second terminal; the second terminal sends feedback information of agreeing to interact in response to the agreeing-to-interact operation of the logged-in second user account; taking the first terminal as an example, after receiving the feedback information of the second terminal, the server starts to push the multimedia data of the second user account to the first terminal, then the first terminal performs merging according to the multimedia data of the first user account and the second user account, and after completing the merging, pushes the merged data to the server. After that, the second terminal and the third terminal can pull the merged data to display the live picture. For example, display the reference action and the corresponding user posing action.
[0285] The first point to be explained is that in the process of live interaction, the number of third user accounts as spectators will change. For example, new third user accounts join the live room, and for example, old spectators exit the live room.
[0286] The second point to be explained is that, as shown in Figure 23 , after the anchor end requests the body interaction PK, the server first judges whether the anchor participating in the current PK has the function opening permission; if it does not have the function opening permission, the process ends here; if it has the function opening permission, it continues to judge whether the APP version of the anchor meets the requirements; only in the case that the APP version is greater than the minimum version of the function opening, the body interaction PK can be opened. Next, for a game, the server will randomly obtain the number of questions equal to the number of anchors from the question bank.
[0287] In some embodiments, the embodiments of the present disclosure also support determining whether the anchor has the function opening permission by the following manner. In other words, only when the preset condition is met, the server will proceed to the step of determining whether the APP version of the anchor meets the requirement. Exemplarily, the preset condition includes at least one of the following:
[0288] 1. The connection interaction between the first user account and the second user account belongs to a preset connection interaction type.
[0289] The connection interaction type includes but is not limited to double connection PK, multi-connection PK, etc., and the present disclosure does not limit this.
[0290] 2. The initiation mode of the connection interaction between the first user account and the second user account belongs to a preset initiation mode.
[0291] The initiation mode of the connection interaction includes but is not limited to random matching, friend PK, etc., and the present disclosure does not limit this.
[0292] 3. The number of fans of the connection interaction initiator in the first user account and the second user account is greater than a number threshold.
[0293] Exemplarily, this step can also be replaced by the number of fans of the first user account and the second user account being greater than the number threshold, and the present disclosure does not limit this.
[0294] 4. The interaction score of each of the first user account and the second user account is greater than a score threshold.
[0295] Exemplarily, this step is used to determine whether the PK progress bar reaches the score threshold of enabling the body interaction PK. Taking double connection PK as an example, the body interaction PK can be enabled only when the PK scores of both parties exceed 100 points.
[0296] The embodiments of the present disclosure limit the user from arbitrarily enabling a new connection interaction mode by setting a preset condition, avoid the arbitrary use of permissions, and also reduce the computing pressure of the server.
[0297] In 2202, the electronic device sends the obtained question to the first terminal; wherein the first terminal is used to display a reference action in each region of the live interface, and obtain the user posing action of each user account participating in the connection interaction.
[0298] In the embodiments of the present disclosure, in addition to the question information, the server also queries the props that can be used by the audience in this PK from the prop library, and then constructs the PK opening signaling (long link message) according to the obtained question information, PK start information and queried prop information, and sends the PK opening signaling to the anchor end and the audience end.
[0299] In the example, the PK start information includes, for example, an ID of the current PK, an ID of the anchor participating in the current PK, a number of anchors, a PK duration, etc., and the disclosure is not limited thereto.
[0300] In some embodiments, the prop information available to the audience of the current PK can be determined according to one or more of the following factors: an APP version of the anchor (e.g., the anchor initiating the current PK), a number of online audience in the live room of the anchor, virtual props allowed to be used by the anchor, a virtual resource transaction volume of the live room of the anchor, etc., and the disclosure is not limited thereto.
[0301] In 2203, the electronic device generates the battle result of the current round of battle based on the similarity between the user posing action of each user account and the corresponding reference action.
[0302] In some embodiments, the generation of the battle result of the current round of battle based on the similarity between the user posing action of each user account and the corresponding reference action includes, but is not limited to, the following manners:
[0303] 2203-1, for any user account participating in the current online interaction, obtaining a live picture image of the user account; wherein the live picture image includes the user posing action of the user account and the corresponding reference action.
[0304] In the example, the terminal corresponding to the user account can collect the image every second and upload the collected live picture image to the server, and the disclosure is not limited thereto.
[0305] 2203-2, performing contour detection on the human body in the live picture image to obtain the posing action contour of the user account.
[0306] For this step, a target detection algorithm can be used to perform target detection on the live picture image to detect whether the live picture image includes a human body. In the case where the live picture image includes a human body, a contour detection algorithm is used to perform contour detection on the human body, and the posing action contour of the user account is obtained.
[0307] 2203-3, determining the similarity between the posing action contour of the user account and the corresponding reference action.
[0308] For this step, the similarity between the action pose contour of the user account and the corresponding reference action can be determined based on a contour matching technique. Illustratively, the contour matching technique includes contour feature description and contour matching. The extracted contour feature can be a shape context, a Fourier descriptor, or a contour moment, which are not limited in the present disclosure. The contour matching is accomplished by calculating the distance between two contour features to obtain the similarity therebetween.
[0309] 2203-4, in response to the obtained similarity being greater than the similarity threshold and the action pose time of the user account being the shortest in the current round of the battle, determining that the user account wins in the current round of the battle and accumulating a score for the user account in the current round of the battle. Illustratively, in a round of battle, the winning side scores 1 point and the other user accounts score 0 points, which are not limited in the present disclosure.
[0310] The data processing scheme provided by the embodiments of the present disclosure realizes a new online interactive mode around the PK scenario. In detail, in the online interactive process of multiple anchors, body interaction PK can be performed between each other, that is, each anchor poses a body action to fit the reference action (an irregular contour line) given by the system, and the PK result is determined according to the similarity between the user pose and the reference action given by the system. In other words, the data processing scheme associates online interaction with action posing, enriches the interactive mode in the online interactive process, and has good live interactive effect.
[0311] The above Figure 4 、 10 and 22 are only basic flows of the present disclosure, and the scheme provided by the present disclosure will be further described based on a specific implementation manner, Figure 24 is a flowchart of another data processing method according to an exemplary embodiment, as shown in Figure 24 , taking the interaction between the first terminal, the second terminal, the third terminal and the server as an example, the data processing method includes the following steps:
[0312] In 2401, the online interaction is started, and after starting the action posing PK, the server obtains a number of questions consistent with the number of user accounts from a question bank for the current round of PK; wherein one question includes one reference action.
[0313] In 2402, the server distributes the obtained questions to the first terminal, the second terminal and the third terminal respectively.
[0314] In 2403, the first terminal, the second terminal and the third terminal display one reference action in each region of the live interface respectively; wherein the number of regions included in the live interface is the same as the number of user accounts participating in the current PK.
[0315] In 2404, the first terminal respectively displays the user posing actions in each region of the live interface.
[0316] In 2405, the second terminal respectively displays the user posing actions in each region of the live interface.
[0317] In 2406, the third terminal respectively displays the user posing actions in each region of the live interface.
[0318] Exemplarily, for the above steps 2403-2407, assuming that the confluence terminal is the first terminal, the second terminal and the third terminal can respectively display the reference actions and the corresponding user posing actions in each region based on the pulled confluence data, and the present disclosure does not make any limitation in this regard.
[0319] In 2407, the server generates the battle result of the current round of battle based on the similarity between the user posing actions of each user account and the corresponding reference actions.
[0320] In 2408, the server respectively delivers the battle result of the current round of battle to the first terminal, the second terminal and the third terminal.
[0321] In 2409, the first terminal, the second terminal and the third terminal display the battle result of the current round of battle.
[0322] The data processing scheme provided by the embodiments of the present disclosure realizes a new online interaction mode around the PK scenario. In detail, in the online interaction process of multiple anchors, the anchors can interact with each other through body interaction PK, that is, each anchor poses a body action to fit the reference action (such as irregular contour line) given by the system, and determines the PK result according to the similarity between the user posing action and the reference action given by the system. In other words, the data processing scheme associates the online interaction with the action posing, enriches the interaction mode in the online interaction process, and has good live interaction effect.
[0323] Figure 25 is a block diagram of a data processing apparatus according to an exemplary embodiment. Referring to Figure 25 The apparatus comprises:
[0324] The first display module 2501 is configured to, in the online interaction process, for a current round of battle, respectively display a reference action in each region of a live interface; wherein the live interface comprises a number of regions which is the same as the number of accounts participating in the online interaction;
[0325] The second display module 2502 is configured to obtain a user posing action of each user account participating in the current online interaction; and display a battle result of a current round of battle based on a similarity between the user posing action of each user account and a corresponding reference action.
[0326] The data processing scheme provided by the embodiments of the present disclosure realizes a new online interaction mode around the PK scenario. In detail, in the online interaction process of multiple anchors, the anchors can perform body interaction PK with each other, that is, each anchor poses a body action to fit a reference action (such as an irregular contour line) given by the system, and determines a PK result according to a similarity between the user posing action and the reference action given by the system. In other words, the data processing scheme associates the online interaction with the action posing, enriches the interaction mode in the online interaction process, and has a good live interaction effect.
[0327] In some embodiments, the user accounts participating in the current online interaction include a first user account and at least one second user account; and the first display module 2501 is configured to:
[0328] In response to a numerical transfer operation performed by a third user account on a virtual prop, display a reference action based on a processing mode indicated by the virtual prop on a target region of the live interface;
[0329] The third user account is a user account that enters a live room of the first user account to watch live streaming.
[0330] In some embodiments, the first display module 2501 is configured to:
[0331] In response to a numerical transfer operation performed by the third user account on a first virtual prop, replace the currently displayed reference action with a new reference action on a region corresponding to the first user account;
[0332] The first virtual prop is used to replace the reference action.
[0333] In some embodiments, the first display module 2501 is configured to:
[0334] In response to a numerical transfer operation performed by the third user account on a second virtual prop, display a reference action obscured by a virtual special effect on a region corresponding to the second user account;
[0335] The second virtual prop is used to obscure the action contour.
[0336] In some embodiments, the first display module 2501 is configured to:
[0337] In response to the third user account performing the numerical transfer operation on the third virtual prop, the reference action is displayed or hidden on the area corresponding to the second user account;
[0338] The third virtual prop is used to blur or hide the action outline.
[0339] In some embodiments, the first display module 2501 is further configured to:
[0340] After a preset time length, the reference action displayed on each area of the live interface is hidden.
[0341] In some embodiments, the reference action displayed on each area of the live interface is an action outline with missing parts; and the first display module 2501 is further configured to:
[0342] After displaying one reference action on each area of the live interface, for any user account participating in the current live interaction, an action prompt word is obtained.
[0343] The action prompt word is displayed in a manner that does not block the display of the live interface.
[0344] The action prompt word is used to prompt the user account to perform an action matching the corresponding reference action.
[0345] In some embodiments, the first display module 2501 is configured to:
[0346] The action prompt word is obtained from user comments; or
[0347] The action prompt word is obtained from a question bank; the question bank includes a plurality of questions, and each question includes a reference action and at least one action keyword.
[0348] In some embodiments, the apparatus further includes:
[0349] A second obtaining module configured to obtain a reference action from a data source based on the number of accounts participating in the current live interaction.
[0350] The data source includes a question bank and an image drawn by a target user account; the question bank includes a plurality of questions, and each question includes a reference action.
[0351] In some embodiments, the user accounts participating in the current live interaction include a first user account and at least one second user account; and the target user account is a third user account entering a live room of the first user account to watch a live broadcast.
[0352] The second obtaining module is further configured to:
[0353] After the reference action corresponding to the first user account is obtained from the question bank, in response to the third user account performing a numerical transfer operation on a fourth virtual prop, an image drawn by the third user account is obtained;
[0354] The first display module 2501 is further configured to display the image in a manner that does not block the display of the live interface;
[0355] The image includes the reference action intended to be performed by the first user account.
[0356] In some embodiments, the second display module 2502 is further configured to:
[0357] After the current round of the game starts, a score board is displayed; the score board displays round information, a current cumulative score of each user account, and an end countdown of the current round of the game.
[0358] In some embodiments, the first display module 2501 is further configured to:
[0359] In each region of the live interface, a corresponding user action and action comment information for the user action are displayed.
[0360] In some embodiments, the second display module 2502 is configured to:
[0361] For any user account participating in the current online interaction, a live picture image of the user account is obtained; the live picture image includes a user action of the user account and a corresponding reference action;
[0362] The human body in the live picture image is subjected to contour detection to obtain a pose action contour of the user account.
[0363] The similarity between the pose action contour and an action contour of the reference action is obtained.
[0364] Based on the similarity corresponding to each user account and a similarity threshold, a game result of the current round of the game is displayed.
[0365] All the optional technical solutions described above can be combined to form optional embodiments of the present disclosure, which will not be described here.
[0366] Figure 26 is a block diagram of another data processing apparatus according to an exemplary embodiment. Referring to Figure 26 The apparatus includes:
[0367] The third display module 2601 is configured to, in the process of the online interaction, display, for a current round of the game, a user posing action of each user account and a corresponding reference action on a live interface based on a live picture after the user accounts participating in the online interaction are merged;
[0368] The user posing action and the reference action of different user accounts are displayed in different areas of the live interface; and the number of the areas included in the live interface is the same as the number of the user accounts participating in the online interaction.
[0369] The fourth display module 2602 is configured to display a game result of the current round of the game based on a similarity between the user posing action of each user account and the corresponding reference action.
[0370] The data processing scheme provided by the embodiments of the present disclosure realizes a new online interaction mode around the PK scenario. In detail, in the process of the online interaction of multiple anchors, the anchors can perform body interaction PK with each other, that is, each anchor poses a body action to fit a reference action (such as an irregular contour line) given by a system, and a PK result is determined according to a similarity between the user posing action and the reference action given by the system. In other words, the data processing scheme associates the online interaction with the action posing, enriches the interaction mode in the online interaction process, and has a good live interaction effect.
[0371] In some embodiments, the user accounts participating in the online interaction include a first user account and at least one second user account; and the apparatus further includes a second sending module.
[0372] The third display module 2601 is further configured to display a virtual prop panel; the virtual prop panel includes a first virtual prop, and the first virtual prop is used to replace a reference action; and in response to a numerical transfer operation of a third user account on the first virtual prop, a currently displayed reference action is replaced with a new reference action in an area corresponding to the first user account.
[0373] The second sending module is configured to, in response to the numerical transfer operation of the third user account on the first virtual prop, send first update signaling to the first user account and the second user account.
[0374] The first update signaling is used to instruct that the currently displayed reference action is replaced with the new reference action in the area corresponding to the first user account; and the third user account is a user account that enters a live room of the first user account to watch a live broadcast.
[0375] In some embodiments, the third display module 2601 is further configured to display a virtual prop panel; wherein the virtual prop panel comprises a second virtual prop, the second virtual prop being used to shield the action contour; and in response to a numerical transfer operation performed by a third user account on the second virtual prop, display a reference action shielded by a virtual special effect on a region corresponding to the second user account.
[0376] The second sending module is further configured to, in response to a numerical transfer operation performed by a third user account on the second virtual prop, send second update signaling to the second user account and the second user account.
[0377] The second update signaling is used to instruct display of a reference action shielded by a virtual special effect on a region corresponding to the second user account.
[0378] In some embodiments, the third display module 2601 is further configured to display a virtual prop panel; wherein the virtual prop panel comprises a third virtual prop, the third virtual prop being used to blur or hide the action contour; and in response to a numerical transfer operation performed by a third user account on the third virtual prop, blur display or cancel display of a reference action on a region corresponding to the second user account.
[0379] The second sending module is further configured to, in response to a numerical transfer operation performed by a third user account on the third virtual prop, send third update signaling to the second user account and the second user account.
[0380] The third update signaling is used to instruct blur display or cancel display of a reference action on a region corresponding to the second user account.
[0381] In some embodiments, the third display module 2601 is further configured to display a virtual prop panel; wherein the virtual prop panel comprises a fourth virtual prop, the fourth virtual prop being used to draw a prompt image; and in response to a numerical transfer operation performed by a third user account on the fourth virtual prop, display a drawing panel.
[0382] The second sending module is further configured to obtain an image drawn by the third user account on the drawing panel, and send fourth update signaling to the first user account.
[0383] The fourth update signaling carries the prompt image; and the prompt image is used to prompt the first user account to make a limb action matching a reference action.
[0384] All the optional technical solutions described above can be combined to form optional embodiments of the present disclosure, which will not be described here.
[0385] Figure 27 is a block diagram of another data processing apparatus according to an exemplary embodiment. Referring to Figure 27 , the apparatus comprises:
[0386] A first obtaining module 2701 is configured to, in a process of the live interaction, obtain a number of questions consistent with a number of accounts participating in the live interaction for a current round of the game; wherein one of the questions comprises one reference action;
[0387] A first sending module 2702 is configured to issue the obtained questions to a first terminal; wherein the first terminal is used to display one reference action in each region of a live interface respectively, and obtain a user action of each user account participating in the live interaction; the live interface comprises a number of regions same as the number of accounts participating in the live interaction; and the first terminal is a terminal corresponding to a first user account participating in the live interaction;
[0388] A processing module 2703 is configured to generate a game result of the current round of the game based on a similarity between the user action of each user account and the corresponding reference action.
[0389] The data processing scheme provided by the embodiments of the present disclosure realizes a new live interaction mode around the PK scenario. In detail, in the process of the live interaction of multiple anchors, the anchors can perform body interaction PK with each other, that is, each anchor fits a reference action (such as an irregular contour line) given by the system by posing a body action, and determines a PK result according to a similarity between the user action and the reference action given by the system. In other words, the data processing scheme associates the live interaction with the action posing, enriches the interaction mode in the live interaction process, and has a good live interaction effect.
[0390] In some embodiments, the first obtaining module 2701 is configured to:
[0391] obtain the same number of questions as the number of accounts participating in the live interaction from the question bank under the condition that a preset condition is met; wherein the preset condition comprises at least one of the following:
[0392] a version number of a target application installed on the first terminal and the second terminal is greater than a preset version number; and the second terminal is a terminal corresponding to the second user account;
[0393] the live interaction between the first user account and the second user account belongs to a preset live interaction type;
[0394] an initiation mode of the live interaction between the first user account and the second user account belongs to a preset initiation mode;
[0395] a number of fans of the online interaction initiator in the first user account and the second user account is greater than a threshold number of people;
[0396] interaction scores of the first user account and the second user account are greater than a threshold score.
[0397] In some embodiments, the processing module 2703 is configured to:
[0398] For any user account participating in the current online interaction, a live picture image of the user account is obtained; wherein the live picture image includes a user posing action of the user account and a corresponding reference action;
[0399] contour detection is performed on the human body in the live picture image to obtain a posing action contour of the user account;
[0400] a similarity between the posing action contour and an action contour of the corresponding reference action is determined;
[0401] in response to the obtained similarity being greater than a similarity threshold and the action posing time of the user account being the shortest in the current game, it is determined that the user account wins in the current game and accumulates a score for the user account in the current game.
[0402] All the optional technical solutions described above can be combined to form optional embodiments of the present disclosure, which will not be described here.
[0403] It should be noted that the data processing apparatus provided in the above embodiments is only used as an example to divide the above functional units when performing data processing. In actual applications, the above functions can be completed by different functional units according to needs, that is, the internal structure of the electronic device is divided into different functional units to complete all or part of the functions described above. In addition, the data processing apparatus and the data processing method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process is described in detail in the method embodiments, which will not be described here.
[0404] As for the apparatus in the above embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments related to the method, and will not be described in detail here.
[0405] In some embodiments, an electronic device is also provided, which includes:
[0406] one or more processors;
[0407] a memory for storing the processor-executable program code;
[0408] The processor is configured to execute the program code to implement the data processing method.
[0409] In response to the electronic device being provided as a terminal, Figure 28 FIG. 28 is a block diagram of a terminal 2800 according to an example embodiment.
[0410] Generally, the terminal 2800 includes a processor 2801 and a memory 2802.
[0411] The processor 2801 includes one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 2801 is implemented in at least one of a hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), a PLA (Programmable Logic Array). Alternatively, the processor 2801 includes a main processor and a coprocessor. The main processor is a processor for processing data in an awake state, also referred to as a CPU (Central Processing Unit). The coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 2801 is integrated with a GPU (Graphics Processing Unit) for rendering and drawing content to be displayed on a display screen. In some embodiments, the processor 2801 further includes an AI (Artificial Intelligence) processor for processing machine learning-related computing operations.
[0412] The memory 2802 includes one or more computer-readable storage media that is non-transitory. The memory 2802 further includes a high-speed random access memory, and a non-volatile memory such as one or more disk storage devices, flash storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 2802 is used to store at least one program code for being executed by the processor 2801 to implement the data processing method provided by the method embodiments in the present application.
[0413] In some embodiments, the terminal 2800 further includes a peripheral device interface 2803 and at least one peripheral device. The processor 2801, the memory 2802 and the peripheral device interface 2803 are connected through a bus or a signal line. Each peripheral device is connected to the peripheral device interface 2803 through a bus, a signal line or a circuit board. The peripheral device includes at least one of a radio frequency circuit 2804, a display screen 2805, a camera component 2806, an audio circuit 2807 and a power supply 2808.
[0414] The peripheral device interface 2803 is used to connect the at least one peripheral device related to I / O (Input / Output) to the processor 2801 and the memory 2802. In some embodiments, the processor 2801, the memory 2802 and the peripheral device interface 2803 are integrated on the same chip or circuit board; in other embodiments, any one or two of the processor 2801, the memory 2802 and the peripheral device interface 2803 are implemented on a separate chip or circuit board, which is not limited in the present application.
[0415] The radio frequency circuit 2804 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 2804 communicates with a communication network and other communication devices through electromagnetic signals. The radio frequency circuit 2804 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. In some embodiments, the radio frequency circuit 2804 includes an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and the like. The radio frequency circuit 2804 communicates with other terminals through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to the World Wide Web, a metropolitan area network, an intranet, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 2804 further includes NFC (Near Field Communication) related circuit, which is not limited in the present application.
[0416] The display screen 2805 is configured to display a UI (User Interface). The UI includes graphics, text, icons, video, and any combination thereof. In the case that the display screen 2805 is a touch display screen, the display screen 2805 is further configured to capture touch signals on or above the surface of the display screen 2805. The touch signals are input to the processor 2801 as control signals for processing. At this time, the display screen 2805 is further configured to provide virtual buttons and / or virtual keyboard, also known as soft buttons and / or soft keyboard. In some embodiments, the display screen 2805 is one, arranged on the front panel of the terminal 2800; in other embodiments, the display screen 2805 is at least two, arranged on different surfaces of the terminal 2800 or in a folding design; in other embodiments, the display screen 2805 is a flexible display screen, arranged on a curved surface or a folding surface of the terminal 2800. Alternatively, the display screen 2805 is arranged in an irregular shape other than a rectangle, i.e., a special-shaped screen. The display screen 2805 is made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).
[0417] The camera assembly 2806 is configured to capture images or videos. In some embodiments, the camera assembly 2806 includes a front camera and a rear camera. Typically, the front camera is arranged on the front panel of the terminal, and the rear camera is arranged on the back of the terminal. In some embodiments, the rear camera is at least two, which are any one of a main camera, a depth-of-field camera, a wide-angle camera, and a telephoto camera, to realize the background blur function by fusing the main camera and the depth-of-field camera, the panoramic shooting and VR (Virtual Reality) shooting function by fusing the main camera and the wide-angle camera, or other fusion shooting functions. In other embodiments, the camera assembly 2806 further includes a flash. The flash is a single-color-temperature flash or a double-color-temperature flash. The double-color-temperature flash refers to the combination of a warm light flash and a cold light flash, used for light compensation under different color temperatures.
[0418] The audio circuit 2807 includes a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting them into electrical signals that are input to the processor 2801 for processing, or to the radio frequency circuit 2804 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones are used, each located at a different part of the terminal 2800. Alternatively, the microphones may be array microphones or omnidirectional microphones. The speaker is used to convert electrical signals from the processor 2801 or the radio frequency circuit 2804 into sound waves. The speaker may be a conventional thin-film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 2807 also includes a headphone jack.
[0419] Power supply 2808 is used to power the various components in terminal 2800. Power supply 2808 can be AC power, DC power, a disposable battery, or a rechargeable battery. If power supply 2808 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is charged via a wired line, while a wireless rechargeable battery is charged via a wireless coil. The rechargeable battery also supports fast charging technology.
[0420] Those skilled in the art will understand that Figure 28 The structure shown does not constitute a limitation on terminal 2800 and may include more or fewer components than shown, or combine certain components, or use different component arrangements.
[0421] In other embodiments, another electronic device is also provided, comprising:
[0422] One or more processors;
[0423] Memory used to store the executable program code of the processor;
[0424] The processor is configured to execute the program code to implement the above-described data processing method.
[0425] In this context, the electronic device is provided as a server. Figure 29 This is a block diagram illustrating a server according to an exemplary embodiment.
[0426] The server 2900 can be quite different in configuration or performance, including one or more processors (Central Processing Units, CPUs) 2901 and one or more memories 2902, wherein the memory 2902 stores at least one piece of program code, which is loaded and executed by the processor 2901 to implement the data processing method provided by each of the above-mentioned method embodiments. Of course, the server 2900 also has components such as a wired or wireless network interface, a keyboard, and an input and output interface, etc. for input and output, and the server 2900 also includes other components for implementing device functions, which are not described here.
[0427] In some embodiments, a computer-readable storage medium including instructions, such as a memory including instructions, is also provided, which is executed by a processor of an electronic device to implement the above-mentioned data processing method. In other embodiments, the computer-readable storage medium is a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, etc.
[0428] In some embodiments, a computer program product is also provided, which includes a computer program that is executed by a processor of an electronic device to implement the above-mentioned data processing method.
[0429] Other embodiments of the present disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the aspects disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure following, in general, the principles of the present disclosure and including such departures from the present disclosure that come within known
[0430] It should be understood that the present disclosure is not limited to the precise structures described above and illustrated in the drawings and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims
1. A data processing method, characterized in that, Applied to the broadcaster's end, the method includes: During the online interaction, for the current game, after the game starts, a reference action is displayed in each area of the live broadcast interface. The reference action is the outline of the action with missing lines. The number of areas included in the live broadcast interface is the same as the number of accounts participating in the online interaction. The user accounts participating in the online interaction include a first user account and at least one second user account. During the battle, the system acquires the poses of each user account participating in the online interaction and displays the corresponding poses and commentary on them in each area of the live stream interface. Furthermore, in response to a third user account performing a value transfer operation on a fourth virtual item, the system acquires an image drawn by the third user account and displays it in a manner that does not obstruct the live stream interface. The third user account is the user account that entered the live stream room of the first user account to watch the live stream. The image includes a reference pose that the first user account intends to strike. After a match ends, the result of the current match is displayed based on the similarity between each user's pose and the corresponding reference pose.
2. The data processing method according to claim 1, characterized in that, The step of displaying a reference action in each area of the live streaming interface includes: In response to the third user account performing a value transfer operation on virtual items, a reference action is displayed on the target area of the live stream interface based on the processing method indicated by the virtual items.
3. The data processing method according to claim 2, characterized in that, In response to the third user account performing a value transfer operation for virtual items, a reference action is displayed on the target area of the live stream interface based on the processing method indicated by the virtual items, including: In response to the third user account performing a value transfer operation on the first virtual item, the currently displayed reference action in the area corresponding to the first user account is replaced with a new reference action; The first virtual prop is used to change the reference action.
4. The data processing method according to claim 2, characterized in that, In response to the third user account performing a value transfer operation for virtual items, a reference action is displayed on the target area of the live stream interface based on the processing method indicated by the virtual items, including: In response to the third user account performing a value transfer operation on the second virtual item, a reference action obscured by virtual effects is displayed in the area corresponding to the second user account. The second virtual prop is used to obscure the outline of the action.
5. The data processing method according to claim 2, characterized in that, In response to the third user account performing a value transfer operation for virtual items, a reference action is displayed on the target area of the live stream interface based on the processing method indicated by the virtual items, including: In response to the third user account performing a value transfer operation on the third virtual item, the reference action is either blurred or unshown in the area corresponding to the second user account. The third virtual prop is used to blur or hide the outline of the action.
6. The data processing method according to claim 1, characterized in that, The method further includes: After a preset duration, the reference actions displayed on each area of the live streaming interface are hidden.
7. The data processing method according to claim 1, characterized in that, After displaying a reference action in each area of the live streaming interface, the method further includes: For any user account participating in this online interaction, obtain action prompts; The action prompts are displayed in a manner that does not obscure the display of the live streaming interface; The action prompt words are used to prompt the user account to perform an action that matches the corresponding reference action.
8. The data processing method according to claim 7, characterized in that, The acquisition of action prompt words includes: Obtain the action prompt words from user comments; or, The action prompt words are obtained from the question bank; wherein the question bank includes multiple questions, and each question includes a reference action and at least one action keyword.
9. The data processing method according to claim 1, characterized in that, The method further includes: Based on the number of accounts participating in this online interaction, reference actions are obtained from the data source; The data source includes a question bank and images drawn by the third user account; the question bank includes multiple questions, and each question includes a reference action.
10. The data processing method according to claim 1, characterized in that, The method further includes: After the start of the current match, a scoreboard is displayed; the scoreboard displays the match information, the current accumulated score of each user account, and the countdown to the end of the current match.
11. The data processing method according to claim 1, characterized in that, The similarity between each user's posed action and the corresponding reference action, based on each user account, displays the result of the current match, including: For any user account participating in this online interaction, obtain the live stream image of the user account; wherein, the live stream image includes the user account's posed action and corresponding reference action; Contour detection is performed on the human body in the live broadcast image to obtain the posed action contour of the user account; Obtain the similarity between the outline of the posed action and the outline of the reference action; Based on the similarity score and similarity threshold for each user account, the result of the current match is displayed.
12. A data processing method, characterized in that, Applied to the audience, the method includes: During the online interaction, for the current game, after the game starts, based on the live broadcast screen after each user account participating in this online interaction merges, the live broadcast interface displays the user's posed action and corresponding reference action, as well as action comment information on the user's posed action; The reference action is the outline of an action with missing lines; the poses, comments, and reference actions of different user accounts are displayed in different areas of the live stream interface; the number of areas included in the live stream interface is the same as the number of accounts participating in this live stream interaction. After the match ends, the result of the current match is displayed based on the similarity between the user's pose and the corresponding reference pose. The user accounts participating in this online interaction include a first user account and at least one second user account; during the battle, the method also includes: Display a virtual prop panel, which includes a fourth virtual prop for drawing an image; in response to a third user account's value transfer operation on the fourth virtual prop, display a drawing panel; acquire the image drawn by the third user account on the drawing panel, and send a fourth update signaling to the first user account; The fourth update signaling carries the image; the image includes a reference action that the first user account intends to perform; the third user account is a user account that enters the live broadcast room of the first user account to watch the live broadcast.
13. The data processing method according to claim 12, characterized in that, The virtual prop panel also includes a first virtual prop, which is used to change the reference action; the method further includes: In response to the third user account performing a value transfer operation on the first virtual item, the currently displayed reference action in the area corresponding to the first user account is changed to a new reference action, and a first update signaling is sent to the first user account and the second user account; The first update signaling is used to instruct the currently displayed reference action to be replaced with a new reference action in the area corresponding to the first user account.
14. The data processing method according to claim 12, characterized in that, The virtual prop panel also includes a second virtual prop, which is used to obscure the action outline; the method further includes: In response to the third user account performing a value transfer operation for the second virtual item, a reference action obscured by virtual effects is displayed in the area corresponding to the second user account, and a second update signaling is sent to the first user account and the second user account; The second update signaling is used to instruct the display of a reference action obscured by a virtual effect in the area corresponding to the second user account.
15. The data processing method according to claim 12, characterized in that, The virtual prop panel also includes a third virtual prop, which is used to blur or hide the action outline; the method further includes: In response to the third user account performing a value transfer operation for the third virtual item, the reference action is blurred or unshown in the area corresponding to the second user account, and a third update signaling is sent to the first user account and the second user account; The third update signaling is used to instruct the display of a reference action in the area corresponding to the second user account, either by blurring or canceling the display.
16. A data processing method, characterized in that, Applied to a server, the method includes: During the online interaction, for the current game, the number of questions obtained is the same as the number of accounts participating in the online interaction; wherein, each question includes one reference action; the user accounts participating in the online interaction include a first user account and at least one second user account; The acquired questions are sent to the first terminal; wherein, the first terminal is used to display a reference action in each area of the live broadcast interface after the start of the battle, the reference action being the outline of an action with missing lines; during the battle, the user poses of each user account participating in the online interaction are acquired, and the corresponding user poses and action comment information for the user poses are displayed in each area of the live broadcast interface; in response to the third user account performing a value transfer operation for the fourth virtual item, the image drawn by the third user account is acquired and displayed in a way that does not obstruct the display of the live broadcast interface; The number of areas included in the live broadcast interface is the same as the number of accounts participating in the live broadcast interaction; the first terminal is the terminal corresponding to the first user account participating in the live broadcast interaction; the third user account is the user account that enters the live broadcast room of the first user account to watch the live broadcast; the image includes a reference action that the first user account wants to pose. After a match ends, the match result is generated based on the similarity between each user's pose and the corresponding reference pose.
17. A data processing apparatus, characterized in that, The device includes: The first display module is configured to, during the online interaction process, for the current game, display a reference action in each area of the live broadcast interface after the game starts, the reference action being the outline of an action with missing lines; wherein, the number of areas included in the live broadcast interface is the same as the number of accounts participating in the online interaction, and the user accounts participating in the online interaction include a first user account and at least one second user account. The second display module is configured to capture the poses of each user account participating in the online interaction during the battle. The first display module is further configured to display, in each area of the live streaming interface, the corresponding user pose and commentary information on the user pose. The second acquisition module is configured to acquire the image drawn by the third user account in response to the third user account performing a value transfer operation for the fourth virtual item, wherein the third user account is the user account that enters the live broadcast room of the first user account to watch the live broadcast. The first display module is further configured to display the image in a manner that does not obstruct the display of the live streaming interface; the image includes a reference pose that the first user account intends to make; The second display module is also configured to display the result of the current match after the match ends, based on the similarity between the user's pose and the corresponding reference pose for each user account.
18. A data processing apparatus, characterized in that, The device includes: The third display module is configured to, during the online interaction process, for the current game, after the game starts, based on the live broadcast screen after each user account participating in the online interaction merges, display the user's pose and corresponding reference pose on the live broadcast interface, as well as the action comment information for the user's pose. The reference action is the outline of an action with missing lines; the user accounts participating in this live interaction include a first user account and at least one second user account; the user poses, action comments, and reference actions of different user accounts are displayed in different areas of the live interface; the number of areas included in the live interface is the same as the number of accounts participating in this live interaction. The fourth display module is configured to display the result of the current match after the match ends, based on the similarity between the user's pose and the corresponding reference pose for each user account. The third display module is also configured to display a virtual item panel during battle; wherein the virtual item panel includes a fourth virtual item, which is used to draw prompt images; and the drawing panel is displayed in response to a third user account's value transfer operation for the fourth virtual item. The second sending module is also configured to acquire the image drawn by the third user account on the drawing panel and send a fourth update signaling to the first user account; The fourth update signaling carries the prompt image; the prompt image is used to prompt the first user account to make a body movement that matches the reference movement; the third user account is the user account that enters the live broadcast room of the first user account to watch the live broadcast.
19. A data processing apparatus, characterized in that, The device includes: The first acquisition module is configured to, during the online interaction process, acquire, for the current game, the number of questions that is consistent with the number of accounts participating in the online interaction; wherein, one question includes one reference action; the user accounts participating in the online interaction include a first user account and at least one second user account; The first sending module is configured to send the acquired question to the first terminal; wherein, the first terminal is used to display a reference action in each area of the live broadcast interface after the start of the battle, the reference action being the outline of an action with missing lines; during the battle, it acquires the user poses of each user account participating in the online interaction, and displays the corresponding user poses and action comment information for the user poses in each area of the live broadcast interface; in response to the third user account performing a value transfer operation for the fourth virtual item, it acquires the image drawn by the third user account and displays the image in a way that does not obstruct the display of the live broadcast interface; The number of areas included in the live broadcast interface is the same as the number of accounts participating in the live broadcast interaction; the first terminal is the terminal corresponding to the first user account participating in the live broadcast interaction; the third user account is the user account that enters the live broadcast room of the first user account to watch the live broadcast; the image includes a reference action that the first user account wants to pose. The processing module is configured to generate the result of the current game based on the similarity between the user's pose and the corresponding reference pose after the game ends.
20. An electronic device, characterized in that, The electronic device includes: One or more processors; Memory used to store the executable program code of the processor; The processor is configured to execute the program code to implement the data processing method as described in any one of claims 1 to 11; or, the data processing method as described in any one of claims 12 to 15; or, the data processing method as described in claim 16.
21. A computer-readable storage medium, characterized in that, When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the data processing method as described in any one of claims 1 to 11; or, the data processing method as described in any one of claims 12 to 15; or, the data processing method as described in claim 16.
22. A computer program product, characterized in that, The method includes a computer program that, when executed by a processor of an electronic device, implements the data processing method as described in any one of claims 1 to 11; or, the data processing method as described in any one of claims 12 to 15; or, the data processing method as described in claim 16.
Citation Information
Patent Citations
Interaction method and related device
CN112752159A
Live broadcast interaction method and system
CN113259692A
Human body action matching method and device, live broadcast system, computer equipment and medium
CN116597515A