Video processing method and device, storage medium, electronic equipment and program product

Abstract

The invention provides a video processing method and device, a storage medium, electronic equipment and a program product, and relates to the technical field of computers. The video processing method comprises the steps that in response to an interaction instruction, identification frames corresponding to a plurality of members in a target video are presented on a playing page of the target video, the identification frame corresponding to each member is associated with the position of the member in the playing page, and the interaction instruction is used for initiating an interaction request to at least one member in the target video; and in response to a selection instruction based on the identification box, determining a target member in the plurality of members. According to the scheme provided by the invention, the user determines the target member for interaction based on the identification box, and does not need to depend on a static nickname and a static head portrait for selection, so that the selection efficiency and accuracy of interaction are remarkably improved.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a video processing method and device, a storage medium, an electronic device, and a program product. Background Art

[0002] In existing video interaction scenarios, when a user wants to interact with a specific member in a video including multiple members, he or she usually needs to select the member through the nickname and avatar in the interaction interface.

[0003] However, since the positions and postures of the members in the video are constantly changing, it is difficult for users to accurately match the avatars and nicknames in the interactive interface with the real people in the video, which increases the difficulty of user selection and reduces the convenience and accuracy of interaction. Summary of the invention

[0004] In view of this, embodiments of the present application provide a video processing method and device, a storage medium, an electronic device, and a program product.

[0005] In a first aspect, an embodiment of the present application provides a video processing method, which is applied to a first user terminal, and the method includes: in response to an interactive instruction, presenting, on the playback page of the target video, identification boxes corresponding to multiple members in the target video, the identification box corresponding to each member is associated with the position of the member in the playback page, and the interactive instruction is used to initiate an interactive request to at least one member in the target video; in response to a selection instruction based on the identification box, determining a target member among the multiple members.

[0006] In combination with the first aspect, in certain implementations of the first aspect, the identification frame corresponding to each member is located in the facial area of ​​the member, and / or the identification frame corresponding to each member is located in a specific area above the head of the member.

[0007] In combination with the first aspect, in certain implementations of the first aspect, the identification box corresponding to each member follows the position of the member in the playback page; and / or the size of the identification box corresponding to each member is positively correlated with the size of the member in the playback page.

[0008] In combination with the first aspect, in certain implementations of the first aspect, the video processing method further includes: identifying facial information of each of the multiple members in the target video; labeling the multiple members based on the facial information of the multiple members, and generating identification boxes for the multiple members.

[0009] In combination with the first aspect, in certain implementations of the first aspect, the video processing method also includes: obtaining identification information of each of the multiple members in the target video from the second user terminal; labeling the multiple members based on the identification information of the multiple members, and generating identification boxes for the multiple members.

[0010] In combination with the first aspect, in certain implementations of the first aspect, identification information of each of the multiple members in the second user terminal is generated by the second user terminal before the target video is played based on facial images of the members to be included in the target video.

[0011] In combination with the first aspect, in certain implementations of the first aspect, the video processing method further includes: determining a target special effect, where the target special effect refers to a visual effect and / or audio effect triggered during the playback of a target video; and playing the target special effect based on a target member.

[0012] In combination with the first aspect, in some implementations of the first aspect, playing the target special effect based on the target member includes: playing the target special effect at a designated position corresponding to the target member in the play page.

[0013] In combination with the first aspect, in certain implementations of the first aspect, a target special effect is played at a designated position corresponding to the target member in the playback page, including: if the number of target members is one, the target member is given an enlarged close-up display, and the target special effect is played at the designated position corresponding to the target member in the playback page; if the number of target members is multiple, a special effect movement trajectory is generated based on the designated positions corresponding to the multiple target members, and the target special effect is played based on the special effect movement trajectory.

[0014] In combination with the first aspect, in certain implementation methods of the first aspect, the target special effect includes a gift-giving special effect, and the target special effect is played at a designated position corresponding to the target member in the playback page, including: adding the identity information of the target member to the visual element of the gift-giving special effect to generate a customized gift special effect containing the identity information of the target member; playing the customized gift special effect containing the identity information of the target member at the designated position corresponding to the target member in the playback page.

[0015] In combination with the first aspect, in certain implementations of the first aspect, the target special effect includes a gift-giving special effect, and the video processing method further includes: presenting a gift panel including multiple gifts on the playback page of the target video so that the user can determine the gift-giving special effect based on the gift panel.

[0016] In combination with the first aspect, in certain implementations of the first aspect, before determining a target member among multiple members in response to a selection instruction based on an identification box, it also includes: when at least one member is selected based on the identification box, selection prompt information corresponding to at least one member is presented on the playback page of the target video so that the user can determine whether to select the at least one member as the target member, and the selection prompt information refers to the prompt information displayed on the playback page of the target video on whether the at least one member is selected.

[0017] In the second aspect, an embodiment of the present application provides a video processing device, which is applied to a first user end, and the device includes: a presentation module, which is used to present, on the playback page of the target video, identification boxes corresponding to multiple members in the target video in response to the user's interaction instructions, wherein the identification box corresponding to each member is associated with the position of the member in the playback page, and the interaction instruction is used to initiate an interaction request to at least one member in the target video; a determination module, which is used to determine the target member among the multiple members in response to the user's selection instruction based on the identification box.

[0018] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program, and the computer program is used to execute the video processing method described in the first aspect.

[0019] In a fourth aspect, an embodiment of the present application provides an electronic device, comprising: a processor; a memory for storing instructions executable by the processor; and the processor is used to execute the video processing method described in the first aspect.

[0020] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes instructions, and when the instructions are executed on an electronic device, the electronic device implements the video processing method described in the first aspect.

[0021] In this application, by presenting an identification box associated with the member's position on the target video playback page, users can determine the target member to interact with based on the identification box, without having to rely on static nicknames and avatars for selection, which significantly improves the efficiency and accuracy of interactive selection. In addition, this intuitive selection method simplifies the operation process, enhances the user's interactive experience with video content, enables users to interact with target members more conveniently and accurately, and improves the overall quality of video interaction and user satisfaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] By describing the embodiments of the present application in more detail in conjunction with the accompanying drawings, the above and other purposes, features and advantages of the present application will become more apparent. The accompanying drawings are used to provide a further understanding of the embodiments of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the present application and do not constitute a limitation of the present application. In the accompanying drawings, the same reference numerals generally represent the same components or steps.

[0023] Figure 1 Shown is a schematic diagram of a video interactive page in the prior art.

[0024] Figure 2 FIG. 1 is a schematic diagram of an implementation environment of a video processing method provided in an embodiment of the present application.

[0025] Figure 3The figure is a flow chart of a video processing method provided in one embodiment of the present application.

[0026] Figure 4 Shown is a schematic diagram of a playback page of a target video in a live broadcast scenario provided by an embodiment of the present application.

[0027] Figure 5 Shown is a schematic diagram of a playback page of a target video in a multi-person PK scenario provided by an embodiment of the present application.

[0028] Figure 6 Shown is a schematic diagram of a playback target special effect provided in an embodiment of the present application.

[0029] Figure 7 Shown is a schematic diagram of a playback target special effect provided by another embodiment of the present application.

[0030] Figure 8 FIG. 4 is a schematic diagram of the structure of a video processing device provided in one embodiment of the present application.

[0031] Fig. 9 Shown is a schematic structural diagram of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0032] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0033] In today's video interaction environment, user engagement and experience are crucial. However, existing interaction mechanisms still have obvious limitations in some aspects, especially when users want to interact with specific members in the video, such interaction includes but is not limited to expressing support, sending virtual gifts or other forms of personalized communication.

[0034] Figure 1 FIG. 1 is a schematic diagram of a video interactive page in the prior art. Figure 1 As shown in the left figure, when a user wants to send a virtual gift to a member in a video, he usually needs to operate on a dedicated video interaction page. Specifically, when the user expands the folded option corresponding to "Send Gift to", the page will list the following Figure 1 The picture on the right shows the nicknames and avatars of all members participating in the video interaction, and users need to select the one they want to interact with.

[0035] However, this selection process has some flaws. Specifically, the members in the video may appear in different positions and angles, and the picture is dynamic, and the positions and postures of the members will continue to change as the video progresses. This makes it difficult for users to accurately match the static avatars and nicknames in the interactive interface with the dynamic real-life images in the video. The ambiguity of this correspondence not only increases the uncertainty of users in the process of selecting interactive objects, but may also cause users to select the wrong objects, thereby affecting the accuracy of the interaction and user satisfaction.

[0036] In summary, the existing video interaction mechanism has defects in accuracy and intuitiveness when users select specific members. Therefore, the present application provides a video processing method, which can provide a more intuitive and accurate selection mechanism to improve the quality of the entire video interaction. The implementation environment and specific implementation methods of the video processing method will be described in detail below.

[0037] Figure 2 FIG. 1 is a schematic diagram of an implementation environment of a video processing method provided by an embodiment of the present application. Figure 2 As shown, the implementation environment includes a first user terminal 210, a second user terminal 220 and a server 230. Exemplarily, the first user terminal 210 is a user terminal (also called a viewer terminal) corresponding to a user who wants to interact with a member in a target video, and the second user terminal 220 is a user terminal (also called a host terminal) corresponding to multiple members in the target video. The first user terminal 210 and the second user terminal 220 are connected to the server 230 via a wireless or wired network.

[0038] In some embodiments, the first user terminal 210 and the second user terminal 220 include a smart phone, a tablet computer, a laptop computer, a desktop computer, etc. The server 230 is an independent physical server, or a server cluster or a distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms, and the present disclosure does not limit this.

[0039] In an example of a group broadcast live scene, multiple group broadcast members are displayed on the screen of the first user terminal 210. When the user wants to interact with one of the members, he only needs to issue an interactive command, and an identification box that accurately corresponds to the position of the group broadcast member will appear in the live broadcast screen in real time. For example, these identification boxes move with the movement of the members. By clicking on the identification box, the user can determine the target member identified by the identification box. This method makes the user's selection more intuitive and accurate, greatly improving the experience of giving gifts.

[0040] In another interactive scenario of a multi-person video call, the user wants to send a fun virtual sticker to friend B to express his or her mood. Then, after the user issues an interactive command on the video chat interface, multiple identification boxes corresponding to the positions of the friends will appear on the screen. After the user clicks on the corresponding identification box of friend B, it means that friend B is selected as the interactive object. Then, select a virtual sticker, click send, and the sticker will appear on friend B's face. This process ensures the precise correspondence between the identification box and the friend's position, making the user's operation more intuitive and accurate, and improving the interactivity and fun of the video chat.

[0041] Figure 3 FIG. 2 is a flow chart of a video processing method provided by an embodiment of the present application. Figure 3 As shown, the video processing method includes the following steps.

[0042] Step S310, in response to the interactive instruction, presenting identification boxes corresponding to the multiple members in the target video on the playback page of the target video.

[0043] The interactive instruction is used to initiate an interactive request to at least one member in the target video. For example, the interactive instruction refers to a request issued by a user to interact with a member in the target video by operating the playback page while watching the target video, such as clicking, touching or voice command.

[0044] After receiving the interactive instruction, the first user terminal generates and presents an identification frame for each of the multiple members appearing in the target video on the playback page of the target video, and the identification frame corresponding to each member is associated with the position of the member in the playback page. The identification frame is a visual element used to highlight and identify a specific member on the playback page. Optionally, the identification frame is a rectangular, circular or other shaped frame surrounding a designated position corresponding to the target member, such as the head or chest.

[0045] Step S320, in response to the selection instruction based on the identification box, determining a target member among the multiple members.

[0046] It is understandable that the purpose of the identification box is to help users more intuitively and accurately identify and select the members they want to interact with. Therefore, when the user sees the identification box associated with the member's position, he can issue a selection instruction by clicking or touching. Then, the first user terminal determines the target member from multiple members according to the user's selection instruction. Optionally, the target member includes members who interact with the user, such as sending virtual gifts, liking or commenting. Optionally, the target member also includes members who perform specific actions (such as waving, raising hands, etc.) or trigger certain preset events (such as entering the screen, leaving the screen, performing specific performances, etc.).

[0047] In this embodiment, by presenting an identification box associated with the member's position on the target video playback page, the user can determine the target member to interact with based on the identification box, without having to rely on static nicknames and avatars for selection, which significantly improves the efficiency and accuracy of interactive selection. In addition, this intuitive selection method simplifies the operation process, enhances the user's interactive experience with the video content, enables users to interact with the target member more conveniently and accurately, and improves the overall quality of video interaction and user satisfaction.

[0048] exist Figure 3 Based on the illustrated embodiment, the video processing method further includes: when at least one member is selected based on the identification box, selection prompt information corresponding to at least one member is presented on the playback page of the target video to determine whether the at least one member is selected as the target member.

[0049] Selection prompt information refers to the prompt information displayed on the playback page of the target video indicating whether the at least one member is selected. Exemplarily, selection prompt information refers to the interactive prompt displayed on the playback page when the user selects at least one member in the target video through the identification box, the purpose of which is to clearly indicate the current selection status to the user and guide the user to confirm whether to determine the selected member as the target member. Exemplarily, the selection prompt information can be a text prompt, a graphic logo, an animation effect or any other form of visual prompt to enhance the intuitiveness and accuracy of the user's operation and ensure that the user can clearly understand the result of the current operation when selecting the target member.

[0050] Figure 4 FIG. 1 is a schematic diagram of a target video playback page in a live broadcast scenario provided by an embodiment of the present application. Figure 4In the left figure, the identification box of each member is black and located in the head area of ​​the member. When the user selects at least one member based on the identification box, the identification box of the selected member is displayed in red. This display mode of the identification box changing from black to red is the selection prompt information. It provides users with feedback on the current selection status through visual changes, and clearly informs users which members have been selected. This design enhances the intuitiveness of user operations and simplifies the selection process, allowing users to quickly and accurately confirm whether to determine the selected member as the target member.

[0051] Figure 5 The figure shows a schematic diagram of a target video playback page in a multiplayer PK (Player Kill) scenario provided by an embodiment of the present application. Figure 5 In the scene shown, there are 4 anchors appearing in the video at the same time. Each anchor has an identification box in the head area. Users can select the anchor they want to interact with by clicking on the identification box. As shown in the figure on the right, when the user selects an anchor, the anchor's identification box will turn red as a selection prompt, clearly indicating that the anchor has been selected as the interaction object. If the user wants to add an interaction object, just click on the identification box of another anchor, and the identification box of the anchor will change to red, ensuring that the user can intuitively see their selection.

[0052] In addition, when the user clicks the identification box, the member is selected as the target member. If the user wants to cancel, just click the identification box of the member again. Figure 4 and Figure 5 In the playback page, for the selected anchors, the avatars and nicknames of these anchors will be displayed, further clarifying the user's selection objects and providing users with clear selection feedback.

[0053] Next, in Figure 3 On the basis of the illustrated embodiment, the presentation of the identification frame is further optimized to enhance its practicality and user experience. Specifically, the identification frame corresponding to each member is located in the facial area of ​​the member, which can help the user quickly identify and lock the target member. And / or, the identification frame corresponding to each member is located in a specific area above the head of the member, which avoids the visual interference that may be caused by blocking the member's face, while maintaining a close association between the identification frame and the member, making it easier for the user to perform selection operations without blocking the line of sight.

[0054] The flexible positioning method of this embodiment enables users to easily find and select the object they want to interact with through the identification box regardless of how the position of the member in the target video changes, thereby enhancing the fluency and interactivity of the video interaction.

[0055] exist Figure 3On the basis of the illustrated embodiment, in order to improve the matching effect between the identification frame and the member and ensure that the user can easily identify and select the target member in the dynamic video scene, the present application also optimizes the dynamic performance of the identification frame. Specifically, the identification frame corresponding to each member moves with the position of the member in the playback page; and / or, the size of the identification frame corresponding to each member is positively correlated with the size of the member in the playback page.

[0056] In this embodiment, the identification frame is no longer limited to a static position, but can be adjusted in real time according to the member's movements and position changes in the video. Specifically, when the member moves in the target video, the identification frame will move with the member's movement, always maintaining a corresponding relationship with the member, ensuring that the user can continue to accurately identify and select the target member.

[0057] In some embodiments, the size of the identification box corresponding to each member is positively correlated with the size of the member in the playback page, which enables the size of the identification box to intuitively reflect the relative importance or attention of the member in the video, while also improving the accuracy and convenience of user interaction with video content. For example, when a member occupies a larger space in the picture, that is, is the main focus of the picture, the corresponding identification box will also be larger, so that users can more easily identify and interact with it; on the contrary, if the member only occupies a smaller space in the picture, the identification box will also be reduced accordingly to avoid excessive interference with the user's viewing experience. In addition, this design also helps to clearly distinguish and highlight different participants in multi-person interactive scenarios, such as live PK, so that viewers can quickly identify the objects they want to support or interact with.

[0058] To sum up, the dynamic adjustment mechanism of this embodiment ensures that the identification frame always corresponds accurately to the members. Even when the members move frequently or the lens is stretched and zoomed, the user can accurately identify and select the target member, thereby improving the efficiency and accuracy of the interactive selection and enhancing the overall experience of video interaction.

[0059] Figure 3 The illustrated embodiment clarifies the association between the identification frame and the member position. In order to ensure that the identification frame can accurately correspond to each member, this embodiment will further explain how to generate these identification frames. Specifically, firstly, the facial information of multiple members in the target video is identified; then, the multiple members are labeled based on their facial information, and identification frames of the multiple members are generated.

[0060] Optionally, when the user issues an interactive command, the user terminal first uses local AI (Artificial Intelligence) face recognition technology to fully scan the scene in the target video and identify all facial information that appears. This process can not only quickly locate the facial position of each member, but also analyze the facial features of each member through a deep learning algorithm, and then generate a facial identifier, i.e., an identifier frame, for each member.

[0061] In this embodiment, the method for generating identification frames based on facial information not only improves the accuracy of member identification, but also provides users with a more intuitive and convenient interactive selection method. By clicking or selecting these identification frames, users can determine the target members with whom they want to interact, which greatly improves the efficiency of video interaction and user experience.

[0062] In order to further enrich the generation method of the identification frame, the present embodiment also introduces a second user terminal to obtain the identification frame of the member. Specifically, the identification information of each of the multiple members in the target video is obtained from the second user terminal; the multiple members are marked based on the identification information of each of the multiple members, and the identification frames of the multiple members are generated.

[0063] The identification information of a member refers to a set of characteristic data or attributes used to uniquely identify and distinguish different members in a target video. Optionally, the identification information of a member includes key information related to the member, such as the member's facial features, name, identity identifier, role name, or other descriptive information related to the member's identity. The purpose is to facilitate accurate labeling of members in the target video content.

[0064] For example, the second user terminal uses Face ID (facial recognition) technology to label the characters appearing in the picture to determine the identification information of each member, and the identification information will be transmitted to the first user terminal, so that the first user terminal interface will display complete information including the member's face and corresponding name. Then, the first user terminal uses the identification information to accurately identify and distinguish each member in the target video, and on this basis, generates a separate identification box for each member.

[0065] The solution in this embodiment makes full use of the data resources of multiple user terminals, making the source of identification information richer and more diverse, and further improving the flexibility of identification frame generation. In addition, by introducing the identification information of the second user terminal, it is also possible to achieve real-time update and dynamic adjustment of video content. For example, in a live broadcast scene, the audience can see the identification information of the newly joined member in real time through the first user terminal, so as to better participate in the interaction.

[0066] As can be seen from the above embodiments, obtaining identification information of members in the target video from the second user terminal is one of the key steps for the first user terminal to generate identification frames of members. The following further describes the generation method of these identification information. Specifically, the identification information of each of the multiple members in the second user terminal is generated by the second user terminal before the target video is played, based on the facial images of the members to be included in the target video.

[0067] For example, before the user interacts with the members of the target video, the second user terminal can enter the member roles that may appear in the video into the AI ​​model, and the entered information includes uploading multiple pictures of their own faces. Through these pictures, the AI ​​model can pre-generate identification information in advance.

[0068] This embodiment significantly improves the efficiency and accuracy of video content annotation by having the second user terminal generate identification information based on the facial image of the member to be in the frame before the target video is played. Moreover, this preprocessing method not only provides an accurate data basis for the subsequent generation of identification frames, but also greatly improves the accuracy of recognition and the smoothness of the process. In addition, this method of generating identification information in advance also optimizes resource allocation, reduces the burden of real-time processing, and makes the display of the entire video content more stable and efficient.

[0069] Figure 3 The embodiment shown realizes the position association between the identification frame and the member, and on this basis, this embodiment further expands the interactive function between the user and the video content, providing the user with a richer interactive experience. Specifically, determine the target special effect; play the target special effect based on the target member.

[0070] Target special effects refer to visual or audio effects triggered by user operation instructions during the playback of the target video, which are used to enhance the interactive experience between the user and the members in the target video.

[0071] Specifically, when a user triggers an interactive command, the user terminal determines the target member and obtains the target special effects determined by the user. Optionally, these special effects include visual or audio effects. Then, the corresponding target special effects are played at the position of the target member, for example, the animation effect of the target special effect is displayed near the identification box of the target member. This implementation method not only enhances the interactivity between the user and the members in the target video, but also makes the user's interactive behavior more intuitive and vivid through the visual presentation of the target special effects, thereby improving the overall viewing experience.

[0072] In some other implementations, the first user terminal determines a target special effect, the second user terminal obtains the target special effect determined by the first user terminal, and plays the target special effect based on the target member.

[0073] Exemplarily, the second user terminal receives the target special effects sent by the user from the first user terminal, including the username of the member to be highlighted. Then, the second user terminal uses Face ID technology to accurately identify and locate the face position of the target member. If the face of the target member is not in the picture during the processing, the task is cached, and the target special effects are displayed after the face of the target member is identified later. In this way, the second user terminal can achieve accurate target special effects playback, thereby enhancing the attractiveness of the target video and the user's participation.

[0074] Further, in some embodiments, the target special effect includes a gift-giving special effect, and the playback page of the target video presents a gift panel including a variety of gifts, so that the user can determine the gift-giving special effect based on the gift panel.

[0075] like Figure 4 and Figure 5 As shown in the left picture in the middle, a gift panel is integrated into the page, which provides a variety of gift options for users to choose from, so that users can send virtual gifts to members in the video.

[0076] In some scenarios, when a user wants to interact with a target member in a video, such as expressing support by sending a gift, he or she can select a specific gift effect by operating the gift panel on the playback page. Specifically, the gift panel lists different types of gifts, and each gift corresponds to a specific gift effect. After the user selects a gift and confirms to send it, the corresponding target effect will be presented on the playback page of the target video according to the user's selection.

[0077] This design not only provides users with an intuitive way to express their support for the members in the video, but also enhances the fun and personalized experience of interaction through rich gift-giving special effects, while also adding more interactivity and entertainment value to the video content.

[0078] In related technologies, after a user successfully selects an interactive object and completes an interactive operation (such as sending a virtual gift), the target special effect often lacks clear directionality and cannot clearly indicate that this target special effect is specifically sent to a certain person. This means that not only is it difficult for the user who sent the target special effect to intuitively see that the target special effect he selected was accurately delivered, but it is also difficult for the members in the video to perceive that this target special effect is specifically sent to them. This lack of intuitive visual feedback weakens the personalization and targeting of the interaction, and cannot effectively enhance the emotional connection between the user and the video members, nor can it enhance the user's sense of participation and satisfaction.

[0079] In order to solve the deficiency of target special effects in the related art in terms of visual feedback, the present application proposes an optimized target special effects display solution. Specifically, the target special effects are played at the designated position corresponding to the target member in the play page.

[0080] That is to say, the presentation of the target special effects is not random or universal, but will be precisely associated with the position of the target member in the screen. For example, if the target special effect is a gift-giving special effect, the animation effect of the gift will appear directly near the target member's identification box or in a specific area of ​​the screen where it is located, rather than randomly appearing in other locations on the playback page. This precise special effect playback method allows each member to clearly know which target special effects are specifically given to them, thereby avoiding embarrassment and dissatisfaction caused by misunderstanding or confusion, and improving the user's viewing experience and sense of participation.

[0081] More specifically, if the number of target members is one, the target member is given an enlarged close-up display, and the target special effect is played at the designated position corresponding to the target member in the playback page; if the number of target members is multiple, a special effect movement trajectory is generated based on the designated positions corresponding to the multiple target members, and the target special effect is played based on the special effect movement trajectory.

[0082] In this embodiment, by dynamically adjusting the display mode of the target special effects according to the number and position of the target members, the effect of the target special effects presentation and the user experience are further optimized. Specifically, when there is only one target member, the member will be given an enlarged close-up display. Figure 6 FIG. 1 is a schematic diagram of a playback target special effect provided by an embodiment of the present application. Figure 6 As shown, the target special effect is a "heart-shaped gift" special effect, and the target member is the member located in the middle of the play page. When the user chooses to send the "heart-shaped gift" special effect to the target member, the special effect is displayed on the chest of the target member, and the target special effect is magnified in the play page. It is understandable that in some embodiments, when the target member is magnified to a certain extent, other members in the play page may be partially squeezed out of the play page. When the target member returns to normal, multiple members will be displayed simultaneously in the play page.

[0083] This close-up display method not only highlights the target member, but also allows users to more clearly see the target member's reaction when receiving the target special effect. At the same time, the target special effect will be played at the designated position corresponding to the target member, further strengthening the focus of the visual effect.

[0084] In addition, when there are multiple target members, the generation and playback of special effect movement trajectories requires comprehensive consideration of multiple factors to ensure that the target special effects can be presented in a natural and visually attractive manner. Figure 7FIG. 1 is a schematic diagram of a playback target special effect provided by another embodiment of the present application. Figure 7 As shown, the starting point and the end point of the target special effect are determined according to the head position of each target member in the play page. Taking the bouncing special effect as an example, the starting point of the target special effect is the target distance above the head of the target member from left to right.

[0085] In some embodiments, a target special effect is played at a designated position corresponding to the target member in a playback page, including: adding the target member's identity information to the visual element of a gift-giving special effect to generate a customized gift special effect containing the target member's identity information; a customized gift special effect containing the target member's identity information is played at a designated position corresponding to the target member in a playback page.

[0086] Exemplarily, the visual elements of the gift giving special effect refer to the visible parts that constitute the gift giving special effect, including elements such as animation effects, text, graphics, colors, etc. The identity information of the target member is used to identify and describe the characteristics of the target member, including nicknames, avatars, facial expressions, etc. and other personalized information related to the target member.

[0087] Exemplarily, the position of the target member's avatar in the playback page is detected (for example, coordinates X=200, Y=500), and this position is set as the designated position corresponding to the target member. Then, the identity information of the target member is added to the gift-giving special effect to generate a customized gift special effect, for example, the target member's avatar is displayed in the center of the blooming fireworks, the first letter of the target member's nickname is printed on the falling ribbons, and the target member's level badge pops up at the end of the special effect. Finally, the customized gift special effect is played at the aforementioned avatar position.

[0088] It can be seen that this embodiment enables the gift-giving special effects to be accurately focused on the target members, enhancing the ritual and pertinence of gift giving. Secondly, the identity information of the target members is mapped to the visual elements of the gift-giving special effects, further enhancing the personalization and exclusivity of the gift special effects. Finally, based on the display of customized gift special effects at designated locations, precise positioning is combined with personalized customization, which not only optimizes the visual effects, but also improves user participation and satisfaction.

[0089] In some embodiments, in order to make the motion trajectory of the target special effect more vivid, the first user terminal generates a parabolic trajectory based on the position information, and the vertex of the trajectory is set to the center position of the two rebound points, thereby forming an arc trajectory.

[0090] After generating the trajectory, the target effect's motion parameters also need to be considered, such as the curvature of the parabola and the speed of the target effect along the trajectory. These parameters can be flexibly adjusted according to the design requirements to adapt to different visual styles and scene requirements. For example, the curvature of the parabola determines the jump height of the target effect, while the speed of movement affects the rhythm and smoothness of the target effect. By precisely controlling these parameters, the target effect can bounce between multiple target members in sequence, forming a smooth and dynamic visual effect.

[0091] Finally, according to the generated special effect movement trajectory and the set motion parameters, the target special effects corresponding to each member are played above the head of each target member in turn. This dynamic trajectory can not only cover all target members, but also guide the user's line of sight to flow between multiple members through the movement of the target special effects, thereby maintaining the display effect of the target special effects while taking into account the visual balance and interactivity in the multi-member scene. This special effect playback method flexibly copes with scenes with different numbers of target members, which not only improves the display effect of the target special effects, but also enhances the interactive experience between users and video content.

[0092] Combination of the above Figures 2 to 7 , describes in detail the video processing method embodiment of the present application, and the following is combined with Figure 8 , the video processing device embodiment of the present application is described in detail. It should be understood that the description of the video processing method embodiment corresponds to the description of the video processing device embodiment, so the part not described in detail can refer to the previous method embodiment.

[0093] Figure 8 FIG. 1 is a schematic diagram of the structure of a video processing device provided by an embodiment of the present application. Figure 8 As shown, the video processing device 80 provided in the embodiment of the present application includes: The presentation module 810 is used to respond to the user's interactive instruction and present, on the playback page of the target video, the identification boxes corresponding to the multiple members in the target video, wherein the identification box corresponding to each member is associated with the position of the member in the playback page, and the interactive instruction is used to initiate an interactive request to at least one member in the target video; The determination module 820 is used to determine a target member among multiple members in response to a selection instruction from a user based on the identification box.

[0094] In one embodiment of the present application, the identification frame corresponding to each member is located in the facial area of ​​the member, and / or the identification frame corresponding to each member is located in a specific area above the head of the member.

[0095] In one embodiment of the present application, the identification box corresponding to each member moves with the position of the member in the play page; and / or, the size of the identification box corresponding to each member is positively correlated with the size of the member in the play page.

[0096] In one embodiment of the present application, the determination module 820 is further used to identify the facial information of each of the multiple members in the target video; annotate the multiple members based on the facial information of the multiple members, and generate identification frames for the multiple members. In one embodiment of the present application, the determination module 820 is further used to obtain identification information of each of the multiple members in the target video from the second user terminal; mark the multiple members based on the identification information of the multiple members, and generate identification boxes for the multiple members.

[0097] In one embodiment of the present application, identification information of each of the multiple members in the second user terminal is generated by the second user terminal before the target video is played based on facial images of the members who are to appear in the target video.

[0098] In one embodiment of the present application, the determination module 820 is also used to determine a target special effect, where the target special effect refers to a visual effect and / or audio effect triggered during the playback of a target video; and play the target special effect based on the target member.

[0099] In one embodiment of the present application, the determination module 820 is further used to play the target special effect at the designated position corresponding to the target member in the play page.

[0100] In one embodiment of the present application, the determination module 820 is also used to, if the number of target members is one, give the target member an enlarged close-up display, and play the target special effects at the designated position corresponding to the target member in the playback page; if the number of target members is multiple, generate a special effect movement trajectory based on the designated positions corresponding to the multiple target members, and play the target special effects based on the special effect movement trajectory.

[0101] In one embodiment of the present application, the determination module 820 is also used to add the identity information of the target member to the visual elements of the gift-giving special effect, to generate a customized gift special effect containing the identity information of the target member; and to play the customized gift special effect containing the identity information of the target member at the designated position corresponding to the target member in the playback page.

[0102] In one embodiment of the present application, the presentation module 810 is also used to present a gift panel including multiple gifts on the playback page of the target video so that the user can determine the gift giving special effects based on the gift panel.

[0103] In one embodiment of the present application, the presentation module 810 is also used to present selection prompt information corresponding to at least one member on the playback page of the target video when at least one member is selected based on the identification box, so that the user can determine whether to select the at least one member as the target member. The selection prompt information refers to the prompt information displayed on the playback page of the target video on whether the at least one member is selected.

[0104] Below, reference Fig. 9 To describe an electronic device according to an embodiment of the present application. Fig. 9 Shown is a schematic structural diagram of an electronic device provided by an exemplary embodiment of the present application.

[0105] like Fig. 9 As shown, the electronic device 90 includes one or more processors 901 and a memory 902 .

[0106] The processor 901 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 90 to perform desired functions.

[0107] The memory 902 may include one or more computer program products, and the computer program product may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, a random access memory (RAM) and / or a cache memory (cache), etc. The non-volatile memory may include, for example, a read-only memory (ROM), a hard disk, a flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 901 may run the program instructions to implement the video processing methods of the various embodiments of the present application described above and / or other desired functions. Various contents such as interactive instructions, selection instructions, and member identification boxes may also be stored in the computer-readable storage medium.

[0108] In one example, the electronic device 90 may further include: an input device 903 and an output device 904 , and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0109] The input device 903 may include, for example, a keyboard, a mouse, etc.

[0110] The output device 904 can output various information to the outside, including interactive instructions, selection instructions, member identification boxes, etc. The output device 904 can include, for example, a display, a speaker, a printer, a communication network and its connected remote output devices, etc.

[0111] Of course, to simplify, Fig. 9 Only some of the components related to the present application in the electronic device 90 are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, according to specific application situations, the electronic device 90 may also include any other appropriate components.

[0112] In addition to the above-mentioned methods and devices, an embodiment of the present application may also be a computer program product, which includes computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the video processing method according to various embodiments of the present application described above in this specification.

[0113] The computer program product may be written in any combination of one or more programming languages ​​to write program codes for performing the operations of the embodiments of the present application, including object-oriented programming languages, such as Java, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as an independent software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0114] In addition, an embodiment of the present application may also be a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the processor executes the steps of the video processing method according to various embodiments of the present application described above in this specification.

[0115] The computer readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0116] The basic principles of the present application are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present application are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present application. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, not for limitation, and the above details do not limit the present application to being implemented by adopting the above specific details.

[0117] The block diagrams of the devices, apparatuses, equipment, and systems involved in this application are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagram. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including", "comprising", "having", etc. are open words, referring to "including but not limited to", and can be used interchangeably with them. The words "or" and "and" used here refer to the words "and / or" and can be used interchangeably with them, unless the context clearly indicates otherwise. The words "such as" used here refer to the phrase "such as but not limited to", and can be used interchangeably with them.

[0118] It should also be noted that in the apparatus, device and method of the present application, each component or each step can be decomposed and / or recombined. Such decomposition and / or recombination should be regarded as equivalent solutions of the present application.

[0119] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present application. Therefore, the present application is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

[0120] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present application to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims

1. A video processing method, characterized in that: Applied to a first user terminal, the method includes: In response to the interactive instruction, on the playback page of the target video, identification boxes corresponding to each of the multiple members in the target video are presented, wherein the identification box corresponding to each member is associated with the position of the member in the playback page, and the interactive instruction is used to initiate an interactive request to at least one member in the target video; In response to a selection instruction based on the identification box, a target member among the plurality of members is determined.

2. The video processing method according to claim 1, characterized in that: The identification frame corresponding to each member is located in the facial area of ​​the member, and / or, The identification frame corresponding to each member is located in a specific area above the head of the member.

3. The video processing method according to claim 1, characterized in that: The identification frame corresponding to each member moves along with the position of the member in the play page; And / or, the size of the identification box corresponding to each member is positively correlated with the size of the member in the play page.

4. The video processing method according to claim 1, characterized in that: Also includes: Identify facial information of each of the multiple members in the target video; The multiple members are labeled based on their respective facial information, and identification frames are generated for the multiple members.

5. The video processing method according to claim 1, characterized in that: Also includes: Acquire identification information of each of the plurality of members in the target video from the second user terminal; The multiple members are labeled based on their respective identification information, and identification boxes are generated for the multiple members.

6. The video processing method according to claim 5, characterized in that: The identification information of each of the multiple members in the second user terminal is generated by the second user terminal before the target video is played, based on the facial images of the members who are to be included in the target video.

7. The video processing method according to any one of claims 1 to 6, characterized in that: Also includes: Determining a target special effect, where the target special effect refers to a visual effect and / or audio effect triggered during playback of the target video; The target special effect is played based on the target member.

8. The video processing method according to claim 7, characterized in that: The playing of the target special effect based on the target member includes: The target special effect is played at the designated position corresponding to the target member in the play page.

9. The video processing method according to claim 8, characterized in that: Playing the target special effect at the designated position corresponding to the target member in the play page includes: If the number of the target member is one, the target member is given an enlarged close-up display, and the target special effect is played at the designated position corresponding to the target member in the play page; If there are multiple target members, a special effect movement trajectory is generated based on the designated positions corresponding to the multiple target members, and the target special effect is played based on the special effect movement trajectory.

10. The video processing method according to claim 8, characterized in that: The target special effect includes a gift giving special effect, and the target special effect is played at the designated position corresponding to the target member in the play page, including: Adding the identity information of the target member to the visual elements of the gift-giving special effect to generate a customized gift special effect including the identity information of the target member; At the designated position corresponding to the target member in the play page, a customized gift special effect containing the identity information of the target member is played.

11. The video processing method according to claim 7, characterized in that: The target special effect includes a gift giving special effect, and the method further includes: A gift panel including a variety of gifts is presented on the playback page of the target video so that the user can determine the gift giving special effect based on the gift panel.

12. The video processing method according to any one of claims 1 to 6, characterized in that: Before determining the target member among the multiple members in response to the selection instruction based on the identification box, the method further includes: In the case of selecting at least one member based on the identification box, selection prompt information corresponding to the at least one member is presented on the playback page of the target video to determine whether to select the at least one member as the target member. The selection prompt information refers to the prompt information displayed on the playback page of the target video on whether the at least one member is selected.

13. A video processing device, characterized in that: Applied to a first user terminal, the device includes: A presentation module, for presenting, in response to an interaction instruction, identification boxes corresponding to a plurality of members in the target video on a playback page of the target video, wherein the identification box corresponding to each member is associated with a position of the member in the playback page, and the interaction instruction is used to initiate an interaction request to at least one member in the target video; The determination module is used to determine a target member among the multiple members in response to a selection instruction based on the identification box.

14. An electronic device, characterized in that: include: processor; as well as A memory, wherein computer program instructions are stored in the memory, and when the computer program instructions are executed by the processor, the processor executes the video processing method according to any one of claims 1 to 12.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer program instructions, which, when executed by a processor, enable the processor to perform the video processing method according to any one of claims 1 to 12.

16. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the video processing method according to any one of claims 1 to 12 is implemented.

Images