Video interaction method, device, computing equipment and computer storage medium
By displaying multiple interfaces on the client and virtualizing the video using morphological recognition algorithms, the problem of users being unable to interact is solved, video interaction is realized, and the fun and participation of the viewing experience is improved.
Patent Information
- Application Number
- CN202111566207.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-20
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2041-12-20
AI Technical Summary
Users are unable to interact while watching videos, resulting in low engagement and poor fun.
Display multiple interfaces on the client, including the original video playback interface and the virtual image video playback interface. The image in the original video is virtualized through the form recognition algorithm, and the virtual image video is controlled according to the instructions entered by the user to realize the user's user's ability to achieve the user's ability to Interaction with video.
It improves the user's interactivity and fun when watching videos, and will not affect the normal playback of the videos.
Smart Images

Figure CN114363685B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of communication technology, and in particular to a video interaction method, device, computing equipment and computer storage medium. Background Art
[0002] With the development of Internet technology, users can watch videos through clients, such as sports games or other entertainment games. However, users only watch the game videos but cannot interact with them. The user participation is low and the fun is poor. Summary of the invention
[0003] In view of the above problems, embodiments of the present invention are proposed to provide a video interaction method, apparatus, computing device and computer storage medium that overcome the above problems or at least partially solve the above problems.
[0004] According to one aspect of an embodiment of the present invention, a video interaction method is provided, comprising:
[0005] Displaying multiple interfaces on the client, the multiple interfaces including an original video playback interface and at least one virtual image video playback interface, the original video playback interface is used to play the original video, and the virtual image video playback interface is used to play the virtual image video after the original video is virtualized;
[0006] The virtual image video is controlled according to the instructions input by the user.
[0007] According to another aspect of an embodiment of the present invention, a video interaction device is provided, comprising:
[0008] A display module, adapted to display multiple interfaces on a client, the multiple interfaces including an original video playback interface and at least one virtual image video playback interface, the original video playback interface is used to play the original video, and the virtual image video playback interface is used to play the virtual image video after the original video is virtualized;
[0009] The control module is adapted to control the virtual image video according to instructions input by the user.
[0010] According to another aspect of an embodiment of the present invention, there is provided a computing device, comprising: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus;
[0011] The memory is used to store at least one executable instruction, and the executable instruction enables the processor to execute the operation corresponding to the above-mentioned video interaction method.
[0012] According to another aspect of the embodiments of the present invention, a computer storage medium is provided, in which at least one executable instruction is stored, and the executable instruction enables a processor to perform operations corresponding to the above-mentioned video interaction method.
[0013] The solution provided by the above-mentioned embodiment of the present invention enables users to interact with the video while watching the video without affecting the normal playback of the video, thereby improving the fun.
[0014] The above description is only an overview of the technical solution of the embodiment of the present invention. In order to more clearly understand the technical means of the embodiment of the present invention, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the embodiment of the present invention more obvious and easy to understand, the specific implementation method of the embodiment of the present invention is specifically listed below. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the embodiments of the present invention. Moreover, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:
[0016] Figure 1A A schematic diagram showing a flow chart of a video interaction method according to an embodiment of the present invention;
[0017] Figure 1B is a schematic diagram of the first image;
[0018] Figure 1C This is a schematic diagram of the operation list;
[0019] Figure 1D This is a schematic diagram of the client interface;
[0020] Figure 2 A schematic diagram showing the structure of a video interaction device according to an embodiment of the present invention is shown;
[0021] Figure 3 A schematic diagram showing the structure of a computing device according to an embodiment of the present invention is shown. DETAILED DESCRIPTION
[0022] The exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present invention and to enable the scope of the present invention to be fully communicated to those skilled in the art.
[0023] Figure 1AFIG. 1 is a flow chart showing a video interaction method according to an embodiment of the present invention. Figure 1A As shown, the method comprises the following steps:
[0024] Step S101, multiple interfaces are displayed on the client, the multiple interfaces include an original video playback interface and at least one virtual image video playback interface, the original video playback interface is used to play the original video, and the virtual image video playback interface is used to play the virtual image video after the original video is virtualized.
[0025] Specifically, when a user wants to interact with the video while watching a video through a client, a split-screen operation can be performed. According to the split-screen operation triggered by the user, multiple interfaces are displayed on the client, wherein the multiple interfaces include an original video playback interface and at least one virtual image video playback interface. The original video playback interface is used to play the original video. Displaying the original video to the user through the original video playback interface can ensure that the normal playback of the video is not affected and the user's need to continue watching the video is met. The number of virtual image video playback interfaces can be one or more, and the virtual image video playback interface is used to play a virtual image video after the original video is virtualized, wherein the virtual image video after the original video is virtualized is obtained by the following method: performing morphological recognition processing on the second image in the original video to obtain image key points of the second image; generating a virtualized first image according to the image key points, and generating a virtual image video based on the virtualized first image.
[0026] For example, based on a morphological recognition algorithm, morphological recognition processing is performed on the second image in the original video to obtain image key points of the second image, wherein the second image is the target image in the original video, such as a contestant, and the image key points are key points representing the movements or body postures of the second image, such as the skeleton key points of the contestant. A virtualized first image is generated based on the image key points, and the movement or body posture of the virtualized first image is consistent with that of the second image. The overall appearance can be a cartoonization of the original contestant or other cartoon images related or unrelated to the original contestant, etc. A virtual image video is generated based on the virtualized first image, for example, the generated virtualized first image is synthesized with a background image (the part of the original video except the second image is called the background image) to obtain a virtual image video, wherein the background image in the virtual image video can be the retained background image in the original video, or obtained by virtualizing or cartoonizing the background image in the original video.
[0027] Here we take the use of human body shape detection algorithm to analyze the live video of the U-shaped skateboard competition as an example to illustrate the specific implementation process:
[0028] The first step is to perform human body shape detection on the second image (here is the contestant) in the original live broadcast video of the game, mainly to identify the skeleton key points of the second image, including but not limited to the following key points: head, knees, wrists, etc.
[0029] The second step is to perform inter-frame analysis on the skeleton key points to determine the second image's game actions, such as rotation and flipping.
[0030] The third step is to draw the skeleton key point detection results based on the game actions, such as Figure 1B Shown in the middle left portion.
[0031] The fourth step is to virtualize the skeleton key point detection results to obtain the virtualized first image, such as Figure 1B As shown in the middle right part, the virtual image video generated based on the first image is displayed in the virtual image video playback interface.
[0032] Step S102, controlling the virtual image video according to the instruction input by the user.
[0033] In this embodiment, the instructions input by the user may include three types, a first instruction, a second instruction and a third instruction, and different instructions have different controls on the virtual image video.
[0034] Specifically, the instructions include a first instruction, which is used to set the target virtual image video playback interface to a control mode, wherein the control mode means that the user can control the first image in the virtual image video displayed in the target virtual image video playback interface; when the target virtual image video playback interface is in the control mode, the action of the first image in the virtual image video changes according to the user operation.
[0035] If the user inputs the first instruction, it can be determined that the user wishes to control the first image in the target virtual image video playback interface, and the target virtual image video playback interface is set to the control mode. When the target virtual image video playback interface is in the control mode, after the user performs an interactive operation, the action of the first image in the virtual image video changes according to the user operation.
[0036] For example, a relevant operation list can be pre-defined for the video, and the client can display the operation list to the user, and the user can select the corresponding user operation from the operation list. Taking the U-shaped skateboard competition video as an example, the competition-related operation list includes but is not limited to: squatting, jumping, flipping, rotating, etc. Figure 1C is a schematic diagram of the operation list, such as Figure 1C As shown, actions 1 to 6 are defined in the operation list, and the user can select the desired operation according to the needs.
[0037] The action of the first image in the virtual image video changes according to the user operation, which can be specifically achieved by the following method: obtaining the interactive state data in the virtual image video; adjusting the action of the first image in the interactive state data according to the interactive control data submitted by the user operation, wherein the interactive state data is the previous frame of the interactive virtual image image in the virtual image video or the virtualized image image when the mode is switched to the control mode.
[0038] Specifically, the interactive state data in the virtual image video is obtained, and the interactive state data is the operation object of the user performing the interactive operation. When the target virtual image video playback interface switches from the follow mode to the control mode, the interactive state data is the virtualized image image in the follow mode at the moment of switching (wherein the virtualized image graphic refers to the corresponding frame image in the virtual image video at the moment of mode switching). For the control mode, this is equivalent to the initialization of the interactive state data; when the target virtual image video playback interface is the control mode, the interactive state data is the previous frame of the interactive virtual image image. The previous frame of the interactive virtual image graphic is the previous frame of the virtual image video corresponding to the moment when the user performs the operation in the control mode.
[0039] The interactive control data is the interactive operation command executed by the user, which reflects what kind of control the user has performed on the first image.
[0040] Then, the action of the first image in the interactive state data is adjusted according to the interactive manipulation data submitted by the user operation. Preferably, the position of the first image in the interactive state data is updated according to the interactive manipulation data, so that the action of the first image in the virtual image video is changed according to the user operation. Specifically, it can be expressed by the following formula:
[0041] H(t,y)=H(t',y')+Cf(c)
[0042] H(t,y) indicates that after the user performs interactive manipulation, at time t, the position coordinates of the key points of the first image are y. H(t',y') indicates the interactive status data, indicating that at time t', the position coordinates of the key points of the image are y'. C indicates the weight corresponding to the key points of the image. f(c) indicates the change function. C and f(c) are determined based on the interactive manipulation data.
[0043] After the user performs an interactive operation, the updated position information (image key point position) is obtained based on the previous position information (image key point position of the first image in the previous frame), and the action of the first image is adjusted based on the updated position information.
[0044] In an optional embodiment of the present invention, the instruction includes a second instruction, and the second instruction is used to set the target virtual image video playback interface to a follow mode. The follow mode means that the target virtual image video playback interface follows the original video displayed on the original video playback interface for display. In the follow mode, the user cannot manipulate it. When the target virtual image video playback interface is in the follow mode, the first image in the virtual image video changes with the action of the second image in the original video, that is, when the action of the second image in the original video displayed on the original video playback interface changes, the first image in the virtual image video will also change accordingly, and the action of the first image is the same as the action of the second image in the original video, wherein the second image in the original video is a real image corresponding to the virtual first image.
[0045] In an optional embodiment of the present invention, the instruction includes a third instruction, and the third instruction is used to switch the mode of the target virtual image video playback interface. The third instruction can control the target virtual image video playback interface to switch from the control mode to the follow mode, or from the follow mode to the control mode.
[0046] For example, if the target virtual image video playback interface is set to the control mode at this time, when the user does not want to control it temporarily, he can switch the mode. When the user inputs the third instruction, the target virtual image video playback interface will be switched from the control mode to the follow mode. After the switch, the first image in the virtual image video changes with the action of the second image in the original video; or, if the target virtual image video playback interface is set to the follow mode at this time, when the user wants to control it, he can input the third instruction, which will switch the target virtual image video playback interface from the follow mode to the control mode. After the switch, the action of the first image in the virtual image video changes according to the user operation.
[0047] Optionally, a virtual image video playback interface can be displayed on the client, and the virtual image video playback interface can be controlled according to the instructions input by the user, for example, set to a control mode, or a follow mode, or a mode switch. In addition, two virtual image video playback interfaces can be displayed on the client, in which case one virtual image video playback interface is set to a follow mode, and the other virtual image video playback interface is set to a control mode.
[0048] Figure 1D This is a schematic diagram of the client interface, such as Figure 1DAs shown, the client displays three interfaces, an original video playback interface and two virtual image video playback interfaces, interface one is the original video playback interface, interface two is the virtual image video playback interface, and interface three is the virtual image video playback interface, wherein the virtual image video playback interface in interface two is set to follow mode, and the virtual image video playback interface in interface three is set to control mode. The first image in the virtual image video displayed in interface two changes with the action of the second image in the original video, and the action of the first image in the virtual image video displayed in interface three changes according to the user operation.
[0049] In an optional embodiment of the present invention, the method further includes: when the virtual image video is in a control mode, calculating the action matching degree between the first image and the second image in the original video, and allocating data resources to the user according to the action matching degree.
[0050] Specifically, a comparison system is pre-designed for calculating the action matching degree between images. At the same moment, the virtual image image and the original video image are input into the comparison system to obtain the action matching degree between the first image and the second image in the original video. If the action matching degree is greater than or equal to the preset matching degree threshold, data resources are allocated to the user. The data resources here can be points, membership rights, etc.
[0051] Optionally, the matching score can also be determined based on the action matching degree. For example, the correspondence between the action matching degree interval and the matching degree score is pre-set. After the action matching degree is calculated, the matching degree interval to which the action matching degree belongs is determined. The matching degree score corresponding to the action matching degree is determined through the mapping relationship. If the matching degree score is greater than a preset score threshold, data resources are allocated to the user.
[0052] By calculating the action matching degree between the first image and the second image in the original video and allocating data resources to users according to the action matching degree, users can be motivated to interact when watching the video, which is conducive to increasing the viewing volume of the video.
[0053] The following is an example of a competition video, combined with Figure 1D To explain:
[0054] Step 1: The video server obtains the real-time game video stream and sends it to the client. The client Figure 1D The real-time live video of the game is played in the original video playback interface (interface 1);
[0055] Step 2: The video server obtains the virtual image video of the actual game action according to the interface 1 (as shown in the interface 2), and sends the virtual image video to the client. After the client decodes the virtual image video, Figure 1DInterface 2 in the video file displays the decoded video file for playback;
[0056] Step 3: The client detects whether the user has triggered the third instruction; if the third instruction is detected, step 4 is executed; otherwise, step 3 is continued;
[0057] Step 4: Interface 3 of the client is switched to the control mode, the video frame currently played on interface 2 is copied, and based on the copied video frame, the video frame is displayed on interface 3;
[0058] Step 5: Detect the user Figure 1D The first command inputted in the target virtual image video playback interface (interface three);
[0059] Step 6: Based on the detected first instruction, sending an image acquisition instruction including interactive control data to the video server;
[0060] Step 7: The video server renders a virtual image of the corresponding control result screen based on the interactive control data and sends it to the client;
[0061] Step 8: The client displays the virtual image sent by the server on interface 3.
[0062] The solution provided by the above-mentioned embodiment of the present invention enables users to interact with the game while watching the live broadcast without affecting the normal live broadcast of the game, thereby improving the fun and being conducive to improving the overall popularity of the live broadcast.
[0063] This embodiment can be applied to online live video scenarios or recorded video scenarios.
[0064] In an optional implementation of the present invention, if there are multiple contestants on the competition field, the interface displayed by the client may only include the original video playback interface and a virtual image video playback interface, and the interactive state data is determined by the following method: obtaining a specified image frame in the original video, wherein the specified image frame is an image showing the global situation on the current competition field at the closest historical playback time to the current time;
[0065] The designated image frame is subjected to virtualization recognition processing to obtain a virtualized game image, and the virtualized game image is displayed in the virtual image video playback interface, wherein the virtualized game image is determined as interactive state data.
[0066] The method is also applicable to situations where there are multiple parties on the field of play, such as ice hockey games, billiard games, etc. When a user wants to perform manipulation, a specified image frame is obtained, wherein the specified image frame is an image showing the global situation on the current field of play at the closest historical playback time to the current time, and virtualization recognition processing is performed on the specified image frame to obtain a virtualized game image, which is displayed on a virtual image video playback interface. By displaying the virtualized game image to the user, the user can first understand the game situation, such as the position of the ice hockey puck, the position of the players, the position of the opponent, etc., before performing interactive manipulation, so as to facilitate the user to decide how to manipulate, thereby realizing "endgame continuation", wherein the virtualized game image is determined as interactive state data.
[0067] This solution enables users to interact with videos while watching them without affecting the normal playback of the videos, thus increasing the fun.
[0068] Figure 2 FIG. 2 is a schematic diagram showing the structure of a video interaction device according to an embodiment of the present invention. Figure 2 As shown, the device includes: a display module 201 and a control module 202.
[0069] The display module 201 is adapted to display multiple interfaces on the client, the multiple interfaces including an original video playback interface and at least one virtual image video playback interface, the original video playback interface is used to play the original video, and the virtual image video playback interface is used to play the virtual image video after the original video is virtualized;
[0070] The control module 202 is adapted to control the virtual image video according to instructions input by the user.
[0071] Optionally, the instruction includes a first instruction, which is used to set the target virtual image video playback interface to a control mode; when the target virtual image video playback interface is in the control mode, the action of the first image in the virtual image video changes according to the user operation.
[0072] Optionally, the instruction includes a second instruction, which is used to set the target virtual image video playback interface to follow mode; when the target virtual image video playback interface is in follow mode, the first image in the virtual image video changes with the action changes of the second image in the original video.
[0073] Optionally, the instruction includes a third instruction, and the third instruction is used to switch the mode of the target virtual image video playback interface.
[0074] Optionally, the device also includes: a calculation module, adapted to calculate the action matching degree between the first image and the second image in the original video when the virtual image video is in the control mode, and allocate data resources to the user according to the action matching degree.
[0075] Optionally, the virtual image video after the original video is virtualized is obtained by the following method:
[0076] Performing morphological recognition processing on the second image in the original video to obtain image key points of the second image;
[0077] A virtualized first image is generated according to the image key points, and a virtual image video is generated based on the virtualized first image.
[0078] Optionally, when the avatar video is in the control mode, the action of the first image in the avatar video changes according to the user operation, specifically including:
[0079] Get interactive status data in the avatar video;
[0080] The action of the first image in the interactive state data is adjusted according to the interactive control data submitted by the user operation, wherein the interactive state data is the previous frame of the interactive virtual image image in the virtual image video or the virtualized image image when the mode is switched to the control mode.
[0081] This solution enables users to interact with videos while watching them without affecting the normal playback of the videos, thus increasing the fun.
[0082] An embodiment of the present invention provides a non-volatile computer storage medium, wherein the computer storage medium stores at least one executable instruction, and the computer executable instruction can execute the video interaction method in any of the above method embodiments.
[0083] Figure 3 The schematic diagram of the structure of a computing device according to an embodiment of the present invention is shown. The specific embodiment of the present invention does not limit the specific implementation of the computing device.
[0084] like Figure 3 As shown, the computing device may include: a processor, a communications interface, a memory, and a communication bus.
[0085] Wherein: the processor, the communication interface, and the memory communicate with each other via a communication bus. The communication interface is used to communicate with other devices such as a client or other server network elements. The processor is used to execute a program, specifically, to execute the relevant steps in the above-mentioned video interaction method embodiment for a computing device.
[0086] Specifically, the program may include program codes including computer operation instructions.
[0087] The processor may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention. The one or more processors included in the computing device may be processors of the same type, such as one or more CPUs; or processors of different types, such as one or more CPUs and one or more ASICs.
[0088] The memory is used to store programs. The memory may include a high-speed RAM memory, and may also include a non-volatile memory, such as at least one disk memory.
[0089] The program can be specifically used to enable the processor to execute the video interaction method in any of the above-mentioned method embodiments. The specific implementation of each step in the program can refer to the corresponding descriptions in the corresponding steps and units in the above-mentioned video interaction embodiments, which will not be repeated here. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the above-described devices and modules can refer to the corresponding process description in the above-mentioned method embodiments, which will not be repeated here.
[0090] The algorithm or display provided herein is not inherently related to any particular computer, virtual system or other device. Various general purpose systems can also be used together with the teachings based on this. According to the above description, it is obvious that the structure required for constructing this type of system. In addition, the embodiment of the present invention is not directed to any specific programming language either. It should be understood that various programming languages can be utilized to realize the content of the embodiment of the present invention described herein, and the description of the above specific language is to disclose the best mode of the embodiment of the present invention.
[0091] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.
[0092] Similarly, it should be understood that in order to streamline the embodiments of the present invention and to aid in understanding one or more of the various inventive aspects, in the above description of the exemplary embodiments of the present invention, the various features of the embodiments of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, the disclosed method should not be interpreted as reflecting the following intention: that the claimed embodiments of the present invention require more features than the features explicitly recited in each claim. More specifically, as reflected in the claims below, the inventive aspects lie in less than all the features of the single embodiment disclosed above. Therefore, the claims that follow the specific embodiment are hereby expressly incorporated into the specific embodiment, wherein each claim itself serves as a separate embodiment of the present invention.
[0093] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and in addition they may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this manner may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.
[0094] In addition, those skilled in the art will appreciate that, although some embodiments herein include certain features included in other embodiments but not other features, the combination of features of different embodiments is meant to be within the scope of the present invention and form different embodiments. For example, in the claims below, any one of the claimed embodiments may be used in any combination.
[0095] The various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or digital signal processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components according to the embodiments of the present invention. The embodiments of the present invention may also be implemented as a device or apparatus program (e.g., a computer program and a computer program product) for executing part or all of the methods described herein. Such a program implementing an embodiment of the present invention may be stored on a computer-readable medium, or may have the form of one or more signals. Such a signal may be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.
[0096] It should be noted that the above embodiments illustrate rather than limit the present invention, and that those skilled in the art may devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets shall not be construed as a limitation on the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present invention may be implemented by means of hardware comprising a number of different elements and by means of a suitably programmed computer. In a unit claim listing a number of devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc. does not indicate any order. These words may be interpreted as names. The steps in the above embodiments, unless otherwise specified, should not be understood as limitations on the order of execution.
Claims
1. A video interaction method, the method is applied to a game scene, the method include: Displaying multiple interfaces on the client, the multiple interfaces include an original video playback interface and at least one virtual image video playback interface, the original video playback interface is used to play the original video, and the virtual image video playback interface is used to play the virtual image video after the original video is virtualized, wherein the original video is a game video; The virtual image video is controlled according to the instructions input by the user, wherein the instructions include a first instruction, and the first instruction is used to set the target virtual image video playback interface to a control mode. When the target virtual image video playback interface is in the control mode, the action of the first image in the virtual image video changes according to the user operation, and the user is a user watching the game video.
2. The method according to claim 1, in, The instruction includes a second instruction, which is used to set the target virtual image video playback interface to a follow mode; when the target virtual image video playback interface is in the follow mode, the first image in the virtual image video changes with the action changes of the second image in the original video.
3. The method according to claim 1 or 2, in, The instructions include a third instruction, and the third instruction is used to switch the mode of the target virtual image video playback interface.
4. The method according to claim 1, in, The method also includes: When the virtual image video is in the control mode, the action matching degree between the first image and the second image in the original video is calculated, and data resources are allocated to the user according to the action matching degree.
5. The method according to claim 1, in, The virtual image video after the original video is virtualized is obtained by the following method: Performing morphological recognition processing on the second image in the original video to obtain image key points of the second image; A virtualized first image is generated according to the image key points, and a virtual image video is generated based on the virtualized first image.
6. The method according to claim 1, in, When the virtual image video is in the control mode, the action of the first image in the virtual image video changes according to the user operation, specifically including: Get interactive status data in the avatar video; The action of the first image in the interactive status data is adjusted according to the interactive control data submitted by the user operation, wherein the interactive status data is the previous frame of the interactive virtual image image in the virtual image video or the virtualized image image when the mode is switched to the control mode.
7. A video interactive device, the device is applied to a game scene, the device include: A display module, adapted to display multiple interfaces on the client, the multiple interfaces including an original video playback interface and at least one virtual image video playback interface, the original video playback interface is used to play the original video, and the virtual image video playback interface is used to play the virtual image video after the original video is virtualized, wherein the original video is a game video; The control module is suitable for controlling the virtual image video according to the instructions input by the user, wherein the instructions include a first instruction, and the first instruction is used to set the target virtual image video playback interface to the control mode. When the target virtual image video playback interface is in the control mode, the action of the first image in the virtual image video changes according to the user operation, and the user is a user watching the game video.
8. A computing device, include: A processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; The memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform an operation corresponding to the video interaction method as described in any one of claims 1-6.
9. A computer storage medium, wherein at least one executable instruction is stored in the storage medium, and the executable instruction enables a processor to perform operations corresponding to the video interaction method as described in any one of claims 1-6.
Citation Information
Patent Citations
Method and apparatus for video playing in application
CN105554424A
Video generation method, device and electronic equipment
CN107968921A
Image display method and device in live broadcast and storage medium
CN109120985A
Virtual image attitude control method and device based on key points, and electronic equipment
CN110139115A
Object interaction method and device, storage medium and electronic device
CN110703913A
