Virtual prop display method, device, equipment and storage medium

Abstract

The present application relates to a method, device, equipment and storage medium for displaying virtual props, and to the field of video processing technology. The method includes: displaying a shooting picture, and in response to detecting a target limb in the shooting picture, rendering a first virtual prop in a three-dimensional space corresponding to the shooting picture; the first virtual prop follows the target limb. When the action of the target limb is the first target action, the motion trajectory of the first virtual prop generated in the three-dimensional space based on the target action is displayed in the shooting picture; when the motion result of the first virtual prop in the three-dimensional space of the shooting picture meets a preset condition, the display effect of the first virtual prop in the shooting picture is updated. Thereby, the interest of the video content is improved.

Description

Technical Field

[0001] The present application relates to the field of video processing technology, and in particular to a method, device, equipment and storage medium for displaying virtual props. Background Art

[0002] With the development of video products (such as short video products), users' demands for video products have become more diversified, for example, the demand for the fun of video products.

[0003] In the related art, in order to improve the fun of video products, some virtual props are often presented. However, the existing virtual props have the technical problem of single display and inability to provide users with a sense of interaction with the video, resulting in insufficient fun of the video content. Summary of the invention

[0004] The present application provides a method, device, equipment and storage medium for displaying virtual props to improve the fun of video content. The technical solution of the present application is as follows:

[0005] In a first aspect of the present application, a method for displaying a virtual prop is provided, the method comprising: displaying a shooting picture, and in response to detecting a target limb in the shooting picture, rendering a first virtual prop in a three-dimensional space corresponding to the shooting picture; the first virtual prop follows the target limb. When the action of the target limb is the first target action, displaying in the shooting picture a motion trajectory of the first virtual prop in the three-dimensional space based on the target action; when the motion result of the first virtual prop in the three-dimensional space of the shooting picture meets a preset condition, updating the display effect of the first virtual prop in the shooting picture.

[0006] In a possible implementation, before detecting the movement of the target limb in the captured image, the method further includes: detecting the posture of the target limb in the captured image, and displaying the first virtual prop when the posture of the target limb is a preset posture.

[0007] In a possible implementation, the movement result of the first virtual prop in the three-dimensional space meets a preset condition, including: the first virtual prop collides with a target object in the three-dimensional space. The target object includes a preset plane, a preset position, or a preset object.

[0008] In a possible implementation, the above “updating the display effect of the first virtual prop” includes: replacing the first virtual prop with the second virtual prop. Or, updating the current posture of the first virtual prop to the target posture. Or, after the current posture of the first virtual prop is updated to the target posture for a preset time, replacing the first virtual prop with the second virtual prop.

[0009] In a possible implementation, the above-mentioned “replacing the first virtual prop with the second virtual prop” includes: determining a posture corresponding to the target object from a first mapping relationship according to the target object colliding with the first virtual prop; the first mapping relationship includes multiple objects and a posture corresponding to each object, and the multiple objects include the target object; according to the posture of the target object, replacing the first virtual prop with the second virtual prop; the posture of the second virtual prop is the posture corresponding to the target object.

[0010] In a possible implementation, the above-mentioned "updating the current posture of the first virtual prop to the target posture" includes: determining the target posture corresponding to the target object from the first mapping relationship according to the target object colliding with the first virtual prop; the first mapping relationship includes multiple objects and the posture corresponding to each object, and the multiple objects include the target object; updating the current posture to the target posture.

[0011] In a possible implementation, the method further includes: after displaying the second virtual prop, displaying a special effect corresponding to the second virtual prop.

[0012] In a possible implementation, after updating the display effect of the first virtual prop, the method further includes: when the action of the target limb is a preset interactive action, controlling the movement of the second virtual prop or the first virtual prop in response to the action of the target limb.

[0013] In a possible implementation, the motion trajectory of the first virtual prop in the three-dimensional space based on the target action includes the motion trajectory of the first virtual prop in the three-dimensional space after the first virtual prop leaves the target limb in response to the target action.

[0014] In a possible implementation, the target action is a throwing action, and when the action of the target limb is the target action, a motion trajectory of the first virtual prop generated in the three-dimensional space based on the target action is displayed, including: when the action of the target limb is a throwing action, a parabolic motion trajectory of the first virtual prop generated in the three-dimensional space based on the throwing action is displayed.

[0015] In a possible implementation, the above-mentioned “detecting the movement of the target limb in the captured image” includes: obtaining motion feature data of the target limb in the captured image; the motion feature data includes movement speed and movement posture. The motion feature data is input into a preset motion detection neural network to detect the movement of the target limb in the captured image.

[0016] In a possible implementation, the above-mentioned “displaying the motion trajectory of the first virtual prop based on the target action” includes: obtaining the current motion parameters of the target limb in the three-dimensional space; the current motion parameters include the current speed, the current position and the current time. The current motion parameters are input into the preset motion equation to determine the motion trajectory, and the motion trajectory of the first virtual prop in the three-dimensional space is displayed.

[0017] In a second aspect, a display device for a virtual prop is provided, the device comprising: a display unit, a processing unit, a detection unit, and an update unit; the display unit is used to display a shot picture; the processing unit is used to render a first virtual prop in a three-dimensional space corresponding to the shot picture in response to detecting a target limb in the shot picture. The first virtual prop follows the target limb; the detection unit is used to detect the movement of the target limb in the shot picture. The display unit is also used to display the movement trajectory of the first virtual prop in the three-dimensional space based on the target movement when the movement of the target limb is the target movement. The update unit is used to update the display effect of the first virtual prop when the movement result of the first virtual prop in the three-dimensional space meets a preset condition.

[0018] In a possible implementation, the detection unit is further configured to detect the posture of the target limb in the captured image. The display unit is further configured to display the first virtual prop when the posture of the target limb is a preset posture.

[0019] In a possible implementation, the movement result of the first virtual prop in the three-dimensional space meets a preset condition, including: the first virtual prop collides with a target object in the three-dimensional space. The target object includes a preset plane, a preset position, or a preset object.

[0020] In a possible implementation, the updating unit is specifically configured to: replace the first virtual prop with the second virtual prop. Or, update the current posture of the first virtual prop to the target posture. Or, after the current posture of the first virtual prop is updated to the target posture for a preset time, replace the first virtual prop with the second virtual prop.

[0021] In a possible implementation, the updating unit is specifically used to: determine a posture corresponding to the target object from a first mapping relationship according to the target object colliding with the first virtual prop; the first mapping relationship includes multiple objects and a posture corresponding to each object, and the multiple objects include the target object; according to the posture of the target object, replace the first virtual prop with a second virtual prop; the posture of the second virtual prop is the posture corresponding to the target object.

[0022] In a possible implementation, the updating unit is specifically used to: determine a target posture corresponding to the target object from a first mapping relationship according to the target object colliding with the first virtual prop; the first mapping relationship includes multiple objects and a posture corresponding to each object, and the multiple objects include the target object; and update the current posture to the target posture.

[0023] In a possible implementation, the display unit is further configured to display a special effect corresponding to the second virtual prop after displaying the second virtual prop.

[0024] In a possible implementation, the display device further includes a control unit. The control unit is configured to control the movement of the second virtual prop or the first virtual prop in response to the movement of the target limb when the movement of the target limb is a preset interactive movement.

[0025] In a possible implementation, the motion trajectory of the first virtual prop in the three-dimensional space based on the target action includes the motion trajectory of the first virtual prop in the three-dimensional space after the first virtual prop leaves the target limb in response to the target action.

[0026] In a possible implementation, the target action is a throwing action, and the display unit is specifically configured to display a parabolic motion trajectory of the first virtual prop generated based on the throwing action in a three-dimensional space when the action of the target limb is the throwing action.

[0027] In a possible implementation, the detection unit is specifically used to: obtain motion feature data of the target limb in the captured image; the motion feature data includes motion speed and motion posture; and input the motion feature data into a preset motion detection neural network to detect the motion of the target limb in the captured image.

[0028] In a possible implementation, the display unit is specifically used to: obtain current motion parameters of the target limb in the three-dimensional space; the current motion parameters include current speed, current position and current time; input the current motion parameters into a preset motion equation, determine the motion trajectory, and display the motion trajectory of the first virtual prop in the three-dimensional space.

[0029] In a third aspect, an electronic device is provided, comprising: a processor and a communication interface; the communication interface and the processor are coupled, and the processor is used to run a computer program or instruction to implement the display method of the first aspect.

[0030] In a fourth aspect, a computer-readable storage medium is provided, in which instructions are stored. When a computer executes the instructions, the computer executes the display method of the first aspect.

[0031] In a fifth aspect, a computer program product is provided. The computer program product includes computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the display method of the first aspect.

[0032] The present application provides a method for displaying a virtual prop, which brings the following beneficial effects: displaying a shot screen including a target limb and a first virtual prop superimposed on the shot screen, wherein the first virtual prop follows the target limb. Further, the movement of the target limb is detected, and when the movement of the target limb is a target movement (such as a throwing movement or a throwing movement), the motion trajectory of the first virtual prop generated in the three-dimensional space based on the target movement is displayed. Subsequently, when the movement result of the first virtual prop in the three-dimensional space meets the preset conditions, the display effect of the first virtual prop is updated. In this way, the user can interact with the virtual prop in real time, control the movement of the virtual prop through interactive actions, and control the display effect of the virtual prop display through interactive actions, thereby improving the interest of the video content and the interest of the video shooting.

[0033] It should be noted that the technical effects brought about by any implementation method in the second to fifth aspects can refer to the technical effects brought about by the corresponding implementation method in the first aspect, and will not be repeated here.

[0034] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the specification are used to explain the principles of the present application, and do not constitute an improper limitation on the present application.

[0036] Figure 1 A schematic diagram of the structure of a virtual prop display system provided in an embodiment of the present application;

[0037] Figure 2 One of the flowcharts of the method for displaying virtual props provided in an embodiment of the present application;

[0038] Figure 3 A schematic diagram of a method for displaying virtual props provided in an embodiment of the present application;

[0039] Figure 4 The second flowchart of the method for displaying virtual props provided in the embodiment of the present application;

[0040] Figure 5 The third flowchart of the method for displaying virtual props provided in the embodiment of the present application;

[0041] Figure 6 A fourth flowchart of a method for displaying virtual props provided in an embodiment of the present application;

[0042] Figure 7 Flow chart 5 of the method for displaying virtual props provided in an embodiment of the present application;

[0043] Figure 8 Flow chart six of the method for displaying virtual props provided in an embodiment of the present application;

[0044] Fig. 9 A schematic diagram of the structure of a display device for virtual props provided in an embodiment of the present application;

[0045] Fig.10 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0046] In order to enable ordinary persons in the art to better understand the technical solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings.

[0047] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the attached claims.

[0048] Before introducing the transaction method provided by this application in detail, a brief introduction to the relevant elements, application scenarios, and implementation environment involved in this application is first given.

[0049] First, a brief introduction to the relevant elements involved in this application is given.

[0050] Augmented reality (AR) technology is a technology that cleverly integrates virtual information with the real world. It widely uses a variety of technical means such as multimedia, three-dimensional modeling, real-time tracking and registration, intelligent interaction, and sensing. It simulates computer-generated virtual information such as text, images, three-dimensional models, music, and videos, and applies them to the real world. The two types of information complement each other, thereby achieving "enhancement" of the real world.

[0051] Secondly, the application scenarios involved in this application are briefly introduced.

[0052] With the development of video products (such as short video products), users' demands for video products have become more diversified, for example, the demand for the fun of video products.

[0053] In the related art, in order to improve the fun of video products, some virtual props are often presented. However, the existing virtual props have the technical problem of single display and inability to provide users with a sense of interaction with the video, resulting in insufficient fun of the video content.

[0054] In view of the above problems, the present application provides a method for displaying a virtual prop, the method comprising: displaying a shooting picture, and in response to detecting a target limb in the shooting picture, rendering a first virtual prop in a three-dimensional space corresponding to the shooting picture; the first virtual prop follows the target limb. When the action of the target limb is the first target action, displaying the motion trajectory of the first virtual prop in the three-dimensional space based on the target action in the shooting picture; when the motion result of the first virtual prop in the three-dimensional space of the shooting picture meets a preset condition, updating the display effect of the first virtual prop in the shooting picture.

[0055] In this way, a shot picture including a target limb and a first virtual prop superimposed on the shot picture are displayed, wherein the first virtual prop follows the target limb. Further, the movement of the target limb is detected, and when the movement of the target limb is a target movement (such as a throwing movement or a throwing movement), the motion trajectory of the first virtual prop generated in the three-dimensional space based on the target movement is displayed. Subsequently, when the movement result of the first virtual prop in the three-dimensional space meets the preset conditions, the display effect of the first virtual prop is updated. In this way, the user can interact with the virtual prop in real time, control the movement of the virtual prop through interactive actions, and control the display effect of the virtual prop display through interactive actions, thereby improving the interest of the video content and the interest of the video shooting.

[0056] Finally, the implementation environment (implementation architecture) involved in the method provided in this application is briefly introduced.

[0057] The virtual prop display method provided by the embodiment of the present disclosure can be applied to a virtual prop display system. Figure 1 FIG. 4 shows a schematic diagram of the structure of the display system of the virtual props. Figure 1 As shown, the virtual prop display system 10 includes a virtual prop display device 11 and an electronic device 12. The virtual prop display device 11 is connected to the electronic device 12. The virtual prop display device 11 and the electronic device 12 may be connected in a wired manner or in a wireless manner, which is not limited in the embodiment of the present invention.

[0058] The display device 11 of the virtual prop is used to display the shooting picture, and in response to detecting the target limb in the shooting picture, render the first virtual prop in the three-dimensional space corresponding to the shooting picture. The first virtual prop follows the target limb. The display device 11 of the virtual prop is also used to display the motion trajectory of the first virtual prop in the three-dimensional space based on the target action in the shooting picture when the action of the target limb is the first target action. The display device 11 of the virtual prop is also used to update the display effect of the first virtual prop in the shooting picture when the motion result of the first virtual prop in the three-dimensional space of the shooting picture meets the preset conditions.

[0059] The display device 11 of the virtual props includes a camera. The display device of the virtual props is also used to collect images of the real world through the camera, input the images of the real world into a preset enhancement algorithm, and output a display screen.

[0060] It should be noted that the preset enhancement algorithm is the one in the display device 11 of the virtual props that is preset by the operation and maintenance personnel.

[0061] The virtual prop display device 11 can implement the virtual prop display method of the embodiment of the present disclosure in various electronic devices 12 .

[0062] The electronic device 12 may be, but is not limited to, a mobile phone, a tablet computer, a laptop computer, a PC, or other device that supports running an application client.

[0063] In different application scenarios, the display device 11 of the virtual props and the electronic device 12 may be independent devices or integrated into the same device, which is not specifically limited in the embodiment of the present invention.

[0064] When the display device 11 of the virtual item and the electronic device 12 are integrated into the same device, the data transmission method between the display device 11 of the virtual item and the electronic device 12 is the data transmission between the internal modules of the device. In this case, the data transmission process between the two is the same as the "data transmission process between the display device 11 of the virtual item and the electronic device 12 when they are independent of each other".

[0065] In the following embodiments provided by the present disclosure, the display device 11 of the virtual props and the electronic device 12 are independently configured for explanation.

[0066] Figure 2 is a flowchart of a method for displaying a virtual prop according to some exemplary embodiments. In some embodiments, the method for displaying a virtual prop can be applied to Figure 1 The virtual prop display device and electronic device shown in the figure can also be applied to other similar devices. The following description will be given by applying the virtual prop display method to an electronic device.

[0067] In order to improve the interest of video content, the present application provides a method for displaying virtual props, such as Figure 2 As shown, including: S201-S205.

[0068] S201, the electronic device displays the shooting picture.

[0069] As a possible implementation method, the electronic device enters the first special effect mode in response to the first operation of the user, and acquires the shooting picture in real time through the camera. Further, the electronic device displays the shooting picture.

[0070] In some embodiments, the electronic device responds to the user's operation of turning on the camera, turns on the camera, and enters the first special effect mode in response to the user's first operation. Further, the electronic device obtains the captured image in real time through the camera and displays the captured image.

[0071] In some embodiments, the electronic device responds to the user's special effect mode selection operation, turns on the camera and enters the first special effect mode. Further, the electronic device obtains the shooting picture in real time through the camera and displays the shooting picture.

[0072] Exemplarily, after displaying the target interface of the target application, the electronic device turns on the camera and enters the first special effect mode in response to a click operation by the user. Furthermore, the electronic device acquires a captured image in real time through the camera and displays the captured image.

[0073] It should be noted that the first operation can be a touch operation of the user, a long press operation of the user, or a body movement operation of the user. The first special effect mode is a special effect mode for entering the display method of the virtual props provided in the embodiment of the present application.

[0074] Exemplarily, after the electronic device detects that the user is drawing a “V” gesture, it enters the first special effect mode.

[0075] S202: In response to detecting a target limb in a captured image, the electronic device renders a first virtual prop in a three-dimensional space corresponding to the captured image.

[0076] The first virtual prop follows the target limb.

[0077] As a possible implementation method, after acquiring a picture taken by a camera, the electronic device detects whether the picture includes a target limb, and if the target limb is detected in the picture, superimposes a first virtual prop on the picture. Subsequently, the electronic device renders the picture superimposed with the first virtual prop to obtain a display picture, and displays the display picture.

[0078] In some embodiments, after acquiring the shooting picture taken by the camera, the electronic device constructs a three-dimensional space corresponding to the shooting picture based on the shooting picture and a preset space construction algorithm. Further, the electronic device detects whether the shooting picture includes the target limb, and when the target limb is detected in the shooting picture, determines the position of the target limb in the three-dimensional space. Subsequently, the electronic device renders the first virtual prop in the three-dimensional space corresponding to the shooting picture, and displays the shooting picture and the first virtual prop.

[0079] For example, the target limb is a hand and the first virtual prop is a rabbit. When the electronic device detects the hand in the shot picture, it renders the rabbit in the three-dimensional space corresponding to the shot picture. Further, the electronic device displays the shot picture and the rabbit based on the shot picture and the rendered rabbit.

[0080] For example, the target limb is a foot and the first virtual prop is a soccer ball. When the electronic device detects the foot in the shot picture, the soccer ball is superimposed on the shot picture. Further, the electronic device displays the shot picture and the soccer ball based on the shot picture and the rendered soccer ball.

[0081] In some implementations, the position of the electronic device at which the first virtual prop is superimposed is determined by the position of the target limb and / or the posture of the target limb.

[0082] For example, the target limb is a hand and the first virtual prop is a stone. When the electronic device detects the hand in the shooting picture, the stone is superimposed on the hand in the shooting picture.

[0083] For example, the target limb is a foot and the first virtual prop is a soccer ball. When the electronic device detects the foot in the captured image, the soccer ball is superimposed on the surface of the foot in the captured image.

[0084] For example, the target limb is a hand and the first virtual prop is a stone. When the electronic device detects the hand-holding gesture in the shooting picture, the stone is superimposed on the palm of the hand in the shooting picture.

[0085] It should be noted that the first virtual prop can be randomly selected or can correspond to the target limb. The embodiment of the present application does not limit the relationship between the target limb and the first virtual prop. The position of the first virtual prop can be located at any position in the shooting picture, for example, it can be above the target limb or below the target limb. The embodiment of the present application does not limit this.

[0086] In another case, after acquiring the picture taken by the camera, the electronic device detects whether the picture includes the target limb. If it is detected that the picture does not include the target limb within a preset time, the electronic device displays a prompt message or a prompt voice.

[0087] Exemplarily, when the electronic device does not detect that the target limb is included in the captured image within 5 seconds, it displays “Please show the interactive limb” on the screen or sends a message “Please show the interactive limb within the shooting range of the camera”.

[0088] S203: The electronic device detects the movement of the target limb in the captured image.

[0089] As a possible implementation method, the electronic device obtains motion feature data of the target limb in the three-dimensional space corresponding to the captured image. The motion feature data includes motion speed and motion posture. Further, the electronic device inputs the motion feature data into a preset motion detection neural network to detect whether the motion of the target limb is the target motion.

[0090] For example, taking the target limb as a hand and the target action as a hand throwing action, the electronic device obtains the movement speed and movement posture of the hand in the three-dimensional space of the shooting picture, and inputs the movement speed and movement posture into a preset action detection neural network to detect the movement of the hand.

[0091] For example, if the target limb is the head and the target action is a butting action, the electronic device obtains the movement speed and movement posture of the head in the captured image, and inputs the movement speed and movement posture into a preset action detection neural network to detect the action of the target limb.

[0092] For example, if the target limb is a foot and the target action is a kicking action, the electronic device obtains the movement speed and movement posture of the head in the captured image, and inputs the movement speed and movement posture into a preset action detection neural network to detect the action of the foot.

[0093] It should be noted that the preset action detection neural network is pre-trained and set in the electronic device by the operation and maintenance personnel. The video frame of the target limb in the shooting picture is generated based on the moving image of the target limb in the real world. The shooting picture can be a shooting picture of a short video or a shooting picture of a live broadcast room, which is not limited in this embodiment of the application.

[0094] S204: When the movement of the target limb is the target movement, the electronic device displays a movement trajectory of the first virtual prop generated in the three-dimensional space based on the target movement.

[0095] As a possible implementation method, the electronic device determines whether the movement of the target limb is the target movement, and when it is determined that the movement of the target limb is the target movement, obtains the current movement parameters of the target limb in the three-dimensional space. The current movement parameters include the current speed, the current position, and the current time. The electronic device inputs the current movement parameters into a preset motion equation, determines the motion trajectory, and displays the motion trajectory of the first virtual prop in the three-dimensional space.

[0096] For example, taking the target limb as a hand, the target action as a hand throwing action, and the first virtual prop as a bone, the electronic device determines the motion trajectory of the hand throwing bone when determining that the hand throwing action is performed, and displays the motion trajectory of the bone in the three-dimensional space.

[0097] For example, taking the target limb as the head, the target action as the butting action, and the first virtual prop as a football as an example, the electronic device determines the movement trajectory of the butting football when determining that the butting action is performed, and displays the movement trajectory of the football in the three-dimensional space.

[0098] For example, if the target limb is a foot, the target action is a kicking action, and the first virtual prop is a flower, the electronic device determines the motion trajectory of the kicking flower when determining that the kicking action is performed, and displays the motion trajectory of the football in the three-dimensional space.

[0099] The specific implementation of this step can be referred to in the subsequent embodiments and will not be described again here.

[0100] In another implementation, the electronic device obtains the movement speed and movement posture of the target limb, and determines whether the movement speed is greater than or equal to a first preset threshold. Further, when the electronic device determines that the movement speed is greater than or equal to the first preset threshold, it determines whether the movement posture matches the preset movement posture, and when the movement posture matches the preset movement posture, it determines that the movement of the target limb is the target movement. Subsequently, when the movement of the target limb is the target movement, the electronic device displays the movement trajectory of the first virtual prop generated in the three-dimensional space based on the target movement.

[0101] It should be noted that the motion trajectory may include a first motion trajectory in which the first virtual prop follows the target limb and a second motion trajectory in which the first virtual prop leaves the target limb and moves on its own.

[0102] It is understandable that in an embodiment of the present application, the electronic device is configured with a first virtual prop for the target limb in the shooting screen. The first virtual prop moves with the target limb. The electronic device detects whether the target limb makes a target action (such as a hand throw or a kick) in the shooting screen, and displays the motion trajectory of the first virtual prop in the three-dimensional space when it is determined that the target limb makes a target action in the shooting screen. In this way, the electronic device responds to the target action of the target limb, virtualizes the motion trajectory of the first virtual prop, and displays the first virtual prop according to the motion trajectory, thereby increasing the interactive screen and improving the fun of the video content.

[0103] S205: When the movement result of the first virtual prop in the three-dimensional space meets a preset condition, the electronic device updates the display effect of the first virtual prop in the shooting picture.

[0104] As a possible implementation method, the electronic device determines whether the first virtual prop collides with a preset plane in the three-dimensional space, and replaces the first virtual prop with the second virtual prop if it is determined that the first virtual prop collides with the plane in the three-dimensional space.

[0105] In some embodiments, when the electronic device determines that the movement of the target limb is the target movement, it calculates the movement trajectory of the first virtual prop in the three-dimensional space and the collision point of the first virtual prop with the plane in the three-dimensional space. Further, the electronic device displays the first virtual prop in the three-dimensional space according to the movement trajectory, and when the first virtual prop is displayed to the collision point, the first virtual prop is replaced by the second virtual prop.

[0106] For example, the first virtual prop is a meat bone, the first virtual prop collides with the ground in the three-dimensional space, and the second virtual prop is a puppy. When the electronic device determines that the meat bone moves to the ground in the three-dimensional space, it replaces the meat bone with the puppy to display the puppy at the collision point with the ground.

[0107] For example, if the first virtual prop is a football, the first virtual prop collides with the sky in the three-dimensional space, and the second virtual prop is stars, when the football moves to the sky, the electronic device replaces the football with stars to display the stars at the collision point in the sky.

[0108] For example, if the first virtual prop is a flower, the first virtual prop collides with a wall in a three-dimensional space, and the second virtual prop is a plant, when the flower moves to the wall, the electronic device replaces the flower with the plant to display the plant at the collision point with the wall.

[0109] As another example, take the first virtual prop as a cat, and the first virtual prop collides with a wall in a three-dimensional space as an example. When the cat collides with the wall in the three-dimensional space, the electronic device displays a lying cat at the collision point where the cat collides with the wall.

[0110] In some embodiments, the second virtual prop can be determined randomly by the electronic device from a plurality of virtual props, or can be determined by the electronic device from a preset prop mapping table based on the first virtual prop, or can be determined by the collision position of the first virtual prop or the collision object of the first virtual prop. This embodiment of the application does not limit this.

[0111] As a possible implementation method, the electronic device determines whether the first virtual prop collides with a preset position in the three-dimensional space, and replaces the first virtual prop with a second virtual prop if it is determined that the first virtual prop collides with the preset position in the three-dimensional space.

[0112] As another possible implementation method, the electronic device determines whether the first virtual prop collides with a preset position in the three-dimensional space, and if it is determined that the first virtual prop collides with the preset position in the three-dimensional space, updates the current posture of the first virtual prop to the target posture.

[0113] As another possible implementation method, the electronic device determines whether the first virtual prop collides with a preset object in the three-dimensional space, and updates the current posture of the first virtual prop to a target posture when it is determined that the first virtual prop collides with the preset object in the three-dimensional space.

[0114] As another possible implementation method, the electronic device determines whether the first virtual prop collides with a preset plane in the three-dimensional space, and if it is determined that the first virtual prop collides with the preset plane in the three-dimensional space, updates the current posture of the first virtual prop to the target posture.

[0115] As another possible implementation method, the electronic device determines whether the first virtual prop collides with a preset position in the three-dimensional space, and when it is determined that the first virtual prop collides with the preset position in the three-dimensional space, after updating the current posture of the first virtual prop to the target posture for a preset time, replaces the first virtual prop with the second virtual prop.

[0116] As another possible implementation method, the electronic device determines whether the first virtual prop collides with a preset plane in the three-dimensional space, and when it is determined that the first virtual prop collides with the preset plane in the three-dimensional space, after updating the current posture of the first virtual prop to the target posture for a preset time, replaces the first virtual prop with the second virtual prop.

[0117] As another possible implementation method, the electronic device determines whether the first virtual prop collides with a preset object in the three-dimensional space, and when it is determined that the first virtual prop collides with the preset object in the three-dimensional space, after updating the current posture of the first virtual prop to the target posture for a preset time, replaces the first virtual prop with the second virtual prop.

[0118] This step in the embodiment of the present application can refer to the subsequent steps and will not be repeated here.

[0119] In order to more clearly describe the display method of the virtual props in the embodiment of the present application, exemplarily, in combination with Figure 3 ,exist Figure 3 In (a), there is a small stone in the palm of the hand; Figure 3 In (b) and (c), the hand throws a small stone, and the small stone moves in a parabola in three-dimensional space; Figure 3 In (d), the small stone hits the ground. Figure 3 In (e), the small stone is replaced by a puppy.

[0120] The present application provides a method for displaying a virtual prop, which has the following beneficial effects: displaying a shot screen including a target limb and a first virtual prop superimposed on the shot screen, wherein the first virtual prop follows the target limb. Further, detecting the movement of the target limb, and displaying the motion trajectory of the first virtual prop in a three-dimensional space based on the target movement when the movement of the target limb is a target movement (such as a throwing movement or a throwing movement). Subsequently, when the movement result of the first virtual prop in the three-dimensional space meets a preset condition, the display effect of the first virtual prop is updated. In this way, the user can interact with the virtual prop in real time, control the movement of the virtual prop through interactive actions, and control the display effect of the virtual prop display through interactive actions, thereby improving the interest of the video content and the interest of the video shooting.

[0121] In one design, in order to improve the interest of video content, Figure 4 As shown, before S203 provided in the embodiment of the present application, S206-S208 are also included.

[0122] S206: The electronic device detects the posture of the target limb in the captured image.

[0123] As a possible implementation method, after acquiring a picture taken by a camera, the electronic device detects the posture of the target limb in the picture.

[0124] Specifically, after acquiring the captured image, the electronic device determines the movement speed of the target limb in the three-dimensional space corresponding to the captured image and the position and posture of the target limb, and determines the posture of the target limb according to the movement speed of the target limb in the three-dimensional space corresponding to the captured image and the position and posture of the target limb. Further, the electronic device detects the posture of the target limb.

[0125] S207: The electronic device determines whether the posture of the target limb in the captured image is a preset posture.

[0126] As a possible implementation method, the electronic device, after determining the posture of the target limb, detects whether the posture of the target limb in the captured image is a preset posture.

[0127] In some embodiments, the preset posture may include a hand-holding posture, a back-leaning posture, a bending posture, and may also include a hand-holding posture and a hand-grasping posture. The preset posture is not limited in the embodiments of the present application.

[0128] S208: When the posture of the target limb is a preset posture, the electronic device displays a first virtual prop.

[0129] As a possible implementation method, when the electronic device determines that the posture of the target limb is a preset posture, it queries the first virtual prop from the second mapping relationship based on the preset posture, and superimposes the first virtual prop on the shooting picture. The second mapping relationship includes multiple postures and virtual props corresponding to each posture. Further, the electronic device renders the shooting picture superimposed with the first virtual prop to obtain a display picture, and displays the display picture.

[0130] Exemplarily, the second mapping relationship is a preset second mapping relationship table.

[0131] For example, the target limb is a hand, and the preset posture is a hand-holding posture. When the electronic device determines that the hand posture is a hand-holding posture, it searches the first virtual prop corresponding to the hand-holding posture from the first preset mapping relationship table based on the hand-holding posture: stone. Further, the electronic device renders the stone on the hand in the three-dimensional space, obtains a display screen of the hand holding the stone, and displays the display screen of the hand holding the stone.

[0132] For example, the target limb is the back, and the preset posture is the bending posture. When the electronic device determines that the posture of the back is the bending posture, it searches the first virtual prop corresponding to the bending posture from the first preset mapping relationship table based on the bending posture of the hand: rockery. Further, the electronic device renders the rockery on the back in the three-dimensional space, obtains a display screen of the rockery on the back, and displays the display screen of the rockery on the back.

[0133] In other embodiments, when the electronic device determines that the posture of the target limb is a preset posture, it randomly configures a first virtual prop for the preset posture, renders the first virtual prop in a three-dimensional space, obtains a display screen, and displays the display screen.

[0134] In other embodiments, when the electronic device determines that the posture of the target limb is a preset posture, the electronic device determines the first virtual prop based on the current time and the third preset mapping relationship table.

[0135] Exemplarily, when determining that the target limb is in a hand-holding posture, the electronic device obtains the current time and determines that the current time is morning. Further, based on morning, the electronic device determines the first virtual prop corresponding to morning from the third preset mapping relationship table.

[0136] Exemplarily, when the electronic device determines that the target limb is in a hand-holding posture, it obtains the current time and determines that the time is afternoon. Further, based on the afternoon, the electronic device determines the first virtual prop corresponding to the afternoon from the second preset mapping relationship table.

[0137] It should be noted that the second preset mapping relationship table and the third preset mapping relationship table are pre-set in the electronic device by operation and maintenance personnel.

[0138] It is understandable that when the posture of the target limb is detected to be a preset posture, the electronic device configures a first virtual prop for the target limb and presents it to the user. In this way, when the electronic device detects the user's intention to interact, it configures a first virtual prop for the target limb and displays the first virtual prop, thereby improving the interest of the video content and the interest of the video shooting.

[0139] In one design, in order to enhance the display effect of video content, in the display method of virtual props provided in an embodiment of the present application, the movement result of the first virtual prop in the three-dimensional space meets a preset condition, including: the first virtual prop collides with the target object in the three-dimensional space.

[0140] The target object includes a preset plane, a preset position or a preset object.

[0141] In some embodiments, the preset plane may be the ground or a wall in a three-dimensional space, or may be the sky or a slope; the preset position may be any position in the three-dimensional space, for example, the middle position of the three-dimensional space, and the preset position may be adjusted according to different three-dimensional spaces; the preset object may include an object or a creature in the three-dimensional space. In the embodiments of the present application, the preset plane, the preset object, and the preset position are not limited.

[0142] Exemplarily, in the case where the three-dimensional space includes a preset plane, the preset plane is taken as the ground. When the first virtual prop moves to the ground in the three-dimensional space, the electronic device determines that the movement result of the first virtual prop meets the preset condition. Subsequently, the electronic device updates the display effect of the first virtual prop at the collision point between the first virtual prop and the ground in the three-dimensional space.

[0143] Exemplarily, in the case where the three-dimensional space includes a preset plane, for example, the preset plane is a wall. When the first virtual prop moves to the wall in the three-dimensional space, the electronic device determines that the movement result of the first virtual prop meets the preset condition. Subsequently, the electronic device updates the display effect of the first virtual prop at the collision point between the first virtual prop and the ground in the three-dimensional space.

[0144] Exemplarily, when the stereoscopic space includes a preset position, for example, the preset position is the center position of the stereoscopic space. When the first virtual prop moves to the center position, the electronic device determines that the movement result of the first virtual prop meets the preset condition.

[0145] Exemplarily, when the stereoscopic space includes a preset object, for example, the preset object is a mountain, the electronic device determines that the movement result of the first virtual prop meets the preset condition when the first virtual prop hits the mountain in the stereoscopic space.

[0146] Exemplarily, in the case where the three-dimensional space includes a preset plane and a preset position, the preset plane is the sky and the preset position is the middle position of the three-dimensional space. The electronic device determines the movement trajectory of the first virtual prop and determines the movement end point of the first virtual prop. If the first virtual prop first moves to the sky in the three-dimensional space, it is determined that the movement result of the first virtual prop meets the preset condition. If the first virtual prop first moves to the middle position of the three-dimensional space, it is determined that the movement result of the first virtual prop meets the preset condition.

[0147] It should be noted that the target object is preset by the electronic device according to the content in the three-dimensional space after the three-dimensional space is generated. The preset object can be a stationary object (such as a stone, a hillside or a table) and a moving object (such as a flying swallow or a moving stone).

[0148] It is understandable that the display effect of the first virtual prop is updated only when the first virtual prop moves to the target position in the three-dimensional space, so as to enhance the display effect of the video content.

[0149] In one design, in order to improve the interest of video content, S205 provided in the embodiment of the present application specifically includes: S2051-S2053.

[0150] S2051: The electronic device replaces the first virtual prop with the second virtual prop.

[0151] As a possible implementation manner, the electronic device replaces the first virtual prop with the second virtual prop when determining that the movement result of the first virtual prop in the three-dimensional space meets a preset condition.

[0152] For example, taking the first virtual prop as a bone and the second virtual prop as a dog as an example, the electronic device replaces the bone with the dog when determining that the movement result of the first virtual prop in the three-dimensional space meets the preset condition.

[0153] For example, taking the first virtual prop as a kitten and the second virtual prop as a lion as an example, the electronic device replaces the kitten with the lion when determining that the movement result of the first virtual prop in the three-dimensional space meets the preset condition.

[0154] S2052: The electronic device updates the current posture of the first virtual prop to the target posture.

[0155] As a possible implementation manner, when determining that the movement result of the first virtual prop in the three-dimensional space meets a preset condition, the electronic device determines a target posture of the first virtual prop and updates the current posture of the first virtual prop to the target posture.

[0156] For example, if the first virtual prop is a kitten, the current posture is a side-lying posture, and the target posture is a standing posture, the electronic device replaces the side-lying kitten with a standing kitten when determining that the movement result of the kitten in the three-dimensional space meets the preset conditions.

[0157] For example, if the first virtual prop is a flower, the current posture is a closed posture, and the target posture is an open posture, the electronic device replaces the closed flower with an open flower when determining that the movement result of the flower in the three-dimensional space meets the preset condition.

[0158] S2053: After the electronic device updates the current posture of the first virtual prop to the target posture for a preset time, the electronic device replaces the first virtual prop with the second virtual prop.

[0159] As a possible implementation method, when the electronic device determines that the movement result of the first virtual prop in the three-dimensional space meets the preset conditions, after updating the current posture of the first virtual prop to the target posture for a preset time, the first virtual prop is replaced by the second virtual prop.

[0160] For example, the first virtual prop is a flower, the current posture is a closed posture, the target posture is an open posture, and the second virtual prop is a cat. When the electronic device determines that the movement result of the flower in the three-dimensional space meets the preset conditions, the closed flower is replaced by an open flower, and after displaying the open flower for 5 seconds, the open flower is replaced by a cat.

[0161] For example, taking the first virtual prop as a cat, the current posture as a side-lying posture, the target posture as a standing posture, and the second virtual prop as a lion as an example, when the electronic device determines that the movement result of the cat in the three-dimensional space meets the preset conditions, the side-lying cat is replaced with a standing cat, and after displaying the standing cat for 3 seconds, the standing cat is replaced with a lion.

[0162] It should be noted that in the embodiment of the present application, S2051, S2052 and S2053 are not arranged in sequence, but are implemented in different ways.

[0163] It is understandable that, when the electronic device determines that the movement result of the first virtual prop in the three-dimensional space meets the preset conditions, it can replace the first virtual prop with the second virtual prop, update the current posture of the first virtual prop to the target posture, or update the current posture of the first virtual prop to the target posture for a preset time, and then replace the first virtual prop with the second virtual prop. In this way, different display effects can be presented to the user, thereby improving the interest of the video content.

[0164] In one design, in order to improve the interest of video content, in the method for displaying virtual props provided in an embodiment of the present application, the target posture or the posture of the second virtual prop corresponds to the target object that the first virtual prop collides with.

[0165] As a possible implementation manner, when the electronic device determines that the collision position of the first virtual prop is a preset position, the electronic device determines the target posture of the first virtual prop or the posture of the second virtual prop based on the collision position and a fourth preset mapping relationship table.

[0166] For example, taking the collision position as a tree trunk and the first virtual prop as a cat, when the electronic device determines that the collision occurs on the tree trunk, the electronic device searches the fourth preset mapping relationship table for a target posture corresponding to the position on the tree trunk based on the position on the tree trunk.

[0167] For example, if the collision position is the middle position of the three-dimensional space and the first virtual prop is a swallow, the electronic device searches the fourth preset mapping relationship table for the target posture corresponding to the middle position of the picture based on the middle position of the picture when determining that the collision occurs at the middle position of the three-dimensional space.

[0168] In this way, the electronic device determines different target postures of the first virtual prop or postures of the second virtual prop based on different preset positions where the first virtual prop collides.

[0169] As a possible implementation manner, when determining that the first virtual prop collides with the preset plane, the electronic device determines the target posture of the first virtual prop or the posture of the second virtual prop based on the type of the preset plane and the fifth preset mapping relationship table.

[0170] For example, if the type of the preset plane is a plane, the second virtual prop is a cat, and the posture of the second virtual prop is a standing posture, when the electronic device determines that the cat collides with the plane, it searches the fifth preset mapping relationship table for the target posture corresponding to the plane: standing posture.

[0171] For example, if the type of the preset plane is an inclined plane, the first virtual prop is a cat, and the posture of the second virtual prop is a running posture, when the electronic device determines that the cat collides with the inclined plane, the electronic device searches the fifth preset mapping relationship table for the target posture corresponding to the middle position of the screen: the running posture, based on the middle position of the screen.

[0172] In this way, the electronic device determines different target postures of the first virtual prop or postures of the second virtual prop based on the different planes that the first virtual prop collides with.

[0173] As a possible implementation manner, when determining that the first virtual prop collides with the preset object, the electronic device determines the target posture of the first virtual prop or the posture of the second virtual prop based on the type of the preset object and the sixth preset mapping relationship table.

[0174] For example, if the type of the preset object is a hill, the second virtual prop is a bird, and the posture of the second virtual prop is a standing posture, when the electronic device determines that the bird collides with the hill, the electronic device searches the sixth preset mapping relationship table for the target posture corresponding to the plane: the standing posture.

[0175] For example, if the type of the preset object is a house, the first virtual prop is a cat, and the posture of the second virtual prop is a side-lying posture, when the electronic device determines that the cat collides with the house, it searches the sixth preset mapping relationship table for the target posture corresponding to the middle position of the picture: the side-lying posture based on the middle position of the picture.

[0176] In this way, when the first virtual prop collides with different preset objects, the electronic device determines different target postures of the first virtual prop or postures of the second virtual prop based on the different preset objects.

[0177] As a possible implementation method, the electronic device determines the target posture of the first virtual prop or the posture of the second virtual prop based on the posture of the collision object, the collision position and the seventh preset mapping relationship table when determining the posture of the collision object of the first virtual prop and the collision position of the first virtual prop.

[0178] For example, if the second virtual prop is a dog, the collision object is the ground, the collision position is the middle area of ​​the ground, and the posture of the second virtual prop is a standing posture, the electronic device determines that the dog's posture is a standing posture when determining that the dog collides with the middle area of ​​the ground.

[0179] For example, taking the second virtual prop as a dog, the collision object as the ground, the collision position as the left area of ​​the ground, and the posture of the second virtual prop as a head-turning posture, when the electronic device determines that the dog collides with the left area of ​​the ground, it searches the seventh preset mapping relationship table and obtains that the dog's posture is a head-turning posture.

[0180] Specifically, in some embodiments, when the first virtual prop collides with the target object, the electronic device determines the posture corresponding to the target object from the first mapping relationship according to the target object colliding with the first virtual prop. The first mapping relationship includes multiple objects and postures corresponding to each object, and the multiple objects include the target object. According to the posture of the target object, the first virtual prop is replaced with the second virtual prop. The posture of the second virtual prop is the posture corresponding to the target object.

[0181] In some other embodiments, when the first virtual prop collides with the target object, the electronic device determines a target posture corresponding to the target object from the first mapping relationship according to the target object that the first virtual prop collides with, and updates the current posture of the first virtual prop to the target posture.

[0182] In other embodiments, when the first virtual prop collides with the target object, the electronic device determines the target posture corresponding to the target object from the first mapping relationship according to the target object that the first virtual prop collides with. The current posture of the first virtual prop is updated to the target posture. Further, the electronic device determines the second virtual prop corresponding to the target object and the target posture of the second virtual prop from the third mapping relationship according to the target object, and replaces the first virtual prop with the second virtual prop after the current posture of the first virtual prop is updated to the target posture for a preset time. Among them, the posture of the second virtual prop is the target posture.

[0183] It should be noted that the fourth preset mapping relationship table, the fifth preset mapping relationship table, the sixth preset mapping relationship table, and the seventh preset mapping relationship table are pre-set in the electronic device by the operation and maintenance personnel. The fourth preset mapping relationship table, the fifth preset mapping relationship table, and the sixth preset mapping relationship can be the same mapping relationship table or different mapping relationship tables, which is not limited in the embodiments of the present application.

[0184] It is understandable that the posture of the first virtual prop at the collision point or the posture of the second virtual prop at the collision point can be determined based on the target object that the first virtual prop collides with. In this way, when the first virtual prop collides with different target objects, virtual props with different postures can be presented to the user, thereby improving the interest of the video content.

[0185] In one design, in order to improve the display effect of augmented reality, after S205 of the embodiment of the present application, it also includes: S209.

[0186] S209: After displaying the second virtual prop, the electronic device displays a special effect corresponding to the second virtual prop.

[0187] As a possible implementation method, after the first virtual prop is replaced by the second virtual prop, the electronic device determines the special effect corresponding to the second virtual prop according to a preset special effect mapping table, and displays the special effect corresponding to the second virtual prop at a preset position in the shooting picture.

[0188] In some embodiments, the electronic device displays a special effect above the second virtual prop.

[0189] In other embodiments, the electronic device displays special effects below the second virtual prop.

[0190] The embodiments of the present application do not specifically limit the preset position.

[0191] As another possible implementation method, after the first virtual prop is replaced by the second virtual prop, the electronic device randomly selects a special effect from a plurality of special effects and displays the special effect at a preset position in the shooting picture.

[0192] In another case, the electronic device displays the special effect corresponding to the first virtual prop when updating the current posture of the first virtual prop to the target posture.

[0193] It can be understood that after the display effect of the first virtual prop is updated, the special effect picture corresponding to the first virtual prop or the second virtual prop is displayed in the shooting picture, which improves the display effect of augmented reality and increases the fun of the video content.

[0194] In one design, in order to increase the interactive effect and improve the fun of the video, Figure 5 As shown, the method for displaying virtual props provided in the embodiment of the present application further includes: S210-S211.

[0195] S210: The electronic device detects whether the movement of the target limb is a preset interactive movement.

[0196] As a possible implementation method, after updating the display effect of the first virtual prop, the electronic device detects in real time or periodically whether the action of the target limb is a preset interactive action.

[0197] Specifically, the electronic device obtains the interaction speed and interaction posture of the target limb in the three-dimensional space within a preset time period. Further, the electronic device detects whether the action of the target limb is a preset interaction action according to the interaction speed and interaction posture.

[0198] In some embodiments, the electronic device obtains multiple interaction gestures and detects whether the movement of the target limb is a preset interaction movement based on the multiple interaction gestures.

[0199] Exemplarily, the preset interactive action may be shaking a finger upward, shaking a finger left or right, or shaking the head left or right. The preset interactive action may also be other interactive actions, which are not specifically limited in the embodiments of the present application.

[0200] S211. When the electronic device detects that the movement of the target limb is a preset interactive movement, the electronic device controls the movement of the second virtual prop in response to the movement of the target limb.

[0201] As a possible implementation method, the electronic device determines that the detected movement of the target limb is a preset interaction movement when it is determined that the interaction speed is greater than or equal to the second preset speed and the interaction posture matches the preset interaction posture. Further, the electronic device controls the second virtual prop to follow the movement of the target limb in response to the movement of the target limb.

[0202] In some embodiments, the electronic device determines that the movement of the target limb is an interactive movement when it determines that the movement of the target limb matches a preset interactive gesture. Further, the electronic device controls the second virtual prop to follow the movement of the target limb in response to the interactive movement of the target limb.

[0203] For example, the target limb is a hand, and the preset interactive action is a finger swinging action. The electronic device obtains multiple hand postures, and when it is determined that the hand posture matches the preset hand posture, it determines that the hand action is a finger swinging action. Further, the electronic device controls the second virtual prop to follow the finger swinging.

[0204] For example, the target limb is the head, and the preset interactive action is a head shaking action. The electronic device obtains multiple head postures, and when it is determined that the head posture matches the preset head posture, determines that the head action is a head shaking action. Further, the electronic device controls the first virtual prop to shake with the head.

[0205] As a possible implementation method, the electronic device determines that the detected movement of the target limb is a preset interaction movement when it is determined that the interaction speed is greater than or equal to the second preset speed and the interaction posture matches the preset interaction posture. Further, the electronic device responds to the movement of the target limb, determines the movement mode of the second virtual prop according to the movement of the target limb, and controls the movement mode of the second virtual prop so that the second virtual prop follows the movement of the target limb.

[0206] For example, the target limb is a hand, the preset interactive action is a hand-pushing action, and the second virtual prop is a lion. When the electronic device determines that the hand action is a hand-pushing action, it determines that the movement mode of the lion is running according to the hand-pushing action and the preset interactive mapping relationship table. Further, the electronic device controls the lion to run.

[0207] It should be noted that the second virtual prop or part of the second virtual prop can follow the movement of the target limb, and the embodiment of the present application does not limit this. For example, the second virtual prop is a horse, and the electronic device can control the horse to follow the movement of the target limb, and can also control the horse's eyes to follow the movement of the target limb.

[0208] It can be understood that the electronic device controls the second virtual prop to move according to the interactive action of the target limb based on the action of the target limb, thereby enhancing the interactive effect and increasing the fun of the video content.

[0209] In one design, in order to enhance the display effect, in the display method of virtual props provided in an embodiment of the present application, the motion trajectory of the first virtual prop in three-dimensional space based on the target action includes the motion trajectory of the first virtual prop in three-dimensional space after leaving the target limb in response to the target action.

[0210] For example, taking the target limb as a hand, the first virtual prop as a stone, and the target action as a parabolic action, the motion trajectory of the stone based on the target action is a parabolic motion trajectory of the stone leaving the hand.

[0211] For example, taking the target limb as a hand, the first virtual prop as a bone, and the target action as a throwing action as an example, the motion trajectory of the stone generated based on the target action is the throwing motion trajectory of the stone leaving the hand.

[0212] It can be understood that displaying the movement track of the first virtual prop alone enhances the realism of the interactive picture, thereby enhancing the display effect.

[0213] In one design, in order to enhance the display effect, the target action is a throwing action, and S204 provided in the embodiment of the present application includes: S2041.

[0214] S2041: When the action of the target limb is a throwing action, the electronic device displays a parabolic motion trajectory of the first virtual prop generated in a three-dimensional space based on the throwing action.

[0215] As a possible implementation method, after determining that the movement of the target limb is a throwing movement, the electronic device determines the parabolic motion trajectory of the first virtual prop in the three-dimensional space based on the throwing movement, and displays the first virtual prop based on the parabolic motion trajectory.

[0216] It is understandable that when the first motion is a throwing motion, the electronic device simulates a parabolic motion trajectory based on the throwing motion, and displays the first virtual prop based on the parabolic motion trajectory, thereby enhancing the realism of the interactive screen and the display effect.

[0217] In one design, in order to enhance the display effect, in the display method of the virtual props provided in the embodiment of the present application, the motion trajectory is obtained by superimposing and rendering the first virtual prop in the three-dimensional space corresponding to the shooting picture.

[0218] As a possible implementation method, when the electronic device determines that the movement of the target limb is the target movement, the electronic device superimposes the first virtual prop in the three-dimensional space constructed based on the shooting picture and renders the movement trajectory of the first virtual prop.

[0219] It can be understood that the three-dimensional space is constructed based on the shooting picture, so as to determine the motion trajectory of the first virtual prop in the three-dimensional space. In this way, the motion trajectory presented to the user is more realistic, thereby enhancing the display effect.

[0220] In one design, in order to accurately determine the movement of the target limb, such as Figure 6 As shown, S203 provided in the embodiment of the present application specifically includes: S2031-S2032.

[0221] S2031. The electronic device obtains motion characteristic data of the target limb in the captured image.

[0222] The motion feature data includes motion speed and motion posture.

[0223] As a possible implementation method, the electronic device obtains pictures of the target limb at different times, and determines the different positions of the target limb in the three-dimensional space, the time corresponding to each position of the target limb, and the movement posture of the target limb based on the multiple pictures. Further, the electronic device determines the movement speed of the target limb based on the different positions of the target limb in the three-dimensional space and the time corresponding to each position of the target limb. Subsequently, the electronic device inputs the movement speed and movement posture of the target limb into a preset motion detection neural network to detect whether the movement of the target limb is the target movement.

[0224] Exemplarily, the electronic device obtains a first captured image at a first moment T1 and a second captured image at a second moment T2, and calculates a first position of the target limb in the first captured image and a second position of the target limb in the second captured image according to a preset position algorithm. Further, the electronic device calculates the moving distance of the target limb according to the first position and the second position, and calculates the movement time of the target limb according to T1 and T2. Subsequently, the electronic device calculates the movement speed of the target limb according to the moving distance and the movement time, and obtains the movement posture of the target limb according to the first captured image and the second captured image.

[0225] In some embodiments, the time interval between the first time point T1 and the second time point T2 is less than or equal to the first time threshold.

[0226] For example, the first time threshold may be 3 seconds (s) or 2s, which is not limited in the embodiments of the present application.

[0227] S2032. The electronic device inputs the motion feature data into a preset motion detection neural network to detect whether the motion of the target limb is the target motion.

[0228] As a possible implementation method, the electronic device inputs motion feature data into a preset motion detection neural network, outputs a motion result, and detects whether the motion of the target limb is a target motion based on the output motion result.

[0229] For example, taking the target action as a hand throwing action, when the preset action detection neural network outputs the hand throwing action result, the electronic device detects the action of the target limb as the target action.

[0230] In another case, the electronic device obtains the movement speed and the movement posture of the target limb, and detects whether the movement of the target limb is the target movement based on the movement speed and the movement posture.

[0231] Specifically, the electronic device determines whether the movement speed is greater than or equal to a first preset threshold, and whether the movement posture is a movement posture corresponding to the target action. Further, if the movement speed of the electronic device is greater than or equal to the first preset threshold, and the movement posture is a movement posture corresponding to the target action, the electronic device detects that the movement of the target limb is the target action.

[0232] It can be understood that the electronic device detects whether the movement of the target limb is the first movement based on the movement speed and movement posture of the target limb in the three-dimensional space, thereby avoiding misjudgment of the movement of the target limb and improving the detection accuracy.

[0233] In one design, in order to accurately display the motion trajectory of the first virtual prop, such as Figure 7 As shown, S204 provided in the embodiment of the present application specifically includes: S2042-S2044.

[0234] S2042. The electronic device obtains current motion parameters of the target limb in the three-dimensional space.

[0235] The current motion parameters include current speed, current position and current time.

[0236] As a possible implementation method, when the electronic device detects that the movement of the target limb is the target movement, the electronic device obtains the current speed, current position and current time of the target limb in the three-dimensional space.

[0237] In some embodiments, when the electronic device detects that the movement of the target limb is the target movement, the electronic device obtains the motion parameters of the target limb in real time or periodically (each motion parameter includes speed, position and time) to obtain multiple motion parameters. Further, when the electronic device detects that the speed of the target limb decreases, the electronic device determines that the motion parameter corresponding to the maximum speed is the current motion parameter.

[0238] In other embodiments, after detecting that the position of the target limb in the three-dimensional space begins to fall, the electronic device determines the motion parameter corresponding to the highest position as the current motion parameter.

[0239] S2043: The electronic device inputs the current motion parameters into a preset motion equation to determine the motion trajectory.

[0240] As a possible implementation method, the electronic device inputs the current speed, current position and current time into a preset motion equation to obtain different positions of the first virtual prop in the three-dimensional space at different times, obtain multiple positions, and obtain the motion trajectory based on the multiple positions.

[0241] For example, taking the target limb as a hand and the target action as a hand throwing action as an example, the preset motion equation is shown in the following formula 1.

[0242]

[0243] Among them, s is the position of the first virtual prop at time t, a is the acceleration of the first virtual prop (when air resistance is ignored, a is equal to the acceleration of gravity), t is ts after the current time, v0 is the current speed, and s0 is the current position.

[0244] It should be noted that for different target actions, the preset motion equations are also different. The preset motion equations are obtained based on action training in real scenes, and can simulate the motion trajectory of the first virtual prop after the target limb performs the target action.

[0245] S2044: The electronic device displays the movement trajectory of the first virtual prop.

[0246] As a possible implementation method, the electronic device displays the first virtual props at different positions in sequence according to a time sequence.

[0247] It can be understood that the electronic device obtains the speed, position and time of the target limb in the three-dimensional space, obtains the current speed, current position and current time of the first virtual prop leaving the target limb, and obtains the motion trajectory of the first virtual prop based on the current speed, current position and current time and the preset motion equation. Further, the electronic device displays the first virtual prop according to the motion trajectory, and can accurately display the motion trajectory of the first virtual prop, thereby enhancing the authenticity of the interaction and improving the fun of the video content.

[0248] In one design, in order to improve the display effect of augmented reality, such as Figure 8 As shown, the method for displaying virtual props provided in the embodiment of the present application further includes: S212-S215.

[0249] S212: The electronic device obtains the current shooting picture.

[0250] As a possible implementation method, the electronic device obtains the current shooting picture through the camera in response to the user clicking the target button in the target application.

[0251] As another possible implementation method, the electronic device obtains the current shooting picture through the camera when the target special effect function is activated.

[0252] S213: The electronic device inputs the current shooting picture into a preset enhancement algorithm to generate a three-dimensional space corresponding to the shooting picture.

[0253] As a possible implementation method, the electronic device inputs the current shooting picture into a preset enhancement algorithm to generate a three-dimensional space corresponding to the shooting picture.

[0254] The three-dimensional space includes a preset plane and / or a preset position. The preset plane may be the ground, a wall, a slope or the sky, and the preset position may be a middle point in the three-dimensional space, which is not limited in the embodiment of the present application.

[0255] S214: When the current shooting picture includes the target limb, the electronic device inputs the current shooting picture into a preset limb algorithm and outputs depth parameter information of the target limb.

[0256] The depth parameter information includes the plane coordinates of the target limb in the current shooting picture and the depth information of the target limb.

[0257] As a possible implementation method, after the target limb is included in the current shooting picture, the electronic device inputs the current shooting picture into a preset limb algorithm and outputs multiple depth parameter information of the target limb.

[0258] It should be noted that the preset limb algorithm is a trained model algorithm and is pre-set in the electronic device by the operation and maintenance personnel.

[0259] S215. The electronic device determines the target space coordinates of the target limb based on the depth parameter information and the reference space coordinates corresponding to the three-dimensional space.

[0260] As a possible implementation, the electronic device uses the position of the camera as the reference space coordinate in the three-dimensional space. The electronic device determines multiple target space coordinates of the target limb based on multiple depth parameter information and the reference space coordinates, and determines the position of the target limb in the three-dimensional space based on the multiple space coordinates. Further, the electronic device determines a shooting picture including the target limb based on the three-dimensional space, and displays the shooting picture.

[0261] It can be understood that the electronic device calculates the position of the target limb and the simulated limb in the three-dimensional space according to different algorithms and displays it, thereby improving the display effect of augmented reality.

[0262] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the method. In order to achieve the above functions, the display device or electronic device of the virtual props includes a hardware structure and / or software module corresponding to the execution of each function. It should be easy for those skilled in the art to realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.

[0263] The embodiment of the present application can divide the display device or electronic device of the virtual props into functional modules according to the above method. For example, the display device or electronic device of the virtual props can include various functional modules corresponding to the various functional divisions, or two or more functions can be integrated into one processing module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical functional division. There may be other division methods in actual implementation.

[0264] For example, an embodiment of the present application also provides a display device for virtual props.

[0265] The present application embodiment provides a virtual prop display device 30, such as Fig. 9 As shown, the display device 30 includes: a display unit 301 , a processing unit 302 , a detection unit 303 and an updating unit 304 .

[0266] The display unit 301 is used to display the shooting picture.

[0267] The processing unit 302 is configured to render a first virtual prop in a three-dimensional space corresponding to the shooting picture in response to detecting the target limb in the shooting picture. The first virtual prop follows the target limb.

[0268] The detection unit 303 is used to detect the movement of the target limb in the captured image.

[0269] The display unit 301 is further configured to display a motion trajectory of the first virtual prop generated in the three-dimensional space based on the target action when the action of the target limb is the target action.

[0270] The updating unit 304 is configured to update the display effect of the first virtual prop when the movement result of the first virtual prop in the three-dimensional space meets a preset condition.

[0271] In a possible implementation, the detection unit 303 is further configured to detect the posture of the target limb in the captured image. The display unit is further configured to display the first virtual prop when the posture of the target limb is a preset posture.

[0272] In a possible implementation, the movement result of the first virtual prop in the three-dimensional space meets a preset condition, including: the first virtual prop collides with a target object in the three-dimensional space. The target object includes a preset plane, a preset position, or a preset object.

[0273] In a possible implementation, the updating unit 304 is specifically configured to: replace the first virtual prop with the second virtual prop. Alternatively, update the current posture of the first virtual prop to the target posture. Alternatively, after the current posture of the first virtual prop is updated to the target posture for a preset time, replace the first virtual prop with the second virtual prop.

[0274] In a possible implementation, the updating unit 304 is specifically used to: determine a posture corresponding to the target object from a first mapping relationship according to the target object colliding with the first virtual prop; the first mapping relationship includes multiple objects and a posture corresponding to each object, and the multiple objects include the target object; according to the posture of the target object, replace the first virtual prop with a second virtual prop; the posture of the second virtual prop is the posture corresponding to the target object.

[0275] In a possible implementation, the updating unit 304 is specifically used to: determine a target posture corresponding to the target object from a first mapping relationship according to the target object colliding with the first virtual prop; the first mapping relationship includes multiple objects and a posture corresponding to each object, and the multiple objects include the target object; and update the current posture to the target posture.

[0276] In a possible implementation, the display unit 301 is further configured to display a special effect corresponding to the second virtual prop after displaying the second virtual prop.

[0277] In a possible implementation, Fig. 9 As shown, the display device 30 further includes a control unit 305. The control unit 305 is used to control the second virtual prop or the first virtual prop to follow the movement of the target limb in response to the movement of the target limb when the movement of the target limb is a preset interactive movement.

[0278] In a possible implementation, the motion trajectory of the first virtual prop in the three-dimensional space based on the target action includes the motion trajectory of the first virtual prop in the three-dimensional space after the first virtual prop leaves the target limb in response to the target action.

[0279] In a possible implementation, the target action is a throwing action, and the display unit 301 is specifically configured to display a parabolic motion trajectory of the first virtual prop generated based on the throwing action in a three-dimensional space when the action of the target limb is a throwing action.

[0280] In a possible implementation, the detection unit 303 is specifically configured to: obtain motion feature data of the target limb in the captured image; the motion feature data includes motion speed and motion posture; and input the motion feature data into a preset motion detection neural network to detect the motion of the target limb in the captured image.

[0281] In a possible implementation, the display unit 301 is specifically used to: obtain current motion parameters of the target limb in the three-dimensional space; the current motion parameters include current speed, current position and current time. Input the current motion parameters into a preset motion equation to determine the motion trajectory, and display the motion trajectory of the first virtual prop in the three-dimensional space.

[0282] In the case of implementing the functions of the above-mentioned integrated modules in the form of hardware, the embodiment of the present application provides a possible structural diagram of the electronic device involved in the above-mentioned embodiment. Fig.10 As shown, the electronic device 40 includes a processor 401, a memory 402 and a bus 403. The processor 401 and the memory 402 may be connected via the bus 403.

[0283] The processor 401 is the control center of the communication device, which can be a processor or a general term for multiple processing elements. For example, the processor 401 can be a general-purpose central processing unit (CPU) or other general-purpose processors. Among them, the general-purpose processor can be a microprocessor or any conventional processor.

[0284] As an embodiment, the processor 401 may include one or more CPUs, such as Fig.10 CPU 0 and CPU 1 are shown in .

[0285] The memory 402 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store information and instructions, an electrically erasable programmable read-only memory (EEPROM), a disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited to these.

[0286] As a possible implementation, the memory 402 may exist independently of the processor 401, and the memory 402 may be connected to the processor 401 via a bus 403 to store instructions or program codes. When the processor 401 calls and executes the instructions or program codes stored in the memory 402, the sensor determination method provided in the embodiment of the present application can be implemented.

[0287] In another possible implementation, the memory 402 may also be integrated with the processor 401 .

[0288] The bus 403 may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.10 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0289] It should be pointed out that Fig.10 The structure shown does not constitute a limitation on the electronic device 40. Fig.10 In addition to the components shown, the electronic device 40 may include more or fewer components than shown, or combine certain components, or arrange the components differently.

[0290] Optionally, the electronic device 40 provided in the embodiment of the present application may further include a communication interface 404 .

[0291] The communication interface 404 is used to connect with other devices through a communication network. The communication network may be Ethernet, wireless access network, wireless local area network (WLAN), etc. The communication interface 404 may include a receiving unit for receiving data and a sending unit for sending data.

[0292] In one design, in the electronic device 40 provided in the embodiment of the present application, the communication interface can also be integrated into the processor.

[0293] In another hardware structure of the server provided in an embodiment of the present application, the electronic device may include a processor and a communication interface. The processor is coupled to the communication interface.

[0294] The functions of the processor can refer to the description of the above processor. In addition, the processor also has a storage function, which can refer to the function of the above memory.

[0295] The communication interface is used to provide data to the processor. The communication interface can be an internal interface of the communication device or an external interface of the communication device.

[0296] It should be pointed out that the above-mentioned another hardware structure does not constitute a limitation on the server. In addition to the above-mentioned another hardware component, the server may include more or fewer components, or a combination of certain components, or different component arrangements.

[0297] In the case of implementing the functions of the above-mentioned integrated modules in the form of hardware, the structural diagram of the middleware involved in the above-mentioned embodiments provided in the embodiments of the present application can refer to the structural diagram of the above-mentioned execution machine.

[0298] The embodiment of the present application further provides a computer-readable storage medium, in which instructions are stored. When a computer executes the instructions, the computer executes each step in the virtual prop display method flow shown in the above method embodiment.

[0299] The embodiment of the present application also provides a computer program product including instructions, and when the instructions are executed on a computer, the computer executes the method for displaying virtual props in the above method embodiment.

[0300] Among them, the computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable computer disk, and a hard disk. Random Access Memory (RAM), Read-Only Memory (ROM), Erasable Programmable Read Only Memory (EPROM), registers, hard disks, optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any other form of computer-readable storage medium in a suitable combination of the above, or numerical values ​​in the art. An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an Application Specific Integrated Circuit (ASIC). In the embodiments of the present application, a computer-readable storage medium may be any tangible medium that contains or stores a program, which may be used by or in conjunction with an instruction execution system, apparatus, or device.

[0301] Since the server, user equipment, computer-readable storage medium, and computer program product in the embodiments of the present application can be applied to the above method, the technical effects that can be obtained can also refer to the above method embodiments, and the embodiments of the present application will not be repeated here.

[0302] The above are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application.

Claims

1. A method for displaying a virtual prop, characterized in that: The method comprises: Displaying a shot picture, and in response to detecting a target limb in the shot picture, rendering a first virtual prop in a three-dimensional space corresponding to the shot picture; the first virtual prop follows the target limb; Detecting the movement of the target limb in the captured image; When the movement of the target limb is a target movement, displaying a movement trajectory of the first virtual prop generated in the three-dimensional space based on the target movement; When the first virtual prop collides with a target object in the three-dimensional space, updating the display effect of the first virtual prop; the target object is a preset plane, a preset position or a preset object; Before detecting the movement of the target limb in the captured image, the method further includes: Detecting the posture of the target limb in the captured image; When the posture of the target limb is a preset posture, displaying the first virtual prop; The updating of the display effect of the first virtual prop includes: replacing the first virtual prop with a second virtual prop; Alternatively, updating the current posture of the first virtual prop to the target posture; Alternatively, after the current posture of the first virtual prop is updated to the target posture for a preset time, the first virtual prop is replaced by the second virtual prop.

2. The display method according to claim 1, characterized in that: The step of replacing the first virtual item with a second virtual item comprises: Determine, from a first mapping relationship, a posture corresponding to the target object according to the target object collided with by the first virtual prop; the first mapping relationship includes a plurality of objects and a posture corresponding to each object, and the plurality of objects includes the target object; According to the posture of the target object, the first virtual prop is replaced by the second virtual prop; the posture of the second virtual prop is the posture corresponding to the target object.

3. The display method according to claim 1, characterized in that: The updating the current posture of the first virtual prop to the target posture includes: Determining a target posture corresponding to the target object from a first mapping relationship according to the target object collided with by the first virtual prop; the first mapping relationship includes a plurality of objects and a posture corresponding to each object, and the plurality of objects includes the target object; The current posture is updated to the target posture.

4. The display method according to claim 1, characterized in that: The method further comprises: After displaying the second virtual prop, a special effect corresponding to the second virtual prop is displayed.

5. The display method according to any one of claims 1 to 4, characterized in that: After updating the display effect of the first virtual prop, the method further includes: In a case where the movement of the target limb is a preset interactive movement, the second virtual prop or the first virtual prop is controlled to move in response to the movement of the target limb.

6. The display method according to any one of claims 1 to 4, characterized in that: The motion trajectory of the first virtual prop in the three-dimensional space based on the target action includes the motion trajectory of the first virtual prop in the three-dimensional space after the first virtual prop leaves the target limb in response to the target action.

7. The display method according to any one of claims 1 to 4, characterized in that: The target action is a throwing action, and when the action of the target limb is the target action, displaying a motion trajectory of the first virtual prop generated in a three-dimensional space based on the target action includes: When the action of the target limb is a throwing action, a parabolic motion trajectory of the first virtual prop generated in the three-dimensional space based on the throwing action is displayed.

8. The display method according to any one of claims 1 to 4, characterized in that: The detecting the movement of the target limb in the captured image includes: Acquiring motion characteristic data of the target limb in the shooting picture; the motion characteristic data includes motion speed and motion posture; The motion feature data is input into a preset motion detection neural network to detect the motion of the target limb in the captured image.

9. The display method according to any one of claims 1 to 4, characterized in that: The displaying of the motion trajectory of the first virtual prop generated based on the target action includes: Acquire current motion parameters of the target limb in the three-dimensional space; the current motion parameters include current speed, current position and current time; The current motion parameters are input into a preset motion equation to determine the motion trajectory, and the motion trajectory of the first virtual prop is displayed.

10. A display device for virtual props, characterized in that: The device comprises: a display unit, a processing unit, a detection unit and an updating unit; The display unit is used to display the shooting picture; The processing unit is configured to render a first virtual prop in a three-dimensional space corresponding to the shooting picture in response to detecting a target limb in the shooting picture; the first virtual prop follows the target limb; The detection unit is used to detect the movement of the target limb in the captured image; The display unit is further configured to display a motion trajectory of the first virtual prop generated in the three-dimensional space based on the target action when the action of the target limb is the target action; The updating unit is configured to update the display effect of the first virtual prop when the first virtual prop collides with a target object in the three-dimensional space; the target object is a preset plane, a preset position or a preset object; The detection unit is further used to detect the posture of the target limb in the captured image; The display unit is further configured to display the first virtual prop when the posture of the target limb is a preset posture; The updating unit is specifically configured to: replace the first virtual prop with a second virtual prop; Alternatively, updating the current posture of the first virtual prop to the target posture; Alternatively, after the current posture of the first virtual prop is updated to the target posture for a preset time, the first virtual prop is replaced by the second virtual prop.

11. An electronic device, characterized in that: include: A processor and a communication interface; the communication interface is coupled to the processor, and the processor is used to run a computer program or instruction to implement the display method as described in any one of claims 1-9.

12. A computer-readable storage medium, wherein instructions are stored in the computer-readable storage medium, characterized in that: When a computer executes the instruction, the computer executes the display method as described in any one of claims 1 to 9.

Images