Virtual object display method and device, equipment, readable storage medium and product

Abstract

The embodiment of the invention provides a virtual object display method and device, equipment, a readable storage medium and a product. The method comprises the steps that a special effect processing request triggered by a user is acquired; displaying at least one target image frame and a virtual object associated with the target special effect in a media content generation page; determining a first motion parameter of the virtual object in a first direction based on the at least one target image frame, and determining a second motion parameter of the virtual object in a second direction based on preset content associated with the virtual object; and driving the virtual object to move according to the first motion parameter and the second motion parameter through a preset dynamic component on a skeleton node corresponding to the virtual object. Therefore, the motion of the virtual object can be more fit with the at least one target image frame. Besides, the motion of the virtual object is controlled by combining the dynamic component and the skeletal animation information, so that the motion of the virtual object is more natural and more fits a real motion scene.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of image processing technology, and in particular, to a virtual object display method, device, equipment, readable storage medium and product. Background Art

[0002] When users perform video capture and video processing operations on terminal devices, in order to optimize the display effect of the video, users can select corresponding special effects content to add to the video according to actual needs. Among them, the special effects content may be associated with dynamic virtual objects.

[0003] However, current virtual objects generally move according to preset motion modes and motion trajectories. Therefore, the display effect of virtual objects is often relatively simple, resulting in the generated video quality being unable to meet the personalized needs of users. Summary of the invention

[0004] The embodiments of the present disclosure provide a virtual object display method, device, equipment, readable storage medium and product, which are used to solve the technical problem that the virtual object display effect corresponding to the current special effects is relatively single.

[0005] In a first aspect, an embodiment of the present disclosure provides a method for displaying a virtual object, including:

[0006] Acquire a special effect processing request triggered by a user, wherein the special effect processing request includes identification information of a target special effect;

[0007] Displaying at least one target image frame and a virtual object associated with the target special effect in a media content generation page;

[0008] Determine a first motion parameter of the virtual object in a first direction based on the at least one target image frame, and determine a second motion parameter of the virtual object in a second direction based on preset content associated with the virtual object, wherein the preset content includes skeletal animation information or preset parameters;

[0009] The virtual object is driven to move according to the first motion parameter and the second motion parameter through a dynamic component preset on a skeletal node corresponding to the virtual object.

[0010] In a second aspect, an embodiment of the present disclosure provides a virtual object display device, including:

[0011] An acquisition module, used to acquire a special effect processing request triggered by a user, wherein the special effect processing request includes identification information of a target special effect;

[0012] A display module, used for displaying at least one target image frame and a virtual object associated with the target special effect in a media content generation page;

[0013] a determination module, configured to determine a first motion parameter of the virtual object in a first direction based on the at least one target image frame, and to determine a second motion parameter of the virtual object in a second direction based on preset content associated with the virtual object, wherein the preset content includes skeletal animation information or preset parameters;

[0014] A driving module is used to drive the virtual object to move according to the first motion parameter and the second motion parameter through a dynamic component preset on a skeletal node corresponding to the virtual object.

[0015] In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a processor and a memory;

[0016] The memory stores computer-executable instructions;

[0017] The processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the virtual object display method as described in the first aspect and various possible designs of the first aspect.

[0018] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer execution instructions. When a processor executes the computer execution instructions, the virtual object display method described in the first aspect and various possible designs of the first aspect is implemented.

[0019] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the virtual object display method as described in the first aspect and various possible designs of the first aspect.

[0020] The virtual object display method, device, equipment, readable storage medium and product provided in this embodiment, after obtaining the special effect processing request triggered by the user, display at least one target image frame and a virtual object associated with the target special effect in the media content generation page, determine the motion parameters of the virtual object in different directions based on the preset content associated with at least one target image frame and the virtual object, and drive the virtual object to move according to the first motion parameter and the second motion parameter based on the dynamic component preset on the skeletal node corresponding to the virtual object. Thereby, the movement of the virtual object can be more closely matched with at least one target image frame. In addition, by controlling the movement of the virtual object in a combination of dynamic components and skeletal animation information, the movement of the virtual object can be made more natural and more closely matched with the real motion scene. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0022] Figure 1 A flowchart of a virtual object display method provided by an embodiment of the present disclosure;

[0023] Figure 2 A schematic diagram of a display interface provided in an embodiment of the present disclosure;

[0024] Figure 3 A flowchart of a virtual object display method provided by another embodiment of the present disclosure;

[0025] Figure 4 A schematic diagram of interface interaction provided by an embodiment of the present disclosure;

[0026] Figure 5 A flowchart of a virtual object display method provided by another embodiment of the present disclosure;

[0027] Figure 6 A schematic diagram of an interface interaction provided by yet another embodiment of the present disclosure;

[0028] Figure 7 A flowchart of a virtual object display method provided by another embodiment of the present disclosure;

[0029] Figure 8 A schematic diagram of the structure of a virtual object display device provided in an embodiment of the present disclosure;

[0030] Fig. 9 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0031] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0032] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0033] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0034] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0035] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0036] In order to solve the technical problem that the virtual object display effect corresponding to the current special effects is relatively single, the present disclosure provides a virtual object display method, device, equipment, readable storage medium and product.

[0037] It should be noted that the virtual object display method, device, equipment, readable storage medium and product provided by the present disclosure can be applied to any application scenario of special effects processing.

[0038] In the related art, some special effects content may be associated with a virtual object. In response to a user's triggering operation on the special effects content, the virtual object associated with the special effects content may be displayed on the display interface. The virtual object generally corresponds to preset motion parameters, which include but are not limited to parameters such as motion trajectory, motion speed, and motion acceleration. The virtual object may move according to the preset motion parameters. The display effect is often relatively simple, and it is impossible to interact with the user in real time.

[0039] In order to improve the matching degree between the virtual object corresponding to the special effect content and the currently acquired image frame and enrich the display effect of the virtual object, a first motion parameter of the virtual object in a first direction can be determined based on at least one currently acquired image frame, and a second motion parameter of the virtual object in a second direction can be determined based on the skeletal animation information associated with the virtual object. The motion of the virtual object is controlled according to the first motion parameter and the second motion parameter through the dynamic component associated with the virtual object.

[0040] Figure 1 A flowchart of a virtual object display method provided by an embodiment of the present disclosure is shown in FIG. Figure 1 As shown, the method includes:

[0041] Step 101: Obtain a special effect processing request triggered by a user, wherein the special effect processing request includes identification information of a target special effect.

[0042] The execution subject of this embodiment is a virtual object display device, which can be coupled to a terminal device, so that based on the target special effect selected by the user on the terminal device, the virtual object corresponding to the target special effect can be driven to move by combining skeletal animation information with a dynamic component. Alternatively, the virtual object display device can also be coupled to a server, which can be connected to a terminal device for communication. Thus, it is possible to obtain a virtual object display request sent by the terminal device based on the user's trigger operation on the target special effect, and based on the virtual object display request, the virtual object corresponding to the target special effect can be driven to move by combining skeletal animation information with a dynamic component, and the terminal device can be controlled to display the moving virtual object.

[0043] In this embodiment, the user can generate video content on the terminal device, and the video content may include at least one target image frame. The video content may be collected by the user in real time through the terminal device, or uploaded in a preset storage path, and the present disclosure does not limit this.

[0044] In order to optimize the display effect of the video content, the user can also select a target special effect according to actual needs, and process at least one target image frame corresponding to the video content based on the target special effect. Accordingly, the virtual object display device can obtain a special effect processing request triggered by the user, wherein the special effect processing request includes identification information of the target special effect.

[0045] Step 102: Display at least one target image frame and a virtual object associated with the target special effect in a media content generation page.

[0046] In this embodiment, in order to optimize the display effect of the video content, the target special effect can be associated with a virtual object. The virtual object can be a virtual three-dimensional object, or a virtual two-dimensional image or other object. After obtaining the special effect processing request, the virtual object matching the target special effect can be determined according to the identification information of the target special effect. At least one target image frame and the virtual object associated with the target special effect are displayed in the media content generation page.

[0047] Optionally, the virtual object may be a single object, for example, the virtual object may be a virtual headdress, and the number of virtual headdresses may be one. Alternatively, the virtual object may be an object composed of multiple objects, for example, the virtual object may be multiple virtual balloons.

[0048] Taking practical application as an example, the virtual object corresponding to the target special effect may be a plurality of virtual balloons, which may move around the human body region in the target image frame.

[0049] Step 103: determine a first motion parameter of the virtual object in a first direction based on the at least one target image frame, and determine a second motion parameter of the virtual object in a second direction based on preset content associated with the virtual object, wherein the preset content includes skeletal animation information or preset parameters.

[0050] In this embodiment, in order to make the movement of the virtual object more consistent with at least one target image frame, a first motion parameter of the virtual object in the first direction can be determined based on at least one target image frame. Taking a practical application as an example, the target image frame can include a target object, which can be a user's head. The virtual object can be a virtual balloon. When the user's head rotates to the left, the virtual balloon can be controlled to rotate to the left accordingly.

[0051] Furthermore, in order to enrich the movement mode of the virtual object, skeletal animation information or preset parameters can be set for the virtual object in advance. Therefore, the second movement parameter of the virtual object in the second direction is determined based on the preset content associated with the virtual object. By respectively determining the first movement parameter and the second movement parameter, the virtual object can move in different movement directions.

[0052] In the above example, the skeleton animation information can be set to allow the virtual balloon to move upward at a preset speed. Based on the first motion parameter and the second motion parameter, the virtual balloon can be controlled to rotate left and right as the human head rotates during the upward movement.

[0053] Step 104: drive the virtual object to move according to the first motion parameter and the second motion parameter through a dynamic component preset on a skeletal node corresponding to the virtual object.

[0054] In this embodiment, the virtual object may be associated with a dynamic component, so that after respectively determining the first motion parameter and the second motion parameter, the dynamic component may drive the virtual object to move based on the first motion parameter and the second motion parameter.

[0055] Figure 2 A schematic diagram of a display interface provided by an embodiment of the present disclosure, such as Figure 2As shown, a target image frame 22 and a virtual object 23 associated with a target special effect may be displayed in a media content generation page 21, wherein the virtual object 23 may be a plurality of virtual balloons. The virtual object 23 may move in a first direction 24 and a second direction 25 based on the driving of a dynamic component.

[0056] The virtual object display method provided in this embodiment, after obtaining the special effect processing request triggered by the user, displays at least one target image frame and a virtual object associated with the target special effect in the media content generation page, determines the motion parameters of the virtual object in different directions based on the preset content associated with at least one target image frame and the virtual object, and drives the virtual object to move according to the first motion parameter and the second motion parameter based on the dynamic component preset on the skeletal node corresponding to the virtual object. Thereby, the movement of the virtual object can be more closely matched with at least one target image frame. In addition, by controlling the movement of the virtual object in a manner combining the dynamic component and the skeletal animation information, the movement of the virtual object can be made more natural and more closely matched with the real motion scene.

[0057] Figure 3 A flowchart of a virtual object display method provided by another embodiment of the present disclosure is shown as follows: Figure 3 As shown, step 103 includes:

[0058] Step 301: Track the position information of the target object in the target image frame.

[0059] Step 302: Determine the position movement information of the target object in two target image frames based on the position information of the target object in the current target image frame and the position information of the target object in the previous target image frame.

[0060] Step 303: Determine a first motion parameter in the first direction according to the position movement information.

[0061] In this embodiment, the target image frame may include a target object, which includes but is not limited to a user's head, a user's limbs, a user's gesture, a specific object, and the like.

[0062] As an implementable method, the user can determine the current target object according to actual needs. For example, the target image frame can include the user's head, the user's limbs, the user's gestures, and a specific object, and the user can specify the user's head as the current target object.

[0063] In order to make the movement of the virtual object more consistent with at least one target image frame, a first motion parameter of the virtual object in a first direction may be determined based on at least one target image frame, so that the dynamics component drives the virtual object according to the first motion parameter.

[0064] Optionally, the position information of the target object in the target image frame may be tracked. Different tracking methods may be used to track different target objects, and the present disclosure does not limit this. For example, when the target object is a user's head, a preset head tracking model may be used to track the target object.

[0065] Further, based on the position information of the target object in the current target image frame and the position information of the target object in the previous target image frame, the position movement information of the target object in the two target image frames is determined, and the first motion parameter in the first direction is determined according to the position movement information.

[0066] For example, if it is determined based on the current target image frame and the previous target image frame that the target object rotates 20 degrees to the left, then it can be determined that the first motion parameter may be a rotation of 20 degrees to the left.

[0067] Figure 4 A schematic diagram of the interface interaction provided by the embodiment of the present disclosure, such as Figure 4 As shown, a target image frame 42 and a virtual object 43 associated with a target special effect may be displayed in a media content generation page 41. The target image frame 42 may include a target object 44. For example, the target object 44 may be an arm of a user, and the virtual object 43 may be a plurality of virtual balloons. In response to a movement operation of the target object 44, the virtual object 43 may move following the movement of the target object 44.

[0068] The virtual object display method provided in this embodiment tracks the position information of the target object in the target image frame, and controls the virtual object to move according to the movement information based on the movement information of the target object in the current target image frame and the target object in the previous target image frame. Thus, the movement of the virtual object can be more closely matched to the movement of the target object in at least one target image frame, enriching the movement mode of the virtual object and enriching the display effect in the media content generation page.

[0069] Figure 5 A flowchart of a virtual object display method provided by another embodiment of the present disclosure, based on any of the above embodiments, the preset content associated with the virtual object includes preset skeletal animation information, wherein the skeletal animation information includes the display position of the skeletal node corresponding to the virtual object in each frame of the target image. Step 103 includes:

[0070] Step 501: Execute a preset number of frames of skeletal animation information.

[0071] Step 502: Determine a second motion parameter of the virtual object in a second direction based on the skeletal animation information of the preset number of frames that have been executed.

[0072] In this embodiment, the preset content associated with the virtual object includes preset skeletal animation information, wherein the skeletal animation information includes the display position of the skeletal node corresponding to the virtual object in each frame of the target image, so that the virtual object can be controlled to move based on the skeletal animation information.

[0073] In actual applications, if the virtual object is controlled to move in the first direction directly based on the skeletal animation information, and the virtual object is controlled to move in the second direction based on the dynamic component through the movement information of the target object, when the skeletal animation information starts / stops, the virtual object is only affected by the dynamics, and there may be a momentary displacement, resulting in poor display effect.

[0074] In order to solve the problem of virtual object teleportation caused by directly combining skeletal animation information with dynamic components, a preset number of frames of skeletal animation information can be pre-executed. The second motion parameter of the virtual object in the second direction is determined based on the executed preset number of frames of skeletal animation information. Thus, the dynamic component can drive the virtual object based on the second motion parameter and the first motion parameter.

[0075] The virtual object display method provided in this embodiment, by preferentially executing the skeletal animation information, and then determining the second motion parameter of the virtual object in the second direction based on the skeletal animation information, so that the dynamic component can drive the virtual object to move based on the first motion parameter determined according to the target object movement information and the second motion parameter. In addition, when the virtual object is controlled in the above manner, the dynamic component can drive the virtual line in combination with the first motion parameter and the second motion parameter generated based on the skeletal animation information, avoiding the problem of virtual object teleportation caused by directly combining the skeletal animation information with the dynamic component.

[0076] Further, based on any of the above embodiments, the virtual object includes a root node and at least one child node, and the root node is a parent node or above of the at least one child node.

[0077] Before step 501, the method further includes:

[0078] Add the skeletal animation information to the root node.

[0079] A preset dynamics component is added to the at least one child node.

[0080] In this embodiment, the virtual object may be composed of multiple nodes. In order to control the movement of the virtual object, the virtual object may include a root node and at least one child node. The root node may be a node at or above the parent of the child node. For example, the parent node of the child node may be the root node, or the previous node of the parent node of the child node may be the root node.

[0081] Taking practical application as an example, the virtual object may be a plurality of virtual balloons. The virtual object may include a root node and at least one child node, each of which may be a virtual balloon. The root node is connected to each child node.

[0082] By adding skeletal animation information to the root node of the parent and above of the child node, and adding a dynamic component to the child node, it is possible to ensure that the skeletal animation information can be run before the dynamic component, thereby providing the child node with a second motion parameter based on the skeletal animation information.

[0083] In order to realize the combination of skeletal animation information and dynamic components, skeletal animation information can be added to the root node, and a dynamic component can be added to at least one child node. Optionally, the child node can correspond to an independent bone, and specifically, a dynamic component can be added to the independent bone corresponding to the child node.

[0084] The skeletal animation information may include the display position of the root node in each frame. Therefore, after the skeletal animation information is pre-executed, the root node can move in the second direction according to the skeletal animation. Since the root node is connected to each child node, the root node can give each child node power in the second direction. Therefore, the dynamics component installed on each child node can drive the virtual object in combination with the first motion parameter and the second motion parameter determined based on the skeletal animation information.

[0085] Optionally, each child node may also be composed of a complete tree structure. The tree structure may include a first root node and at least one first child node. A skeletal animation may be added to the first root node, and a dynamic component may be added to at least one first child node. Thus, a single child node may be driven in a personalized manner.

[0086] Taking practical application as an example, the child node corresponding to the virtual object can be a transparent box, and the transparent box can include multiple decorative contents. Among them, the transparent box can be the first root node, and the decorative content in the transparent box can be the first child node. Skeletal animation information can be added to the transparent box, and the skeletal animation information defines the display position of the transparent box in each frame. The transparent box can be controlled to move upward based on the skeletal animation information. In the process of the transparent box rising, multiple decorative contents can be given rising power. In addition, as the user's head rotates in the target image frame, the decorative content can be given horizontal rotation power. Therefore, the dynamic component set on the decorative content can simultaneously control the decorative content to move in the transparent box according to the rising power and the horizontal rotation power.

[0087] The virtual object display method provided in this embodiment adds skeletal animation information to the root node of the virtual object and adds dynamic components to the independent bones of each node in the virtual object, thereby realizing the combination of skeletal animation information and dynamic components, so that the virtual object moves accordingly with the movement of the target object on the basis of moving according to the skeletal animation information.

[0088] Further, based on any of the above embodiments, step 502 includes:

[0089] A second motion parameter of the root node in the second direction is determined based on the skeletal animation information of the preset number of frames that have been executed.

[0090] The second motion parameter of the root node in the second direction is determined as the second motion parameter of at least one child node in the virtual object in the second direction.

[0091] In this embodiment, since the root node is associated with preset skeletal animation information, the root node can move when the skeletal animation information is executed. The second motion parameter of the root node in the second direction can be determined based on the skeletal animation information of the preset number of frames that have been executed. The motion trend of the root node can be determined based on the position of the root node in the first frame and the position of the root node in the second frame, and the second motion parameter can be determined based on the motion trend.

[0092] Furthermore, since the virtual object includes a root node and at least one child node, the second motion parameter of the root node in the second direction can be determined as the second motion parameter of each node in the second motion parameter of the virtual object in the second direction, so that the root node can move synchronously with the at least one child node.

[0093] Figure 6 A schematic diagram of an interface interaction provided by another embodiment of the present disclosure is shown in FIG. Figure 6As shown, a target image frame 62 and a virtual object 63 associated with a target special effect may be displayed in a media content generation page 61. The target image frame 62 may include a target object 64. For example, the target object 64 may be an arm of a user, and the virtual object 63 may be a plurality of virtual balloons. In response to the movement operation of the target object 64 and the second motion parameter in the second direction determined based on the skeletal animation information, the virtual object 63 may perform an upward motion while following the movement of the target object 64.

[0094] The virtual object display method provided in this embodiment can accurately determine the second motion parameter of the virtual object in the second direction based on the skeletal animation information by preferentially executing the skeletal animation information. Therefore, the dynamics component can drive the virtual alignment in combination with the first motion parameter and the second motion parameter generated based on the skeletal animation information, thus avoiding the problem of virtual object teleportation caused by directly combining the skeletal animation information with the dynamics component.

[0095] Optionally, based on any of the above embodiments, step 104 includes:

[0096] The child node is driven to move according to the first motion parameter and the second motion parameter according to the dynamic component preset on the skeleton node corresponding to the child node.

[0097] In this embodiment, at least one sub-node may be associated with a dynamic component. Therefore, after determining the first motion parameter and the second motion parameter, the dynamic component associated with each sub-node may perform a node driving operation based on the first motion parameter and the second motion parameter to achieve driving of the virtual object.

[0098] The virtual object display method provided in this embodiment drives each sub-node to move according to the first motion parameter and the second motion parameter by using the dynamic component preset on the skeletal node corresponding to each sub-node, so that the dynamic component can jointly drive the virtual object to move based on the first motion parameter determined according to the target object movement information and the second motion parameter.

[0099] Optionally, based on any of the above embodiments, the preset content associated with the virtual object includes preset parameters.

[0100] Step 103 includes:

[0101] The preset parameter is determined as a first motion parameter of the virtual object in a first direction.

[0102] In this embodiment, the preset content associated with the virtual object includes preset parameters. In order to make the movement of the virtual object more in line with the personalized needs of the user, the user can set preset parameters for the virtual object in advance, wherein the preset parameters include motion parameters corresponding to the virtual object, and the motion parameters include but are not limited to the preset motion speed, motion acceleration, motion direction, motion cycle and other contents of the virtual object.

[0103] Therefore, the preset parameter can be directly determined as the first motion parameter of the virtual object in the first direction, so that the dynamics component can realize the driving operation of the virtual object based on the first motion parameter.

[0104] The virtual object display method provided in this embodiment can accurately control the movement of the virtual object in the first direction based on the dynamic component by presetting the preset parameters.

[0105] Figure 7 A flowchart of a virtual object display method provided by another embodiment of the present disclosure is provided. Based on any of the above embodiments, the method further includes:

[0106] Step 701: In response to the setting operation triggered by the user, obtain the random motion parameters generated by the user, wherein the random motion parameters include one or more of an action coordinate axis, a gravity parameter range, and a triggering timing.

[0107] Step 104 includes:

[0108] Step 702: Drive the virtual object to move according to the first motion parameter, the second motion parameter and the random motion parameter through the dynamic component preset on the skeleton node corresponding to the virtual object.

[0109] In this embodiment, in order to make the motion state of the virtual object more realistic, a random motion parameter may be added to the virtual object so that the virtual object performs random motion within a small range based on the random motion parameter.

[0110] Optionally, the user can set the random motion parameters according to actual needs. In response to the setting operation triggered by the user, the random motion parameters generated by the user are obtained, wherein the random motion parameters include one or more of the action coordinate axis, the gravity parameter range, and the triggering time. For example, the action coordinate axis can be the X-axis and the Z-axis. The gravity parameter range can be (-0.05-0.05). The triggering time can be triggered every N frames. In addition, in order to further improve the realism of the virtual object movement, the damping parameters, elastic parameters, rigidity parameters, slowness parameters, gravity parameters, etc. can also be set in the kinematic component. The user can set one or more of the above parameters according to actual needs, and the present disclosure does not limit this.

[0111] Furthermore, the virtual object can be driven to move according to the first motion parameter, the second motion parameter and the random motion parameter by the dynamic component preset on the skeletal node corresponding to the virtual object. Thus, the virtual object can move in the first direction and the second direction, and can also shake randomly during the movement.

[0112] The virtual object display method provided in this embodiment obtains the random motion parameters generated by the user in response to the setting operation triggered by the user, so that the dynamic component can drive the virtual object to move in combination with the first motion parameter, the second motion parameter and the random motion parameter, so that when the virtual object moves according to the skeletal animation information, it can move accordingly with the movement of the target object. In addition, the virtual object can also perform random motion based on the random motion parameter to make the movement of the virtual object more realistic.

[0113] Figure 8 A schematic diagram of the structure of a virtual object display device provided in an embodiment of the present disclosure, such as Figure 8 As shown, the device includes: an acquisition module 81, a display module 82, a determination module 83 and a driving module 84. The acquisition module 81 is used to obtain a special effect processing request triggered by a user, wherein the special effect processing request includes identification information of a target special effect. The display module 82 is used to display at least one target image frame and a virtual object associated with the target special effect in a media content generation page. The determination module 83 is used to determine a first motion parameter of the virtual object in a first direction based on the at least one target image frame, and to determine a second motion parameter of the virtual object in a second direction based on preset content associated with the virtual object, wherein the preset content includes skeletal animation information or preset parameters. The driving module 84 is used to drive the virtual object to move according to the first motion parameter and the second motion parameter through a dynamic component preset on a skeletal node corresponding to the virtual object.

[0114] Further, based on any of the above embodiments, the determination module is used to: perform a tracking operation on the position information of the target object in the target image frame. Determine the position movement information of the target object in the two target image frames based on the position information of the target object in the current target image frame and the position information of the target object in the previous target image frame. Determine the first motion parameter in the first direction according to the position movement information.

[0115] Further, based on any of the above embodiments, the preset content associated with the virtual object includes preset skeletal animation information, wherein the skeletal animation information includes the display position of the skeletal node corresponding to the virtual object in each frame of the target image. The determination module is used to: execute the skeletal animation information for a preset number of frames. Determine the second motion parameter of the virtual object in the second direction based on the skeletal animation information for the preset number of frames that have been executed.

[0116] Further, based on any of the above embodiments, the virtual object includes a root node and at least one child node, and the root node is a parent node or above of the at least one child node. The determination module is further used to: add the skeletal animation information to the root node. Add a preset dynamic component to the at least one child node.

[0117] Further, based on any of the above embodiments, the determination module is used to: determine the second motion parameter of the root node in the second direction based on the skeletal animation information of the preset number of frames that have been executed, and determine the second motion parameter of the root node in the second direction as the second motion parameter of at least one child node in the virtual object in the second direction.

[0118] Further, based on any of the above embodiments, the driving module is used to: drive the sub-node to move according to the first motion parameter and the second motion parameter according to a dynamic component preset on the skeletal node corresponding to the sub-node.

[0119] Further, based on any of the above embodiments, the preset content associated with the virtual object includes a preset parameter. The determination module is used to: determine the preset parameter as a first motion parameter of the virtual object in the first direction.

[0120] Further, based on any of the above embodiments, the device further includes: an acquisition module, for acquiring the random motion parameters generated by the user in response to the setting operation triggered by the user, wherein the random motion parameters include one or more of the action coordinate axis, gravity parameter range, and trigger timing. The driving module is used to drive the virtual object to move according to the first motion parameter, the second motion parameter, and the random motion parameter through the dynamic component preset on the skeletal node corresponding to the virtual object.

[0121] The device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effect are similar, and this embodiment will not be repeated here.

[0122] In order to implement the above embodiment, the present disclosure also provides an electronic device, including: a processor and a memory;

[0123] The memory stores computer-executable instructions;

[0124] The processor executes the computer-executable instructions stored in the memory, so that the processor executes the virtual object display method as described in any of the above embodiments.

[0125] Fig. 9 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure, such as Fig. 9 As shown, the electronic device 900 may be a terminal device or a server. The terminal device may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (Portable Media Players, PMPs), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig. 9 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0126] like Fig. 9As shown, the electronic device 900 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 to a random access memory (RAM) 903. In the RAM 903, various programs and data required for the operation of the electronic device 900 are also stored. The processing device 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0127] Typically, the following devices may be connected to the I / O interface 905: input devices 906 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 908 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 909. The communication device 909 may allow the electronic device 900 to communicate with other devices wirelessly or by wire to exchange data. Although Fig. 9 The electronic device 900 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0128] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 909, or installed from a storage device 908, or installed from a ROM 902. When the computer program is executed by the processing device 901, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0129] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0130] In order to implement the above embodiments, the embodiments of the present disclosure further provide a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the virtual object display method as described in any of the above embodiments is implemented.

[0131] In order to implement the above embodiments, the embodiments of the present disclosure further provide a computer program product, including a computer program, which implements the virtual object display method as described in any of the above embodiments when executed by a processor.

[0132] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0133] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0134] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0135] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0136] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".

[0137] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0138] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0139] In a first aspect, according to one or more embodiments of the present disclosure, a method for displaying a virtual object is provided, comprising:

[0140] Acquire a special effect processing request triggered by a user, wherein the special effect processing request includes identification information of a target special effect;

[0141] Displaying at least one target image frame and a virtual object associated with the target special effect in a media content generation page;

[0142] Determine a first motion parameter of the virtual object in a first direction based on the at least one target image frame, and determine a second motion parameter of the virtual object in a second direction based on preset content associated with the virtual object, wherein the preset content includes skeletal animation information or preset parameters;

[0143] The virtual object is driven to move according to the first motion parameter and the second motion parameter through a dynamic component preset on a skeletal node corresponding to the virtual object.

[0144] According to one or more embodiments of the present disclosure, determining a first motion parameter of the virtual object in a first direction based on the at least one target image frame includes:

[0145] Performing a tracking operation on the position information of the target object in the target image frame;

[0146] Determine the position movement information of the target object in two target image frames based on the position information of the target object in the current target image frame and the position information of the target object in the previous target image frame;

[0147] Determine a first motion parameter in the first direction according to the position movement information.

[0148] According to one or more embodiments of the present disclosure, the preset content associated with the virtual object includes preset skeletal animation information, wherein the skeletal animation information includes the display position of the skeletal node corresponding to the virtual object in each frame of the target image;

[0149] The determining, based on the preset content associated with the virtual object, a second motion parameter of the virtual object in the second direction comprises:

[0150] Execute a preset number of frames of the skeletal animation information;

[0151] A second motion parameter of the virtual object in the second direction is determined based on the skeletal animation information of the preset number of frames that have been executed.

[0152] According to one or more embodiments of the present disclosure, the virtual object includes a root node and at least one child node, and the root node is a parent node or above of the at least one child node;

[0153] Before executing the preset number of frames of the skeletal animation information, the method further includes:

[0154] Adding the skeletal animation information to the root node;

[0155] A preset dynamics component is added to the at least one child node.

[0156] According to one or more embodiments of the present disclosure, determining the second motion parameter of the virtual object in the second direction based on the skeletal animation information of the preset number of frames that have been executed includes:

[0157] Determine a second motion parameter of the root node in a second direction based on the skeletal animation information of the preset number of frames that have been executed;

[0158] The second motion parameter of the root node in the second direction is determined as the second motion parameter of at least one child node in the virtual object in the second direction.

[0159] According to one or more embodiments of the present disclosure, the method of driving the virtual object to move according to the first motion parameter and the second motion parameter by using a dynamic component preset on a skeletal node corresponding to the virtual object includes:

[0160] The child node is driven to move according to the first motion parameter and the second motion parameter according to the dynamic component preset on the skeleton node corresponding to the child node.

[0161] According to one or more embodiments of the present disclosure, the preset content associated with the virtual object includes preset parameters;

[0162] Determining a second motion parameter of the virtual object in a second direction based on preset content associated with the virtual object includes:

[0163] The preset parameter is determined as a first motion parameter of the virtual object in a first direction.

[0164] According to one or more embodiments of the present disclosure, the method further includes:

[0165] In response to the setting operation triggered by the user, obtaining the random motion parameters generated by the user, wherein the random motion parameters include one or more of an action coordinate axis, a gravity parameter range, and a triggering timing;

[0166] The method of driving the virtual object to move according to the first motion parameter and the second motion parameter by using a dynamic component preset on a skeletal node corresponding to the virtual object includes:

[0167] The virtual object is driven to move according to the first motion parameter, the second motion parameter and the random motion parameter through a dynamic component preset on a skeletal node corresponding to the virtual object.

[0168] In a second aspect, according to one or more embodiments of the present disclosure, there is provided a virtual object display device, comprising:

[0169] An acquisition module, used to acquire a special effect processing request triggered by a user, wherein the special effect processing request includes identification information of a target special effect;

[0170] A display module, used for displaying at least one target image frame and a virtual object associated with the target special effect in a media content generation page;

[0171] a determination module, configured to determine a first motion parameter of the virtual object in a first direction based on the at least one target image frame, and to determine a second motion parameter of the virtual object in a second direction based on preset content associated with the virtual object, wherein the preset content includes skeletal animation information or preset parameters;

[0172] A driving module is used to drive the virtual object to move according to the first motion parameter and the second motion parameter through a dynamic component preset on a skeletal node corresponding to the virtual object.

[0173] According to one or more embodiments of the present disclosure, the determining module is used to:

[0174] Performing a tracking operation on the position information of the target object in the target image frame;

[0175] Determine the position movement information of the target object in two target image frames based on the position information of the target object in the current target image frame and the position information of the target object in the previous target image frame;

[0176] Determine a first motion parameter in the first direction according to the position movement information.

[0177] According to one or more embodiments of the present disclosure, the preset content associated with the virtual object includes preset skeletal animation information, wherein the skeletal animation information includes the display position of the skeletal node corresponding to the virtual object in each frame of the target image;

[0178] The determining module is used to:

[0179] Execute a preset number of frames of the skeletal animation information;

[0180] A second motion parameter of the virtual object in the second direction is determined based on the skeletal animation information of the preset number of frames that have been executed.

[0181] According to one or more embodiments of the present disclosure, the virtual object includes a root node and at least one child node, and the root node is a parent node or above of the at least one child node;

[0182] The determining module is further used for:

[0183] Adding the skeletal animation information to the root node;

[0184] A preset dynamics component is added to the at least one child node.

[0185] According to one or more embodiments of the present disclosure, the determining module is used to:

[0186] Determine a second motion parameter of the root node in a second direction based on the skeletal animation information of the preset number of frames that have been executed;

[0187] The second motion parameter of the root node in the second direction is determined as the second motion parameter of at least one child node in the virtual object in the second direction.

[0188] According to one or more embodiments of the present disclosure, the driving module is used to:

[0189] The child node is driven to move according to the first motion parameter and the second motion parameter according to the dynamic component preset on the skeleton node corresponding to the child node.

[0190] According to one or more embodiments of the present disclosure, the preset content associated with the virtual object includes preset parameters;

[0191] The determining module is used to:

[0192] The preset parameter is determined as a first motion parameter of the virtual object in a first direction.

[0193] According to one or more embodiments of the present disclosure, the device further includes:

[0194] an acquisition module, configured to acquire, in response to a setting operation triggered by the user, random motion parameters generated by the user, wherein the random motion parameters include one or more of an action coordinate axis, a gravity parameter range, and a triggering timing;

[0195] The driving module is used for:

[0196] The virtual object is driven to move according to the first motion parameter, the second motion parameter and the random motion parameter through a dynamic component preset on a skeletal node corresponding to the virtual object.

[0197] In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: at least one processor and a memory;

[0198] The memory stores computer-executable instructions;

[0199] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the virtual object display method as described in the first aspect and various possible designs of the first aspect.

[0200] In a fourth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer execution instructions. When a processor executes the computer execution instructions, the virtual object display method described in the first aspect and various possible designs of the first aspect is implemented.

[0201] In a fifth aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, including a computer program, which, when executed by a processor, implements the virtual object display method described in the first aspect and various possible designs of the first aspect.

[0202] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0203] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0204] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A virtual object display method, characterized in that: include: Acquire a special effect processing request triggered by a user, wherein the special effect processing request includes identification information of a target special effect; Displaying at least one target image frame and a virtual object associated with the target special effect in a media content generation page; Determine a first motion parameter of the virtual object in a first direction based on the at least one target image frame, and determine a second motion parameter of the virtual object in a second direction based on preset content associated with the virtual object, wherein the preset content includes skeletal animation information or preset parameters; The virtual object is driven to move according to the first motion parameter and the second motion parameter through a dynamic component preset on a skeletal node corresponding to the virtual object.

2. The method according to claim 1, characterized in that The determining, based on the at least one target image frame, a first motion parameter of the virtual object in the first direction comprises: Performing a tracking operation on the position information of the target object in the target image frame; Determine the position movement information of the target object in two target image frames based on the position information of the target object in the current target image frame and the position information of the target object in the previous target image frame; Determine a first motion parameter in the first direction according to the position movement information.

3. The method according to claim 1, characterized in that The preset content associated with the virtual object includes preset skeletal animation information, wherein the skeletal animation information includes a display position of the virtual object in each frame of the target image; The determining, based on the preset content associated with the virtual object, a second motion parameter of the virtual object in the second direction comprises: Execute a preset number of frames of the skeletal animation information; A second motion parameter of the virtual object in the second direction is determined based on the skeletal animation information of the preset number of frames that have been executed.

4. The method according to claim 3, characterized in that The virtual object includes a root node and at least one child node, and the root node is a parent node or above of the at least one child node; Before executing the preset number of frames of the skeletal animation information, the method further includes: Adding the skeletal animation information to the root node; A preset dynamics component is added to the at least one child node.

5. The method according to claim 4, characterized in that The determining the second motion parameter of the virtual object in the second direction based on the skeletal animation information of the preset number of frames that have been executed includes: Determine a second motion parameter of the root node in a second direction based on the skeletal animation information of the preset number of frames that have been executed; The second motion parameter of the root node in the second direction is determined as the second motion parameter of at least one child node in the virtual object in the second direction.

6. The method according to claim 4, characterized in that The method of driving the virtual object to move according to the first motion parameter and the second motion parameter by using a dynamic component preset on a skeletal node corresponding to the virtual object includes: The child node is driven to move according to the first motion parameter and the second motion parameter according to the dynamic component preset on the skeleton node corresponding to the child node.

7. The method according to claim 1, characterized in that The preset content associated with the virtual object includes preset parameters; The determining, based on the preset content associated with the virtual object, a second motion parameter of the virtual object in the second direction comprises: The preset parameter is determined as a first motion parameter of the virtual object in a first direction.

8. The method according to any one of claims 1 to 7, characterized in that: The method further comprises: In response to the setting operation triggered by the user, obtaining the random motion parameters generated by the user, wherein the random motion parameters include one or more of an action coordinate axis, a gravity parameter range, and a triggering timing; The method of driving the virtual object to move according to the first motion parameter and the second motion parameter by using a dynamic component preset on a skeletal node corresponding to the virtual object includes: The virtual object is driven to move according to the first motion parameter, the second motion parameter and the random motion parameter through a dynamic component preset on a skeletal node corresponding to the virtual object.

9. A virtual object display device, characterized in that: include: An acquisition module, used to acquire a special effect processing request triggered by a user, wherein the special effect processing request includes identification information of a target special effect; A display module, used for displaying at least one target image frame and a virtual object associated with the target special effect in a media content generation page; a determination module, configured to determine a first motion parameter of the virtual object in a first direction based on the at least one target image frame, and to determine a second motion parameter of the virtual object in a second direction based on preset content associated with the virtual object, wherein the preset content includes skeletal animation information or preset parameters; A driving module is used to drive the virtual object to move according to the first motion parameter and the second motion parameter through a dynamic component preset on a skeletal node corresponding to the virtual object.

10. An electronic device, characterized in that: include: Processor and memory; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor executes the virtual object display method according to any one of claims 1 to 9.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the processor executes the computer-executable instructions, the virtual object display method according to any one of claims 1 to 9 is implemented.

12. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the method for displaying a virtual object as claimed in any one of claims 1 to 9 is implemented.

Images