Interaction control method and apparatus, electronic device, and storage medium

Abstract

Embodiments of the present disclosure provide an interaction control method and apparatus, an electronic device, and a storage medium. A virtual object moving along a first spatial path is displayed on multimedia data displayed in an interaction interface, the virtual object being located in a virtual three-dimensional space generated on the basis of the multimedia data, and the first spatial path being a motion path of the object in the virtual three-dimensional space; when the virtual object collides with a target object in the multimedia data, a second motion state of the virtual object is obtained on the basis of the spatial collision position of the virtual object and the target object; and, on the basis of the second motion state of the virtual object, the virtual object is controlled to move along a second spatial path in the virtual three-dimensional space. By means of computing the second motion state of the virtual object when the virtual object collides with the target object in the multimedia data, the virtual object is controlled to move along the second spatial path in the virtual three-dimensional space, thereby implementing complex motion of the virtual object in stereoscopic space and improving the human-computer interaction effect.

Description

Interactive control method, device, electronic device and storage medium

[0001] This application claims priority to Chinese Patent Application No. 202311569289.4 filed on November 22, 2023, and the contents of the above-mentioned Chinese patent application disclosure are hereby incorporated by reference in their entirety as a part of this application. Technical Field

[0002] Embodiments of the present disclosure relate to an interactive control method, device, electronic device, and storage medium. Background Art

[0003] Currently, with the advancement of display technology and device performance, the ways of human-computer interaction are becoming more and more diverse. In related technologies, the user's image information can be collected to capture the user's body movements as control instructions, thereby enabling the user to interactively control the virtual objects displayed in the terminal device.

[0004] However, the solutions in the prior art can only achieve simple control of virtual objects on the screen, and cannot control the virtual objects to achieve complex movements, which reduces the authenticity of the virtual objects and affects the human-computer interaction effect. Summary of the Invention

[0005] The embodiments of the present disclosure provide an interactive control method, device, electronic device, and storage medium to overcome the problem of being unable to control virtual objects to achieve complex movements.

[0006] In a first aspect, an embodiment of the present disclosure provides an interactive control method, including:

[0007] A virtual object moving along a first spatial trajectory is displayed on the multimedia data displayed in the interactive interface, wherein the virtual object is located in a virtual three-dimensional space generated based on the multimedia data, and the first spatial trajectory is the object movement trajectory in the virtual three-dimensional space; when the virtual object collides with a target object in the multimedia data, a second motion state of the virtual object is obtained based on the spatial collision position of the virtual object and the target object; and based on the second motion state of the virtual object, the virtual object is controlled to move along the second spatial trajectory in the virtual three-dimensional space.

[0008] In a second aspect, an embodiment of the present disclosure provides an interactive control device, including:

[0009] a display module configured to display a virtual object moving along a first spatial trajectory on the multimedia data displayed in the interactive interface, wherein the virtual object is located in a virtual three-dimensional space generated based on the multimedia data, and the first spatial trajectory is a motion trajectory of the object in the virtual three-dimensional space;

[0010] a processing module, configured to obtain a second motion state of the virtual object according to a spatial collision position between the virtual object and the target object when the virtual object collides with the target object in the multimedia data;

[0011] The control module is configured to control the virtual object to move along a second spatial trajectory in the virtual three-dimensional space according to the second motion state of the virtual object.

[0012] In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a processor and a memory;

[0013] The memory stores computer-executable instructions;

[0014] The processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the interactive control method described in the first aspect and various possible designs of the first aspect.

[0015] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the interactive control method described in the first aspect and various possible designs of the first aspect is implemented.

[0016] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the interactive control method described in the first aspect and various possible designs of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0018] FIG1 is a diagram of an application scenario of the interactive control method provided by an embodiment of the present disclosure;

[0019] FIG2 is a flow chart of an interactive control method according to an embodiment of the present disclosure;

[0020] FIG3 is a schematic diagram of a virtual three-dimensional space provided by an embodiment of the present disclosure;

[0021] FIG4 is a flowchart of a specific implementation of step S101 in the embodiment shown in FIG2 ;

[0022] FIG5 is a flowchart of a specific implementation method of step S1012 in the embodiment shown in FIG4 ;

[0023] FIG6 is a flowchart of specific implementation steps of step S1012A in the embodiment shown in FIG5 ;

[0024] FIG7 is a schematic diagram of controlling the movement of a virtual object provided by an embodiment of the present disclosure;

[0025] FIG8 is a flowchart of a specific implementation of step S1013 in the embodiment shown in FIG4 ;

[0026] FIG9 is a schematic diagram of a virtual object along a first spatial trajectory provided by an embodiment of the present disclosure;

[0027] FIG10 is a flowchart of a specific implementation of step S103 in the embodiment shown in FIG2 ;

[0028] FIG11 is a second flow chart of the interactive control method provided in an embodiment of the present disclosure;

[0029] FIG12 is a schematic diagram of a collision process between a target object and a virtual object provided by an embodiment of the present disclosure;

[0030] FIG13 is a structural block diagram of an interactive control device provided by an embodiment of the present disclosure;

[0031] FIG14 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure;

[0032] FIG15 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0033] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present disclosure without making any creative efforts shall fall within the scope of protection of the present disclosure.

[0034] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0035] The following explains the application scenarios of the embodiments of the present disclosure:

[0036] FIG1 is an application scenario diagram of the interactive control method provided by the embodiment of the present disclosure. The interactive control method provided by the embodiment of the present disclosure can be applied to various application scenarios of human-computer interaction, more specifically, for example, in game scenarios, sports training scenarios, educational scenarios, etc. based on the interactive functions of the terminal device. For example, as shown in FIG1 , the terminal device can be a display terminal 11 with a camera, and an application with human-computer interaction functions is running in the display device 11. The display terminal 11 collects multimedia data of the user's body movements through the camera 12, such as video or video frames (i.e., images). To control the virtual object 13 displayed in the application, such as the "football" shown in the figure, so that it moves in the direction indicated by the arrow, thereby realizing control interaction for the virtual object 13 in the display terminal 11.

[0037] In existing technologies, controlling virtual objects displayed on terminal devices typically involves converting user body movements into corresponding control instructions through image capture. These instructions are then used to control the virtual objects displayed on the terminal device, thereby achieving human-computer interaction. However, because the image data captured during image capture is a two-dimensional video of the user's body movements, the control instructions generated based on this two-dimensional video can only control the virtual objects displayed on the terminal device within the two-dimensional plane. Consequently, the virtual objects are restricted to movement within a fixed two-dimensional screen. This results in the virtual objects being unable to achieve complex movements, reducing their realism and impacting the human-computer interaction experience.

[0038] The embodiments of the present disclosure provide an interactive control method to solve the above problems.

[0039] Refer to Figure 2, which is a flow chart of the interactive control method provided by an embodiment of the present disclosure. The method of this embodiment can be applied to a terminal device or a server. When the server is the execution subject, the steps of information display and instruction reception are implemented through the terminal device connected to it. Specifically, the interactive control method includes:

[0040] Step S101: Displaying a virtual object moving along a first spatial trajectory on multimedia data displayed in an interactive interface, wherein the virtual object is located in a virtual three-dimensional space generated based on the multimedia data, and the first spatial trajectory is the object movement trajectory in the virtual three-dimensional space.

[0041] For example, this embodiment uses a terminal device as the execution subject of the method of this embodiment. Referring to the application scenario schematic diagram shown in FIG1 , the terminal device is, for example, an electronic device with a display screen, such as a smartphone, tablet computer, or smart display terminal. First, the terminal device can use a built-in or connected image acquisition unit, such as a camera, to capture multimedia data in real time, such as videos or images with or without soundtracks. The multimedia data can also be pre-recorded video or image data, without limitation. More specifically, the multimedia data can be, for example, a video captured of a user's face or torso, i.e., the multimedia data can display, for example, one of the user's head, torso, or limbs. Furthermore, the terminal device can run an application to display an interactive interface and play the multimedia data within the interactive interface. The terminal device then uses the application to display a virtual object moving along a first spatial trajectory within the interactive interface. The virtual object is located within a virtual three-dimensional space generated based on the multimedia data, and the first spatial trajectory is the object's motion trajectory within the virtual three-dimensional space. Specifically, the virtual object moves within the virtual three-dimensional space, and the trajectory generated by its movement within the virtual three-dimensional space is the first spatial trajectory. FIG3 is a schematic diagram of a virtual three-dimensional space provided by an embodiment of the present disclosure. Referring to FIG3 , the virtual three-dimensional space is a preset stereoscopic space having three directional dimensions: length (shown as X in the figure), width (shown as Y in the figure), and height (shown as Z in the figure). The first spatial trajectory of the virtual object in the virtual three-dimensional space (shown as trajectory L1 in the figure) can be a straight line or a curve. The terminal device controls the movement of the virtual object by controlling the first motion state of the virtual object and the force acting on the virtual object, so that the virtual object presents an object motion trajectory corresponding to the first spatial trajectory in the virtual three-dimensional space. The first motion state is the initial motion state of the virtual object.

[0042] In a possible implementation, as shown in FIG4 , the specific implementation of step S101 includes:

[0043] Step S1011: Creating a virtual three-dimensional space by detecting multimedia data.

[0044] For example, a terminal device extracts frames from the currently playing (real-time captured) multimedia data to obtain a video frame image, and then obtains an image coordinate system corresponding to the video frame image. Then, using a camera model, the two-dimensional image coordinate system is converted into a camera coordinate system. The camera coordinate system is a coordinate system established with the camera as the origin, where the camera's optical axis is the Z axis and is perpendicular to the image plane. The X and Y axes are parallel to the image plane and correspond to the row and column directions of the image. The camera coordinate system is a three-dimensional coordinate system. The converted camera coordinate system can describe the spatial position of objects in the multimedia data. Next, the camera coordinate system is further transformed by multiplying it by a spatial transformation matrix to obtain a virtual three-dimensional space coordinate system, thereby creating a virtual three-dimensional space. This virtual three-dimensional space is generated based on the camera coordinate system corresponding to the multimedia data. Therefore, based on this virtual three-dimensional space, the spatial position of the target object in the multimedia data can be represented. In subsequent steps, by converting the target object and virtual objects in the multimedia data into this virtual three-dimensional space, collision detection between the target object and the virtual object and control of the spatial motion of the virtual object are achieved. The spatial transformation matrix can be predetermined based on the configuration information, which will not be described here.

[0045] Step S1012: Acquire a first motion state of the virtual object in the virtual three-dimensional space.

[0046] Exemplarily, after creating a virtual three-dimensional space, a first motion state of the virtual object moving in the virtual three-dimensional space is determined, wherein the first motion state includes, for example, the initial position, initial velocity, initial acceleration, and initial motion direction of the virtual object. Afterwards, the terminal device controls the movement of the virtual object based on the first motion state, for example, making the virtual object start at a specified position of the interactive interface, at a specified angle, velocity, and acceleration, and move along a first spatial trajectory.

[0047] Furthermore, in one possible implementation, the first motion state may be pre-set or randomly generated. For example, a virtual object may appear at a specified location or area in the interactive interface and move at a random angle and speed. Alternatively, the virtual object may appear at a random location in the interactive interface and move at a random angle, speed, or acceleration. The implementation form (position, speed, acceleration, angle) of the first motion state of the virtual object may be entirely random, partially random, partially pre-set, or entirely pre-set. The specific configuration is not limited herein.

[0048] In another possible implementation, the first motion state may be dynamically generated according to the video content of the multimedia data. As shown in FIG5 , the specific implementation steps of step S1012 include:

[0049] Step S1012A: Acquire a virtual three-dimensional space outline of at least one target object in the multimedia data, where the virtual three-dimensional space outline is an outline of the target object in the virtual three-dimensional space.

[0050] Step S1012B: Based on the virtual three-dimensional space outline of the target object, a first motion state of the virtual object in the virtual three-dimensional space is obtained.

[0051] Exemplarily, because the first motion state of a virtual object directly affects its first spatial trajectory, dynamically setting the first motion state and, consequently, controlling the first spatial trajectory can be achieved by obtaining the content of multimedia data, namely, the virtual three-dimensional spatial outline of at least one target object in the multimedia data, and setting the first motion state to match the virtual three-dimensional spatial outline. Exemplarily, after obtaining the multimedia data, the terminal device first detects the multimedia data to obtain the virtual three-dimensional spatial outline of at least one target object in the multimedia data. Specifically, the terminal device extracts video frames from the multimedia data and performs target detection on the video frames to obtain the outline of the target object. The target object may be, for example, the head or limbs of a user in the video frame, or a specific object such as a racket or a stick. The target object's outline is then converted to a virtual three-dimensional spatial coordinate system corresponding to the virtual three-dimensional space to obtain a virtual three-dimensional spatial outline. The virtual three-dimensional spatial outline may be a collection of coordinate points in the virtual three-dimensional spatial coordinate system, implemented as a matrix or array.

[0052] Afterwards, based on the virtual three-dimensional space outline, a first motion state of the virtual object in the virtual three-dimensional space is generated, wherein the first motion state includes, for example, an initial position, an initial motion angle, an acceleration, etc. According to the virtual three-dimensional space outline, the initial position is set outside the virtual three-dimensional space outline, and / or, by setting the initial motion angle and acceleration, the first spatial trajectory of the virtual object passes through the virtual three-dimensional space outline, that is, visually, a special effect style of the virtual object in the interactive interface moving toward the target object in the multimedia data is presented.

[0053] In the steps of this embodiment, the first motion state of the virtual object in the virtual three-dimensional space is obtained based on the virtual three-dimensional space outline of the target object, thereby realizing dynamic control of the first motion state, and then realizing precise control of the first space trajectory, thereby improving the rationality of the motion trajectory of the virtual object and improving the efficiency and interaction effect of human-computer interaction.

[0054] Furthermore, illustratively, as shown in FIG6 , the specific implementation steps of step S1012A include:

[0055] S1012A-1: Identify a target object in multimedia data and obtain the camera coordinates of the target object;

[0056] S1012A-2: Convert the camera coordinates of the target object into virtual three-dimensional space coordinates in the virtual three-dimensional space corresponding to the multimedia data;

[0057] S1012A-3: Obtain a virtual three-dimensional space outline of the target object according to the virtual three-dimensional space coordinates.

[0058] For example, by extracting features based on the pixels of a video frame image and classifying the extracted special effects, the target object in the video frame image can be identified and the coordinates of the target object in the camera coordinate system, i.e., the camera coordinates, can be obtained. The camera coordinate system is a coordinate system established with the camera as the origin, wherein the optical axis of the camera is the Z axis, which is perpendicular to the image plane. The X-axis and Y-axis are parallel to the image plane and correspond to the row and column directions of the image. The camera coordinates can refer to the coordinate set of points on the outline of the target object in the camera coordinate system, or the coordinates or coordinate set of the center point of the target object or the corner points corresponding to the positioning frame, which can be set as needed. The above process of obtaining the camera coordinates of the target object in the image based on the video frame image needs to be implemented in conjunction with the camera model. Specifically, the implementation process of converting the object in the plane image to the camera coordinate system through the camera model is not repeated here.

[0059] Furthermore, after obtaining the camera coordinates, the camera coordinates are further converted to coordinates in a virtual three-dimensional space coordinate system. In one possible implementation, the virtual three-dimensional space coordinate system is a calculated world coordinate system, that is, the target object and the virtual object can be converted to the same world coordinate system for collision detection. Of course, in another possible implementation, the virtual three-dimensional space coordinate system is an independent coordinate system corresponding to the virtual three-dimensional space (that is, different from the world coordinate system). The specific implementation method can be set as needed and is not limited here. The implementation step of converting the camera coordinates of the target object into virtual three-dimensional space coordinates in the virtual three-dimensional space corresponding to the multimedia data is to multiply the camera coordinate system by a preset space conversion matrix to obtain the virtual three-dimensional space coordinates in the corresponding virtual three-dimensional space. The space conversion matrix can be predetermined based on configuration information and is not further described here. When the virtual three-dimensional space is an inferred real world space (that is, the virtual three-dimensional space coordinate system is a calculated world coordinate system), the space conversion matrix is ​​a matrix that converts the camera coordinate system to the world coordinate system. The specific implementation method is the existing technology and is not further described here.

[0060] Furthermore, based on the virtual three-dimensional space coordinates obtained by the camera coordinate conversion, the virtual three-dimensional space outline of the target object is obtained. Specifically, the set of virtual three-dimensional space coordinates is used as the virtual three-dimensional space outline, or the set of space coordinates obtained after processing the virtual three-dimensional space coordinates, such as sampling and fitting, is used as the virtual three-dimensional space outline. This process is equivalent to the modeling process of the three-dimensional model of the appearance of the virtual object. The virtual three-dimensional space outline obtained according to the steps of this embodiment is used to implement the subsequent steps of collision detection and state prediction of the virtual object and the target object.

[0061] In the steps of this embodiment, by performing two coordinate transformations on the target object in the multimedia data, the virtual three-dimensional space outline of the target object is obtained, and then in the subsequent steps, the initial operating state is dynamically set based on the virtual three-dimensional space outline, thereby achieving accurate control of the motion trajectory of the virtual object in the three-dimensional space, improving the visual realism of the virtual object, and the efficiency of the user's control of the virtual object through the target object.

[0062] Step S1013: Based on the first motion state, the virtual object is controlled to move in the virtual three-dimensional space, and the virtual object is rendered to display the virtual object moving along the first spatial trajectory.

[0063] Exemplarily, after determining the first motion state of the virtual object, the terminal device continuously refreshes the running state of the virtual object over time based on the preset refresh frequency and the first motion state, and synchronously renders the virtual object, thereby achieving the purpose of displaying the virtual object moving along the first spatial trajectory on the interactive interface. Figure 7 is a schematic diagram of controlling the movement of a virtual object provided by an embodiment of the present disclosure. Referring to Figure 7, exemplarily, first, at time t_0, according to the first motion state = State_0, the spatial coordinates of the virtual object in the virtual three-dimensional space are determined to be P = (x_0, y_0, z_0), and the motion speed is a vector V = (v1, v2, v3); then, based on a preset time interval, at time t_1 after the duration det_T, the motion state of the virtual object is updated to State_1, and accordingly, the spatial coordinates of the virtual object in the virtual three-dimensional space are P = (x_1, y_1, z_1), where x_1 = x_0 + v1*det_T; y_1 = y_0 + v2*det_T; z_1 = z_0 + v3*det_T. Similarly, at time t_2 (not shown in the figure), after another period of det_T, the spatial coordinates of the virtual object in the virtual three-dimensional space are (x_2, y_2, z_2). Correspondingly, x_2 = x_1 + v1 * det_T; y_2 = y_1 + v2 * det_T; z_2 = z_1 + v3 * det_T. By analogy, the virtual object moves along the above spatial coordinates in sequence, and the motion trajectory formed is the first spatial trajectory. At the same time, the terminal device renders at each spatial coordinate position and renders the material corresponding to the virtual object to that spatial position, thereby achieving the visual effect of displaying the virtual object moving along the first spatial trajectory.

[0064] Furthermore, on the basis of controlling the motion trajectory of the virtual object based on position and speed (first motion state), the virtual object can be further controlled based on acceleration, so that the virtual object presents a first spatial trajectory of curved and variable speed motion.

[0065] For example, in one possible implementation, the specific implementation of step S1013 includes:

[0066] A damping parameter is obtained, where the damping parameter represents a law of how the speed and / or acceleration of the virtual object changes over time when the virtual object moves in the virtual three-dimensional space; and the virtual object is controlled to move along the first spatial trajectory based on the damping parameter and the first motion state.

[0067] Exemplarily, the damping parameter characterizes the law of how the speed and / or acceleration of a virtual object change over time when the virtual object moves in a virtual three-dimensional space. For example, the speed of the virtual object becomes faster or slower over time; or the speed of the virtual object becomes faster or slower as the distance moved; or the speed of the virtual object becomes faster or slower as the distance from the target object changes. The damping parameter can be a fixed acceleration vector for the virtual object, or the damping parameter can be a function that characterizes how the speed of the virtual object changes with an independent variable (such as the movement time and distance of the virtual object). Based on the first motion state, the damping parameter is combined to determine the spatial position of the virtual object at different times, thereby realizing variable speed and curved motion of the virtual object.

[0068] In another possible implementation, the specific implementation of step S1013 includes:

[0069] Obtaining gravity parameters, which are used to determine the magnitude and / or direction of the gravitational force on the virtual object when it moves in the virtual three-dimensional space; and controlling the virtual object to move along the first spatial trajectory based on the gravity parameters and the first motion state.

[0070] Exemplarily, gravity parameters are used to determine the magnitude and / or direction of the gravitational force exerted on a virtual object as it moves within a virtual three-dimensional space. When a virtual object moves within the virtual three-dimensional space, the gravitational force exerted on it changes its speed and direction of motion. Furthermore, the guiding effect is related to the virtual object's spatial position, acting as a constantly changing force applied to the virtual object, thereby controlling its trajectory. More specifically, gravity parameters include the coordinates of the gravitational point and the gravitational coefficient, i.e., Gra = [loc, coef], where loc is the gravitational point coordinate and coef is the gravitational coefficient. The gravitational point coordinates represent the position of the gravitational point exerting gravitational force on the virtual object, while the gravitational coefficient represents the magnitude of the gravitational force exerted by the gravitational point on the virtual object, i.e., a mapping between gravitational force and distance. After obtaining the gravity parameters, the spatial distance between the gravitational point coordinates and the virtual object's spatial coordinates is calculated. Combined with the gravitational coefficient, a gravitational vector representing the magnitude and direction of the gravitational force exerted on the virtual object is obtained. Afterwards, the virtual object is controlled to move along the first spatial trajectory by combining the gravitational effect (ie, the acceleration of the virtual object) and the first motion state obtained in the previous step. The specific implementation method will not be repeated here.

[0071] For example, the above two steps of controlling the movement of the virtual object in the virtual three-dimensional space based on the first motion state can be performed separately to achieve the purpose of controlling the movement of the virtual object in the virtual three-dimensional space, or can be performed together to achieve the purpose of controlling the movement of the virtual object in the virtual three-dimensional space. FIG8 is a flowchart of a specific implementation method of step S1013 provided in an embodiment of the present disclosure. As shown in FIG8, the specific implementation method of step S1013 includes:

[0072] Step S1013A: Obtain a damping parameter, where the damping parameter represents a law of how the speed and / or acceleration of the virtual object changes over time when the virtual object moves in the virtual three-dimensional space.

[0073] Step S1013B: Obtain gravity parameters, which are used to determine the magnitude and / or direction of the gravity acting on the virtual object when it moves in the virtual three-dimensional space.

[0074] Step S1013C: controlling the virtual object to move along the first spatial trajectory according to the damping parameter, the gravity parameter, and the first motion state.

[0075] FIG9 is a schematic diagram of a virtual object along a first space trajectory provided by an embodiment of the present disclosure. As shown in FIG9 ,

[0076] For example, at time t_0, based on the first motion state State_0, the spatial coordinates of virtual object 91 in virtual three-dimensional space are determined to be P = (x_0, y_0, z_0), and the motion velocity is vector V = (v1, v2, v3). Simultaneously, virtual object 91 is subjected to a damping force and the gravitational force of a gravitational point (shown as point T in the figure) located within the target object, respectively indicated as F1 and F2. F1 corresponds to the damping force vector, whose direction is opposite to the motion velocity vector V, generating an acceleration that hinders the motion of virtual object 91 and decelerates it. F2 corresponds to the gravitational force vector, whose direction is from the center point of virtual object 91 to the gravitational point. The magnitude of the gravitational vector varies with the spatial distance between the center point of virtual object 91 and the gravitational point. Afterwards, based on the preset time interval, at time t_1 after the det_T duration, the spatial coordinates of the virtual object 91 in the virtual 3D space are (x_1, y_1, z_1), where: x_1 = x_0 + v1*det_T + 0.5*(F1_x + F2_x)*det_T 2 ; y_1=y_0+v2*det_T+0.5*(F1_y+F2_y)*det_T 2 ; z_1=z_0+v3*det_T+0.5*(F1_z+F2_z)*det_T 2 ;

[0077] In the above formula, F1_x, F1_y, and F1_z are the components of F1 in the x, y, and z directions; F2_x, F2_y, and F2_z are the components of F2 in the x, y, and z directions.

[0078] Similarly, at time t_2, after another time duration det_T, virtual object 91's spatial coordinates in the virtual three-dimensional space are (x_2, y_2, z_2). Similarly, virtual object 91 moves along these spatial coordinates, forming a motion trajectory that is the first spatial trajectory of curved variable speed motion. Simultaneously, the terminal device renders the corresponding assets at each spatial coordinate position, thereby achieving the visual effect of displaying virtual object 91 moving along the first spatial trajectory.

[0079] Furthermore, optionally, before displaying the virtual object in the interactive interface, the terminal device can trigger the corresponding special effects props by receiving a trigger instruction input by the user, thereby triggering the above-mentioned special effects of the virtual object moving along the first spatial trajectory in the interactive interface. The specific triggering process can be set as needed and will not be repeated here.

[0080] Step S102: When the virtual object collides with the target object in the multimedia data, a second motion state of the virtual object is obtained according to the spatial collision positions of the virtual object and the target object.

[0081] Step S103: According to the second motion state of the virtual object, the virtual object is controlled to move along the second spatial trajectory in the virtual three-dimensional space.

[0082] Exemplarily, when a terminal device controls a virtual object to move in a virtual three-dimensional space, when a collision is detected between the virtual object and a target object in multimedia data, the trajectory of the virtual object is controlled to change in order to simulate a collision of an object in a real environment. Specifically, the second motion state of the virtual object is determined based on the collision point between the virtual object and the target object in the virtual three-dimensional space, that is, the spatial collision position, wherein the second motion state is the motion state of the virtual object after the collision with the target object. Afterwards, the trajectory of the virtual object is recalculated based on the second motion state of the virtual object, thereby controlling the virtual object to move along the second spatial trajectory in the virtual three-dimensional space.

[0083] In a possible implementation, as shown in FIG10 , a specific implementation of step S103 includes:

[0084] Step S1031: obtaining a first physical parameter corresponding to the virtual object, where the first physical parameter is used to characterize the motion state and / or object properties of the virtual object during collision.

[0085] Step S1032: Obtaining a second motion state of the virtual object according to the first physical parameter and the spatial collision position.

[0086] Exemplarily, the first physical parameter corresponding to the virtual object characterizes the motion state and / or object properties of the virtual object when it collides, wherein the motion state includes the speed and acceleration of the virtual object, which can be a numerical value or a vector; the object property characterizes the properties of the virtual object that affect the motion state after the collision, such as weight, elastic modulus, etc. The object property of the virtual object is a pre-set numerical value, which can be customized according to user needs and will not be described in detail here. Afterwards, the operating state is calculated based on the above-mentioned first physical parameter and the predicted spatial collision position to obtain the second motion state. Among them, the above-mentioned process of calculating the second operating state can be implemented based on a preset physical collision system, that is, the data corresponding to the virtual object and the data corresponding to the target object are input into the physical collision system, and the collision detection between the two and the calculation of the collision point (spatial collision position) can be realized. The specific implementation process will not be repeated in this embodiment.

[0087] Furthermore, based on the introduction in the steps of the previous embodiment, the terminal device reconstructs the virtual object and the target object in the virtual three-dimensional space by creating a virtual three-dimensional space, and performs collision detection on the two in the virtual three-dimensional space. Therefore, after detecting that the virtual object collides with the target object, the collision state can be further simulated in the virtual three-dimensional space to obtain the second motion state of the virtual object, and based on the second motion state, the virtual object is controlled to move along the corresponding second spatial trajectory in the virtual three-dimensional space and rendered. In the interactive interface, the corresponding visual effect is that the virtual object after the collision moves in all directions (in three-dimensional space) based on the spatial collision position, rather than just in one plane, thereby achieving a more realistic special effect.

[0088] Among them, after obtaining the second motion state, the specific implementation process of controlling the virtual object to move along the second spatial trajectory in the virtual three-dimensional space based on the second motion state is similar to the implementation method of controlling the virtual object to move along the second spatial trajectory in the virtual three-dimensional space based on the first motion state introduced in the previous embodiment. It will not be repeated here. For details, please refer to the introduction of the corresponding part in the previous embodiment.

[0089] In this embodiment, a virtual object moving along a first spatial trajectory is displayed on multimedia data displayed in an interactive interface, wherein the virtual object is located in a virtual three-dimensional space generated based on the multimedia data, and the first spatial trajectory is the object's motion trajectory in the virtual three-dimensional space. When the virtual object collides with a target object in the multimedia data, a second motion state of the virtual object is obtained based on the spatial collision position between the virtual object and the target object. Based on the second motion state of the virtual object, the virtual object is controlled to move along the second spatial trajectory in the virtual three-dimensional space. By displaying the virtual object moving along the first spatial trajectory and, when the virtual object collides with the target object in the multimedia data, controlling the virtual object to move along the second spatial trajectory in the virtual three-dimensional space based on the second motion state of the virtual object, complex motion of the virtual object in three-dimensional space is achieved, the motion realism of the virtual object is improved, and the human-computer interaction effect is thereby enhanced.

[0090] Referring to Figure 11, Figure 11 is a second flow chart of the interactive control method provided by an embodiment of the present disclosure. Based on the embodiment shown in Figure 2, this embodiment further refines step S102, and the interactive control method includes:

[0091] Step S201: Displaying a virtual object moving along a first spatial trajectory on the multimedia data displayed in the interactive interface, wherein the virtual object is located in a virtual three-dimensional space generated based on the multimedia data, and the first spatial trajectory is the object movement trajectory in the virtual three-dimensional space.

[0092] Step S202: Acquire a first physical parameter corresponding to the virtual object and a second physical parameter corresponding to the target object.

[0093] Step S203: Process the first physical parameter and the second physical parameter through the physical collision system to detect whether the virtual object and the target object collide. If a collision occurs, output the spatial collision position of the virtual object and the target object; if no collision occurs, return to step S201.

[0094] Exemplarily, the first physical parameter is used to characterize the motion state and / or object properties of a virtual object upon collision, and the second physical parameter characterizes the motion state of a target object upon collision. By creating a virtual three-dimensional space and modeling the virtual object and target object within the virtual three-dimensional space, the terminal device can calculate the physical parameters of the target object and the virtual object in real time, thereby obtaining the current first and second physical parameters. The first and second physical parameters are then input into a preset physical collision system, which performs collision detection on the target object and the virtual object to determine whether a collision has occurred between the virtual object and the target object. Furthermore, if a collision occurs, the location of the collision is calculated through the physical collision system, and subsequent motion state calculations are performed. In one possible implementation, the physical collision system performs collision detection based on the first physical parameter and the second physical parameter, and directly predicts the corresponding second motion state based on the calculated spatial collision position and outputs it, so that the terminal device obtains the second motion state, that is, the specific implementation method of the subsequent step S204 can also be based on the output of the physical collision system; on the other hand, if no collision occurs, the process returns to step S201, continues to render and display the virtual object, and repeats the above steps until the virtual object collides.

[0095] Step S204: obtaining a second motion state of the virtual object according to the first physical parameter, the second physical parameter and the spatial collision position.

[0096] For example, after obtaining the spatial collision position, the motion state is estimated based on the first and second physical parameters to obtain the second motion state of the virtual object. This embodiment can be simulated and calculated using a physical collision system to obtain the predicted second motion state of the virtual object. The physical collision system is a software program that simulates physical collisions based on a model. Its specific implementation is based on existing technology, and its implementation principles are not further described here.

[0097] Step S205: According to the second motion state of the virtual object, the virtual object is controlled to move along the second spatial trajectory in the virtual three-dimensional space.

[0098] Optionally, after step S201, the method further includes:

[0099] Step S200A: Rendering a motion trajectory special effect of the virtual object based on the first spatial trajectory;

[0100] Optionally, after step S203, the method further includes:

[0101] Step S200B: When the virtual object collides with the target object in the multimedia data, a collision effect of the virtual object is rendered at the spatial collision position.

[0102] Optionally, after step S205, the method further includes:

[0103] Step S200C: Rendering a motion trajectory special effect of the virtual object based on the second spatial trajectory.

[0104] For example, after step S201, step S203, and step S205, the motion trajectory and collision effects of the virtual object can be rendered, thereby highlighting the visual effect of the motion trajectory of the virtual object and the collision effect between the virtual object and the target object, thereby improving the visual response effect in the human-computer interaction process, and improving the interaction efficiency and interaction accuracy.

[0105] Furthermore, after step S204, the method further includes:

[0106] Step S204A: When the second motion state is a target motion state, a corresponding target special effect is displayed in the interactive interface.

[0107] For example, based on the introduction in the previous section, the first physical parameter is used to characterize the motion state and / or object properties of the virtual object when it collides, and the second physical parameter characterizes the motion state of the target object when it collides, wherein the motion state includes information such as the spatial position, motion speed, and motion acceleration of the virtual object / target object. When the motion state of the target object when it collides, and / or the motion state of the virtual object when it collides, is a special target state, it indicates that a relatively special and obvious collision has occurred between the target object controlled by the user and the virtual object in the virtual three-dimensional space. For example, when the following content is displayed in the interactive interface: "The user's head" (target object) collides with the "football" (virtual object), and when the collision occurs, the speed of the "user's head" is greater than a first speed threshold, and the angle between the speed of the "user's head" and the speed of the "football" is greater than a first angle threshold, that is, the "user's head" collides with the "football" at a relatively fast speed and a relatively positive angle, when the above conditions are met, a corresponding target special effect is displayed in the interactive interface, such as a full-screen flashing special effect, or the text "Good ball!" is displayed on the interactive interface. This will prompt the user of the current interactive operation, which is to meet the interactive operation requirements of specific operations, thereby guiding the user to perform reasonable interactive operations and improving the efficiency of human-computer interaction.

[0108] FIG. 12 is a schematic diagram of the collision process between a target object and a virtual object provided by an embodiment of the present disclosure. Referring to FIG. 12, the above embodiment will be further introduced. Exemplarily, first, the terminal device captures a user image through a built-in camera. The user image includes the user's head and the user's torso (part). After that, the terminal device identifies the user's head as the target object 122 and displays a small ball 121 moving downward from the upper left part of the interaction interface, that is, the virtual object. Based on the introduction in the previous embodiment, the terminal device calculates the motion state of the small ball 121 in the virtual three-dimensional space and optionally combines information such as damping parameters and gravitational parameters to calculate the spatial position of the small ball 121 in real time, so as to display the first spatial trajectory of the small ball 121 on the interaction interface in real time. After that, the target object 122 (the user's head) in the video will move in the virtual three-dimensional space as the user's head moves in the real environment. The terminal device determines whether a collision occurs by calculating the first physical parameter of the virtual object and the second physical parameter of the target object 122 in real time. When no collision occurs between the two, for example, as shown in Case I in the figure, the small ball 121 always moves along the first spatial trajectory L1 (shown as L1 in the figure) calculated in real time until it moves out of the interaction interface. When a collision occurs between the two, but after the target object 122 and the virtual object collide, the speed of the virtual object (one of the implementation manners of the second motion state) is slower (shown as V<V0 in the figure), that is, as shown in Case II in the figure, the small ball moves along the second spatial trajectory L2 (shown as L2 in the figure) after the collision until it moves out of the interaction interface; when a collision occurs between the two, and after the target object 122 and the virtual object collide, the speed of the virtual object is faster (shown as V>V0 in the figure), that is, as shown in Case III in the figure, the small ball moves along the second spatial trajectory L3 (shown as L3 in the figure) after the collision until it moves out of the interaction interface. At the same time, an additional target special effect 123 is displayed in the interaction interface, such as the text special effect "Good shot" shown in the figure, to achieve the purpose of interacting with the user.

[0109] In this embodiment, the implementation manners of steps S201 and S205 are the same as those of steps S101 and S103 in the embodiment shown in FIG. 2 of the present disclosure, and will not be elaborated here one by one.

[0110] Corresponding to the interaction control method in the above embodiment, FIG. 13 is a structural block diagram of an interaction control device provided by an embodiment of the present disclosure. For the convenience of description, only parts related to the embodiment of the present disclosure are shown. Referring to FIG. 13, the interaction control device 3 includes:

[0111] A display module 31, configured to display a virtual object moving along a first spatial trajectory on the multimedia data displayed in the interaction interface, where the virtual object is located in a virtual three-dimensional space generated based on the multimedia data, and the first spatial trajectory is the object motion trajectory in the virtual three-dimensional space;

[0112] a processing module 32 for obtaining a second motion state of the virtual object according to a spatial collision position of the virtual object and the target object when the virtual object collides with the target object in the multimedia data;

[0113] The control module 33 is configured to control the virtual object to move along a second spatial trajectory in the virtual three-dimensional space according to the second motion state of the virtual object.

[0114] In one embodiment of the present disclosure, the display module 31 is specifically used to: create a virtual three-dimensional space by detecting multimedia data; obtain a first motion state of a virtual object in the virtual three-dimensional space; based on the first motion state, control the movement of the virtual object in the virtual three-dimensional space, and render the virtual object to display the virtual object moving along the first space trajectory.

[0115] In one embodiment of the present disclosure, when obtaining the first motion state of a virtual object in a virtual three-dimensional space, the display module 31 is specifically used to: obtain a virtual three-dimensional space outline of at least one target object in multimedia data, where the virtual three-dimensional space outline is the outline of the target object in the virtual three-dimensional space; and obtain the first motion state of the virtual object in the virtual three-dimensional space based on the virtual three-dimensional space outline of the target object.

[0116] In one embodiment of the present disclosure, when obtaining the virtual three-dimensional space outline of at least one target object in multimedia data, the display module 31 is specifically used to: identify the target object in the multimedia data and obtain the camera coordinates of the target object; convert the camera coordinates of the target object into virtual three-dimensional space coordinates in the virtual three-dimensional space corresponding to the multimedia data; and obtain the virtual three-dimensional space outline of the target object based on the virtual three-dimensional space coordinates.

[0117] In one embodiment of the present disclosure, when controlling the movement of a virtual object in a virtual three-dimensional space based on a first motion state, the display module 31 is specifically used to: obtain a damping parameter, where the damping parameter characterizes how the speed and / or acceleration of the virtual object change over time when the virtual object moves in the virtual three-dimensional space; and control the virtual object to move along a first spatial trajectory according to the damping parameter and the first motion state.

[0118] In one embodiment of the present disclosure, when the display module 31 controls the movement of a virtual object in a virtual three-dimensional space based on a first motion state, it is specifically used to: obtain gravity parameters, which are used to determine the magnitude and / or direction of the gravitational force on the virtual object when it moves in the virtual three-dimensional space; and control the virtual object to move along a first spatial trajectory according to the gravity parameters and the first motion state.

[0119] In one embodiment of the present disclosure, the processing module 32 is specifically used to: obtain a first physical parameter corresponding to the virtual object, the first physical parameter is used to characterize the motion state and / or object properties of the virtual object when it collides; and obtain a second motion state of the virtual object based on the first physical parameter and the spatial collision position.

[0120] In one embodiment of the present disclosure, the processing module 32 is further used to: obtain a second physical parameter corresponding to the target object, the second physical parameter representing the motion state of the target object when it collides; and obtain the second motion state of the virtual object based on the first physical parameter, the second physical parameter and the spatial collision position.

[0121] In one embodiment of the present disclosure, the control module 33 is further configured to: when the first motion state and / or the second motion state represented by the second physical parameter is a target motion state, display a corresponding target special effect in the interactive interface.

[0122] In one embodiment of the present disclosure, the processing module 32 is further used to: obtain a second physical parameter corresponding to the target object, the second physical parameter representing the motion state of the target object when it collides; process the first physical parameter and the second physical parameter through the physical collision system to detect whether the virtual object and the target object collide, and / or obtain the spatial collision position of the virtual object and the target object.

[0123] In one embodiment of the present disclosure, the control module 33 is further used for at least one of the following: rendering motion trajectory effects of a virtual object based on the first spatial trajectory and / or the second spatial trajectory; and rendering collision effects of the virtual object at the spatial collision position when the virtual object collides with a target object in multimedia data.

[0124] The display module 31, processing module 32 and control module 33 are connected in sequence. The interactive control device 3 provided in this embodiment can implement the technical solution of the above method embodiment, and its implementation principle and technical effect are similar, which will not be described in detail in this embodiment.

[0125] FIG14 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. As shown in FIG14 , the electronic device 4 includes:

[0126] A processor 41, and a memory 42 communicatively connected to the processor 41;

[0127] Memory 42 stores computer-executable instructions;

[0128] The processor 41 executes the computer-executable instructions stored in the memory 42 to implement the interactive control method in the embodiments shown in FIG. 2 to FIG. 12 .

[0129] Optionally, the processor 41 and the memory 42 are connected via a bus 43 .

[0130] The relevant explanations can be understood by referring to the relevant descriptions and effects corresponding to the steps in the embodiments corresponding to Figures 2 to 12, and no further details will be given here.

[0131] An embodiment of the present disclosure provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, they are used to implement the interactive control method provided in any one of the embodiments corresponding to Figures 2 to 12 of the present disclosure.

[0132] In order to implement the above embodiment, the present disclosure further provides an electronic device.

[0133] Referring to FIG15 , there is shown a schematic diagram of the structure of an electronic device 900 suitable for implementing an embodiment of the present disclosure. The electronic device 900 may be a terminal device or a server. The terminal device may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), vehicle-mounted terminals (e.g., vehicle-mounted navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG15 is merely an example and should not limit the functionality and scope of use of the embodiments of the present disclosure.

[0134] As shown in FIG15 , the electronic device 900 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 into a random access memory (RAM) 903. Various programs and data required for the operation of the electronic device 900 are also stored in the RAM 903. The processing device 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0135] Typically, the following devices can be connected to the I / O interface 905: input devices 906 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 908 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 909. The communication device 909 can allow the electronic device 900 to communicate with other devices wirelessly or by wire to exchange data. Although FIG15 shows an electronic device 900 with various devices, it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively.

[0136] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication device 909, or installed from the storage device 908, or installed from the ROM 902. When the computer program is executed by the processing device 901, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0137] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0138] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0139] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0140] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet Service Provider).

[0141] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0142] The units involved in the embodiments described in this disclosure may be implemented in software or hardware. In some cases, the name of a unit does not limit the unit itself. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses."

[0143] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0144] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0145] In a first aspect, according to one or more embodiments of the present disclosure, an interactive control method is provided, comprising:

[0146] A virtual object moving along a first spatial trajectory is displayed on the multimedia data displayed in the interactive interface, wherein the virtual object is located in a virtual three-dimensional space generated based on the multimedia data, and the first spatial trajectory is the object movement trajectory in the virtual three-dimensional space; when the virtual object collides with a target object in the multimedia data, a second motion state of the virtual object is obtained based on the spatial collision position of the virtual object and the target object; and based on the second motion state of the virtual object, the virtual object is controlled to move along the second spatial trajectory in the virtual three-dimensional space.

[0147] According to one or more embodiments of the present disclosure, displaying a virtual object moving along a first spatial trajectory on multimedia data displayed in an interactive interface includes: creating the virtual three-dimensional space by detecting the multimedia data; obtaining a first motion state of the virtual object in the virtual three-dimensional space; and controlling the virtual object to move in the virtual three-dimensional space based on the first motion state, and rendering the virtual object to display the virtual object moving along the first spatial trajectory.

[0148] According to one or more embodiments of the present disclosure, obtaining the first motion state of the virtual object in the virtual three-dimensional space includes: obtaining the virtual three-dimensional space outline of at least one target object in the multimedia data, where the virtual three-dimensional space outline is the outline of the target object in the virtual three-dimensional space; and obtaining the first motion state of the virtual object in the virtual three-dimensional space based on the virtual three-dimensional space outline of the target object.

[0149] According to one or more embodiments of the present disclosure, obtaining a virtual three-dimensional space outline of at least one target object in the multimedia data includes: identifying the target object in the multimedia data and obtaining the camera coordinates of the target object; converting the camera coordinates of the target object into virtual three-dimensional space coordinates in the virtual three-dimensional space corresponding to the multimedia data; and obtaining the virtual three-dimensional space outline of the target object based on the virtual three-dimensional space coordinates.

[0150] According to one or more embodiments of the present disclosure, controlling the movement of the virtual object in the virtual three-dimensional space based on the first motion state includes: obtaining a damping parameter, wherein the damping parameter represents a law of change of the speed and / or acceleration of the virtual object over time when the virtual object moves in the virtual three-dimensional space; and controlling the virtual object to move along the first spatial trajectory according to the damping parameter and the first motion state.

[0151] According to one or more embodiments of the present disclosure, controlling the movement of the virtual object in the virtual three-dimensional space based on the first motion state includes: obtaining gravity parameters, which are used to determine the magnitude and / or direction of the gravitational force on the virtual object when it moves in the virtual three-dimensional space; and controlling the virtual object to move along the first spatial trajectory based on the gravity parameters and the first motion state.

[0152] According to one or more embodiments of the present disclosure, obtaining the second motion state of the virtual object based on the spatial collision position between the virtual object and the target object includes: obtaining a first physical parameter corresponding to the virtual object, the first physical parameter being used to characterize the motion state and / or object properties of the virtual object when colliding; and obtaining the second motion state of the virtual object based on the first physical parameter and the spatial collision position.

[0153] According to one or more embodiments of the present disclosure, the method further includes: obtaining a second physical parameter corresponding to the target object, the second physical parameter characterizing the motion state of the target object when colliding; obtaining the second motion state of the virtual object based on the first physical parameter and the spatial collision position includes: obtaining the second motion state of the virtual object based on the first physical parameter, the second physical parameter and the spatial collision position.

[0154] According to one or more embodiments of the present disclosure, the method further includes: when the second motion state is a target motion state, displaying a corresponding target special effect in the interactive interface.

[0155] According to one or more embodiments of the present disclosure, the method further includes: obtaining a second physical parameter corresponding to the target object, wherein the second physical parameter represents the motion state of the target object when colliding; processing the first physical parameter and the second physical parameter through a physical collision system to detect whether the virtual object and the target object collide, and / or obtaining the spatial collision position of the virtual object and the target object.

[0156] According to one or more embodiments of the present disclosure, at least one of the following items is also included: rendering the motion trajectory special effects of the virtual object based on the first spatial trajectory and / or the second spatial trajectory; when the virtual object collides with the target object in the multimedia data, rendering the collision special effects of the virtual object at the spatial collision position.

[0157] In a second aspect, according to one or more embodiments of the present disclosure, an interactive control device is provided, comprising:

[0158] a display module configured to display a virtual object moving along a first spatial trajectory on the multimedia data displayed in the interactive interface, wherein the virtual object is located in a virtual three-dimensional space generated based on the multimedia data, and the first spatial trajectory is a motion trajectory of the object in the virtual three-dimensional space;

[0159] a processing module, configured to obtain a second motion state of the virtual object according to a spatial collision position between the virtual object and the target object when the virtual object collides with the target object in the multimedia data;

[0160] The control module is configured to control the virtual object to move along a second spatial trajectory in the virtual three-dimensional space according to the second motion state of the virtual object.

[0161] According to one or more embodiments of the present disclosure, the display module is specifically used to: create the virtual three-dimensional space by detecting the multimedia data; obtain a first motion state of the virtual object in the virtual three-dimensional space; based on the first motion state, control the movement of the virtual object in the virtual three-dimensional space, and render the virtual object to display the virtual object moving along the first spatial trajectory.

[0162] According to one or more embodiments of the present disclosure, when the display module obtains the first motion state of the virtual object in the virtual three-dimensional space, it is specifically used to: obtain the virtual three-dimensional space outline of at least one target object in the multimedia data, where the virtual three-dimensional space outline is the outline of the target object in the virtual three-dimensional space; and obtain the first motion state of the virtual object in the virtual three-dimensional space based on the virtual three-dimensional space outline of the target object.

[0163] According to one or more embodiments of the present disclosure, when the display module obtains the virtual three-dimensional space outline of at least one target object in the multimedia data, it is specifically used to: identify the target object in the multimedia data and obtain the camera coordinates of the target object; convert the camera coordinates of the target object into virtual three-dimensional space coordinates in the virtual three-dimensional space corresponding to the multimedia data; and obtain the virtual three-dimensional space outline of the target object based on the virtual three-dimensional space coordinates.

[0164] According to one or more embodiments of the present disclosure, when the display module controls the virtual object to move in the virtual three-dimensional space based on the first motion state, it is specifically used to: obtain a damping parameter, where the damping parameter represents the law of change of the speed and / or acceleration of the virtual object over time when the virtual object moves in the virtual three-dimensional space; and control the virtual object to move along the first spatial trajectory according to the damping parameter and the first motion state.

[0165] According to one or more embodiments of the present disclosure, when the display module controls the virtual object to move in the virtual three-dimensional space based on the first motion state, it is specifically used to: obtain gravity parameters, which are used to determine the magnitude and / or direction of the gravitational force on the virtual object when it moves in the virtual three-dimensional space; and control the virtual object to move along the first spatial trajectory according to the gravity parameters and the first motion state.

[0166] According to one or more embodiments of the present disclosure, the processing module is specifically used to: obtain a first physical parameter corresponding to the virtual object, where the first physical parameter is used to characterize the motion state and / or object properties of the virtual object when it collides; and obtain a second motion state of the virtual object based on the first physical parameter and the spatial collision position.

[0167] According to one or more embodiments of the present disclosure, the processing module is further used to: obtain a second physical parameter corresponding to the target object, the second physical parameter representing the motion state of the target object when it collides; and obtain the second motion state of the virtual object based on the first physical parameter, the second physical parameter and the spatial collision position.

[0168] According to one or more embodiments of the present disclosure, the control module is further configured to: when the second motion state is a target motion state, display a corresponding target special effect in the interactive interface.

[0169] According to one or more embodiments of the present disclosure, the processing module is further used to: obtain a second physical parameter corresponding to the target object, the second physical parameter representing the motion state of the target object when it collides; process the first physical parameter and the second physical parameter through a physical collision system to detect whether the virtual object and the target object collide, and / or obtain the spatial collision position of the virtual object and the target object.

[0170] According to one or more embodiments of the present disclosure, the control module is further used for at least one of the following: rendering the motion trajectory special effects of the virtual object based on the first spatial trajectory and / or the second spatial trajectory; when the virtual object collides with the target object in the multimedia data, rendering the collision special effects of the virtual object at the spatial collision position.

[0171] In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: at least one processor and a memory;

[0172] The memory stores computer-executable instructions;

[0173] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the interactive control method described in the first aspect and various possible designs of the first aspect.

[0174] In a fourth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the interactive control method described in the first aspect and various possible designs of the first aspect is implemented.

[0175] In a fifth aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the interactive control method as described in the first aspect and various possible designs of the first aspect.

[0176] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0177] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0178] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. An interactive control method, comprising: Displaying a virtual object moving along a first spatial trajectory on the multimedia data displayed in the interactive interface, wherein the virtual object is located in a virtual three-dimensional space generated based on the multimedia data, and the first spatial trajectory is a movement trajectory of the object in the virtual three-dimensional space; When the virtual object collides with the target object in the multimedia data, obtaining a second motion state of the virtual object according to the spatial collision position between the virtual object and the target object; According to the second motion state of the virtual object, the virtual object is controlled to move along a second space trajectory in the virtual three-dimensional space.

2. The method according to claim 1, wherein: Displaying a virtual object moving along a first spatial trajectory on the multimedia data displayed in the interactive interface includes: Creating the virtual three-dimensional space by detecting the multimedia data; Acquire a first motion state of the virtual object in the virtual three-dimensional space; Based on the first motion state, the virtual object is controlled to move in the virtual three-dimensional space, and the virtual object is rendered to display the virtual object moving along the first space trajectory.

3. The method according to claim 2, wherein: The acquiring the first motion state of the virtual object in the virtual three-dimensional space includes: Acquire a virtual three-dimensional space outline of at least one target object in the multimedia data, where the virtual three-dimensional space outline is an outline of the target object in the virtual three-dimensional space; Based on the virtual three-dimensional space contour of the target object, a first motion state of the virtual object in the virtual three-dimensional space is obtained.

4. The method according to claim 3, wherein: The obtaining of a virtual three-dimensional space outline of at least one target object in the multimedia data comprises: Identify a target object in the multimedia data and obtain camera coordinates of the target object; Converting the camera coordinates of the target object into virtual three-dimensional space coordinates in the virtual three-dimensional space corresponding to the multimedia data; A virtual three-dimensional space outline of the target object is obtained according to the virtual three-dimensional space coordinates.

5. The method according to claim 2, wherein: The controlling the virtual object to move in the virtual three-dimensional space based on the first motion state includes: Acquire a damping parameter, where the damping parameter represents a law of how the speed and / or acceleration of the virtual object changes over time when the virtual object moves in the virtual three-dimensional space; The virtual object is controlled to move along the first space trajectory according to the damping parameter and the first motion state.

6. The method according to claim 2, wherein: The controlling the virtual object to move in the virtual three-dimensional space based on the first motion state includes: Acquiring gravity parameters, where the gravity parameters are used to determine the magnitude and / or direction of the gravity applied to the virtual object when the virtual object moves in the virtual three-dimensional space; The virtual object is controlled to move along the first space trajectory according to the gravity parameter and the first motion state.

7. The method according to claim 1, wherein: The obtaining, according to the spatial collision position between the virtual object and the target object, a second motion state of the virtual object comprises: Acquire a first physical parameter corresponding to the virtual object, where the first physical parameter is used to characterize a motion state and / or an object property of the virtual object when it collides; A second motion state of the virtual object is obtained according to the first physical parameter and the spatial collision position.

8. The method according to claim 7, further comprising: Acquire a second physical parameter corresponding to the target object, where the second physical parameter represents a motion state of the target object when colliding; The obtaining, according to the first physical parameter and the spatial collision position, a second motion state of the virtual object comprises: A second motion state of the virtual object is obtained according to the first physical parameter, the second physical parameter and the spatial collision position.

9. The method according to claim 8, further comprising: When the second motion state is a target motion state, a corresponding target special effect is displayed in the interactive interface.

10. The method according to claim 7, further comprising: Acquire a second physical parameter corresponding to the target object, where the second physical parameter represents a motion state of the target object when colliding; The first physical parameter and the second physical parameter are processed by a physical collision system to detect whether the virtual object collides with the target object, and / or to obtain a spatial collision position between the virtual object and the target object.

11. The method according to claim 1, further comprising at least one of the following: Rendering a motion trajectory special effect of the virtual object based on the first spatial trajectory and / or the second spatial trajectory; When the virtual object collides with the target object in the multimedia data, a collision effect of the virtual object is rendered at the spatial collision position.

12. An interactive control device, comprising: A display module is configured to display a virtual object moving along a first spatial trajectory on the multimedia data displayed in the interactive interface, wherein the virtual object is located in a virtual three-dimensional space generated based on the multimedia data, and the first spatial trajectory is a movement trajectory of the object in the virtual three-dimensional space; a processing module configured to obtain a second motion state of the virtual object according to a spatial collision position between the virtual object and the target object when the virtual object collides with the target object in the multimedia data; and The control module is configured to control the virtual object to move along a second spatial trajectory in the virtual three-dimensional space according to the second motion state of the virtual object.

13. An electronic device, comprising: Processor and memory; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the interactive control method according to any one of claims 1 to 11.

14. A computer-readable storage medium, wherein: The computer-readable storage medium stores computer-executable instructions, and when the processor executes the computer-executable instructions, the interactive control method according to any one of claims 1 to 11 is implemented.

15. A computer program product comprising a computer program, wherein: When the computer program is executed by a processor, the interactive control method according to any one of claims 1 to 11 is implemented.

Images