Motion control method and device for displaying objects

Abstract

This disclosure provides a motion control method and device for a display object, relating to the field of motion control technology. The method includes: acquiring facial feature data of a user; updating the current motion speed of the display object based on the facial feature data; and controlling the display object to move within a display interface based on the updated current motion speed. This disclosure maps facial feature data to motion speed, thereby controlling the movement of the display object through the motion speed. In this way, when the facial feature data changes, the motion speed of the display object changes, and this change in motion speed can make the position of the display object after movement uncertain, thus diversifying the relative positional relationship between the display object and the face, and further improving the motion diversity of the display object.

Description

Technical Field

[0001] This disclosure relates to the field of motion control technology, and in particular to a motion control method and device for a display object. Background Technology

[0002] In the field of motion control technology, users can control the movement of displayed objects for an enjoyable experience. There are various ways for users to control these objects, including traditional methods such as using input devices like keyboards and mice. To further enhance the user experience, users can also control the movement of displayed objects using their facial expressions.

[0003] Existing technology achieves motion control of a displayed object by leveraging the relative positional relationship between facial feature points and the displayed object. Specifically, firstly, the scheme for controlling the movement of a displayed object via face captures an image of the user's face to identify the positions of facial feature points. Then, based on these feature point positions and the preset relative positional relationship, the position of the displayed object on the display interface is updated. In this way, the position of the displayed object changes with the positions of the facial feature points, achieving the goal of controlling the movement of the displayed object via face.

[0004] However, existing technologies suffer from the problem of displaying only one type of object movement. Summary of the Invention

[0005] This disclosure provides a motion control method and device for a display object, which can improve the motion diversity of the display object.

[0006] In a first aspect, embodiments of this disclosure provide a motion control method for a displayed object, comprising:

[0007] Obtain the user's facial feature data;

[0008] The current movement speed of the displayed object is updated based on the facial feature data;

[0009] The display object is controlled to move within the display interface based on the updated current motion speed.

[0010] In a second aspect, embodiments of this disclosure provide a motion control device for a displayed object, comprising:

[0011] The feature data acquisition module is used to acquire the user's facial feature data;

[0012] The motion speed update module is used to update the current motion speed of the displayed object based on the facial feature data;

[0013] The motion control module is used to control the movement of the displayed object in the display interface according to the updated current motion speed.

[0014] Thirdly, embodiments of this disclosure provide an electronic device, including: at least one processor and a memory;

[0015] The memory stores computer-executed instructions;

[0016] The at least one processor executes computer execution instructions stored in the memory, causing the electronic device to perform the method as described in the first aspect.

[0017] Fourthly, embodiments of this disclosure provide a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, cause a computing device to implement the method described in the first aspect.

[0018] Fifthly, embodiments of this disclosure provide a computer program for implementing the method as described in the first aspect.

[0019] This disclosure provides a method and apparatus for controlling the motion of a display object. The method includes: acquiring facial feature data of a user; updating the current motion speed of the display object based on the facial feature data; and controlling the display object to move within a display interface based on the updated current motion speed. This disclosure allows facial feature data to be mapped to motion speed, thereby controlling the movement of the display object through the motion speed. In this way, when the facial feature data changes, the motion speed of the display object changes, and this change in motion speed can make the position of the display object after movement uncertain, thus diversifying the relative positional relationship between the display object and the face, and further improving the motion diversity of the display object. Attached Figure Description

[0020] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0021] Figure 1 This is a schematic diagram illustrating the relative positional relationship between feature point locations and displayed objects in existing technologies.

[0022] Figure 2 This is a flowchart illustrating the steps of a motion control method for a display object provided in an embodiment of this disclosure;

[0023] Figure 3 This is a schematic diagram of the face rotation angle provided in an embodiment of this disclosure;

[0024] Figure 4 This is a schematic diagram of a motion path update provided in an embodiment of this disclosure;

[0025] Figure 5 This is a schematic diagram illustrating the correspondence between the two-dimensional coordinates of facial feature points and the current movement direction of the displayed object, provided in an embodiment of this disclosure.

[0026] Figure 6 This is a structural block diagram of a motion control device for displaying an object provided in an embodiment of this disclosure;

[0027] Figure 7 This is a structural block diagram of an electronic device provided in an embodiment of this disclosure;

[0028] Figure 8 This is a structural block diagram of another electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0029] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.

[0030] As described in the background section, existing technologies suffer from the problem of monotonous movement of the displayed object. After analyzing the prior art, the inventors discovered that one reason for this problem is that the relative positional relationship between the feature points and the displayed object remains constant. This results in the displayed object's movement always mirroring facial movements, leading to a lack of variation in the object's motion.

[0031] Figure 1 This is a schematic diagram illustrating the relative positional relationship between feature point locations and displayed objects in existing technology. (Refer to...) Figure 1 As shown, at time t1, the displayed object is located to the lower right of the feature point position, and at time t2, the displayed object is still located to the lower right of the feature point position, and the relative positional relationship between the two is consistent.

[0032] To address the aforementioned problems, embodiments of this disclosure propose diversifying the motion of the display object by diversifying the relative positional relationship between the face and the display object. To achieve this diversification, facial feature data is first mapped to motion speed, thereby controlling the movement of the display object through the motion speed. Thus, when the facial feature data changes, the motion speed of the display object changes, and this change in motion speed makes the position of the display object after movement uncertain, thereby diversifying the relative positional relationship between the display object and the face.

[0033] The technical solutions of the present disclosure and how the technical solutions of the present disclosure solve the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of the present disclosure will now be described with reference to the accompanying drawings.

[0034] Figure 2 This is a flowchart illustrating the steps of a motion control method for a displayed object according to an embodiment of this disclosure. The displayed object can be any object displayed on the screen of an electronic device; it can be understood as a virtual object. Optionally, the displayed object can be a 3D (three-dimensional) virtual object. The displayed object varies in different application scenarios. One application scenario of this disclosure is a game scenario, in which a game interface can be displayed on the screen, and the displayed object can be understood as a game character, which can move within the game interface. This movement can be controlled by the player. It should be noted that the application scenarios of this disclosure are not limited to the aforementioned game scenario, and therefore the displayed object is not limited to the aforementioned game character.

[0035] Reference Figure 2 As shown, the motion control method for the displayed object includes:

[0036] S101: Obtain the user's facial feature data.

[0037] Among them, facial feature data is the representation of facial features in the data, and its changes can reflect changes in facial features. It should be noted that facial feature data can be any feature of the face, such as the position of facial feature points, facial rotation angle, etc.

[0038] In this embodiment of the disclosure, facial feature data may include multiple one-dimensional sub-data: two-dimensional coordinate values ​​of facial feature points, facial rotation angle on at least one plane, and the size of the facial region.

[0039] In this context, the two-dimensional coordinates of facial feature points are the components of the coordinate position of the facial feature points in a two-dimensional face image, along with two dimensions. For example, if the coordinate position can be (x, y), then the two-dimensional coordinates of the facial feature points can include both x and y values.

[0040] It should be noted that facial feature points can be any feature point on the face, including but not limited to: eyes, nose, ears, eyebrows, mouth, etc. The position of facial feature points can represent facial movement, and thus the two-dimensional coordinate values ​​of facial feature points can be used to represent facial movement characteristics, which can be used to control the movement of the displayed object.

[0041] The facial rotation angle, a vector representing the rotational state of the face in real 3D space, indicates the magnitude and direction of the user's face rotation. In practical applications, multiple rotation axes can be set in real 3D space, each corresponding to a facial rotation angle to represent the magnitude and direction of rotation around that axis. To represent rotation in each direction using the fewest possible rotation axes, three mutually perpendicular rotation axes can be set in 3D space. Figure 3 This is a schematic diagram of the face rotation angle provided in an embodiment of this disclosure. Figure 3 The three coordinate axes in real three-dimensional space are used as three rotation axes. (Refer to...) Figure 3 As shown, establish as Figure 3 The diagram shows a three-dimensional coordinate system where Pitch, Yaw, and Roll represent rotation angles in three planes. Pitch is the face rotation angle in the YOZ plane, which is the face rotation angle around the x-axis. Yaw is the face rotation angle in the XOZ plane, which is the face rotation angle around the y-axis. Roll is the face rotation angle in the XOY plane, which is the face rotation angle around the z-axis.

[0042] It is understandable that the above-mentioned face rotation angle is used to represent the rotational movement of the face, so that the movement of the displayed object can be controlled by the face rotation angle.

[0043] The aforementioned face rotation angle can be obtained through the following steps: First, the coordinate positions of facial feature points are identified from the face image using a face recognition algorithm; then, the PNP (perspective-n-point) algorithm is performed based on the coordinate positions of the facial feature points and the coordinate positions of preset standard key points to obtain the aforementioned face rotation angle.

[0044] In addition to the facial rotation angle and the two-dimensional coordinates of facial feature points mentioned above, facial feature data can also include the size of the facial region. The size of the facial region can also be extracted from the facial image; it increases as the face moves towards the screen and decreases as the face moves away from the screen. Therefore, the size of the facial region can also be used to represent changes in facial features to control the movement of the displayed object.

[0045] After obtaining the above-mentioned multiple sub-data, the movement speed of the displayed object can be controlled by one or more of the above-mentioned sub-data. For specific control methods, please refer to the description of S102.

[0046] S102: Update the current movement speed of the displayed object based on facial feature data.

[0047] The correspondence between the current movement speed and facial feature data can be arbitrary. For example, when the coordinate position of a facial feature point represents the face moving to the left, the movement speed can be increased; when the coordinate position of a facial feature point represents the face moving to the right, the movement speed can be decreased. As another example, when the facial rotation angle represents the face rotating downwards, the direction of the movement speed can be adjusted downwards; when the facial rotation angle represents the face rotating upwards, the direction of the movement speed can be adjusted upwards, and so on. Of course, the above correspondences are merely examples provided in the embodiments of this disclosure and do not constitute a limitation on the correspondence between the current movement speed and facial feature data.

[0048] In this embodiment, facial feature data can be converted into a target motion speed of the displayed object, and then the current motion speed of the displayed object can be updated according to the target motion speed so that the current motion speed can approximate the target motion speed. The target motion speed can be understood as the expected motion speed of the displayed object. In this way, the current motion speed can be gradually adjusted according to the target motion speed, which can avoid the discontinuity of the displayed object's motion caused by excessively large updates to the current motion speed.

[0049] In this context, both the current velocity and the target velocity of the displayed object are vectors, which can be represented by two-dimensional or three-dimensional vectors to realize the movement of the displayed object in two-dimensional or three-dimensional space. The two-dimensional or three-dimensional space in which the displayed object moves can be understood as a virtual space. Therefore, the process of converting the above facial feature data into target velocity can be described as follows: mapping at least one one-dimensional sub-data of the facial feature data to a component of the target velocity in at least one dimension. That is, for one dimension in the virtual space, the component of the target velocity in that dimension is associated with at least one sub-data.

[0050] It should be noted that, for a given dimension, the component of the target motion velocity in that dimension can be obtained by transforming at least one associated sub-data. This transformation can be linear or non-linear. Thus, compared to directly using the sub-data as the component of the target motion velocity in that dimension, the transformed component can help improve the diversity of the target motion velocity, thereby increasing the motion diversity of the displayed object.

[0051] Of course, compared to linear transformation, nonlinear transformation yields a better diversity of target motion velocities, which can further improve the motion diversity of displayed objects.

[0052] In one example of this embodiment, the sub-data associated with the components of the target motion velocity in each dimension is: the two-dimensional coordinate values ​​of facial feature points. For example, the values ​​of the facial feature point coordinates in the first dimension can be converted as the components of the target motion velocity in the first dimension, and the values ​​of the facial feature point coordinates in the second dimension can be converted as the components of the target motion velocity in the third dimension.

[0053] Furthermore, the component of the target motion velocity in the second dimension can be set to 0, thus obtaining the target motion velocity V1 = (f1(x1), 0, f2(y1)). Here, x1 is the value of the facial feature point coordinates in the first dimension, and y1 is the value of the facial feature point coordinates in the second dimension. f1 is a linear or non-linear function transforming x1, and f2 is a linear or non-linear function transforming y1. In this way, the motion velocity of the displayed object can be controlled by the motion of the facial feature points.

[0054] Alternatively, the dimensions of the facial region can be transformed into a component of the target motion velocity in the second dimension, thus obtaining the target motion velocity V1 = (f1(x1), f3(s), f2(y1)), where s is the dimension of the facial region, and f3 is a linear or nonlinear function that transforms s. f1, f2, and f3 can be the same or different. In this way, in addition to controlling the motion velocity of the displayed object through the motion of facial feature points, the motion velocity of the displayed object can also be controlled by the facial dimensions, allowing control of the displayed object's motion velocity even when the face is facing or moving away from the screen.

[0055] In another example of this embodiment, the sub-data associated with the three-dimensional components of the target motion velocity is: at least one facial rotation angle in a plane. For example, it can be... Figure 3 The facial rotation angle Roll in the image is converted into the component of the target motion velocity in the first dimension. Figure 3The facial rotation angle Yaw is converted into a component of the target motion velocity in the second dimension. Figure 3 The face rotation angle (Pitch) is converted into a component of the target motion velocity in the third dimension. Thus, the motion velocity of the displayed object can be controlled by rotating the face.

[0056] After obtaining the target velocity, the current velocity can be updated to approximate the target velocity based on the relationship between the current velocity and the target velocity. Specifically, for any dimension in three-dimensional space, it is determined whether the component of the target velocity in that dimension is greater than the component of the current velocity in that dimension. If it is greater, the component of the current velocity in that dimension is increased by a preset first acceleration, where the first acceleration is greater than 0. If it is less, the component of the current velocity in that dimension is decreased by a preset second acceleration, where the second acceleration is less than 0.

[0057] Since the magnitudes of the current velocity and the target velocity may differ across different dimensions, it's necessary to update the component of the current velocity in each dimension based on their relative magnitudes. For example, if the component of the current velocity in the first dimension is greater than that of the target velocity in the first dimension, then the component of the current velocity in the first dimension needs to be decreased. Conversely, if the component of the current velocity in the second dimension is less than that of the target velocity in the second dimension, then the component of the current velocity in the second dimension needs to be increased.

[0058] As can be seen, compared to updating the components of the current motion speed in the same way in each dimension, the embodiments of this disclosure update each dimension separately, which can update the current motion speed more accurately and make the current motion speed better approximate the target motion speed.

[0059] It should be noted that the first acceleration mentioned above is used to increase the current velocity, and the second acceleration is used to decrease the current velocity. In practical applications, the acceleration in each dimension can be different to further increase the diversity of motion velocities.

[0060] The first and second accelerations mentioned above can be set according to the time interval between two adjacent frames. When the time interval is large, the first acceleration can be set to a larger value. When the time interval is small, the first acceleration can be set to a smaller value. The setting of the second acceleration is the same as that of the first acceleration, and will not be repeated here.

[0061] S103: Control the movement of the displayed object in the display interface according to the updated current motion speed.

[0062] It is understandable that the display interface described above will differ in different application scenarios. For example, in a gaming application scenario, the display interface can be the game interface.

[0063] Specifically, first, the product of the updated current motion speed and the time interval between two adjacent frames is determined as the motion vector of the display object; then, the sum of the coordinate position of the display object in the current image and the motion vector is determined as the coordinate position of the display object in the next frame image, so that the display object can be displayed in the next frame image.

[0064] The displayed object needs to move along a pre-generated path, which can be understood as a game process. During the game, the user needs to control the displayed object to move along the path; if the displayed object deviates from the path, the game is considered lost.

[0065] The motion path described above can be generated by following these steps: First, obtain a preset number of path components; then, generate the motion path of the display object using the path components.

[0066] The path component is a software object used to generate motion paths, and these path components can be concatenated in sequence to form motion paths. This embodiment of the disclosure can generate motion paths using a preset number of path components, which can save computer resources and increase the sense of urgency in the game.

[0067] The process of assembling motion paths using the aforementioned path components can be divided into three stages.

[0068] In the first stage, a motion path is generated by any one of the preset number of path components. At this time, the motion path only includes this one path component, and the position of the path component can be randomly determined.

[0069] After assembling the first path component, the remaining unused path components can be assembled sequentially to obtain the motion path, which is the second stage.

[0070] In the second stage, the preset number of path components has not yet been used up. That is, if there are unused path components among the preset number of path components, an unused path component is identified as the target path component, and the target path component is spliced ​​to a target adjacent position of the farthest path component of the motion path to obtain the updated motion path.

[0071] In the third stage, the preset number of path components has been used up. If there are no unused path components among the preset number, the nearest path component of the motion path is determined as the target path component. This target path component is then stitched to a target adjacent position of the farthest path component of the motion path to obtain the updated motion path. The nearest path component is the path component with the longest target stitching time. The target stitching time for each path component is the time corresponding to the most recent stitching of the corresponding path component into the motion path. The farthest path component is the path component with the shortest target stitching time.

[0072] As can be seen, except for the first path component, the splicing process of the other path components is the same, and the process of generating the motion path is the process of splicing all the path components in sequence.

[0073] For any target path component among the remaining path components, its corresponding target adjacent position can be any adjacent position of the farthest path component. To enhance the game's appeal, the target adjacent position can be randomly selected from multiple adjacent positions of the farthest path component. Adjacent positions can include, but are not limited to: front, back, left, right, right front, right back, left front, and left back.

[0074] Specifically, each time a target adjacent position is selected, a random number is generated, and the adjacent position corresponding to the value interval of this random number is determined as the target adjacent position. The correspondence between the value interval and the adjacent position is predetermined. For example, if the random number ranges from 0 to 1, the range can be divided into 8 value intervals, corresponding to the following adjacent positions: front, back, left, right, right front, right back, left front, and left back. Thus, if the generated random number falls within the value interval corresponding to "front," then "front" can be considered the target adjacent position.

[0075] In practical applications, the lengths of the value intervals corresponding to different adjacent positions can be different. This allows the selection of the preferred adjacent position to be adjusted by changing the length of the value interval. For example, the length of the value interval corresponding to "forward" can be set to the maximum, thus prioritizing "forward" as the target adjacent position and causing the displayed object to move forward first.

[0076] Understandably, in the second stage described above, unused path components can be joined together until all path components are used. However, in the third stage, since all path components have been used, it's necessary to decide when to update the motion path. If the displayed object has a long unvisited section in the current motion path, updating the motion path may not be necessary to reduce computation and conserve computer resources. If the displayed object has a short unvisited section in the current motion path, not updating the motion path could prevent the displayed object from continuing to move, leading to an abnormal game termination.

[0077] In summary, the movement path can be updated when the length of the untraveled segment in the current movement path is appropriate. This not only minimizes computational load and conserves computer resources, but also ensures that the displayed object has a path to follow, preventing abnormal game termination.

[0078] Specifically, based on the current coordinates of the displayed object, it can be determined whether the displayed object is located at the target middle position of the motion path. When the displayed object is located at the target middle position of the motion path, the target path component is spliced ​​to a target adjacent position of the farthest path component of the motion path. The target middle position includes all other positions outside the farthest path component of the motion path.

[0079] The target's center position can be the center between the farthest and nearest path components. The farthest and nearest path components are located at the start and end positions of the current motion path, respectively, and are updated as the motion path is updated. For example, if the current motion path is composed of A1, A2, A3, A4, and A5, with A1 as the nearest path component and A5 as the farthest, then if A1 is appended to the target's adjacent position after A5, the nearest path component updates to A2, and the farthest path component updates to A1.

[0080] As can be seen from the foregoing description, the aforementioned target adjacent locations are randomly selected from at least one adjacent location of the farthest path component. Optionally, the process of randomly selecting target adjacent locations from at least one adjacent location may include:

[0081] First, obtain at least one adjacent position of the farthest path component of the motion path.

[0082] Then, it is determined whether there is at least one candidate position among at least one adjacent position, and the candidate position includes at least one of the following: a position other than the current position of each path component, or a position that has at most one adjacent edge to the motion path.

[0083] Finally, if at least one candidate position exists among at least one neighboring position, then one position is randomly selected from the at least one candidate position as the target neighboring position. If no candidate position exists among at least one neighboring position, then it is determined that there is no target neighboring position, and the movement path cannot be updated.

[0084] As can be seen, the embodiments of this disclosure can splice the target path component to the target adjacent position randomly selected from the candidate positions.

[0085] When the candidate position is outside the motion path, overlapping paths can be avoided. When the candidate position has at most one adjacent edge to the motion path, paths with double the width can be avoided, which helps to save path components.

[0086] Figure 4 This is a schematic diagram illustrating the updating of a motion path according to an embodiment of this disclosure. (Refer to...) Figure 4 As shown, the motion path is obtained by sequentially piecing together A1, A2, A3, and A4. At this point, the target path component A5 can be pieced together to a target adjacent position of A4. When selecting a target adjacent position, first obtain the adjacent positions of A4: L1 to L6, the position of A2, and the position of A3. Then, select positions outside the motion path and positions that have at most one adjacent edge to the motion path from these adjacent positions, resulting in candidate positions: L2, L3, L4, L5, and L6. Therefore, a target adjacent position can be randomly selected from the candidate positions to piece together A5.

[0087] It can be seen from the above Figure 4 The process shown avoids A5 being spliced ​​to the positions of A2 and A3, preventing the motion path from overlapping at the locations of A2 or A3. It also avoids splicing A5 to L1, thus preventing the motion path from being twice the width of A2, A3, A4, and A4 at L1, saving path components and improving their effective utilization.

[0088] In this embodiment of the disclosure, the correspondence between facial feature data and current movement speed can also be displayed on the display interface. This helps the user better control the movement of the displayed object based on this correspondence.

[0089] For the facial feature data mentioned above, when the facial feature data is the two-dimensional coordinates of facial feature points, the vector from the origin of the two-dimensional coordinate system to the facial feature point can be displayed. When the facial feature data is the facial rotation angle, the direction and / or angle of facial rotation can be displayed.

[0090] For the aforementioned current motion speed, the current motion speed can be displayed at the current position of the displayed object, including at least one of the following: the direction of the current motion speed and the magnitude of the current motion speed.

[0091] Figure 5 This is a schematic diagram illustrating the correspondence between the two-dimensional coordinates of facial feature points and the current movement direction of the displayed object, provided in an embodiment of this disclosure. (Refer to...) Figure 5 As shown, V1 is the vector from the origin O to the facial feature point P1, and V2 is the current motion speed of the displayed object at its current position P2.

[0092] Corresponding to the motion control method of the display object in the above embodiment, Figure 6 This is a structural block diagram of a motion control device for displaying an object, provided in an embodiment of this disclosure. For ease of explanation, only the parts relevant to the embodiments of this disclosure are shown. (Refer to...) Figure 6 The motion control device 200 for the displayed object includes: a feature data acquisition module 201, a motion speed update module 202, and a motion control module 203.

[0093] Among them, the feature data acquisition module 201 is used to acquire the user's facial feature data.

[0094] The motion speed update module 202 is used to update the current motion speed of the displayed object based on the facial feature data.

[0095] The motion control module 203 is used to control the movement of the display object in the display interface according to the updated current motion speed.

[0096] Optionally, the motion speed update module 202 is further configured to:

[0097] The facial feature data is converted into the target motion speed of the displayed object.

[0098] The current motion speed of the displayed object is updated based on the target motion speed.

[0099] Optionally, the facial feature data includes at least one of the following one-dimensional sub-data: two-dimensional coordinates of facial feature points, facial rotation angle on at least one plane, and the size of the facial region; the target motion velocity includes components in at least two dimensions, and at least one component in said dimension is associated with at least one of the sub-data.

[0100] Optionally, the motion speed update module 202 is further configured to:

[0101] For one of the dimensions, at least one of the sub-data is transformed into a component of the target motion velocity in the dimension, and the transformation includes at least one of the following: linear transformation and nonlinear transformation.

[0102] Optionally, the motion speed update module 202 is further configured to:

[0103] For a given dimension, if the component of the target motion velocity in that dimension is greater than the component of the current motion velocity in that dimension, then the component of the current motion velocity in that dimension is increased by a preset first acceleration, wherein the first acceleration is greater than 0.

[0104] If the component of the target velocity in the dimension is less than the component of the current velocity in the dimension, then the component of the current velocity in the dimension is reduced by a preset second acceleration, wherein the second acceleration is less than 0.

[0105] Optionally, the device further includes:

[0106] The path component acquisition module is used to acquire a preset number of path components.

[0107] A motion path generation module is used to generate the motion path of the display object through the path component.

[0108] Optionally, the motion path generation module is further configured to:

[0109] The motion path is generated through one of the path components.

[0110] If there are unused path components among the preset number of path components, then one of the unused path components will be identified as the target path component;

[0111] If there are no unused path components among the preset number of path components, the nearest path component of the motion path is determined as the target path component. The nearest path component is the path component with the longest target splicing time. The target splicing time of each path component is the time corresponding to the most recent splicing of the corresponding path component into the motion path.

[0112] The target path component is spliced ​​to a target adjacent position of the farthest path component of the motion path to obtain the updated motion path. The farthest path component is the path component with the shortest target splicing time.

[0113] Optionally, the motion path generation module is further configured to:

[0114] When the displayed object is located at the target middle position of the motion path, the target path component is spliced ​​to a target adjacent position of the farthest path component of the motion path, and the target middle position includes the remaining positions in the motion path other than the farthest path component.

[0115] Optionally, the motion path generation module is further configured to:

[0116] Obtain at least one adjacent position of the farthest path component of the motion path.

[0117] If there is at least one candidate position among the at least one adjacent positions, then one position is randomly selected from the at least one candidate position as the target adjacent position. The at least one candidate position includes at least one of the following: a position other than the current position of each path component, or a position that has at most one adjacent edge to the motion path.

[0118] The target path component is attached to the adjacent position of the target.

[0119] Optionally, the device further includes:

[0120] The correspondence display module is used to display the correspondence between the facial feature data and the current movement speed.

[0121] Optionally, the components of the target motion speed in the three dimensions are: the two-dimensional coordinates of the facial feature points and the size of the facial region; or, the components of the target motion speed in the three dimensions are: the facial rotation angle on at least one plane.

[0122] This embodiment provides a motion control device for a displayed object, which can be used to perform the above-described actions. Figure 2 The technical solutions of the method embodiments shown are similar in implementation principle and technical effect, and will not be described again here.

[0123] Figure 7 This is a structural block diagram of an electronic device 600 provided in an embodiment of the present disclosure. The electronic device 600 includes a memory 602 and at least one processor 601.

[0124] Among them, memory 602 stores computer-executed instructions.

[0125] At least one processor 601 executes computer execution instructions stored in memory 602, causing electronic device 601 to perform the aforementioned functions. Figure 2 The method in the middle.

[0126] In addition, the electronic device may also include a receiver 603 and a transmitter 604, wherein the receiver 603 is used to receive information from other devices or equipment and forward it to the processor 601, and the transmitter 604 is used to send information to other devices or equipment.

[0127] Further, refer to Figure 8The diagram illustrates a structural schematic of an electronic device 900 suitable for implementing embodiments of the present disclosure. This electronic device 900 can be a terminal device. The terminal device can include, but is not limited to, mobile terminals such as mobile phones, laptops, digital radio receivers, personal digital assistants (PDAs), portable Android devices (PADs), portable media players (PMPs), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. Figure 8 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0128] like Figure 8 As shown, the electronic device 900 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 into a random access memory (RAM) 903. The RAM 903 also stores various programs and data required for the operation of the electronic device 900. The processing unit 901, ROM 902, and RAM 903 are interconnected via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0129] Typically, the following devices can be connected to I / O interface 905: input devices 906 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 907 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 908 including, for example, magnetic tapes, hard disks, etc.; and communication devices 909. Communication device 909 allows electronic device 900 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 8 An electronic device 900 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0130] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 909, or installed from a storage device 908, or installed from a ROM 902. When the computer program is executed by a processing device 901, it performs the functions defined in the methods of embodiments of this disclosure.

[0131] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0132] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0133] The aforementioned computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to perform the methods shown in the above embodiments.

[0134] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0135] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0136] The units described in the embodiments of this disclosure can be implemented in software or in hardware. The name of a unit does not necessarily limit the unit itself; for example, the first acquisition unit can also be described as "a unit that acquires at least two Internet Protocol addresses".

[0137] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0138] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0139] In a first example of the first aspect, embodiments of this disclosure provide a motion control method for a displayed object, comprising:

[0140] Obtain the user's facial feature data.

[0141] The current movement speed of the displayed object is updated based on the facial feature data.

[0142] The display object is controlled to move within the display interface based on the updated current motion speed.

[0143] Based on the first example of the first aspect, in the second example of the first aspect, updating the current motion speed of the displayed object according to the facial feature data includes:

[0144] The facial feature data is converted into the target motion speed of the displayed object.

[0145] The current motion speed of the displayed object is updated based on the target motion speed.

[0146] Based on the second example of the first aspect, in the third example of the first aspect, the facial feature data includes at least one of the following one-dimensional sub-data: two-dimensional coordinate values ​​of facial feature points, facial rotation angle on at least one plane, and size of facial region; the target motion velocity includes components in at least two dimensions, and at least one component in said dimension is associated with at least one of said sub-data.

[0147] Based on the third example of the first aspect, in the fourth example of the first aspect, the step of converting the facial feature data into the target motion velocity of the displayed object includes:

[0148] For one of the dimensions, at least one of the sub-data is transformed into a component of the target motion velocity in the dimension, and the transformation includes at least one of the following: linear transformation and nonlinear transformation.

[0149] Based on the third or fourth example of the first aspect, in the fifth example of the first aspect, updating the current motion speed of the display object according to the target motion speed includes:

[0150] For a given dimension, if the component of the target motion velocity in that dimension is greater than the component of the current motion velocity in that dimension, then the component of the current motion velocity in that dimension is increased by a preset first acceleration, wherein the first acceleration is greater than 0.

[0151] If the component of the target velocity in the dimension is less than the component of the current velocity in the dimension, then the component of the current velocity in the dimension is reduced by a preset second acceleration, wherein the second acceleration is less than 0.

[0152] Based on the first to fourth examples of the first aspect, in the sixth example of the first aspect, the method further includes:

[0153] Get a preset number of path components.

[0154] The path component generates the motion path of the displayed object.

[0155] Based on the sixth example of the first aspect, in the seventh example of the first aspect, generating the motion path of the display object through the path component includes:

[0156] The motion path is generated through one of the path components.

[0157] If there are unused path components among the preset number of path components, then one of the unused path components will be determined as the target path component.

[0158] If there are no unused path components among the preset number of path components, the nearest path component of the motion path is determined as the target path component. The nearest path component is the path component with the longest target splicing time. The target splicing time of each path component is the time corresponding to the most recent splicing of the corresponding path component into the motion path.

[0159] The target path component is spliced ​​to a target adjacent position of the farthest path component of the motion path to obtain the updated motion path. The farthest path component is the path component with the shortest target splicing time.

[0160] Based on the seventh example of the first aspect, in the eighth example of the first aspect, the step of splicing the target path component to a target adjacent position of the farthest path component of the motion path includes:

[0161] When the displayed object is located at the target middle position of the motion path, the target path component is spliced ​​to a target adjacent position of the farthest path component of the motion path, and the target middle position includes the remaining positions in the motion path other than the farthest path component.

[0162] Based on the eighth example of the first aspect, in the ninth example of the first aspect, the step of splicing the target path component to a target adjacent position of the farthest path component of the motion path includes:

[0163] Obtain at least one adjacent position of the farthest path component of the motion path.

[0164] If there is at least one candidate position among the at least one adjacent positions, then one position is randomly selected from the at least one candidate position as the target adjacent position. The at least one candidate position includes at least one of the following: a position other than the current position of each path component, or a position that has at most one adjacent edge to the motion path.

[0165] The target path component is attached to the adjacent position of the target.

[0166] Based on the second to fourth examples of the first aspect, in the tenth example of the first aspect, the method further includes:

[0167] This displays the correspondence between the facial feature data and the current movement speed.

[0168] Based on the third example of the first aspect, in the eleventh example of the first aspect, the components of the target motion speed in three dimensions are: the two-dimensional coordinate values ​​of the facial feature points and the size of the facial region; or, the components of the target motion speed in three dimensions are: the facial rotation angle on at least one plane.

[0169] In a first example of the second aspect, this disclosure provides a motion control device for a displayed object, the device comprising:

[0170] The feature data acquisition module is used to acquire the user's facial feature data.

[0171] The motion speed update module is used to update the current motion speed of the displayed object based on the facial feature data.

[0172] The motion control module is used to control the movement of the displayed object in the display interface according to the updated current motion speed.

[0173] Based on the first example of the second aspect, in the second example of the second aspect, the motion speed update module is further configured to:

[0174] The facial feature data is converted into the target motion speed of the displayed object.

[0175] The current motion speed of the displayed object is updated based on the target motion speed.

[0176] Based on the second example of the second aspect, in the third example of the second aspect, the facial feature data includes at least one of the following one-dimensional sub-data: two-dimensional coordinate values ​​of facial feature points, facial rotation angle on at least one plane, and size of facial region; the target motion velocity includes components in at least two dimensions, and at least one component in said dimension is associated with at least one of said sub-data.

[0177] Based on the third example of the second aspect, in the fourth example of the second aspect, the motion speed update module is further used for:

[0178] For one of the dimensions, at least one of the sub-data is transformed into a component of the target motion velocity in the dimension, and the transformation includes at least one of the following: linear transformation and nonlinear transformation.

[0179] Based on the third or fourth example of the second aspect, in the fifth example of the second aspect, the motion speed update module is further configured to:

[0180] For a given dimension, if the component of the target motion velocity in that dimension is greater than the component of the current motion velocity in that dimension, then the component of the current motion velocity in that dimension is increased by a preset first acceleration, wherein the first acceleration is greater than 0.

[0181] If the component of the target velocity in the dimension is less than the component of the current velocity in the dimension, then the component of the current velocity in the dimension is reduced by a preset second acceleration, wherein the second acceleration is less than 0.

[0182] Based on the first to fourth examples of the second aspect, in the sixth example of the second aspect, the device further includes:

[0183] The path component acquisition module is used to acquire a preset number of path components.

[0184] A motion path generation module is used to generate the motion path of the display object through the path component.

[0185] Based on the sixth example of the second aspect, in the seventh example of the second aspect, the motion path generation module is further configured to:

[0186] The motion path is generated through one of the path components.

[0187] If there are unused path components among the preset number of path components, then one of the unused path components will be determined as the target path component.

[0188] If there are no unused path components among the preset number of path components, the nearest path component of the motion path is determined as the target path component. The nearest path component is the path component with the longest target splicing time. The target splicing time of each path component is the time corresponding to the most recent splicing of the corresponding path component into the motion path.

[0189] The target path component is spliced ​​to a target adjacent position of the farthest path component of the motion path to obtain the updated motion path. The farthest path component is the path component with the shortest target splicing time.

[0190] Based on the seventh example of the second aspect, in the eighth example of the second aspect, the motion path generation module is further configured to:

[0191] When the displayed object is located at the target middle position of the motion path, the target path component is spliced ​​to a target adjacent position of the farthest path component of the motion path, and the target middle position includes the remaining positions in the motion path other than the farthest path component.

[0192] Based on the eighth example of the second aspect, in the ninth example of the second aspect, the motion path generation module is further configured to:

[0193] Obtain at least one adjacent position of the farthest path component of the motion path.

[0194] If there is at least one candidate position among the at least one adjacent positions, then one position is randomly selected from the at least one candidate position as the target adjacent position. The at least one candidate position includes at least one of the following: a position other than the current position of each path component, or a position that has at most one adjacent edge to the motion path.

[0195] The target path component is attached to the adjacent position of the target.

[0196] Based on the second to fourth examples of the second aspect, in the tenth example of the second aspect, the device further includes:

[0197] The correspondence display module is used to display the correspondence between the facial feature data and the current movement speed.

[0198] Based on the third example of the second aspect, in the eleventh example of the second aspect, the components of the target motion speed in three dimensions are: the two-dimensional coordinate values ​​of the facial feature points, the size of the facial region, or the components of the target motion speed in three dimensions are: the facial rotation angle on at least one plane.

[0199] Thirdly, according to one or more embodiments of the present disclosure, an electronic device is provided, comprising: at least one processor and a memory;

[0200] The memory stores computer-executed instructions;

[0201] The at least one processor executes computer execution instructions stored in the memory, causing the electronic device to implement the method described in any of the first aspects.

[0202] Fourthly, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, the computer-readable storage medium storing computer-executable instructions that, when executed by a processor, cause a computing device to implement the method described in any one of the first aspects.

[0203] Fifthly, according to one or more embodiments of the present disclosure, a computer program is provided for implementing the method described in any of the first aspects.

[0204] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0205] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0206] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A method for controlling the motion of a displayed object, characterized in that, The method includes: Obtain the user's facial feature data; The current movement speed of the displayed object is updated based on the facial feature data; Controlling the movement of the displayed object within the display interface based on the updated current motion speed; updating the current motion speed of the displayed object based on the facial feature data includes: The facial feature data is converted into the target motion speed of the displayed object; The current motion speed of the displayed object is updated according to the target motion speed; the facial feature data includes at least one of the following one-dimensional sub-data: two-dimensional coordinate values ​​of facial feature points, at least one facial rotation angle on a plane, and the size of the facial region; The target motion velocity includes components in at least two dimensions, and at least one component in one dimension is associated with at least one of the sub-data. Updating the current motion speed of the displayed object based on the target motion speed includes: For a given dimension, if the component of the target motion velocity in that dimension is greater than the component of the current motion velocity in that dimension, then the component of the current motion velocity in that dimension is increased by a preset first acceleration, wherein the first acceleration is greater than 0. If the component of the target velocity in the dimension is less than the component of the current velocity in the dimension, then the component of the current velocity in the dimension is reduced by a preset second acceleration, wherein the second acceleration is less than 0.

2. The method according to claim 1, characterized in that, The step of converting the facial feature data into the target motion speed of the displayed object includes: For one of the dimensions, at least one of the sub-data is transformed into a component of the target motion velocity in the dimension, and the transformation includes at least one of the following: linear transformation and nonlinear transformation.

3. The method according to claim 1 or 2, characterized in that, The method further includes: Get a preset number of path components; The path component generates the motion path of the displayed object.

4. The method according to claim 3, characterized in that, The step of generating the motion path of the display object through the path component includes: The motion path is generated through one of the path components; If there are unused path components among the preset number of path components, then one of the unused path components will be identified as the target path component; If there are no unused path components among the preset number of path components, the nearest end road component of the motion path is determined as the target path component. The nearest end path component is the path component with the longest target splicing time. The target splicing time of each path component is the time corresponding to the most recent time when the corresponding path component was spliced ​​into the motion path. The target path component is spliced ​​to a target adjacent position of the farthest path component of the motion path to obtain the updated motion path. The farthest path component is the path component with the shortest target splicing time.

5. The method according to claim 4, characterized in that, The step of attaching the target path component to a target adjacent position of the farthest path component of the motion path includes: When the displayed object is located at the target middle position of the motion path, the target path component is spliced ​​to a target adjacent position of the farthest path component of the motion path, and the target middle position includes the remaining positions in the motion path other than the farthest path component.

6. The method according to claim 5, characterized in that, The step of attaching the target path component to a target adjacent position of the farthest path component of the motion path includes: Obtain at least one adjacent position of the farthest path component of the motion path; If there is at least one candidate position among the at least one adjacent positions, then one position is randomly selected from the at least one candidate position as the target adjacent position. The at least one candidate position includes at least one of the following: a position other than the current position of each path component, or a position that has at most one adjacent edge to the motion path. The target path component is attached to the adjacent position of the target.

7. The method according to claim 1 or 2, characterized in that, The method further includes: This displays the correspondence between the facial feature data and the current movement speed.

8. The method according to claim 1, characterized in that, The components of the target's motion velocity in three dimensions are: the two-dimensional coordinates of the facial feature points, and the size of the facial region; Alternatively, the target motion velocity has three components in three dimensions: at least one facial rotation angle on a plane.

9. A motion control device for displaying an object, characterized in that, The device includes: The feature data acquisition module is used to acquire the user's facial feature data; The motion speed update module is used to update the current motion speed of the displayed object based on the facial feature data; The motion control module is used to control the movement of the display object in the display interface according to the updated current motion speed; The motion speed update module is also used for: The facial feature data is converted into the target motion speed of the displayed object; Update the current motion speed of the displayed object according to the target motion speed; The facial feature data includes at least one of the following one-dimensional sub-data: two-dimensional coordinates of facial feature points, at least one facial rotation angle on a plane, and the size of the facial region; The target motion velocity includes components in at least two dimensions, and at least one component in one dimension is associated with at least one of the sub-data. The motion speed update module is also used for: For a given dimension, if the component of the target motion velocity in that dimension is greater than the component of the current motion velocity in that dimension, then the component of the current motion velocity in that dimension is increased by a preset first acceleration, wherein the first acceleration is greater than 0. If the component of the target velocity in the dimension is less than the component of the current velocity in the dimension, then the component of the current velocity in the dimension is reduced by a preset second acceleration, wherein the second acceleration is less than 0.

10. An electronic device, characterized in that, include: At least one processor and memory; The memory stores computer-executed instructions; The at least one processor executes computer execution instructions stored in the memory, causing the electronic device to perform the method as described in any one of claims 1 to 8.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, cause a computing device to implement the method as described in any one of claims 1 to 8.

12. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method as described in any one of claims 1 to 8.

Images