Interactive methods, devices, storage media, and electronic devices for motion-sensing tasks

By displaying the outline of the target object's posture on the interactive interface and filling in the content when it collides with virtual objects, the problem of reduced interactive participation in motion-sensing tasks is solved, and a more intuitive task completion experience is achieved.

CN117115394BActive Publication Date: 2026-11-17TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202210529374.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-05-16
Publication Date
2026-11-17
Estimated Expiration
2042-05-16

AI Technical Summary

Technical Problem

Current motion-sensing tasks require remote control operation, which reduces user engagement and makes it impossible for them to fully participate and intuitively perceive the task completion rate.

Method used

The target object's pose outline is displayed on the interactive interface, and its internal content is filled when it collides with a virtual object, until the task completion conditions are met and a prompt message is displayed.

Benefits of technology

It enhances the interactive engagement of motion-sensing tasks, allowing users to more intuitively perceive their task completion status and improving the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117115394B_ABST
    Figure CN117115394B_ABST
Patent Text Reader

Abstract

This application discloses an interactive method, apparatus, storage medium, and electronic device for motion-sensing tasks. The method includes: displaying a pose outline of the target object on an interactive interface during the participation of the target object in the target motion-sensing task; wherein the pose outline is a virtual outline obtained by contour recognition of an image containing the target object, and the interior of the pose outline is in a state of unfilled state; filling the interior of the pose outline with content when it collides with at least one virtual object appearing in the interactive interface; and displaying a task completion prompt when the filling progress of the pose outline reaches the completion condition of the target motion-sensing task. This application solves the technical problem of low interactive efficiency in motion-sensing tasks.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of computers, and more specifically, to an interactive method, apparatus, storage medium, and electronic device for motion-sensing tasks. Background Technology

[0002] In related technologies, motion-sensing tasks typically require remote control devices to operate virtual characters. However, this method reduces the user's sense of interactive participation in the task, preventing them from fully engaging in the execution process and intuitively sensing the completion of the task. Therefore, there is a problem of reduced interactive participation in motion-sensing tasks.

[0003] There is currently no effective solution to the above problems. Summary of the Invention

[0004] This application provides an interactive method, apparatus, storage medium, and electronic device for motion-sensing tasks, to at least address the technical problem of reduced interactive engagement in motion-sensing tasks.

[0005] According to one aspect of the embodiments of this application, an interactive method for a motion-sensing task is provided, comprising: displaying a pose outline of the target object on an interactive interface during the participation of the target object in the target motion-sensing task, wherein the pose outline is a virtual outline obtained by contour recognition of an image containing the target object, and the interior of the pose outline is in a state of unfilled; filling the interior of the pose outline with content when the pose outline collides with at least one virtual object appearing in the interactive interface; and displaying a task completion prompt message when the filling progress of the pose outline reaches the completion condition of the target motion-sensing task.

[0006] According to another aspect of the embodiments of this application, an interactive device for a motion-sensing task is also provided, comprising: a first display unit, configured to display the posture outline of the target object on an interactive interface during the participation of the target object in the target motion-sensing task, wherein the posture outline is a virtual outline obtained by contour recognition of an image containing the target object, and the interior of the posture outline is in a state of unfilled; a first filling unit, configured to fill the interior of the posture outline with content when the posture outline collides with at least one virtual object appearing in the interactive interface; and a second display unit, configured to display a task completion prompt message when the filling progress of the interior of the posture outline reaches the completion condition of the target motion-sensing task.

[0007] As an optional solution, the first filling unit includes: a first display module, used to fill the interior of the pose outline with content and display a target identifier to be activated when the pose outline collides with at least one virtual object and the interior filling progress has not reached the completion condition of the target haptic task.

[0008] As an optional solution, the second display unit includes: a second display module, used to display the target prompt information and activate the target identifier when the internal filling progress reaches the completion condition of the target haptic task.

[0009] As an optional solution, the above-mentioned device includes: a first acquisition unit, configured to, when the pose outline collides with at least one virtual object appearing in the interactive interface, fill the interior of the pose outline with content, and then, when the pose outline collides with at least one virtual object, acquire collision attribute information of the at least one virtual object; and a second filling unit, configured to, when the pose outline collides with at least one virtual object appearing in the interactive interface, fill the interior of the pose outline with content according to the collision attribute information.

[0010] As an optional solution, the second filling unit includes: a first filling module, configured to, when the collision attribute information includes positive filling attribute information, obtain a first quantity of the positive filling attribute information and fill the interior of the posture outline with a first capacity of content, wherein the first capacity is positively correlated with the first quantity; and a second filling module, configured to, when the collision attribute information includes negative filling attribute information, obtain a second quantity of the negative filling attribute information and deduct the interior of the posture outline with a second capacity of content, wherein the second capacity is positively correlated with the second quantity.

[0011] As an optional solution, the second filling unit includes: a third filling module, used to fill the interior of the pose outline contour with content corresponding to the first filling attribute information when the collision attribute information includes the first filling attribute information of the first virtual object; and a fourth filling module, used to fill the interior of the pose outline contour with content corresponding to the second filling attribute information when the collision attribute information includes the second filling attribute information of the second virtual object, wherein the content filling corresponding to the first filling attribute information is different from the content filling corresponding to the second filling attribute information.

[0012] As an optional solution, the first filling unit includes a fifth filling module, which is used to sequentially fill at least two internal regions of the pose outline when the pose outline collides with at least one virtual object.

[0013] As an optional solution, the first filling unit includes: a sixth filling module, used to fill the first internal region with content when the first part of the pose outline collides with at least one virtual object and the filling progress of the first internal region of the pose outline has not reached a first threshold, wherein the first part outline is associated with the first internal region and the first part outline corresponds to the first entity part of the target object; and a seventh filling module, used to fill the second internal region with content when the second part of the pose outline collides with at least one virtual object and the filling progress of the second internal region of the pose outline has not reached a second threshold, wherein the second part outline is associated with the second internal region and the second part outline corresponds to the second entity part of the target object.

[0014] As an optional solution, the first filling unit includes: an eighth filling module, used to fill the interior of the pose outline with content using a first-form filling element when the pose outline collides with at least one virtual object and the interior filling progress reaches a first filling threshold; and a ninth filling module, used to remove the already filled first-form filling element and fill the interior of the pose outline with content using a second-form filling element when the pose outline collides with at least one virtual object and the interior filling progress reaches a second filling threshold, wherein the second filling threshold is greater than the first filling threshold.

[0015] As an optional solution, the above-mentioned device includes: a first removal unit, configured to generate N virtual objects in a moving state at an initial position on the interactive interface after the pose outline of the target object is displayed on the interactive interface during the target object's participation in the target somatosensory task, wherein at least one virtual object includes the N virtual objects in a moving state; a second removal unit, configured to remove virtual objects that collide with the pose outline of the N virtual objects in a moving state after the pose outline of the target object is displayed on the interactive interface during the target object's participation in the target somatosensory task; or, remove virtual objects located outside the interactive interface from the N virtual objects in a moving state.

[0016] As an optional solution, the above-mentioned device includes: an adjustment unit, which, after generating N virtual objects in a moving state at the initial position on the above-mentioned interactive interface, adjusts the moving position of the target virtual objects in the above-mentioned interactive interface in response to a control command triggered by the target account participating in the above-mentioned haptic task on the target virtual objects, wherein the N virtual objects in a moving state include the target virtual objects.

[0017] As an optional solution, the above-mentioned device includes: a data acquisition unit, used to acquire an image of the target object located in the interactive area associated with the target haptic task before the target object's posture outline is displayed on the interactive interface during the target object's participation in the target haptic task, thereby obtaining a target outline image of the target object; a recognition unit, used to perform image recognition on the target outline image before the target object's posture outline is displayed on the interactive interface during the target object's participation in the target haptic task, thereby obtaining an image recognition result; and a second acquisition unit, used to acquire the posture outline based on the image recognition result before the target object's posture outline is displayed on the interactive interface during the target object's participation in the target haptic task.

[0018] As an optional solution, the second acquisition unit includes: a first filtering module, configured to, when the image recognition result includes the overall pixel data of the target outline image, filter out first pixel data from the overall pixel data whose pixel value is less than or equal to a first pixel threshold with respect to the background pixel value; a first construction module, configured to construct the pose outline contour using the first pixel data; or, a second filtering module, configured to, when the image recognition result includes the overall pixel data, filter out second pixel data from the overall pixel data whose pixel value is greater than or equal to a second pixel threshold with respect to the human body pixel value; and a second construction module, configured to construct the pose outline contour using the second pixel data.

[0019] According to another aspect of the embodiments of this application, a computer program product or computer program is provided, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the interactive method for the above-described haptic task.

[0020] According to another aspect of the embodiments of this application, an electronic device is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the above-described interactive method for the somatosensory task through the computer program.

[0021] In this embodiment, during the participation of the target object in a target motion-sensing task, the pose outline of the target object is displayed on the interactive interface. This pose outline is a virtual outline obtained by contour recognition of an image containing the target object, and its interior is in a state of unfilled space. When the pose outline collides with at least one virtual object appearing in the interactive interface, its interior is filled with content. When the filling progress of the pose outline reaches the completion condition of the target motion-sensing task, a task completion prompt is displayed. This departs from the traditional interactive method of motion-sensing tasks, utilizing the pose outline collected from the user to perform the motion-sensing task, thereby improving the interactive participation of the motion-sensing task and solving the technical problem of reduced interactive participation. Furthermore, by filling the interior of the pose outline with content, the user can more intuitively perceive the completion of the motion-sensing task, thus improving the user experience of the motion-sensing task. Attached Figure Description

[0022] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings: Figure 1 This is a schematic diagram of an application environment for an optional interactive method for motion-sensing tasks according to an embodiment of this application; Figure 2 This is a schematic diagram of the flow of an optional interactive method for a motion-sensing task according to an embodiment of this application; Figure 3 This is a schematic diagram of an optional interactive method for a motion-sensing task according to an embodiment of this application; Figure 4 This is a schematic diagram of another optional interactive method for a motion-sensing task according to an embodiment of this application; Figure 5 This is a schematic diagram of another optional interactive method for a motion-sensing task according to an embodiment of this application; Figure 6 This is a schematic diagram of another optional interactive method for a motion-sensing task according to an embodiment of this application; Figure 7 This is a schematic diagram of another optional interactive method for a motion-sensing task according to an embodiment of this application; Figure 8 This is a schematic diagram of another optional interactive method for a motion-sensing task according to an embodiment of this application; Figure 9This is a schematic diagram of another optional interactive method for a motion-sensing task according to an embodiment of this application; Figure 10 This is a schematic diagram of another optional interactive method for a motion-sensing task according to an embodiment of this application; Figure 11 This is a schematic diagram of another optional interactive method for a motion-sensing task according to an embodiment of this application; Figure 12 This is a schematic diagram of another optional interactive method for a motion-sensing task according to an embodiment of this application; Figure 13 This is a schematic diagram of another optional interactive method for a motion-sensing task according to an embodiment of this application; Figure 14 This is a schematic diagram of another optional interactive method for a motion-sensing task according to an embodiment of this application; Figure 15 This is a schematic diagram of an optional interactive device for a motion-sensing task according to an embodiment of this application; Figure 16 This is a schematic diagram of the structure of an optional electronic device according to an embodiment of this application. Detailed Implementation

[0023] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0024] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0025] According to one aspect of the embodiments of this application, an interactive method for motion-sensing tasks is provided. Optionally, as an optional implementation, the above-described interactive method for motion-sensing tasks can be applied to, but is not limited to, [examples of other methods]. Figure 1The environment shown may include, but is not limited to, user equipment 102 and server 112. User equipment 102 may include, but is not limited to, a display 104, a processor 106 and a memory 108. Server 112 includes a database 114 and a processing engine 116.

[0026] The specific process can be summarized in the following steps: In step S102, the user equipment 102 obtains an execution command for the pose outline contour 1026 to collide with the virtual object 1028 appearing in the interactive interface 1024, wherein the pose outline contour 1026 is a virtual contour obtained by contour recognition of the acquired image containing the target object 1022. Steps S104-S106: Send the execution command to the server 112 via network 110; In step S108, server 112 retrieves the initial filling progress of posture outline 1026 from the database, and fills the content of posture outline 1026 according to the instructions of the execution command through processing engine 116, thereby obtaining the internal filling progress of posture outline 1026. In steps S110-S112, the internal filling progress is sent to user equipment 102 via network 110. User equipment 102 displays the interactive screen corresponding to the internal filling progress on display 104 via processor 106, and stores the internal filling progress in memory 108.

[0027] remove Figure 1 Beyond the examples shown, the above steps can be completed with server assistance, i.e., the server can perform steps such as obtaining the internal filling progress, thereby reducing the processing load on the server. The user equipment 102 includes, but is not limited to, handheld devices (such as mobile phones), laptops, desktop computers, in-vehicle devices, etc., and this application does not limit the specific implementation of the user equipment 102.

[0028] Alternatively, as an alternative implementation method, such as Figure 2 As shown, the interactive methods for motion-sensing tasks include: S202, During the process of the target object participating in the target somatosensory task, the pose outline of the target object is displayed on the interactive interface. The pose outline is a virtual outline obtained by contour recognition of the collected image containing the target object, and the interior of the pose outline is in an unfilled state. S204, If the pose outline collides with at least one virtual object appearing in the interactive interface, fill the interior of the pose outline with content. S206, when the filling progress inside the posture outline reaches the completion condition of the target haptic task, display a task completion prompt message.

[0029] Optionally, in this embodiment, the above-mentioned interactive method for motion-sensing tasks can be applied, but is not limited to, in controller-free virtual interactive game scenarios. For example, by using sensors to identify the player's human body, calculating the coordinates of all points on the player's outline, outlining the human body, and combining with a physics engine, detecting collisions between the player's outline and falling objects on the screen. Each successful collision is equivalent to catching an object and completing a charge. The player's task is to catch falling objects with their limbs to complete the charge of their entire body. This scheme allows players to participate in interactive activities to complete charge and obtain rewards. The sensors can be applied, but are not limited to, peripheral devices of the host, allowing players to operate the host's system interface using voice commands or gestures instead of holding or stepping on controllers. In addition, the sensors can also capture the player's entire body movements, allowing them to play the game with their bodies, providing a "controller-free gaming and entertainment experience." Specifically, the sensor is a device resembling a webcam. The sensor has three lenses: the middle lens is an RGB color camera, and the left and right lenses are 3D structured light depth sensors composed of an infrared emitter and an infrared CMOS camera, respectively. The sensor also features autofocus tracking technology, with the base motor rotating as the focused object moves. The sensor also incorporates an array microphone, using multiple microphones to simultaneously pick up sound and eliminate background noise through comparison.

[0030] Optionally, in this embodiment, the target object may be, but is not limited to, an entity user participating in the target somatosensory task. The entity user may, but is not limited to, learn about the execution process and progress of the target somatosensory task through an interactive interface. For example, the interactive interface may display a virtual contour (posture outline contour) obtained by contour recognition of the image of the target object, and a process screen of the entity user participating in the target somatosensory task using the posture outline contour. Furthermore, in this embodiment, the pose outline is set to be synchronized with the behavior of the target object, such as... Figure 3 As shown, the interactive interface 304 displays the pose outline contour 306 obtained by contour recognition of the acquired target object 302 image, such as... Figure 3 As shown in (a) in the figure; further as Figure 3 As shown in (b), when the behavior of the target object 302 changes, such as when the target object 302 moves, the behavior of the posture outline 306 displayed on the interactive interface 304 also changes synchronously, such as when the display position of the posture outline 306 on the interactive interface 304 moves synchronously with the target object 302.

[0031] Optionally, in this embodiment, virtual objects can be understood, but are not limited to, as virtual props that interact with the target object, such as virtual resources, virtual gifts, virtual cards, etc. When a virtual object appears, the target object can collide with the virtual object by manipulating the pose outline contour, thereby filling the interior of the pose outline contour with content. To further illustrate, optionally based on Figure 3 The scenario shown continues, for example... Figure 4 As shown, the pose outline 306 of the target object 302 and the virtual object 402 are displayed on the interactive interface 304, as follows. Figure 4 As shown in (a) in the figure; further as Figure 4 As shown in (b), when the pose outline 306 collides with the virtual object 402, the interior of the pose outline 306 is filled with content (shaded area).

[0032] Optionally, in this embodiment, the completion condition of the target somatosensory task may include, but is not limited to, the internal filling progress of the pose outline contour being greater than or equal to the target progress, such as the initial internal filling progress of the pose outline contour. Figure 5 The pose outline 502 shown in the figure represents the progress of the internal filling of the pose outline when the target haptic task completion conditions are met. Figure 5 The pose outline shown is 504.

[0033] Optionally, in this embodiment, the task completion prompt information may be used, but is not limited to, to indicate that the target somatosensory task has been completed; in addition, to enhance the target object's sense of accomplishment when completing the target somatosensory task, it may be used, but is not limited to, to prompt the target object to take a picture of the completion screen of the target somatosensory task.

[0034] It should be noted that during the target object's participation in the target somatosensory task, the target object's posture outline is displayed on the interactive interface. The posture outline is a virtual outline obtained by contour recognition of the captured image containing the target object, and the interior of the posture outline is in a state of unfilled. If the posture outline collides with at least one virtual object appearing in the interactive interface, the interior of the posture outline is filled with content. When the filling progress of the interior of the posture outline reaches the completion condition of the target somatosensory task, a task completion prompt message is displayed.

[0035] To further illustrate, the optional based on Figure 3 The scenario shown continues, for example... Figure 6 As shown, during the target object 302's participation in the target motion sensing task, the pose outline 306 of the target object 302 is displayed on the interactive interface 304, such as... Figure 6As shown in (a), the pose outline contour 306 can be, but is not limited to, a virtual contour obtained by contour recognition of an image containing the target object 302 acquired using the image acquisition device 602, and the interior of the pose outline contour is in an unfilled state; further as... Figure 6 As shown in (b), when the pose outline 306 collides with at least one virtual object 402 appearing within the interactive interface 304, the interior of the pose outline 306 is filled with content; furthermore, as Figure 6 As shown in (c), when the filling progress inside the pose outline 306 reaches the completion condition of the target haptic task, a task completion prompt message 604, such as "Task completed!", is displayed.

[0036] Through the embodiments provided in this application, during the process of a target object participating in a target haptic task, the pose outline of the target object is displayed on the interactive interface. The pose outline is a virtual outline obtained by contour recognition of an image containing the target object, and its interior is in a state of unfilled space. If the pose outline collides with at least one virtual object appearing in the interactive interface, its interior is filled with content. When the filling progress of the pose outline reaches the completion condition of the target haptic task, a task completion prompt is displayed. This departs from the traditional interactive method of haptic tasks, utilizing the pose outline collected from the user to perform the haptic task, thereby improving the interactive participation of the haptic task and solving the technical problem of reduced interactive participation in haptic tasks. Furthermore, by filling the interior of the pose outline with content, the user can more intuitively perceive the completion of the haptic task, which is beneficial to improving the user experience of the haptic task.

[0037] As an optional solution, if the pose outline collides with at least one virtual object appearing within the interactive interface, the interior of the pose outline is filled with content, including: If the pose outline collides with at least one virtual object and the internal filling progress has not met the completion conditions of the target haptic task, the content of the pose outline is filled and the target identifier to be activated is displayed, wherein the target identifier is used to represent the internal entity element of the target object.

[0038] Optionally, in this embodiment, when the target object is an actual biological object, the internal entity elements may be, but are not limited to, the internal organs and parts of the actual biological object, such as the internal organs; and then, during the process of the target object participating in the target somatosensory task, the initial state posture outline is first displayed on the interactive interface, wherein the initial state posture outline includes an inactive target identifier, and the inactive target identifier may be, but is not limited to, a static organ or part without light.

[0039] As an optional solution, if the infill progress of the pose outline reaches the completion condition of the target haptic task, a task completion prompt message is displayed, including: When the internal filling progress reaches the completion conditions of the target haptic task, the target prompt message is displayed and the target icon is activated.

[0040] It should be noted that if the pose outline collides with at least one virtual object and the internal filling progress has not reached the completion condition of the target motion sensing task, the content of the pose outline is filled and the target identifier to be activated is displayed; if the internal filling progress reaches the completion condition of the target motion sensing task, the target prompt information is displayed and the target identifier is activated.

[0041] To further illustrate, optionally based on Figure 5 The scenario shown continues, for example... Figure 7 As shown, when the pose outline 502 collides with at least one virtual object and the internal filling progress has not reached the completion condition of the target haptic task, the content of the pose outline 502 is filled and the target identifier 702 to be activated is displayed; when the internal filling progress reaches the completion condition of the target haptic task, the pose outline 504 that has been fully filled is displayed and the target identifier 704 is activated.

[0042] Through the embodiments provided in this application, when the internal filling progress reaches the completion conditions of the target somatosensory task, target prompt information is displayed and the target identifier is activated, thereby achieving the technical effect of improving the interactive intuitiveness of the somatosensory task.

[0043] As an optional solution, in the event that the pose outline collides with at least one virtual object appearing within the interactive interface, after filling the interior of the pose outline with content, the following steps are taken: S1, In the case that the pose outline collides with at least one virtual object, obtain the collision attribute information of at least one virtual object. S2, fill the interior of the pose outline with content based on the collision attribute information.

[0044] Optionally, in this embodiment, the collision attribute information may be used, but is not limited to, to represent the attribute information of a virtual object when it collides with the pose outline contour, such as the volume of the virtual object, the area of ​​the virtual object, the type of the virtual object, the number of virtual objects, etc.

[0045] As an optional approach, the interior of the pose outline is filled with content based on collision attribute information, including: S1, when the collision attribute information includes positive fill attribute information, obtain the first quantity of positive fill attribute information, and fill the interior of the pose outline with the content of the first capacity, wherein the first capacity is positively correlated with the first quantity; S2, when the collision attribute information includes negative fill attribute information, obtain the second quantity of negative fill attribute information, and perform content subtraction of the second capacity inside the pose outline, wherein the second capacity is positively correlated with the second quantity.

[0046] Optionally, in this embodiment, the positive fill attribute information and the negative fill attribute information can be, but are not limited to, opposite fill attribute information. For example, the positive fill attribute information is used to indicate that the interior of the pose outline contour is filled with "+1" content, while the negative fill attribute information is used to indicate that the interior of the pose outline contour is deducted with "-1" content. Furthermore, when the collision attribute information includes both the positive fill attribute information "+1" and the negative fill attribute information "-1", it can be considered, but is not limited to, that no adjustment is made to the interior of the pose outline contour.

[0047] Optionally, in this embodiment, the first quantity of positive fill attribute information can be understood, but is not limited to, the number of virtual objects carrying positive fill attribute information that collide with the pose outline contour, and the second quantity of negative fill attribute information can be understood, but is not limited to, the number of virtual objects carrying negative fill attribute information that collide with the pose outline contour; and when the collision attribute information includes 3 positive fill attribute information "+1" and 2 negative fill attribute information "-1", it can be considered, but is not limited to, that the interior of the pose outline contour is not filled with "+1" content.

[0048] Through the embodiments provided in this application, when the collision attribute information includes positive fill attribute information, a first quantity of positive fill attribute information is obtained, and the interior of the pose outline contour is filled with content of a first capacity, wherein the first capacity is positively correlated with the first quantity; when the collision attribute information includes negative fill attribute information, a second quantity of negative fill attribute information is obtained, and the interior of the pose outline contour is deducted with content of a second capacity, wherein the second capacity is positively correlated with the second quantity, thereby achieving the technical effect of improving the flexibility of content filling.

[0049] As an optional approach, the interior of the pose outline is filled with content based on collision attribute information, including: S1, when the collision attribute information includes the first filling attribute information of the first virtual object, fill the interior of the pose outline with the content corresponding to the first filling attribute information. S2, when the collision attribute information includes the second fill attribute information of the second virtual object, fill the interior of the pose outline with the content corresponding to the second fill attribute information, wherein the content filling corresponding to the first fill attribute information is different from the content filling corresponding to the second fill attribute information.

[0050] It should be noted that different types of virtual objects may, but are not limited to, have different ways of filling the interior of their pose outlines with different content.

[0051] To further illustrate, optionally based on Figure 3 Trivial scenarios, for example Figure 8 As shown, a first virtual object 802 and a second virtual object 804 are displayed on the interactive interface 304; further, when the collision attribute information includes the first fill attribute information of the first virtual object 802, the interior of the pose outline is filled with the content corresponding to the first fill attribute information; when the collision attribute information includes the second fill attribute information of the second virtual object 804, the interior of the pose outline is filled with the content corresponding to the second fill attribute information, wherein the content filling corresponding to the first fill attribute information is different from the content filling corresponding to the second fill attribute information.

[0052] Through the embodiments provided in this application, when the collision attribute information includes the first filling attribute information of the first virtual object, the interior of the pose outline contour is filled with the content corresponding to the first filling attribute information; when the collision attribute information includes the second filling attribute information of the second virtual object, the interior of the pose outline contour is filled with the content corresponding to the second filling attribute information. The content filling corresponding to the first filling attribute information is different from the content filling corresponding to the second filling attribute information, thereby achieving the technical effect of improving the flexibility of content filling.

[0053] As an optional solution, if the pose outline collides with at least one virtual object appearing within the interactive interface, the interior of the pose outline is filled with content, including: If the pose outline collides with at least one virtual object, the content of at least two internal regions of the pose outline is sequentially filled.

[0054] Optionally, in this embodiment, the content filling of the posture outline can be, but is not limited to, sequential, such as first filling the content inside the first target area of ​​the posture outline, and then filling the content inside the second target area of ​​the posture outline.

[0055] It should be noted that, in the event that the pose outline collides with at least one virtual object, the content of at least two internal regions of the pose outline is sequentially filled.

[0056] To further illustrate, alternatively, for example... Figure 9 As shown, when the pose outline 902 collides with a virtual object, at least two internal regions of the pose outline are sequentially filled with content, such as first obtaining the pose outline 904 and then obtaining the pose outline 906.

[0057] Through the embodiments provided in this application, when the pose outline collides with at least one virtual object, the content of at least two internal regions of the pose outline is sequentially filled, thereby achieving the technical effect of improving the efficiency of content filling.

[0058] As an optional solution, if the pose outline collides with at least one virtual object appearing within the interactive interface, the interior of the pose outline is filled with content, including: S1, when the first part of the pose outline collides with at least one virtual object and the filling progress of the first internal region of the pose outline does not reach the first threshold, the content of the first internal region is filled, wherein the first part outline is associated with the first internal region and the first part outline corresponds to the first entity part of the target object. S2, when the second part of the pose outline collides with at least one virtual object and the filling progress of the second inner region of the pose outline has not reached the second threshold, the content of the second inner region is filled, wherein the second part outline is associated with the second inner region and the second part outline corresponds to the second entity part of the target object.

[0059] Optionally, in this embodiment, in order to improve the target object's participation enthusiasm when participating in the target somatosensory task, the target object needs to perform multiple operations to make the outline of the corresponding part of different physical parts touch the corresponding virtual object in order to complete the content filling of the corresponding internal area.

[0060] It should be noted that, when the first part of the pose outline collides with at least one virtual object and the filling progress of the first inner region of the pose outline has not reached the first threshold, the first inner region is filled with content. Here, the first part outline is associated with the first inner region, and the first part outline corresponds to the first entity part of the target object. When the second part of the pose outline collides with at least one virtual object and the filling progress of the second inner region of the pose outline has not reached the second threshold, the second inner region is filled with content. Here, the second part outline is associated with the second inner region, and the second part outline corresponds to the second entity part of the target object.

[0061] To further illustrate, optionally based on Figure 9 The scenario shown continues, for example... Figure 10 As shown, when the first part of the posture outline 902 collides with the virtual object 1002 and the filling progress of the inner region 1004 of the posture outline 902 has not reached the first threshold, the inner region 1004 is filled with content to obtain the filled posture outline 1006. To further illustrate, optionally based on Figure 9 The scenario shown continues, for example... Figure 11 As shown, when the second part of the pose outline 902 collides with the virtual object 1102 and the filling progress of the inner region 1104 of the pose outline 902 has not reached the first threshold, the inner region 1104 is filled with content to obtain the filled pose outline 1106.

[0062] Through the embodiments provided in this application, when the first part of the pose outline collides with at least one virtual object and the filling progress of the first internal region of the pose outline has not reached a first threshold, the first internal region is filled with content, wherein the first part outline is associated with the first internal region and the first part outline corresponds to the first entity part of the target object; when the second part of the pose outline collides with at least one virtual object and the filling progress of the second internal region of the pose outline has not reached a second threshold, the second internal region is filled with content, wherein the second part outline is associated with the second internal region and the second part outline corresponds to the second entity part of the target object, thereby achieving the technical effect of improving the flexibility of content filling.

[0063] As an optional solution, if the pose outline collides with at least one virtual object appearing within the interactive interface, the interior of the pose outline is filled with content, including: S1, when the pose outline collides with at least one virtual object and the internal filling progress reaches the first filling threshold, the content of the pose outline is filled using the first form of filling element. S2, when the pose outline collides with at least one virtual object and the internal filling progress reaches the second filling threshold, remove the filled first-form filling element and use the second-form filling element to fill the content inside the pose outline, wherein the second filling threshold is greater than the first filling threshold.

[0064] Optionally, in this embodiment, to improve the visual intuitiveness of content filling at different stages, different forms of filling elements can be used to complete the content filling at different stages; in addition, to further improve the visual intuitiveness of content filling, higher filling thresholds correspond to filling elements with higher visual appeal.

[0065] It should be noted that when the pose outline collides with at least one virtual object and the internal filling progress reaches the first filling threshold, the content of the pose outline is filled using the first form of filling elements; when the pose outline collides with at least one virtual object and the internal filling progress reaches the second filling threshold, the filled first form of filling elements is removed, and the content of the pose outline is filled using the second form of filling elements, wherein the second filling threshold is greater than the first filling threshold.

[0066] To further illustrate, optionally based on Figure 9 The scenario shown continues, for example... Figure 12 As shown, when the pose outline 902 collides with at least one virtual object and the internal filling progress reaches the first filling threshold, the content of the pose outline 902 is filled with the first form of filling element to obtain the pose outline 1202; when the pose outline 1202 collides with at least one virtual object and the internal filling progress reaches the second filling threshold, the filled first form of filling element is removed, and the content of the pose outline 1202 is filled with the second form of filling element to obtain the pose outline 1204, wherein the second filling threshold is greater than the first filling threshold.

[0067] Through the embodiments provided in this application, when the pose outline collides with at least one virtual object and the internal filling progress reaches a first filling threshold, the content of the pose outline is filled using a first-form filling element; when the pose outline collides with at least one virtual object and the internal filling progress reaches a second filling threshold, the filled first-form filling element is removed, and the content of the pose outline is filled using a second-form filling element, wherein the second filling threshold is greater than the first filling threshold, thereby achieving the technical effect of improving the visual intuitiveness of the content filling.

[0068] As an optional approach, after displaying the pose outline of the target object on the interactive interface during the target object's participation in the target somatosensory task, the following steps are taken: S1, generate N virtual objects in a moving state at the initial position on the interactive interface, wherein at least one virtual object includes N virtual objects in a moving state. S2, remove N virtual objects that are in motion and collide with the pose outline; or, remove N virtual objects that are in motion but are located outside the interactive interface.

[0069] Optionally, in this embodiment, the pixels on the canvas corresponding to the interactive interface are traversed, and the pose outline of the target object (human body) is identified by determining whether each pixel and its adjacent pixels are part of the target object, thereby obtaining a series of outline coordinates; furthermore, the algorithm implementation for the pose outline can refer to the following program: for (let i = 0; i < kinectPixelData.length; i++) { / / Filtering is the pixel of the human body if (kinectPixelData[i] !== isBackground) { / / Two pixels in the horizontal direction const prevXPixel = kinectPixelData[i - 1]; const nextXPixel = kinectPixelData[i + 1]; / / Two pixels in the vertical direction const prevYPixel = kinectPixelData[i - bodyWidth]; const nextYPixel = kinectPixelData[i + bodyWidth]; / / The four pixels at the top, bottom, left, and right are all inside the human body. if ( prevXPixel !== isBackground && nextXPixel !== isBackground && prevYPixel !== isBackground && nextYPixel !== isBackground ) { / / Fill background color } else { / / The two pixels, one representing the human body and the other the background, are the pixels at the edge of the human body. / / Draw colors and outline the edges of the human body / / Calculate the (x, y) coordinates of a pixel on the canvas x = i % bodyWidth; y = Math.floor(i / bodyWidth); } }; Further, after obtaining a series of contour coordinates (x, y), each point is drawn, and the human figure can be outlined. Then, the physics engine is introduced to build each contour point into a rigid body. The rigid body can be, but is not limited to, a graphic that follows the laws of real-world physics. The physics engine can be, but is not limited to, a computer program that simulates a Newtonian mechanics model, using variables such as mass, velocity, friction, and air resistance. It can be used to predict the effects under different conditions and is mainly used in computational physics, video games, and computer animation. In addition, in this embodiment, the virtual object can be, but is not limited to, continuously generated and falling objects that enter the field of view from the top of the screen; the newly created falling object is called a rigid body and enters the screen on the canvas; each time it is drawn, the falling objects in the current screen are traversed, and it is determined whether the object exceeds the bottom of the screen and is off-screen. Falling objects that are off-screen are removed from the falling object array, and falling objects that are not off-screen are drawn into a pattern.

[0070] It should be noted that N virtual objects in a moving state are generated at the initial position on the interactive interface, wherein at least one virtual object includes the N virtual objects in a moving state; virtual objects that collide with the pose outline of the N virtual objects in a moving state are removed; or, virtual objects located outside the interactive interface are removed from the N virtual objects in a moving state.

[0071] To further illustrate, optionally, for example, N virtual objects 1306 in a moving state are generated at the initial position 1304 on the interactive interface 1302; virtual objects that collide with the pose outline 1308 among the N virtual objects in a moving state are removed; or, virtual objects located outside the interactive interface 1302 among the N virtual objects in a moving state are removed.

[0072] The embodiments provided in this application generate N virtual objects in a moving state at an initial position on the interactive interface, wherein at least one virtual object includes the N virtual objects in a moving state; remove virtual objects that collide with the pose outline contours among the N virtual objects in a moving state; or remove virtual objects located outside the interactive interface among the N virtual objects in a moving state, thereby achieving the technical effect of improving the comprehensiveness of control over virtual objects.

[0073] As an optional approach, after generating N virtual objects in a moving state at the initial position on the interactive interface, the following steps are taken: In response to the control command triggered by the target account participating in the target motion-sensing task on the target virtual object, adjust the movement position of the target virtual object within the interactive interface, where N virtual objects in a moving state include the target virtual object.

[0074] Optionally, in this embodiment, to enhance the participation of multiple users in the target motion-sensing task, the virtual object can also be controlled and moved by other users participating in the target motion-sensing task, thereby improving the flexibility of control over the virtual object.

[0075] It should be noted that the response is based on the target account participating in the target motion-sensing task and its interaction with the target virtual object.

[0076] As an optional approach, before displaying the pose outline of the target object on the interactive interface during the target object's participation in the target somatosensory task, the following steps are taken: S1, acquire images of the target object located within the interactive area associated with the target somatosensory task, and obtain the target outline image of the target object; S2, perform image recognition on the target outline image to obtain the image recognition result; S3, obtain the pose outline based on the image recognition results.

[0077] It should be noted that the target object located within the interactive area associated with the target somatosensory task is image acquired to obtain the target outline image of the target object; image recognition is performed on the target outline image to obtain the image recognition result; and the pose outline contour is obtained based on the image recognition result.

[0078] To further illustrate, alternatively, for example... Figure 14 As shown, the specific steps are as follows: Step S1402: Start the image acquisition device; Step S1404: Capture images of the player after entering the area; Step S1406: Filter out contour coordinate points from the image data; Step S1408: Draw the outline and generate a rigid body; Step S1410: Draw the falling object and generate a rigid body; Step S1412: Detect the collision between the outline and the rigid body. If the colliding objects are a human body and a falling object, it is determined that the player has caught the falling object. Step S1414: Determine if there is a collision. If yes, proceed to step S1416; otherwise, proceed to step S1412. Step S1416: Fill in the outline. When a player receives a dropped item, they can charge once. Based on the current charge progress, the outline of the humanoid pattern is filled with color. Step S1415: Determine whether the space is filled. If yes, proceed to step S1420; otherwise, proceed to step S1412. Step S1420: Display the final screen.

[0079] As an optional approach, the pose outline is obtained based on the image recognition results, including: S1, when the image recognition result includes the overall pixel data of the target outline image, select first pixel data from the overall pixel data whose pixel value is less than or equal to the background pixel value; construct the pose outline contour using the first pixel data; or... S2, if the image recognition result includes overall pixel data, select second pixel data from the overall pixel data whose pixel value is more than or equal to the second pixel threshold and whose similarity with human pixel value is greater than or equal to the second pixel threshold; use the second pixel data to construct the pose outline contour.

[0080] Optionally, in this embodiment, real-time image data returned by the image acquisition device is used to draw a human figure (target object) pattern, as detailed below: The data returned by the image acquisition device includes bodyIndexMapImageFrame data and the background identification field K4ABT_BODY_INDEX_MAP_BACKGROUND, where bodyIndexMapImageFrame is picture image data, which is an array composed of pixels of the picture in the order from top to bottom and from left to right, and K4ABT_BODY_INDEX_MAP_BACKGROUND is a value representing the value of the non-human part background; further traverse the pixels of bodyIndexMapImageFrame, and filter out the points whose values are not equal to K4ABT_BODY_INDEX_MAP_BACKGROUND, these points are the human part, for example: for (let i = 0; i <bodyIndexMapImageFrame.length;i++){if (bodyIndexMapImageFrame[i]!== K4ABT_BODY_INDEX_MAP_BACKGROUND){ / / bodyIndexMapImageFrame[i] This point is the human part, including x and y coordinates}}.

[0081] With the embodiments provided in the present application, when the image recognition result includes the overall pixel data of the target stroke image, first pixel data whose similarity between the pixel value and the background pixel value is less than or equal to the first pixel threshold is filtered out from the overall pixel data; the posture stroke contour is constructed by using the first pixel data; or, when the image recognition result includes the overall pixel data, second pixel data whose similarity between the pixel value and the human body pixel value is greater than or equal to the second pixel threshold is filtered out from the overall pixel data; the posture stroke contour is constructed by using the second pixel data, thereby achieving the technical effect of improving the accuracy of the posture stroke contour.

[0082] As an optional solution, optionally for the convenience of understanding, the above somatosensory task interaction method is applied to the actual scene of offline activities, for example, the human body of the player is recognized through Kinect, the coordinates of all points of the player's contour are obtained through calculation, the human body is stroked, and combined with the physics engine, the collision between the player's contour and the objects falling on the screen is detected, and each successful collision is equivalent to catching the object to complete one charge. The player's task is to catch the falling objects with their limbs to complete the charging of the whole body. In offline activities, through this embodiment, players can participate in the interaction to complete the charging to obtain rewards.

[0083] Optionally, in this embodiment, for example, when a player enters the interactive area, a humanoid outline of the player appears on the screen, and objects (BUFFs) randomly fall from the top of the screen. Players can touch the BUFFs by moving or waving their arms. Each successful touch of a BUFF is equivalent to completing one charge, which is reflected in the humanoid outline filling with color from the feet to the head. When the color fills the highest point of the humanoid outline, it indicates that the charge is complete, and the player passes the level. The player can take a photo as proof of completion. This proof can be used to redeem rewards.

[0084] Optionally, in this embodiment, the player's height can be obtained first through the data returned by Kinect, where the data returned by Kinect is assumed to be bodyHeight = bodyIndexMapImageFrame.height; / / bodyIndexMapImageFrame, and the charging progress increases with each collision as changeProgress +=chargeStep; if (changeProgress > bodyHeight) {changeProgress = bodyHeight;}; further, the charged parts of the human body are filled with color, starting from the feet to the head, for example, if (y > bodyHeight - changeProgress) { / / Iterate through the points of the human body parts, and fill the points with color where the y coordinate is lower than the charging progress}; in addition, when the human figure pattern is completely filled, it means that the charging is complete, the player has passed the level, and can take a photo as proof to receive the reward, such as if(changeProgress >= bodyHeight) { / / Charging is complete, prompt to take a photo as proof}.

[0085] The embodiments provided in this application provide real-time feedback on the charging feedback received from falling objects, which increases the game's appeal, and the interactive fun is enhanced through motion recognition; in addition, rewards are given for participating in the interaction, providing a link to offline activities.

[0086] It is understood that in the specific embodiments of this application, data such as user information are involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0087] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0088] According to another aspect of the embodiments of this application, an interactive device for implementing the above-described interactive method for a somatosensory task is also provided. For example... Figure 15 As shown, the device includes: The first display unit 1502 is used to display the pose outline of the target object on the interactive interface during the target object's participation in the target somatosensory task. The pose outline is a virtual outline obtained by contour recognition of the acquired image containing the target object, and the interior of the pose outline is in an unfilled state. The first filling unit 1504 is used to fill the interior of the pose outline when the pose outline collides with at least one virtual object appearing in the interactive interface. The second display unit 1506 is used to display a task completion prompt when the infill progress inside the posture outline reaches the completion condition of the target haptic task.

[0089] Optionally, in this embodiment, the interactive device for the aforementioned motion-sensing task can be applied, but is not limited to, in a controller-free virtual interactive game scene. For example, it can identify the player's human body using sensors, calculate the coordinates of all points on the player's outline, outline the human body, and, combined with a physics engine, detect collisions between the player's outline and falling objects on the screen. Each successful collision is equivalent to catching an object and completing one charge. The player's task is to catch falling objects with their limbs to charge their entire body. This scheme allows players to participate in interactive activities to complete charging and obtain rewards. The sensor can be, but is not limited to, applied to peripheral devices of the host computer, allowing players to operate the host's system interface using voice commands or gestures instead of holding or stepping on a controller. Furthermore, the sensor can capture the player's entire body movements, allowing them to play the game using their body, providing a "controller-free gaming and entertainment experience." Specifically, the sensor is a device resembling a webcam. The sensor has three lenses: the middle lens is an RGB color camera, and the left and right lenses are 3D structured light depth sensors composed of an infrared emitter and an infrared CMOS camera, respectively. The sensor also features autofocus tracking technology, with the base motor rotating as the focused object moves. The sensor also incorporates an array microphone, using multiple microphones to simultaneously pick up sound and eliminate background noise through comparison.

[0090] Optionally, in this embodiment, the target object may be, but is not limited to, an entity user participating in the target somatosensory task. The entity user may, but is not limited to, learn about the execution process and progress of the target somatosensory task through an interactive interface. For example, the interactive interface may display a virtual contour (posture outline contour) obtained by contour recognition of the image of the target object, and a process screen of the entity user participating in the target somatosensory task using the posture outline contour.

[0091] Optionally, in this embodiment, virtual objects can be understood, but are not limited to, as virtual props that interact with the target object, such as virtual resources, virtual gifts, virtual cards, etc. When a virtual object appears, the target object can collide with the virtual object by manipulating the pose outline contour, thereby filling the interior of the pose outline contour with content.

[0092] Optionally, in this embodiment, the task completion prompt information may be used, but is not limited to, to indicate that the target somatosensory task has been completed; in addition, to enhance the target object's sense of accomplishment when completing the target somatosensory task, it may be used, but is not limited to, to prompt the target object to take a picture of the completion screen of the target somatosensory task.

[0093] It should be noted that during the target object's participation in the target somatosensory task, the target object's posture outline is displayed on the interactive interface. The posture outline is a virtual outline obtained by contour recognition of the captured image containing the target object, and the interior of the posture outline is in a state of unfilled. If the posture outline collides with at least one virtual object appearing in the interactive interface, the interior of the posture outline is filled with content. When the filling progress of the interior of the posture outline reaches the completion condition of the target somatosensory task, a task completion prompt message is displayed.

[0094] For specific embodiments, please refer to the example shown in the interactive device for the above-mentioned motion-sensing task, which will not be repeated here.

[0095] Through the embodiments provided in this application, during the process of a target object participating in a target haptic task, the pose outline of the target object is displayed on the interactive interface. The pose outline is a virtual outline obtained by contour recognition of an image containing the target object, and its interior is in a state of unfilled space. If the pose outline collides with at least one virtual object appearing in the interactive interface, its interior is filled with content. When the filling progress of the pose outline reaches the completion condition of the target haptic task, a task completion prompt is displayed. This departs from the traditional interactive method of haptic tasks, utilizing the pose outline collected from the user to perform the haptic task, thereby improving the interactive participation of the haptic task and solving the technical problem of reduced interactive participation in haptic tasks. Furthermore, by filling the interior of the pose outline with content, the user can more intuitively perceive the completion of the haptic task, which is beneficial to improving the user experience of the haptic task.

[0096] As an optional solution, the first filling unit 1504 includes: The first display module is used to fill the interior of the pose outline with content and display the target identifier to be activated when the pose outline collides with at least one virtual object and the interior filling progress has not reached the completion condition of the target haptic task. The target identifier is used to represent the internal entity element of the target object.

[0097] For specific implementation examples, please refer to the examples shown in the above interactive methods for motion-sensing tasks, which will not be repeated here.

[0098] As an optional solution, the second display unit 1506 includes: The second display module is used to display target prompt information and activate the target identifier when the internal filling progress reaches the completion conditions of the target haptic task.

[0099] For specific implementation examples, please refer to the examples shown in the above interactive methods for motion-sensing tasks, which will not be repeated here.

[0100] As an optional solution, the device includes: The first acquisition unit is used to fill the interior of the posture outline with content when the posture outline collides with at least one virtual object appearing in the interactive interface, and then acquire the collision attribute information of at least one virtual object when the posture outline collides with at least one virtual object. The second filling unit is used to fill the interior of the pose outline with content after the pose outline collides with at least one virtual object appearing in the interactive interface, and then fill the interior of the pose outline with content according to the collision attribute information.

[0101] For specific implementation examples, please refer to the examples shown in the above interactive methods for motion-sensing tasks, which will not be repeated here.

[0102] As an optional solution, the second filling unit includes: The first filling module is used to obtain a first quantity of positive filling attribute information when the collision attribute information includes positive filling attribute information, and to fill the interior of the pose outline with a first capacity of content, wherein the first capacity is positively correlated with the first quantity. The second filling module is used to obtain the second quantity of negative filling attribute information when the collision attribute information includes negative filling attribute information, and to subtract the content of the second capacity of the pose outline contour, wherein the second capacity is positively correlated with the second quantity.

[0103] For specific implementation examples, please refer to the examples shown in the above interactive methods for motion-sensing tasks, which will not be repeated here.

[0104] As an optional solution, the second filling unit includes: The third filling module is used to fill the interior of the pose outline with the content corresponding to the first filling attribute information when the collision attribute information includes the first filling attribute information of the first virtual object. The fourth filling module is used to fill the interior of the pose outline contour with content corresponding to the second filling attribute information when the collision attribute information includes the second filling attribute information of the second virtual object. The content filling corresponding to the first filling attribute information is different from the content filling corresponding to the second filling attribute information.

[0105] For specific implementation examples, please refer to the examples shown in the above interactive methods for motion-sensing tasks, which will not be repeated here.

[0106] As an optional solution, the first filling unit 1504 includes: The fifth filling module is used to sequentially fill at least two internal regions of the pose outline with content when the pose outline collides with at least one virtual object.

[0107] For specific implementation examples, please refer to the examples shown in the above interactive methods for motion-sensing tasks, which will not be repeated here.

[0108] As an optional solution, the first filling unit 1504 includes: The sixth filling module is used to fill the content of the first internal region when the first part of the pose outline collides with at least one virtual object and the filling progress of the first internal region of the pose outline has not reached the first threshold. The first part outline is associated with the first internal region and the first part outline corresponds to the first entity part of the target object. The seventh filling module is used to fill the content of the second internal region when the second part of the pose outline collides with at least one virtual object and the filling progress of the second internal region of the pose outline has not reached the second threshold. The second part outline is associated with the second internal region and corresponds to the second entity part of the target object.

[0109] For specific implementation examples, please refer to the examples shown in the above interactive methods for motion-sensing tasks, which will not be repeated here.

[0110] As an optional solution, the first filling unit 1504 includes: The eighth filling module is used to fill the interior of the pose outline with the first form of filling elements when the pose outline collides with at least one virtual object and the internal filling progress reaches the first filling threshold. The ninth filling module is used to remove the already filled first-form filling elements and fill the interior of the pose outline with content when the pose outline collides with at least one virtual object and the internal filling progress reaches the second filling threshold. The second filling threshold is greater than the first filling threshold.

[0111] For specific implementation examples, please refer to the examples shown in the above interactive methods for motion-sensing tasks, which will not be repeated here.

[0112] As an optional solution, the device includes: The first removal unit is used to generate N virtual objects in a moving state at the initial position on the interactive interface after the target object's posture outline is displayed on the interactive interface during the target object's participation in the target somatosensory task. At least one virtual object includes N virtual objects in a moving state. The second removal unit is used to remove, after the pose outline of the target object is displayed on the interactive interface during the target object's participation in the target somatosensory task, remove N virtual objects in a moving state that collide with the pose outline outline; or remove N virtual objects in a moving state that are located outside the interactive interface.

[0113] For specific implementation examples, please refer to the examples shown in the above interactive methods for motion-sensing tasks, which will not be repeated here.

[0114] As an optional solution, the device includes: An adjustment unit is used to generate N virtual objects in a moving state at the initial position on the interactive interface, and then adjust the moving position of the target virtual objects in the interactive interface in response to the control command triggered by the target account participating in the target somatosensory task on the target virtual objects. The N virtual objects in a moving state include the target virtual objects.

[0115] For specific implementation examples, please refer to the examples shown in the above interactive methods for motion-sensing tasks, which will not be repeated here.

[0116] As an optional solution, the device includes: The acquisition unit is used to acquire images of the target object located in the interactive area associated with the target somatosensory task before the target object's pose outline is displayed on the interactive interface during the target object's participation in the target somatosensory task, so as to obtain the target outline image of the target object. The recognition unit is used to perform image recognition on the target outline image before the target object's posture outline is displayed on the interactive interface during the target object's participation in the target somatosensory task, and obtain the image recognition result. The second acquisition unit is used to acquire the pose outline based on the image recognition results before the pose outline of the target object is displayed on the interactive interface during the target object's participation in the target somatosensory task.

[0117] For specific implementation examples, please refer to the examples shown in the above interactive methods for motion-sensing tasks, which will not be repeated here.

[0118] As an optional solution, the second acquisition unit includes: A first filtering module is used to filter out first pixel data whose pixel value is less than or equal to a first pixel threshold from the overall pixel data when the image recognition result includes the overall pixel data of the target outline image; a first construction module is used to construct a pose outline contour using the first pixel data; or, The second filtering module is used to filter out second pixel data from the overall pixel data when the image recognition result includes overall pixel data, and the similarity between the pixel value and the human pixel value is greater than or equal to the second pixel threshold; the second construction module is used to construct the pose outline contour using the second pixel data.

[0119] For specific implementation examples, please refer to the examples shown in the above interactive methods for motion-sensing tasks, which will not be repeated here.

[0120] According to another aspect of the embodiments of this application, an electronic device for implementing the above-described interactive method for haptic tasks is also provided, such as... Figure 16 As shown, the electronic device includes a memory 1602 and a processor 1604. The memory 1602 stores a computer program, and the processor 1604 is configured to execute the steps of any of the above method embodiments via the computer program.

[0121] Optionally, in this embodiment, the aforementioned electronic device may be located in at least one of a plurality of network devices in a computer network.

[0122] Optionally, in this embodiment, the processor can be configured to perform the following steps via a computer program: S1, During the process of the target object participating in the target somatosensory task, the pose outline of the target object is displayed on the interactive interface. The pose outline is a virtual outline obtained by contour recognition of the collected image containing the target object, and the interior of the pose outline is in an unfilled state. S2, when the pose outline collides with at least one virtual object appearing in the interactive interface, fill the content inside the pose outline. S3: When the filling progress inside the pose outline reaches the completion condition of the target haptic task, a task completion prompt message is displayed.

[0123] Alternatively, as those skilled in the art will understand, Figure 16 The structure shown is for illustrative purposes only. Electronic devices can also be smartphones (such as Android phones, iOS phones, etc.), tablets, PDAs, mobile internet devices (MIDs), PADs, and other terminal devices. Figure 16 This does not limit the structure of the aforementioned electronic devices. For example, the electronic device may also include components that are more... Figure 16 The more or fewer components shown (such as network interfaces, etc.), or having the same Figure 16 The different configurations shown.

[0124] The memory 1602 can be used to store software programs and modules, such as the program instructions / modules corresponding to the interactive method and device for the somatosensory task in this embodiment. The processor 1604 executes various functional applications and data processing by running the software programs and modules stored in the memory 1602, thereby realizing the interactive method for the somatosensory task described above. The memory 1602 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 1602 may further include memory remotely located relative to the processor 1604, and these remote memories can be connected to the terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof. Specifically, the memory 1602 may be used, but is not limited to, to store information such as the target somatosensory task, posture outline contour, and task completion prompt information. As an example, such as Figure 16 As shown, the memory 1602 may include, but is not limited to, the first display unit 1502, the first filling unit 1504, and the second display unit 1506 in the interactive device for the aforementioned motion-sensing task. Furthermore, it may include, but is not limited to, other module units in the interactive device for the aforementioned motion-sensing task, which will not be elaborated upon in this example.

[0125] Optionally, the transmission device 1606 described above is used to receive or send data via a network. Specific examples of the network described above may include wired networks and wireless networks. In one example, the transmission device 1606 includes a Network Interface Controller (NIC), which can be connected to other network devices and a router via a network cable to communicate with the Internet or a local area network. In another example, the transmission device 1606 is a Radio Frequency (RF) module, used for wireless communication with the Internet.

[0126] In addition, the aforementioned electronic device also includes: a display 1608 for displaying information such as the target motion sensing task, posture outline, and task completion prompts; and a connection bus 1610 for connecting the various module components in the aforementioned electronic device.

[0127] In other embodiments, the aforementioned terminal device or server can be a node in a distributed system, wherein the distributed system can be a blockchain system, which is a distributed system formed by connecting multiple nodes through network communication. The nodes can form a peer-to-peer (P2P) network, and any form of computing device, such as a server, terminal, or other electronic device, can become a node in the blockchain system by joining this peer-to-peer network.

[0128] According to one aspect of this application, a computer program product is provided, comprising a computer program / instructions containing program code for performing the methods shown in the flowchart. In such embodiments, the computer program can be downloaded and installed from a network via a communication component, and / or installed from a removable medium. When the computer program is executed by a central processing unit, it performs various functions provided in embodiments of this application.

[0129] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0130] It should be noted that the computer system of the electronic device is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of this application.

[0131] A computer system includes a Central Processing Unit (CPU), which performs various appropriate actions and processes based on programs stored in Read-Only Memory (ROM) or loaded from RAM. ROM also stores various programs and data required for system operation. The CPU, ROM, and RAM are interconnected via a bus. Input / output interfaces (I / O interfaces) are also connected to the bus.

[0132] The following components are connected to the input / output interface: input sections including keyboards, mice, etc.; output sections including cathode ray tubes (CRTs), liquid crystal displays (LCDs), and speakers; storage sections including hard drives; and communication sections including network interface cards such as LAN cards and modems. The communication section performs communication processing via a network such as the Internet. Drives are also connected to the input / output interface as needed. Removable media, such as disks, optical discs, magneto-optical discs, semiconductor memories, etc., are installed on the drive as needed so that computer programs read from them can be installed into the storage section as required.

[0133] Specifically, according to embodiments of this application, the processes described in the various method flowcharts can be implemented as computer software programs. For example, embodiments of this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication component, and / or installed from a removable medium. When the computer program is executed by a central processing unit, it performs various functions defined in the system of this application.

[0134] According to one aspect of this application, a computer-readable storage medium is provided, wherein a processor of a computer device reads computer instructions from the computer-readable storage medium, and executes the computer instructions to cause the computer device to perform the methods provided in the various alternative implementations described above.

[0135] Optionally, in this embodiment, the computer-readable storage medium described above may be configured to store a computer program for performing the following steps: S1, During the process of the target object participating in the target somatosensory task, the pose outline of the target object is displayed on the interactive interface. The pose outline is a virtual outline obtained by contour recognition of the collected image containing the target object, and the interior of the pose outline is in an unfilled state. S2, when the pose outline collides with at least one virtual object appearing in the interactive interface, fill the content inside the pose outline. S3: When the filling progress inside the pose outline reaches the completion condition of the target haptic task, a task completion prompt message is displayed.

[0136] Optionally, in this embodiment, those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing the hardware related to the terminal device. The program can be stored in a computer-readable storage medium, which may include: flash drive, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0137] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0138] If the integrated units in the above embodiments are implemented as software functional units and sold or used as independent products, they can be stored in the aforementioned computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause one or more computer devices (which may be personal computers, servers, or network devices, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application.

[0139] In the above embodiments of this application, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0140] In the several embodiments provided in this application, it should be understood that the disclosed client can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces, indirect coupling or communication connection between units or modules, and may be electrical or other forms.

[0141] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0142] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0143] The above description is only a preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications should also be considered within the scope of protection of this application.

Claims

1. An interactive method for a motion-sensing task, characterized in that, include: During the process of the target object participating in the target somatosensory task, the pose outline of the target object is displayed on the interactive interface. The pose outline is a virtual outline obtained by contour recognition of the captured image containing the target object, and the interior of the pose outline is in an unfilled state. If the pose outline collides with at least one virtual object appearing in the interactive interface, the interior of the pose outline is filled with content. When the filling progress inside the pose outline reaches the completion condition of the target somatosensory task, a task completion prompt message is displayed; When the pose outline collides with at least one virtual object appearing in the interactive interface, the content filling of the interior of the pose outline includes: when the pose outline collides with the at least one virtual object and the interior filling progress has not reached the completion condition of the target haptic task, the content filling of the interior of the pose outline is performed, and a target identifier to be activated is displayed, wherein the target identifier is used to represent the internal entity element of the target object.

2. The method according to claim 1, characterized in that, When the filling progress inside the pose outline reaches the completion condition of the target somatosensory task, a task completion prompt message is displayed, including: When the internal filling progress reaches the completion condition of the target haptic task, a task completion prompt message is displayed, and the target identifier is activated.

3. The method according to claim 1, characterized in that, When the pose outline collides with at least one virtual object appearing within the interactive interface, after filling the interior of the pose outline with content, the process includes: In the event that the pose outline collides with the at least one virtual object, the collision attribute information of the at least one virtual object is obtained; The content is filled into the interior of the pose outline based on the collision attribute information.

4. The method according to claim 3, characterized in that, The step of filling the interior of the pose outline based on the collision attribute information includes: When the collision attribute information includes positive fill attribute information, a first quantity of the positive fill attribute information is obtained, and the interior of the pose outline is filled with a first capacity of content, wherein the first capacity is positively correlated with the first quantity; When the collision attribute information includes negative fill attribute information, a second quantity of the negative fill attribute information is obtained, and the content of the interior of the pose outline is subtracted by a second capacity, wherein the second capacity is positively correlated with the second quantity.

5. The method according to claim 3, characterized in that, The step of filling the interior of the pose outline based on the collision attribute information includes: When the collision attribute information includes the first filling attribute information of the first virtual object, the content corresponding to the first filling attribute information is filled into the interior of the pose outline contour. When the collision attribute information includes the second fill attribute information of the second virtual object, the interior of the pose outline is filled with the content corresponding to the second fill attribute information, wherein the content filling corresponding to the first fill attribute information is different from the content filling corresponding to the second fill attribute information.

6. The method according to claim 1, characterized in that, When the pose outline collides with at least one virtual object appearing within the interactive interface, filling the interior of the pose outline with content includes: In the event that the pose outline collides with at least one virtual object, the content of at least two internal regions of the pose outline is sequentially filled.

7. The method according to claim 1, characterized in that, When the pose outline collides with at least one virtual object appearing within the interactive interface, filling the interior of the pose outline with content includes: When the first part of the pose outline collides with the at least one virtual object and the filling progress of the first inner region of the pose outline does not reach the first threshold, the first inner region is filled with content, wherein the first part outline is associated with the first inner region and the first part outline corresponds to the first entity part of the target object. If the second part of the pose outline collides with the at least one virtual object and the filling progress of the second inner region of the pose outline does not reach the second threshold, the second inner region is filled with content, wherein the second part outline is associated with the second inner region and the second part outline corresponds to the second entity part of the target object.

8. The method according to any one of claims 1 to 7, characterized in that, When the pose outline collides with at least one virtual object appearing within the interactive interface, filling the interior of the pose outline with content includes: When the pose outline collides with at least one virtual object and the internal filling progress reaches a first filling threshold, the content of the pose outline is filled using a first-form filling element. When the pose outline collides with at least one virtual object and the internal filling progress reaches a second filling threshold, the filled elements of the first form are removed, and the contents of the pose outline are filled using the filling elements of the second form, wherein the second filling threshold is greater than the first filling threshold.

9. The method according to any one of claims 1 to 7, characterized in that, The process of displaying the pose outline of the target object on the interactive interface during the target object's participation in the target somatosensory task includes: N virtual objects in a moving state are generated at the initial position on the interactive interface, wherein the at least one virtual object includes the N virtual objects in a moving state. Remove the virtual objects that collide with the pose outline of the N moving virtual objects; or, remove the virtual objects that are outside the interactive interface of the N moving virtual objects.

10. The method according to claim 9, characterized in that, After generating N virtual objects in a moving state at the initial position on the interactive interface, the process includes: In response to a control command triggered by a target account participating in the target haptic task on a target virtual object, the movement position of the target virtual object within the interactive interface is adjusted, wherein the N virtual objects in the moving state include the target virtual object.

11. The method according to any one of claims 1 to 7, characterized in that, Before displaying the pose outline of the target object on the interactive interface during the target object's participation in the target somatosensory task, the process includes: Image acquisition is performed on the target object located within the interactive area associated with the target somatosensory task to obtain the target outline image of the target object; The target outline image is subjected to image recognition to obtain the image recognition result; The pose outline is obtained based on the image recognition result.

12. The method according to claim 11, characterized in that, The step of obtaining the pose outline based on the image recognition result includes: When the image recognition result includes the overall pixel data of the target outline image, first pixel data with a similarity to the background pixel data that is less than or equal to a first pixel threshold is selected from the overall pixel data; the pose outline contour is constructed using the first pixel data; or, If the image recognition result includes the overall pixel data, then select second pixel data from the overall pixel data whose pixel value is more than or equal to the human pixel value; and use the second pixel data to construct the pose outline contour.

13. An interactive device for motion-sensing tasks, characterized in that, include: The first display unit is used to display the posture outline of the target object on the interactive interface during the target object's participation in the target somatosensory task. The posture outline is a virtual outline obtained by performing contour recognition on the acquired image containing the target object, and the interior of the posture outline is in an unfilled state. The first filling unit is used to fill the interior of the pose outline with content when the pose outline collides with at least one virtual object appearing in the interactive interface. The second display unit is used to display a task completion prompt message when the filling progress inside the pose outline reaches the completion condition of the target somatosensory task. The first filling unit includes: a first display module, configured to fill the interior of the pose outline with content and display a target identifier to be activated when the pose outline collides with the at least one virtual object and the interior filling progress has not reached the completion condition of the target haptic task, wherein the target identifier is used to represent the internal entity element of the target object.

14. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein the program, when executed, performs the method described in any one of claims 1 to 12.

15. A computer program product comprising a computer program / instructions, characterized in that, When the computer program / instructions are executed by the processor, they implement the steps of the method described in any one of claims 1 to 12.

16. An electronic device comprising a memory and a processor, characterized in that, The memory stores a computer program, and the processor is configured to execute the method described in any one of claims 1 to 12 through the computer program.

Citation Information

Patent Citations

  • Monitoring fitness using a mobile device

    US20140371887A1