An interactive method and related apparatus

Abstract

The embodiment of the application discloses an interactive method and related device, when playing interactive content including multiple resources, first resource is played first, if the first resource completes playing, a first image corresponding to the first resource is displayed, the first image is used to indicate the object to make a corresponding action, a second image of the object is collected, a matching result of the first image and the second image is obtained, and the second resource included in the interactive content is played according to the matching result. Thus, when playing the interactive content, after the first resource completes playing, the object can be provided to make a corresponding action according to the first image to realize interaction, the second resource is played according to the interaction, so that more playability is provided, more interaction scenes are opened, the participation of the object is higher, and the experience of the user is improved.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to an interactive method and related apparatus. Background Technology

[0002] In order to attract more traffic, major platforms have launched modes of resource interaction with users, such as interactive videos. Users can participate and interact continuously while watching, intervene in the environment of the show, make choices at key plot points, and influence the plot or game's direction.

[0003] Interactive video is essentially a multi-threaded video model, where a single video contains multiple sub-videos. After the current sub-video finishes playing, the next sub-video to play is determined based on the user's selection. In related technologies, this is typically achieved through traditional user interface (UI) interaction methods. For example, after the current sub-video finishes playing, multiple options are provided on the page for the user to select using a mouse or other tools.

[0004] However, the above methods have low playability, low user engagement, and poor user experience. Summary of the Invention

[0005] To address the aforementioned technical problems, this application provides an interactive method and related apparatus for improving the user experience.

[0006] The embodiments of this application disclose the following technical solutions:

[0007] In a first aspect, embodiments of this application provide an interactive method, the method comprising:

[0008] The first of several resources included in the interactive content playback;

[0009] In response to the completion of playback of the first resource, a first image corresponding to the first resource is displayed, and the first image is used to instruct the object to perform a corresponding action.

[0010] Acquire a second image of the object;

[0011] Obtain the matching results of the first image and the second image;

[0012] Play the second resource based on the matching result, where the second resource is one of the plurality of resources.

[0013] Secondly, embodiments of this application provide an interactive method, the method comprising:

[0014] Obtain the authentication request of the terminal device, the authentication request including the resource identifier of the first resource and the second image of the object, wherein the first resource is one of a plurality of resources included in the interactive content;

[0015] Determine the matching result between the second image and the first image, wherein the first image is used to instruct the object to perform a corresponding action;

[0016] The matching result is sent to the terminal device so that the terminal device can play a second resource corresponding to the matching result, wherein the second resource is one of a plurality of resources included in the interactive content.

[0017] Thirdly, embodiments of this application provide an interactive device, the device comprising: a playback unit, a display unit, a collection unit, and an acquisition unit;

[0018] The playback unit is used to play the first resource among multiple resources included in the interactive content;

[0019] The display unit is configured to display a first image corresponding to the first resource in response to the completion of playback of the first resource, wherein the first image is used to instruct the object to perform a corresponding action;

[0020] The acquisition unit is used to acquire a second image of the object;

[0021] The acquisition unit is used to acquire the matching result of the first image and the second image;

[0022] The playback unit is used to play a second resource according to the matching result, wherein the second resource is one of the plurality of resources.

[0023] Fourthly, embodiments of this application provide an interactive device, the device comprising: an acquisition unit, a determination unit, and a transmission unit;

[0024] The acquisition unit is used to acquire the authentication request of the terminal device. The authentication request includes the resource identifier of the first resource and the second image of the object. The first resource is one of a plurality of resources included in the interactive content.

[0025] The determining unit is used to determine the matching result between the second image and the first image, wherein the first image is used to instruct the object to perform a corresponding action;

[0026] The sending unit is used to send the matching result to the terminal device so that the terminal device can play a second resource corresponding to the matching result, wherein the second resource is one of a plurality of resources included in the interactive content.

[0027] Fifthly, embodiments of this application provide an interactive system, the system comprising a terminal device and a server:

[0028] The terminal device is used to perform the method described in the first aspect;

[0029] The server is used to execute the method described in the second aspect.

[0030] Sixthly, embodiments of this application provide a computer device, the device including a processor and a memory:

[0031] The memory is used to store program code and transmit the program code to the processor;

[0032] The processor is configured to execute the methods described in the first and second aspects according to the instructions in the program code.

[0033] In a seventh aspect, embodiments of this application provide a computer-readable storage medium for storing a computer program for performing the methods described in the first and second aspects.

[0034] Eighthly, embodiments of this application provide a computer program product or computer program including computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods described in the first and second aspects.

[0035] As can be seen from the above technical solution, when playing interactive content comprising multiple resources, the first resource is played first. Once the first resource has finished playing, a first image corresponding to it is displayed. This first image is used to instruct the object to perform a corresponding action. A second image of the object is then captured, and the matching result between the first and second images is obtained. Based on the matching result, the second resource included in the interactive content is played. Therefore, when playing interactive content, after the first resource has finished playing, interaction can be achieved by allowing the object to perform a corresponding action according to the first image. The second resource is then played based on the interaction, thus providing more playability, opening up more interactive scenarios, increasing object participation, and improving the user experience. Attached Figure Description

[0036] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0037] Figure 1 This is a schematic diagram of a video interaction provided in an embodiment of this application;

[0038] Figure 2 A schematic diagram of an interactive system provided in an embodiment of this application;

[0039] Figure 3 A signaling interaction diagram of an interactive system provided in an embodiment of this application;

[0040] Figure 4 A schematic diagram illustrating an interactive method provided in an embodiment of this application;

[0041] Figure 5 A flowchart illustrating an interactive method provided in an embodiment of this application;

[0042] Figure 6 This is a schematic diagram illustrating an application scenario of an interactive method provided in an embodiment of this application.

[0043] Figure 7 A schematic diagram of an interactive device provided in an embodiment of this application;

[0044] Figure 8 A schematic diagram of an interactive device provided in an embodiment of this application;

[0045] Figure 9 This is a schematic diagram of the server structure provided in an embodiment of this application;

[0046] Figure 10 This is a schematic diagram of the structure of a terminal device provided in an embodiment of this application. Detailed Implementation

[0047] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a particular order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented, for example, in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “corresponding to,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0048] During the playback of resources such as videos, images, or music, user interaction is crucial. It not only attracts more users but also enhances the user experience. In one example, the resource is an interactive video featuring a race game using different modes of transportation, comprising multiple sub-videos. For clarity, please refer to [link to relevant documentation]. Figure 1 The figure illustrates a video interaction method provided in an embodiment of this application. As shown, after the current sub-video finishes playing, three controls are displayed on the player interface. Different controls correspond to different modes of transportation. Users can click different buttons to continue playing different sub-videos based on their selections. However, this method only allows users to interact through traditional UI interaction methods, resulting in low playability and a poor user experience.

[0049] Based on this, this application provides an interactive method that allows the object to perform corresponding actions according to the first image during interaction. The resource continues to play based on the completion of the actions, providing more playability for the resource playback, opening up more interactive scenarios, increasing the object's participation, and improving the user experience.

[0050] This method is applied to Figure 2 The interactive system shown in the figure includes a server and terminal devices. The server involved in this application can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms. Terminal devices can be smartphones, tablets, laptops, PDAs, personal computers, smart TVs, smartwatches, in-vehicle devices, wearable devices, etc., but are not limited to these. Terminals and servers can be directly or indirectly connected via wired or wireless communication, which is not limited here. The number of servers and terminal devices is also not limited.

[0051] Based on the above introduction, the interactive system provided in this application will be described below. The interactive system includes a terminal device and a server. The terminal device mainly performs functions such as playing interactive content, displaying a first image or capturing a second image. The server mainly performs functions such as determining the matching result of the first image and the second image so that the matching algorithm can be updated in a timely manner.

[0052] As one possible implementation, the functions implemented by the server can also be implemented through the terminal device to save network requests and ensure normal interaction in the event of server failure. However, when the matching algorithm requires a large amount of computation, it may consume a lot of resources, which may not be able to be handled by the terminal device alone. As another possible implementation, a simplified version of the matching algorithm can be built into the terminal device as a fallback solution when the server fails to identify the match or when the server malfunctions.

[0053] For ease of explanation, the following detailed description uses a scheme involving interaction between a terminal device and a server. See [link to relevant documentation]. Figure 3 This figure is a signaling interaction diagram of an interactive system provided in an embodiment of this application.

[0054] S301: The first resource among multiple resources included in the interactive content played by the terminal device.

[0055] In one or more embodiments, an interactive device deployed on a terminal device plays a first resource from a plurality of resources included in the interactive content. These resources include, but are not limited to, video, audio, or text / image content. The interactive content includes multiple resources for interacting with objects; for example, six 10-second sub-videos (resources) constitute a one-minute video (interactive content). The object is the target for interaction, such as a user, a thing, etc.

[0056] S302: The terminal device responds to the completion of playback of the first resource by displaying the first image corresponding to the first resource.

[0057] In one or more embodiments, the interactive content includes at least a first resource and a second resource. After the first resource is played, the interactive content enters the stage of interacting with the object, that is, displaying a first image corresponding to the first resource. The first image is used to instruct the object to perform a corresponding action. For example, the first image displays a yoga pose so that the object can perform the corresponding yoga pose according to the instructions of the first image.

[0058] It's important to note that the first image can include multiple sub-images. Different sub-images instruct the object to perform different actions, each representing a different choice. Thus, the object can mimic an action in one of the sub-images to make a corresponding choice, and then continue playing the corresponding resource based on that choice. For example, when the interactive content is a yoga video, the first image can display multiple yoga poses, each representing a different difficulty level. This allows the user's yoga level to be determined, enabling the playback of yoga videos at different levels. Therefore, not only do the multiple sub-images enrich the user's choices and increase their engagement, but they also provide an immersive experience, enhancing the user's overall experience.

[0059] It should be noted that when the target is a user, the first image can instruct the user to make corresponding body movements using at least two body parts. These body parts can be major joints such as the top of the head, facial features, neck, and limbs, so that multiple parts of the user's body can participate in the interaction, increasing user engagement, giving the user a sense of immersion, and improving the user experience.

[0060] It should be noted that when the object is a user, the terminal device used by the user is mostly a smartphone. In order to adapt to the image acquisition unit of the smartphone, such as the characteristic that the smartphone camera only captures objects at close range, the user can be instructed to make corresponding gestures through the first image. In order to make it easier to capture the second image of the object in the subsequent acquisition, the image that only includes the user's gestures is easier to capture than the image that includes the user's body movements, thus improving the user experience.

[0061] S303: The second image of the object acquired by the terminal device.

[0062] In one or more embodiments, after the first image is displayed, the object may perform a corresponding action according to the instructions of the first image. At this time, the interactive device may call an image acquisition unit such as a camera to acquire a second image of the object.

[0063] S304: The server receives an authentication request from the terminal device.

[0064] The terminal device includes the resource identifier of the first resource and the second image in the authentication request and sends them to the server so that the server can determine the matching result of the first image and the second image. It is understood that the first resource played by the terminal device is obtained from the server. At the same time as obtaining the first resource, the terminal device also obtains the first image corresponding to the first resource. Therefore, the server can determine the first image based on the resource identifier of the first resource.

[0065] It should be noted that the authentication request may also include the content identifier of the interactive content to which the first resource belongs, so that when the server provides authentication services for multiple terminal devices at the same time, it can accurately determine the first image corresponding to each authentication request.

[0066] S305: The server determines the matching result between the second image and the first image.

[0067] This application does not specifically limit the method for determining the matching result of the first image and the second image. For example, it can use Euclidean distance or cosine similarity. Those skilled in the art can set the method as needed. The following description uses Euclidean distance as an example.

[0068] When the first image instructs the user to perform a corresponding body movement, the body key points of the object in the second image can be identified. These key points can include major joints such as the top of the head, facial features, neck, and limbs. The body sensory information feature values ​​of the second image can be extracted based on these key points. The matching result between the second image and the first image can be determined by comparing the body sensory information feature values ​​of the second image with the unlocking body sensory feature values ​​of the first image.

[0069] It should be noted that the unlocking motion feature value of the first image can be entered by the editors of the interactive content or the operators of the resource website when creating the interactive content. Alternatively, after setting the first image, the server can use artificial intelligence (AI) to identify and obtain the unlocking motion feature value based on the first image. This application does not make any specific limitations on this.

[0070] S306: The terminal device obtains the matching result of the first image and the second image.

[0071] The server sends the matching results of the first and second images to the terminal device.

[0072] S307: The terminal device plays the second resource based on the matching result.

[0073] If the terminal device obtains a matching result indicating that the second image and the first image are successfully matched, for example, by obtaining the second resource based on the resource identifier of the first resource, the second resource can continue playing. The second resource can be the resource following the first resource in the interactive content, in chronological order.

[0074] If the first image comprises multiple sub-images, the obtained matching result will be refined to match a target sub-image within the first image, where the target sub-image is one of the multiple sub-images included in the first image. In this case, if the terminal device obtains a matching result indicating that the second image matches the target sub-image, since different sub-images correspond to different subsequent resources, the second resource can be obtained and played based on the resource identifiers of the target sub-image and the first resource.

[0075] If the terminal device obtains a matching result indicating that the second image and the first image fail to match, it can execute S303-S306 again until a successful matching result is obtained, and then play the second resource according to the matching result.

[0076] To make the technical solutions provided in the embodiments of this application clearer, the following is in conjunction with... Figure 4The interactive method provided in this application embodiment will be described using an example. When playing interactive content including multiple resources through the playback interface of a terminal device, only one resource is played at a time. During the playback of a single resource, the playback interface will display a traditional playback progress bar, pause / play buttons, etc. For ease of explanation, the following example uses interactive content including a first resource and a second resource, where both the first and second resources are videos. See [link to example]. Figure 4 The playback interface 401 of the terminal device 400 plays interactive content. The playback interface 401 will first play the first resource. After the first resource is finished playing, it will display the first image that asks the user to make a heart shape above their head. Then, it will turn on the camera to capture the user's second image and send the second image and the resource identifier of the first resource to the server in the form of an authentication request to obtain the matching result. When the first image and the second image are successfully matched, the second resource will be played according to the matching result.

[0077] As can be seen from the above technical solution, when playing interactive content comprising multiple resources, the first resource is played first. Once the first resource has finished playing, a first image corresponding to it is displayed. This first image is used to instruct the object to perform a corresponding action. A second image of the object is then captured, and the matching result between the first and second images is obtained. Based on the matching result, the second resource included in the interactive content is played. Therefore, when playing interactive content, after the first resource has finished playing, interaction can be achieved by allowing the object to perform a corresponding action according to the first image. The second resource is then played based on the interaction, thus providing more playability, opening up more interactive scenarios, increasing object participation, and improving the user experience.

[0078] As one possible implementation, prior to S301, the terminal device could obtain interactive content from the server. Since the interactive content includes multiple resources, this application provides two methods depending on how the terminal device obtains the resources, which will be described below.

[0079] The first method: The terminal device obtains only one resource from the server each time.

[0080] After the terminal device obtains the trigger operation of the object, such as when the user clicks to play interactive content on the playback interface of the terminal device, the terminal device sends the content identifier including the interactive content to the server. The server determines the interactive content corresponding to the content identifier based on the content identifier. The server determines the resource type of the first resource in the interactive content. If the first resource is a motion-sensing lock type, the server sends the first resource to the terminal device; if the first resource is not a motion-sensing lock type, the server obtains the third resource, uses the third resource as the first resource, and determines the resource type of the first resource again.

[0081] For example, if the interactive content includes three video segments, and the resource types of the first, second, and third video segments are all non-motion-locked, then after receiving the content identifier of the interactive content sent by the terminal device, the server determines that the resource type of the first video segment is non-motion-locked, then retrieves the second video segment. After determining that the resource type of the second video segment is non-motion-locked, the server retrieves the third video segment. If the resource type of the third video segment is determined to be motion-locked, then the server sends the first, second, and third video segments as the first resource to the terminal device.

[0082] The second method involves the terminal device acquiring all interactive content at once.

[0083] After the terminal device obtains the trigger operation of the object, it retrieves the interactive content based on the content identifier of the interactive content carried by the trigger operation, determines the resource type of the first resource in the interactive content, and if the first resource is a non-motion-sensing locking type, it retrieves the third resource, uses the third resource as the first resource, and determines the resource type of the first resource again. If the first resource is a motion-sensing locking type, it executes the aforementioned S303.

[0084] As one possible implementation, unlike the aforementioned approaches, the first resource is only one resource. (Participate) Figure 5 The figure is a flowchart of an interactive method provided in an embodiment of this application.

[0085] S501: First resource playback complete.

[0086] S502: Determine whether the first resource is a motion-sensing lock type. If not, execute S503; if yes, execute S504.

[0087] S503: Play the second resource.

[0088] S504: Acquire a second image through the image acquisition unit.

[0089] S505: Send the resource identifier of the first resource and the second image of the object to the server in the authentication request.

[0090] The server determines the matching result between the second image and the first image and sends the matching result to the terminal device. As one possible implementation, if the matching result indicates a successful match between the first and second images, the server sends the resource identifier of the second resource corresponding to the matching result to the terminal device. If the first and second images fail to match, the server returns an empty resource identifier to the terminal device.

[0091] S506: Determine if the resource identifier is empty. If yes, execute S504; otherwise, execute S507.

[0092] S507: Play the second resource according to the resource identifier of the second resource.

[0093] As one possible implementation, the matching result will differ depending on whether the first image includes multiple sub-images, which will be explained below.

[0094] The first type: The first image does not include sub-images.

[0095] Alternatively, if the first image contains only one action, the matching result can be either a successful match or a failed match.

[0096] For example, the unlocking haptic feature values ​​of the first image are represented in the form of a two-dimensional array, such as [[10, 20, 30], [30, 25, 20, 15], [1, 2, 3, 4]]. In this case, the unlocking haptic feature values ​​of the first image can be strictly matched with the haptic information feature values ​​of the second image, or there can be a certain error. This application does not make specific limitations on this; the following explanation uses an error of 10%.

[0097] The haptic information feature value and the unlocking haptic feature value not only need to have the same dimension, but the haptic information feature value also needs to be between 90% and 110% of the unlocking haptic feature value. For example, when the haptic information feature value is [[9, 21, 31], [30, 25, 20, 15], [1, 2, 3, 4]], the matching result is that the second image and the first image are successfully matched. However, when the haptic information feature value is [[10, 20, 30], [30, 25, 20, 15]], the matching result is that the second image and the first image are not matched (the dimensions are different); when the haptic information feature value is [[1, 2, 3], [30, 25, 20, 15], [1, 2, 3, 4]], the matching result is that the second image and the first image are not matched (the error is too large).

[0098] The second type: The first image includes multiple sub-images.

[0099] Alternatively, the first image may contain multiple sub-images, each indicating a different action to be performed by the object, thus corresponding to different unlocking motion sensory feature values. In this case, the matching result could be a successful match with a specific sub-image in the first image, or a failure to match the first image with the second image.

[0100] For example, based on the haptic information feature value of the second image, a target sub-image is determined from multiple sub-images included in the first image. The unlocking haptic feature value of the target sub-image and the haptic information feature value of the second image meet a preset condition. Based on the haptic information feature value of the second image and the unlocking haptic feature value of the target sub-image, the matching result between the second image and the first image is determined.

[0101] For example, compared to the unlocking haptic feature values ​​of other sub-images, the unlocking haptic feature value of the target sub-image is closest to the haptic information feature value of the second image. If the similarity is 90%, the second image and the target sub-image in the first image are successfully matched. If the similarity is 50%, the second image and the first image are not matched.

[0102] The following is combined Figure 6 Taking video as an example, this paper introduces the application scenarios of the interactive method provided in the embodiments of this application through examples from the operation side, the backend, and the user side.

[0103] On the operations side: Video editors or video website operators can upload videos to the backend or edit them using the aforementioned terminal devices. For example, a media asset editing and input platform can be provided for the operations side, such as a World Wide Web (WWW) platform. Specifically, video editors or video website operators input relevant video information, such as motion-sensing unlock feature values, resource identifiers, and content identifiers, through the media asset editing and input platform, as detailed in Table 1.

[0104] Table 1

[0105] Information fields Field meaning video_id Content Identifier point_id Resource Identifier time Time point lock_type Resource types pattern Unlock motion-sensing features next_pass_point_id If authentication is successful, the resource identifier of the second resource will be... next_fail_point_id It can be empty, used in scenarios where authentication fails.

[0106] The terminal device can play different resources based on the time point. Resource types are divided into motion-locked and non-motion-locked types, represented by 1 for motion-locked and 0 for non-motion-locked. The unlocked motion-sensing feature value is compared with the motion-sensing information feature value to determine whether the second image matches the first image successfully.

[0107] The backend side refers to the aforementioned server, and may further include a media asset platform, an authentication platform, and an image recognition platform. The media asset platform stores interactive content and information fields such as resource identifiers entered by the operator through the media asset editing and input platform, providing resources to the user side. After obtaining the resource identifier and the second image sent by the user side, the authentication platform retrieves the unlocking haptic feature value of the first image from the media asset platform based on the resource identifier, sends the second image to the image recognition platform to obtain the haptic information feature value of the second image, and then determines the matching result based on the unlocking haptic feature value and the haptic information feature value, returning the matching result to the user side.

[0108] User side: refers to the aforementioned terminal device, which includes a player for playing interactive content. The user plays interactive content through the player, and the player obtains playback information such as resource streaming information and resource identifiers from the media asset platform. If the first resource finishes playing, the player displays the first image and uses the camera provided by the terminal device to capture the user's second image. The player then sends the second image and resource identifier to the authentication platform to obtain the matching result.

[0109] In addition to the interactive methods provided in the above embodiments, this application also provides an interactive device.

[0110] See Figure 7 This figure is a schematic diagram of an interactive device provided in an embodiment of this application. Figure 7 As shown, the interactive device 700 includes: a playback unit 701, a display unit 702, a collection unit 703, and an acquisition unit 704;

[0111] The playback unit 701 is used to play the first resource among multiple resources included in the interactive content;

[0112] The display unit 702 is configured to display a first image corresponding to the first resource in response to the completion of playback of the first resource, wherein the first image is used to instruct the object to perform a corresponding action.

[0113] The acquisition unit 703 is used to acquire a second image of the object;

[0114] The acquisition unit 704 is used to acquire the matching result of the first image and the second image;

[0115] The playback unit 701 is used to play a second resource according to the matching result, wherein the second resource is one of the plurality of resources.

[0116] As one possible implementation, the device further includes a receiving unit, a determining unit, and an execution unit;

[0117] The receiving unit is used to receive the trigger operation of the object, and the trigger operation includes the content identifier of the interactive content;

[0118] The acquisition unit 704 is used to acquire the first resource of the interactive content according to the content identifier.

[0119] As one possible implementation, the device further includes a receiving unit;

[0120] The receiving unit is used to receive the trigger operation of the object, and the trigger operation includes the content identifier of the interactive content;

[0121] The acquisition unit 704 is used to acquire the interactive content according to the content identifier;

[0122] The determining unit is used to determine the resource type of the first resource of the interactive content;

[0123] The execution unit is configured to execute the step of acquiring the second image of the object in response to the resource type of the first resource being a motion-sensing locking type;

[0124] In response to the fact that the resource type of the first resource is a non-motion-sensing locking type, a third resource is obtained, and the third resource is used as the first resource. The step of determining the resource type of the first resource among the multiple resources included in the interactive content is then executed.

[0125] As one possible implementation, the acquisition unit 704 is used for:

[0126] The second resource is obtained based on the resource identifier of the first resource.

[0127] As one possible implementation, the acquisition unit 704 is used for:

[0128] The second resource is obtained based on the target sub-image and the resource identifier of the first resource, wherein the target sub-image is a sub-image included in the first image.

[0129] As can be seen from the above technical solution, when playing interactive content comprising multiple resources, the first resource is played first. Once the first resource has finished playing, a first image corresponding to it is displayed. This first image is used to instruct the object to perform a corresponding action. A second image of the object is then captured, and the matching result between the first and second images is obtained. Based on the matching result, the second resource included in the interactive content is played. Therefore, when playing interactive content, after the first resource has finished playing, interaction can be achieved by allowing the object to perform a corresponding action according to the first image. The second resource is then played based on the interaction, thus providing more playability, opening up more interactive scenarios, increasing object participation, and improving the user experience.

[0130] See Figure 8 This figure is a schematic diagram of an interactive device provided in an embodiment of this application. Figure 8 As shown, the interactive device 800 includes: an acquisition unit 801, a determination unit 802, and a sending unit 803;

[0131] The acquisition unit 801 is used to acquire the authentication request of the terminal device. The authentication request includes the resource identifier of the first resource and the second image of the object. The first resource is one of a plurality of resources included in the interactive content.

[0132] The determining unit 802 is used to determine the matching result between the second image and the first image, wherein the first image is used to instruct the object to perform a corresponding action;

[0133] The sending unit 803 is used to send the matching result to the terminal device so that the terminal device can play the second resource corresponding to the matching result according to the matching result, wherein the second resource is one of the multiple resources included in the interactive content.

[0134] As one possible implementation, the first image is used to instruct the object to perform a corresponding body action, and the determining unit 802 is used to:

[0135] Identify key human body features of the object in the second image;

[0136] Based on the key points of the human body, extract the somatosensory information feature values ​​of the second image;

[0137] The matching result between the second image and the first image is determined based on the haptic information feature value of the second image and the unlocking haptic feature value corresponding to the first image.

[0138] As one possible implementation, the first image includes multiple sub-images, each sub-image corresponding to a different unlocking haptic feature value. The determining unit 802 is used to:

[0139] Based on the somatosensory information feature value of the second image, a target sub-image is determined from the plurality of sub-images, wherein the unlocking somatosensory feature value of the target sub-image and the somatosensory information feature value of the second image satisfy a preset condition;

[0140] The matching result between the second image and the first image is determined based on the haptic information feature value of the second image and the unlocking haptic feature value of the target sub-image.

[0141] As one possible implementation, the device further includes a receiving unit and an execution unit;

[0142] The receiving unit is used to receive the content identifier sent by the terminal device;

[0143] The determining unit 802 is configured to determine the interactive content corresponding to the content identifier based on the content identifier; and determine the resource type of the first resource among the multiple resources included in the interactive content.

[0144] The execution unit is configured to send the first resource to the terminal device in response to the first resource being a motion-sensing lock type.

[0145] In response to the fact that the resource type of the first resource is a non-motion-sensing locking type, a third resource is obtained, and the third resource is used as the first resource. The step of determining the resource type of the first resource among the multiple resources included in the interactive content is then executed.

[0146] As can be seen from the above technical solution, when playing interactive content comprising multiple resources, the first resource is played first. Once the first resource has finished playing, a first image corresponding to it is displayed. This first image is used to instruct the object to perform a corresponding action. A second image of the object is then captured, and the matching result between the first and second images is obtained. Based on the matching result, the second resource included in the interactive content is played. Therefore, when playing interactive content, after the first resource has finished playing, interaction can be achieved by allowing the object to perform a corresponding action according to the first image. The second resource is then played based on the interaction, thus providing more playability, opening up more interactive scenarios, increasing object participation, and improving the user experience.

[0147] The aforementioned interactive system can be a computer device, which can be a server or a terminal device. The aforementioned interactive device can be built into the server or terminal device. The computer device provided in this application embodiment will be described below from the perspective of hardware implementation. Figure 9 The diagram shown is a schematic of the server's structure. Figure 10 The diagram shown is a structural schematic of the terminal device.

[0148] See Figure 9 , Figure 9 This is a schematic diagram of a server structure provided in an embodiment of this application. The server 1400 can vary significantly due to different configurations or performance. It may include one or more Central Processing Units (CPUs) 1422 (e.g., one or more processors) and a memory 1432, and one or more storage media 1430 (e.g., one or more mass storage devices) for storing application programs 1442 or data 1444. The memory 1432 and storage media 1430 can be temporary or persistent storage. The program stored in the storage media 1430 may include one or more modules (not shown in the diagram), each module may include a series of instruction operations on the server. Furthermore, the CPU 1422 may be configured to communicate with the storage media 1430 and execute the series of instruction operations in the storage media 1430 on the server 1400.

[0149] Server 1400 may also include one or more power supplies 1426, one or more wired or wireless network interfaces 1450, one or more input / output interfaces 1458, and / or one or more operating systems 1441, such as Windows Server. TM Mac OS X TM Unix TM Linux TM FreeBSD TM etc.

[0150] The steps performed by the server in the above embodiments can be based on this Figure 9 The server structure shown.

[0151] CPU 1422 is used to perform the following steps:

[0152] The first of several resources included in the interactive content playback;

[0153] In response to the completion of playback of the first resource, a first image corresponding to the first resource is displayed, and the first image is used to instruct the object to perform a corresponding action.

[0154] Acquire a second image of the object;

[0155] Obtain the matching results of the first image and the second image;

[0156] Play the second resource based on the matching result, where the second resource is one of the plurality of resources.

[0157] Alternatively, follow these steps:

[0158] Obtain the authentication request of the terminal device, the authentication request including the resource identifier of the first resource and the second image of the object, wherein the first resource is one of a plurality of resources included in the interactive content;

[0159] Determine the matching result between the second image and the first image, wherein the first image is used to instruct the object to perform a corresponding action;

[0160] The matching result is sent to the terminal device so that the terminal device can play a second resource corresponding to the matching result, wherein the second resource is one of a plurality of resources included in the interactive content.

[0161] Optionally, the CPU 1422 may also execute method steps of any specific implementation of the interaction method in the embodiments of this application.

[0162] See Figure 10 , Figure 10This is a schematic diagram of the structure of a terminal device provided in an embodiment of this application. Figure 10 The diagram shown is a block diagram of a partial structure of a smartphone related to the terminal device provided in the embodiments of this application. The smartphone includes: a radio frequency (RF) circuit 1510, a memory 1520, an input unit 1530, a display unit 1540, a sensor 1550, an audio circuit 1560, a wireless Fidelity (WiFi) module 1570, a processor 1580, and a power supply 1590, among other components. Those skilled in the art will understand that... Figure 10 The smartphone structure shown does not constitute a limitation on smartphones and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0163] The following is combined Figure 10 A detailed introduction to the various components of a smartphone:

[0164] RF circuit 1510 can be used for receiving and transmitting signals during information transmission or calls. Specifically, it receives downlink information from the base station and processes it with processor 1580; additionally, it transmits uplink data to the base station. Typically, RF circuit 1510 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier (LNA), and a duplexer. Furthermore, RF circuit 1510 can also communicate wirelessly with networks and other devices. The aforementioned wireless communication can use any communication standard or protocol, including but not limited to Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, and Short Messaging Service (SMS).

[0165] The memory 1520 can be used to store software programs and modules. The processor 1580 executes the software programs and modules stored in the memory 1520 to realize various functions and data processing of the smartphone. The memory 1520 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, applications required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the smartphone (such as audio data, phonebook, etc.). In addition, the memory 1520 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0166] The input unit 1530 can be used to receive input numerical or character information, and to generate key signal inputs related to user settings and function control of the smartphone. Specifically, the input unit 1530 may include a touch panel 1531 and other input devices 1532. The touch panel 1531, also known as a touch screen, can collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near the touch panel 1531), and drive corresponding connected devices according to a pre-set program. Optionally, the touch panel 1531 may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch position and the signal generated by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, sends it to the processor 1580, and can receive and execute commands sent by the processor 1580. In addition, the touch panel 1531 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1531, the input unit 1530 may also include other input devices 1532. Specifically, other input devices 1532 may include, but are not limited to, one or more of the following: physical keyboard, function keys (such as volume control buttons, power buttons, etc.), trackball, mouse, joystick, etc.

[0167] Display unit 1540 can be used to display information input by the user or information provided to the user, as well as various menus of the smartphone. Display unit 1540 may include display panel 1541, optionally configured as a Liquid Crystal Display (LCD), Organic Light-Emitting Diode (OLED), or similar display panel 1541. Further, touch panel 1531 may cover display panel 1541. When touch panel 1531 detects a touch operation on or near it, it transmits the information to processor 1580 to determine the type of touch event. Subsequently, processor 1580 provides corresponding visual output on display panel 1541 based on the type of touch event. Although in Figure 10 In this embodiment, the touch panel 1531 and the display panel 1541 are two separate components to realize the input and output functions of the smartphone. However, in some embodiments, the touch panel 1531 and the display panel 1541 can be integrated to realize the input and output functions of the smartphone.

[0168] Smartphones may also include at least one sensor 1550, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display panel 1541 according to the ambient light level, and the proximity sensor can turn off the display panel 1541 and / or the backlight when the smartphone is moved to the ear. As a type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes). When stationary, it can detect the magnitude and direction of gravity and can be used for applications that recognize the smartphone's posture (such as landscape / portrait switching, related games, magnetometer posture calibration), vibration recognition-related functions (such as pedometers, taps), etc. Other sensors that smartphones may also be equipped with, such as gyroscopes, barometers, hygrometers, thermometers, and infrared sensors, will not be described in detail here.

[0169] Audio circuit 1560, speaker 1561, and microphone 1562 provide an audio interface between the user and the smartphone. Audio circuit 1560 converts received audio data into electrical signals and transmits them to speaker 1561, where speaker 1561 converts them into sound signals for output. On the other hand, microphone 1562 converts collected sound signals into electrical signals, which are received by audio circuit 1560, converted into audio data, and then processed by processor 1580 before being transmitted via RF circuit 1510 to, for example, another smartphone, or the audio data can be output to memory 1520 for further processing.

[0170] WiFi is a short-range wireless transmission technology. Smartphones using the WiFi module 1570 can help users send and receive emails, browse web pages, and access streaming media, providing wireless broadband internet access. Although Figure 10 WiFi module 1570 is shown, but it is understood that it is not an essential component of a smartphone and can be omitted as needed without changing the nature of the invention.

[0171] The processor 1580 is the control center of the smartphone, connecting various parts of the smartphone via various interfaces and lines. It performs various functions and processes data by running or executing software programs and / or modules stored in the memory 1520 and by accessing data stored in the memory 1520. Optionally, the processor 1580 may include one or more processing units; preferably, the processor 1580 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 1580.

[0172] The smartphone also includes a power supply 1590 (such as a battery) that supplies power to various components. Preferably, the power supply can be logically connected to the processor 1580 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system.

[0173] Although not shown, smartphones may also include a camera, Bluetooth module, etc., which will not be described in detail here.

[0174] In this embodiment of the application, the memory 1520 included in the smartphone can store program code and transmit the program code to the processor.

[0175] The processor 1580 included in the smartphone can execute the interactive methods provided in the above embodiments according to the instructions in the program code.

[0176] This application also provides a computer-readable storage medium for storing a computer program that performs the interactive method provided in the above embodiments.

[0177] This application also provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the interactive methods provided in the various optional implementations of the above aspects.

[0178] Those skilled in the art will understand that all or part of the steps of the above method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it performs the steps of the above method embodiments. The aforementioned storage medium can be at least one of the following media: read-only memory (ROM), RAM, magnetic disk or optical disk, and other media that can store program code.

[0179] It should be noted that the various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, for the device and system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiments. The device and system embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of the solution in this embodiment according to actual needs. Those skilled in the art can understand and implement this without creative effort.

[0180] The above description is merely one specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Based on the implementation methods provided in the above aspects, this application can also be further combined to provide more implementation methods. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An interactive method, characterized in that, The method includes: The first of several resources included in the interactive content playback; In response to the completion of playback of the first resource, a first image corresponding to the first resource is displayed, and the first image is used to instruct the object to perform a corresponding action. Acquire a second image of the object; Obtain the matching results of the first image and the second image; Play the second resource according to the matching result, where the second resource is one of the plurality of resources; The method further includes: Determine the resource type of the first resource among the multiple resources included in the interactive content; In response to the first resource being of the motion-sensing locking type, the step of acquiring the second image of the object is executed; In response to the fact that the resource type of the first resource is a non-motion-sensing locking type, a third resource is obtained, and the third resource is used as the first resource. The step of determining the resource type of the first resource among the multiple resources included in the interactive content is then executed.

2. The method according to claim 1, characterized in that, The method further includes: Receive a trigger operation from the object, the trigger operation including the content identifier of the interactive content; The first resource for obtaining the interactive content is obtained based on the content identifier.

3. The method according to claim 1, characterized in that, The method further includes: Receive a trigger operation from the object, the trigger operation including the content identifier of the interactive content; The interactive content is obtained based on the content identifier.

4. The method according to claim 3, characterized in that, The method further includes: The second resource is obtained based on the resource identifier of the first resource.

5. The method according to claim 3, characterized in that, The first image includes multiple sub-images, with different sub-images used to instruct the object to perform different actions. The method further includes: The second resource is obtained based on the target sub-image and the resource identifier of the first resource, wherein the target sub-image is a sub-image included in the first image.

6. An interactive method, characterized in that, The method includes: Obtain the authentication request of the terminal device, the authentication request including the resource identifier of the first resource and the second image of the object, wherein the first resource is one of a plurality of resources included in the interactive content; Determine the matching result between the second image and the first image, wherein the first image is used to instruct the object to perform a corresponding action; The matching result is sent to the terminal device so that the terminal device can play the second resource corresponding to the matching result, wherein the second resource is one of the multiple resources included in the interactive content; The method further includes: Determine the resource type of the first resource among the multiple resources included in the interactive content; In response to the fact that the resource type of the first resource is a motion-sensing lock type, the first resource is sent to the terminal device; In response to the fact that the resource type of the first resource is a non-motion-sensing locking type, a third resource is obtained, and the third resource is used as the first resource. The step of determining the resource type of the first resource among the multiple resources included in the interactive content is then executed.

7. The method according to claim 6, characterized in that, The first image is used to instruct the object to perform a corresponding body action, and determining the matching result between the second image and the first image includes: Identify key human body features of the object in the second image; Based on the key points of the human body, extract the somatosensory information feature values ​​of the second image; The matching result between the second image and the first image is determined based on the haptic information feature value of the second image and the unlocking haptic feature value corresponding to the first image.

8. The method according to claim 7, characterized in that, The first image includes multiple sub-images, each sub-image corresponding to a different unlocking haptic feature value. The step of determining the matching result between the second image and the first image based on the haptic information feature value of the second image and the unlocking haptic feature value corresponding to the first image includes: Based on the somatosensory information feature value of the second image, a target sub-image is determined from the plurality of sub-images, wherein the unlocking somatosensory feature value of the target sub-image and the somatosensory information feature value of the second image satisfy a preset condition; The matching result between the second image and the first image is determined based on the haptic information feature value of the second image and the unlocking haptic feature value of the target sub-image.

9. The method according to claim 6, characterized in that, The method further includes: Receive the content identifier sent by the terminal device; The interactive content corresponding to the content identifier is determined based on the content identifier.

10. An interactive device, characterized in that, The device includes: a playback unit, a display unit, a acquisition unit, and an acquisition unit; The playback unit is used to play the first resource among multiple resources included in the interactive content; The display unit is configured to display a first image corresponding to the first resource in response to the completion of playback of the first resource, wherein the first image is used to instruct the object to perform a corresponding action; The acquisition unit is used to acquire a second image of the object; The acquisition unit is used to acquire the matching result of the first image and the second image; The playback unit is used to play a second resource according to the matching result, wherein the second resource is one of the plurality of resources; The device further includes: a determining unit and an execution unit; The determining unit is used to determine the resource type of the first resource among the multiple resources included in the interactive content; The execution unit is configured to, in response to the first resource being of the motion-sensing locking type, execute the acquisition of the second image of the object; The execution unit is configured to, in response to the first resource being a non-motion-sensing locking type, acquire a third resource, use the third resource as the first resource, and execute the process of determining the resource type of the first resource among the multiple resources included in the interactive content.

11. The apparatus according to claim 10, characterized in that, The device further includes: A receiving unit is configured to receive a trigger operation from the object, wherein the trigger operation includes a content identifier of the interactive content; The acquisition unit is used to acquire the first resource of the interactive content based on the content identifier.

12. The apparatus according to claim 10, characterized in that, The device further includes: A receiving unit is configured to receive a trigger operation from the object, wherein the trigger operation includes a content identifier of the interactive content; The acquisition unit is used to acquire the interactive content based on the content identifier.

13. The apparatus according to claim 12, characterized in that, The acquisition unit is used to acquire the second resource based on the resource identifier of the first resource.

14. The apparatus according to claim 12, characterized in that, The first image includes multiple sub-images, and different sub-images are used to indicate different actions of the object. The acquisition unit is used to acquire the second resource based on the target sub-image and the resource identifier of the first resource. The target sub-image is a sub-image included in the first image.

15. An interactive device, characterized in that, The device includes: an acquisition unit, a determination unit, and a transmission unit; The acquisition unit is used to acquire the authentication request of the terminal device. The authentication request includes the resource identifier of the first resource and the second image of the object. The first resource is one of a plurality of resources included in the interactive content. The determining unit is used to determine the matching result between the second image and the first image, wherein the first image is used to instruct the object to perform a corresponding action; The sending unit is used to send the matching result to the terminal device so that the terminal device can play the second resource corresponding to the matching result according to the matching result, wherein the second resource is one of the multiple resources included in the interactive content; The device further includes: an execution unit; The determining unit is used to determine the resource type of the first resource among the multiple resources included in the interactive content; The execution unit is configured to send the first resource to the terminal device in response to the first resource being a motion-sensing lock type. The execution unit is configured to, in response to the first resource being a non-motion-sensing locking type, acquire a third resource, use the third resource as the first resource, and execute the process of determining the resource type of the first resource among the multiple resources included in the interactive content.

16. The apparatus according to claim 15, characterized in that, The first image is used to instruct the object to perform a corresponding body movement, and the determining unit is used to: Identify key human body features of the object in the second image; Based on the key points of the human body, extract the somatosensory information feature values ​​of the second image; The matching result between the second image and the first image is determined based on the haptic information feature value of the second image and the unlocking haptic feature value corresponding to the first image.

17. The apparatus according to claim 16, characterized in that, The first image includes multiple sub-images, each sub-image corresponding to a different unlocking haptic feature value. The determining unit is used for: Based on the somatosensory information feature value of the second image, a target sub-image is determined from the plurality of sub-images, wherein the unlocking somatosensory feature value of the target sub-image and the somatosensory information feature value of the second image satisfy a preset condition; The matching result between the second image and the first image is determined based on the haptic information feature value of the second image and the unlocking haptic feature value of the target sub-image.

18. The apparatus according to claim 15, characterized in that, The device further includes: The receiving unit is used to receive the content identifier sent by the terminal device; The determining unit is used to determine the interactive content corresponding to the content identifier based on the content identifier.

19. An interactive system, characterized in that, The system includes terminal devices and servers: The terminal device is used to perform the method according to any one of claims 1-5; The server is used to perform the method according to any one of claims 6-9.

20. A computer device, characterized in that, The device includes a processor and a memory: The memory is used to store program code and transmit the program code to the processor; The processor is configured to execute the method according to any one of claims 1-5, or to execute the method according to any one of claims 6-9, based on instructions in the program code.

21. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store a computer program for performing the method according to any one of claims 1-5, or for performing the method according to any one of claims 6-9.

22. A computer program product, characterized in that, It includes a computer program or instructions; when the computer program or instructions are executed by a processor, it performs the method according to any one of claims 1-5, or performs the method according to any one of claims 6-9.

Images