Interaction method and device based on multimedia resources, electronic equipment and storage medium

Abstract

The invention provides an interaction method and device based on multimedia resources, electronic equipment and a storage medium, and belongs to the technical field of multimedia. The method comprises the steps that multimedia resources are displayed in a first local area in a resource display interface, and interactive elements associated with the multimedia resources are displayed in a second local area in the resource display interface; in response to a posture change operation on the terminal, displaying that the interactive element moves along with the posture change of the terminal in the second local area; and displaying an interaction result corresponding to the interactive element under the condition that the moving state of the interactive element meets a condition. According to the method, the display content in the interaction process is enriched, a novel interaction mode is provided, a user does not need to specially pay attention to the display area where the interactive elements are located, interaction with the interactive elements can be achieved only by changing the posture of the terminal, operation is easy, and the man-machine interaction efficiency can be improved.

Description

Technical Field

[0001] This disclosure relates to the field of multimedia technology, and in particular to an interactive method, apparatus, electronic device, and storage medium based on multimedia resources. Background Technology

[0002] With the rapid development of multimedia technology, displaying items to users through multimedia resources such as videos and images has become increasingly popular. When displaying items using multimedia resources, an interactive element is usually provided, such as a viewing control or a shopping cart control, allowing users to interact by viewing item information or acquiring desired items. However, the interactive element is typically fixed in one position to prompt user interaction, resulting in relatively simple content that is difficult to attract user attention, thus impacting human-computer interaction efficiency. Summary of the Invention

[0003] This disclosure provides an interactive method, apparatus, electronic device, and storage medium based on multimedia resources. It not only enriches the displayed content during the interaction process but also offers a novel interaction method that eliminates the need for the user to specifically focus on the display area where interactive elements are located. Users can interact with interactive elements simply by changing the posture of the terminal, simplifying operation and improving human-computer interaction efficiency. The technical solution of this disclosure is as follows: According to one aspect of the embodiments of this disclosure, an interactive method based on multimedia resources is provided, comprising: Multimedia resources are displayed in a first partial area of ​​the resource display interface, and interactive elements associated with the multimedia resources are displayed in a second partial area of ​​the resource display interface. In response to a change in the terminal's posture, the interactive element is displayed to move within the second local area as the terminal's posture changes. When the movement state of the interactive element meets the conditions, the interaction result corresponding to the interactive element is displayed. The interaction result includes at least one of the acquisition result of the virtual resource associated with the multimedia resource and the redirection to the landing page associated with the multimedia resource.

[0004] According to another aspect of the embodiments of this disclosure, an interactive device based on multimedia resources is provided, comprising: The first display unit is configured to display multimedia resources in a first partial area of ​​a resource display interface, and to display interactive elements associated with the multimedia resources in a second partial area of ​​the resource display interface. The first display unit is further configured to perform an operation in response to a change in the attitude of the terminal, displaying that the interactive element moves within the second local area as the attitude of the terminal changes; The second display unit is configured to display the interaction result corresponding to the interactive element when the movement state of the interactive element meets the conditions. The interaction result includes at least one of the acquisition result of the virtual resource associated with the multimedia resource and the landing page associated with the multimedia resource.

[0005] In some embodiments, the first display unit is further configured to display multimedia resources in the full-screen area of ​​the resource display interface; and, when the multimedia resources meet the interaction conditions, display the multimedia resources in the first partial area and display the interactive elements associated with the multimedia resources in the second partial area.

[0006] In some embodiments, the first display unit is further configured to display an interactive progress bar in the resource display interface, the interactive progress bar being used to indicate a countdown for interacting with interactive elements associated with the multimedia resource; when the interactive progress bar is full, the multimedia resource is displayed in the first local area, and the interactive element associated with the multimedia resource is displayed in the second local area.

[0007] In some embodiments, the first display unit is configured to display the interactive element associated with the multimedia resource rising up in the second local area of ​​the resource display interface.

[0008] In some embodiments, the first display unit is further configured to display the interactive element falling when the interactive element rises to a first position in the second local area.

[0009] In some embodiments, the first display unit is further configured to display the collision result of the interactive element when the interactive element collides with any boundary of the second local region.

[0010] In some embodiments, the first display unit is configured to perform at least one of the following: If the interactive element collides with any boundary of the second local area, it will be displayed that the interactive element is bounced away. If the interactive element collides with any boundary of the second local area, the interactive element is displayed as deformed.

[0011] In some embodiments, the multimedia resources are used to display a target item, and the interactive element is a virtual container used to provide virtual resources for obtaining the target item; The first display unit is configured to display the virtual resources exposed after the virtual container opens, in the event that the target virtual container collides with any boundary of the second local area.

[0012] In some embodiments, there are multiple interaction results corresponding to the interactive element, and different interaction results are triggered by the interactive element located in different positions; The second display unit is configured to, when the movement state of the interactive element meets the conditions, display, based on the current position of the interactive element, an interaction result that matches the current position among multiple interaction results corresponding to the interactive element.

[0013] In some embodiments, the second local region includes multiple boundaries, and the multiple boundaries correspond one-to-one with the multiple interaction results; The second display unit is configured to, when the movement state of the interactive element meets the conditions, determine a target boundary from multiple boundaries of the second local area based on the current position of the interactive element, wherein the target boundary is the boundary closest to the current position among the multiple boundaries; and display the interaction result that matches the target boundary among the multiple interaction results.

[0014] In some embodiments, the second local region includes a plurality of triggerable regions, and the plurality of triggerable regions correspond one-to-one with the plurality of interaction results; The second display unit is configured to, when the movement state of the interactive element meets the conditions, determine a target triggerable area from the plurality of triggerable areas based on the current position of the interactive element, wherein the target triggerable area is the triggerable area where the current position is located in the plurality of triggerable areas; and display the interaction result that matches the target triggerable area from the plurality of interaction results.

[0015] In some embodiments, the interactive sensing area of ​​the interactive element is the second local area; The second display unit is further configured to perform an interaction result corresponding to the interactive element in response to a trigger operation on the interactive element; and to display the interaction result corresponding to the interactive element in response to a trigger operation on any position within the second local area other than the interactive element.

[0016] In some embodiments, the second local area includes an operation hotspot on the screen of the terminal, the operation hotspot being used to represent an area on the screen of the terminal that has been triggered more than a number of times.

[0017] In some embodiments, the first display unit is further configured to perform the following actions: in the second local area, displaying the interactive element moved to a second position, and highlighting the interactive element at the second position, if no posture change operation is detected.

[0018] In some embodiments, there are multiple interactive elements; The first display unit is configured to display multiple interactive elements associated with the multimedia resource in a second local area of ​​the resource display interface; and, if the posture change operation is not detected, to display a target interactive element among the multiple interactive elements moving to the second position in the second local area.

[0019] According to another aspect of the present disclosure, an electronic device is provided, the electronic device comprising: One or more processors; Memory used to store the executable program code of the processor; The processor is configured to execute the program code to implement the aforementioned interactive method based on multimedia resources.

[0020] According to another aspect of the present disclosure, a computer-readable storage medium is provided that, when program code in the computer-readable storage medium is executed by a processor of an electronic device, enables the electronic device to perform the above-described interactive method based on multimedia resources.

[0021] According to another aspect of the present disclosure, a computer program product is provided, including a computer program / instructions that, when executed by a processor, implement the above-described interactive method based on multimedia resources.

[0022] The solution provided in this disclosure, during the display of multimedia resources, displays the multimedia resources in a first partial area of ​​the resource display interface, and displays the interactive elements associated with the multimedia resources in a second partial area of ​​the resource display interface. This not only facilitates subsequent user interaction with the interactive elements, but also ensures that the interaction does not interfere with the continued display of the multimedia resources, thereby improving the information transparency of the multimedia resources. When a change in the terminal's posture is detected, the interactive elements are displayed moving in the second partial area according to the terminal's posture change, intuitively demonstrating the user's interaction with the interactive elements. When the movement state of the interactive elements meets the conditions, the interaction result of the interactive elements is displayed. This not only enriches the display content during the interaction process, but also eliminates the need for the user to pay special attention to the display area where the interactive elements are located; the user only needs to change the terminal's posture to interact with the interactive elements. This is a novel interaction method that is simple to operate and can improve the efficiency of human-computer interaction.

[0023] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0024] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure, and are not intended to unduly limit this disclosure.

[0025] Figure 1 This is a schematic diagram illustrating the implementation environment of an interactive method based on multimedia resources, according to an exemplary embodiment.

[0026] Figure 2 This is a flowchart illustrating an interactive method based on multimedia resources according to an exemplary embodiment.

[0027] Figure 3 This is a flowchart illustrating another interactive method based on multimedia resources according to an exemplary embodiment.

[0028] Figure 4 This is a schematic diagram illustrating an interactive element display according to an exemplary embodiment.

[0029] Figure 5 This is a schematic diagram illustrating an interactive progress bar according to an exemplary embodiment.

[0030] Figure 6 This is a schematic diagram illustrating the appearance of interactive elements according to an exemplary embodiment.

[0031] Figure 7 This is a schematic diagram illustrating an interaction with an interactive element according to an exemplary embodiment.

[0032] Figure 8 This is a schematic diagram illustrating another way of interacting with an interactive element, according to an exemplary embodiment.

[0033] Figure 9 This is a schematic diagram illustrating another interactive element according to an exemplary embodiment.

[0034] Figure 10 This is a schematic diagram illustrating another way of displaying interactive elements according to an exemplary embodiment.

[0035] Figure 11 This is a block diagram illustrating an interactive device based on multimedia resources according to an exemplary embodiment.

[0036] Figure 12 This is a block diagram illustrating a terminal according to an exemplary embodiment. Detailed Implementation

[0037] To enable those skilled in the art to better understand the technical solutions of this disclosure, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings.

[0038] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0039] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in this disclosure are all authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the multimedia resources, interactive elements, and terminal postures involved in this disclosure were all obtained with full authorization.

[0040] It should be noted that, in response, the condition or state on which the operation is performed depends can be real-time or have a set delay when the condition or state is met; unless otherwise specified, there is no restriction on the order in which the multiple operations are performed.

[0041] Figure 1 This is a schematic diagram illustrating an implementation environment for an interactive method based on multimedia resources, according to an exemplary embodiment. Taking an electronic device as an example, see [link to example]. Figure 1 The implementation environment specifically includes: terminal 101 and server 102.

[0042] In this embodiment, terminal 101 is used to play multimedia resources such as videos and image sets. In some embodiments, a target application is installed on terminal 101, which is used to play multimedia resources. The target application may be a video application, an audio application, a social application, etc., and is not limited thereto. For example, the target application may take the form of a web application, a microprogram, or a client, and this disclosure is not limited thereto. A microprogram refers to a program that runs on top of other applications, such as a mini-program. Server 102 is used to provide background services for the target application running on terminal 101. For example, in response to a display operation of multimedia resources, terminal 101 obtains the corresponding multimedia resources from server 102 for display. Of course, server 102 may also include other functional servers to provide more comprehensive and diversified services.

[0043] In some embodiments, interactive elements associated with multimedia resources are displayed simultaneously. Users can interact with these interactive elements by adjusting or changing the posture of terminal 101. When the posture of terminal 101 changes, the interactive elements displayed by terminal 101 move accordingly. When the movement state of the interactive elements meets certain conditions, terminal 101 displays the corresponding interaction result, such as displaying the acquisition result of the virtual resource associated with the multimedia resource or redirecting to the landing page associated with the multimedia resource, thereby realizing the interaction between the user and the interactive elements.

[0044] In this embodiment, terminal 101 is at least one of the following devices: smartphone, smartwatch, desktop computer, laptop, MP3 player, MP4 player, and laptop computer. Terminal 101 has communication functions and can access wired or wireless networks. Terminal 101 generally refers to one of multiple terminals; this embodiment uses terminal 101 as an example. Those skilled in the art will understand that the number of terminals can be more or less. For example, there may be several, dozens, hundreds, or even more terminals. This disclosure does not limit the number or type of terminals.

[0045] Server 102 can be a standalone physical server, a server cluster consisting of multiple physical servers, or a distributed file system. It can also be a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. In some embodiments, server 102 and terminal 101 are directly or indirectly connected via wired or wireless communication, which is not limited in this embodiment. Optionally, the number of servers 102 can be more or less, which is not limited in this embodiment. Of course, server 102 may also include other functional servers to provide more comprehensive and diversified services. Server 102 undertakes the main computing work, and terminal 101 undertakes secondary computing work; or, server 102 undertakes secondary computing work, and terminal 101 undertakes the main computing work; or, server 102 or terminal 101 can each independently undertake computing work, which is not limited in this embodiment.

[0046] Figure 2 This is a flowchart illustrating an interactive method based on multimedia resources according to an exemplary embodiment. See also... Figure 2 The multimedia resource-based interaction method is applied to the terminal, and the multimedia resource-based interaction includes the following steps.

[0047] In step 201, the terminal displays multimedia resources in a first local area of ​​the resource display interface and displays interactive elements associated with the multimedia resources in a second local area of ​​the resource display interface.

[0048] In this embodiment, the resource display interface is used to display multimedia resources. Multimedia resources can be videos, text, images, etc., and this embodiment does not limit the scope of the multimedia resources. The resource display interface includes a first partial area and a second partial area. During the display of multimedia resources, the terminal displays the multimedia resources in the first partial area and the interactive elements associated with the multimedia resources in the second partial area. That is, the terminal can display multimedia resources and interactive elements in separate sections within the resource display interface.

[0049] Interactive elements can be virtual containers used to provide virtual resources, such as virtual red envelopes or virtual gift boxes; or interactive elements can be interface jump controls associated with multimedia resources, such as viewing or obtaining controls for items displayed in multimedia resources, or download controls for applications displayed in multimedia resources. This disclosure does not limit the interactive elements.

[0050] The first local area and the second local area can be half-screen areas in the resource display interface, that is, the first local area and the second local area are of equal size, each occupying half of the entire interface; or, the first local area and the second local area are of unequal size. The sum of the first local area and the second local area can be the entire resource display interface, or it can be a part of the resource display interface. This embodiment does not limit the size of the first local area and the second local area.

[0051] In step 202, in response to a change in the terminal's posture, the terminal displays interactive elements that move within a second local area as the terminal's posture changes.

[0052] In this embodiment of the disclosure, a user can interact with interactive elements displayed on the resource display interface by adjusting or changing the posture of the terminal. Upon detecting an operation targeting a change in the terminal's posture, the terminal displays interactive elements that move within a second local area in accordance with the change in the terminal's posture.

[0053] The interactive elements move only within the second local area and will not move outside of it. The direction and speed of movement of the interactive elements can be related to changes in the terminal's posture. Optionally, the direction of movement of the interactive elements is towards the boundary closest to the ground on the terminal. That is, when the terminal's posture changes, the terminal determines the boundary closest to the ground, and then displays the interactive elements moving towards that boundary, creating the effect of the interactive elements moving due to gravity. The movement speed of the interactive elements can depend on the angle between the plane of the terminal screen and the ground. The movement speed of the interactive elements can be positively correlated with this angle. This angle ranges from 0 to 90°. The larger the angle between the plane of the terminal screen and the ground, the faster the movement speed of the interactive elements. Alternatively, the movement speed of the interactive elements can also be positively correlated with the rate of change of the terminal's posture (such as rotational angular velocity).

[0054] In step 203, if the movement state of the interactive element meets the conditions, the terminal displays the interaction result corresponding to the interactive element. The interaction result includes at least one of the following: the acquisition result of the virtual resource associated with the multimedia resource and the redirection to the landing page associated with the multimedia resource.

[0055] In this embodiment of the disclosure, when the movement state of the interactive element meets certain conditions, the terminal displays the interaction result corresponding to the interactive element, such as displaying the acquisition result of the virtual resource associated with the multimedia resource, or jumping to the landing page associated with the multimedia resource. This landing page can be a details page or acquisition page of the item displayed by the multimedia resource, or it can be a download page of the application displayed by the multimedia resource, etc., and this embodiment of the disclosure does not limit this.

[0056] The conditions mentioned above may include the interactive element stopping moving, the interactive element moving to a preset position, the interactive element moving for a preset duration, a collision occurring, or the moving speed falling below a speed threshold, etc. This disclosure does not limit these conditions.

[0057] This disclosure provides an interactive method based on multimedia resources. During the display of multimedia resources, the resources are displayed in a first partial area of ​​the resource display interface, and the interactive elements associated with the multimedia resources are displayed in a second partial area of ​​the resource display interface. This not only facilitates subsequent user interaction with the interactive elements but also ensures that the interaction does not interfere with the continued display of the multimedia resources, thus improving the information transparency of the multimedia resources. When a change in the terminal's posture is detected, the interactive elements are displayed moving within the second partial area according to the terminal's posture, intuitively demonstrating the user's interaction with the interactive elements. When the movement state of the interactive elements meets certain conditions, the interaction result is displayed. This not only enriches the display content during the interaction process but also eliminates the need for the user to specifically focus on the display area where the interactive elements are located; the user only needs to change the terminal's posture to interact with the interactive elements. This is a novel interaction method that is simple to operate and can improve the efficiency of human-computer interaction.

[0058] In some embodiments, the method further includes: Multimedia resources are displayed in the full-screen area of ​​the resource display interface; Multimedia resources are displayed in a first local area of ​​the resource display interface, and interactive elements associated with the multimedia resources are displayed in a second local area of ​​the resource display interface, including: When the multimedia resources meet the interactive conditions, the multimedia resources are displayed in the first local area, and the interactive elements associated with the multimedia resources are displayed in the second local area.

[0059] The solution provided in this embodiment first displays multimedia resources in the full-screen area of ​​the resource display interface to convey more information from the multimedia resources to the user. When the multimedia resources meet the interaction conditions, they are then displayed in a first partial area, and interactive elements are displayed in a second partial area. This partitioned display of multimedia resources and interactive elements ensures that interactive elements do not interfere with the continued display of the multimedia resources, facilitating the transmission of more information to the user and improving the information transmission rate of the multimedia resources. Furthermore, interactive elements are only displayed when the interaction conditions are met, increasing the likelihood of matching the user's interaction intent. If the interaction conditions are not met, interactive elements are not displayed, saving operational resources.

[0060] In some embodiments, the method further includes: Display an interactive progress bar in the resource display interface. The interactive progress bar is used to indicate the countdown for interactive elements that can be associated with multimedia resources to interact with. When the multimedia resources meet the interactive conditions, the multimedia resources are displayed in a first local area, and the interactive elements associated with the multimedia resources are displayed in a second local area, including: When the interactive progress bar is full, the multimedia resource is displayed in the first local area, and the interactive elements associated with the multimedia resource are displayed in the second local area.

[0061] The solution provided in this disclosure, by displaying an interactive progress bar, intuitively shows the countdown to when interaction with interactive elements is possible, allowing users to quickly know when interaction with the interactive elements is possible, thus improving information transmission efficiency. When the interactive progress bar is full, multimedia resources are displayed in a first local area, and interactive elements are displayed in a second local area, facilitating timely interaction between users and the interactive elements in the second local area, thereby improving human-computer interaction efficiency. Furthermore, when the interactive progress bar is full, it indicates that the multimedia resources have been displayed for a certain period of time, increasing the likelihood that the user is interested in the multimedia resources and is more likely to interact with the interactive elements within them. Displaying interactive elements in this situation aligns with the user's interaction intent.

[0062] In some embodiments, displaying interactive elements associated with multimedia resources in a second partial area of ​​the resource display interface includes: In the second local area of ​​the resource display interface, interactive elements associated with the multimedia resources rise up.

[0063] The solution provided in this disclosure provides a novel display method when interactive elements are displayed in the second local area. By displaying interactive elements that rise in the second local area, the interactive elements are not only displayed, but also make it more likely that the interactive elements will be discovered by the user, thereby improving the efficiency of information transmission and human-computer interaction.

[0064] In some embodiments, the method further includes: When an interactive element rises to the first position within the second local area, the interactive element is displayed as falling.

[0065] The solution provided in this embodiment can display the interactive element falling after it rises to the first position in the second local area, further enriching the display process of the interactive element, extending the movement time of the interactive element, and making it more likely that the interactive element will be discovered by the user, thereby improving the efficiency of information transmission and human-computer interaction.

[0066] In some embodiments, the method further includes: If an interactive element collides with any boundary of the second local region, display the collision result of the interactive element.

[0067] The solution provided in this embodiment not only provides users with immediate visual feedback when an interactive element collides with any boundary of the second local area, allowing users to know that their operation has been recognized and responded to, thus improving information transmission efficiency, but also enriches the display content during the interaction with the interactive element, increases the dynamism and realism of the interaction, and helps to improve the user's interactive experience.

[0068] In some embodiments, if an interactive element collides with any boundary of the second local region, the collision result of the interactive element is displayed, including at least one of the following: If an interactive element collides with any boundary of the second local area, it will be displayed that the interactive element is bounced away. If an interactive element collides with any boundary of the second local area, the interactive element will be displayed as deformed.

[0069] The solution provided in this embodiment displays that the interactive element is bounced away or deformed when it collides with any boundary of the second local area. This intuitively shows the changes of the interactive element during the interaction process, letting users know that their operation has been recognized and responded to, improving the efficiency of information transmission, enriching the display content during the interaction with the interactive element, increasing the dynamism and realism of the interaction, and helping to improve the user's interactive experience.

[0070] In some embodiments, multimedia resources are used to display target items, and interactive elements are virtual containers used to provide virtual resources for obtaining target items; If an interactive element collides with any boundary of the second local region, display the collision result of the interactive element, including: If the target virtual container collides with any boundary of the second local region, the virtual resources will be exposed after the virtual container is opened.

[0071] The solution provided in this embodiment, if the interactive element is a virtual container used to provide virtual resources for items in multimedia resources, when the virtual container collides with any boundary of the second local area, displays the virtual resources exposed after the virtual container is opened, intuitively showing the interaction with the virtual container. This makes it easy for users to discover the virtual resources in a timely manner and know the source of the virtual resources, improving the efficiency of information transmission. Moreover, it does not require users to click on the virtual container to open it, making the operation simple and improving the efficiency of obtaining virtual resources.

[0072] In some embodiments, there are multiple interaction results corresponding to interactive elements, and different interaction results are triggered by interactive elements in different positions; When the movement state of an interactive element meets certain conditions, display the corresponding interaction result for the interactive element, including: If the movement state of an interactive element meets the conditions, based on the current position of the interactive element, display the interactive result that matches the current position among the multiple interactive results corresponding to the interactive element.

[0073] The solution provided in this disclosure, when the movement state of an interactive element meets the conditions, displays the corresponding interaction result based on the current position of the interactive element. This not only enriches the interactive content and increases the possibility of users manipulating interactive elements to move to different positions to obtain different interaction results, thereby improving the interaction rate, but also simplifies the operation, eliminating the need for users to click on interactive elements to interact, thus improving the efficiency of human-computer interaction.

[0074] In some embodiments, the second local region includes multiple boundaries, and each boundary corresponds one-to-one with a multiple interaction result; When the movement state of an interactive element meets certain conditions, based on the current position of the interactive element, display the interaction result that matches the current position from among multiple interaction results corresponding to the interactive element, including: When the movement state of the interactive element meets the conditions, the target boundary is determined from multiple boundaries of the second local region based on the current position of the interactive element. The target boundary is the boundary that is closest to the current position among the multiple boundaries. Displays the interaction result that matches the target boundary from among multiple interaction results.

[0075] The solution provided in this embodiment includes multiple boundaries in the second partial area of ​​the resource display interface. An interaction result can be configured for each boundary. When the movement state of the interactive element meets the conditions, the interaction result corresponding to the boundary that is currently closest to the interactive element is displayed. This not only enriches the interactive content and increases the possibility of users manipulating the interactive element to move to different boundaries to obtain different interaction results, thereby improving the interaction rate, but also simplifies the operation, eliminating the need for users to click on the interactive element to interact, thus improving the efficiency of human-computer interaction.

[0076] In some embodiments, the second local region includes multiple triggerable regions, and there is a one-to-one correspondence between the multiple triggerable regions and multiple interaction results; When the movement state of an interactive element meets certain conditions, based on the current position of the interactive element, display the interaction result that matches the current position from among multiple interaction results corresponding to the interactive element, including: When the movement state of an interactive element meets the conditions, a target triggerable area is determined from multiple triggerable areas based on the current position of the interactive element. The target triggerable area is the triggerable area where the current position is located among the multiple triggerable areas. Displays the interaction results that match the target triggerable area from among multiple interaction results.

[0077] The solution provided in this embodiment includes multiple triggerable areas in the second partial area of ​​the resource display interface. Each triggerable area can be configured with an interaction result. When the movement state of an interactive element meets the conditions, the interaction result corresponding to the interactive area is displayed according to the interactive area to which the interactive element has moved. This not only enriches the interactive content and increases the possibility of users manipulating interactive elements to move to different areas to obtain different interaction results, thereby improving the interaction rate, but also simplifies the operation, eliminating the need for users to pay special attention to the display area where the interactive element is located, thus improving the efficiency of human-computer interaction.

[0078] In some embodiments, the interactive sensing area of ​​an interactive element is a second local area; The method also includes: In response to a triggering action on an interactive element, display the corresponding interaction result for the interactive element; In response to a trigger operation on any location within the second local area other than the interactive element, display the interaction result corresponding to the interactive element.

[0079] The solution provided in this embodiment associates the interactive sensing area of ​​the interactive element with the entire second local area during the display of the interactive element in the second local area. This allows the interactive result of the interactive element to be displayed not only when it is triggered, but also when it is triggered at any other location in the second local area. This achieves the goal of enabling interaction with the interactive element by triggering any location in the second local area, without requiring the user to pay special attention to the display location of the interactive element. Triggering any location in the second local area will result in an interactive result, increasing the likelihood of successful interaction with the interactive element in one go and thus improving the efficiency of human-computer interaction.

[0080] In some embodiments, the second local region includes an operation hotspot on the terminal's screen, which represents an area on the terminal's screen that has been triggered more than a threshold number of times.

[0081] The solution provided in this embodiment is that the operation hot zone is the area on the terminal screen that is triggered more than a threshold number of times and belongs to the user's usual operation area. By including the operation hot zone in the second local area, the interactive element can be placed in the user's usual operation area. This not only increases the possibility of the user interacting with the interactive element, but also facilitates interaction with the interactive element, thereby improving the efficiency of human-computer interaction.

[0082] In some embodiments, the method further includes: If no pose change operation is detected, the interactive element is displayed to move to the second position within the second local area; Highlight interactive elements in the second position.

[0083] The solution provided in this embodiment, without detecting a change in the user's terminal posture, can further transmit the interactive element to the user by displaying the interactive element moving to a second position and highlighting the interactive element, thereby increasing the likelihood of the user interacting with the interactive element and thus improving the interaction rate.

[0084] In some embodiments, there are multiple interactive elements; The second local area in the resource display interface displays interactive elements associated with the multimedia resources, including: In the second local area of ​​the resource display interface, multiple interactive elements associated with the multimedia resources are displayed; In the absence of detected pose change operations, within the second local area, interactive elements are displayed moving to a second position, including: In the absence of detected attitude change operation, within the second local area, the target interactive element among multiple interactive elements is displayed to move to the second position.

[0085] The solution provided in this embodiment first displays multiple interactive elements in a second local area, making it easier for users to discover these multiple interactive elements in a timely manner for interaction. If no interaction between the user and the interactive elements is detected, the target interactive element among the multiple interactive elements is moved to a second position, which can further transmit the interactive elements that can be interacted with to the user, thereby increasing the likelihood of the user interacting with the interactive elements and thus improving the interaction rate.

[0086] The above Figure 2 The diagram shown is merely the basic process of this disclosure. The following section will further elaborate on the solution provided in this disclosure based on a specific implementation method. Figure 3 This is a flowchart illustrating another interactive method based on multimedia resources according to an exemplary embodiment. Taking an electronic device provided as a terminal as an example, see [link to example]. Figure 3The interactive method based on multimedia resources includes the following steps.

[0087] In step 301, the terminal displays multimedia resources in the full-screen area of ​​the resource display interface.

[0088] In this embodiment of the disclosure, in response to a resource display command, the terminal displays multimedia resources in the full-screen area of ​​the resource display interface. That is, the multimedia resources occupy the entire resource display interface.

[0089] In step 302, when the multimedia resources meet the interaction conditions, the terminal displays the multimedia resources in a first local area of ​​the resource display interface and displays the interactive elements associated with the multimedia resources in a second local area of ​​the resource display interface.

[0090] In this embodiment, when the multimedia resource meets the interaction conditions, the terminal displays the multimedia resource in a first partial area of ​​the resource display interface, and displays interactive elements associated with the multimedia resource in a second partial area of ​​the resource display interface. The interaction conditions can be that the multimedia resource has played to a target time or reached a preset duration, or that a target item appears in the multimedia resource, etc., and this embodiment does not limit this. The solution provided by this embodiment first displays the multimedia resource in the full-screen area of ​​the resource display interface to convey more information from the multimedia resource to the user. When the multimedia resource meets the interaction conditions, it is then displayed in the first partial area, and interactive elements are displayed in the second partial area. This partitioned display of multimedia resources and interactive elements ensures that interactive elements do not interfere with the continued display of the multimedia resource, facilitating the transmission of more information to the user and improving the information transmission rate of the multimedia resource. Furthermore, displaying interactive elements only when the interaction conditions are met increases the likelihood of matching the user's interaction intentions; not displaying interactive elements when the interaction conditions are not met saves operational resources.

[0091] This disclosure does not limit the display positions of the first and second local regions. For example, the first local region may be located above the resource display interface, and the second local region may be located below the resource display interface. That is, the first local region may be located above the second local region.

[0092] In some embodiments, the second partial region includes an operation hotspot on the terminal's screen. An operation hotspot represents an area on the terminal's screen that is triggered more frequently than a threshold number. For example, if the terminal is a mobile phone, and the user typically holds the phone by its lower half, the lower area of ​​the screen is frequently triggered and thus constitutes the terminal's operation hotspot. In this case, the second partial region is located below the resource display interface. The solution provided by this disclosure, since the operation hotspot is an area on the terminal's screen that is triggered more frequently than a threshold number and is a user-favored operation area, includes the operation hotspot in the second partial region. This allows interactive elements to be located within the user-favored operation area, not only increasing the likelihood of user interaction with interactive elements but also facilitating interaction with them, thereby improving human-computer interaction efficiency.

[0093] For example, Figure 4 This is a schematic diagram illustrating the display of interactive elements according to an exemplary embodiment. See also: Figure 4 The first local area 401 is located at the top of the resource display interface, and the second local area 402 is located at the bottom of the resource display interface. The terminal displays multimedia resources in the first local area 401 and interactive elements 403 in the second local area 402. The interactive element 403 is a virtual red envelope, used to provide virtual resources.

[0094] In some embodiments, before displaying interactive elements, the terminal can also display an interaction progress bar in the resource display interface. The interaction progress bar is used to indicate a countdown for interaction with the interactive elements associated with the multimedia resource. When the interaction progress bar is full, the multimedia resource is displayed in a first partial area, and the interactive elements associated with the multimedia resource are displayed in a second partial area. That is, the terminal can display the interaction progress bar while displaying the multimedia resource in full screen, thereby indicating when interaction is possible. This disclosure does not limit the display position or style of the interaction progress bar.

[0095] For example, Figure 5 This is a schematic diagram illustrating an interactive progress bar according to an exemplary embodiment. See also: Figure 5The terminal displays multimedia resources in the full-screen area of ​​the resource display interface. These multimedia resources are used to showcase the target item to the user. A resource prompt component 501 is displayed in the lower left corner of the resource display interface. The resource prompt component 501 displays icons 502 for interactive elements and an interaction progress bar 503. The interactive elements provide virtual resources for acquiring the target item, reducing the user's resource consumption when acquiring it. The interaction progress bar 503 indicates a countdown before interaction with the interactive elements begins. When the interaction progress bar 503 is full, the terminal displays the resource display interface divided into a first half-screen area 504 and a second half-screen area 505. Multimedia resources continue to be displayed in the first half-screen area 504, while interactive elements 506 are displayed in the second half-screen area 505.

[0096] The solution provided in this disclosure, by displaying an interactive progress bar, intuitively shows the countdown to when interaction with interactive elements is possible, allowing users to quickly know when interaction with the interactive elements is possible, thus improving information transmission efficiency. When the interactive progress bar is full, multimedia resources are displayed in a first local area, and interactive elements are displayed in a second local area, facilitating timely interaction between users and the interactive elements in the second local area, thereby improving human-computer interaction efficiency. Furthermore, when the interactive progress bar is full, it indicates that the multimedia resources have been displayed for a certain period of time, increasing the likelihood that the user is interested in the multimedia resources and is more likely to interact with the interactive elements within them. Displaying interactive elements in this situation aligns with the user's interaction intent.

[0097] During the display of the aforementioned interactive elements in the second local area, they can appear statically at a certain position within the second local area, or they can appear dynamically within the second local area. This disclosure does not limit the manner in which the interactive elements appear. In some embodiments, the terminal displays interactive elements associated with multimedia resources rising up within the second local area of ​​the resource display interface. That is, when an interactive element appears in the second local area, the terminal can display the interactive element rising up. Specifically, the terminal displays the interactive element appearing at the bottom edge of the second local area and moving upwards from the bottom edge. The bottom edge of the second local area refers to the boundary closest to the ground within the second local area, thus creating an effect where the interactive element overcomes gravity and moves in the anti-gravity direction, similar to a "rising balloon." The solution provided by this disclosure, when displaying interactive elements in the second local area, not only provides a novel display method by displaying the interactive elements rising up within the second local area, but also increases the likelihood that the interactive elements will be discovered by the user, thereby improving information transmission efficiency and human-computer interaction efficiency.

[0098] In some embodiments, when the interactive element rises to a first position within the second local area, the terminal displays the interactive element falling. The first position can be any boundary position on the second local area, or it can be the center position within the second local area, etc., and this disclosure does not limit this. That is, within the second local area, the interactive element first rises and then falls. The solution provided by this disclosure, after the interactive element rises to the first position within the second local area, can also display the interactive element falling, further enriching the display process of the interactive element, extending the movement time of the interactive element, and making it more likely that the interactive element will be discovered by the user, thereby improving information transmission efficiency and human-computer interaction efficiency.

[0099] For example, Figure 6 This is a schematic diagram illustrating the appearance of interactive elements according to an exemplary embodiment. See also... Figure 6 The interactive element is a virtual red envelope 601. The virtual red envelope 601 appears from the bottom of the second local area 602, moves upward, and when the virtual red envelope 601 collides with the top of the second local area 602, the terminal displays the virtual red envelope 601 falling.

[0100] In step 303, in response to the attitude change operation of the terminal, the interactive elements displayed on the terminal move within the second local area as the attitude of the terminal changes.

[0101] In this embodiment, upon detecting a change in the terminal's posture, the terminal displays interactive elements that move within a second local area in accordance with the terminal's posture change. The direction and speed of movement of the interactive elements are related to the change in the terminal's posture. Optionally, the direction of movement of the interactive elements is towards the boundary closest to the ground on the terminal (or the second local area). The speed of movement of the interactive elements may depend on the angle between the plane containing the terminal screen and the ground; the larger the angle, the faster the interactive elements move. This embodiment does not limit the movement state of the interactive elements.

[0102] For example, Figure 7 This is a schematic diagram illustrating interaction with an interactive element according to an exemplary embodiment. See also: Figure 7In response to a leftward rotation of the terminal, the left boundary of the second local area 701 is closer to the ground. In this case, the interactive element 702 moves towards the left boundary of the second local area 701 until it reaches the left boundary. In response to a rightward rotation of the terminal, the right boundary of the second local area 701 is closer to the ground. In this case, the interactive element 702 moves towards the right boundary of the second local area 701 until it reaches the right boundary. This movement creates the effect that the interactive element 702 is moving due to gravity.

[0103] In this embodiment, the interactive element moves only within the second local area and will not move outside of it. If the interactive element collides with any boundary of the second local area, the terminal can display the collision result. The collision result may be a change in the movement state (e.g., movement direction) of the interactive element, or a change in its shape, etc., which are not limited in this embodiment. The solution provided by this embodiment, by displaying the collision result when the interactive element collides with any boundary of the second local area, not only provides the user with immediate visual feedback, letting the user know that their operation has been recognized and responded to, thus improving information transmission efficiency, but also enriches the displayed content during the interaction with the interactive element, increasing the dynamism and realism of the interaction, and thus enhancing the user's interactive experience.

[0104] In some embodiments, the process of displaying the collision results of interactive elements on the terminal may include at least one of the following: The first provision states that if an interactive element collides with any boundary of the second local region, the terminal can display that the interactive element has been bounced away. The direction of movement of the interactive element after being bounced away is related to its direction of movement before being bounced away. Optionally, the direction of movement after being bounced away and the direction of movement before being bounced away are symmetrical about the normal to the collided boundary; that is, the normal to the collided boundary is the axis of symmetry between the direction of movement after being bounced away and the direction of movement before being bounced away.

[0105] Secondly, if an interactive element collides with any boundary of the second local area, the terminal can also display that the interactive element has deformed. The deformation may be that the interactive element breaks into multiple parts, the shape of the interactive element changes (e.g., the overall shape of the interactive element becomes larger), or the texture of the interactive element changes, etc., and this embodiment of the present disclosure does not limit this.

[0106] The solution provided in this embodiment displays that the interactive element is bounced away or deformed when it collides with any boundary of the second local area. This intuitively shows the changes of the interactive element during the interaction process, letting users know that their operation has been recognized and responded to, improving the efficiency of information transmission, enriching the display content during the interaction with the interactive element, increasing the dynamism and realism of the interaction, and helping to improve the user's interactive experience.

[0107] In other embodiments, multimedia resources are used to display target items. Interactive elements are virtual containers used to provide virtual resources for acquiring target items. Accordingly, the process of the terminal displaying the collision result of the interactive element includes: if the target virtual container collides with any boundary of the second local area, the terminal displays that the virtual container has opened, revealing the virtual resources. For example, if the interactive element is a virtual red envelope, if an empty virtual red envelope collides with any boundary of the second local area, the terminal displays that the virtual red envelope has opened, revealing the virtual resources inside. The solution provided by this disclosure, if the interactive element is a virtual container used to provide virtual resources for items in multimedia resources, displays that the virtual container has opened, revealing the virtual resources, when the virtual container collides with any boundary of the second local area. This intuitively demonstrates the interaction with the virtual container, making it easier for users to discover the virtual resources and know their source, improving information transmission efficiency. Furthermore, it eliminates the need for users to click on the virtual container to open it, simplifying the operation and improving the efficiency of acquiring virtual resources.

[0108] In other embodiments, there may be multiple interactive elements within the second local area. These multiple interactive elements can move within the second local area in the same manner as described above. That is, in response to a change in the terminal's posture, the terminal displays multiple interactive elements moving within the second local area as the terminal's posture changes.

[0109] For example, Figure 8 This is a schematic diagram illustrating another interaction with an interactive element according to an exemplary embodiment. See also Figure 8 In response to a leftward rotation of the terminal, the left boundary of the second local area 801 is closer to the ground. In this case, the terminal displays multiple interactive elements 802 moving together towards the left boundary of the second local area 801 until they reach the left boundary. In response to a rightward rotation of the terminal, the right boundary of the second local area 801 is closer to the ground. In this case, the terminal displays multiple interactive elements 802 moving towards the right boundary of the second local area 801 until they reach the right boundary. This movement creates the effect that multiple interactive elements 802 are moving due to gravity.

[0110] During the movement of multiple interactive elements within the second local area, in addition to displaying the collision result when each interactive element encounters the boundary of the area, the corresponding collision result can also be displayed when a collision occurs between interactive elements. This embodiment does not limit the collision result.

[0111] In step 304, if the movement state of the interactive element meets the conditions, the terminal displays the interaction result corresponding to the interactive element. The interaction result includes at least one of the following: the acquisition result of the virtual resource associated with the multimedia resource and the redirection to the landing page associated with the multimedia resource.

[0112] In this embodiment of the disclosure, in response to the condition being met by the movement state of the interactive element, the terminal displays the interaction result of the interactive element, such as displaying the acquisition result of the virtual resource associated with the multimedia resource, or jumping to the landing page associated with the multimedia resource, etc. This embodiment of the disclosure does not limit this.

[0113] In some embodiments, there are multiple interaction results corresponding to an interactive element. Different interaction results are triggered by interactive elements in different positions. Accordingly, the process of the terminal displaying the interaction results corresponding to the interactive element includes: when the movement state of the interactive element meets the conditions, the terminal displays the interaction result that matches the current position among the multiple interaction results corresponding to the interactive element. The solution provided by the embodiments of this disclosure, when the movement state of the interactive element meets the conditions, displays the interaction result corresponding to the current position of the interactive element, which not only enriches the interaction content and increases the possibility of users manipulating the interactive element to move to different positions to obtain different interaction results, thereby improving the interaction rate; but also is simple to operate, requiring no user to click on the interactive element to interact, thus improving the efficiency of human-computer interaction.

[0114] Optionally, the second local area includes multiple boundaries, and each boundary corresponds one-to-one with a number of interaction results. Accordingly, the process by which the terminal displays the interaction result that matches the current position among the multiple interaction results corresponding to the interactive element, based on the current position of the interactive element, includes: when the movement state of the interactive element meets the conditions, the terminal determines a target boundary from the multiple boundaries of the second local area based on the current position of the interactive element. The target boundary is the boundary closest to the current position among the multiple boundaries. Then, the terminal displays the interaction result that matches the target boundary among the multiple interaction results. The solution provided by this embodiment includes multiple boundaries in the second local area of ​​the resource display interface, and an interaction result can be configured for each boundary. When the movement state of the interactive element meets the conditions, the interaction result corresponding to the boundary closest to the current position of the interactive element is displayed. This not only enriches the interaction content and increases the likelihood that users can manipulate the interactive element to move to different boundaries to obtain different interaction results, thereby improving the interaction rate; but also simplifies the operation, eliminating the need for users to click on the interactive element to interact, thus improving human-computer interaction efficiency.

[0115] Optionally, the second partial area includes multiple triggerable areas, with a one-to-one correspondence between the multiple triggerable areas and multiple interaction results. Accordingly, the process by which the terminal displays the interaction result matching the current position among the multiple interaction results corresponding to the interactive element, based on the current position of the interactive element, includes: when the movement state of the interactive element meets the conditions, the terminal determines a target triggerable area from the multiple triggerable areas based on the current position of the interactive element. The target triggerable area is the triggerable area where the current position is located among the multiple triggerable areas. Then, the terminal displays the interaction result matching the target triggerable area among the multiple interaction results. The solution provided by this embodiment includes multiple triggerable areas in the second partial area of ​​the resource display interface, and can configure an interaction result for each triggerable area. When the movement state of the interactive element meets the conditions, the interaction result corresponding to the interactive area is displayed according to the interactive area to which the interactive element has currently moved. This not only enriches the interactive content and increases the possibility of users manipulating the interactive element to move to different areas to obtain different interaction results, thereby improving the interaction rate; but also simplifies the operation, requiring no special attention from the user to the display area where the interactive element is located, thus improving human-computer interaction efficiency.

[0116] This disclosure provides an interactive method based on multimedia resources. During the display of multimedia resources, the resources are displayed in a first partial area of ​​the resource display interface, and the interactive elements associated with the multimedia resources are displayed in a second partial area of ​​the resource display interface. This not only facilitates subsequent user interaction with the interactive elements but also ensures that the interaction does not interfere with the continued display of the multimedia resources, thus improving the information transparency of the multimedia resources. When a change in the terminal's posture is detected, the interactive elements are displayed moving within the second partial area according to the terminal's posture, intuitively demonstrating the user's interaction with the interactive elements. When the movement state of the interactive elements meets certain conditions, the interaction result is displayed. This not only enriches the display content during the interaction process but also eliminates the need for the user to specifically focus on the display area where the interactive elements are located; the user only needs to change the terminal's posture to interact with the interactive elements. This is a novel interaction method that is simple to operate and can improve the efficiency of human-computer interaction.

[0117] In some embodiments, in addition to interacting with interactive elements by changing the posture of the terminal as described in the above embodiments, users can also interact with interactive elements by triggering the terminal screen. Specifically, the interactive sensing area of ​​the interactive element is a second local area. In response to a triggering operation on the interactive element, the terminal displays the interaction result corresponding to the interactive element. Alternatively, in response to a triggering operation on any position within the second local area other than the interactive element, the terminal displays the interaction result corresponding to the interactive element. The solution provided by this disclosure associates the interactive sensing area of ​​the interactive element with the entire second local area during the display of the interactive element in the second local area. This allows the interactive element to be displayed not only when it is triggered, but also when any position within the second local area other than the interactive element is triggered. This achieves the goal of being able to interact with the interactive element by triggering any position within the second local area, without requiring the user to specifically focus on the display position of the interactive element. Triggering any position within the second local area will yield the interaction result corresponding to the interactive element, increasing the probability of successful interaction with the interactive element in one go and thus improving the efficiency of human-computer interaction.

[0118] In other embodiments, even without detecting a change in posture, the terminal can further display the interactive element moving to a second position within a second local area, highlighting the interactive element at the second position. The second position can be located in the operation hotspot of the terminal screen, such as the lower left corner of the resource display interface; this embodiment does not limit this. The highlighting method can be magnification, adding animation effects to the interactive element, etc., and this embodiment does not limit this. That is, even if the user does not interact with the interactive element by changing the terminal's posture within a preset time, the terminal can still display the interactive element moving to a second position and highlighting it, further conveying the interactive element to the user and increasing the likelihood of user interaction with the interactive element, thereby improving the interaction rate.

[0119] For example, Figure 9 This is a schematic diagram illustrating another display of interactive elements according to an exemplary embodiment. See also Figure 9 If no posture change operation is detected, the terminal displays that the interactive element 901 moves to the lower left corner area 902 of the resource display interface, and displays a prompt message 903 in the lower left corner area 902 to prompt the user to interact with the interactive element 901.

[0120] In some embodiments, there are multiple interactive elements in the second local area. That is, the terminal displays multiple interactive elements associated with multimedia resources in the second local area of ​​the resource display interface. If no posture change operation is detected within a preset time period, the terminal displays a target interactive element among the multiple interactive elements in the second local area, which moves to a second position. Other interactive elements besides the target interactive element disappear from the second local area, such as moving out or fading out of the second local area. The solution provided by this disclosure embodiment, by first displaying multiple interactive elements in the second local area, facilitates the user to discover the multiple interactive elements for interaction in a timely manner. If no user interaction with the interactive elements is detected, by displaying a target interactive element among the multiple interactive elements moving to a second position, it can further convey the interactive elements that can be interacted with to the user, thereby increasing the likelihood of the user interacting with the interactive elements and thus improving the interaction rate.

[0121] For example, Figure 10 This is a schematic diagram illustrating another way of displaying interactive elements according to an exemplary embodiment. See also Figure 10If no posture change operation is detected, the terminal displays that the target interactive element 1001 among multiple interactive elements moves to the lower left corner area 1002 of the resource display interface, and displays a prompt message 1003 in the lower left corner area 1002 to prompt the user to interact with the target interactive element 1001. Other interactive elements other than the target interactive element 1001 move out of the second local area 1004 from the bottom of the second local area 1004.

[0122] Alternatively, multiple interactive elements can be moved together to a second position to leave more display area for multimedia resources, reduce the interference of interactive elements on the display of multimedia resources, and meet the user's viewing intention. This disclosure does not limit this aspect.

[0123] In summary, in related technologies, multimedia resources typically display interactive elements (such as interactive controls) in a fixed location to prompt users to interact. The displayed content is relatively simple and fails to attract user attention, thus affecting human-computer interaction efficiency. This solution, however, displays multimedia resources and interactive elements in different areas. This not only facilitates subsequent user interaction with the interactive elements but also ensures that the interaction does not interfere with the continued display of multimedia resources, improving information transmission. Upon detecting a change in the terminal's posture, the interactive element is displayed moving within a second local area according to the terminal's posture, intuitively demonstrating the user's interaction with the interactive element. When the movement state of the interactive element meets certain conditions, the interaction result is displayed. Users do not need to specifically focus on the display area of ​​the interactive element; they only need to change the terminal's posture to interact with it. This is a novel interaction method that is simple to operate and improves human-computer interaction efficiency.

[0124] Furthermore, the related technologies also have the following core barriers compared to this solution: The first barrier is the insufficient precision and robustness of dynamic triggering logic. Interaction triggering in related technologies is typically based on simple "coordinate point hits" (such as clicks). Triggering methods based on "movement state" (such as rising to the first position) require real-time, precise judgment of the interactive element's spatial position, speed, and direction, and the definition of a reasonable "condition" threshold. If the threshold is set improperly, it can lead to false triggers (triggering before reaching the position) or trigger failures (no response upon reaching the position), resulting in a worse user experience than static clicks. This solution's condition determination does not rely solely on an absolute coordinate (first position), but combines "position range" and "momentum state." For example, determining "condition met" might be: the interactive element enters a tolerance range near a preset position, and its vertical upward speed is below a certain threshold (meaning it is about to reach the peak and begin to fall). This design greatly enhances the fault tolerance of triggering and the accuracy of intent recognition, making the interaction feel more natural and reliable, as if interacting with a real physical object.

[0125] The second barrier is the confusion between interactive gesture conflicts and user intent. In related technologies, on touch devices, vertical swiping of the screen is usually the highest-level global browsing gesture. If an interactive element is allowed to move independently within a local area (such as "rising / falling"), the user's finger swipe is easily misinterpreted by the system as an attempt to move the interactive element, thus hindering normal interface scrolling and causing serious interaction conflicts and user frustration. This solution cleverly defines a second local area as a dedicated "interactive response zone." The system determines the user's intent by recognizing the synchronicity between the gesture's starting point and the change in the terminal's posture: for example, only a change in posture (such as tilting the phone): it is determined that the user wants to interact with the interactive element, triggering its movement; or, for example, only a touch swipe: it is determined to be normal page scrolling, and the interactive element remains still or ignores the operation. This design clearly distinguishes the interaction modalities, fundamentally avoiding conflicts and allowing the two interaction methods to coexist harmoniously.

[0126] The third barrier is the resource competition between dynamic interaction and content rendering. In related technologies, when playing high-quality video (the first area), the system's GPU and CPU resources are already highly strained. If a complex animation requiring continuous physics calculations (such as simulating gravity and collisions) is run in another area (the second area), it can easily lead to dropped video frames, animation stuttering, or a surge in overall power consumption. Traditional solutions, to preserve the core experience, typically set controls to static or use minimalist animations. This solution, however, divides the interface into a content layer (the first area, high priority) and an interaction layer (the second area, dynamic priority). The system prioritizes rendering resources for the content layer. For animations in the interaction layer, high-precision physics simulation and rendering are only activated when a valid posture change operation is detected; during static or slight shaking, low-power standby animations are used. This on-demand computing strategy provides stunning dynamic effects while minimizing interference with the core multimedia experience, achieving a perfect balance between functionality and performance.

[0127] Therefore, the focus of this solution is not merely on "making interactive elements move", but on systematically and effectively solving a series of intertwined technical and experiential challenges in making interactive elements "move in a useful, smooth, and non-intrusive way".

[0128] All of the above-mentioned optional technical solutions can be combined in any way to form optional embodiments of this disclosure, and will not be described in detail here.

[0129] Figure 11 This is a block diagram illustrating an interactive device based on multimedia resources according to an exemplary embodiment. See also... Figure 11 The interactive device based on multimedia resources includes: a first display unit 1101 and a second display unit 1102.

[0130] The first display unit 1101 is configured to display multimedia resources in a first local area of ​​the resource display interface and display interactive elements associated with the multimedia resources in a second local area of ​​the resource display interface. The first display unit 1101 is also configured to perform an operation in response to a change in the attitude of the terminal, displaying interactive elements moving within a second local area as the attitude of the terminal changes. The second display unit 1102 is configured to display the interaction result corresponding to the interactive element when the movement state of the interactive element meets the conditions. The interaction result includes at least one of the acquisition result of the virtual resource associated with the multimedia resource and the jump to the landing page associated with the multimedia resource.

[0131] In some embodiments, the first display unit 1101 is further configured to display multimedia resources in the full-screen area of ​​the resource display interface; and to display multimedia resources in a first partial area and interactive elements associated with the multimedia resources in a second partial area when the multimedia resources meet the interaction conditions.

[0132] In some embodiments, the first display unit 1101 is further configured to display an interactive progress bar in the resource display interface, the interactive progress bar being used to indicate a countdown for interacting with interactive elements associated with the multimedia resource; when the interactive progress bar is full, the multimedia resource is displayed in a first local area, and the interactive elements associated with the multimedia resource are displayed in a second local area.

[0133] In some embodiments, the first display unit 1101 is configured to display interactive elements associated with multimedia resources rising up in a second local area of ​​the resource display interface.

[0134] In some embodiments, the first display unit 1101 is further configured to display the interactive element falling when the interactive element rises to a first position in the second local area.

[0135] In some embodiments, the first display unit 1101 is further configured to display the collision result of the interactive element when the interactive element collides with any boundary of the second local region.

[0136] In some embodiments, the first display unit 1101 is configured to perform at least one of the following: If an interactive element collides with any boundary of the second local area, it will be displayed that the interactive element is bounced away. If an interactive element collides with any boundary of the second local area, the interactive element will be displayed as deformed.

[0137] In some embodiments, multimedia resources are used to display target items, and interactive elements are virtual containers used to provide virtual resources for obtaining target items; The first display unit 1101 is configured to display virtual resources exposed after the virtual container is opened, in the event that the target virtual container collides with any boundary of the second local region.

[0138] In some embodiments, there are multiple interaction results corresponding to interactive elements, and different interaction results are triggered by interactive elements in different positions; The second display unit 1102 is configured to, when the movement state of the interactive element meets the conditions, display the interaction result that matches the current position among multiple interaction results corresponding to the interactive element.

[0139] In some embodiments, the second local region includes multiple boundaries, and each boundary corresponds one-to-one with a multiple interaction result; The second display unit 1102 is configured to, when the movement state of the interactive element meets the conditions, determine the target boundary from multiple boundaries of the second local region based on the current position of the interactive element, wherein the target boundary is the boundary closest to the current position among the multiple boundaries; and display the interactive result that matches the target boundary from multiple interactive results.

[0140] In some embodiments, the second local region includes multiple triggerable regions, and there is a one-to-one correspondence between the multiple triggerable regions and multiple interaction results; The second display unit 1102 is configured to, when the movement state of the interactive element meets the conditions, determine a target triggerable area from multiple triggerable areas based on the current position of the interactive element, wherein the target triggerable area is the triggerable area where the current position is located in the multiple triggerable areas; and display the interaction result that matches the target triggerable area from among the multiple interaction results.

[0141] In some embodiments, the interactive sensing area of ​​an interactive element is a second local area; The second display unit 1102 is further configured to perform an interaction result corresponding to the interactive element in response to a trigger operation on the interactive element; and to display the interaction result corresponding to the interactive element in response to a trigger operation on any position in the second local area other than the interactive element.

[0142] In some embodiments, the second local region includes an operation hotspot on the terminal's screen, which represents an area on the terminal's screen that has been triggered more than a threshold number of times.

[0143] In some embodiments, the first display unit 1101 is further configured to perform the following operations: in the absence of detected attitude change, displaying an interactive element moved to a second position within a second local area; and highlighting the interactive element at the second position.

[0144] In some embodiments, there are multiple interactive elements; The first display unit 1101 is configured to display multiple interactive elements associated with multimedia resources in a second local area of ​​the resource display interface; and in the absence of a detected attitude change operation, to display the target interactive element among the multiple interactive elements moving to a second position in the second local area.

[0145] This disclosure provides an interactive device based on multimedia resources. During the display of multimedia resources, the multimedia resources are displayed in a first partial area of ​​the resource display interface, and the interactive elements associated with the multimedia resources are displayed in a second partial area of ​​the resource display interface. This not only facilitates subsequent user interaction with the interactive elements but also ensures that the interaction does not interfere with the continued display of the multimedia resources, thus improving the information transparency of the multimedia resources. When a change in the terminal's posture is detected, the interactive elements are displayed moving within the second partial area according to the terminal's posture, intuitively demonstrating the user's interaction with the interactive elements. When the movement state of the interactive elements meets certain conditions, the interaction result is displayed. This not only enriches the display content during the interaction process but also eliminates the need for the user to specifically focus on the display area where the interactive elements are located; the user only needs to change the terminal's posture to interact with the interactive elements. This is a novel interaction method that is simple to operate and can improve the efficiency of human-computer interaction.

[0146] It should be noted that the interactive device based on multimedia resources provided in the above embodiments, when interacting with interactive elements associated with multimedia resources, is only illustrated by the division of the above functional units. In practical applications, the above functions can be assigned to different functional units as needed, that is, the internal structure of the electronic device can be divided into different functional units to complete all or part of the functions described above. In addition, the interactive device based on multimedia resources provided in the above embodiments and the interactive method embodiments based on multimedia resources belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.

[0147] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0148] When an electronic device is provided as a terminal, Figure 12 This is a block diagram illustrating a terminal 1200 according to an exemplary embodiment. The terminal... Figure 12 A structural block diagram of a terminal 1200 provided in an exemplary embodiment of this disclosure is shown. The terminal 1200 may be a smartphone, tablet computer, MP3 player (Moving Picture Experts Group Audio Layer III), MP4 player (Moving Picture Experts Group Audio Layer IV), laptop computer, or desktop computer. The terminal 1200 may also be referred to as a user device, portable terminal, laptop terminal, desktop terminal, or other names.

[0149] Typically, terminal 1200 includes a processor 1201 and a memory 1202.

[0150] Processor 1201 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Processor 1201 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Processor 1201 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 1201 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 1201 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0151] The memory 1202 may include one or more computer-readable storage media, which may be non-transitory. The memory 1202 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1202 are used to store at least one computer program, which is executed by the processor 1201 to implement the multimedia resource-based interactive method provided in the method embodiments of this application.

[0152] In some embodiments, the terminal 1200 may also optionally include a peripheral device interface 1203 and at least one peripheral device. The processor 1201, memory 1202, and peripheral device interface 1203 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 1203 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of the following: radio frequency circuitry 1204, display screen 1205, camera assembly 1206, audio circuitry 1207, and power supply 1208.

[0153] Peripheral device interface 1203 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 1201 and memory 1202. In some embodiments, processor 1201, memory 1202 and peripheral device interface 1203 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 1201, memory 1202 and peripheral device interface 1203 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0154] The radio frequency (RF) circuit 1204 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 1204 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 1204 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. In some embodiments, the RF circuit 1204 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 1204 can communicate with other terminals via at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: the World Wide Web, metropolitan area networks, intranets, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 1204 may also include circuitry related to NFC (Near Field Communication), which is not limited in this application.

[0155] Display screen 1205 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. When display screen 1205 is a touch display screen, it also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to processor 1201 for processing. In this case, display screen 1205 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one display screen 1205, disposed on the front panel of terminal 1200; in other embodiments, there may be at least two display screens, disposed on different surfaces of terminal 1200 or in a folded design; in still other embodiments, display screen 1205 may be a flexible display screen, disposed on a curved or folded surface of terminal 1200. Furthermore, display screen 1205 may also be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. The display screen 1205 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0156] The camera assembly 1206 is used to acquire images or videos. In some embodiments, the camera assembly 1206 includes a front-facing camera and a rear-facing camera. Typically, the front-facing camera is located on the front panel of the terminal, and the rear-facing camera is located on the back of the terminal. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In some embodiments, the camera assembly 1206 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash is a combination of a warm-light flash and a cool-light flash, which can be used for light compensation at different color temperatures.

[0157] The audio circuit 1207 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting the sound waves into electrical signals that are input to the processor 1201 for processing, or input to the radio frequency circuit 1204 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, each positioned at a different location on the terminal 1200. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert electrical signals from the processor 1201 or the radio frequency circuit 1204 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 1207 may also include a headphone jack.

[0158] Power supply 1208 is used to power the various components in terminal 1200. Power supply 1208 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When power supply 1208 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged via a wired line, and a wireless rechargeable battery is a battery that is charged via a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0159] Those skilled in the art will understand that Figure 12 The structure shown does not constitute a limitation on terminal 1200 and may include more or fewer components than shown, or combine certain components, or use different component arrangements.

[0160] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory 1202 including instructions, which can be executed by the processor 1201 of the terminal 1200 to complete the above-described interactive method based on multimedia resources. Optionally, the computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, or optical data storage device, etc.

[0161] A computer program product includes a computer program / instructions that, when executed by a processor, implement the aforementioned interactive method based on multimedia resources.

[0162] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0163] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. An interactive method based on multimedia resources, characterized in that, The method includes: Multimedia resources are displayed in a first partial area of ​​the resource display interface, and interactive elements associated with the multimedia resources are displayed in a second partial area of ​​the resource display interface. In response to a change in the terminal's posture, the interactive element is displayed to move within the second local area as the terminal's posture changes. When the movement state of the interactive element meets the conditions, the interaction result corresponding to the interactive element is displayed. The interaction result includes at least one of the acquisition result of the virtual resource associated with the multimedia resource and the redirection to the landing page associated with the multimedia resource.

2. The interactive method based on multimedia resources according to claim 1, characterized in that, The method further includes: Multimedia resources are displayed in the full-screen area of ​​the resource display interface; The step of displaying multimedia resources in a first partial area of ​​the resource display interface, and displaying interactive elements associated with the multimedia resources in a second partial area of ​​the resource display interface, includes: When the multimedia resource meets the interaction conditions, the multimedia resource is displayed in the first local area, and the interactive element associated with the multimedia resource is displayed in the second local area.

3. The interactive method based on multimedia resources according to claim 2, characterized in that, The method further includes: An interactive progress bar is displayed in the resource display interface. The interactive progress bar is used to indicate a countdown for interactive elements that can be interacted with by the multimedia resource. When the multimedia resource meets the interaction conditions, displaying the multimedia resource in the first local area and displaying the interactive element associated with the multimedia resource in the second local area includes: When the interactive progress bar is full, the multimedia resource is displayed in the first local area, and the interactive element associated with the multimedia resource is displayed in the second local area.

4. The interactive method based on multimedia resources according to claim 1, characterized in that, The step of displaying the interactive elements associated with the multimedia resource in the second partial area of ​​the resource display interface includes: In the second local area of ​​the resource display interface, interactive elements associated with the multimedia resource are displayed and raised.

5. The interactive method based on multimedia resources according to claim 4, characterized in that, The method further includes: When the interactive element rises to a first position within the second local area, the interactive element is displayed as falling.

6. The interactive method based on multimedia resources according to claim 1, characterized in that, The method further includes: If the interactive element collides with any boundary of the second local area, the collision result of the interactive element is displayed.

7. The interactive method based on multimedia resources according to claim 6, characterized in that, Displaying the collision result of the interactive element when it collides with any boundary of the second local region includes at least one of the following: If the interactive element collides with any boundary of the second local area, it will be displayed that the interactive element is bounced away. If the interactive element collides with any boundary of the second local area, the interactive element is displayed as deformed.

8. The interactive method based on multimedia resources according to claim 6, characterized in that, The multimedia resources are used to display the target item, and the interactive element is a virtual container used to provide virtual resources for obtaining the target item; The step of displaying the collision result of the interactive element when it collides with any boundary of the second local region includes: If the target virtual container collides with any boundary of the second local area, the virtual container is displayed to reveal the virtual resources after it is opened.

9. The interactive method based on multimedia resources according to claim 1, characterized in that, There are multiple interaction results corresponding to the interactive element, and different interaction results are triggered by the interactive element in different positions; The step of displaying the interaction result corresponding to the interactive element when the movement state of the interactive element meets the conditions includes: When the movement state of the interactive element meets the conditions, based on the current position of the interactive element, display the interaction result that matches the current position among the multiple interaction results corresponding to the interactive element.

10. The interactive method based on multimedia resources according to claim 9, characterized in that, The second local region includes multiple boundaries, and each of the multiple boundaries corresponds one-to-one with one of the multiple interaction results; When the movement state of the interactive element meets the conditions, based on the current position of the interactive element, displaying the interaction result that matches the current position among multiple interaction results corresponding to the interactive element, including: When the movement state of the interactive element meets the conditions, a target boundary is determined from multiple boundaries of the second local region based on the current position of the interactive element. The target boundary is the boundary that is closest to the current position among the multiple boundaries. Display the interaction result that matches the target boundary among the multiple interaction results.

11. The interactive method based on multimedia resources according to claim 9, characterized in that, The second local area includes multiple triggerable areas, and there is a one-to-one correspondence between the multiple triggerable areas and the multiple interaction results; When the movement state of the interactive element meets the conditions, based on the current position of the interactive element, displaying the interaction result that matches the current position among multiple interaction results corresponding to the interactive element, including: When the movement state of the interactive element meets the conditions, a target triggerable area is determined from the plurality of triggerable areas based on the current position of the interactive element. The target triggerable area is the triggerable area where the current position is located among the plurality of triggerable areas. Display the interaction result that matches the target triggerable area from among the multiple interaction results.

12. The interactive method based on multimedia resources according to claim 1, characterized in that, The interactive sensing area of ​​the interactive element is the second local area; The method further includes: In response to a trigger operation on the interactive element, the interaction result corresponding to the interactive element is displayed; In response to a trigger operation on any location within the second local area other than the interactive element, the interaction result corresponding to the interactive element is displayed.

13. The interactive method based on multimedia resources according to claim 1, characterized in that, The second local area includes an operation hotspot on the screen of the terminal, which represents an area on the screen of the terminal that has been triggered more than a certain number of times.

14. The interactive method based on multimedia resources according to claim 1, characterized in that, The method further includes: If the attitude change operation is not detected, the interactive element is displayed to have moved to the second position within the second local area; The interactive element is highlighted in the second position.

15. The interactive method based on multimedia resources according to claim 14, characterized in that, There are multiple interactive elements; The step of displaying the interactive elements associated with the multimedia resource in the second partial area of ​​the resource display interface includes: In the second partial area of ​​the resource display interface, multiple interactive elements associated with the multimedia resource are displayed; The step of displaying the interactive element moving to a second position within the second local area when the pose change operation is not detected includes: If the posture change operation is not detected, the target interactive element among the plurality of interactive elements is displayed to move to the second position within the second local area.

16. An interactive device based on multimedia resources, characterized in that, The device includes: The first display unit is configured to display multimedia resources in a first partial area of ​​a resource display interface, and to display interactive elements associated with the multimedia resources in a second partial area of ​​the resource display interface. The first display unit is further configured to perform an operation in response to a change in the attitude of the terminal, displaying that the interactive element moves within the second local area as the attitude of the terminal changes; The second display unit is configured to display the interaction result corresponding to the interactive element when the movement state of the interactive element meets the conditions. The interaction result includes at least one of the acquisition result of the virtual resource associated with the multimedia resource and the landing page associated with the multimedia resource.

17. An electronic device, characterized in that, The electronic device includes: One or more processors; Memory used to store the executable program code of the processor; The processor is configured to execute the program code to implement the interactive method based on multimedia resources as described in any one of claims 1 to 15.

18. A computer-readable storage medium, characterized in that, When the instructions in the computer-readable storage medium are executed by the processor of the electronic device, the electronic device is able to perform the interactive method based on multimedia resources as described in any one of claims 1 to 15.

19. A computer program product, characterized in that, It includes a computer program that, when executed by a processor, implements the interactive method based on multimedia resources as described in any one of claims 1 to 15.

Images