Terminal-based man-machine interaction method and device, equipment, storage medium and product

Abstract

The invention discloses a man-machine interaction method, device and equipment based on a terminal, a storage medium and a product, and belongs to the technical field of man-machine interaction. The method comprises the following steps: displaying an interaction task in a playing process of multimedia content, wherein the interaction task is a task completed by changing a machine body state of a terminal; in response to a state conversion operation for the machine body state, updating display content corresponding to the interaction task based on the change of the machine body state; and under the condition that the interaction task is completed, displaying receiving information of the watching reward for watching the multimedia content. According to the technical scheme, indirect interaction of the multimedia content is achieved through direct interaction with the terminal, operation in a limited operation space of a touch screen is avoided, the interaction modes between a user and the multimedia content are enriched, the types of man-machine interaction are enriched, and then the interaction frequency of the user and the multimedia content is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of human-computer interaction technology, and in particular to a terminal-based human-computer interaction method, device, equipment, storage medium and product. Background Art

[0002] Nowadays, there are many forms of advertising. Incentive advertising is a popular form of advertising that allows users to exchange in-app rewards through interactive methods such as watching ads and trying out ads.

[0003] In the related art, users can obtain rewards by watching incentivized ads. For example, when the incentivized ad is halfway through playing, the viewing reward is displayed, and by clicking the viewing reward on the touch screen, users can receive the corresponding viewing reward, such as gift packages, discounts or coupons.

[0004] However, in the related art, the user's operating space on the touch screen is limited, and the human-computer interaction method is relatively simple. Summary of the invention

[0005] The present application provides a terminal-based human-computer interaction method, device, equipment, storage medium and product, and the technical solution is as follows:

[0006] According to one aspect of the present application, a terminal-based human-computer interaction method is provided, the method comprising:

[0007] Displaying interactive tasks during the playback of multimedia content, wherein the interactive tasks are tasks completed by changing the body state of the terminal;

[0008] In response to a state change operation for the state of the machine, updating display content corresponding to the interactive task based on the change of the state of the machine;

[0009] When the interactive task is completed, information on receiving a viewing reward for viewing the multimedia content is displayed.

[0010] According to one aspect of the present application, a terminal-based human-computer interaction device is provided, the device comprising:

[0011] A display module, used for displaying interactive tasks during the playback of multimedia content, wherein the interactive tasks are tasks completed by changing the body state of the terminal;

[0012] The display module is configured to respond to a state change operation on the state of the machine and update the display content corresponding to the interactive task based on the change of the state of the machine;

[0013] The display module is used to display the redemption information of the viewing reward for watching the multimedia content when the interactive task is completed.

[0014] According to another aspect of the present application, a computer device is provided, which includes: a processor and a memory, wherein at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor to implement the terminal-based human-computer interaction method as described above.

[0015] According to another aspect of the present application, a computer storage medium is provided, in which at least one computer program is stored. The at least one computer program is loaded and executed by a processor to implement the terminal-based human-computer interaction method as described above.

[0016] According to another aspect of the present application, a computer program product is provided, which includes a computer program stored in a computer-readable storage medium; the computer program is read and executed from the computer-readable storage medium by a processor of a computer device, so that the computer device executes the terminal-based human-computer interaction method described above.

[0017] The beneficial effects of the technical solution provided by this application include at least:

[0018] By displaying interactive tasks during the playback of multimedia content; responding to the state change operation for the body state, updating the display content corresponding to the interactive task based on the change of the body state; and displaying the collection information of the viewing reward for watching the multimedia content when the interactive task is completed. The present application provides a new human-computer interaction method, which realizes indirect interaction with multimedia content based on direct interaction with the terminal, avoids operating in the limited operating space of the touch screen, enriches the interaction methods between users and multimedia content, enriches the types of human-computer interaction, and thus increases the interaction frequency between users and multimedia content. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0020] Figure 1 is a schematic diagram of a terminal-based human-computer interaction method provided by an exemplary embodiment of the present application;

[0021] Figure 2is a schematic diagram of the architecture of a computer system provided by an exemplary embodiment of the present application;

[0022] Figure 3 is a flow chart of a terminal-based human-computer interaction method provided by an exemplary embodiment of the present application;

[0023] Figure 4 is a flow chart of a terminal-based human-computer interaction method provided by an exemplary embodiment of the present application;

[0024] Figure 5 is a schematic diagram of a multimedia content playback interface provided by an exemplary embodiment of the present application;

[0025] Figure 6 is a schematic diagram of a multimedia content playback interface provided by an exemplary embodiment of the present application;

[0026] Figure 7 is a schematic diagram of a viewing reward in a multimedia content playback interface provided by an exemplary embodiment of the present application;

[0027] Figure 8 is a schematic diagram of a viewing reward in a multimedia content playback interface provided by an exemplary embodiment of the present application;

[0028] Fig. 9 is a flow chart of a terminal-based human-computer interaction method provided by an exemplary embodiment of the present application;

[0029] Fig.10 is a block diagram of a terminal-based human-computer interaction device provided by an exemplary embodiment of the present application;

[0030] Fig.11 It is a structural diagram of a computer device provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0031] In order to make the purpose, technical scheme and advantages of the present application clearer, the implementation mode of the present application will be further described in detail below in conjunction with the accompanying drawings. The exemplary embodiments will be described in detail here, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation modes described in the following exemplary embodiments do not represent all implementation modes consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the attached claims.

[0032] The terms used in this disclosure are for the purpose of describing specific embodiments only and are not intended to limit the disclosure. The singular forms of "a", "said" and "the" used in this disclosure and the appended claims are also intended to include plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0033] It should be understood that although the terms first, second, third, etc. may be used in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other.

[0034] The present application embodiment provides a schematic diagram of a terminal-based human-computer interaction method, such as Figure 1 As shown, the method is applied to a terminal and can be executed by the terminal.

[0035] Exemplarily, the terminal displays a multimedia playback interface 10, which includes multimedia elements and interactive tasks displayed in the multimedia content; the terminal responds to changes in the terminal's body state, and when the interactive task is completed, displays the collection information of the viewing reward 30 for watching the multimedia content.

[0036] The multimedia content is at least one of short videos, incentive advertisements, online videos, and live videos, but is not limited thereto, and the embodiments of the present application do not make specific limitations on this.

[0037] Optionally, the multimedia element is a picture, video, audio or other format of content displayed to the user, but is not limited to this and is not specifically limited in the embodiments of the present application.

[0038] Exemplarily, the terminal updates the display content corresponding to the interactive task in response to a state change operation of the interaction between the terminal body and an interactive object in the real world.

[0039] A state change operation refers to an operation that senses operation information based on a sensor in the terminal and changes the body state of the terminal; or, a state change operation refers to an operation that directly interacts with the terminal but does not interact with multimedia content; or, a state change operation refers to an operation that interacts with other parts of the terminal except multimedia content; or, a state change operation refers to an operation performed on the body of the terminal; or, a state change operation refers to an operation that changes the body state of the terminal based on interactive objects in the real world.

[0040] Display content refers to the change process of the display style of multimedia content from a first style to a second style; or, display content refers to feedback information corresponding to the state change operation of the terminal; or, display content refers to the display style change effect of multimedia content.

[0041] Optionally, the state change operation includes at least one of the following, but is not limited thereto:

[0042] Terminal twisting operation, which refers to a human-computer interaction method of rotating the terminal in any direction of "up, down, left, right, front, and back", or, terminal twisting operation refers to a human-computer interaction method of rotating the terminal in any direction of "up, down, left, right, front, and back" at a first angle;

[0043] Charging operation: Charging operation refers to the operation of charging the terminal, that is, connecting a charging cable to the charging interface of the terminal. Optionally, the charging interface includes: at least one of a Universal Serial Bus (USB) interface, a fast lightning interface, and a Type-C interface, but is not limited thereto;

[0044] Gesture control operation: Gesture control operation refers to the operation of performing specific gestures (such as swiping, pinching, etc.) on the terminal screen, or sliding in a specified direction;

[0045] Accessing a designated WiFi network operation refers to the operation of receiving wireless signals sent by a wireless router in the real world through the built-in wireless access point of the terminal;

[0046] Near Field Communication (NFC) identification operation, which refers to the operation of receiving a signal sent by an NFC radio through an NFC receiver;

[0047] Augmented Reality (AR) operation: Augmented Reality (AR) operation refers to the operation of using AR technology to combine the real environment and virtual elements to judge the scene where the terminal is located.

[0048] It should be noted that the terminal twisting operation refers to twisting the terminal in a first direction by a first angle. The terminal twisting operation here is different from the shake operation. The shake operation refers to the operation of shaking back and forth for at least one round. This application is in the scene of watching multimedia content. In order to ensure clarity, the terminal twisting operation in this application only needs to twist an angle from one direction. Secondly, the terminal twisting operation in the embodiment of the present application acts on the terminal during the playback of multimedia content and does not directly interact with the multimedia content. Exemplarily, the terminal switches the body state from an uncharged state to a charged state in response to the charging operation, and the display style of the multimedia content is switched from a first style to a second style of charging style change animation.

[0049] The first style refers to the display style of the multimedia content before the state change operation, and the second style refers to the display style of the multimedia content after the state change operation.

[0050] like Figure 1 As shown in Figure (a), the first style refers to the display style of the multimedia content before the state change operation, or the default display style corresponding to the multimedia content. For example, the multimedia content under the first style is in an obscured state, that is, the entirety of the multimedia content cannot be seen or the entirety of the multimedia content cannot be clearly seen.

[0051] like Figure 1 As shown in Figure (d) in the figure, the multimedia content in the second style is in a clear state.

[0052] It should be noted that the first style and the second style are two different display styles of the incentive video. The embodiment of the present application is described by taking the first style as a blurred state and the second style as a clear state as an example, but is not limited to this.

[0053] Taking the state change operation as a charging operation as an example, the terminal switches the body state from an uncharged state to a charged state in response to the charging operation, and the display style of the multimedia content is switched from a first style to a second style of charging style change animation.

[0054] The charging style change animation refers to the style change animation played after the charging operation is performed on the terminal.

[0055] like Figure 1 As shown in FIG. (b), after the charging interface of the terminal is connected to the charger 20, the charging style change animation is displayed in the multimedia playback interface 10, and the blocked part of the multimedia content gradually becomes clear from bottom to top. Figure 1 As shown in FIG. 5( c ) , when all the blocked parts of the multimedia content become clear, the display style of the multimedia content in the terminal changes to the second style.

[0056] In some embodiments, the charging speed of the terminal changes in response to the charging operation, and the playback speed of the charging style change animation changes synchronously with the charging speed. The speed at which the blocked part of the multimedia content gradually becomes clearer from bottom to top is related to the charging speed. For example, as the charging speed slows down, the speed at which the blocked part of the multimedia content gradually becomes clearer from bottom to top also gradually slows down.

[0057] For example, Figure 1 As shown in Figure (d), after the display style of the multimedia content is switched to the second style, that is, when the multimedia content becomes clear, the viewing reward 30 corresponding to the multimedia content is displayed, and the reward can be collected by clicking on the viewing reward 30.

[0058] The viewing reward 30 refers to a reward obtained by completing an interactive task during viewing of multimedia content.

[0059] Optionally, the viewing reward 30 can be divided into two types: material reward and spiritual reward.

[0060] Material rewards refer to rewards that give users certain materials, such as red envelopes, coupons, gift boxes, lucky bags, etc. provided by advertisers. They can also be prop cards, reward doubling cards, advertising time reduction cards, etc. provided by the application.

[0061] Spiritual rewards refer to rewards that are used to encourage users without any material provision, such as exclusive blessings provided by advertisers, system blessings corresponding to holidays, etc., or virtual titles provided by applications.

[0062] Optionally, the style of viewing reward 30 is at least one of text, animation, red envelope style, and audio, but is not limited to this, and the embodiment of the present application does not make specific limitations on this.

[0063] In summary, the method provided by this embodiment displays interactive tasks during the playback of multimedia content; responds to the state change operation for the body state, updates the display content corresponding to the interactive task based on the change of the body state; and displays the collection information of the viewing reward for watching the multimedia content when the interactive task is completed. This application provides a new human-computer interaction method, which realizes indirect interaction with multimedia content based on the interaction with the terminal, avoids operating within the limited operating space of the touch screen, enriches the interaction methods between users and multimedia content, enriches the types of human-computer interaction, and thus increases the interaction frequency between users and multimedia content.

[0064] Figure 2 The schematic diagram of the architecture of a computer system provided by an embodiment of the present application is shown. The computer system may include: a terminal 100 and a server 200.

[0065] The terminal 100 may be an electronic device such as a mobile phone, a tablet computer, a vehicle-mounted terminal (vehicle computer), a wearable device, a personal computer (PC), a vehicle-mounted terminal, an aircraft, an unmanned vending terminal, etc. The terminal 100 may be installed with a client that runs a target application, and the target application may be an application for reference advertisement playback, or may be other applications that provide advertisement playback functions, which is not limited in this application. In addition, this application does not limit the form of the target application, including but not limited to an application (Application, App) installed in the terminal 100, a mini-program, etc., and may also be in the form of a web page.

[0066] The server 200 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services, cloud database, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), and cloud servers for basic cloud computing services such as big data. The server 200 may be a background server of the above-mentioned target application, used to provide background services for the client of the target application.

[0067] Among them, cloud technology refers to a hosting technology that unifies hardware, software, network and other resources in a wide area network or local area network to realize data computing, storage, processing and sharing. Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, application technology, etc. based on the cloud computing business model. It can form a resource pool, which is used on demand and flexible and convenient. Cloud computing technology will become an important support. The background services of the technical network system require a large amount of computing and storage resources, such as video websites, picture websites and more portal websites. With the high development and application of the Internet industry, in the future, each item may have its own identification mark, and all need to be transmitted to the background system for logical processing. Data of different levels will be processed separately. All kinds of industry data require strong system backing support, which can only be achieved through cloud computing.

[0068] In some embodiments, the above-mentioned server can also be implemented as a node in a blockchain system. Blockchain is a new application mode of computer technologies such as distributed data storage, peer-to-peer transmission, consensus mechanism, encryption algorithm, etc. Blockchain is essentially a decentralized database, a string of data blocks generated by cryptographic methods. Each data block contains a batch of network transaction information, which is used to verify the validity of its information (anti-counterfeiting) and generate the next block. Blockchain can include the underlying blockchain platform, the platform product service layer, and the application service layer.

[0069] The terminal 100 and the server 200 may communicate with each other via a network, such as a wired or wireless network.

[0070] The terminal-based human-computer interaction method provided in the embodiment of the present application can be performed by a computer device as the execution subject of each step. The computer device refers to an electronic device with data calculation, processing and storage capabilities. Figure 2Taking the implementation environment of the scheme shown as an example, the terminal-based human-computer interaction method can be executed by the terminal 100 (such as the client of the target application installed and running in the terminal 100 executes the terminal-based human-computer interaction method), or the server 200 can execute the terminal-based human-computer interaction method, or the terminal 100 and the server 200 can interact and cooperate to execute it, and this application does not limit this.

[0071] Figure 3 1 is a flowchart of a terminal-based human-computer interaction method provided by an exemplary embodiment of the present application. The method can be executed by a terminal. The method includes:

[0072] Step 302: Displaying interactive tasks during the playback of multimedia content.

[0073] Exemplarily, the multimedia content is at least one of short videos, incentive advertisements, online videos, and live videos, but is not limited thereto, and the embodiments of the present application do not specifically limit this.

[0074] Optionally, the multimedia elements in the multimedia content are pictures, videos, audios or other formats of content displayed to the user, but are not limited to this and are not specifically limited in the embodiments of the present application.

[0075] Incentive ads are a popular form of advertising that allow users to exchange in-app rewards through interactive methods such as watching ads and trying out ads.

[0076] Interactive tasks are completed by changing the terminal's body state.

[0077] The body status refers to the status of the physical body of the terminal.

[0078] Step 304: In response to the state change operation for the body state, update the display content corresponding to the interactive task based on the change of the body state.

[0079] Displaying content refers to the process in which the display style of multimedia content switches from a first style to a second style.

[0080] The change of the body state is achieved through the state change operation on the terminal.

[0081] A state change operation refers to an operation that senses operation information based on a sensor in the terminal and changes the body state of the terminal; or, a state change operation refers to an operation that directly interacts with the terminal but does not interact with multimedia content; or, a state change operation refers to an operation that interacts with other parts of the terminal except multimedia content; or, a state change operation refers to an operation performed on the body of the terminal; or, a state change operation refers to an operation that changes the body state of the terminal based on interactive objects in the real world.

[0082] It should be noted that the state change operation is to make the terminal linked with the real world. The user does not interact directly with the multimedia content, but changes the state of the terminal itself based on the sensor in the terminal. The state of the terminal is changed through the state change operation, thereby triggering the acquisition of viewing rewards for multimedia content based on the state of the terminal.

[0083] Optionally, the state change operation includes at least one of the following, but is not limited thereto:

[0084] Terminal twisting operation: Terminal twisting operation refers to the human-computer interaction mode of rotating the terminal in any direction of "up, down, left, right, front and back";

[0085] Charging operation: charging operation refers to the operation of charging the terminal, or charging operation refers to the interaction between the body and the charging connector, that is, connecting the charging cable to the charging interface of the terminal. Optionally, the charging interface includes at least one of: a USB interface, a lightning interface, and a Type-C interface, but is not limited thereto;

[0086] Gesture control operation: Gesture control operation refers to the operation of performing specific gestures (such as swiping, pinching, etc.) on the terminal screen, or sliding in a specified direction;

[0087] Accessing a designated WiFi network operation refers to the operation of receiving wireless signals sent by a wireless router in the real world through the built-in wireless access point of the terminal;

[0088] Near Field Communication (NFC) identification operation, which refers to the operation of receiving a signal sent by an NFC radio through an NFC receiver;

[0089] Augmented reality (AR) operation refers to the use of AR technology to combine the real environment and virtual elements to judge the scene in which the terminal is located.

[0090] Step 306: When the interactive task is completed, information on receiving a viewing reward for viewing multimedia content is displayed.

[0091] Viewing rewards can be divided into two types: material rewards and spiritual rewards.

[0092] Material rewards refer to rewards that give users certain materials, such as red envelopes, coupons, gift boxes, lucky bags, etc. provided by advertisers. They can also be prop cards, reward doubling cards, advertising time reduction cards, etc. provided by the application.

[0093] Spiritual rewards refer to rewards that are used to encourage users without any material provision, such as exclusive blessings provided by advertisers, system blessings corresponding to holidays, etc., or virtual titles provided by applications.

[0094] Optionally, the style of the viewing reward is at least one of text, animation, red envelope style, and audio, but is not limited to this, and the embodiments of the present application do not make specific limitations on this.

[0095] In summary, the method provided by this embodiment displays interactive tasks during the playback of multimedia content; responds to the state change operation for the body state, updates the display content corresponding to the interactive task based on the change of the body state; and displays the collection information of the viewing reward for watching the multimedia content when the interactive task is completed. This application provides a new human-computer interaction method, which realizes indirect interaction with multimedia content based on the interaction with the terminal, avoids operating within the limited operating space of the touch screen, enriches the interaction methods between users and multimedia content, enriches the types of human-computer interaction, and thus increases the interaction frequency between users and multimedia content.

[0096] Figure 4 1 is a flowchart of a terminal-based human-computer interaction method provided by an exemplary embodiment of the present application. The method can be executed by a terminal. The method includes:

[0097] Step 402: Display interactive tasks during the playback of multimedia content.

[0098] For example, the multimedia content is at least one of short videos, incentive advertisements, online videos, and live videos, but is not limited thereto, and the embodiments of the present application do not make specific limitations on this.

[0099] Optionally, the multimedia elements in the multimedia content are pictures, videos, audios or other formats of content displayed to the user, but are not limited to this and are not specifically limited in the embodiments of the present application.

[0100] Incentive ads are a popular form of advertising that allow users to exchange in-app rewards through interactive methods such as watching ads and trying out ads.

[0101] Interactive tasks are tasks that are completed by changing the terminal's body state through interaction between the terminal's body and interactive objects in the real world.

[0102] For example, the multimedia content may be multimedia content that comes with the target application, and the viewing reward corresponding to the multimedia content may be related to the target application, such as a reward within the target application. The multimedia content may also be multimedia content corresponding to other applications, and the reward corresponding to the multimedia content may be related to other applications, such as a reward within other applications.

[0103] For example, Figure 5 When multimedia content is played in the terminal, an interactive task will be displayed in the multimedia content playback interface 501. The interactive task is used to prompt the user to change the terminal's body state, thereby switching the display style of the multimedia content from the first style to the second style, such as Figure 5 As shown in FIG. 5( a ), the interactive task is a terminal twisting task 502. The terminal twisting task 502 includes a terminal twisting logo. The user can change the display style of the multimedia content by twisting the terminal. Figure 5 As shown in FIG. 5( b ), the interactive task is a charging interface connection task 503 , which includes an identification of the charging interface connection. The user can change the display style of the multimedia content by connecting the charging interface.

[0104] It should be noted that the above-mentioned terminal twisting task 502 and charging interface connecting task 503 may appear separately or in combination, and the embodiment of the present application does not specifically limit this.

[0105] In some embodiments, the terminal identifies the category of an object in the real world through a camera; based on the category of the object, the terminal loads and plays multimedia content corresponding to the object.

[0106] The method of identifying the category of the object includes at least one of the following, but is not limited to:

[0107] Take photos of objects in the real world through a camera; identify the category of the object based on the photos taken;

[0108] Scan the barcode of an object in the real world through a camera; identify the category of the object based on the barcode scanning result.

[0109] For example, by taking a photo of a TV, the TV is identified, and then multimedia content related to the TV is loaded and played.

[0110] Step 404: In response to the state change operation of the interaction between the terminal body and the interactive object in the real world, update the display content corresponding to the interactive task.

[0111] A state change operation refers to an operation that senses operation information based on the sensors in the terminal and changes the body state of the terminal; or, a state change operation refers to an operation that directly interacts with the terminal but does not interact with the multimedia content; or, a state change operation refers to an operation that interacts with other parts of the terminal except the multimedia content; or, a state change operation refers to an operation performed on the body of the terminal.

[0112] It should be noted that the state change operation is to make the terminal linked with the real world. The user does not interact directly with the multimedia content, but changes the state of the terminal itself based on the sensor in the terminal. The state of the terminal is changed through the state change operation, thereby triggering the acquisition of viewing rewards for multimedia content based on the state of the terminal.

[0113] Display content refers to the change process of the display style of multimedia content from a first style to a second style; or, display content refers to feedback information corresponding to the state change operation of the terminal; or, display content refers to the display style change effect of multimedia content.

[0114] For example, the multimedia content in the first style is in an obstructed state, that is, the multimedia content cannot be seen in its entirety or cannot be seen clearly, and the multimedia content in the first style is unclear, not smooth, and incomplete. The multimedia content in the second style is clear, smooth, and complete.

[0115] It should be noted that the first style and the second style are two different display styles of the incentive video. The embodiment of the present application is described by taking the first style as a blurred state and the second style as a clear state as an example, but is not limited to this.

[0116] Optionally, the style of the displayed content may be at least one of video, animation, picture, text, and audio, but is not limited thereto, and the embodiments of the present application do not specifically limit this.

[0117] In some embodiments, the visual style change of the displayed content is manifested as at least one of the following:

[0118] ·Power-on animation design: Design a set of power-on animations, including the insertion action of the "charging interface icon" and the power-on light animation extending from the center point of the bottom edge of the style change prompt information to both sides. Optionally, the charging interface icon can customize the appearance, color and animation of the interface icon and the power-on light according to personalized needs;

[0119] Interface response operation: When the terminal detects that the user has performed a "terminal twist operation" or a "charging operation", the power-on animation in the multimedia content playback interface is triggered. According to the user's operation intensity and speed (such as angle size or charging speed, etc.), the playback speed of the displayed content is adjusted in real time to achieve the effect of the interface icon moving upward and inserting the bottom of the style change prompt information.

[0120] ·Multimedia content interactive task success conditions: During the animation playback process, set the conditions for the multimedia content interactive task success. For example, when the "interface icon" is inserted to the bottom of the style change prompt information, and the power-on light extends from the bottom of the style change prompt information to the top of the style change prompt information, the multimedia content interactive task is considered successful.

[0121] ·State or style changes after the interactive task of multimedia content is successful: After the interactive task of multimedia content is successful, the multimedia element will trigger at least one of the following state or style changes: the multimedia element gradually changes from the original blurred state to the clear state, the brightness of the multimedia element gradually changes from dark to bright, the stains or obstructions on the multimedia element are gradually erased, the dust on the multimedia element is gradually sucked away, the water vapor on the multimedia element is gradually evaporated, the video material changes from paused playback to continued playback, the video material changes from slow playback to normal or accelerated playback, etc.

[0122] It should be noted that the above-mentioned state or style change effects can be presented individually or in combination.

[0123] In some embodiments, the auditory style change of the displayed content is manifested as: when the terminal detects that the user has performed a "terminal twist operation" or a "charging operation", a corresponding prompt sound effect is played to indicate that the state change operation has been completed. The sound effect can be customized according to the scene or brand characteristics of the multimedia content.

[0124] It should be noted that the auditory / aural style changes of the above-mentioned display content styles can be presented separately or in combination.

[0125] In some embodiments, the change in the display content from the first style to the second style includes at least one of the following, but is not limited thereto:

[0126] Multimedia elements gradually change from a blurry state to a clear state;

[0127] The brightness of multimedia elements gradually changes from dark to bright;

[0128] Stains or obstructions on multimedia elements are gradually erased;

[0129] Dust on multimedia elements is gradually sucked away;

[0130] The water vapor on the multimedia elements gradually evaporates;

[0131] The video material resumes playing after being paused;

[0132] · Video clips can be played from slow to normal or accelerated.

[0133] It should be noted that the change style of the displayed content may be one or more of the above, that is, the change styles of the style change may be presented individually or in combination.

[0134] For example, Figure 6 The schematic diagram of the multimedia content playback interface shown in FIG. Figure 6As shown in FIG. 6( a ), when multimedia content is played in the terminal, the display content of the interactive task will be displayed in the multimedia content playback interface 601. The display content of the interactive task is used to prompt the process of switching the display style of the multimedia content from the first style to the second style. Figure 6 As shown in FIG. 1( b), the terminal responds to the state change operation for the terminal. The state change operation takes twisting the terminal as an example. The interface icon 603 in the multimedia content playback interface 601 moves upward to the bottom of the prompt information 602 for inserting the interactive task along with the state change operation. The prompt information in the prompt information 602 for the interactive task is canceled. Then, as shown in FIG. Figure 6 As shown in FIG. (c), a power-on light 604 is extended from the center point of the bottom edge of the interactive task prompt information 602 to both sides. When the power-on light 604 extends from the bottom of the interactive task prompt information 602 to the top of the interactive task prompt information 602, the display style of the multimedia content is successfully switched; Figure 6 As shown in Figure (d), after the display style of the multimedia content is successfully switched, the prompt information 602 of the interactive task is cancelled, and the complete, clear and smooth multimedia content is presented in the multimedia content playback interface 601. At the same time, the viewing reward for watching the multimedia content is displayed, and the information for receiving the viewing reward is displayed in the multimedia content playback interface 601.

[0135] Without performing a state change operation, complete, clear, and smooth multimedia content will be presented after a set time, but the reward in the multimedia content will not be triggered, that is, the information for receiving the viewing reward will not be displayed in the multimedia content playback interface 601.

[0136] The state change operation is a charging operation.

[0137] The charging operation refers to the operation of charging the terminal, or the charging operation refers to the interactive operation between the body and the charging connector, that is, connecting the charging cable to the charging interface of the terminal.

[0138] Exemplarily, in response to the charging operation, the terminal switches the body state from an uncharged state to a charged state, and the display style of the multimedia content is switched from a first style to a second style of the charging style change animation.

[0139] The charging style change animation refers to the style change animation played after the charging operation is performed on the terminal.

[0140] In some embodiments, in response to a change in an operational attribute of a charging operation, the terminal changes the playback attribute of the charging style change animation synchronously with the operational attribute.

[0141] The operational attributes of the charging operation include at least one of a charging rate and a charging time, but are not limited thereto, and the embodiments of the present application do not specifically limit this.

[0142] The playback attributes of the charging style change animation include at least one of playback speed, playback volume, and playback brightness, but are not limited to these. The embodiments of the present application do not specifically limit this.

[0143] In some embodiments, in response to a change in the charging speed of the charging operation, the playing speed of the charging pattern change animation changes synchronously with the charging speed.

[0144] For example, the charging style change animation is to gradually make the blocked part of the multimedia content clearer from bottom to top, and the speed at which the blocked part of the multimedia content gradually becomes clearer from bottom to top is related to the charging speed. For example, as the charging speed slows down, the speed at which the blocked part of the multimedia content gradually becomes clearer from bottom to top also gradually slows down.

[0145] The state change operation is to access a specified WiFi network operation.

[0146] Accessing a designated WiFi network refers to the interactive operation between the wireless access point built into the machine and a wireless router in the real world.

[0147] In some embodiments, in response to the operation of connecting to a designated WiFi network, the state of the machine body is switched from a state of not connecting to the designated WiFi network to a state of connecting to the designated WiFi network, and the display style of the multimedia content is switched from a first style to a second style of the connecting WiFi style change animation.

[0148] The WiFi access style change animation refers to the style change animation played after the operation of accessing a specified WiFi network is performed on the terminal.

[0149] For example, the built-in wireless access point in the terminal is turned on to receive the WiFi signal transmitted by the wireless router. In response to the wireless access point in the terminal being connected to the wireless router, the display style of the multimedia content is switched from the first style to the second style of the access WiFi style change animation. For example, when entering the coverage area of ​​the wireless router, the display style of the multimedia content is switched from the first style to the second style of the access WiFi style change animation.

[0150] In some embodiments, in response to a change in an operational attribute during interaction between a wireless access point and a wireless router, the terminal changes the playback attribute of the WiFi access style change animation synchronously with the operational attribute.

[0151] The playback attributes of the WiFi access style change animation include at least one of playback speed, playback volume, and playback brightness, but are not limited to these. The embodiments of the present application do not specifically limit this.

[0152] In response to the change in the interaction distance between the wireless access point and the wireless router, the playback speed of the charging style change animation changes synchronously with the interaction distance. For example, the closer the distance between the wireless access point and the wireless router, the faster the playback speed of the charging style change animation, or the higher the brightness.

[0153] The state change operation is an NFC identification operation.

[0154] In some embodiments, the terminal switches the body state from the NFC unrecognized state to the NFC recognized state in response to the NFC recognition operation, and the display style of the multimedia content is switched from the first style to the second style of the NFC style change animation.

[0155] For example, when entering a community gate by swiping the NPC through the terminal, the terminal responds to the NFC receiver in the body receiving and identifying the signal emitted by the NFC radio frequency device, and displays the "Welcome Home" animation.

[0156] The state change operation is a terminal twist operation.

[0157] Exemplarily, the terminal switches the body state from the first twisted state to the second twisted state in response to the terminal twisting operation, and the display style of the multimedia content is switched from the first style to the second style of the twisting style change animation.

[0158] Terminal twisting operation refers to a human-computer interaction method of rotating the terminal in any direction of "up, down, left, right, front, and back".

[0159] The twist style change animation refers to the animation played after a twist operation is performed on the terminal.

[0160] In some embodiments, in response to a change in an operation attribute of a twisting operation of the terminal, the playing attribute of the twisting style change animation changes synchronously with the operation attribute.

[0161] The operational attributes of the terminal twisting operation include at least one of a twisting angle, a twisting rate, a twisting direction, and a twisting time, but are not limited thereto. The embodiments of the present application do not specifically limit this.

[0162] The playback attributes of the twisting style change animation include at least one of playback speed, playback volume, and playback brightness, but are not limited thereto, and the embodiments of the present application do not make specific limitations on this.

[0163] In some embodiments, the twisting rate of the terminal changes in response to the twisting operation of the terminal, and the playing speed of the twisting style change animation changes synchronously with the twisting rate.

[0164] For example, as the twisting speed of the terminal increases, the playing speed of the twisting style change animation also increases, that is, the faster the terminal is twisted, the faster the playing speed of the twisting style change animation is.

[0165] In some embodiments, the terminal changes the twisting angle in response to the twisting operation of the terminal, and the playing speed of the twisting style change animation changes synchronously with the twisting angle.

[0166] For example, as the twist angle of the terminal increases, the playing speed of the twist style change animation also increases, that is, the larger the twist angle of the terminal, the faster the playing speed of the twist style change animation. For example, when the terminal is just started to be rotated, the twist style change animation is played at 1x speed; after the terminal is rotated 45 degrees, the twist style change animation is played at 1.5x speed; after the terminal is rotated 90 degrees, the twist style change animation is played at 2x speed.

[0167] The state change operations are charging operation and terminal twisting operation.

[0168] Exemplarily, in response to simultaneously executing a charging operation and a terminal twisting operation, the terminal switches the body state from an uncharged state to a charged state, and the display style of the multimedia content is switched from a first style to a second style of a charging twisting style change animation.

[0169] Or, in response to the terminal successively performing the charging operation and the terminal twisting operation, the terminal switches the body state from the uncharged state to the charged state, and the display style of the multimedia content is switched from the first style to the second style of the charging twisting style change animation. The time difference between the charging operation and the terminal twisting operation is less than the time threshold, for example, less than 3 seconds.

[0170] The charging twisting style change animation refers to the style change animation played after the charging operation and the terminal twisting operation are performed on the terminal.

[0171] In some embodiments, in response to changes in the operation attributes corresponding to the charging operation and the terminal twisting operation, respectively, the playback attributes of the charging twisting style change animation change synchronously with the operation attributes.

[0172] In some embodiments, the terminal determines the change amplitude of the playback speed of the charging twisting style change animation in response to the change in the charging speed of the charging operation and the change in the twisting angle of the terminal twisting operation, based on the weight value of the charging speed and the terminal twisting operation; and modifies the playback speed of the charging twisting style change animation according to the change amplitude.

[0173] In some embodiments, the terminal responds to a change in the twisting angle of a terminal twisting operation, and determines the change amplitude of the playback speed of the charging twisting style change animation based on the twisting angle of the terminal twisting operation; within a time threshold, the terminal responds to the charging operation and doubles the change amplitude of the playback speed of the charging twisting style change animation; and modifies the playback speed of the charging twisting style change animation according to the doubled change amplitude.

[0174] The state change operation is a gesture control operation.

[0175] Gesture control operations refer to operations performed by performing specific gestures (such as swiping, pinching, etc.) on the terminal screen, or sliding in a specified direction.

[0176] Exemplarily, the terminal turns on the camera to obtain gesture movements in front of the screen. In response to the gesture control operation, the terminal switches the body state from the first gesture state to the second gesture state, and displays a gesture style change animation of the multimedia content from the first style to the second style.

[0177] The gesture style change animation refers to the style change animation played after a gesture control operation is performed on the terminal.

[0178] In some embodiments, in response to a change in an operation attribute of a gesture control operation, the terminal changes the playback attribute of the gesture style change animation synchronously with the operation attribute.

[0179] The operation attributes of the gesture control operation include at least one of a gesture control rate, a gesture control shape, and a gesture control distance, but are not limited thereto. The embodiments of the present application do not make specific limitations on this.

[0180] The playback attributes of the gesture style change animation include at least one of playback speed, playback volume, and playback brightness, but are not limited thereto, and the embodiments of the present application do not make specific limitations on this.

[0181] In some embodiments, the gesture control rate of the terminal changes in response to the gesture control operation, and the playback speed of the gesture style change animation changes synchronously with the gesture control rate.

[0182] For example, the gesture style change animation is to gradually make the blocked part of the multimedia content clearer from left to right, and the speed at which the blocked part of the multimedia content gradually becomes clearer from left to right is related to the gesture control rate. For example, as the gesture control rate slows down, the speed at which the blocked part of the multimedia content gradually becomes clearer from the lower left to the right also gradually slows down.

[0183] Step 406: When the interactive task is completed, information on receiving a viewing reward for viewing multimedia content is displayed.

[0184] Viewing rewards refer to the rewards obtained by completing interactive tasks while watching multimedia content.

[0185] Optionally, viewing rewards can be divided into two types: material rewards and spiritual rewards.

[0186] Material rewards refer to rewards that give users certain materials, such as red envelopes, coupons, gift boxes, lucky bags, etc. provided by advertisers. They can also be prop cards, reward doubling cards, advertising time reduction cards, etc. provided by the application.

[0187] Spiritual rewards refer to rewards that are used to encourage users without any material provision, such as exclusive blessings provided by advertisers, system blessings corresponding to holidays, etc., or virtual titles provided by applications.

[0188] Optionally, the style of the viewing reward is at least one of text, animation, red envelope style, and audio, but is not limited to this, and the embodiments of the present application do not make specific limitations on this.

[0189] Exemplarily, after the state of the terminal is changed by the state transformation operation of the terminal, the interactive task is completed, the multimedia content is indirectly interacted with, and the display style of the multimedia content is switched from the first style to the second style. After switching to the second style, the reward in the multimedia content is obtained, and the viewing reward corresponding to the multimedia content is displayed in the multimedia content playback interface.

[0190] For example, Figure 7 A schematic diagram of viewing rewards in a multimedia content playback interface is shown. After the display style of the multimedia content is successfully switched, a complete, clear, and smooth multimedia content is presented in a multimedia content playback interface 701, and viewing rewards in the multimedia content are obtained at the same time, and viewing rewards 702 are displayed in a multimedia content playback interface 702. Viewing rewards 702 can be presented in the form of text, so that users can quickly know the keywords of the multimedia content.

[0191] For example, Figure 8 A schematic diagram of viewing rewards in a multimedia content playback interface is shown. After the display style of the multimedia content is successfully switched, a complete, clear, and smooth multimedia content is presented in the multimedia content playback interface 801, and the reward in the multimedia content is triggered at the same time. The receiving information of the viewing reward 802 is displayed in the multimedia content playback interface 802. The viewing reward 802 is presented in the form of a red envelope. After the user receives the red envelope, a successful receipt mark 803 is displayed.

[0192] In summary, the method provided in this embodiment displays interactive tasks during the playback of multimedia content; updates the displayed content corresponding to the interactive tasks based on the change of the body state; and displays the collection information of viewing rewards for viewing multimedia content when the interactive tasks are completed. This application provides a new human-computer interaction method, which realizes indirect interaction with multimedia content based on the interaction with the terminal, avoids operating in the limited operating space of the touch screen, enriches the interaction methods between users and multimedia content, enriches the types of human-computer interaction, and thus increases the frequency of interaction between users and multimedia content.

[0193] The method provided in this embodiment changes the state of the terminal through the state change operation of the terminal to display the display content of the interactive task. The present application displays creative and interesting interactive tasks by interacting with the terminal where the multimedia content is located, thereby enhancing the user's attention to and willingness to participate in the multimedia content. By designing attractive task prompts and interactive guidance, the user's interest is stimulated, and the user is guided to complete the state change operation, thereby realizing indirect interaction with the multimedia content, enriching the interaction mode between the user and the multimedia content, enriching the types of human-computer interaction, and thereby increasing the frequency of interaction between the user and the multimedia content.

[0194] The method provided in this embodiment displays the switching process of the display style of multimedia content through the state change operation of the terminal, presents the style change animation in visual, auditory and other aspects, makes the multimedia content more vivid and immersive, and helps to improve the user experience during the viewing of multimedia content.

[0195] The method provided in this embodiment is that when the multimedia content is initially played, the multimedia content appears in an obscured style. When the interactive task of changing the terminal body state is completed, the multimedia content appears in a clear style. In the context of playing the multimedia content, there is no direct interaction with the multimedia content. By changing the terminal body state, the collection of viewing rewards in the multimedia content is triggered. By providing viewing rewards, the participation and experience of the multimedia content can be further improved, and ultimately the conversion rate of the multimedia content can be promoted.

[0196] Fig. 9 1 is a flowchart of a terminal-based human-computer interaction method provided by an exemplary embodiment of the present application. The method can be executed by a terminal and a server. The method includes:

[0197] Step 901: Start.

[0198] Step 902: Display interactive tasks.

[0199] Interactive tasks are tasks completed by changing the terminal's body state during the playback of multimedia content.

[0200] According to the advertiser's demands and product strategies, the server generates one or more interactive tasks for each multimedia content on the server, such as "Complete the power-on task and win a generous prize!", "Complete the power-on task and get a surprise reward". At the same time, an interactive guide for twisting the terminal or connecting the charging port is generated, such as displaying an animation of a mobile phone rotating pattern to guide the user to perform the terminal twisting operation. The server stores the task prompt and the interactive guide data in a certain format, such as JavaScript Object Notation (JSON), and associates them with the multimedia elements of the multimedia content.

[0201] When the terminal needs to display multimedia content, it sends a multimedia content request to the server. The server returns the corresponding multimedia elements, as well as the data of the associated interactive tasks and interactive guide animations according to the request.

[0202] After receiving the data returned by the server, the terminal parses the data and renders the interactive task and interactive guide animation data on the multimedia content playback interface. According to the returned data, the font, color, size and other styles of the interactive task can be adjusted to obtain the best visual effect.

[0203] The terminal renders the interactive tasks and interactive guide animations on the multimedia content playback interface. The interactive tasks can be set to appear when the advertisement starts playing to attract the user's attention. The interactive guide animation can respond to user operations in real time. For example, when the phone is rotated, the animation follows the rotation, helping users to complete the state change operation more easily.

[0204] Step 903: Determine whether to execute a state change operation.

[0205] Exemplarily, in the application program in the terminal, a sensor data acquisition module is written to use the built-in sensors of the terminal (such as gyroscope, gravity sensor, battery power, etc.) to monitor and collect the user's state change operation data in real time.

[0206] For the “terminal twisting operation”, a gyroscope or a gravity sensor may be used to detect changes in the terminal rotation angle.

[0207] For "charging operation", you can identify it by monitoring the charging status broadcast of Android or iOS system. For example, in Android system, you can register a broadcast receiver and monitor ACTION_BATTERY_CHANGED broadcast to detect the charging status.

[0208] After acquiring the sensor data, the collected sensor data is analyzed in real time to determine whether the user has performed a "terminal twisting operation" or a "connected charging operation".

[0209] Regarding the determination of "terminal twisting operation": the data generated by the gyroscope or gravity sensor can be analyzed to calculate the rotation angle of the terminal in each direction. When the angle reaches a preset threshold, it is determined that the user has performed a twisting operation.

[0210] For the judgment of "charging operation": the charging status can be judged by checking the battery status. In the Android system, it can be judged by checking the BATTERY_PLUGGED_USB or BATTERY_PLUGGED_AC status in the ACTION_BATTERY_CHANGED broadcast. In the iOS system, the battery state BatteryState attribute of the user interface UI Device can be used to determine whether the terminal is charging.

[0211] Exemplarily, when it is detected that the user has performed a state change operation, step 904 is executed; when it is detected that the user has not performed a state change operation, step 907 is executed.

[0212] Step 904: Display the display content of the interactive task.

[0213] When the terminal detects that the user has performed a "terminal twisting operation" or a "charging operation", the state change module is triggered to transmit relevant operation information (such as sensor data) to the server, and the interactive task response is triggered and the corresponding display content is displayed.

[0214] In some embodiments, the visual style change of the displayed content is manifested as at least one of the following:

[0215] ·Power-on animation design: Design a set of power-on animations, including the insertion action of the "charging interface icon" and the power-on light animation extending from the center point of the bottom edge of the style change prompt information to both sides. Optionally, the charging interface icon can customize the appearance, color and animation of the interface icon and the power-on light according to personalized needs;

[0216] Interface response operation: When the terminal detects that the user has performed a "terminal twist operation" or a "charging operation", the power-on animation in the multimedia content playback interface is triggered. According to the user's operation intensity and speed (such as angle size or charging speed, etc.), the playback speed of the multimedia content style change is adjusted in real time to achieve the effect of the interface icon moving upward and inserting the bottom of the style change prompt information.

[0217] ·Multimedia content interactive task success conditions: During the animation playback process, set the conditions for the multimedia content interactive task success. For example, when the "interface icon" is inserted to the bottom of the style change prompt information, and the power-on light extends from the bottom of the style change prompt information to the top of the style change prompt information, the multimedia content interactive task is considered successful.

[0218] ·State or style changes after the interactive task of multimedia content is successful: After the interactive task of multimedia content is successful, the multimedia element will trigger at least one of the following state or style changes: the multimedia element gradually changes from the original blurred state to the clear state, the brightness of the multimedia element gradually changes from dark to bright, the stains or obstructions on the multimedia element are gradually erased, the dust on the multimedia element is gradually sucked away, the water vapor on the multimedia element is gradually evaporated, the video material changes from paused playback to continued playback, the video material changes from slow playback to normal or accelerated playback, etc.

[0219] It should be noted that the above-mentioned state or style change effects can be presented individually or in combination.

[0220] In some embodiments, the auditory style change of the displayed content is manifested as: when the terminal detects that the user has performed a "terminal twist operation" or a "charging operation", a corresponding prompt sound effect is played to indicate that the state change operation has been completed. The sound effect can be customized according to the scene or brand characteristics of the multimedia content.

[0221] It should be noted that the above-mentioned changes in the auditory / aural styles of the display contents may be presented individually or in combination.

[0222] Step 905: The style switching is completed, and the multimedia elements in the multimedia content are displayed completely, clearly and smoothly.

[0223] After the display style of the multimedia content in the terminal is switched from the first style to the second style, the multimedia content completes the style switching, and the multimedia elements in the multimedia content can be displayed completely, clearly and smoothly.

[0224] Step 906: Display viewing rewards for viewing multimedia content.

[0225] After the display style of the multimedia content is switched to the second style, the viewing reward corresponding to the multimedia content is displayed.

[0226] Optionally, the viewing reward includes at least one of the following types:

[0227] Jump to the details page after 3 seconds, allowing users to learn more exciting things faster;

[0228] Gift packages, discounts, coupons and other rewards provided by advertisers;

[0229] Rewards provided by app developers.

[0230] Exemplarily, the terminal detects whether the display style of the multimedia content is successfully changed in the multimedia content playback interface. When the "interface icon" is inserted at the bottom of the style change prompt information and the power-on light extends to the top of the prompt information of the interactive task, it is determined that the display style of the multimedia content is changed. The terminal records the completion status and related information in the local data.

[0231] When the display style of the multimedia content is changed, the terminal plays the complete, clear and smooth multimedia elements, and displays the incremental advertising selling point information. This information can include the advertiser's coupons, gift packages or other promotional activities. At the same time, the terminal sends a completion message to the server. The server will register the corresponding rewards according to the settings of the application developer and advertiser. The rewards can include points, game props, coupons, gift packages, discounts and other forms, and these viewing rewards are associated with user data.

[0232] The terminal pops up a corresponding prompt based on the viewing reward returned by the server. For example, it informs the user that points, coupons or other mall rewards have been obtained. The prompt window can include information such as task result overview, reward details, and reward collection method.

[0233] After receiving the reward prompt, the user can proceed according to the method of claiming. App developers and advertisers can verify the information of users completing tasks and issue corresponding rewards. The terminal should ensure that users can successfully claim rewards and integrate them into the reward distribution link in the app or game.

[0234] In the process of displaying complete multimedia content, the terminal can be set to automatically jump to the ad landing page after a certain period of time (such as N seconds). Users can also actively click on the ad content to go to the landing page to learn more exciting information. The ad landing page is highly related to the multimedia element content.

[0235] Step 907: After 10 seconds, the multimedia elements are automatically displayed completely, clearly and smoothly.

[0236] When it is detected that the user has not performed a state change operation, the terminal automatically displays complete, clear and smooth multimedia elements in the multimedia content after a preset time (such as 10 seconds), but will not trigger the collection information of the viewing reward of the multimedia content.

[0237] Step 908: End.

[0238] Fig.10 A schematic diagram of the structure of a terminal-based human-computer interaction device provided by an exemplary embodiment of the present application is shown. The device can be implemented as all or part of a computer device through software, hardware, or a combination of both. The device includes:

[0239] The display module 1001 is used to display interactive tasks during the playback of multimedia content, where the interactive tasks are tasks completed by changing the body state of the terminal;

[0240] The display module 1001 is used for responding to the state change operation for the state of the machine and updating the display content corresponding to the interactive task based on the change of the state of the machine;

[0241] The display module 1001 is used to display the redemption information of the viewing reward for watching the multimedia content when the interactive task is completed.

[0242] In some embodiments, the display module 1001 is further used to update the display content corresponding to the interactive task in response to a state change operation of the interaction between the terminal body and an interactive object in the real world.

[0243] The state change operation refers to an operation performed by changing the body state of the terminal based on an interactive object in the real world, and the display content refers to the process of switching the display style of the multimedia content from a first style to a second style.

[0244] In some embodiments, the display module 1001 is further used to switch the body state from an uncharged state to a charged state in response to the charging operation, and to display the charging style change animation in which the display style of the multimedia content switches from the first style to the second style.

[0245] The charging operation refers to the interactive operation between the body and the charging connector, and the charging style change animation refers to the style change animation played after the charging operation is performed on the terminal.

[0246] In some embodiments, the display module 1001 is further configured to respond to a change in an operation attribute of the charging operation, and the playback attribute of the charging style change animation changes synchronously with the operation attribute.

[0247] In some embodiments, the display module 1001 is further configured to respond to a change in the charging speed of the charging operation, and the playback speed of the charging style change animation changes synchronously with the charging speed.

[0248] In some embodiments, the display module 1001 is further used to switch the body state from a state of not connecting to the designated WiFi network to a state of connecting to the designated WiFi network in response to the operation of connecting to the designated WiFi network, and to display the display style of the multimedia content from the first style to the second style of the connected WiFi style change animation.

[0249] Among them, the access to the designated WiFi network operation refers to the interactive operation between the wireless access point built into the body and the wireless router in the real world, and the access to WiFi style change animation refers to the style change animation played after the access to the designated WiFi network operation is performed on the terminal.

[0250] In some embodiments, the display module 1001 is further configured to respond to a change in an operation attribute when the wireless access point interacts with the wireless access point, and the playback attribute of the access WiFi style change animation changes synchronously with the operation attribute.

[0251] In some embodiments, the display module 1001 is further configured to respond to a change in the interaction distance between the wireless access points, and the playback speed of the charging style change animation changes synchronously with the interaction distance.

[0252] In some embodiments, the display module 1001 is also used to switch the body state from an NFC unrecognized state to an NFC recognized state in response to the interactive operation between the NFC receiver and the NFC radio in the body, and to display the NFC style change animation in which the display style of the multimedia content is switched from the first style to the second style.

[0253] In some embodiments, the display module 1001 is further configured to switch the state of the body from the first twisted state to the second twisted state in response to a terminal twisting operation, and display the twisting style change animation in which the display style of the multimedia content is switched from the first style to the second style;

[0254] The terminal twisting operation refers to an operation of twisting the body of the terminal at a first angle, and the twisting style changing animation refers to an animation played after the twisting operation is performed on the terminal.

[0255] In some embodiments, the display module 1001 is further configured to respond to a change in an operation attribute of the terminal twisting operation, and the playback attribute of the twisting style change animation changes synchronously with the operation attribute.

[0256] In some embodiments, the display module 1001 is further configured to cause the playback speed of the twisting style change animation to change synchronously with the twisting angle in response to a change in the twisting angle of the terminal twisting operation.

[0257] In some embodiments, the display module 1001 is further configured to respond to a change in the twisting rate of the terminal twisting operation, and the playing speed of the twisting style change animation changes synchronously with the twisting rate.

[0258] In some embodiments, the display module 1001 is also used to switch the body state from a first gesture state to a second gesture state in response to a gesture control operation, and to display a gesture style change animation in which the display style of the multimedia content switches from the first style to the second style.

[0259] The gesture style change animation refers to the style change animation played after the gesture control operation is performed on the terminal.

[0260] In some embodiments, the terminal further includes an identification module 1002 and a loading module 1003 .

[0261] The recognition module 1002 is used to recognize the category of objects in the real world through a camera.

[0262] The loading module 1003 is used to load and play the multimedia content corresponding to the object based on the category of the object.

[0263] In some embodiments, the recognition module 1002 is used to take a photo of the object in the real world through the camera; identify the category of the object based on the taken photo; or, scan a barcode of the object in the real world through the camera; and identify the category of the object based on the scanning result of the barcode.

[0264] Fig.11 The block diagram of the structure of a computer device 1100 provided by an exemplary embodiment of the present application is shown. The computer device 1100 may be a portable mobile terminal, such as a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III), an MP4 player (Moving Picture Experts Group Audio Layer IV). The computer device 1100 may also be called a user device, a portable terminal, or other names.

[0265] Typically, the computer device 1100 includes a processor 1101 and a memory 1102 .

[0266] The processor 1101 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1101 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), and PLA (Programmable Logic Array). The processor 1101 may also include a main processor and a coprocessor. The main processor is a processor for processing data in an awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 1101 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1101 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0267] The memory 1102 may include one or more computer-readable storage media, which may be tangible and non-transitory. The memory 1102 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1102 is used to store at least one instruction, which is used to be executed by the processor 1101 to implement the terminal-based human-computer interaction method provided in the embodiment of the present application.

[0268] In some embodiments, the computer device 1100 may further include: a peripheral device interface 1103 and at least one peripheral device. Specifically, the peripheral device includes: at least one of a radio frequency interface 1104 , a touch display screen 1105 , a camera assembly 1106 , an audio circuit 1107 and a power supply 1108 .

[0269] The peripheral device interface 1103 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 1101 and the memory 1102. In some embodiments, the processor 1101, the memory 1102, and the peripheral device interface 1103 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1101, the memory 1102, and the peripheral device interface 1103 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0270] The radio frequency interface 1104 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency interface 1104 communicates with communication networks and other communication devices through electromagnetic signals. The radio frequency interface 1104 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the radio frequency interface 1104 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The radio frequency interface 1104 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to: the World Wide Web, a metropolitan area network, an intranet, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency interface 1104 may also include circuits related to NFC (Near Field Communication), which is not limited in this application.

[0271] The touch display screen 1105 is used to display a UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. The touch display screen 1105 also has the ability to collect touch signals on the surface or above the surface of the touch display screen 1105. The touch signal may be input to the processor 1101 as a control signal for processing. The touch display screen 1105 is used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the touch display screen 1105 may be one, and the front panel of the computer device 1100 is set; in other embodiments, the touch display screen 1105 may be at least two, which are respectively set on different surfaces of the computer device 1100 or are folded; in some embodiments, the touch display screen 1105 may be a flexible display screen, which is set on a curved surface or a folded surface of the computer device 1100. Even, the touch display screen 1105 can also be set to a non-rectangular irregular shape, that is, a special-shaped screen. The touch display screen 1105 can be made of materials such as LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), etc.

[0272] The camera assembly 1106 is used to capture images or videos. Optionally, the camera assembly 1106 includes a front camera and a rear camera. Typically, the front camera is used to realize video calls or selfies, and the rear camera is used to realize the shooting of photos or videos. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, and a wide-angle camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, and the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting functions. In some embodiments, the camera assembly 1106 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0273] The audio circuit 1107 is used to provide an audio interface between the user and the computer device 1100. The audio circuit 1107 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 1101 for processing, or input them into the radio frequency interface 1104 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the computer device 1100. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 1101 or the radio frequency interface 1104 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as distance measurement. In some embodiments, the audio circuit 1107 may also include a headphone jack.

[0274] The power supply 1108 is used to power various components in the computer device 1100. The power supply 1108 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 1108 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged through a wired line, and a wireless rechargeable battery is a battery that is charged through a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0275] In some embodiments, the computer device 1100 further includes one or more sensors 1109 , including but not limited to: an acceleration sensor 1110 , a gyroscope sensor 1111 , a pressure sensor 1112 , an optical sensor 1113 , and a proximity sensor 1114 .

[0276] The acceleration sensor 1110 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the computer device 1100. For example, the acceleration sensor 1110 can be used to detect the components of gravity acceleration on the three coordinate axes. The processor 1101 can control the touch display screen 1105 to display the user interface in a horizontal view or a vertical view according to the gravity acceleration signal collected by the acceleration sensor 1110. The acceleration sensor 1110 can also be used for collecting game or user motion data.

[0277] The gyro sensor 1111 can detect the body direction and rotation angle of the computer device 1100, and the gyro sensor 1111 can cooperate with the acceleration sensor 1110 to collect the user's 3D actions on the computer device 1100. The processor 1101 can implement the following functions based on the data collected by the gyro sensor 1111: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

[0278] The pressure sensor 1112 can be set on the side frame of the computer device 1100 and / or the lower layer of the touch display screen 1105. When the pressure sensor 1112 is set on the side frame of the computer device 1100, it can detect the user's grip signal of the computer device 1100, and perform left and right hand recognition or shortcut operations according to the grip signal. When the pressure sensor 1112 is set on the lower layer of the touch display screen 1105, it can control the operability controls on the UI interface according to the user's pressure operation on the touch display screen 1105. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.

[0279] The optical sensor 1113 is used to collect the ambient light intensity. In one embodiment, the processor 1101 can control the display brightness of the touch display screen 1105 according to the ambient light intensity collected by the optical sensor 1113. Specifically, when the ambient light intensity is high, the display brightness of the touch display screen 1105 is increased; when the ambient light intensity is low, the display brightness of the touch display screen 1105 is reduced. In another embodiment, the processor 1101 can also dynamically adjust the shooting parameters of the camera assembly 1106 according to the ambient light intensity collected by the optical sensor 1113.

[0280] The proximity sensor 1114, also called a distance sensor, is usually arranged on the front of the computer device 1100. The proximity sensor 1114 is used to collect the distance between the user and the front of the computer device 1100. In one embodiment, when the proximity sensor 1114 detects that the distance between the user and the front of the computer device 1100 is gradually decreasing, the processor 1101 controls the touch display screen 1105 to switch from the screen-on state to the screen-off state; when the proximity sensor 1114 detects that the distance between the user and the front of the computer device 1100 is gradually increasing, the processor 1101 controls the touch display screen 1105 to switch from the screen-off state to the screen-on state.

[0281] Those skilled in the art will understand that Fig.11 The structure shown in the figure does not constitute a limitation on the computer device 1100, and the computer device 1100 may include more or less components than shown in the figure, or combine some components, or adopt a different arrangement of components.

[0282] An embodiment of the present application also provides a computer device, which includes a processor and a memory, wherein the memory stores at least one program, and the at least one program is loaded and executed by the processor to implement the terminal-based human-computer interaction method provided by the above-mentioned method embodiments.

[0283] An embodiment of the present application also provides a computer-readable storage medium, in which at least one computer program is stored. The at least one computer program is loaded and executed by a processor to implement the terminal-based human-computer interaction method provided by the above-mentioned method embodiments.

[0284] An embodiment of the present application also provides a computer program product, which includes a computer program, and the computer program is stored in a computer-readable storage medium; the computer program is read and executed from the computer-readable storage medium by a processor of a computer device, so that the computer device executes to implement the terminal-based human-computer interaction method provided in the above-mentioned method embodiments.

[0285] It will be understood that in the specific implementation of the present application, the data involved, historical data, and data related to user data processing such as portraits related to user identity or characteristics, when the above embodiments of the present application are applied to specific products or technologies, need to obtain user permission or consent, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0286] It should be understood that the "plurality" mentioned in this article refers to two or more. "And / or" describes the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0287] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0288] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent switching, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A terminal-based human-computer interaction method, characterized in that: The method is applied to a terminal, and the method includes: Displaying interactive tasks during the playback of multimedia content, wherein the interactive tasks are tasks completed by changing the body state of the terminal; In response to a state change operation for the state of the machine, updating display content corresponding to the interactive task based on the change of the state of the machine; When the interactive task is completed, information on receiving a viewing reward for viewing the multimedia content is displayed.

2. The method according to claim 1, characterized in that The updating of the display content corresponding to the interactive task based on the change of the state of the machine in response to the state change operation for the state of the machine includes: In response to a state change operation of interaction between a body of the terminal and an interactive object in the real world, updating the display content corresponding to the interactive task; The state change operation refers to an operation of changing the body state of the terminal based on the interactive object in the real world, and the display content refers to the process of switching the display style of the multimedia content from a first style to a second style.

3. The method according to claim 2, characterized in that The state change operation includes a charging operation, and the display content includes a charging style change animation; The updating of the display content corresponding to the interactive task in response to the state change operation of the interaction between the terminal and the interactive object in the real world includes: In response to the charging operation, the state of the body is switched from an uncharged state to a charged state, and the charging style change animation showing the display style of the multimedia content is switched from the first style to the second style; The charging operation refers to the interactive operation between the body and the charging connector, and the charging style change animation refers to the style change animation played after the charging operation is performed on the terminal.

4. The method according to claim 3, characterized in that: The method further comprises: In response to a change in the operating attribute of the charging operation, the playing attribute of the charging style change animation changes synchronously with the operating attribute.

5. The method according to claim 4, characterized in that The operation attribute includes charging speed, and the playback attribute includes playback speed; In response to the operation attribute of the charging operation changing, the playback attribute of the charging style change animation changes synchronously with the operation attribute, including: In response to a change in the charging speed of the charging operation, the playing speed of the charging pattern change animation changes synchronously with the charging speed.

6. The method according to claim 2, characterized in that The state change operation includes an operation of accessing a specified WiFi network, and the displayed content includes an animation of a change in the style of accessing WiFi; The updating of the display content corresponding to the interactive task in response to the state change operation of the interaction between the terminal and the interactive object in the real world includes: In response to the designated WiFi network access operation, the state of the device is switched from a state of not accessing the designated WiFi network to a state of accessing the designated WiFi network, and a display style of the multimedia content is switched from the first style to the second style of the WiFi access style change animation; Among them, the access to the designated WiFi network operation refers to the interactive operation between the wireless access point built into the body and the wireless router in the real world, and the access to WiFi style change animation refers to the style change animation played after the access to the designated WiFi network operation is performed on the terminal.

7. The method according to claim 6, characterized in that The method further comprises: In response to a change in an operation attribute when the wireless access point interacts with the wireless access point, a play attribute of the access WiFi style change animation changes synchronously with the operation attribute.

8. The method according to claim 7, characterized in that The operation attribute includes the interaction distance, and the playback attribute includes the playback speed; In response to the operation attribute of the wireless access point interacting with the wireless access point changing, the play attribute of the access WiFi style change animation changes synchronously with the operation attribute, including: In response to a change in the interaction distance between the wireless access points, the play speed of the charging pattern change animation changes synchronously with the interaction distance.

9. The method according to claim 2, characterized in that: The state change operation includes an NFC identification operation, and the display content includes an NFC style change animation; The updating of the display content corresponding to the interactive task in response to the state change operation of the interaction between the terminal and the interactive object in the real world includes: In response to the NFC recognition operation, the body state is switched from the NFC unrecognized state to the NFC recognized state, and the NFC style change animation showing the display style of the multimedia content is switched from the first style to the second style.

10. The method according to claim 1, characterized in that The state change operation includes a terminal twisting operation, and the display content includes a twisting style change animation; The updating of the display content corresponding to the interactive task based on the change of the state of the machine in response to the state change operation for the state of the machine includes: In response to the terminal twisting operation, the state of the body is switched from the first twisting state to the second twisting state, and the twisting style change animation showing the display style of the multimedia content is switched from the first style to the second style; The terminal twisting operation refers to an operation of twisting the body of the terminal at a first angle, and the twisting style changing animation refers to an animation played after the twisting operation is performed on the terminal.

11. The method according to claim 10, characterized in that The method further comprises: In response to a change in the operation attribute of the terminal twisting operation, the play attribute of the twisting style change animation changes synchronously with the operation attribute.

12. The method according to claim 11, characterized in that The operation attribute includes a twist angle, and the playback attribute includes a playback speed; In response to the operation attribute of the terminal twisting operation changing, the playback attribute of the twisting style change animation changes synchronously with the operation attribute, including: In response to a change in the twist angle of the terminal twisting operation, the play speed of the twist pattern change animation changes synchronously with the twist angle.

13. The method according to claim 11, characterized in that The operation attribute includes a twist rate, and the playback attribute includes a playback speed; In response to the operation attribute of the terminal twisting operation changing, the playback attribute of the twisting style change animation changes synchronously with the operation attribute, including: In response to a change in the twisting rate of the terminal twisting operation, the playing speed of the twisting pattern changing animation changes synchronously with the twisting rate.

14. The method according to claim 1, characterized in that The state change operation includes a gesture control operation, and the display content includes a gesture style change animation; The updating of the display content corresponding to the interactive task based on the change of the state of the machine in response to the state change operation for the state of the machine includes: In response to the gesture control operation, the state of the machine body is switched from the first gesture state to the second gesture state, and a gesture style change animation showing the display style of the multimedia content is switched from the first style to the second style; The gesture style change animation refers to the style change animation played after the gesture control operation is performed on the terminal.

15. The method according to any one of claims 1 to 14, characterized in that: The method further comprises: Identify the categories of objects in the real world through cameras; Based on the category of the object, the multimedia content corresponding to the object is loaded and played.

16. The method according to claim 15, characterized in that The identifying the category of the object in the real world by using the camera includes: Taking a photo of the object in the real world by using the camera; identifying the category of the object based on the taken photo; Or, a barcode of the object in the real world is scanned by the camera; and the category of the object is identified based on the scanning result of the barcode.

17. A terminal-based human-computer interaction device, characterized in that: The device comprises: A display module, used for displaying interactive tasks during the playback of multimedia content, wherein the interactive tasks are tasks completed by changing the body state of the terminal; The display module is configured to respond to a state change operation on the state of the machine and update the display content corresponding to the interactive task based on the change of the state of the machine; The display module is used to display the redemption information of the viewing reward for watching the multimedia content when the interactive task is completed.

18. A computer device, characterized in that: The computer device comprises: a processor and a memory, wherein at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor to implement the terminal-based human-computer interaction method according to any one of claims 1 to 16.

19. A computer storage medium, characterized in that: At least one computer program is stored in the computer-readable storage medium, and the at least one computer program is loaded and executed by the processor to implement the terminal-based human-computer interaction method according to any one of claims 1 to 16.

20. A computer program product, characterized in that The computer program product includes a computer program, which is stored in a computer-readable storage medium; the computer program is read and executed from the computer-readable storage medium by a processor of a computer device, so that the computer device executes the terminal-based human-computer interaction method as described in any one of claims 1 to 16.

Images