Human-computer interaction method, device, equipment, medium and program product

Abstract

The embodiment of the invention provides a man-machine interaction method and device, equipment, a medium and a program product. The method comprises the steps that target media data are displayed in a target interface, and the target media data are currently played media data; in response to a starting operation of a target service, object motion information is determined according to device attitude data sent by an attitude data acquisition device, the target service comprises interaction configuration information, and the interaction configuration information represents candidate object motion information and a candidate interaction mode; and determining a target interaction mode according to the object motion information and the interaction configuration information, and executing an interaction operation on the target media data according to the target interaction mode. According to the embodiment of the invention, man-machine interaction is controlled based on different motion information of the object, the user is prevented from being in the same posture for a long time, and the user is guided to do proper motion and healthily and properly use the application program.

Description

TECHNICAL FIELD

[0001] Embodiments of the present disclosure relate to computer technology, and in particular, to a human-computer interaction method, device, apparatus, medium and program product. BACKGROUND

[0002] At present, with the development of computer and network technology, more and more users watch videos on video platforms. The video platform can be a video application and the like.

[0003] After the user terminal starts the video application, the user terminal can receive the video stream pushed by the transmission server and play any video in the video stream. During the video playing process, the user can realize video page turning by sliding the fingers up and down in the screen. However, in the above-mentioned solution, the user will maintain the same posture for a long time, which is easy to cause physical fatigue. SUMMARY

[0004] Embodiments of the present disclosure provide a human-computer interaction method, device, apparatus, medium and program product, which can enrich the human-computer interaction mode and avoid the user maintaining the same posture for a long time.

[0005] In a first aspect, the embodiments of the present disclosure provide a human-computer interaction method, comprising:

[0006] displaying target media data in a target interface, wherein the target media data is currently played media data;

[0007] in response to an opening operation of a target service, determining object motion information according to device posture data sent by a posture data acquisition device, wherein the target service comprises interaction configuration information, and the interaction configuration information represents candidate object motion information and candidate interaction mode;

[0008] determining a target interaction mode according to the object motion information and the interaction configuration information, and performing an interaction operation on the target media data according to the target interaction mode.

[0009] In a second aspect, the embodiments of the present disclosure further provide a human-computer interaction device, comprising:

[0010] a media data display module configured to display target media data in a target interface, wherein the target media data is currently played media data;

[0011] a motion determination module configured to, in response to an opening operation of a target service, determine object motion information according to device posture data sent by a posture data acquisition device, wherein the target service comprises interaction configuration information, and the interaction configuration information represents candidate object motion information and candidate interaction mode;

[0012] An interaction module is configured to determine a target interaction mode according to the object motion information and interaction configuration information, and perform an interaction operation on the target media data according to the target interaction mode.

[0013] In a third aspect, the embodiments of the present disclosure further provide an electronic device, which comprises:

[0014] one or more processors;

[0015] a storage device configured to store one or more programs,

[0016] When the one or more programs are executed by the one or more processors, the one or more processors implement the human-computer interaction method according to any of the embodiments of the present disclosure.

[0017] In a fourth aspect, the embodiments of the present disclosure further provide a storage medium containing computer executable instructions, which, when executed by a computer processor, are configured to perform the human-computer interaction method according to any of the embodiments of the present disclosure.

[0018] The embodiments of the present disclosure provide a human-computer interaction method, device, equipment, medium and program product. By responding to the opening operation of a target service, object motion information is determined according to device posture data sent by a posture data acquisition device, then a target interaction mode is determined according to the object motion information and interaction configuration information, and an interaction operation is performed on target media data according to the target interaction mode, so as to realize human-computer interaction control based on different motion information of an object, avoid a user staying in the same posture for a long time, and guide the user to make appropriate movements and use the application program in a healthy and moderate way. BRIEF DESCRIPTION OF DRAWINGS

[0019] The above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent as various embodiments of the present disclosure are disclosed in detail with reference to the drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals refer to the same or similar elements. It should be understood that the drawings are schematic, and the original and elements are not necessarily drawn according to the scale.

[0020] Figure 1 A flowchart of a human-computer interaction method provided by the embodiments of the present disclosure;

[0021] Figure 2 A schematic diagram of a target interface provided by the embodiments of the present disclosure;

[0022] Figure 3 A video flipping schematic diagram provided by the embodiments of the present disclosure;

[0023] Figure 4 A human-computer interaction system framework diagram provided by the embodiments of the present disclosure;

[0024] Figure 5 A flowchart of another human-computer interaction method provided by an embodiment of the present disclosure is shown in FIG. 6;

[0025] Figure 6 A schematic diagram of another target interface provided by an embodiment of the present disclosure is shown in FIG. 7;

[0026] Figure 7 A schematic diagram of another target interface provided by an embodiment of the present disclosure is shown in FIG. 8;

[0027] Figure 8 A structural schematic diagram of a human-computer interaction device provided by an embodiment of the present disclosure is shown in FIG. 9;

[0028] Figure 9 A structural schematic diagram of an electronic device provided by an embodiment of the present disclosure is shown in FIG. 10. DETAILED DESCRIPTION

[0029] Embodiments of the present disclosure will be described in more detail by referring to the drawings. Although certain embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be implemented in various forms, and should not be construed as being limited to the embodiments set forth herein, but rather, these embodiments are provided so as to more completely and thoroughly understand the present disclosure. It is understood that the drawings and embodiments of the present disclosure are for exemplary purposes only, and are not intended to limit the scope of protection of the present disclosure.

[0030] It is understood that each step described in the method embodiments of the present disclosure can be executed in different orders, and / or in parallel. In addition, the method embodiments can include additional steps and / or omit the execution of the steps shown. The scope of the present disclosure is not limited in this respect.

[0031] The term "comprising" and variations thereof as used herein are open-ended, that is, "comprising but not limited to." The term "based on" is "based, at least in part, on." The term "one embodiment" means "at least one embodiment." The term "another embodiment" means "at least one additional embodiment." The term "some embodiments" means "at least some embodiments." Related definitions are given below in the description of the application.

[0032] It is noted that the concepts of "first", "second", etc. mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not intended to limit the order or interdependence of the functions performed by these devices, modules or units.

[0033] It is noted that the modification of "one", "multiple" mentioned in the present disclosure is illustrative and not limiting, and those skilled in the art should understand that, unless otherwise explicitly indicated in the context, it should be understood as "one or more".

[0034] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0035] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0036] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application, server, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.

[0037] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0038] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0039] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0040] Figure 1 This is a flowchart illustrating a human-computer interaction method provided in an embodiment of this disclosure. This embodiment is applicable to scenarios where a user views media data, such as human-computer interaction achieved by changing the user's posture. The method can be executed by a human-computer interaction device, which can be implemented in software and / or hardware, optionally through an electronic device, such as a mobile terminal or a PC.

[0041] like Figure 1 As shown, the method includes:

[0042] S110. Display target media data in the target interface, wherein the target media data is the currently playing media data.

[0043] In this embodiment of the disclosure, the target interface represents the medium through which the user interacts with media data. For example, the target interface can be a user interface in a video application that displays target media data. The target media data is the media data currently playing in the target interface. Media data includes videos or images, etc.

[0044] Figure 2 This is a schematic diagram of a target interface provided in an embodiment of this disclosure. For example... Figure 2 As shown, the target interface 210 displays video 220 and progress bar 230, with the diagonal lines in the progress bar 230 indicating the playback progress of video 220.

[0045] S120. In response to the activation operation of the target service, determine the object motion information based on the device attitude data sent by the attitude data acquisition device, wherein the target service includes interaction configuration information, and the interaction configuration information represents the candidate object motion information and candidate interaction mode.

[0046] The target service represents a human-computer interaction service that relies on object motion information. It can be understood that the target service is initiated by the user, and the target user is fully aware of the object motion information required for the human-computer interaction service before initiating the service. For example, target services include services that switch videos via head movements and / or services that perform head interactions via target notifications. Switching videos is a video page-turning method, i.e., switching the currently playing video by turning the page. If the service of switching videos via head movements is activated, the object motion information is determined based on device posture data to control video switching accordingly. Target notifications are used to remind users to perform object movements. Object movements include head movements or arm movements, etc.

[0047] Device attitude data is collected by an attitude data acquisition device. In this embodiment, the device attitude data may include at least one of the following: device rotation rate, gravity vector, acceleration, magnetic field vector, heading angle, and sensor position, etc. The device attitude data can be used to determine the motion information of the object associated with the device. This object motion information includes head movement information or arm movement information, etc. For headphones or in-ear headphones, head movement information can be determined using headphone attitude data. For handheld user terminals, arm movement information can be determined using terminal attitude data, etc.

[0048] Attitude data acquisition devices can include headphones with integrated Inertial Measurement Units (IMUs). The IMU is typically integrated into the headphones to detect the headphones' attitude data after the user wears them. For example, pitch, yaw, and roll angles can be used to characterize the head's position and direction of movement. Pitch angle describes the head's rotation in the vertical plane, i.e., the angle of tilting up and down. A positive value indicates tilting up, and a negative value indicates tilting down. Yaw angle describes the head's rotation in the horizontal plane, i.e., the angle of turning left and right. A positive value indicates turning right, and a negative value indicates turning left. Roll angle describes the head's rotation in the forward and backward direction, i.e., the angle of head shaking. A positive value indicates head shaking forward, and a negative value indicates head shaking backward.

[0049] The posture data acquisition device may also include a gyroscope within the user terminal to detect the position and direction of arm movement after the user holds the terminal. For example, the position and direction of arm movement can be represented by translation along coordinate axes. Translation along the X-axis represents horizontal movement, translation along the Y-axis represents vertical movement, and translation along the Z-axis represents forward / backward movement.

[0050] Candidate object motion information and candidate interaction methods can be pre-configured to characterize the interaction methods corresponding to object motion. Candidate interaction methods include video page turning up, video page turning down, image page turning up, image page turning down, interaction progress updates, or displaying target effects. For example, interaction configuration information can include controlling video page turning by rotating the head in the vertical plane by a set angle. Specifically, turning the head up (i.e., looking up) by more than xx degrees executes video page turning up, and turning the head down (i.e., looking down) by less than cc degrees executes video page turning down. Interaction configuration information can also include updating the interaction progress by rotating the head in the vertical plane and / or in the forward / backward direction by a set angle. Specifically, turning the head to the left by 'aa' degrees confirms the completion of a specified action and updates the interaction progress of the progress bar control; turning the head back by 'ss' degrees confirms the completion of another specified action and updates the interaction progress of the progress bar control again.

[0051] For example, the target service is activated based on the click operation of the target control, the device posture data sent by the posture data acquisition device is obtained, and the object motion information is determined based on the device posture data.

[0052] Specifically, the target control is used to enable or disable the service of switching videos based on head movements. If the target control is clicked, the service of switching videos based on head movements is enabled. Device attitude data, such as rotation rate, gravity vector, acceleration, magnetic field vector, heading angle, and sensor position, is acquired through the target interface provided by the attitude data acquisition device. The head rotation angle and direction are then determined based on the device attitude data.

[0053] S130. Determine the target interaction method based on the object motion information and interaction configuration information, and perform an interaction operation on the target media data according to the target interaction method.

[0054] The target interaction method can include candidate interaction methods corresponding to candidate object motion information that match the object's motion information. That is, the object's motion information is matched with the candidate object motion information in the interaction configuration information, and the candidate interaction method corresponding to the matched candidate object motion information is taken as the target interaction method.

[0055] Interactive operations on target media data can include controlling video switching based on object motion information, or displaying target effects at corresponding positions in the video by completing guided actions.

[0056] For example, the object motion information is matched with candidate object motion information to obtain a target interaction method, wherein the object motion information includes the object rotation angle and the object rotation direction. The target media data is then switched according to the target interaction method.

[0057] For example, if an object moves vertically upwards from its starting position (i.e., looks up), the object's motion information is real-time changing data. While the object's motion information remains constant, it can be matched with candidate object motion information to determine the target interaction method. Assuming the matched candidate object motion information is looking up beyond a first angle, the corresponding target interaction method is video page turning upwards. If the current object's looking-up angle is less than the first angle, video page turning is not executed until the looking-up angle is greater than or equal to the first angle. If the head is detected returning to its starting position from the looking-up state, video page turning is not executed. If the looking-up angle is again greater than or equal to the first angle, video page turning is executed again. If the head is detected returning to its starting position from the looking-up state, video page turning is not executed. If the head is detected moving vertically downwards from its starting position (i.e., looking down), the object's motion information is matched with candidate object motion information to determine the target interaction method. Assuming the matched candidate object motion information is looking down no more than a second angle, the corresponding target interaction method is video page turning downwards. If the current head-down angle of the object's motion information is greater than the second angle, the video will not be turned down until the head-down angle is less than or equal to the second angle, at which point the video will be turned down. If the head is detected to return to the starting position from the head-down state, the video will not be turned down. If the head-down angle is detected to be less than or equal to the second angle again, the video will be turned down again.

[0058] Since users cannot directly observe their head movement information, the movement of a slider in a control bar can be used to represent head movement information on the target interface. Optionally, after determining the object's movement information based on the device attitude data sent by the attitude data acquisition device, the method further includes: displaying a movement information display control on the target interface. The movement information display control includes a control bar and a slider, and the slider reciprocates within the control bar according to the object's movement information. For example, the position and direction of the slider within the control bar can be adjusted in real time according to the head's rotation angle and rotation method, so that the slider reciprocates within the control bar. Specifically, a correspondence can be established between the range of pitch angles of head movement and the length of the control bar. Then, the object's movement information is determined based on the real-time acquired device attitude data, and the position and direction of the slider within the control bar are adjusted in real time according to the object's movement information. If the object's movement information represents the movement process of raising the head to xx degrees and then returning to its original position, the movement of the slider follows the head movement, moving upward from the center position of the control bar to the distance corresponding to the head-raising angle, and then returning to the center position of the control bar. If the object's motion information represents the motion process of lowering the head to cc degrees and then resetting, then the movement of the slider follows the head movement, moving downwards from the center position of the control bar to the distance corresponding to the head-up angle, and then returning to the center position of the control bar.

[0059] Figure 3 This is a schematic diagram of a video page-turning method provided in an embodiment of this disclosure. In the diagram, an arrow moving upwards and away from the center of the control bar indicates looking up, and an arrow moving downwards and closer to the center of the control bar indicates returning to its original position after looking up. Similarly, an arrow moving downwards and away from the center of the control bar indicates looking down, and an arrow moving upwards and closer to the center of the control bar indicates returning to its original position after looking down. Figure 3 As shown, the target interface 310 displays a first video 320 and a motion information display control 330, wherein the slider in the motion information display control 330 is located at the center of the control bar. If the object's motion information represents the motion process of raising the head to xx degrees and then returning to its original position, then when the head is raised to xx degrees, a video page-up operation is performed to display a second video 340 on the target interface 310. The slider moves following the head movement. The motion information display control 330 is displayed at the position corresponding to the first video 320, and the slider moves upward from the center of the control bar until it reaches the distance corresponding to the head raising angle. The motion information display control 330 is displayed at the position corresponding to the second video 340, and the slider moves upward from the distance corresponding to the head raising angle until it returns to the center of the control bar.

[0060] The current target interface 310 displays the first video 320. If the object's motion information represents the motion process of lowering the head to cc degrees and then returning to its original position, then when the head is lowered to cc degrees, a video page-down operation is performed to display the third video 350 on the target interface 310. The movement of the slider follows the head movement. A motion information display control 330 is displayed at the position corresponding to the first video 320. The slider moves downward from the center of the control bar until it reaches the distance corresponding to the head-down angle. A motion information display control 330 is displayed at the position corresponding to the third video 350. The slider moves upward from the distance corresponding to the head-down angle until it returns to the center of the control bar.

[0061] Figure 4 This is a framework diagram of a human-computer interaction system provided in an embodiment of this disclosure. Figure 4 As shown, the human-computer interaction system includes a physical layer 410, a data processing layer 420, a data layer 430, and an application layer 440. The physical layer 410 includes a posture data acquisition device, belonging to the headset end. The data processing layer 420, data layer 430, and application layer 440 form the client's logical layer. The data processing layer 420 includes a data parsing module. The data layer 430 includes device posture data. The application layer 440 includes an interaction module and an event detection module. The application layer 440 detects headset connection and disconnection events in real time. After the headset is connected, the data processing layer 420 receives head tracking data reported by the physical layer and parses the head tracking data to obtain device posture data. The device posture data is used to construct the data layer 430. The application layer 440 determines object motion information based on the device posture data and performs human-computer interaction according to the target interaction method corresponding to the object motion information.

[0062] Optionally, device posture data can also be acquired through a posture data acquisition device on the user terminal. For example, the phone's posture data can be acquired through the gyroscope on the phone, and the arm movement information can be determined based on the phone's posture data. Accordingly, the interactive configuration information can include moving the arm forward and backward along the z-axis to control video page turning, and moving forward by more than or equal to ff centimeters to control video page turning upward, and moving backward by less than or equal to bb centimeters to control video page turning downward.

[0063] The technical solution of this disclosure embodiment determines the object motion information based on the device posture data sent by the posture data acquisition device in response to the start operation of the target service. Then, it determines the target interaction mode based on the object motion information and interaction configuration information, and performs interactive operations on the target media data according to the target interaction mode. This realizes human-computer interaction control based on different motion information of the object, avoids the user from being in the same posture for a long time, and guides the user to perform appropriate exercise and use the application in a healthy and moderate manner.

[0064] Figure 5This is a flowchart illustrating another human-computer interaction method provided in this embodiment of the present disclosure. Based on the above embodiments, this embodiment of the present disclosure specifies that a target service is activated via a target reminder notification. For example... Figure 5 As shown, the method includes:

[0065] S510. Display target media data in the target interface, wherein the target media data is the currently playing media data.

[0066] S520. In response to the receipt event of the target reminder notification, start the target service and display the target reminder notification on the target interface, wherein the target reminder notification is used to remind the target to move.

[0067] The target reminder notification includes action guidance information and a progress bar control. The action guidance information includes at least one sub-action. The action guidance information may include specified actions beneficial to the cervical spine. For example, specified actions may include the movements prescribed in cervical spine exercises. The progress bar control is used to represent the user's progress on the specified actions in the action guidance information. Optionally, the progress bar control can be a control that displays the interactive progress in the target reminder notification. The target reminder notification can be in the form of a pop-up notification, displaying the target reminder notification content, guidance information, and progress bar control within the pop-up notification.

[0068] Optionally, the target alert notification represents a system notification message or a notification message sent by other user terminals within the same target group. For example, after the headset is connected, the user terminal can determine the difference in posture data by collecting headset posture data at different times. If the difference in posture data between adjacent collection times within a set time period is less than a set difference threshold, it is determined that the headset is in the same posture for a long time, and a target alert notification is generated. This target alert notification is a system notification message.

[0069] Alternatively, it can retrieve target notifications sent by other user terminals within the same target group. Accordingly, the user account and avatar corresponding to the user terminal that sent the target notification are displayed in the notification pop-up to identify the friend who sent the target notification. By having friends send notifications to each other, the frequency of interaction between friends is increased, raising the probability that users will respond to the target notifications.

[0070] Optionally, after receiving the target notification, the client displays the target notification in the corresponding location of the target media data on the target interface, so that the user can see the target notification intuitively. This increases the probability of the user responding to the target notification.

[0071] Figure 6 This is a schematic diagram of another target interface provided in an embodiment of this disclosure. Figure 6As shown, a target reminder notification 620 is displayed in the target interface 600 at the position corresponding to the target video 610. The target reminder notification 620 includes target reminder notification content 621, guidance information 622, progress bar control 623, user account 624, and user avatar 625, etc.

[0072] S530. Obtain device attitude data sent by the attitude data acquisition device, and determine the object motion information based on the device attitude data.

[0073] S540. Match the object motion information with the current sub-action to obtain the action matching degree.

[0074] Since motion guidance information may include more than one sub-action, users need to complete each sub-action one by one.

[0075] In this embodiment of the disclosure, the decomposed actions of motion guidance information are displayed through target reminder notifications, that is, the sub-actions of motion guidance information are displayed one by one, so that users can better complete the action. When the object motion information matches the current sub-action, it is considered that the user has completed the sub-action, the interaction progress can be updated, and the next sub-action can be displayed.

[0076] Alternatively, motion guidance information can be used to display each sub-action sequentially, and the interaction progress can be updated as the user completes a sub-action.

[0077] Action matching degree characterizes the consistency between the rotation direction of an object's motion information and the current sub-action. The rotation direction in the object's motion information is matched with the current sub-action; if the directions match, the action matching degree is determined to be 1; otherwise, it is determined to be 0.

[0078] S550. If the action matching degree is greater than the set matching threshold, the object motion information is matched with the candidate object motion information to obtain the target interaction method, and the next sub-action is displayed in the target reminder notification.

[0079] In this embodiment of the disclosure, the target interaction method may include the interaction method corresponding to the matching result between the object motion information and the candidate object motion information. If there is candidate object motion information that matches the object motion information, the target interaction method is determined to be an interaction progress update. If there is no candidate object motion information that matches the object motion information, the target interaction method is determined to be to abandon the interaction progress update.

[0080] When the action matching degree is less than the set matching threshold, it usually means that the rotation direction of the object's motion information is inconsistent with the current sub-action. In this case, it can be determined that the user has not completed the specified action, and there is no need to continue with the target interaction method. The current sub-action can be repeatedly displayed through a target reminder notification to guide the user to perform the correct action. Alternatively, an error message pop-up can be used to prompt the user that the rotation direction is incorrect, etc.

[0081] If the action matching degree is greater than the set matching threshold, it is determined that the rotation direction of the object's motion information is consistent with the current sub-action. The object's motion information can then continue to be matched with candidate object motion information in both rotation direction and rotation angle dimensions. The candidate interaction method corresponding to the matched candidate object motion information will then be used as the target interaction method. Specifically, the target interaction method can be an interaction progress update. If there is candidate object motion information that matches the object's motion information, the target interaction method is an interaction progress update. If there is no candidate object motion information that matches the object's motion information, the target interaction method is to abandon the interaction progress update.

[0082] Since the rotation direction of the determined object's motion information is consistent with the current sub-action, the next sub-action can be displayed through a target reminder notification.

[0083] Assuming the motion guidance information is that the head turns from left to right and then from right to left, this can be broken down into three sub-actions: the first sub-action is turning the head to the left, the second is turning the head to the right, and the third is turning the head to the left again. If the user completes the first sub-action through rotation direction matching, the target interaction method is determined based on the matching result between the object motion information corresponding to the first sub-action and the candidate object motion information. If the match is successful, the interaction progress of the progress bar control is updated. If the user completes the second sub-action through rotation direction matching, the target interaction method is determined based on the matching result between the object motion information corresponding to the second sub-action and the candidate object motion information. If the match is successful, the interaction progress of the progress bar control is updated again, and so on.

[0084] Optionally, if the action matching degree is greater than a set matching threshold, the object motion information is matched with the candidate object motion information to obtain the target interaction method.

[0085] Optionally, if the action matching degree is greater than a set matching threshold, the next sub-action is displayed in the target reminder notification.

[0086] S560. Update the interaction progress of the progress bar control in the target interface according to the target interaction method.

[0087] In this embodiment, the number of sub-actions included in the motion guidance information divides the interactive progress of the progress bar control into a corresponding number of sub-segments. Each time a sub-action is completed, and the target interaction method is interactive progress update, the number of sub-segments of the interactive progress of the progress bar control increases by one. It should be noted that if a sub-action is completed, and the target interaction method is to abandon interactive progress update, then updating the interactive progress of the progress bar control is abandoned. Similarly, if a sub-action is not completed, updating the interactive progress of the progress bar control is also abandoned.

[0088] Figure 7 This is a schematic diagram of yet another target interface provided in an embodiment of this disclosure. For example... Figure 7 As shown, the motion guidance information 710 is the head turning from left to right, then from right to back, and then from back to left. This motion guidance information can be decomposed into four sub-actions. Correspondingly, the interaction progress of the progress bar control 720 is divided into four sub-segments (represented by dashed lines), each representing 25%. If the object's motion information is a leftward head turn of z1 degrees, consistent with the rotation direction of the first sub-action, then the object's motion information is matched with candidate interaction methods in the interaction configuration information. If a candidate object's motion information is a leftward head turn of z1 degrees, then the target interaction method is determined to be a sub-segment with increasing interaction progress, i.e., the interaction progress of the progress bar control 720 is 25%. If the object's motion information is a rightward head turn of z2 degrees, consistent with the rotation direction of the second sub-action, then the object's motion information is matched with candidate interaction methods in the interaction configuration information. If a candidate object's motion information is a rightward head turn of z2 degrees, then the target interaction method is determined to be a sub-segment with increasing interaction progress, i.e., the interaction progress of the progress bar control 720 is 50%. If the object's motion information indicates a leftward head turn of z3 degrees, which is inconsistent with the rotation direction of the third sub-action in the motion guidance information, then the update of the progress bar control 720's interactive progress is abandoned, and the interactive progress is maintained at 50%. An error message notification 730 is displayed at the corresponding position in the target video to inform the user of the incorrect rotation direction.

[0089] S570. If the interaction progress meets the preset end condition, then turn off the target reminder notification and display the target special effect at the position corresponding to the target media data.

[0090] Target effects are image assets with specific effects rendered at the locations corresponding to target media data. Displaying target effects at the locations corresponding to target media data can incentivize users to respond to target reminder notifications, increasing their willingness to respond to target reminder notifications again, thereby preventing users from remaining in the same posture for extended periods.

[0091] The preset end condition is used to determine whether the user has completed the sub-actions included in the exercise guidance information. This can be determined by the status information of the interactive progress in the progress bar control. If the interactive progress in the progress bar control is 100%, it is determined that the user has completed the sub-actions included in the exercise guidance information, meaning the interactive progress meets the preset end condition.

[0092] For example, if the interaction progress is 100%, the notification pop-up corresponding to the target reminder notification is closed, and the target effect is displayed at the position corresponding to the target media data.

[0093] Optionally, if the interaction progress meets a preset end condition, the target reminder notification is turned off.

[0094] Optionally, if the interaction progress meets the preset end condition, the target effect is displayed at the position corresponding to the target media data.

[0095] The technical solution of this disclosure guides users to perform specified actions through target reminder notifications, displays the interaction progress at the corresponding position of the target media data, and displays target special effects when the interaction progress meets the preset end conditions. This achieves the goal of improving users' enthusiasm for responding to target reminder notifications through positive incentives, enriches the interaction methods, and avoids users from staying in the same posture for a long time.

[0096] Figure 8 This is a schematic diagram of a human-computer interaction device provided in an embodiment of the present disclosure. The device can be implemented in the form of software and / or hardware, and optionally, it can be implemented by an electronic device, such as a mobile terminal or a PC.

[0097] like Figure 8 As shown, the device includes: a media data display module 810, a motion determination module 820, and an interaction module 830.

[0098] The media data display module 810 is used to display target media data in the target interface, wherein the target media data is the currently playing media data;

[0099] The motion determination module 820 is used to determine the motion information of an object based on the device attitude data sent by the attitude data acquisition device in response to the start operation of the target service. The target service includes interaction configuration information, which represents the motion information of candidate objects and candidate interaction methods.

[0100] The interaction module 830 is used to determine the target interaction mode based on the object motion information and interaction configuration information, and to perform interactive operations on the target media data according to the target interaction mode.

[0101] Optionally, the motion determination module 820 is specifically used for:

[0102] The target service is activated based on the click operation of the target control, the device attitude data sent by the attitude data acquisition device is obtained, and the object motion information is determined based on the device attitude data.

[0103] Optionally, it also includes:

[0104] The motion information display module is used to display a motion information display control on the target interface after determining the object's motion information based on the device attitude data sent by the attitude data acquisition device. The motion information display control includes a control bar and a slider, and the slider moves back and forth within the control bar according to the object's motion information.

[0105] Optionally, the interaction module 830 is specifically used for:

[0106] The target interaction method is obtained by matching the object motion information with the candidate object motion information, wherein the object motion information includes the object rotation angle and the object rotation direction;

[0107] The target media data is switched according to the target interaction method.

[0108] Optionally, the motion determination module 820 is specifically used for:

[0109] In response to the receipt of a target reminder notification, the target service is started, and the target reminder notification is displayed on the target interface, wherein the target reminder notification is used to remind the target to move;

[0110] The device attitude data sent by the attitude data acquisition device is acquired, and the motion information of the object is determined based on the device attitude data.

[0111] Optionally, the target reminder notification includes motion guidance information and a progress bar control, wherein the motion guidance information includes at least one sub-action.

[0112] Optionally, the interaction module 830 is specifically used for:

[0113] The motion information of the object is matched with the current sub-action to obtain the motion matching degree;

[0114] If the action matching degree is greater than the set matching threshold, the object motion information is matched with the candidate object motion information to obtain the target interaction method, and / or, the next sub-action is displayed in the target reminder notification.

[0115] Optionally, the interaction module 830 is also specifically used for:

[0116] Update the interaction progress of the progress bar control in the target interface according to the target interaction method;

[0117] If the interaction progress meets the preset end condition, then the target reminder notification is turned off, and / or the target effect is displayed at the position corresponding to the target media data.

[0118] Optionally, the target reminder notification represents a system notification message, or a notification message sent by other user terminals within the same target group.

[0119] The human-computer interaction device provided in this disclosure can execute the human-computer interaction method provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects of executing the method.

[0120] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the protection scope of the embodiments of this disclosure.

[0121] Figure 9 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Reference is made below. Figure 9 It illustrates an electronic device suitable for implementing embodiments of the present disclosure (e.g., Figure 9 The diagram below shows the structure of the terminal device 900. The terminal device in this embodiment may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. Figure 9 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0122] like Figure 9 As shown, the electronic device 900 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 into a random access memory (RAM) 903. The RAM 903 also stores various programs and data required for the operation of the electronic device 900. The processing unit 901, ROM 902, and RAM 903 are interconnected via a bus 904. An edit / output (I / O) interface 905 is also connected to the bus 904.

[0123] Typically, the following devices can be connected to I / O interface 905: input devices 906 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 907 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 908 including, for example, magnetic tapes, hard disks, etc.; and communication devices 909. Communication device 909 allows electronic device 900 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 9 An electronic device 900 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0124] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 909, or installed from a storage device 908, or installed from a ROM 902. When the computer program is executed by a processing device 901, it performs the functions defined in the methods of embodiments of this disclosure.

[0125] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0126] The electronic device provided in this embodiment and the human-computer interaction method provided in the above embodiments belong to the same inventive concept. Technical details not described in detail in this embodiment can be found in the above embodiments, and this embodiment has the same beneficial effects as the above embodiments.

[0127] This disclosure provides a computer storage medium storing a computer program that, when executed by a processor, implements the human-computer interaction method provided in the above embodiments.

[0128] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0129] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0130] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0131] The aforementioned computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to:

[0132] The target media data is displayed on the target interface, wherein the target media data is the currently playing media data;

[0133] In response to the activation operation of the target service, the motion information of the object is determined based on the device attitude data sent by the attitude data acquisition device. The target service includes interaction configuration information, which represents the motion information of the candidate object and the candidate interaction method.

[0134] The target interaction method is determined based on the object motion information and interaction configuration information, and the interaction operation is performed on the target media data according to the target interaction method.

[0135] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0136] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0137] The units described in the embodiments of this disclosure can be implemented in software or hardware. The names of the units are not, in some cases, intended to limit the specific unit.

[0138] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0139] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0140] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0141] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0142] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A human-computer interaction method, characterized in that, include: The target media data is displayed on the target interface, wherein the target media data is the currently playing media data; In response to the activation operation of the target service, the motion information of the object is determined based on the device attitude data sent by the attitude data acquisition device. The target service includes interaction configuration information, which represents the motion information of the candidate object and the candidate interaction method. The target interaction method is determined based on the object motion information and interaction configuration information, and the interaction operation is performed on the target media data according to the target interaction method.

2. The method according to claim 1, characterized in that, The response to the activation operation of the target service, determining the object motion information based on the device attitude data sent by the attitude data acquisition device, includes: The target service is activated based on the click operation of the target control, the device attitude data sent by the attitude data acquisition device is obtained, and the object motion information is determined based on the device attitude data.

3. The method according to claim 1, characterized in that, After determining the object's motion information based on the device attitude data sent by the attitude data acquisition device, the process also includes: A motion information display control is displayed on the target interface. The motion information display control includes a control bar and a slider. The slider moves back and forth within the control bar according to the motion information of the object.

4. The method according to claim 1, characterized in that, The step of determining the target interaction method based on the object motion information and interaction configuration information, and performing interactive operations on the target media data according to the target interaction method, includes: The target interaction method is obtained by matching the object motion information with the candidate object motion information, wherein the object motion information includes the object rotation angle and the object rotation direction; The target media data is switched according to the target interaction method.

5. The method according to claim 1, characterized in that, The response to the activation operation of the target service, determining the object motion information based on the device attitude data sent by the attitude data acquisition device, includes: In response to the receipt of a target reminder notification, the target service is started, and the target reminder notification is displayed on the target interface, wherein the target reminder notification is used to remind the target to move; The device attitude data sent by the attitude data acquisition device is acquired, and the motion information of the object is determined based on the device attitude data.

6. The method according to claim 5, characterized in that, The target reminder notification includes motion guidance information and a progress bar control, and the motion guidance information includes at least one sub-action.

7. The method according to claim 6, characterized in that, Determining the target interaction method based on the object motion information and interaction configuration information includes: The motion information of the object is matched with the current sub-action to obtain the motion matching degree; If the action matching degree is greater than the set matching threshold, the object motion information is matched with the candidate object motion information to obtain the target interaction method, and / or, the next sub-action is displayed in the target reminder notification.

8. The method according to claim 6, characterized in that, The step of performing interactive operations on the target media data according to the target interaction method includes: Update the interaction progress of the progress bar control in the target interface according to the target interaction method; If the interaction progress meets the preset end condition, then the target reminder notification is turned off, and / or the target effect is displayed at the position corresponding to the target media data.

9. The method according to claim 5, characterized in that, The target reminder notification represents a system notification message, or a notification message sent by other user terminals within the same target group.

10. A human-computer interaction device, characterized in that, include: The media data display module is used to display target media data in the target interface, wherein the target media data is the currently playing media data; The motion determination module is used to determine the motion information of an object in response to the activation operation of a target service, based on the device attitude data sent by the attitude data acquisition device. The target service includes interaction configuration information, which represents the motion information of candidate objects and candidate interaction methods. The interaction module is used to determine the target interaction method based on the object motion information and interaction configuration information, and to perform interactive operations on the target media data according to the target interaction method.

11. An electronic device, characterized in that, The electronic device includes: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the human-computer interaction method as described in any one of claims 1-9.

12. A storage medium containing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a computer processor, are used to perform the human-computer interaction method as described in any one of claims 1-9.

13. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the human-computer interaction method as described in any one of claims 1-9.

Images