Video-based interaction method and device, equipment and storage medium

By collecting and comparing sensor data, the user's status is automatically judged and the switching prompt is displayed on the video playback page, which solves the problem that users cannot automatically switch to the listening video mode in a specific state, and achieves diversified satisfaction of video functions and improved user experience.

CN119906845APending Publication Date: 2025-04-29BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202311416718.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-10-27
Publication Date
2025-04-29

AI Technical Summary

Technical Problem

How to meet users' diverse needs for video-related functions, especially when users browse videos in specific states such as walking, how to automatically switch to the listening video mode to meet users' diverse needs.

Method used

By collecting sensor data (such as accelerator, gyroscope, etc.) and comparing them, determine whether the target comparison result of the preset occurrence number condition is met based on the comparison results within the preset period. If it matches, the play mode switching prompt message is displayed on the video playback page, prompting the user to switch to the preset video listening mode.

Benefits of technology

It is realized that when the sensor data comparison result that meets the occurrence number conditions within the preset period includes the target comparison result, the playback mode switching prompt information is automatically displayed, reminding the user to switch to the listening video mode, thereby playing video in the audio playback mode, meeting the user's diverse needs for video-related functions and improving user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119906845A_ABST
    Figure CN119906845A_ABST
Patent Text Reader

Abstract

The invention provides a video-based interaction method and device, equipment and a storage medium, and the method comprises the steps: determining whether the comparison results of sensor data meeting a preset occurrence frequency condition in a preset period comprise a target comparison result or not according to the comparison results of the collected sensor data in the preset period; if yes, displaying playing mode switching prompt information on the video playing page; the playing mode switching prompt information is used for prompting to switch to the preset video listening mode. By acquiring the sensor data and comparing the sensor data, when it is determined that the comparison result of the sensor data meeting the occurrence frequency condition in the preset period comprises the target comparison result, the playing mode switching prompt information can be displayed to remind a user to switch to a video listening mode, and the user experience is improved. Therefore, the video corresponding to the video playing page is played in the audio playing mode, the diversified requirements of the user for the related functions of the video are further met, and the user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of data processing, and in particular to a video-based interaction method, device, equipment and storage medium. Background Art

[0002] At present, with the development of video technology, more and more users are spending their time by playing videos. As a result, users' demands for video-related functions are becoming more and more diversified.

[0003] Therefore, how to meet users' diverse demands for video-related functions has become a technical problem that needs to be solved urgently. Summary of the invention

[0004] In order to solve the above technical problems, the embodiments of the present disclosure provide a video-based interaction method.

[0005] In a first aspect, the present disclosure provides a video-based interaction method, the method comprising:

[0006] Determining, based on the comparison results of the collected sensor data within a preset period, whether the comparison results of the sensor data that meet the preset number of occurrence conditions within the preset period include the target comparison results;

[0007] If it is determined that the comparison result of the sensor data that meets the preset number of occurrences within the preset period includes the target comparison result, a playback mode switching prompt message is displayed on the video playback page; wherein the playback mode switching prompt message is used to prompt switching to a preset audio and video mode, and the preset audio and video mode is used to play the video corresponding to the video playback page in audio playback mode.

[0008] In an optional implementation, the determining, based on the comparison results of the collected sensor data within a preset period, whether the comparison results of the sensor data that meet the preset number of occurrence conditions within the preset period include the target comparison result includes:

[0009] In response to a preset trigger operation on the video playback page, a preset sensor data comparison module is started; wherein the preset sensor data comparison module is used to compare the collected sensor data according to a preset frequency;

[0010] According to the comparison result of the preset sensor data comparison module within the preset period, it is determined whether the comparison result of the sensor data that meets the preset occurrence number condition within the preset period includes the target comparison result.

[0011] In an optional implementation, determining whether the comparison results of the sensor data meeting the preset number of occurrence conditions within the preset period include the target comparison results according to the comparison results of the preset sensor data comparison module within the preset period includes:

[0012] Upon receiving a callback event of the preset sensor data comparison module, determining whether a preset period has ended;

[0013] If it is determined that the preset period ends, determining a comparison result of sensor data that meets a preset number of occurrence conditions within the preset period;

[0014] It is determined whether the comparison results of the sensor data that meet the preset number of occurrence conditions within the preset period include a target comparison result.

[0015] In an optional implementation, when receiving the callback event of the preset sensor data comparison module, determining whether the preset period has ended includes:

[0016] Upon receiving a callback event from the preset sensor data comparison module, determining a time difference between the current system time and the first callback time of the preset period;

[0017] Determine whether the time difference is not less than a preset time threshold.

[0018] In an optional implementation, when receiving the callback event of the preset sensor data comparison module, determining whether the preset period has ended includes:

[0019] When receiving a callback event of the preset sensor data comparison module, determining the number of times information corresponding to the callback event;

[0020] Determine whether the number of times information is not less than a preset number of times threshold.

[0021] In an optional implementation, if it is determined that the preset period ends, determining the comparison result of the sensor data that meets the preset number of occurrence conditions within the preset period includes:

[0022] If it is determined that the preset period is over, a preset query instruction is sent to the preset sensor data comparison module; wherein the preset query instruction is used to instruct to query the comparison result of the sensor data that meets the preset number of occurrence conditions within the preset period;

[0023] The comparison result of the sensor data that meets the preset number of occurrence conditions within the preset period is received and returned by the preset sensor data comparison module.

[0024] In an optional implementation manner, before displaying the playback mode switching prompt information on the video playback page, the method further includes:

[0025] Based on a preset display frequency control condition, determining whether to display the playback mode switching prompt information; wherein the preset display frequency control condition is used to control the display frequency of the playback mode switching prompt information;

[0026] Correspondingly, if it is determined that the comparison result of the sensor data that meets the preset number of occurrence conditions within the preset period includes the target comparison result, displaying the playback mode switching prompt information on the video playback page includes:

[0027] If it is determined that the comparison result of the sensor data that meets the preset number of occurrences within the preset period includes the target comparison result, and it is determined based on the preset display frequency control condition that the playback mode switching prompt information can be displayed, the playback mode switching prompt information is displayed on the video playback page.

[0028] In an optional implementation manner, after displaying the playback mode switching prompt information on the video playback page, the method further includes:

[0029] A stop instruction is sent to the preset sensor data comparison module; wherein the stop instruction is used to instruct to stop collecting and comparing sensor data.

[0030] In an optional implementation, in response to a preset trigger operation on a video playback page, starting a preset sensor data comparison module includes:

[0031] In response to a display triggering operation on a video playback page, a preset sensor data comparison module is started; wherein the video playback page is used to support video playback based on a media information stream.

[0032] In a second aspect, the present disclosure provides a video-based interaction device, the device comprising:

[0033] A first determination module, configured to determine, based on the comparison results of the collected sensor data within a preset period, whether the comparison results of the sensor data meeting a preset number of occurrence conditions within the preset period include a target comparison result;

[0034] The first display module is used to display a playback mode switching prompt message on the video playback page if it is determined that the comparison result of the sensor data that meets the preset number of occurrences within the preset period includes the target comparison result; wherein the playback mode switching prompt message is used to prompt switching to a preset audio-visual mode, and the preset audio-visual mode is used to play the video corresponding to the video playback page in audio playback mode.

[0035] In a third aspect, the present disclosure provides a computer-readable storage medium, wherein the computer-readable storage medium stores instructions, and when the instructions are executed on a terminal device, the terminal device implements the above method.

[0036] In a fourth aspect, the present disclosure provides a video-based interactive device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above method when executing the computer program.

[0037] In a fifth aspect, the present disclosure provides a computer program product, wherein the computer program product comprises a computer program / instructions, and the computer program / instructions implement the above method when executed by a processor.

[0038] Compared with the prior art, the technical solution provided by the embodiments of the present disclosure has at least the following advantages:

[0039] The disclosed embodiment provides a video-based interaction method. First, based on the comparison results of the collected sensor data within a preset period, it is determined whether the comparison results of the sensor data that meet the preset number of occurrence conditions within the preset period include the target comparison results. If it is determined that the comparison results of the sensor data that meet the preset number of occurrence conditions within the preset period include the target comparison results, a playback mode switching prompt information is displayed on the video playback page, wherein the playback mode switching prompt information is used to prompt switching to a preset audio-video mode, and the preset audio-video mode is used to play the video corresponding to the video playback page in an audio playback mode.

[0040] It can be seen that the embodiment of the present disclosure collects sensor data and compares the sensor data. When it is determined that the comparison result of the sensor data that meets the number of occurrence conditions within a preset period includes the target comparison result, it can display a playback mode switching prompt message to remind the user to switch to the video listening mode, thereby playing the video corresponding to the video playback page in the audio playback mode, further meeting the user's diverse needs for video-related functions and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0042] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0043] Figure 1A A flowchart of a video-based interaction method provided in an embodiment of the present disclosure;

[0044] Figure 1B A flowchart of another video-based interaction method provided by an embodiment of the present disclosure;

[0045] Figure 2 A schematic diagram of a video playback page provided in an embodiment of the present disclosure;

[0046] Figure 3 A schematic diagram of another video playback page provided in an embodiment of the present disclosure;

[0047] Figure 4 A schematic diagram of a processing flow of a video-based interaction method provided in an embodiment of the present disclosure;

[0048] Figure 5 A schematic diagram of the structure of a video-based interactive device provided in an embodiment of the present disclosure;

[0049] Figure 6 A schematic diagram of the structure of a video-based interactive device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0050] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0051] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0052] At present, with the development of video technology, more and more users spend their time by playing videos, and as a result, users' demands for video-related functions are becoming more and more diverse. Therefore, how to meet users' diverse demands for video-related functions has become a technical problem that needs to be solved urgently.

[0053] For example, in a scenario where a user browses a video while walking, although there is a listening mode, it needs to be switched to the listening mode based on a user trigger. However, most users do not know that they can continue to listen to videos after the phone turns off the screen.

[0054] To this end, the embodiment of the present disclosure provides a video-based interaction method. First, based on the comparison results of the collected sensor data within a preset period, it is determined whether the comparison results of the sensor data that meet the preset number of occurrence conditions within the preset period include the target comparison results. If it is determined that the comparison results of the sensor data that meet the preset number of occurrence conditions within the preset period include the target comparison results, a playback mode switching prompt information is displayed on the video playback page; wherein the playback mode switching prompt information is used to prompt switching to a preset audio-video mode, and the preset audio-video mode is used to play the video corresponding to the video playback page in an audio playback mode.

[0055] It can be seen that the embodiment of the present disclosure collects sensor data and compares the sensor data. When it is determined that the comparison result of the sensor data that meets the number of occurrence conditions within a preset period includes the target comparison result, it can display a playback mode switching prompt message to remind the user to switch to the video listening mode, thereby playing the video corresponding to the video playback page in the audio playback mode, further meeting the user's diverse needs for video-related functions and improving the user experience.

[0056] Based on this, the present disclosure provides a video-based interaction method. Figure 1A , is a flow chart of a video-based interaction method provided by an embodiment of the present disclosure, the method specifically comprising:

[0057] S101a: Determine, based on the comparison results of the collected sensor data within a preset period, whether the comparison results of the sensor data that meet a preset number of occurrence conditions within the preset period include a target comparison result.

[0058] The video-based interaction method provided by the embodiments of the present disclosure may be applied to a client, for example, the client may include a client deployed on a smart phone, a client deployed on a tablet computer, etc.

[0059] The preset occurrence condition may specifically be the comparison result of sensor data that appears more than the preset occurrence number within a preset period; or the comparison result of sensor data that appears the most times within the preset period.

[0060] In the disclosed embodiment, the preset period is a pre-set period, which can be a period obtained from the server during the startup of the application. It is worth noting that the disclosed embodiment determines once according to the duration of a period whether there is a target comparison result determined based on the sensor data.

[0061] In actual applications, the sensor data is collected in real time using sensors such as the accelerometer, gyroscope, and linear accelerator of the current device, and the collected sensor data is compared at a preset frequency to obtain a comparison result. Specifically, the object activity reflected by the sensor data can be determined by comparing the sensor data, that is, the corresponding object activity is reflected by the comparison result of the sensor data.

[0062] In the disclosed embodiment, a target comparison result is preset to characterize the target object activity reflected by the target sensor data.

[0063] In practical applications, for multiple comparison results of sensor data within a preset period, comparison results of sensor data that meet a preset number of occurrence conditions are determined, and then it is further determined whether these comparison results include a target comparison result.

[0064] For example, assuming that the preset period is 30 seconds, the collected sensor data is compared once every 2 seconds within the preset period to obtain a comparison result. It can be understood that 15 comparison results can be obtained within the preset period. Further, the comparison result with the most occurrences among the 15 comparison results is determined, and then it is determined whether the comparison result with the most occurrences is the target comparison result.

[0065] S102a: If it is determined that the comparison result of the sensor data that meets the preset number of occurrences within the preset period includes the target comparison result, displaying a playback mode switching prompt message on the video playback page.

[0066] The playback mode switching prompt information is used to prompt switching to a preset audio-visual mode, and the preset audio-visual mode is used to play the video corresponding to the video playback page in an audio playback mode.

[0067] In the disclosed embodiment, the playback mode switching prompt information is used to prompt the player to switch from the current video playback mode to the preset audio-video mode, wherein the preset audio-video mode includes playing the video corresponding to the video playback page based on the audio playback mode. Switching to the preset audio-video mode can be achieved by triggering the playback mode switching prompt information.

[0068] In an optional implementation, if it is determined that the comparison results of sensor data that meet the preset number of occurrences within a preset period include target comparison results, a playback mode switching prompt message is displayed on the video playback page; if it is determined that the comparison results of sensor data that meet the preset number of occurrences within the preset period do not include target comparison results, step S101a is continued to trigger a new round of comparison of sensor data and determination of target comparison results.

[0069] The disclosed embodiment collects and compares sensor data, and when it is determined that the comparison result of sensor data that meets the number of occurrence conditions within a preset period includes a target comparison result, it can display a playback mode switching prompt message to remind the user to switch to the video listening mode, thereby playing the video corresponding to the video playback page in the audio playback mode, further meeting the user's diverse needs for video-related functions and improving the user experience.

[0070] In order to facilitate understanding of the above content, the present disclosure embodiment provides a specific application scenario of the video-based interaction method. Figure 1B , is a flowchart of another video-based interaction method provided by an embodiment of the present disclosure, the method specifically comprising:

[0071] S101b: In response to a preset trigger operation on the video playback page, start a preset sensor data comparison module.

[0072] The preset sensor data comparison module is used to compare the collected sensor data at a preset frequency.

[0073] In the disclosed embodiment, the video playback page is used to play videos, and may be a page for playing videos based on any multimedia information stream.

[0074] In an embodiment of the present disclosure, when a preset trigger operation for a video playback page is received, a preset sensor data comparison module is started, wherein the preset trigger operation for the video playback page may include a display trigger operation for the video playback page, that is, an operation for triggering the display of the video playback page, such as an operation for opening the video playback page, specifically an operation for triggering a jump from another page to the video playback page, or an operation for starting the video playback page for the first time, etc.

[0075] In addition, the preset trigger operation for the video playback page can also include preset trigger operations on the video playback page, which can be interactive operations such as single-click, double-click, and long press, which are used to trigger the start of the preset sensor data comparison module; it can also be used to trigger the start control on the video playback page to trigger the start of the preset sensor data comparison module, and so on.

[0076] The preset sensor data comparison module refers to classifying the object activity into predefined object activity categories based on the sensor data collected by the accelerometer, gyroscope, and linear accelerometer, wherein the preset sensor data comparison module may include any module with a sensor data comparison function, and may specifically determine the corresponding object activity based on the collected sensor data comparison, for example, it may include object activities such as walking, lying, riding, and standing still. After the preset sensor data comparison module is started, it compares the collected sensor data at a preset frequency, wherein the preset frequency may be determined based on system properties, for example, if the preset sensor data comparison module is deployed in an Android system, the preset frequency may be set to 1s, and if the preset sensor data comparison module is deployed in an IOS system, the preset frequency may be set to 2s.

[0077] In an optional implementation, when a display trigger operation for a video playback page is received, a preset sensor data comparison module is started, wherein the video playback page is used to support video playback based on a media information stream.

[0078] Among them, the display trigger operation for the video playback page is used to trigger the display operation of the video playback page, such as opening the video playback page, specifically triggering the operation of jumping from another page to the video playback page, or starting the video playback page for the first time.

[0079] S102b: Determine, based on the comparison result of the preset sensor data comparison module within a preset period, whether the comparison result of the sensor data meeting the preset occurrence number condition within the preset period includes a target comparison result.

[0080] In the disclosed embodiment, the preset period is a pre-set period, which can be a period obtained from the server during the startup of the application. It is worth noting that the disclosed embodiment determines once according to the duration of a period whether there is a target comparison result determined based on the sensor data.

[0081] The preset sensor data comparison module compares the collected sensor data at a preset frequency within a preset period. For example, if the preset period is 30 seconds, it is determined within the duration of 30 seconds whether the comparison result of the sensor data that meets the preset number of occurrence conditions includes the target comparison result.

[0082] The comparison result of the preset sensor data comparison module includes the comparison result obtained by comparing the collected sensor data at a preset frequency within a preset period, which can reflect the corresponding object activity. In other words, a preset period includes multiple comparison results, and the multiple comparison results refer to multiple comparison results obtained at a preset frequency. Based on the multiple comparison results, it is determined whether the comparison results of the sensor data that meet the preset number of occurrence conditions within the preset period include the target comparison result.

[0083] Among them, the preset occurrence number condition can specifically be the comparison result of sensor data that appears more than the preset occurrence number within a preset period. For example, the preset occurrence number condition is the comparison result that appears more than 5 times within a preset period. Assuming that the target comparison result is used to reflect the object activity of walking, if it is determined that the object activity reflected by the comparison result with a number of occurrences greater than 5 times within a preset period is the object activity of "walking", then it is determined that the comparison result of the sensor data that meets the preset occurrence number condition in the preset period includes the target comparison result.

[0084] The preset occurrence condition can also be the comparison result that appears the most times within a preset period. For example, assuming that the object activity reflected by the target comparison result is walking, if a comparison result that appears the most times within a preset period is determined to be a comparison result reflecting the object activity of "walking", then the comparison result that appears the most times within the preset period is determined to include the target comparison result.

[0085] In an optional implementation, when a callback event of a preset sensor data comparison module is received, it is determined whether the preset period has ended. If it is determined that the preset period has ended, the comparison result of the sensor data that meets the preset number of occurrence conditions within the preset period is determined, and then, it is determined whether the comparison result of the sensor data that meets the preset number of occurrence conditions within the preset period includes the target comparison result.

[0086] The callback event of the preset sensor data comparison module is used to determine whether the preset period has ended, that is, whether the preset period has ended is determined by the callback event.

[0087] In practical applications, whether the preset period has ended can be determined by recording the time, calculating the time difference, and judging the size of the time difference and the preset period.

[0088] In an optional implementation, when a callback event of a preset sensor data comparison module is received, a time difference between the current system time and the first callback time of a preset period is determined to determine whether the time difference is not less than a preset time threshold.

[0089] The preset time threshold may be a preset period.

[0090] For example, assuming that the first callback time of the preset period is 14:00:00, the current system time is 14:00:20, and the time difference between the two is 20s. If the time difference is less than the preset time threshold, it means that the preset period has not ended. If the time difference is greater than or equal to the preset time threshold, it means that the preset period has ended.

[0091] In addition, within the preset period, the number of times the preset sensor data comparison module compares the sensor data at the preset frequency is calculable, that is, the preset number threshold. Therefore, it is also possible to determine whether the preset period has ended by recording the number and judging whether the cumulative number reaches the preset number threshold.

[0092] In another optional implementation, when a callback event of a preset sensor data comparison module is received, the number of times information corresponding to the callback event is determined to determine whether the number of times information is not less than a preset number threshold.

[0093] Each time a callback event occurs, a comparison result is generated, and the preset number threshold is the number of comparison results obtained by the preset sensor data comparison module within a preset period at a preset frequency.

[0094] For example, the preset frequency is once every 2 seconds, the preset period is 30 seconds, and the preset number threshold is 15 times. If the number of times corresponding to the callback event is less than the preset number threshold, it means that the preset period has not ended. If the number of times corresponding to the callback event is greater than or equal to the preset number threshold, it means that the preset period has ended.

[0095] In the embodiment of the present disclosure, after determining that the preset period has ended, it is necessary to determine the comparison result of the sensor data that meets the preset number of occurrence conditions within the preset period to further determine the target comparison result.

[0096] Specifically, after determining that the preset period has ended, a preset query instruction is sent to the preset sensor data comparison module, wherein the preset query instruction is used to indicate a comparison result of the sensor data that meets the preset number of occurrence conditions within the preset period based on a preset number threshold, and then the comparison result of the sensor data that meets the preset number of occurrence conditions within the preset period returned by the preset sensor data comparison module is received.

[0097] Based on the received comparison results, it is determined whether the comparison results that meet the preset occurrence number condition within the preset period include the target comparison result.

[0098] S103b: If it is determined that the comparison result of the sensor data that meets the preset number of occurrences within the preset period includes the target comparison result, displaying a playback mode switching prompt message on the video playback page.

[0099] The playback mode switching prompt information is used to prompt switching to a preset audio-visual mode, and the preset audio-visual mode is used to play the video corresponding to the video playback page in an audio playback mode.

[0100] In the disclosed embodiment, the playback mode switching prompt information is used to prompt the player to switch from the current video playback mode to the preset audio-video mode, wherein the preset audio-video mode includes playing the video corresponding to the video playback page based on the audio playback mode. Switching to the preset audio-video mode can be achieved by triggering the playback mode switching prompt information.

[0101] In the embodiment of the present disclosure, the embodiment of the present disclosure does not impose any restrictions on the display method and display position of the playback mode switching prompt information on the video playback page.

[0102] In addition, based on displaying the playback mode switching prompt information on the video playback page, a switching control can also be displayed on the video playback page, and the current video playback mode can be switched to a preset video listening mode by triggering the switching control.

[0103] In actual applications, when the playback mode switching prompt information is displayed on the video playback page, a close control may also be displayed on the video playback page to close the playback mode switching prompt information.

[0104] like Figure 2 , which is a schematic diagram of a video playback page provided by an embodiment of the present disclosure. The video playback page displays a playback mode switching prompt message 201, a switching control 202, and a closing control 203.

[0105] like Figure 3 As shown in FIG. 1 , another schematic diagram of a video playback page provided by an embodiment of the present disclosure is shown. When a trigger operation of a switching control on the video playback page is received, the current video playback mode is switched to a preset video listening mode, such as Figure 3 As shown, a half-screen panel is pulled out in the listening and video mode, and prompt information 301 is displayed on the half-screen panel to prompt the user that the user has entered the listening and video mode.

[0106] In the video-based interaction method provided by the embodiment of the present disclosure, first, based on the comparison results of the collected sensor data within a preset period, it is determined whether the comparison results of the sensor data that meet the preset number of occurrence conditions within the preset period include the target comparison results. If it is determined that the comparison results of the sensor data that meet the preset number of occurrence conditions within the preset period include the target comparison results, a playback mode switching prompt information is displayed on the video playback page; wherein the playback mode switching prompt information is used to prompt switching to a preset audio-video mode, and the preset audio-video mode is used to play the video corresponding to the video playback page in an audio playback mode.

[0107] It can be seen that the embodiment of the present disclosure collects sensor data and compares the sensor data. When it is determined that the comparison result of the sensor data that meets the number of occurrence conditions within a preset period includes the target comparison result, it can display a playback mode switching prompt message to remind the user to switch to the video listening mode, thereby playing the video corresponding to the video playback page in the audio playback mode, further meeting the user's diverse needs for video-related functions and improving the user experience.

[0108] In actual applications, before displaying the playback mode switching prompt information on the video playback page, a preset display frequency control condition can also be set, that is, whether to display the playback mode switching prompt information is determined by the preset display frequency control condition. When the preset display frequency control condition is met, the playback mode switching prompt information is displayed, and when the preset display frequency control condition is not met, the playback mode switching prompt information is displayed. For example, the preset display frequency control condition can be that the playback mode switching prompt information is displayed once every 72 hours, or once every 24 hours.

[0109] Specifically, based on a preset display frequency control condition, it is determined whether to display the playback mode switching prompt information, wherein the preset display frequency control condition is used to control the display frequency of the playback mode switching prompt information.

[0110] On the basis of the above embodiment, when the comparison result of the sensor data that meets the preset number of occurrence conditions within the preset period includes the target comparison result, and it is determined based on the preset display frequency control conditions that the playback mode switching prompt information can be displayed, the playback mode switching prompt information is displayed on the video playback page.

[0111] The display frequency of the playback mode switching prompt information is controlled by presetting the display frequency control conditions to reduce the impact of blocking the playback page and further improve the user experience.

[0112] In addition, other display conditions can be set, such as whether other prompt information is being displayed on the current video playback page. When the display condition that no other prompt information is being displayed on the current video playback page is met, the playback mode switching prompt information is displayed on the video playback page. When all display conditions are met, the playback mode switching prompt information is displayed on the video playback page.

[0113] In actual applications, after the playback mode switching prompt message is displayed on the video playback page, the collection and comparison of sensor data can be stopped to reduce unnecessary resource operation and improve system processing speed.

[0114] Specifically, a stop instruction is sent to a preset sensor data comparison module, wherein the stop instruction is used to instruct to stop collecting and comparing sensor data.

[0115] In order to facilitate understanding of the above embodiments, a processing flow diagram of a video-based interaction method provided in the embodiments of the present disclosure is shown as follows: Figure 4 As shown, the disclosed embodiment takes walking as an example of the scene of the object activity reflected by the comparison result of the target, and generally explains how to prompt the user to switch the playback mode in the walking scene, and the specific discussion is as follows:

[0116] First, enter the video playback page, start the preset sensor data comparison module, collect sensor data, compare the sensor data, and obtain the comparison result. According to the preset frequency and preset period of the system, calculate the preset number threshold, send the preset number threshold to the preset sensor data comparison module, and receive the callback event of the preset sensor data comparison module.

[0117] Then, determine whether to record the first callback time. When determining to record the first callback time, obtain the first callback time and the current time of the system, calculate the difference between the two, obtain the time difference, and determine whether the time difference is greater than or equal to the preset time threshold. When it is greater than or equal to the preset time threshold, send a preset query instruction to the preset sensor data comparison module. The preset sensor data comparison module queries the comparison results of sensor data that meet the preset number of occurrence conditions within a preset period based on the preset number threshold. The comparison results that meet the preset number of occurrence conditions within the preset period are received from the preset sensor data comparison module, and it is determined whether the comparison results that meet the preset number of occurrence conditions within the preset period include the target comparison results.

[0118] When the comparison results of sensor data that meet the preset number of occurrence conditions within the preset period include the target comparison results, it is determined whether the display frequency control conditions and other display conditions are met. If all display conditions are met, the playback mode switching prompt information is displayed on the video playback page, and a stop command is sent to the preset sensor data comparison module to stop collecting and comparing the sensor data.

[0119] Based on the above method embodiment, the present disclosure also provides a video-based interactive device, referring to Figure 5 A schematic diagram of a video-based interactive device provided in an embodiment of the present disclosure, the device comprising:

[0120] A first determination module 501 is used to determine whether the comparison results of the sensor data that meet the preset number of occurrence conditions within the preset period include the target comparison results according to the comparison results of the sensor data collected within the preset period;

[0121] The first display module 502 is used to display a playback mode switching prompt message on the video playback page if it is determined that the comparison result of the sensor data that meets the preset number of occurrences within the preset period includes the target comparison result; wherein the playback mode switching prompt message is used to prompt switching to a preset audio-visual mode, and the preset audio-visual mode is used to play the video corresponding to the video playback page in audio playback mode.

[0122] In an optional implementation manner, the first determining module includes:

[0123] A start module, used to start a preset sensor data comparison module in response to a preset trigger operation on the video playback page; wherein the preset sensor data comparison module is used to compare the collected sensor data according to a preset frequency;

[0124] The first determination submodule is used to determine whether the comparison results of the sensor data that meet the preset occurrence number condition within the preset period include the target comparison result according to the comparison result of the preset sensor data comparison module within the preset period.

[0125] In an optional implementation manner, the first determining submodule includes:

[0126] A second determination submodule, configured to determine whether a preset period has ended upon receiving a callback event from the preset sensor data comparison module;

[0127] A third determination submodule, configured to determine, when determining that the preset period ends, a comparison result of sensor data that meets a preset number of occurrence conditions within the preset period;

[0128] The fourth determination submodule is used to determine whether the comparison results of the sensor data that meet the preset number of occurrence conditions within the preset period include the target comparison results.

[0129] In an optional implementation manner, the second determining submodule includes:

[0130] A fifth determination submodule, configured to determine a time difference between a current system time and a first callback time of a preset period when receiving a callback event of the preset sensor data comparison module;

[0131] The sixth determination submodule is used to determine whether the time difference is not less than a preset time threshold.

[0132] In an optional implementation manner, the second determining submodule includes:

[0133] A seventh determination submodule, configured to determine, upon receiving a callback event from the preset sensor data comparison module, the number of times information corresponding to the callback event;

[0134] The eighth determination submodule is used to determine whether the number information is not less than a preset number threshold.

[0135] In an optional implementation manner, the third determining submodule includes:

[0136] A sending submodule, used to send a preset query instruction to the preset sensor data comparison module when determining that the preset period ends; wherein the preset query instruction is used to instruct to query the comparison result of the sensor data that meets the preset number of occurrence conditions within the preset period;

[0137] The receiving submodule is used to receive the comparison result of the sensor data that meets the preset number of occurrence conditions within the preset period returned by the preset sensor data comparison module.

[0138] In an optional implementation, the device further includes:

[0139] A second determination module is used to determine whether to display the playback mode switching prompt information based on a preset display frequency control condition; wherein the preset display frequency control condition is used to control the display frequency of the playback mode switching prompt information;

[0140] Accordingly, the first display module includes:

[0141] The first display submodule is used to determine that the comparison result of the sensor data that meets the preset number of occurrences within the preset period includes the target comparison result, and when it is determined based on the preset display frequency control condition that the playback mode switching prompt information can be displayed, the playback mode switching prompt information is displayed on the video playback page.

[0142] In an optional implementation, the device further includes:

[0143] The sending module is used to send a stop instruction to the preset sensor data comparison module; wherein the stop instruction is used to instruct to stop collecting and comparing sensor data.

[0144] In an optional implementation manner, the startup module is specifically used to:

[0145] In response to a display triggering operation on a video playback page, a preset sensor data comparison module is started; wherein the video playback page is used to support video playback based on a media information stream.

[0146] In the video-based interactive device provided by the embodiment of the present disclosure, first, based on the comparison results of the collected sensor data within a preset period, it is determined whether the comparison results of the sensor data that meet the preset number of occurrence conditions within the preset period include the target comparison results. If it is determined that the comparison results of the sensor data that meet the preset number of occurrence conditions within the preset period include the target comparison results, a playback mode switching prompt information is displayed on the video playback page; wherein the playback mode switching prompt information is used to prompt switching to a preset audio-video mode, and the preset audio-video mode is used to play the video corresponding to the video playback page in an audio playback mode.

[0147] It can be seen that the embodiment of the present disclosure collects sensor data and compares the sensor data. When it is determined that the comparison result of the sensor data that meets the number of occurrence conditions within a preset period includes the target comparison result, it can display a playback mode switching prompt message to remind the user to switch to the video listening mode, thereby playing the video corresponding to the video playback page in the audio playback mode, further meeting the user's diverse needs for video-related functions and improving the user experience.

[0148] In addition to the above-mentioned method and apparatus, the embodiments of the present disclosure further provide a computer-readable storage medium, in which instructions are stored. When the instructions are executed on a terminal device, the terminal device implements the video-based interaction method described in the embodiments of the present disclosure.

[0149] The embodiment of the present disclosure further provides a computer program product, which includes a computer program / instructions. When the computer program / instructions are executed by a processor, the video-based interaction method described in the embodiment of the present disclosure is implemented.

[0150] In addition, the present disclosure also provides a video-based interactive device, see Figure 6 As shown, it may include:

[0151] Processor 601, memory 602, input device 603 and output device 604. The number of processors 601 in the video-based interactive device can be one or more. Figure 6 In some embodiments of the present disclosure, the processor 601, the memory 602, the input device 603 and the output device 604 may be connected via a bus or other means, wherein: Figure 6 The example of connecting through bus is taken in the following.

[0152] The memory 602 can be used to store software programs and modules. The processor 601 executes various functional applications and data processing of the video-based interactive device by running the software programs and modules stored in the memory 602. The memory 602 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application required for a function, etc. In addition, the memory 602 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. The input device 603 can be used to receive input digital or character information, and generate signal input related to user settings and function control of the video-based interactive device.

[0153] Specifically in this embodiment, the processor 601 will load the executable files corresponding to the processes of one or more applications into the memory 602 according to the following instructions, and the processor 601 will run the applications stored in the memory 602, thereby realizing the various functions of the above-mentioned video-based interactive device.

[0154] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0155] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A video-based interactive method, characterized in that: The method comprises: Determining, based on the comparison results of the collected sensor data within a preset period, whether the comparison results of the sensor data that meet the preset number of occurrence conditions within the preset period include the target comparison results; If it is determined that the comparison result of the sensor data that meets the preset number of occurrences within the preset period includes the target comparison result, a playback mode switching prompt message is displayed on the video playback page; wherein the playback mode switching prompt message is used to prompt switching to a preset audio and video mode, and the preset audio and video mode is used to play the video corresponding to the video playback page in audio playback mode.

2. The method according to claim 1, characterized in that The step of determining, based on the comparison results of the collected sensor data within the preset period, whether the comparison results of the sensor data meeting the preset number of occurrence conditions within the preset period include the target comparison results includes: In response to a preset trigger operation on the video playback page, a preset sensor data comparison module is started; wherein the preset sensor data comparison module is used to compare the collected sensor data according to a preset frequency; According to the comparison result of the preset sensor data comparison module within the preset period, it is determined whether the comparison result of the sensor data that meets the preset occurrence number condition within the preset period includes the target comparison result.

3. The method according to claim 2, characterized in that The determining, based on the comparison result of the preset sensor data comparison module within the preset period, whether the comparison result of the sensor data meeting the preset occurrence number condition within the preset period includes the target comparison result includes: Upon receiving a callback event of the preset sensor data comparison module, determining whether a preset period has ended; If it is determined that the preset period ends, determining a comparison result of sensor data that meets a preset number of occurrence conditions within the preset period; It is determined whether the comparison results of the sensor data that meet the preset number of occurrence conditions within the preset period include a target comparison result.

4. The method according to claim 3, characterized in that The step of determining whether a preset period has ended upon receiving a callback event of the preset sensor data comparison module comprises: Upon receiving a callback event from the preset sensor data comparison module, determining a time difference between the current system time and the first callback time of the preset period; Determine whether the time difference is not less than a preset time threshold.

5. The method according to claim 3, characterized in that: The step of determining whether a preset period has ended upon receiving a callback event of the preset sensor data comparison module comprises: When receiving a callback event of the preset sensor data comparison module, determining the number of times information corresponding to the callback event; Determine whether the number of times information is not less than a preset number of times threshold.

6. The method according to claim 3, characterized in that If it is determined that the preset period ends, then determining the comparison result of the sensor data that meets the preset number of occurrence conditions within the preset period includes: If it is determined that the preset period is over, a preset query instruction is sent to the preset sensor data comparison module; wherein the preset query instruction is used to instruct to query the comparison result of the sensor data that meets the preset number of occurrence conditions within the preset period; The comparison result of the sensor data that meets the preset number of occurrence conditions within the preset period is received and returned by the preset sensor data comparison module.

7. The method according to claim 1, characterized in that Before displaying the playback mode switching prompt information on the video playback page, the method further includes: Based on a preset display frequency control condition, determining whether to display the playback mode switching prompt information; wherein the preset display frequency control condition is used to control the display frequency of the playback mode switching prompt information; Correspondingly, if it is determined that the comparison result of the sensor data that meets the preset number of occurrence conditions within the preset period includes the target comparison result, displaying the playback mode switching prompt information on the video playback page includes: If it is determined that the comparison result of the sensor data that meets the preset number of occurrences within the preset period includes the target comparison result, and it is determined based on the preset display frequency control condition that the playback mode switching prompt information can be displayed, the playback mode switching prompt information is displayed on the video playback page.

8. The method according to claim 2, characterized in that: After displaying the playback mode switching prompt information on the video playback page, the method further includes: A stop instruction is sent to the preset sensor data comparison module; wherein the stop instruction is used to instruct to stop collecting and comparing sensor data.

9. The method according to claim 2, characterized in that: The method of starting a preset sensor data comparison module in response to a preset trigger operation on a video playback page includes: In response to a display triggering operation on a video playback page, a preset sensor data comparison module is started; wherein the video playback page is used to support video playback based on a media information stream.

10. A video-based interactive device, characterized in that: The device comprises: A first determination module, configured to determine, based on the comparison results of the collected sensor data within a preset period, whether the comparison results of the sensor data meeting a preset number of occurrence conditions within the preset period include a target comparison result; The first display module is used to display a playback mode switching prompt message on the video playback page if it is determined that the comparison result of the sensor data that meets the preset number of occurrences within the preset period includes the target comparison result; wherein the playback mode switching prompt message is used to prompt switching to a preset audio-visual mode, and the preset audio-visual mode is used to play the video corresponding to the video playback page in audio playback mode.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, and when the instructions are executed on a terminal device, the terminal device implements the method according to any one of claims 1 to 9.

12. A video-based interactive device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method according to any one of claims 1 to 9 is implemented.

Citation Information

Patent Citations

  • Interactive method and system of real environment and virtual environment

    CN107346174A

  • Visual audio playing method and device

    CN108174269A

  • Reading mode control method based on electronic book application and electronic equipment

    CN110647306A

  • Lightweight smart agricultural heterogeneous Internet of Things management system

    CN111163181A

  • Message display device and method

    US20100064021A1