Interaction method and device based on video fitness, equipment and storage medium
By introducing interactive entrances and adjustment functions in video fitness applications, users can adjust video content according to their own needs, solving the problems of video continuity and distraction in the existing technology, and improving fitness effects and user experience.
Patent Information
- Application Number
- CN202411100284.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-12
- Publication Date
- 2024-11-19
AI Technical Summary
In existing video fitness applications, it is difficult for users to find suitable videos for continuous exercise, resulting in interruption of exercise and distraction of attention, and unable to effectively achieve fitness results.
It provides an interactive method based on video fitness. Through the interactive portal, users can adjust the currently played fitness video according to their own needs, including monitoring user operations, obtaining input information and adjusting video content, ensuring continuous video playback and personalized experience.
It enables users to adjust fitness videos according to their own needs anytime, anywhere, improves the continuity and effect of exercises, simplifies the operation process, and improves the user experience.
Smart Images

Figure CN118984412A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of video processing technology, and in particular to an interactive method, device, equipment and storage medium based on video fitness. Background Art
[0002] With the improvement of living standards, people are generally concerned about their physical health. Whether it is the elderly, middle-aged people or young people, they generally have fitness methods that are suitable for them. For example, retired elderly people are very fond of square dancing, which not only exercises the body but also improves social interaction, making up for the lack of social activities of the elderly. However, the elderly who can participate in square dancing usually have good physical strength or extroverted personalities. For the elderly with poor physical strength or introverted personalities, this type of elderly people prefer some fitness activities that can be carried out in quiet and private places. For middle-aged and young people, some people prefer fitness venues, but for some people who are limited by time and energy, home is a better choice.
[0003] With the development of the Internet, applications (APPs) and video technology, more and more application content is presented to users in the form of videos. In particular, as people of all ages pay more and more attention to fitness and fitness is becoming more and more common, video content providers provide a variety of fitness content videos to meet this situation. For those elderly people who are not physically strong enough and introverted, or most middle-aged and young people, they can use video applications to exercise in any suitable place for them. Therefore, the rise of such video applications meets the fitness needs of many people.
[0004] Although current video applications provide a variety of fitness content for people's fitness needs, such as equipment application, fitness movements and training methods, yoga, meditation, Tai Chi, Tai Chi sword and other types of fitness activities, such as different durations of 2 minutes, 5 minutes, 30 minutes, or different exercise intensities and calorie consumption, thus meeting the needs of different users, it also brings a problem: in order to achieve better fitness results, users need to spend time to find videos that suit them from a large number of videos of many types, different durations, and different exercise intensities, and need to select multiple videos according to the duration of the video and their own exercise duration. In actual implementation, after users have spent a certain amount of time to find a suitable video and follow the instructor in the video to complete it, they still need to stop and continue to look for the next video, resulting in interruptions in fitness activities. This interruption not only interrupts the continuity of fitness, but also easily distracts users' attention when looking for videos, resulting in poor completion of fitness activities and failure to achieve the fitness results expected by users.
[0005] Therefore, there is an urgent need for a method that can help users to perform continuous fitness activities following videos, and for flexibility considerations, it is also necessary for users to be able to change the video they are using according to their own needs anytime and anywhere. Summary of the invention
[0006] In view of the technical problems existing in the prior art, the present invention proposes an interactive method, device, equipment and storage medium based on video fitness, which can interact with users and change the fitness video currently being played by the user based on the user's needs while the user follows the fitness video for continuous fitness activities.
[0007] According to one aspect of the present invention, the present invention provides an interactive method based on video fitness, which includes the following steps:
[0008] Providing the user with a current fitness video and an interactive entrance, wherein the current fitness video is a fitness video or a collection of multiple continuously played video clips obtained based on current progress information in the user's fitness plan;
[0009] Monitoring the user's operation on the interactive portal;
[0010] Acquiring user input information in response to the user operating the interactive portal;
[0011] Determining adjustment content for the current fitness video based on the user's input information; and
[0012] The current fitness video is adjusted based on the adjustment content.
[0013] According to another aspect of the present invention, the present invention also provides an interactive device based on a fitness video, which includes:
[0014] An interactive interface module, configured to provide a current fitness video and an interactive entrance to the user, wherein the current fitness video is a fitness video or a collection of multiple fitness videos played continuously obtained based on the user's current progress information determined based on the fitness plan;
[0015] an operation monitoring module configured to monitor the user's operation on the interactive portal, and obtain user input information in response to the user's operation on the interactive portal;
[0016] an adjustment content determination module configured to determine adjustment content for the current fitness video based on user input information; and
[0017] The adjustment module is configured to adjust the current fitness video based on the adjustment content.
[0018] According to another aspect of the present invention, the present invention further provides an electronic device, comprising a processor and a memory storing computer program instructions; when the electronic device executes the computer program instructions, the aforementioned fitness video-based interaction method is implemented.
[0019] According to another aspect of the present invention, the present invention further provides a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the aforementioned fitness video-based interaction method is implemented.
[0020] According to another aspect of the present invention, the present invention further provides a computer program product, including computer program instructions, which implement the aforementioned fitness video-based interaction method when executed by a processor.
[0021] The present invention provides users with continuously played fitness videos, so that users can concentrate on following the videos to perform fitness activities; users can input information at any time through a variety of interactive entrances according to their current experience, needs, preferences, etc., and the present invention adjusts the fitness video in response to the user's input information. The user's operation is simple, the processing efficiency is high, and the delay is small, thereby improving the user's application experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] The preferred embodiments of the present invention will be further described in detail below with reference to the accompanying drawings, wherein:
[0023] Figure 1 is a flow chart of an interactive method based on fitness videos according to an embodiment of the present invention;
[0024] Figure 2 is a schematic diagram of a user personal interface according to an embodiment of the present invention;
[0025] Figure 3 is a schematic diagram of a user personal interface according to another embodiment of the present invention;
[0026] Figure 4 is a flow chart of a method for adjusting a current fitness video based on determined adjustment content according to an embodiment of the present invention;
[0027] Figure 5 is a principle block diagram of an interactive device based on fitness videos according to an embodiment of the present invention;
[0028] Figure 6 is a schematic diagram of the architecture of an interactive device based on fitness videos according to another embodiment of the present invention;
[0029] Figure 7is a principle block diagram of an interactive device based on a client and server architecture according to an embodiment of the present invention; and
[0030] Figure 8 FIG. 4 is a schematic diagram of the hardware structure of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION
[0031] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0032] In the following detailed description, reference may be made to the various specification drawings that are part of the present application and are used to illustrate specific embodiments of the present application. In the accompanying drawings, similar reference numerals describe substantially similar components in different figures. The various specific embodiments of the present application are described below in sufficient detail so that a person of ordinary skill in the art with relevant knowledge and skills in the art can implement the technical solutions of the present application. It should be understood that other embodiments may also be used or structural, logical or electrical changes may be made to the embodiments of the present application.
[0033] The present invention relates to a processing method and device applied to a video platform, and the video platform includes but is not limited to a video application (APP) applied to a smart phone, a website provided in the form of a web page applied to a desktop computer, a tablet computer, a laptop computer, etc. The users of the video platform include video providing users and ordinary users who watch videos. In the following description, unless otherwise specified, the "user" in the present invention refers to an ordinary user who watches videos.
[0034] After a user registers as a user on the video platform, in order to better serve the user, the video platform monitors and records the user's behavior and video playback data on the platform and stores them in the database to form a video playback record database. Each video playback data obtained is called a record, which includes the video ID, time and other related information played by the user. Therefore, the video playback record database stores a historical video playback record table for each user. Each record records the user's playback behavior on the video platform and the data of a corresponding video, including the recording time, video ID, and related information reflecting the video playback. Video IDs include video names, video IDs (ID), or video providing user names, etc. Relevant information used to reflect video playback includes, for example, the start time of playback, the end time of playback, etc.
[0035] In order to facilitate understanding of the content of each video and for related business processing, the video platform sets multiple tags for each video in the video library. Each tag corresponds to a video feature. The video feature includes, for example, the following types of video features and corresponding feature information:
[0036] Fitness activity type: its specific characteristic information includes "aerobics", "belly slimming exercises", "body shape", "lazy exercises", "cervical spine exercises", "yoga", "Pilates", "whole body sweating" or "patting exercises", etc.
[0037] Exercise type: Its specific feature information includes "aerobic exercise", "anaerobic exercise", "strength training", etc., which can help users choose according to their exercise goals and preferences.
[0038] Action type: Its specific characteristic information includes "few actions", "moderate actions" or "many actions".
[0039] Video length: Its specific feature information includes "2 minutes", "5 minutes" or "30 minutes", etc.
[0040] Video background: Its specific feature information may be simple color, or “landscape”, “city”, “stage”, etc.
[0041] Music type: Its specific feature information includes "popular songs", "classic old songs", "DJ dance music", "love songs", "folk songs", "red songs", "children's songs", etc.
[0042] Music rhythm: Its specific feature information includes "fast", "slow", "soothing", etc. Since fast-paced music can stimulate the user's enthusiasm for exercise, slow-paced music can help the user to do deep stretching or meditation. Therefore, the present invention also regards the background music rhythm in the fitness video as a video feature.
[0043] Interactivity: It is used to reflect whether the video contains interactive parts with the audience. Its specific feature information includes the coach's encouraging words, audience feedback, etc. Because different users have different interactive needs and preferences, the video feature of "interactivity" can help users find videos that better suit their interactive preferences.
[0044] Applicable groups: used to indicate which groups of people are suitable for watching the video. Specific characteristic information may include "beginners", "intermediate fitness enthusiasts", "advanced fitness enthusiasts", or specific groups such as "pregnant women", "elderly people", etc.
[0045] Safety Tips: This feature indicates whether the video contains tips for correct posture and avoiding injuries, which can help users exercise more safely.
[0046] Exercise intensity: used to reflect the exercise intensity of fitness activities in the video. Its specific feature information includes "low intensity", "medium intensity" and "high intensity".
[0047] Calorie consumption: used to reflect the calorie consumption of fitness activities in the video. Its specific characteristic information is such as "100 calories", "200 calories", etc.
[0048] Movement difficulty: used to reflect the difficulty of fitness movements in the video. Its specific feature information includes "entry level", "first-level difficulty", "second-level difficulty", "professional level", etc.
[0049] Targeted Part: Used to indicate the specific part of the body that the exercises in the video mainly target. Its specific feature information includes "abdomen", "legs", "back", etc.
[0050] Coach qualifications: used to introduce the professional background and qualifications of the coach in the video, and increase users' trust in the professionalism of the video content.
[0051] The feature information of the aforementioned various video features of each video is stored in the video information library in the form of tags, and corresponds to the video identifier one by one. Therefore, when a video identifier of a video is obtained, the feature information of the corresponding video feature can be found by searching the video information library based on the video identifier.
[0052] In order to avoid the user stopping to look for videos during fitness, which would disrupt the continuity of fitness and distract the user's attention, the present invention provides the user with a complete personalized fitness plan and fitness videos or video collections that can be played continuously, and provides the user with a method for interacting with fitness videos, so that the user can change the fitness video based on current actual needs.
[0053] Figure 1 is a flow chart of an interactive method based on fitness videos according to an embodiment of the present invention, the method comprising:
[0054] Step S1, providing the user with the current fitness video and interactive entrance.
[0055] Step S2, monitoring the user's operation on the interactive portal.
[0056] Step S3, obtaining information input by the user based on the interactive entrance based on the user operating the interactive entrance.
[0057] Step S4: determining the adjustment content of the current fitness video based on the information input by the user.
[0058] Step S5, adjusting the current fitness video based on the adjustment content.
[0059] Among them, the current fitness video in step S1 is a fitness video obtained based on the current progress information in the user's fitness plan or a fitness video collection consisting of multiple continuously played video clips. For the convenience of explanation, the fitness video or the fitness video collection consisting of multiple continuously played video clips will be collectively referred to as fitness video below.
[0060] The fitness plan can be formulated by the user, or by the video platform according to the user's historical behavior and playback data on the video platform. In one embodiment, the video platform provides users with a variety of fitness plan templates. After logging into the video platform, the user can set various parameter items provided by the fitness plan template according to their own situation, thereby obtaining a fitness plan.
[0061] The fitness plan template is, for example, a fitness plan suitable for various groups of people determined according to the prior knowledge of experts, and the various groups of people can be determined by multiple dimensional information, such as age, gender, occupation, and weight. The fitness plan includes a total number of times or a total time span, such as 30 times, half a year, one month, three months, etc. The fitness plan can also include multiple stages, and for a fitness plan with a total time span, its various stages can be divided by time nodes. For example, for a 6-month fitness plan, the same day of each month from the start date is used as a time node to divide the entire fitness plan into 6 stages. For a fitness plan with a total number of times, its various stages can be obtained by dividing the total number of times by the number of times. For example, for a 30-time fitness plan, every 5 times is used as a segmentation point to divide the entire fitness plan into 6 stages. The above time nodes and the number of times are called progress nodes. Each stage can also further include a secondary progress node, thereby dividing the stage into multiple sub-stages.
[0062] The fitness plan may also include fitness index data corresponding to each progress node, such as tasks to be completed and / or goals to be achieved at each stage, and the fitness index may be, for example, the shortest exercise duration, the minimum calorie consumption, the intensity to be taken during exercise, etc. The above progress nodes and corresponding fitness index data are collectively referred to as progress information.
[0063] When making a fitness plan, the user can first specify one from multiple fitness plan templates and set the aforementioned progress nodes and corresponding fitness index data. In another embodiment, the video platform provides a template evaluation function. When the user is unable to determine which fitness plan template to specify, the user can enter the template evaluation page provided by the video platform to evaluate and determine a fitness plan template that suits their needs. The template evaluation page configures various options, such as age, gender, occupation, weight, etc. The video platform determines a fitness plan template for the user based on the various options configured by the user.
[0064] The user then sets the fitness plan template to obtain a personalized fitness plan. The template provides multiple video features for each progress node. When setting the fitness plan template, the user sets multiple video features for each progress node based on his / her exercise preferences and video preferences, so that each progress node corresponds to a video feature set.
[0065] In another embodiment, the video platform counts the user's video preference features and exercise preference features from the user's historical video playback records, thereby obtaining a feature set of the user's preferences. Then, the user's personal information is obtained, and a fitness plan template adapted to the personal information is matched based on a preset fitness plan template, and then the corresponding progress node and the corresponding fitness index are determined based on the exercise preference feature, and then the video features that meet the fitness index of each progress node are selected from the user's preferred feature set, thereby forming a complete fitness plan. In another embodiment, a large model can be used to construct prompt information based on the user's personal information and the user's preferred feature set, and the large model outputs a complete fitness plan.
[0066] Whether it is a fitness plan formulated by the user or a fitness plan generated by the video platform for the user, each progress node corresponds to a set of video features.
[0067] The fitness plan is stored in the database as a kind of personal information of the user, and the user can view it through the user's personal interface after logging into the video platform. In addition, the video platform records the user's application data of the fitness plan, such as recording the user's playback information of the fitness video or video set generated based on the fitness plan, such as the playback time, the fitness video played, etc., and based on the progress information in the fitness plan, determines the stage of the user's fitness video playback behavior at the time of recording, thereby marking the progress information in the fitness plan to obtain progress marking information.
[0068] When the user is detected to be online, the current progress information of the user is determined by querying the progress mark information of the fitness plan, and a corresponding video feature set is obtained. Based on the video feature set, multiple fitness videos are obtained to obtain a candidate video set, and one or more candidate videos are selected from the candidate video set to obtain the current fitness video of the user.
[0069] In one embodiment, an interactive entrance is provided in the user personal interface, so in step S1, when it is detected that the user logs into the user personal interface of the video platform and visits the page where the current fitness video is located, the current fitness video and the corresponding interactive entrance are provided. Figure 2 , Figure 2 is a schematic diagram of a user personal interface according to an embodiment of the present invention, Figure 3 is a schematic diagram of a user personal interface according to another embodiment of the present invention, Figure 2 and Figure 3 The content of the current fitness video page is displayed in the figure. At the top of the page is a tab bar, and the upper part of the page is a fitness video list, which includes a cover image of each video clip and a play button. The lower part of the page provides an interactive entrance. The interactive entrance can be provided in one or more ways of a button, a label, a pop-up window, and a page, and a pop-up window or a page can be provided based on the user's operation on the button or label, thereby providing the user with more interactive content.
[0070] The interactive portal provided by the present invention corresponds to the information category, so when it is detected that the user has performed a corresponding operation on an interactive portal, the information category can be determined according to the interactive portal operated by the user.
[0071] The information categories may include primary categories or multi-level categories, and thus the interactive entrances may also be considered to correspond to primary interactive entrances and multi-level interactive entrances. For example, the primary information categories may be divided into exercise preference categories and instant feedback content categories, and the exercise preference categories may include multiple secondary preference categories, such as exercise duration, exercise intensity, movement change type, a combination of multi-stage intensity and movement change type, a specific mode, and a local exercise mode, etc. The specific mode may be set to display only the content of a single specific teacher or the content of several specific teachers. The local exercise mode may be set to exercise only a certain local part or focus on exercising a certain local part, such as the upper body, lower body, shoulder and neck, waist and abdomen, leg joints, etc.
[0072] During the interaction process, the user can set the content of a certain information category separately, or can set the content of multiple information categories in combination. For example, "exercise intensity" and "action change type" are combined with "exercise duration" for setting. At this time, the interactive entrance provided is, for example, a label, and the user enters the corresponding setting page by clicking the label. By dividing the overall exercise duration into multiple stages in the "exercise duration" item, the exercise intensity and action change type of each stage are set respectively, such as low intensity + less action in the first stage, medium and light + moderate action in the second stage, high and light + moderate action in the third stage, low intensity + less action in the fourth stage, etc. In another embodiment, the present invention also provides a combination setting button, so that the user can flexibly combine multiple setting options, thereby achieving more flexible settings.
[0073] In order to provide rich interactive content, there are multiple ways to provide information categories and their corresponding content. For example, the first-level information category is provided in the form of a button or label, and the specific content of the second-level information category is provided in the form of a pop-up window, page, or drop-down menu. Among them, the specific content of each information category can be provided in the form of an option button. For example, for the "exercise duration" of the second-level information category, it includes multiple specific durations, such as 20 minutes, 30 minutes, 40 minutes, etc. When the "exercise duration" of the second-level information category is provided in an independent pop-up window or on a setting page, each specific duration corresponds to an option button, and the user provides input information by clicking one of the option buttons. When the "exercise duration" of the second-level information category is provided as a button, its multiple specific contents can be provided by a drop-down menu, and each specific duration corresponds to an option in the drop-down menu. When the user operates, click the "exercise duration" button and select one of the options from the provided drop-down menu to provide input information. The same interactive provision method is for example "exercise intensity", "action change type", etc. "Exercise intensity" can provide three specific contents: high, medium, and low intensity; "Movement variation type" can provide three specific contents: more, less, and moderate. In addition, the specific contents of these information categories can also be provided in other ways, such as in the form of a progress bar, and the user sets it by dragging the progress bar.
[0074] like Figure 2 , where the button "Workout Settings" is a first-level information category in the workout preference category. Figure 2 In the embodiment shown, when the user clicks the button "Exercise Settings", the configurable content is displayed in the form of a pop-up window, which includes two secondary information categories "Overall Exercise Intensity" and "Overall Movement Variation", and their respective specific content is provided in the form of option buttons. The user can click an option button, as shown in the figure, to select "Medium Intensity" and "Moderate Movement". In addition, Figure 2 The "Workout Settings" pop-up window also shows an intensity chart for each stage of the current fitness video.
[0075] The instant feedback content category includes one or more positive information items and one or more negative information items. For example, Figure 2 and Figure 3 The buttons "Like" and "Dislike" in the app are two secondary information categories in the instant feedback content category, which are used to provide positive information items and negative information items respectively. Through positive information items, users' positive preference data such as favorite teachers, songs, and exercise intensity can be collected, and negative information items are used to filter out videos that users do not like, which helps to update and improve the accuracy of fitness plans and fitness videos generated for users.
[0076] The interactive portal of the instant feedback content category usually corresponds to a single video clip. Figure 3For example, when a user selects a video clip in the fitness video list and clicks the "dislike" button, a pop-up window as shown in the figure appears. It includes various options for users to choose from, such as "dislike the teacher", "dislike the song", "dislike the background", "inappropriate movements", etc.
[0077] When providing an interactive entrance, the present invention also provides a corresponding input method according to the interactive entrance provision method. One of the input methods is a screen click method, corresponding to the button of the aforementioned primary information category, the option button of a certain information category in the pop-up window or the page, and its input method is a screen click method, so after monitoring that the user clicks the button, the corresponding button can be determined according to the user's screen click operation, and then the information category corresponding to the button can be read to obtain the specific content corresponding to the current user operation, that is, the user's input information.
[0078] Another input method is screen dragging or screen sliding, and the specific input information is determined based on the dragging distance or sliding distance and the corresponding setting option content. For example, for the secondary information category "exercise duration", when its specific content is provided in the form of a progress bar, a screen dragging or screen sliding method is provided. When the user is detected dragging or sliding the progress bar of the secondary information category "exercise duration", the information category is determined to be "exercise duration" through the button "exercise duration" clicked by the user, and the specific duration is calculated based on the position of the progress bar, thereby obtaining the user's input information. For example, the corresponding duration T is calculated by the following formula 1-1:
[0079]
[0080] Among them, x2 is the horizontal coordinate of the current position of the progress bar after the user sets it, x1 is the horizontal coordinate of the starting point of the progress bar, X is the maximum horizontal length that can be set for the progress bar, and T N The maximum duration that can be set for the progress bar.
[0081] Similarly, other information categories can also provide screen dragging or screen sliding as input methods. For example, for Figure 2For the secondary information categories "exercise intensity" and "action change type", each includes three different degrees of discrete content. The present invention sets multiple progress bar thresholds for the specific content of this information category. Two adjacent progress bar thresholds constitute a threshold interval, and one threshold interval corresponds to a specific discrete content. For example, the progress bar from the starting position to the one-third position is the first threshold interval, corresponding to the first degree of discrete content, the progress bar from the one-third position to the two-thirds position is the second threshold interval, corresponding to the second degree of discrete content, and the progress bar from the two-thirds position to the end point is the third threshold interval, corresponding to the third degree of discrete content. Therefore, the position proportion p of the progress bar is first calculated according to formula 1-2:
[0082]
[0083] The position proportion p is then compared with each threshold value to determine the threshold interval in which the current position proportion p of the progress bar is located, and then the corresponding specific content is determined based on the threshold interval.
[0084] Another input method may be voice input. For example, the setting content implemented by clicking on the screen can also be implemented by voice. Figure 2 A corresponding voice input button can also be set corresponding to the button "Dislike". When it is detected that the user has clicked the voice input button, the microphone of the terminal device is started to record the voice information input by the user, and corresponds to the voice input button "Dislike", determining that the voice information corresponds to the content corresponding to the setting option "Dislike".
[0085] In addition, a gesture input method can be provided, so that the user can input the content of the corresponding setting option based on gesture operation. For example, corresponding to the exercise duration setting item, after the user enters the setting page, the terminal camera is started to capture the user's hand movements. When the user uses the specified gesture, the corresponding input information is determined based on the preset gesture meaning. For example, the user can use the palm pressing action to indicate the instruction to reduce the duration, and set the specific duration to be reduced according to the distance the palm is pressed down.
[0086] The present invention also provides a terminal posture input mode. According to specific setting options, the user can input information by manipulating the terminal posture. Taking the exercise duration setting item as an example, after the user enters the setting page, the user can determine the change and amount of the exercise duration by controlling the tilt direction and tilt angle of the terminal. For example, the posture state change information of the terminal can be monitored by the built-in gyroscope and acceleration sensor of the terminal device. For example, when the original state of the terminal is static and the text direction on the screen is upward, the user operates the terminal device so that the screen tilts backward at a certain speed v and then returns to the original state. The posture state change information detected by the present invention includes a first speed v1, an angle θ, and a second speed v2. According to the terminal posture definition corresponding to the exercise duration setting option: the speed of tilting backward is negative, the speed of tilting forward is positive, and when the tilting speed exceeds the threshold, it is determined that the duration setting instruction is issued, and the positive speed corresponds to increasing the duration, and the negative speed corresponds to reducing the duration. The maximum tilt angle corresponds to the maximum duration. Therefore, according to the first speed v1 being negative and greater than the threshold, it can be known that the user has issued an instruction to reduce the exercise duration, and the specific duration of the reduction can be calculated according to the tilt angle θ.
[0087] In another embodiment, an interactive entrance is provided in the playback interface. When the user plays the current fitness video, a button or label is provided in the playback interface, and a corresponding information input method is provided, which is similar to the interactive entrance and input method provided in the personal interface above, and will not be repeated here.
[0088] In this embodiment, the information category corresponding to the interactive entrance has a corresponding relationship with the video adjustment feature used to adjust the fitness video. The present invention is provided with a video adjustment feature set, which is a subset of the video feature set, that is, each video adjustment feature is a video feature.
[0089] For example, for the secondary information categories "exercise intensity" and "action change type" in the primary information category "exercise settings", the two are two video adjustment features in the video adjustment feature set, and are also two video features in the video adjustment features. Therefore, after obtaining the user's input information based on the user's operation of the interactive portal, the information category corresponding to the interactive portal is first determined, and then the content corresponding to the information category is extracted from the user's input information, and then the video adjustment feature corresponding to the information category of the current interactive portal is determined based on the correspondence between the video adjustment feature and the information category, and the content extracted from the input information is used as the feature value of the video adjustment feature, and the video adjustment feature and its feature value are used as the adjustment content for the current fitness video.
[0090] See also Figure 4 , Figure 41 is a flow chart of a method for adjusting a current fitness video based on determined adjustment content according to an embodiment of the present invention. The method comprises:
[0091] Step S51, locate the video clip to be adjusted from the current fitness video. For example, obtain the video features and feature information of each video clip constituting the current fitness video, and compare them with the determined video adjustment features and feature information respectively, and use the video clip containing the video adjustment features as the video clip to be adjusted.
[0092] Step S52, determining the video adjustment duration based on the adjusted video segment or the video adjustment feature value. For example, when the video adjustment feature does not involve duration, the duration of the adjusted video segment is used as the video adjustment duration. If the video adjustment feature involves duration, the duration in the video adjustment feature is used as the video adjustment duration.
[0093] Step S53, updating the video feature set corresponding to the current progress information. In one embodiment, the video features and feature values corresponding to the current progress information are obtained, and the feature values of the video features that are the same as the video adjustment features are replaced with the video adjustment feature values to obtain updated video features and feature values.
[0094] Step S54: Match multiple video clips from the video database based on the updated video feature set to obtain an adjusted video set.
[0095] Step S55: acquiring one or more target adjusted video segments from the adjusted video set according to the video adjustment duration.
[0096] Step S56: deleting the located adjusted video segments from the current fitness video, and adding the one or more target adjusted video segments to the current fitness video.
[0097] For example, when the video adjustment features include "exercise duration", "movement variation type" and "specific teacher mode", the adjusted video segments that do not conform to the feature information are located from the current fitness video based on the feature information of the aforementioned three video adjustment features.
[0098] Then, the feature values of "exercise duration", "movement change type" and "specific teacher mode" corresponding to the current progress information are obtained, and the feature values of these three video features are replaced with feature values determined according to the user input information, thereby updating the video feature set in the current progress information in the fitness plan.
[0099] Based on the updated video features and their feature values, multiple video clips are matched from a video database to obtain an adjusted video set.
[0100] The corresponding duration is determined and calculated based on the located adjusted video segment, i.e., the duration T1 of the video to be replaced. Then, the remaining duration Tr is calculated by subtracting the duration T1 of the video to be replaced from the duration Tn of the current fitness video. Since the user resets the exercise duration T in this embodiment, the video duration Tm that needs to be increased can be calculated by the difference between the reset exercise duration T and the remaining duration Tr, which is the video adjustment duration.
[0101] A video set S consisting of one or more video clips is determined from the adjusted video set, the difference between its total duration Ts and the video duration Tm that needs to be increased should be less than the set duration deviation threshold δ, and then the videos in the video set S replace the adjusted video clips located in the current fitness video, thereby obtaining a new current fitness video.
[0102] In another embodiment, during the user's playing of a fitness video, after receiving the input information set by the user through the interactive portal, all subsequent video segments in the current fitness video starting from the user-set time are used as adjusted video segments. After obtaining the feature information of the video adjustment feature according to the user's settings, the feature value of the video feature that is the same as the video adjustment feature in the current progress information is replaced with the feature value determined according to the user input information, thereby updating the video feature set in the current progress information of the fitness plan. Then, based on the updated video features and their feature values, multiple video segments are matched from the video database to obtain an adjusted video set. Then, the duration Ts of the video set that needs to be played subsequently is determined according to the following formula 1-3:
[0103] |TT S -t play |<δ 1-3
[0104] T is the set exercise time, T S is the duration of the video set S to be played later, t play is the exercise duration, that is, the playback duration of the current fitness video, and δ is the set duration deviation threshold.
[0105] Then, one or more video segments with a total duration of Ts are determined from the adjusted video set, and the aforementioned adjusted video segments are replaced, thereby obtaining a new current fitness video.
[0106] In addition, when the fitness video includes multiple exercise stages, after determining the duration Ts of the video set to be played subsequently based on the aforementioned formula 1-2, it is also necessary to determine that the duration of each stage should satisfy that the difference between the duration of the video set of each stage and the set duration is less than the stage duration deviation threshold, that is, the determined video set to be played subsequently satisfies the formula shown in formula 1-4:
[0107]
[0108] Where T g is the duration of the g-th stage, T sg is the total duration of the video set s of the g-th stage selected, τ is the set stage duration deviation threshold, G is the set of subsequent stages, T is the exercise duration set by the user or the duration of the current fitness video, t play is the exercise duration, and δ is the set duration deviation threshold. The duration of each stage can be the original stage duration of the current fitness video, or the duration set by the current user.
[0109] In another embodiment, during the exercise of playing a fitness video by the user, instant feedback can be provided based on the currently playing video. Since an interactive entrance and a corresponding input method are provided in the playback interface, the user can provide feedback information through the interactive entrance according to the provided input method. When negative feedback information is provided, the information category is determined to be a negative information item, and the corresponding video adjustment feature and its feature value are determined based on the feedback information provided by the user. For example, when the negative feedback information is "I don't like the background of the video", the video adjustment feature is determined to be "video background" based on the keyword "background", and the feature information of the video feature "video background" of the current video clip is used as the video adjustment feature value. For example, the "video background" of the current video clip is green, and "green" is used as the feature value of the video adjustment feature; when the "video background" of the current video clip is a specified background image, the identifier of the current background image is used as the feature value of the video adjustment feature.
[0110] The video adjustment feature and its feature value are added to the video feature set of the current progress information, and are marked as features to be filtered, thereby obtaining an updated video feature set.
[0111] Then, according to the video adjustment feature of "video background" and the feature information of "green", a video segment that meets the condition is located from the current fitness video as the adjusted video segment, and the replaced video duration T1 is calculated based on the located adjusted video segment.
[0112] Then, based on the updated video features and their feature values, multiple video clips are matched from the video database to obtain an adjusted video set, wherein the videos in the adjusted video set are video clips from which the green video background is filtered out.
[0113] A video set S is determined from the adjusted video set, the difference between its total duration Ts and the duration T1 of the replaced video should be less than the set duration deviation threshold δ, and then the video in the video set S replaces the adjusted video segment located in the current fitness video, thereby obtaining a new current fitness video.
[0114] In another aspect, the present invention also provides an interactive device based on a fitness video, see Figure 5 , Figure 5 : is a principle block diagram of an interactive device based on fitness video according to an embodiment of the present invention, the device includes an interactive interface module 1, an operation monitoring module 2, an adjustment content determination module 3 and an adjustment module 4, wherein the interactive interface module 1 is used to provide the user with a current fitness video and an interactive entrance, wherein the current fitness video is a fitness video or a collection of multiple continuously played fitness videos obtained based on the user's current progress information determined by the fitness plan, and stored in a database 300. The operation monitoring module 2 monitors the user's operation on the interactive entrance, and obtains user input information in response to the user's operation of the interactive entrance. The adjustment content determination module 3 determines the adjustment content of the current fitness video based on the user input information. The adjustment module 4 adjusts the current fitness video based on the adjustment content.
[0115] The fitness video-based interaction method and device provided by the present invention can provide users with continuously played fitness videos while also providing users with a variety of interactive entrances. Users can interact with fitness videos at any time according to their current experience, needs, preferences, etc., with simple operation and high processing efficiency.
[0116] Figure 6 It is a schematic diagram of the architecture of an interactive device based on fitness videos according to another embodiment of the present invention. In this embodiment, the interactive device includes a client and a server. The client device is located in the user device, which can be a separate client application, or a plug-in or applet of the video platform. The user device is, for example, a mobile terminal (such as a smart phone) 100 or a computer 102. The server is located in the server 200, and the server 200 is connected to a database 300. The client and the server use the network unit in the device to realize network communication, and then send various requests and various data to each other.
[0117] Figure 7 1 is a block diagram of the principle of an interactive device based on a client and server architecture according to an embodiment of the present invention. In this embodiment, the client includes an interface unit 110, a video playback unit 120, an interaction monitoring unit 130, and a client communication unit 140. The server includes a fitness plan unit 210, a user online monitoring unit 220, a fitness video unit 230, an interaction information processing unit 240, a server communication unit 250, and a database 300.
[0118] The fitness plan unit 210 of the server obtains user data from the database 300 to generate a personalized fitness plan for each user. The user online monitoring unit 220 monitors the user status and notifies the fitness video unit 230 after detecting that the user is online. The fitness video unit 230 reads the user's fitness plan from the database 300 to determine the user's current progress information, and generates the user's current fitness video based on the video features corresponding to the current progress information. In one embodiment, the current fitness video or its information is sent to the client via the server communication unit 250. The client communication unit 140 of the client receives the current fitness video or its information and sends it to the interface unit 110, and the interface unit 110 corresponds to Figure 5 The interactive interface module 1 in the embodiment displays the current fitness video or its information in the corresponding section, and provides an interactive entrance in the current interface. When the user applies the current fitness video, he clicks the play button. The video playback unit 120 plays the current fitness video in the user device when receiving the play button information. When the current fitness video is a video, it is played from the beginning. When the current fitness video is a video set, it is played in sequence according to the preset order. If the client receives only the information of the current fitness video, such as the video cover, video logo, etc., the video playback unit 120 requests the corresponding video from the server through the client communication unit 140 when receiving the play button information. After receiving the video request, the server communication unit 250 of the server sends its request information to the fitness video unit 230, and the fitness video unit 230 sends the data of the current fitness video to the client, so that it is played online in real time in the user device.
[0119] The interaction monitoring unit 130 corresponds to Figure 5 The operation monitoring module 2 in the current fitness video playback process monitors the user feedback information in real time, including monitoring the user's screen operation, voice operation, gesture operation and posture operation of the device terminal. After monitoring the user feedback information, the user input information is obtained from it, and the user input information is sent to the server through the client communication unit 140. The interactive information processing unit 240 of the server includes Figure 5 The adjustment content determination module 3 in the fitness plan unit 210 receives the user input information, obtains the adjustment content of the current fitness video, and sends it to the fitness plan unit 210 and the fitness video unit 230 at the same time. Figure 5 The adjustment module 4 in the embodiment adjusts the current fitness video and sends the adjusted information or video to the client. The fitness plan unit 210 modifies the video features corresponding to the current progress information. The specific processing process is described in the above description of the method, which will not be repeated here.
[0120] The present invention also provides an electronic device, comprising a processor and a memory storing computer program instructions; when the processor executes the computer program instructions, the interactive method based on fitness video in any of the above embodiments is implemented. The electronic device in the present invention can be Figure 6 The user equipment in the embodiment, such as the mobile terminal 100 or the computer 102, may also be Figure 6 Server 200 in. Figure 8 FIG. 1 is a schematic diagram of the hardware structure of an electronic device according to an embodiment of the present invention. Figure 8 As shown, the electronic device may include a processor 601 and a memory 602 storing computer program instructions.
[0121] Specifically, the processor 601 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiment of the present invention.
[0122] The memory 602 may include a large capacity memory for data or instructions. By way of example and not limitation, the memory 602 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive or a combination of two or more of these. In appropriate cases, the memory 602 may include a removable or non-removable (or fixed) medium. In appropriate cases, the memory 602 may be inside or outside the integrated gateway disaster recovery device. In a specific embodiment, the memory 602 is a non-volatile solid-state memory.
[0123] The memory 602 may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk storage medium device, an optical storage medium device, a flash memory device, an electrical, optical or other physical / tangible memory storage device. Therefore, generally, the memory 602 includes one or more tangible (non-transitory) computer-readable storage media (e.g., a memory device) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described in any of the fitness video-based interactive methods of the present invention.
[0124] The processor 601 implements any one of the fitness video-based interaction methods in the above embodiments by reading and executing computer program instructions stored in the memory 602 .
[0125] In one example, the electronic device may further include a communication interface 603 and a bus 610. Figure 8As shown, the processor 601, the memory 602, and the communication interface 603 are connected through the bus 610 and complete the communication between each other. The communication interface 603 is mainly used to realize the communication between each module, device, unit and / or device in the embodiment of the present invention. The bus 610 includes hardware, software or both, and couples the components of the online data flow billing device to each other. For example and not limitation, the bus may include an accelerated graphics port (AGP) or other graphics bus, an enhanced industrial standard architecture (EISA) bus, a front-end bus (FSB), a hypertransport (HT) interconnect, an industrial standard architecture (ISA) bus, an infinite bandwidth interconnect, a low pin count (LPC) bus, a memory bus, a micro channel architecture (MCA) bus, a peripheral component interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a serial advanced technology attachment (SATA) bus, a video electronics standard association local (VLB) bus or other suitable buses or a combination of two or more of these. Where appropriate, the bus 610 may include one or more buses. Although the embodiments of the present invention describe and illustrate specific buses, the present invention considers any suitable bus or interconnect.
[0126] In addition, in combination with the video processing method based on the fitness plan in the above embodiment, the embodiment of the present invention can provide a computer-readable storage medium and a computer program product. The computer-readable storage medium stores computer program instructions, and when the computer program instructions are executed by the processor, any one of the interactive methods based on the fitness video in the above embodiment is implemented. The computer-readable storage medium is, for example, the various memories mentioned above. The computer program product in the present invention can be a software package or code segment that can be downloaded via a computer network such as the Internet, an intranet, etc.
[0127] It should be clear that the present invention is not limited to the specific configuration and processing described above and shown in the figures. For the sake of simplicity, a detailed description of the known method is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present invention is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps after understanding the spirit of the present invention.
[0128] The functional blocks shown in the above-described block diagram can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, etc. When implemented in software, the elements of the present invention are programs or code segments used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or a communication link by a data signal carried in a carrier wave. "Computer-readable storage medium" may include any medium capable of storing or transmitting information, may include a non-transient computer-readable storage medium, such as including an electronic circuit, a semiconductor memory device, a ROM, a flash memory, an erasable ROM (EROM), a floppy disk, a CD-ROM, an optical disk, a hard disk, an optical fiber medium, may also include a radio frequency (RF) link, etc.
[0129] It should also be noted that the exemplary embodiments mentioned in the present invention describe some methods or systems based on a series of steps or devices. However, the present invention is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the embodiments, or in a different order from the embodiments, or several steps can be performed simultaneously.
[0130] The above embodiments are only used to illustrate the present invention, but not to limit the present invention. Ordinary technicians in the relevant technical field can make various changes and modifications without departing from the scope of the present invention. Therefore, all equivalent technical solutions should also fall within the scope of the present invention.
Claims
1. An interactive method based on fitness videos, characterized in that: include: Providing the user with a current fitness video and an interactive entrance, wherein the current fitness video is a fitness video or a collection of multiple continuously played video clips obtained based on current progress information in the user's fitness plan; Monitoring the user's operation on the interactive portal; Acquiring user input information in response to the user operating the interactive portal; Determining adjustment content for the current fitness video based on the user's input information; and The current fitness video is adjusted based on the adjustment content.
2. The interactive method based on fitness video according to claim 1, characterized in that: When providing interactive entrances to users, they are provided in one or more forms of buttons, labels, pop-up windows and pages.
3. The interactive method based on fitness video according to claim 1 or 2, characterized in that: Provide users with an input method based on an interactive portal, wherein the input method includes one or more of a screen operation input method, a voice input method, a gesture operation input method, and a terminal posture operation input method.
4. The interactive method based on fitness video according to claim 1, characterized in that: The interactive entrance is provided in the user personal interface or in the playback interface of the current fitness video.
5. The interactive method based on fitness video according to claim 1, characterized in that: The interaction entrance corresponds to an information category, and the information category includes a preference category or an instant feedback content category.
6. The interactive method based on fitness video according to claim 5, characterized in that: The instant feedback content category includes at least one or more negative information items.
7. The interactive method based on fitness video according to claim 5 or 6, characterized in that: The step of determining the adjustment content of the current fitness video based on the information input by the user includes: Determine the target information category corresponding to the interactive entry based on the interactive entry; Extracting content corresponding to the target information category from the user's input information; and Based on the correspondence between the video adjustment feature and the information category, the video adjustment feature corresponding to the target information category is determined, and the content of the target information category is used as the feature value of the video adjustment feature, and the video adjustment feature and its feature value are used as the adjustment content of the current fitness video.
8. The interactive method based on fitness video according to claim 7, characterized in that: When the information category is a preference category, the step of adjusting the current fitness video based on the adjustment content includes: Locate the adjusted video segment that needs to be replaced from the current fitness video; Determining the video adjustment duration based on the adjusted video segment or the video adjustment feature value; Acquire video features and feature values corresponding to the current progress information, and replace the feature values of the video features that are the same as the video adjustment features with the video adjustment feature values to obtain updated video features and feature values; Matching multiple video clips from a video database based on the updated video features and their feature values to obtain an adjusted video set; Acquire one or more target adjusted video segments from the adjusted video set according to the video adjustment duration; and The located adjusted video segments are deleted from the current fitness video, and the one or more target adjusted video segments are added to the current fitness video.
9. The interactive method based on fitness video according to claim 7, characterized in that: When the information category is an instant feedback content category and its content is negative information item content, the step of adjusting the current fitness video based on the adjustment content includes: Locate the adjusted video segment that needs to be replaced from the current fitness video; Determining the video adjustment duration based on the adjusted video segment or the video adjustment feature value; Adding the video adjustment feature and its feature value to the video feature set corresponding to the current progress information, and marking it as the video feature value that needs to be filtered to obtain an updated video feature set; matching a plurality of video clips from a video database based on the updated video feature set after the updating to obtain an adjusted video set; Acquire one or more target adjusted video segments from the adjusted video set according to the video adjustment duration; and The located adjusted video segments are deleted from the current fitness video, and the one or more target adjusted video segments are added to the current fitness video.
10. The interactive method based on fitness video according to claim 8 or 9, characterized in that: The steps of locating the adjusted video segment to be replaced from the current fitness video include: Based on the video adjustment feature value, one or more video segments are determined from the current fitness video as the adjusted video segments; or, in the current fitness video playback scene, the operation moment of the user operation interaction entrance is obtained, and all video segments after the corresponding operation moment in the current fitness video are determined as the adjusted video segments.
11. An interactive device based on fitness videos, characterized in that: include: An interactive interface module, configured to provide a current fitness video and an interactive entrance to the user, wherein the current fitness video is a fitness video or a collection of multiple fitness videos played continuously obtained based on the user's current progress information determined based on the fitness plan; an operation monitoring module configured to monitor the user's operation on the interactive portal, and obtain user input information in response to the user's operation on the interactive portal; an adjustment content determination module configured to determine adjustment content for the current fitness video based on user input information; and The adjustment module is configured to adjust the current fitness video based on the adjustment content.
12. An electronic device, characterized in that: The electronic device comprises a processor and a memory storing computer program instructions; when the electronic device executes the computer program instructions, the interactive method based on fitness video as described in any one of claims 1-10 is implemented.
13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer program instructions, and when the computer program instructions are executed by a processor, the interactive method based on a fitness video as described in any one of claims 1 to 10 is implemented.
14. A computer program product, characterized in that It includes computer program instructions, which, when executed by a processor, implement the interactive method based on fitness videos as described in any one of claims 1-10.
Citation Information
Cited By
Peking Opera interactive experience method and device based on motion capture
CN121438396A
