Audio and video playing method and device, terminal equipment and storage medium
By setting up multiple video acquisition and output devices in the fitness equipment, multi-angle playback of fitness videos and multi-directional collection and display of user action videos is solved, and the problem that existing fitness equipment cannot achieve comprehensive guidance and monitoring is improved, and the fitness experience and teaching effect of fitness users are improved.
Patent Information
- Application Number
- CN202311190009.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-15
- Publication Date
- 2025-03-18
AI Technical Summary
Existing fitness equipment cannot achieve comprehensive guidance and monitoring of fitness users, resulting in poor fitness experience for fitness users.
By setting at least two video acquisition devices and video output devices on the user side and the coach side, multi-angle playback of fitness videos and multi-directional acquisition and display of user action videos are realized, providing a comprehensive immersive experience in fitness scenes.
It improves the fitness experience of fitness users, realizes multi-faceted guidance and monitoring of fitness users, and enhances the effect of fitness teaching and user participation.
Smart Images

Figure CN119653250A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of communication technology, and more specifically, to an audio and video playback method, apparatus, terminal equipment and storage medium in the field of communication technology. Background Art
[0002] As people pay more and more attention to their physical health, more and more people choose to stay healthy through fitness. In order to save time, many office workers choose to learn fitness videos at home to exercise at home. Correspondingly, home fitness solutions have emerged: a variety of online fitness courses and live fitness, as well as various smart fitness equipment derived from home fitness, such as smart fitness mirrors and other fitness equipment. Smart fitness mirrors are intelligent fitness equipment that combines artificial intelligence technology. They generally have cameras, display screens, speakers and other equipment. They can record the user's exercise posture, speed, heart rate and other exercise data, and provide real-time feedback and guidance based on the user's exercise posture.
[0003] At present, fitness users usually use a single device to perform online or offline fitness; for example, watching fitness videos or capturing action videos through a single device, and displaying prompt information to fitness users through a single device; however, using a single device to perform fitness cannot provide all-round guidance and monitoring for fitness users, resulting in a poor fitness experience for fitness users. Summary of the invention
[0004] The present application provides an audio and video playback method, apparatus, terminal device and storage medium, which can enable fitness users to achieve an immersive experience of all-round fitness scenes and improve the fitness experience of fitness users.
[0005] In a first aspect, an audio and video playback method is provided, the method being applied to a user terminal, the method comprising:
[0006] In response to a selection operation by a fitness user, determining at least two first video acquisition devices and at least two first video output devices, wherein each of the at least two first video acquisition devices is located at a different position, and each of the at least two first video output devices is located at a different position;
[0007] Acquire a fitness video to be played, and control at least two first video output devices to play the fitness video to be played;
[0008] Controlling at least two first video acquisition devices to acquire an action video of a fitness user, wherein the action video includes a posture of the first user;
[0009] Control some or all of the at least two first video output devices to output target prompt information corresponding to the posture of the fitness user.
[0010] In a second aspect, an audio and video playback method is provided, which is applied to a coach end, and the method includes:
[0011] detecting a first selection operation on a first fitness mode, where the first fitness mode is used to instruct to perform online fitness teaching to a fitness user;
[0012] In response to a second selection operation, determining at least two second video acquisition devices and at least two second video output devices, each of the at least two second video acquisition devices being located at a different position, and each of the at least two second video output devices being located at a different position;
[0013] Control at least two second video acquisition devices to acquire a fitness coach's fitness video, and send the fitness video to a user terminal of a fitness user;
[0014] receiving an action video of a fitness user, where the action video includes a posture of the fitness user;
[0015] At least two second video output devices are controlled to play the action video of the fitness user, so that the fitness coach can provide online fitness teaching to the fitness user.
[0016] In a third aspect, an audio and video playback device is provided, the device comprising:
[0017] A first determination module is used to determine at least two first video acquisition devices and at least two first video output devices in response to a selection operation of a fitness user, wherein each of the at least two first video acquisition devices is located at a different position, and each of the at least two first video output devices is located at a different position;
[0018] A first playing module, used for acquiring a fitness video to be played, and controlling at least two first video output devices to play the fitness video to be played;
[0019] A collection module, used to control at least two first video collection devices to collect action videos of fitness users, where the action videos include postures of fitness users;
[0020] The display module is used to control some or all of the at least two first video output devices to output target prompt information corresponding to the posture of the fitness user.
[0021] In a fourth aspect, an audio and video playback device is provided, the device comprising:
[0022] A detection module, configured to detect a first selection operation on a first fitness mode, where the first fitness mode is used to instruct a fitness user to perform online fitness teaching;
[0023] A second determination module is used to determine at least two second video acquisition devices and at least two second video output devices in response to a second selection operation, wherein each of the at least two second video acquisition devices is located at a different position, and each of the at least two second video output devices is located at a different position;
[0024] A sending module, used for controlling at least two second video acquisition devices to acquire a fitness coach's fitness video, and sending the fitness video to a user terminal of a fitness user;
[0025] A receiving module, used to receive an action video of a fitness user, where the action video includes the posture of the fitness user;
[0026] The second playback module is used to control at least two second video output devices to play the action video of the fitness user, so that the fitness coach can provide online fitness teaching to the fitness user.
[0027] In a fifth aspect, an audio and video playback system is provided, including a user end and a coach end, the user end is used to execute the method in the above-mentioned first aspect or any possible implementation of the first aspect, and the coach end is used to execute the method in the above-mentioned second aspect or any possible implementation of the second aspect.
[0028] In a sixth aspect, a terminal device is provided, comprising a memory and a processor. The memory is used to store executable program code, and the processor is used to call and run the executable program code from the memory, so that the terminal device executes the method in the first aspect or any possible implementation of the first aspect.
[0029] In a seventh aspect, another terminal device is provided, comprising a memory and a processor. The memory is used to store executable program code, and the processor is used to call and run the executable program code from the memory, so that the terminal device executes the method in the second aspect or any possible implementation of the second aspect.
[0030] In an eighth aspect, a computer program product is provided, comprising: a computer program code, which, when executed on a computer, enables the computer to execute the method of the first aspect or any possible implementation of the first aspect, or to execute the method of the second aspect or any possible implementation of the second aspect.
[0031] In the ninth aspect, a computer-readable storage medium is provided, which stores a computer program code. When the computer program code runs on a computer, the computer executes the method in the above-mentioned first aspect or any possible implementation of the first aspect, or executes the above-mentioned second aspect or any possible implementation of the second aspect.
[0032] In the above technical solution, when the user terminal obtains the fitness video to be played, the fitness video is played through at least two first video output devices; since each of the at least two first video output devices is located at a different position and each first video output device plays the fitness video, the fitness user can watch the fitness video at different positions, thereby allowing the fitness user to watch the fitness video in an immersive manner; in addition, in the solution of the present application, when the fitness user watches the fitness video for fitness, the action video of the fitness user at various angles can be collected through at least two first video acquisition devices at different positions; some or all of the at least two first video output devices are controlled to output target prompt information corresponding to the posture of the fitness user; the target prompt information is displayed by some or all of the video output devices at different positions, so that the fitness user can achieve an immersive experience of all-round fitness scenes, thereby improving the fitness experience of the fitness user.
[0033] In the above technical solution, when a fitness coach conducts online fitness teaching to a fitness user, the coach end can collect the fitness coach's fitness video through at least two second video acquisition devices, and send the collected fitness video to the user end of the fitness user; since each of the at least two second video acquisition devices is located at a different position, the fitness video sent by the coach end to the user end is the fitness video of the fitness coach at different angles, so that all-round fitness posture teaching for the fitness user can be achieved; in addition, the coach end can also receive the action video of the fitness user, and play the action video of the fitness user on at least two second video output devices; since each of the at least two second video output devices is located at a different position, the fitness coach end can watch the action video of the fitness user at different positions, and provide online teaching guidance to the fitness user's fitness actions in a more timely manner. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] Figure 1 This is a schematic diagram of a scene of fitness video playback provided in an embodiment of the present application;
[0035] Figure 2 It is a structural diagram of an audio and video playback system provided in an embodiment of the present application;
[0036] Figure 3It is a structural diagram of another audio and video playback system provided in an embodiment of the present application;
[0037] Figure 4 is a schematic diagram of interaction between terminal devices provided in an embodiment of the present application;
[0038] Figure 5 is a schematic flow chart of an audio and video playback method provided in an embodiment of the present application;
[0039] Figure 6 This is an interface display diagram of a terminal device provided in an embodiment of the present application;
[0040] Figure 7 is a schematic diagram of the location of a video output device provided in an embodiment of the present application;
[0041] Figure 8 is a schematic flow chart of a posture detection method provided in an embodiment of the present application;
[0042] Fig. 9 is a schematic diagram of a virtual image provided in an embodiment of the present application;
[0043] Fig.10 is a schematic flow chart of a method for generating initial prompt information provided in an embodiment of the present application;
[0044] Fig.11 It is a schematic diagram of an interface of a user terminal device and a coach terminal device provided in an embodiment of the present application;
[0045] Fig.12 is a schematic flow chart of another video playback method provided in an embodiment of the present application;
[0046] Fig.13 It is a structural schematic diagram of an audio and video playback device provided in an embodiment of the present application;
[0047] Fig.14 is a structural schematic diagram of another audio and video playback device provided in an embodiment of the present application;
[0048] Fig.15 It is a structural diagram of a terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0049] The technical solution in the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B: "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0050] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features.
[0051] Before explaining the audio and video playback method provided in the embodiment of the present application, the terms involved in the embodiment of the present application are first explained and illustrated.
[0052] 1. Artificial Intelligence (AI) Camera Fitness
[0053] AI camera fitness refers to an intelligent fitness mode that uses a camera with artificial intelligence technology to provide athletes with autonomous training and guidance services by identifying and tracking human bones and postures. This fitness mode uses AI algorithms for motion analysis and posture correction, and monitors and provides feedback on the athlete's movements in real time, thereby improving fitness effects and safety.
[0054] 2. Live Fitness
[0055] Live fitness refers to fitness coaches performing live fitness on live platforms, and users can watch the live broadcast and participate in training through the Internet. This fitness method is not restricted by location, and it can also reduce the possible contact between traditional fitness coaches and users.
[0056] 3. Online fitness classes
[0057] Online fitness courses refer to fitness institutions or fitness coaches publishing and providing fitness courses, fitness plans, etc. on the Internet platform. Users can train at their own time and place, and user training is not restricted by time and place. This fitness method is often implemented with the help of fitness applications (applicants, APPs) or fitness platforms. Users can choose some popular or high-level fitness courses to exercise, and can also self-combine and self-adjust according to their physical condition, fitness goals and preferences. This fitness method is more flexible, personalized and convenient, and has greater freedom in time, place, and cost.
[0058] 4. Smart fitness equipment (e.g., smart fitness mirror)
[0059] Users can watch fitness videos on the display screen of the smart fitness mirror and follow the fitness videos to exercise. The camera on the smart fitness mirror collects the user's fitness movements and provides guidance for the user's fitness movements. Users can use the smart fitness mirror for digital training and complete fitness plans, tracking, feedback and data analysis in one stop.
[0060] As users' attention to health gradually increases, the field of home fitness has received more and more attention. Correspondingly, many home fitness solutions have emerged: rich online fitness courses and live fitness, as well as various smart fitness equipment derived from home fitness, such as AI cameras, smart fitness mirrors, etc., further creating more mature conditions and diverse experiences for people's home fitness.
[0061] Currently, if Figure 1 As shown, when users exercise through smart devices, they can only watch fitness videos on the screen of the fitness device; once the user moves, they may not be able to watch fitness videos. That is, currently, fitness videos are played only on one terminal device, and users can only watch them on one terminal device. When the location of the terminal device is determined, users can only watch videos in front of the terminal device. Once the user's head turns to other directions, the user cannot watch the video. In addition, the fitness device can only collect the user's fitness movements through a camera installed on the fitness device to provide movement guidance, and cannot monitor and guide the user's fitness movements in an all-round way, resulting in a poor fitness experience for users.
[0062] Based on this, an embodiment of the present application provides an audio and video playback method, which can enable fitness users to achieve an immersive experience of all-round fitness scenes and improve the fitness experience of fitness users.
[0063] The following describes in detail the audio and video playback method provided in the embodiment of the present application, taking the teaching video follow-up mode and the coach online teaching mode as examples.
[0064] Figure 2 It is a structural diagram of an audio and video playback system provided in an embodiment of the present application. Figure 2 The audio and video playback system in can correspond to the teaching video follow-up mode.
[0065] like Figure 2 As shown, the audio and video playback system includes a user terminal device 210, and the user terminal device 210 may include: a supported input device, a terminal device of a fitness user, and a supported output device; wherein the terminal device 211 of the fitness user includes: a near-field media transmission module (a first media transmission module), a fitness data transmission module, a virtual image module, a video data module, and an audio data module; the supported devices include at least two video acquisition devices 212 and at least two video output devices 213; Figure 2 An example is given in which two video acquisition devices include a laptop computer and a tablet computer, and an example is given in which two video output devices include a laptop computer and a tablet computer.
[0066] It should be understood that the difference between the terminal device 211 of the fitness user and the at least two video output devices is that the fitness user can operate on the terminal device 211 of the fitness user, and the terminal device 211 of the fitness user can respond to the operation of the fitness user to obtain the fitness video to be played, similar to the fitness device. The at least two video output devices can be understood as video projection devices; for example, projection devices for fitness videos.
[0067] It should be understood that in the embodiments of the present application, fitness users may also be referred to as fitness students; fitness users may watch fitness videos on a projection device, i.e., at least two video output devices.
[0068] For example, the near-field media transmission module is used for the terminal device to establish a near-field connection with an Internet of Things (IoT) device (such as a smart watch, tablet computer, laptop computer, smart TV, speaker, etc.) and to transmit media data and separate audio and video. Among them, establishing a near-field connection refers to establishing a communication connection with an IoT device within a preset range of the terminal device. The preset range can be pre-set, and the embodiments of the present application are not limited to this. For example, when the terminal device is at the home of a fitness user, a near-field connection can be established between the IoT device at the fitness user's home and the terminal device.
[0069] For example, the fitness data module is used to collect and process data of the smart wearable device. Furthermore, the fitness data module may also include a fitness data collection module, a fitness data encoding module, and a fitness data decoding module. Among them, the fitness data collection module is used to collect fitness data, the fitness data encoding module is used to encode the collected fitness data, and the fitness data decoding module is used to decode the encoded fitness data.
[0070] For example, the virtual image module is used to generate and display the virtual image and detect the posture of the fitness user. Furthermore, the virtual image module may also include a virtual image generation module, a posture detection module and a virtual image display module. Among them, the virtual image generation module is used to generate the virtual image, the posture detection module is used to detect the user's posture, and the virtual image display module is used to display the virtual image. The virtual image can also be called a virtual posture.
[0071] For example, the video data module is used to collect, encode, decode, record and play video data. Furthermore, the video data module may include a multi-end video collection module, a video encoding module, a video decoding module, a multi-end video playback module and a video recording module. Among them, the multi-end video collection module is used to collect multi-end videos, the video encoding module is used to encode the collected multi-end videos, the video decoding module is used to decode the encoded multi-end videos, the multi-end video playback module is used to play the decoded multi-end videos, and the video recording module is used to record the played multi-end videos.
[0072] For example, the audio data module is used to collect, encode, decode, record and play audio data. Furthermore, the audio data module may include an audio collection module, an audio encoding module, an audio decoding module, an audio playback module and an audio recording module. Among them, the audio collection module is used to collect audio, the audio encoding module is used to encode the collected audio, the audio decoding module is used to decode the encoded audio, the audio playback module is used to play the decoded audio, and the audio recording module is used to record the played audio.
[0073] Exemplarily, in response to the selection operation of the fitness user, the terminal device of the fitness user can establish a near-field connection with at least two video acquisition devices 212 and at least two video output devices 213 selected by the fitness user through the near-field media transmission module.
[0074] Exemplarily, the terminal device 211 of the fitness user is used to determine at least two video capture devices 212 and at least two video output devices 213 in response to the selection operation of the fitness user; and, is used to obtain offline fitness videos and send fitness videos to at least two video output devices 213; and, when the fitness user is exercising, the terminal device 211 of the fitness user is used to obtain the action video of the fitness user captured by at least two video capture devices 213; wherein, each of the at least two video output devices is located at a different position, and each of the at least two video capture devices is located at a different position.
[0075] Optionally, the terminal device of the fitness user can store some fitness videos locally, and when the fitness user wants to watch the fitness video, the locally stored offline fitness video can be directly obtained on the terminal device of the fitness user. Exemplarily, each of the at least two video output devices can play the fitness video at the same time; it can be understood that the screen content played in each video device is the same.
[0076] Optionally, the supported input device may also include an audio device, which is used to collect audio; for example, the audio device may be a smart speaker. Correspondingly, the supported output device may also include an audio device, which is used to play audio; for example, the audio device may be a smart speaker.
[0077] Exemplarily, the video output device in the embodiment of the present application may only display the video image and play the audio through the speaker; or, the video output device may also display the video image and play the audio at the same time.
[0078] Optionally, the supported input devices may also include smart wearable devices; in the solution of the present application, the smart wearable device can be used to collect physiological characteristic data; for example, detecting the user's heart rate data, blood pressure and other physiological characteristic data during fitness; exemplarily, the smart wearable device can be a smart watch, a smart bracelet, etc.
[0079] For example, the terminal device may be any electronic product that can interact with the user through one or more methods such as keyboard, touch pad, touch screen, remote control, voice interaction or handwriting device, such as personal computer (PC), mobile phone, smart phone, personal digital assistant (PDA), Pocket PC (Personal Digital Assistant), tablet computer, smart TV, etc.
[0080] Figure 3 It is a structural diagram of another audio and video playback system provided in an embodiment of the present application. Figure 3The audio and video playback system in the can correspond to the coach online teaching mode. Figure 3 As shown, the audio and video playback system includes a user terminal device 210 and a coach terminal device 220 .
[0081] Among them, the user-end device 210 and the coach-end device 220 can perform media data transmission through a far-field media transmission module; illustratively, the media data may include: audio data transmission, video data transmission, and fitness data transmission, etc., and the fitness data may include, for example, the user's heart rate, blood pressure and other physiological characteristic data.
[0082] Exemplarily, the user terminal device 210 includes: a supported input device, a terminal device of a fitness user, and a supported output device; wherein the terminal device of the fitness user includes: a near-field media transmission module, a fitness data module, a virtual image module, a video data module, and an audio data module; optionally, the functions of each module refer to Figure 2 The relevant description will not be repeated here.
[0083] Exemplarily, the coach terminal device 220 includes: a supported input device, a fitness coach terminal device and a supported output device; wherein the fitness coach terminal device includes: a near-field media transmission module, a fitness data module, a virtual image module, a video data module, and an audio data module; optionally, the functions of each module refer to Figure 2 The relevant description will not be repeated here.
[0084] Exemplarily, in response to the selection operation of the fitness user, the terminal device of the fitness user can establish a near-field connection with at least two video acquisition devices and at least two video output devices selected by the fitness user through the near-field media transmission module.
[0085] Exemplarily, the fitness coach's terminal device obtains the fitness video of the fitness coach captured by at least two video capture devices through the near-field media transmission module, and sends the fitness video to the terminal device of the fitness user through the far-field media transmission media, and the terminal device of the fitness user receives the fitness video through the far-field media transmission module.
[0086] For example, the terminal device of the fitness user uploads the fitness coach's fitness video to the server through the network, and the server then transmits the fitness video to the terminal device of the fitness user. When the terminal device of the fitness user receives the fitness video, it sends the fitness video to at least two video output devices through the near-field media transmission module, so that the at least two video output devices play the fitness video.
[0087] Combine the following Figure 4 Taking the coach's online teaching mode as an example, the processes of fitness video acquisition, transmission and display are described.
[0088] like Figure 4 As shown, the terminal device of the fitness coach is used to obtain the teaching video (fitness video of the fitness coach) collected by the video collection device through the multi-terminal video collection module, and encode the teaching video through the video encoding module; the audio module is used to obtain the audio collected by the audio device, and encode the audio through the audio encoding module; the fitness data is used to obtain the physiological characteristic data collected by the smart wearable device through the collection module, and encode the physiological characteristic data through the fitness data encoding module, and then the encoded teaching video, audio, and physiological characteristic data are sent to the terminal device of the fitness user through the far-field media transmission module.
[0089] It should be understood that the video acquisition device, video output device, audio device and smart wearable device here are devices that establish a near-field connection with the terminal device of the fitness coach.
[0090] Exemplarily, after receiving the teaching video, audio, and physiological characteristic data, the terminal device of the fitness student can decode the teaching video through the video decoding module; decode the audio through the audio decoding module, and decode the physiological characteristic data through the fitness data decoding module; then the multi-terminal video playback module plays the teaching video through the video output device, the audio playback module plays the audio through the audio device, and the fitness data display module displays the physiological characteristic data through the smart wearable device.
[0091] It should be understood that the video output device, audio device and smart wearable device here are devices that establish a near-field connection with the terminal device of the fitness user.
[0092] In addition, the terminal device of the fitness user can also use the multi-terminal video acquisition module to obtain the fitness user's fitness action video captured by the video acquisition device, and then generate the fitness user's virtual posture through the virtual image generation module; display the fitness user's virtual posture through the virtual image display module, detect the fitness user's virtual posture through the action detection module, and send the fitness user's virtual posture to the terminal device of the fitness coach through the far-field media transmission module. The terminal device of the fitness coach can display the fitness user's virtual posture in the video output device through the virtual image display module.
[0093] Here we only briefly explain the interaction between the terminal device of the fitness user and the terminal device of the fitness coach, which will be explained in detail later.
[0094] In the embodiments of the present application, the terminal devices of the fitness user and the terminal devices of the fitness coach may be, for example, smart phones, smart tablets and other devices; the video acquisition device and the video output device may include, for example, tablet computers, smart TVs and other devices.
[0095] Optionally, in an embodiment of the present application, a terminal device of a fitness user and at least two video acquisition devices and at least two video output devices are connected to the same wireless network.
[0096] Optionally, in an embodiment of the present application, the terminal device of the fitness user shares the same account with at least two video capture devices and at least two video output devices; through this account, at least two video capture devices can capture the action video of the fitness user, the terminal device of the fitness user can obtain the fitness video, and the fitness video can be played on at least two video output devices.
[0097] Next, the audio and video playback method provided in the embodiment of the present application is explained in detail.
[0098] Figure 5 is a schematic flow chart of a video playback method provided in an embodiment of the present application. The method can be applied to Figure 2 or Figure 3 Terminal devices for fitness users, such as Figure 5 As shown, the method includes:
[0099] S510: In response to a selection operation of a fitness user, at least two first video acquisition devices and at least two first video output devices are determined, each of the at least two first video acquisition devices is located at a different position, and each of the at least two first video output devices is located at a different position.
[0100] For example, Figure 6 As shown, the fitness user can click the "Enable near-field transmission" control on the interface of the fitness user's terminal device; after clicking the control, the fitness user can select at least two video capture devices for capturing the fitness user's action videos during fitness, and at least two video output devices for playing the fitness videos to be played.
[0101] The at least two video capture devices and the at least two video output devices may be completely identical devices, that is, the at least two video capture devices are identical to all of the at least two video output devices. It should be understood that if a device has a camera and a display screen, the device can be used as a video output device to display fitness videos through the display screen; it can also be used as a video capture device to capture the action video of the fitness user during fitness through the camera.
[0102] For example, a fitness user may select a tablet computer and a laptop computer with a camera and a display screen as both video acquisition devices and video output devices, and then at least two video acquisition devices and at least two video output devices are completely the same devices.
[0103] The at least two video acquisition devices and the at least two video output devices may also be completely different devices. For example, a fitness user may select a video camera with a camera and a laptop computer as video acquisition devices, and select a smart TV with a display screen and a tablet computer as video output devices. Then, the at least two video acquisition devices and the at least two video output devices are completely different devices.
[0104] The at least two video acquisition devices and the at least two video output devices may also be partially identical and partially different devices, that is, the at least two video acquisition devices are identical to some of the at least two video output devices. For example, a fitness user may select a video camera with a camera and a laptop computer as video acquisition devices, and select a smart TV with a display screen and a laptop computer as video output devices, then the at least two video acquisition devices and the at least two video output devices are partially identical and partially different devices.
[0105] For example, if the user selects a tablet and a laptop as at least two video acquisition devices, and selects a tablet and a smart TV as at least two video output devices, after the fitness user selects, Figure 6 As shown, the icons of "tablet computer collection and display", "smart TV display" and "laptop computer collection" will appear on the interface of the fitness user's terminal device.
[0106] It should be understood that the fitness user places at least two video output devices that need to be connected to the terminal device of the fitness user in different positions in advance. For example, the fitness user places a tablet computer in front of the fitness user, places a smart TV on the left side of the fitness user, and places a laptop computer on the right side of the fitness user. Figure 7 Each of the video output devices selected by the user is located at a different position, so that subsequent fitness users can watch fitness videos in the front, left, and right sides, thereby improving the user experience.
[0107] Correspondingly, the fitness user also places at least two video capture devices that need to establish connections with the fitness user's terminal device in different positions in advance, and each of the at least two video capture devices is located at a different position. In this way, when the fitness user is exercising, at least two video capture devices can capture action videos of the fitness user at different angles.
[0108] Optionally, the fitness user can also select an audio device for collecting or outputting audio. If the user selects a smart TV as the audio device, after the fitness user selects, Figure 6 As shown, a "Smart TV plays audio" logo will appear on the interface of the fitness user's terminal device.
[0109] Optionally, the fitness user can also select a smart wearable device. In the case where the smart wearable device is a smart watch, the fitness user wears the smart watch on the wrist, and the smart watch is used to collect the fitness user's physiological characteristic data. The physiological characteristic data may include the fitness user's heart rate, blood pressure and other data. If the user selects a smart watch as the smart wearable device, after the fitness user selects it, Figure 6 As shown, a “smart watch collection” logo will appear on the interface of the fitness user’s terminal device.
[0110] When the fitness user completes the selection, the fitness user's terminal device establishes a communication connection with at least two video acquisition devices, at least two video output devices, an audio device, and a smart wearable device through the near-field media transmission module. Subsequently, the combined application of these devices will be used to realize operations such as video playback and posture prompts.
[0111] S520: Acquire a fitness video to be played, and control at least two first video output devices to play the fitness video to be played.
[0112] Fitness users can select fitness modes on their terminal devices. Fitness modes include online coach teaching mode and teaching video follow-up mode.
[0113] In a possible implementation, when the terminal device of the fitness user detects a selection operation on a first fitness mode, where the first fitness mode is used to instruct the fitness user to perform online fitness teaching, the terminal device of the fitness user can determine that the fitness user has selected the coach online teaching mode.
[0114] In one possible implementation, when the terminal device of the fitness user detects a selection operation on the second fitness mode, and the second fitness mode is used to instruct the fitness user to perform offline fitness teaching, the terminal device of the fitness user can determine that the fitness user selects the teaching video follow-up mode.
[0115] Correspondingly, when the fitness user selects the coach online teaching mode, the implementation process of obtaining the fitness video to be played in S502 may be: obtaining the fitness video to be played in the terminal device of the fitness user.
[0116] When the fitness user selects the teaching video follow-up mode, the implementation process of obtaining the fitness video to be played in S502 may be: obtaining the fitness video to be played sent by the terminal device of the fitness coach.
[0117] Among them, the terminal device of the fitness user can obtain the fitness video to be played sent by the terminal device of the fitness coach through the far-field media transmission module.
[0118] When the terminal device of the fitness user obtains the fitness video, since the fitness user has set at least two video output devices for playing the fitness video in S510, the terminal device of the fitness user transmits the fitness video to the at least two video output devices through the near-field media transmission module, and controls the at least two video output devices to play the fitness video simultaneously. In this way, the fitness user can watch the fitness video in all directions and realize the immersive experience of the fitness scene.
[0119] Based on the above example, the terminal device of the fitness user determines three video output devices in response to the selection operation of the fitness user. These three video output devices include a tablet computer, a laptop computer, and a smart TV, and these three video output devices also serve as audio devices. Among them, the tablet computer is placed in front of the fitness user, the smart TV is placed on the left side of the fitness user, and the laptop computer is placed on the right side of the fitness user. When the terminal device of the fitness user receives the fitness video, the fitness video is transmitted to the three video output devices through the near-field media transmission module. When the three video output devices receive the fitness video, they play the fitness video at the same time. In this way, the fitness user can watch the fitness video in the front, left, and right directions. Figure 7 As shown, if the fitness user is currently located in front of the tablet computer, that is, watching the fitness video through the tablet computer, when the user turns left or right, he or she can also watch the fitness video through the smart TV on the left or the laptop on the right.
[0120] In addition, in the coach online teaching mode, the fitness coach can also select at least two video acquisition devices, at least two video output devices, audio devices, and smart wearable devices on the fitness coach's terminal device, and after the fitness coach completes the selection, the fitness coach's terminal device establishes a communication connection with at least two video acquisition devices, at least two video output devices, audio devices, and smart wearable devices through a near-field media transmission module. When the fitness coach performs fitness teaching, at least two video acquisition devices collect the fitness coach's fitness video, and transmit the fitness coach's fitness video to the fitness coach's terminal device through the near-field media transmission module, and the fitness coach's terminal device sends the fitness coach's fitness video to the fitness user's terminal device through the far-field transmission module, and at least two video output devices that establish a communication connection with the fitness user's terminal device can receive and play the fitness coach's fitness video. Therefore, in this scenario, the fitness video received by the fitness user's terminal device can be the fitness coach's online fitness video.
[0121] Moreover, similar to the way in which a fitness user places at least two video output devices, a fitness coach may also place at least two video acquisition devices at different locations. In this scenario, the fitness video may include multiple fitness videos, which may be posture videos of the fitness coach acquired from different angles.
[0122] Moreover, in the scenario where there are multiple fitness videos, the implementation process of S520 may be: obtaining multiple fitness videos; controlling each of at least two video output devices to play multiple fitness videos. That is, each video output device that establishes a communication connection with the terminal device of the fitness user plays the multiple fitness videos. In this way, the fitness user can watch the fitness videos of the fitness coach from different angles in all directions. The fitness user watching the fitness videos of the fitness coach from different angles helps the fitness user to better adjust his or her posture during fitness.
[0123] Optionally, in a scenario where there are multiple fitness videos, each of the at least two video output devices plays a different fitness video. In this case, the number of the at least two video output devices should be less than or equal to the number of the multiple fitness videos. Since each video output device must play a fitness video, if the number of fitness videos is less than the number of video output devices, there must be a video output device that plays the same fitness video as the other video output devices. For example, there are 3 video output devices and 2 fitness videos to be played. If each video output device plays a fitness video, then there must be a video output device that plays the same fitness video as the other video output device.
[0124] In a possible implementation, if the number of at least two video output devices should be less than or equal to the number of multiple fitness videos, the implementation process of S520 can also be: obtaining multiple fitness videos; controlling each of the at least two video output devices to play at least one fitness video to be played among the multiple fitness videos to be played, and the fitness videos to be played played in each video output device are different.
[0125] For example, the terminal device of the fitness user obtains three fitness videos, and the at least two video output devices that establish a communication connection with the terminal video of the fitness user include two video output devices. The terminal device of the fitness user can control one of the two video output devices to play the two fitness videos, and the other video output device to play the remaining fitness video, so as to ensure that each video output device plays a fitness video and each video output device plays a different fitness video.
[0126] For example, if the number of fitness videos is the same as the number of video output devices, the terminal device of the fitness user can control each video output device to play a fitness video, and different video output devices play different fitness videos. If the fitness video includes a fitness video in the square of the fitness coach, a fitness video on the left side of the fitness coach, and a fitness video on the right side of the fitness coach, and the video output device includes three video output devices located in the square, left side, and right side of the fitness user, respectively, the terminal device of the fitness user can control the video output device located in the square of the fitness user to play the fitness video in the square of the fitness coach, the video output device located in the left side of the fitness user to play the fitness video on the left side of the fitness coach, and the video output device located in the right side of the fitness user to play the fitness video on the right side of the fitness coach. When the fitness user watches the fitness video through at least two video output devices, he will follow the posture of the fitness coach in the fitness video to move, and the embodiment of the present application can also detect and prompt the posture of the fitness user through subsequent operations.
[0127] S530: Control at least two first video acquisition devices to acquire an action video of a fitness user, where the action video includes a posture of the fitness user.
[0128] After the fitness user selects at least two video acquisition devices on the fitness user's terminal device, when the fitness user follows the fitness video, the at least two video acquisition devices can acquire the action video of the fitness user during exercise, and the action video includes various postures of the fitness user during exercise. When the at least two video acquisition devices acquire the action video, they upload the action video to the fitness user's terminal device through the near-field media transmission module.
[0129] S540: Control some or all of the at least two first video output devices to output target prompt information corresponding to the posture of the fitness user.
[0130] In one possible implementation, if the posture of the fitness user is not standard, some or all of the at least two first video output devices are controlled to output target prompt information, and the target prompt information is used to prompt the fitness user that the posture is not standard; if the posture of the fitness user is standard, some or all of the at least two first video output devices are controlled to output target prompt information, and the target prompt information is used to prompt the fitness user that the posture is standard.
[0131] Among them, when a fitness user exercises according to a fitness video, the fitness movements performed by the fitness user may be different from the fitness movements in the fitness video. If the difference is large, it can be considered that the posture of the fitness user is not standard and needs to be adjusted. Here, the posture in the fitness video is considered to be a standard posture. If the difference is small, it is considered that the posture of the fitness user is standard. Therefore, the target prompt information can be prompt information when the posture of the fitness user is not standard, that is, the fitness movement of the fitness user is very different from the fitness movement in the fitness video, and the prompt information is used to prompt the fitness user to pay attention to the posture. It can also be prompt information when the posture of the fitness user is standard, that is, when the fitness movement of the fitness user is the same as the fitness movement in the fitness video or the difference is small, it is used to encourage the fitness user, such as "The fitness posture is completely standard, great."
[0132] Therefore, the embodiment of the present application can detect the action video of the fitness user to detect whether the posture in the action video of the fitness user is standard, and output target prompt information to prompt the fitness user.
[0133] In a possible implementation, when the posture of the fitness user is standard, the target prompt information is output through the video output device to prompt the fitness user that there may be situations that affect the normal fitness of the fitness user, so the fitness user may not be prompted when the posture of the fitness user is standard. When the posture of the fitness user is not standard, the target prompt information is output through the video output device to prompt the fitness user to pay attention to the posture. Subsequently, when the posture of the fitness user is not standard, the target prompt information is output to prompt the fitness user.
[0134] The target prompt information can be displayed in some or all of the at least two video output devices. If the target prompt information is displayed in each video output device, since the at least two video output devices are located at different positions, the fitness user can view the target prompt information in time at different positions.
[0135] It should be understood that, normally, when exercising, fitness users often look at the video output device directly in front of them, so the target prompt information can be displayed on the video output device directly in front of the fitness user among the at least two video output devices, that is, the target prompt information can be displayed on some of the at least two video output devices.
[0136] Among them, the fitness user can set up in advance on the terminal device of the fitness user to select the video output device that displays the target prompt information. In this way, when the terminal device of the fitness user obtains the target prompt information, the target prompt information can be transmitted to the video output device selected by the fitness user through the near-field media transmission module, and the video output device selected by the fitness user can display the target prompt information to prompt the posture of the fitness user. The implementation process of S540 will be described below for the teaching video follow-up mode and the coach online teaching mode respectively.
[0137] In the teaching video follow-up mode, after obtaining the fitness user's action video, the fitness user's terminal device can detect the fitness user's posture according to the fitness user's action video to generate target prompt information. In a possible implementation, the implementation process of the fitness user's terminal device detecting the fitness user's posture and generating target prompt information can be: generating target prompt information according to the fitness user's posture and the fitness user's physiological characteristic data, and the physiological characteristic data corresponds to the fitness user's posture. For example, the fitness user's physiological characteristic data can be collected by an intelligent wearable device that establishes a communication connection with the fitness user's terminal device. The fitness user's terminal device can obtain the physiological characteristic data collected by the intelligent wearable device through the near-field media transmission module.
[0138] S510 mentions that a fitness user can select a smart wearable device on the fitness user's terminal device. When the fitness user wears the smart wearable device, the smart wearable device can collect the fitness user's physiological characteristic data, and send the fitness user's physiological characteristic data to the fitness user's terminal device in real time through the near-field media transmission module, and the fitness user's terminal device can obtain the fitness user's physiological characteristic data in real time. For example, the smart wearable device can collect the fitness user's heart rate value, blood pressure, calories consumed by exercise and other physiological characteristic data. It should be understood that the time when the video acquisition device collects each posture of the fitness user and the time when the smart wearable device collects the fitness user's physiological characteristic data are simultaneous, that is, each posture corresponds to a kind of physiological characteristic data, the fitness user's posture includes multiple postures, and accordingly, each physiological characteristic data also includes multiple physiological characteristic values.
[0139] When the posture of the fitness user and the corresponding physiological characteristic data are obtained, the terminal device of the fitness user can execute the operation of generating target prompt information according to the posture and physiological characteristic data of the fitness user.
[0140] In a possible implementation process, the implementation process of generating target prompt information based on the posture and physiological characteristic data of the fitness user can be: obtaining a sample data set, the sample data set including multiple sample postures, and sample physiological characteristic intervals corresponding to each sample posture in the multiple sample postures; generating target prompt information based on the posture, physiological characteristic data and sample data set of the fitness user.
[0141] Among them, the sample data set can be preset, and the sample data set can be obtained through big data analysis.
[0142] It should be understood that the posture of the fitness user includes multiple postures. When the posture of the fitness user is detected, each posture is actually detected. Since the method of detecting each posture is the same, the first posture is taken as an example for explanation below. The first posture is any posture among the multiple postures. Since each posture corresponds to a physiological characteristic value, after determining the first posture, the first physiological characteristic value corresponding to the first posture can be determined. For example, the first heart rate value, the first blood pressure value, etc. corresponding to the first posture.
[0143] In one possible implementation, the process of generating target prompt information based on the fitness user's posture, physiological characteristic data and sample data set can be as follows: based on the first posture, determine the target sample posture and the target sample physiological characteristic interval in the sample data set, and the target sample posture corresponds to the target sample physiological characteristic interval; if the first physiological characteristic value is greater than the target sample physiological characteristic interval, generate target prompt information, and the target prompt information is used to prompt that there is a safety risk in the posture; if the first physiological characteristic value is less than the target sample physiological characteristic interval, generate target prompt information, and the target prompt information is used to prompt that the posture is not standard.
[0144] Exemplarily, according to the first posture, determining the target sample posture and the target sample physiological feature interval in the sample data set can be achieved by calculating the similarity between the first posture and each sample posture, and taking the sample posture corresponding to the highest similarity value as the target sample posture.
[0145] Since each sample posture in the sample data set corresponds to a sample physiological characteristic interval, when determining the target sample posture, the target sample physiological characteristic interval corresponding to the target sample posture can be obtained. Then, it is determined whether the first physiological characteristic value is within the target sample physiological characteristic interval. If the first physiological characteristic value is within the target sample physiological characteristic interval, it is considered that the first posture of the fitness user is standardized. If the first physiological characteristic value is not within the target sample physiological characteristic interval, that is, outside the target sample physiological characteristic interval, it is considered that the posture of the fitness user may not be standardized, or there may be a safety risk, and a target prompt information can be generated at this time. Among them, since the physiological characteristic value can include multiple characteristic values such as heart rate value and blood pressure value, it is determined here whether the first physiological characteristic value is within the target sample physiological characteristic interval, and whether each characteristic value is within the target sample physiological characteristic interval, for example, it is determined whether the first heart rate value is within the target sample heart rate interval, and whether the first blood pressure value is within the target sample blood pressure interval. The first physiological characteristic value is within the target sample physiological characteristic interval, which means that each first physiological characteristic value is within the target sample physiological characteristic interval, and the first physiological characteristic value is not within the target sample physiological characteristic interval, which means that there is a first physiological characteristic value that is not within the target sample physiological characteristic interval.
[0146] Since each physiological characteristic interval in the sample physiological characteristic interval refers to the normal fluctuation range of each physiological characteristic interval when the fitness action is standardized, usually, when a fitness user is exercising, if a certain posture is not standardized, the change range of each physiological characteristic value corresponding to the posture is the same, such as each physiological characteristic value may increase, or each physiological characteristic value may decrease.
[0147] Furthermore, when the first physiological characteristic value is outside the target sample physiological characteristic interval, different target prompt information can be generated according to whether the first physiological characteristic value is greater than the target sample physiological characteristic interval or less than the target sample physiological characteristic interval, so as to provide more accurate prompts to fitness users.
[0148] If the first physiological characteristic value is greater than the target sample physiological characteristic interval, target prompt information is generated, and the target prompt information is used to prompt that there is a safety risk in the posture; if the first physiological characteristic value is less than the target sample physiological characteristic interval, target prompt information is generated, and the target prompt information is used to prompt that the posture is not standard.
[0149] For example, if the first physiological characteristic value is higher than the upper limit of the target sample physiological characteristic interval, it means that the fitness user has a large movement amplitude, resulting in excessively high physiological characteristics, and there may be safety risks. For example, the target prompt information may be "The current physiological characteristics are too high, there are risks, pay attention to safety". If the first physiological characteristic value is lower than the lower limit of the target sample physiological characteristic interval, it means that the fitness user's posture during exercise is not standard, such as a small swing amplitude, and the target prompt information may be "The current posture is not standard, pay attention to standard posture".
[0150] Combine the following Figure 8 , the manner in which the terminal device of the fitness user detects the posture of the fitness user and generates target prompt information is further described. Figure 8 It is a schematic flow chart of a posture detection method provided in an embodiment of the present application. Figure 8 The physiological characteristic value is illustrated by the heart rate value, such as Figure 8 As shown, the method comprises the following steps:
[0151] S801, obtaining a sample data set, a first posture and a first heart rate value corresponding thereto;
[0152] S802, determining, according to the first posture, a target sample posture and a target sample heart rate interval corresponding to the first posture in the sample data set;
[0153] S803, determining whether the first heart rate value is within the target sample heart rate interval;
[0154] If the first heart rate value is within the target sample heart rate interval, no operation is performed; if the first heart rate value is outside the target sample heart rate interval, the next operation is performed;
[0155] S804, determining the magnitude relationship between the first heart rate value and the target sample heart rate interval;
[0156] S805, if the first heart rate value is greater than the target sample heart rate interval, a first target prompt message is generated to remind the fitness user that the current heart rate is too high and there is a safety risk; if the first heart rate value is less than the target sample heart rate interval, a second target prompt message is generated to remind the fitness user that the current posture is not standard and to pay attention to the standard posture.
[0157] The above-mentioned method of detecting posture is mainly to detect the posture of the fitness user based on the heart rate data. In a possible implementation method, the posture of the fitness user can also be detected only based on the sample posture in the sample data set. For example, when the target sample posture corresponding to the first posture is obtained, the difference between the key points of each skeleton in the first posture and the target sample posture can be determined, and the target prompt information can be generated according to the difference. The target prompt information can be information for guiding the posture of the fitness user for the target sample posture. For example, compared with the target sample posture, the distance between the shoulders in the first posture is closer, and the distance between the knees is farther, so the target prompt information can be exemplarily "the distance between the shoulders in the first posture is closer, and the distance between the knees is farther, pay attention to adjust the posture."
[0158] After obtaining the target prompt information, the terminal device of the fitness user can send the target prompt information to at least two video output devices, and control some or all of the at least two video output devices to display the target prompt information, so that the fitness user can pay attention to the posture or safety in time according to the target prompt information. That is, the terminal device of the fitness user can provide posture standard prompts or safety risk prompts for the posture of the fitness user, which can improve the fitness effect and ensure the personal safety of the fitness user. Among them, the target prompt information can be audio information, text information, or a combination of audio information and text information, which is not limited in the embodiments of the present application.
[0159] In addition, in a possible implementation, when following a fitness video, a fitness user can also choose to record and save his / her own posture video on the terminal device of the fitness user, so that the fitness user can record his / her own training effect.
[0160] In the coach online teaching mode, the initial prompt information can be generated by the terminal device of the fitness user, the terminal device of the fitness coach verifies the initial prompt information, and the terminal device of the fitness user receives the verified prompt information (target prompt information), or the terminal device of the fitness coach generates the target prompt information, and the terminal device of the fitness user receives the target prompt information. In the scenario where the terminal device of the fitness user generates the initial prompt information, the terminal device of the fitness user may have misjudgment, resulting in an error in the initial prompt information. Therefore, the initial prompt information can also be verified by the fitness coach, and the terminal device of the fitness user controls at least two video output devices to display the verified target prompt information. Among them, the scenario in which the terminal device of the fitness user generates the initial prompt information, the fitness coach verifies the initial prompt information, and the terminal device of the fitness user controls at least two video output devices to display the verified prompt information, that is, the target prompt information, is called scenario one, and the scenario in which the terminal device of the fitness coach generates the target prompt information, and the terminal device of the fitness user receives and controls at least two video output devices to display the target prompt information is called scenario two. The following introduces these two scenarios respectively.
[0161] Scene 1
[0162] In a possible implementation, the operation of a terminal device of a fitness user in the following scenario may include the following steps:
[0163] Step 541: Acquire physiological characteristic data of the fitness user, where the physiological characteristic data corresponds to the posture of the fitness user;
[0164] Step 542: generating initial prompt information according to the posture and physiological characteristic data of the fitness user;
[0165] Step 543: generating a virtual posture of the fitness user according to the posture of the fitness user;
[0166] Step 544: sending initial prompt information, virtual posture and physiological characteristic data to the coach end (the terminal device of the fitness coach);
[0167] Step 545: Obtain target prompt information according to the verification result of the initial prompt information;
[0168] If the verification result indicates that the verification is passed, verification pass information is received, and target prompt information is obtained as initial prompt information according to the verification pass information;
[0169] If the verification result indicates that the verification fails, the target prompt information sent by the coach is received, and the target prompt information is the target prompt information obtained by the coach after adjusting the initial prompt information through the virtual posture and physiological characteristic data.
[0170] That is, the terminal device of the fitness user can generate initial prompt information and the virtual posture of the fitness user, and then send the initial prompt information, the virtual posture of the fitness user and the physiological characteristic data to the terminal device of the fitness coach, and the fitness coach verifies the initial prompt information according to the virtual posture and the physiological characteristic data, and the terminal device of the fitness user controls at least two video output devices to display the verified target prompt information. The following is a detailed explanation of steps 541 to 545.
[0171] Among them, the implementation process of step 541 and step 542 can refer to the relevant content of the terminal device of the fitness user generating target prompt information in the above-mentioned teaching video follow-up mode, and will not be repeated here.
[0172] In step 543, the terminal device of the fitness user can pre-collect the body parameter information, physiological characteristic data, and image of the fitness user, perform feature extraction on the image of the fitness user, extract the key bone points in the image, and generate a customized virtual image of the fitness user in combination with the body parameter information and physiological characteristic data of the fitness user. Among them, the key bone points can include bone points such as neck, shoulders, elbows, wrists, waist, knees, ankles, etc. It should be understood that the operation time of the terminal device of the fitness user to generate the virtual image of the fitness user should be the time when the fitness user first uses the terminal device of the fitness user. In this way, when the subsequent fitness user follows the fitness video movement, the virtual image module can map the posture of the fitness user in the action video of the fitness user collected by the video acquisition device to the virtual image of the fitness user generated in advance, and the virtual posture of the fitness user corresponding to the posture of the fitness user can be obtained. Among them, the virtual posture of the fitness user can be generated by a neural network.
[0173] Fig. 9 is a schematic diagram of a virtual image provided by an embodiment of the present application. Fig. 9 As shown, Fig. 9 Each digital number in the string identifies a key point of the skeleton. Fig. 9 Eleven skeleton key points are used as an example. In fact, more skeleton key points may be included, and this embodiment of the present application does not limit this.
[0174] For example, a fitness user can input his / her own body parameter information such as height and weight in advance on the fitness user's terminal device, and select a smart wearable device and a video acquisition device on the fitness user's terminal device, and establish connections with the two devices respectively. In this way, when the fitness user wears the smart wearable device, the smart wearable device can collect the physiological characteristic data of the fitness user and send the physiological characteristic data to the fitness user's terminal device. When the fitness user is within the collection range of the camera in the video acquisition device, the video acquisition device can collect the image of the fitness user and send the image of the fitness user to the fitness user's terminal device. The virtual image module in the fitness user's terminal device can generate a virtual image of the fitness user based on the fitness user's body parameter information, physiological characteristic data, and the image of the fitness user.
[0175] Among them, when generating the virtual posture of the fitness user according to the posture of the fitness user, the relative position of the key points of the skeleton in space can be calculated to estimate the current posture of the fitness user, and then estimate the movement trajectory, frequency, amplitude and other information of the fitness user's limbs. That is, the posture of the fitness user at the next moment can be estimated according to the posture of the fitness user at the current moment, so as to more quickly generate the virtual posture of the fitness user corresponding to the posture of the fitness user.
[0176] In addition, before executing step 542 to generate the initial prompt information, the fitness user may also first execute step 543 to generate a virtual posture of the fitness user according to the posture of the fitness user, and then generate the initial prompt information according to the virtual posture and physiological characteristic data of the fitness user.
[0177] Fig.10 FIG. 1 is a schematic flow chart of a method for generating initial prompt information provided in an embodiment of the present application. Fig.10 As shown, the method comprises the following steps:
[0178] S1001, obtaining body parameter information, physiological characteristic data, and an image of a fitness user;
[0179] S1002, generating a virtual image according to the body parameter information, physiological characteristic data, and image of the fitness user;
[0180] S1003, obtaining an action video and physiological characteristic data of a fitness user, where the physiological characteristic data corresponds to the posture of the fitness user in the action video;
[0181] S1004, mapping the action video of the fitness user onto the virtual image to generate a virtual posture of the fitness user;
[0182] S1005, detecting the virtual posture of the fitness user according to the physiological characteristic data and the sample data set, and generating initial prompt information.
[0183] After obtaining the initial prompt information, the virtual posture of the fitness user, and the physiological characteristic data, the terminal device of the fitness user can send the initial prompt information, the virtual posture of the fitness user, and the physiological characteristic data to the terminal device of the fitness coach based on step 544. The fitness coach verifies the initial prompt information according to the virtual posture and the physiological characteristic data.
[0184] Among them, the terminal device of the fitness user can send initial prompt information, the virtual posture of the fitness user and physiological characteristic data to the terminal device of the fitness coach through the far-field media transmission module.
[0185] Among them, the advantage of the fitness user's terminal device sending the fitness user's virtual posture to the fitness coach's terminal device instead of the fitness user's action video is that it can protect the privacy of the fitness user, and because the virtual posture is mainly the movement of the key points of the skeleton, the distribution of the key points of the skeleton is very sparse, and the amount of data sent is small. If a video is sent, the amount of video data is large. Therefore, the method of sending virtual postures can reduce the bandwidth occupied by video data transmission and reduce network latency.
[0186] After obtaining the initial prompt information, the virtual posture of the fitness user and the physiological characteristic data, the terminal device of the fitness coach displays the initial prompt information, the virtual posture of the fitness user and the physiological characteristic data, so that the fitness coach can verify the initial prompt information according to the virtual posture and physiological characteristic data of the fitness user to obtain the verification result.
[0187] If the fitness coach determines that the initial prompt information generated by the terminal device of the fitness user does not have any misjudgment, that is, the verification is determined to be passed, then the terminal device of the fitness coach can send verification pass information to the terminal device of the fitness user, and the verification pass information indicates that the verification is passed. When the terminal device of the fitness user receives the verification pass information, it is determined that the initial prompt information does not have any misjudgment, and at this time, some or all of the at least two video output devices can be controlled to display target prompt information, and the target prompt information is the initial prompt information.
[0188] Among them, the terminal device of the fitness coach can send verification pass information to the terminal device of the fitness user through the far-field media transmission module.
[0189] In a possible implementation, when the fitness coach determines that the verification is passed, the verification pass information may not be sent to the terminal device of the fitness user. If the terminal device of the fitness user does not receive the verification pass information sent by the terminal device of the fitness coach within a preset time, it is considered that the verification is passed, and at this time, some or all of the at least two video output devices are controlled to display the target prompt information. The preset time can be pre-set, and the embodiment of the present application is not limited to this.
[0190] If the fitness coach determines that the initial prompt information generated by the terminal device of the fitness user is misjudged, that is, determines that the verification fails, the fitness coach can adjust the initial prompt information generated by the terminal device of the fitness user.
[0191] In the coach online teaching mode, the fitness coach can also select video output devices, video acquisition devices, audio devices, and smart wearable devices on the fitness coach's terminal device, similar to the selection operation of the fitness user on the fitness user's terminal device. After the fitness coach's selection, these devices establish communication connections based on the fitness coach's terminal device.
[0192] For example, a fitness coach can adjust the initial prompt information through voice, so that the audio device can collect the voice of the fitness coach and send the voice of the fitness coach to the terminal device of the fitness coach through the near-field media transmission module. The terminal device of the fitness coach obtains the target prompt information and sends the target prompt information to the terminal device of the fitness user through the far-field media transmission module. The terminal device of the fitness user receives the target prompt information and controls some or all of the at least two video output devices to display the target prompt information.
[0193] In addition, the fitness coach can also guide the fitness user based on the virtual posture and initial prompt information of the fitness user, such as guiding the fitness user to pay attention to the swing amplitude of the elbow when making a certain posture. Among them, the guidance information can be, for example, the voice information of the fitness coach. The audio device connected to the terminal device of the fitness coach can collect the guidance information, and send the guidance information to the terminal device of the fitness coach through the near-field media transmission module. The terminal device of the fitness coach sends the guidance information to the terminal device of the fitness user through the far-field media transmission module. The terminal device of the fitness coach controls part or all of the video output devices in at least two video output devices to display the guidance information, so as to help the fitness user further adjust the posture and improve the fitness effect.
[0194] Scene 2
[0195] In a possible implementation, the operation of the terminal device of the fitness user in scenario two may include the following steps: obtaining physiological characteristic data of the fitness user, the physiological characteristic data corresponding to the posture of the fitness user; generating a virtual posture of the fitness user according to the posture of the fitness user; sending the virtual posture and physiological characteristic data of the fitness user to the coach end (the terminal device of the fitness coach); and receiving the target prompt information sent by the coach end.
[0196] Among them, the terminal device of the fitness user can send the virtual posture and physiological characteristic data of the fitness user to the terminal device of the fitness coach through the far-field media transmission module, and receive the target prompt information sent by the coach through the far-field media transmission module.
[0197] Among them, the implementation process of the terminal device of the fitness user generating the virtual posture of the fitness user can refer to the relevant content of the above scenario one, which will not be repeated here.
[0198] After the fitness user's terminal device generates the fitness user's virtual posture, it can send the fitness user's virtual posture and physiological characteristic data to the fitness coach's terminal device, and the fitness coach's terminal device generates target prompt information based on the fitness user's virtual posture and physiological characteristic data, and sends the target prompt information to the fitness user's terminal device. The implementation process of the fitness coach generating the target prompt information based on the fitness user's virtual posture and physiological characteristic data can refer to the relevant content of the fitness user's terminal device generating the target prompt information, which will not be repeated here.
[0199] In addition, after generating the target prompt information, the fitness coach's terminal device can also display the target prompt information on the fitness coach's terminal device and / or the video output device connected to it, and the fitness coach verifies the target prompt information. If the verification is successful, the fitness coach's terminal device sends the target prompt information to the terminal device of the fitness user, and the terminal device of the fitness user controls part or all of the video output devices of at least two terminal devices connected to it to display the target prompt information.
[0200] If the verification fails, the fitness coach can also correct the target prompt information through voice. The audio device connected to the fitness coach's terminal device collects the voice and sends the fitness coach's voice to the fitness coach's terminal device. The fitness coach's terminal device obtains the updated target prompt information and sends the updated target prompt information to the fitness user's terminal device. The fitness user's terminal device receives the updated target prompt information and controls some or all of the at least two video output devices to display the updated target prompt information.
[0201] In addition, in a possible implementation method, when a fitness user follows a fitness video, he or she can also choose to record and save the fitness coach's posture video (fitness video) and his or her own movement video on the fitness user's terminal device, so that the fitness user can record the effect of his or her own training, and can later review the saved fitness coach's posture video after class.
[0202] In addition, in a possible implementation method, the terminal device of the fitness user can also generate posture improvement suggestions and posture correction videos based on the fitness user's action video, fitness video and target prompt information after each video playback, to help the fitness user further correct his or her posture and enhance the fitness user's fitness experience.
[0203] Fig.11 Schematic diagram of the interface between a user terminal device and a coach terminal device provided in an embodiment of the present application. Fig.11 As shown, the coach-end device includes a fitness coach's terminal device 1110, and the user-end device includes a fitness user's terminal device 1120, a smart TV 1121, a tablet computer 1122, and a smart wearable device 1123. Fig.11 The video capture device and smart wearable device connected to the terminal device 1110 of the fitness coach are not shown. When the fitness user operates on the terminal device of the fitness user, the terminal device of the fitness user can display the video output device, video capture device, audio device, and smart wearable device selected by the fitness user. Fig.11 As shown, it can be seen that fitness users select smart TV and tablet computer as video output devices, tablet computer as video acquisition device, smart TV as audio device, smart watch as smart wearable device, Fig.11 In this way, when the terminal device of the fitness user receives the fitness video of the fitness coach sent by the terminal device of the fitness coach, the smart TV and tablet computer connected to the terminal device of the fitness user can display the fitness video at the same time. Fig.11 It can be seen from the display interface 1121 of the smart TV and the display screen 1122 of the tablet computer that the video acquisition devices selected by the terminal device of the fitness coach include three video acquisition devices, and the positions of these three video acquisition devices are in front of the coach, to the left of the coach, and to the right of the coach. In addition, the smart wearable device connected to the terminal device of the fitness coach can also collect the physiological characteristic data of the coach at the same time. The fitness coach terminal sends the physiological characteristic data of the coach to the terminal device of the fitness user while sending the fitness video.
[0204] After receiving the fitness video, the fitness user follows the fitness video and the video acquisition device connected to the fitness user's terminal device, i.e., the tablet computer, collects the fitness user's fitness action video. The smart wearable device connected to the fitness user's terminal device, i.e., the smart watch, collects the fitness user's physiological characteristic data and sends the fitness user's action video and the fitness user's physiological characteristic data to the fitness user's terminal device respectively. The fitness user's terminal device can display the fitness user's physiological characteristic data (student data) and the fitness coach's physiological characteristic data (coach data) in the video output device, the smart TV and the tablet computer. Among them, the student data "02:00" indicates the fitness user's exercise duration, "10 kcal" indicates the calorie value consumed by the fitness user's exercise, and "100 beats / minute" indicates the current heart rate of the fitness user during exercise, and the same is true for the coach data.
[0205] Moreover, after receiving the action video of the fitness user, the terminal device of the fitness user can display the posture of the fitness user on the video output device connected to the terminal device of the fitness user. Fig.11 The display of virtual posture is used as an example for explanation. Moreover, when the posture of the fitness user is not standard, the target prompt information is displayed on the video output device to prompt the fitness user. It should be noted that fitness videos, student data, coach data, virtual posture of the fitness user, and target prompt information, etc. can also be displayed on the terminal device of the fitness user. That is, the content displayed on the video output device will be displayed on the terminal device of the fitness user. In addition, the terminal device of the fitness user can also send the virtual posture of the fitness user and the physiological characteristic data of the fitness user to the terminal device of the fitness coach. The terminal device of the fitness coach can control the display of the virtual posture on the video output device connected to it, and display the physiological characteristic data on the smart wearable device. Optionally, the virtual posture and physiological characteristic data will also be displayed on the terminal device of the fitness coach. Fig.11 The following is an example of displaying a picture on a terminal device of a fitness user. Optionally, a terminal device of a fitness coach can also display student data and coach data, so that the fitness coach can guide the posture of the fitness user.
[0206] The embodiment of the present application can be divided into video playback in the coach online teaching mode and the teaching video follow-up mode. The video playback methods in these two modes are described below. Among them, the terminal device of the fitness user can be called the student terminal, and the terminal device of the fitness coach can be called the coach terminal. The fitness user (fitness student) is referred to as the student, and the fitness coach is referred to as the coach.
[0207] Mode 1: Coach online teaching mode.
[0208] The process of the coaching online teaching mode may include the following steps:
[0209] Step 1: The fitness student and the fitness coach select the IOT device they want to connect to on the student side and the coach side respectively. The student side determines to establish a communication connection with the IOT device selected by the student through the near-field media transmission module. Correspondingly, the coach side also establishes a communication connection with the IOT device selected by the coach through the near-field media transmission module. Among them, the IOT device may include at least two video output devices, at least two video acquisition devices, an audio device, and a smart wearable device;
[0210] Step 2: The student receives the student's physiological characteristic data collected by the smart wearable device through the fitness data module, performs image analysis on the student's image collected by the video acquisition device through the video data module to extract the key points of the skeleton, generates the student's virtual image through the virtual image module, and maps the student's action video to the virtual image when the video acquisition device collects the student's action video, thereby obtaining the virtual posture of the fitness user;
[0211] Step 3: The coach uses the near-field media transmission module to call at least two video acquisition devices to capture the coach's fitness videos at different angles. At the same time, the coach's audio can be collected through an audio device, and the coach's physiological characteristic data can be collected through a smart wearable device.
[0212] Step 4: The coach end transmits the collected fitness video, audio data and physiological characteristic data of the coach to the student end through the far-field media transmission module;
[0213] Step 5: The student end renders the teaching screen according to the received video stream. For example, if three video streams are received, three display screens are rendered on the student end, and the three screens (fitness videos) are displayed simultaneously through at least two video output devices;
[0214] Step 6: When the student follows the coach's fitness video, the student uses the video acquisition module to call the video acquisition device to collect the student's action video, and collects the student's physiological characteristic data through the smart wearable device. Then the virtual image module generates the student's virtual posture, detects the student's posture, and generates initial prompt information; Step 7: The student sends the student's virtual posture, physiological characteristic data and initial prompt information to the coach;
[0215] Alternatively, the student end sends the student's virtual posture and physiological characteristic data to the coach end;
[0216] Step 8: The coach re-verifies the student's virtual posture and physiological characteristic data and the initial prompt information on the coach's end. If the verification passes, a verification pass message is sent to the student's end. If the verification fails, the coach adjusts the initial prompt information to obtain the target prompt information and sends the target prompt information to the student's end.
[0217] Alternatively, the coach generates target prompt information based on the student's virtual posture and physiological characteristic data, and sends the target prompt information to the student;
[0218] Step 9: The student terminal displays the target prompt information;
[0219] Step 10: Students can also record and save the coach’s posture video and their own posture video on the student terminal.
[0220] In addition, the coach can guide the student's posture on the coach end to prevent the student from getting injured. The coach end sends the coach's guidance information to the student end, which can be the coach's voice information; the student end plays the guidance information so that the student can exercise more effectively according to the coach's guidance.
[0221] In the coach's online teaching mode, the student side detects the student's action video, and the coach conducts a secondary test on the coach side to guide the student, further improving the student's fitness experience. Moreover, the student side sends the student's action video to the coach side in the form of a virtual posture, which not only protects the student's privacy, but also reduces the bandwidth occupied during video data transmission and reduces network latency.
[0222] Mode 2: Teaching video follow-up mode.
[0223] The process of the teaching video follow-up mode may include the following steps:
[0224] Step 1: The student selects the IOT device that he wants to connect to on the student terminal and the coach terminal, and the student terminal establishes a connection with the IOT device selected by the student through the near-field media transmission module, wherein the IOT device may include at least two video output devices, a video acquisition device, an audio device, and a smart wearable device;
[0225] Step 2: The student end receives the student's physiological characteristic data collected by the smart wearable device through the fitness data module, performs image analysis on the student's image collected by the video acquisition device through the video data module to extract the key points of the skeleton, generates the student's virtual image through the virtual image module, and maps the student's action video to the virtual image when the video acquisition device collects the student's action video, thereby obtaining the virtual posture of the fitness user;
[0226] Step 3: The student terminal receives the offline fitness video and simultaneously plays the offline fitness video through at least two video output devices;
[0227] Step 4: When the student follows the offline teaching video, the student uses the video acquisition module to call the video acquisition device to collect the student's action video, and collects the student's physiological characteristic data through the physiological characteristic data acquisition device. Then the virtual image module generates the student's virtual posture, detects the student's posture, generates target prompt information, and displays the target prompt information through the video output device;
[0228] Step 5: Students can also record and save their own posture videos on the student terminal.
[0229] In summary, the embodiments of the present application involve two technical solutions: the generation of a virtual image and the design of a multi-device collaborative fitness system based on a distributed multimedia framework. When a student uses the fitness software on a terminal device for the first time, a customized virtual image is generated using a virtual image generation module. When the student follows the teaching video, the video capture device captures the student's action video, maps the action video to the virtual image, and generates the student's virtual posture. The student end can also send the student's virtual posture to the coach end. The advantage is that it avoids the influence of network delay on the transmission of the video screen when the student shows the posture to the coach end. Using virtual posture instead of video can help reduce network uplink pressure, reduce network delay, and protect the student's personal privacy. In addition, the student end can also perform standardized detection of the student's posture and make safety prompts in time, which is conducive to ensuring the student's fitness safety.
[0230] The design of a multi-device collaborative fitness system based on a distributed multimedia framework includes a teaching video follow-up mode and a coach online teaching mode. In the teaching video follow-up mode, students select offline fitness videos. Through the near-field media transmission module, the video screen on the student side can be simultaneously streamed to multiple video output devices such as smart TVs, laptops, and tablets that are connected to the student side for playback, and the teaching audio can be streamed to the speakers for playback. When students exercise according to offline fitness videos, they can call the video acquisition device through the video acquisition module to capture the student's fitness action video, detect the student's posture in the action video, and generate target prompt information to prompt the student.
[0231] In the coach online teaching mode, after the coach and the student enter the teaching room, the coach can call multiple video acquisition devices such as tablets and laptops to collect the coach's fitness videos, and then transmit them to the student through the far-field media transmission module. The student can use the near-field media transmission module to simultaneously stream the coach's real-time teaching images to multiple video output devices such as smart TVs, laptops, and tablets connected to the student, and can stream the audio to the speakers for playback. In this way, students can watch the video images effortlessly in multiple directions while exercising.
[0232] The scheme of the embodiment of the present application, on the one hand, utilizes the existing IOT devices of fitness students to create an immersive fitness environment for students, so that fitness students can watch teaching videos from multiple angles and receive guidance from fitness coaches; and sending the posture videos of fitness students in the form of virtual images to the coach side can reduce the bandwidth occupied by video data transmission, reduce network latency, and effectively protect the personal privacy of fitness students; on the other hand, fitness coaches can also conduct multi-faceted fitness movement teaching through the participation of multiple IOT devices, and with the help of the movement detection module, the correction of students' fitness movements will also be more intelligent and more convenient.
[0233] All the above optional technical solutions can be combined in any way to form optional embodiments of the present application, and the embodiments of the present application will not be described in detail one by one.
[0234] Fig.12 is a schematic flow chart of another video playback method provided in an embodiment of the present application. The method can be applied to Figure 3 Terminal equipment for fitness coaches, such as Fig.12 As shown, the method includes:
[0235] S1201: a first selection operation on a first fitness mode is detected, where the first fitness mode is used to instruct to perform online fitness teaching to a fitness user;
[0236] The fitness coach can also select the coach online teaching mode on the fitness coach's terminal device to provide online fitness teaching to the fitness user. When the fitness coach's terminal device detects the first selection operation of the first fitness mode, it can be determined that the fitness coach provides online fitness teaching to the fitness user.
[0237] S1202: In response to the second selection operation, determining at least two second video acquisition devices and at least two second video output devices, wherein each of the at least two second video acquisition devices is located at a different position, and each of the at least two second video output devices is located at a different position;
[0238] Among them, the fitness coach can select at least two video acquisition devices, at least two video output devices, an audio device, and a smart wearable device on the fitness coach's terminal device. After the fitness coach completes the selection, the fitness coach's terminal device establishes a communication connection with the at least two video acquisition devices, at least two video output devices, an audio device, and the smart wearable device through the near-field media transmission module. In addition, the implementation process of S1202 can refer to the relevant content of S510 above, which will not be repeated here.
[0239] S1203: Control at least two second video acquisition devices to acquire a fitness coach's fitness video, and send the fitness video to a user terminal of a fitness user;
[0240] In one possible implementation, the coaching end includes a first media transmission module (near-field media transmission module) and a second media transmission module (far-field media transmission module). The first media transmission module is used for the coaching end to establish a communication connection with at least two second video acquisition devices, at least two video output devices, an audio device, and a smart wearable device. The second media transmission module is used for the coaching end to establish a communication connection with the user end.
[0241] Therefore, the terminal device of the fitness coach can obtain at least two video acquisition devices to capture the fitness videos of the fitness coach at multiple angles through the near-field media transmission module, and send the multiple fitness videos to the terminal device of the fitness user through the far-field media transmission module.
[0242] S1204: receiving an action video of a fitness user, where the action video includes a posture of the fitness user;
[0243] Among them, the terminal device of the fitness coach can receive the action video of the fitness user during exercise sent by the terminal device of the fitness user through the far-field media transmission module to detect the posture of the fitness user in the action video.
[0244] In a possible implementation, the posture of the fitness user in the action video is a virtual posture.
[0245] S1205: Control at least two second video output devices to play the action video of the fitness user, so that the fitness coach can provide online fitness teaching to the fitness user.
[0246] Among them, the terminal device of the fitness coach can send the action video of the fitness user to at least two video output devices through the near-field media transmission module.
[0247] As mentioned above, the coach's online teaching mode can include two teaching scenarios. Scenario 1: the fitness user's terminal device generates initial prompt information, the fitness coach verifies the initial prompt information, and sends the verification result of the initial prompt information to the fitness user's terminal device; Scenario 2: the fitness coach's terminal device generates target prompt information and sends the target prompt information to the fitness user's terminal device.
[0248] In a possible implementation, if the fitness user's posture is not standard, the generated target prompt information is used to prompt the fitness user that the posture is not standard; if the fitness user's posture is standard, the generated target prompt information is used to prompt the fitness user that the posture is standard.
[0249] Scenario 1:
[0250] The terminal device of the fitness coach can also receive the physiological characteristic data and initial prompt information of the fitness user, where the physiological characteristic data corresponds to the posture of the fitness user; the initial prompt information is verified through the posture and physiological characteristic data of the fitness user to obtain the verification result of the initial prompt information.
[0251] Among them, the terminal device of the fitness coach can receive the physiological characteristic data and initial prompt information sent by the terminal device of the fitness user through the far-field media transmission module.
[0252] In a possible implementation, the implementation process of sending the verification result of the initial prompt information to the user end can be: if the initial prompt information verification passes, sending the verification pass information to the user end; if the initial prompt information verification fails, adjusting the initial prompt information according to the posture and physiological characteristic data of the fitness user to obtain the target prompt information; and sending the target prompt information to the user end, the target prompt information is used to prompt the fitness user's posture when the fitness user's posture is not standard.
[0253] After obtaining the initial prompt information, the virtual posture of the fitness user and the physiological characteristic data, the terminal device of the fitness coach displays the initial prompt information, the virtual posture of the fitness user and the physiological characteristic data, so that the fitness coach can verify the initial prompt information according to the virtual posture and physiological characteristic data of the fitness user to obtain the verification result.
[0254] If the fitness coach determines that the initial prompt information generated by the terminal device of the fitness user does not have any misjudgment, that is, the verification is determined to be passed, then the terminal device of the fitness coach can send verification pass information to the terminal device of the fitness user, and the verification pass information indicates that the verification is passed. When the terminal device of the fitness user receives the verification pass information, it is determined that the initial prompt information does not have any misjudgment, and at this time, some or all of the at least two video output devices can be controlled to display target prompt information, and the target prompt information is the initial prompt information.
[0255] If the fitness coach determines that the initial prompt information generated by the terminal device of the fitness user is misjudged, that is, determines that the verification fails, the fitness coach can adjust the initial prompt information generated by the terminal device of the fitness user.
[0256] For example, a fitness coach can adjust the initial prompt information through voice, so that the audio device can collect the voice of the fitness coach and send the voice of the fitness coach to the terminal device of the fitness coach through the near-field media transmission module. The terminal device of the fitness coach then obtains the target prompt information and sends the target prompt information to the terminal device of the fitness user through the far-field media transmission module.
[0257] Scenario 2:
[0258] The terminal device of the fitness coach can also receive the physiological characteristic data of the fitness user, which corresponds to the posture of the fitness user; generate target prompt information corresponding to the posture of the fitness user based on the virtual posture and the physiological characteristic data; and send the target prompt information to the user terminal.
[0259] Among them, the terminal device of the fitness coach can receive the physiological characteristic data of the fitness user sent by the terminal device of the fitness user through the far-field media transmission module.
[0260] In a possible implementation, the terminal device of the fitness coach generates the target prompt information according to the virtual posture and physiological characteristic data by: acquiring a sample data set, the sample data set including a plurality of sample postures and a sample physiological characteristic interval corresponding to each of the plurality of sample postures;
[0261] According to the first virtual posture, a target sample posture and a target sample physiological characteristic interval in the sample data set are determined, and the target sample posture corresponds to the target sample physiological characteristic interval, wherein the virtual posture includes the first virtual posture, and the physiological characteristic data includes a first physiological characteristic value, and the first physiological characteristic value is used to represent the physiological characteristic value of the fitness user in the first virtual posture;
[0262] If the first physiological characteristic value is greater than the target sample physiological characteristic interval, target prompt information is generated, and the target prompt information is used to prompt that there is a safety risk in the first virtual posture;
[0263] If the first physiological characteristic value is less than the target sample physiological characteristic interval, target prompt information is generated, and the target prompt information is used to prompt that the first virtual posture is not standard.
[0264] Among them, the terminal device of the fitness coach generates the target prompt information, which can refer to the relevant content of the terminal device of the fitness user generating the target prompt information, and will not be repeated here.
[0265] After generating the target prompt information, the terminal device of the fitness coach can send the target prompt information to the terminal device of the fitness user through the far-field media transmission module.
[0266] In an embodiment of the present application, when a fitness coach provides online fitness teaching to a fitness user, the coach end can collect the fitness coach's fitness video through at least two video acquisition devices, and send the collected fitness video to the user end of the fitness user; since each of the at least two video acquisition devices is located at a different position, the fitness videos sent by the coach end to the user end are fitness videos of the fitness coach at different angles, thereby realizing multi-faceted fitness posture teaching for the fitness user; in addition, the coach end can also receive the action video of the fitness user, and play the action video of the fitness user on at least two video output devices; since each of the at least two video output devices is located at a different position, the fitness coach end can watch the action video of the fitness user at different positions, and provide online teaching guidance to the fitness user's fitness actions in a more timely manner.
[0267] Fig.13 is a structural diagram of an audio and video playback device provided in an embodiment of the present application. Fig.13 As shown, the device comprises:
[0268] The determination module 1301 is used to determine at least two first video acquisition devices and at least two first video output devices in response to a selection operation of a fitness user, wherein each of the at least two first video acquisition devices is located at a different position, and each of the at least two first video output devices is located at a different position;
[0269] The playing module 1302 is used to obtain the fitness video to be played, and control at least two first video output devices to play the fitness video to be played;
[0270] The acquisition module 1303 is used to control at least two first video acquisition devices to acquire an action video of a fitness user, where the action video includes a posture of the fitness user;
[0271] The output module 1304 is used to control some or all of the at least two first video output devices to output target prompt information corresponding to the posture of the fitness user.
[0272] Optionally, the device also includes: a first detection module, used to detect a selection operation on a first fitness mode, the first fitness mode is used to instruct online fitness teaching to fitness users; a first generation module, used to generate a virtual posture of the fitness user according to the posture of the fitness user; a first sending module, used to send the virtual posture and physiological characteristic data of the fitness user to the coach end, so that the coach end generates target prompt information according to the virtual posture and the physiological characteristic data, and the physiological characteristic data corresponds to the posture of the fitness user; a receiving module, used to receive the target prompt information sent by the coach end.
[0273] Optionally, the device also includes: a first detection module, used to detect a selection operation on a first fitness mode, the first fitness mode is used to instruct online fitness teaching to fitness users; a second generation module, used to generate initial prompt information according to the posture of the fitness user and the physiological characteristic data of the fitness user; a third generation module, used to generate a virtual posture of the fitness user according to the posture of the fitness user; a second sending module, used to send the initial prompt information, the virtual posture and the physiological characteristic data to the coach end, so that the coach end verifies the initial prompt information through the virtual posture and the physiological characteristic data, and the physiological characteristic data corresponds to the posture of the fitness user; an obtaining module, used to obtain target prompt information according to the verification result of the initial prompt information.
[0274] Optionally, the module is also used to: if the verification result indicates that the verification is passed, receive the verification pass information; based on the verification pass information, obtain the target prompt information as the initial prompt information; if the verification result indicates that the verification fails, receive the target prompt information sent by the coach end, and the target prompt information is the prompt information obtained after the coach end adjusts the initial prompt information through virtual posture and physiological characteristic data.
[0275] Optionally, the playing module 1302 is further used to obtain a fitness video to be played sent by the coach.
[0276] Optionally, the device also includes: a second detection module, used to detect the selection operation of the second fitness mode, the second fitness mode is used to instruct offline fitness teaching to the fitness user; a fourth generation module, used to generate target prompt information according to the posture of the fitness user and the physiological characteristic data of the fitness user, the physiological characteristic data corresponding to the posture of the fitness user.
[0277] Optionally, the playing module 1302 is further used to: obtain a fitness video to be played in the user terminal.
[0278] Optionally, the fourth generation module is also used to: obtain a sample data set, the sample data set including multiple sample postures and sample physiological characteristic intervals corresponding to each of the multiple sample postures; generate target prompt information based on the fitness user's posture, physiological characteristic data and sample data set.
[0279] Optionally, the output module 1304 is further used to: if the posture of the fitness user is not standard, control some or all of the at least two first video output devices to output target prompt information, and the target prompt information is used to prompt the fitness user that the posture is not standard.
[0280] Optionally, the output module 1304 is further used to: if the fitness user's posture is standard, control some or all of the at least two first video output devices to output target prompt information, and the target prompt information is used to prompt the fitness user to standardize the posture.
[0281] Optionally, the posture includes a first posture, and the physiological characteristic data includes a first physiological characteristic value, and the first physiological characteristic value is used to represent the physiological characteristic value of the fitness user in the first posture; the fourth generation module is also used to: determine the target sample posture and the target sample physiological characteristic interval in the sample data set according to the first posture, and the target sample posture corresponds to the target sample physiological characteristic interval; if the first physiological characteristic value is greater than the target sample physiological characteristic interval, generate target prompt information, and the target prompt information is used to prompt that the first posture has a safety risk; if the first physiological characteristic value is less than the target sample physiological characteristic interval, generate target prompt information, and the target prompt information is used to prompt that the first posture is not standard.
[0282] Optionally, the user terminal includes a first media transmission module, which is used for the user terminal to establish a communication connection with at least two first video acquisition devices and at least two first video output devices, and to transmit the fitness video to be played to the at least two first video output devices through the first media transmission module; to obtain the action video of the fitness user captured by the at least two first video acquisition devices through the first media transmission module; to transmit target prompt information to some or all of the at least two first video output devices through the first media transmission module; and to obtain the physiological characteristic data collected by the wearable device through the first media transmission module.
[0283] Optionally, the user end includes a second media transmission module, which is used for the user end to establish a communication connection with the coach end, receive the fitness video to be played sent by the coach end through the second media transmission module; send virtual posture and physiological characteristic data to the coach end through the second media transmission module; receive target prompt information sent by the coach end through the second media transmission module; send initial prompt information, virtual posture and physiological characteristic data to the coach end through the second media transmission module; receive verification pass information through the second media transmission module; receive target prompt information sent by the coach end through the second media transmission module.
[0284] Optionally, the fitness video to be played includes multiple fitness videos to be played, and the playing module 1302 is further used to: obtain multiple fitness videos to be played; and control each of the at least two first video output devices to play the multiple fitness videos to be played.
[0285] Optionally, the fitness video to be played includes multiple fitness videos to be played, and the number of at least two first video output devices is less than or equal to the number of the multiple fitness videos to be played. The playing module 1302: obtains multiple fitness videos to be played; controls each of the at least two first video output devices to play at least one fitness video to be played among the multiple fitness videos to be played, and the fitness videos to be played played in each first video output device are different.
[0286] Optionally, the multiple fitness videos to be played are fitness coach posture videos captured from different angles.
[0287] Optionally, the at least two first video acquisition devices are identical to some or all of the at least two first video output devices.
[0288] Fig.14 is a schematic diagram of the structure of another audio and video playback device provided in an embodiment of the present application. Fig.14 As shown, the device comprises:
[0289] A detection module 1401 is used to detect a first selection operation of a first fitness mode, where the first fitness mode is used to instruct to perform online fitness teaching to a fitness user;
[0290] A determination module 1402 is used to determine, in response to a second selection operation, at least two second video acquisition devices and at least two second video output devices, each of the at least two second video acquisition devices being located at a different position, and each of the at least two second video output devices being located at a different position;
[0291] The first sending module 1403 is used to control at least two second video acquisition devices to acquire the fitness video of the fitness coach, and send the fitness video to the user terminal of the fitness user;
[0292] The first receiving module 1404 is used to receive an action video of a fitness user, where the action video includes the posture of the fitness user;
[0293] The playing module 1405 is used to control at least two second video output devices to play the action video of the fitness user, so that the fitness coach can provide online fitness teaching to the fitness user.
[0294] Optionally, the posture of the fitness user is a virtual posture of the fitness user.
[0295] Optionally, the device also includes: a second receiving module, used to receive physiological characteristic data of a fitness user, the physiological characteristic data corresponding to the posture of the fitness user; a generating module, used to generate target prompt information corresponding to the posture of the fitness user based on the virtual posture and the physiological characteristic data; and a second sending module, used to send the target prompt information to the user end.
[0296] Optionally, the generation module is also used to: obtain a sample data set, the sample data set including multiple sample postures and sample physiological feature intervals corresponding to each of the multiple sample postures; generate target prompt information based on the virtual posture, physiological feature data and the sample data set.
[0297] Optionally, the generating module is further used to: if the posture of the fitness user is not standard, generate target prompt information according to the virtual posture, physiological characteristic data and sample data set, and the target prompt information is used to prompt the fitness user that the posture is not standard.
[0298] Optionally, the generating module is further used to: if the posture of the fitness user is standard, generate target prompt information according to the virtual posture, physiological characteristic data and sample data set, and the target prompt information is used to prompt the fitness user to standardize the posture.
[0299] Optionally, the virtual posture includes a first virtual posture, and the physiological characteristic data includes a first physiological characteristic value, and the first physiological characteristic value is used to represent the physiological characteristic value of the fitness user in the first virtual posture; the generation module is also used to: determine the target sample posture and the target sample physiological characteristic interval in the sample data set according to the first virtual posture, and the target sample posture corresponds to the target sample physiological characteristic interval; if the first physiological characteristic value is greater than the target sample physiological characteristic interval, generate target prompt information, and the target prompt information is used to prompt that the first virtual posture has a safety risk; if the first physiological characteristic value is less than the target sample physiological characteristic interval, generate target prompt information, and the target prompt information is used to prompt that the first virtual posture is not standard.
[0300] Optionally, the device also includes: a third receiving module, used to receive physiological characteristic data and initial prompt information of a fitness user, the physiological characteristic data corresponding to the posture of the fitness user; a verification module, used to verify the initial prompt information through the posture and physiological characteristic data of the fitness user to obtain a verification result of the initial prompt information; a third sending module, used to send the verification result of the initial prompt information to the user end.
[0301] Optionally, the third sending module is also used to: if the initial prompt information verification passes, send the verification pass information to the user end; if the initial prompt information verification fails, adjust the initial prompt information according to the fitness user's posture and physiological characteristic data to obtain target prompt information corresponding to the fitness user's posture; and send the target prompt information to the user end.
[0302] Optionally, the coaching end includes a first media transmission module, which is used for the coaching end to establish a communication connection with at least two second video acquisition devices and at least two second video output devices, and obtain the fitness video of the fitness coach captured by at least two second video acquisition devices through the first media transmission module; and transmit the action video of the fitness user to at least two second video output devices through the first media transmission module.
[0303] Optionally, the coaching end includes a second media transmission module, which is used to establish a communication connection between the coaching end and the user end, receive the action video of the fitness user sent by the user end through the second media transmission module; receive the physiological characteristic data of the fitness user sent by the user end through the second media transmission module; send target prompt information to the user end through the second media transmission module; receive the physiological characteristic data and initial prompt information of the fitness user sent by the user end through the second media transmission module; send the verification result of the initial prompt information to the user end through the second media transmission module; send the verification pass information to the user end through the second media transmission module; and send the target prompt information to the user end through the second media transmission module.
[0304] Fig.15 1 is a schematic diagram of the structure of a terminal device provided in an embodiment of the present application. The terminal device can be a terminal device of a fitness user or a terminal device of a fitness coach.
[0305] For example, Fig.15 As shown, the terminal device 1500 includes: a memory 1501 and a processor 1502, wherein the memory 1501 stores an executable program code 15011, and the processor 1502 is used to call and execute the executable program code 15011 to perform an audio and video playback method. In the case where the terminal device is a terminal device of a fitness user, the execution Figure 5 The audio and video playback method shown in the figure is executed when the terminal device is a terminal device of a fitness user. Fig.12 The audio and video playback method shown.
[0306] In this embodiment, the terminal device can be divided into functional modules according to the above method example. For example, each functional module can be corresponded, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.
[0307] In the case of dividing each functional module according to each function, the terminal device may include: a determination module, a playback module, a collection module and an output module, or include: a detection module, a determination module, a first sending module, a first receiving module and a playback module. It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and will not be repeated here.
[0308] The terminal device provided in this embodiment is used to execute the above-mentioned audio and video playback method, and thus can achieve the same effect as the above-mentioned implementation method.
[0309] In the case of using an integrated unit, the terminal device may include a processing module and a storage module. The processing module may be used to control and manage the actions of the terminal device. The storage module may be used to support the terminal device to execute mutual program codes and data.
[0310] The processing module may be a processor or a controller, which may implement or execute various exemplary logic blocks, modules and circuits disclosed in the present application. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc. The storage module may be a memory.
[0311] This embodiment also provides a computer-readable storage medium, in which a computer program code is stored. When the computer program code is executed on a computer, the computer executes the above-mentioned related method steps to implement an audio and video playback method in the above-mentioned embodiment.
[0312] This embodiment further provides a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement an audio and video playback method in the above-mentioned embodiment.
[0313] In addition, the terminal device provided in the embodiments of the present application may specifically be a chip, component or module, and the terminal device may include a connected processor and memory; wherein the memory is used to store instructions, and when the terminal device is running, the processor may call and execute instructions so that the chip executes an audio and video playback method in the above-mentioned embodiments.
[0314] Among them, the terminal device, computer-readable storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
[0315] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0316] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0317] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. An audio and video playback method, characterized in that: Applied to a user terminal, the method includes: In response to a selection operation by a fitness user, determining at least two first video acquisition devices and at least two first video output devices, wherein each of the at least two first video acquisition devices is located at a different position, and each of the at least two first video output devices is located at a different position; Acquire a fitness video to be played, and control the at least two first video output devices to play the fitness video to be played; Controlling the at least two first video acquisition devices to acquire an action video of the fitness user, wherein the action video includes a posture of the fitness user; Control some or all of the at least two first video output devices to output target prompt information corresponding to the posture of the fitness user.
2. The method according to claim 1, characterized in that The method further comprises: detecting a selection operation of a first fitness mode, where the first fitness mode is used to instruct the fitness user to perform online fitness teaching; generating a virtual posture of the fitness user according to the posture of the fitness user; Sending the virtual posture and physiological characteristic data of the fitness user to the coach end, so that the coach end generates the target prompt information according to the virtual posture and the physiological characteristic data, wherein the physiological characteristic data corresponds to the posture of the fitness user; Receive the target prompt information sent by the coach end.
3. The method according to claim 1, characterized in that The method further comprises: detecting a selection operation of a first fitness mode, where the first fitness mode is used to instruct the fitness user to perform online fitness teaching; generating initial prompt information according to the posture of the fitness user and the physiological characteristic data of the fitness user; generating a virtual posture of the fitness user according to the posture of the fitness user; Sending the initial prompt information, the virtual posture and the physiological characteristic data to the coach end, so that the coach end verifies the initial prompt information through the virtual posture and the physiological characteristic data, and the physiological characteristic data corresponds to the posture of the fitness user; The target prompt information is obtained according to the verification result of the initial prompt information.
4. The method according to claim 3, characterized in that The obtaining of the target prompt information according to the verification result of the initial prompt information includes: If the verification result indicates that the verification is passed, receiving verification pass information sent by the coach terminal; according to the verification pass information, obtaining the target prompt information as the initial prompt information; If the verification result indicates that the verification fails, the target prompt information sent by the coach end is received, and the target prompt information is prompt information obtained after the coach end adjusts the initial prompt information through the virtual posture and the physiological characteristic data.
5. The method according to any one of claims 2 to 4, characterized in that The step of obtaining a fitness video to be played includes: Obtain the fitness video to be played sent by the coach terminal.
6. The method according to claim 1, characterized in that The method further comprises: detecting a selection operation of a second fitness mode, where the second fitness mode is used to instruct to perform offline fitness teaching for the fitness user; The target prompt information is generated according to the posture of the fitness user and the physiological characteristic data of the fitness user, wherein the physiological characteristic data corresponds to the posture of the fitness user.
7. The method according to claim 6, characterized in that The step of obtaining a fitness video to be played includes: Obtain the fitness video to be played in the user terminal.
8. The method according to claim 6 or 7, characterized in that: The step of generating the target prompt information according to the posture of the fitness user and the physiological characteristic data of the fitness user includes: Acquire a sample data set, wherein the sample data set includes a plurality of sample postures and a sample physiological feature interval corresponding to each of the plurality of sample postures; The target prompt information is generated according to the posture of the fitness user, the physiological characteristic data and the sample data set.
9. The method according to claim 8, characterized in that The controlling part or all of the at least two first video output devices to output target prompt information corresponding to the posture of the fitness user includes: If the posture of the fitness user is not standard, control some or all of the at least two first video output devices to output the target prompt information, and the target prompt information is used to prompt the fitness user that the posture is not standard.
10. The method according to claim 8, characterized in that The controlling part or all of the at least two first video output devices to output target prompt information corresponding to the posture of the fitness user includes: If the posture of the fitness user is standard, control some or all of the at least two first video output devices to output the target prompt information, and the target prompt information is used to prompt the fitness user of the standard posture.
11. The method according to claim 9, characterized in that The posture includes a first posture, and the physiological characteristic data includes a first physiological characteristic value, and the first physiological characteristic value is used to represent a physiological characteristic value of the fitness user in the first posture; The step of generating the target prompt information according to the posture of the fitness user, the physiological characteristic data and the sample data set includes: Determine, according to the first posture, a target sample posture and a target sample physiological characteristic interval in the sample data set, wherein the target sample posture corresponds to the target sample physiological characteristic interval; If the first physiological characteristic value is greater than the target sample physiological characteristic interval, the target prompt information is generated, and the target prompt information is used to prompt that the first posture has a safety risk; If the first physiological characteristic value is smaller than the target sample physiological characteristic interval, the target prompt information is generated, and the target prompt information is used to prompt that the first posture is not standard.
12. The method according to any one of claims 2 to 11, characterized in that The user terminal includes a first media transmission module, and the first media transmission module is used for the user terminal to establish a communication connection with the at least two first video acquisition devices and the at least two first video output devices. The method also includes: transmitting the fitness video to be played to the at least two first video output devices through the first media transmission module; Acquiring, by the first media transmission module, the action video of the fitness user captured by the at least two first video capture devices; The target prompt information is transmitted to some or all of the at least two first video output devices through the first media transmission module.
13. The method according to claim 12, characterized in that The first media transmission module is also used for the user terminal to establish a communication connection with the wearable device of the fitness user, and further includes: The physiological characteristic data collected by the wearable device is obtained through the first media transmission module.
14. The method according to claim 2, characterized in that The user terminal includes a second media transmission module, and the second media transmission module is used for the user terminal to establish a communication connection with the coach terminal. The obtaining of the fitness video to be played includes: Receiving the fitness video to be played sent by the coach terminal through the second media transmission module; The sending of the virtual posture and physiological characteristic data of the fitness user to the coach terminal includes: Sending the virtual posture and the physiological characteristic data to the coach terminal through the second media transmission module; The receiving the target prompt information sent by the coach terminal includes: The target prompt information sent by the coaching terminal is received through the second media transmission module.
15. The method according to any one of claims 3 to 5, characterized in that The user terminal includes a second media transmission module, and the second media transmission module is used for the user terminal to establish a communication connection with the coach terminal, and the sending of the initial prompt information, the virtual posture and the physiological characteristic data to the coach terminal includes: The initial prompt information, the virtual posture and the physiological characteristic data are sent to the coaching terminal through the second media transmission module.
16. The method according to claim 4 or 5, characterized in that The user terminal includes a second media transmission module, and the second media transmission module is used for the user terminal to establish a communication connection with the coach terminal, and the receiving verification pass information includes: Receiving the verification pass information sent by the coach terminal through the second media transmission module; The receiving the target prompt information sent by the coach terminal includes: The target prompt information sent by the coaching terminal is received through the second media transmission module.
17. The method according to any one of claims 1 to 5, characterized in that The fitness video to be played includes a plurality of fitness videos to be played, and the step of obtaining the fitness video to be played and controlling the at least two first video output devices to play the fitness video to be played includes: Obtaining the plurality of fitness videos to be played; Each of the at least two first video output devices is controlled to play the plurality of fitness videos to be played.
18. The method according to any one of claims 1 to 5, characterized in that The fitness video to be played includes a plurality of fitness videos to be played. If the number of the at least two first video output devices is less than or equal to the number of the plurality of fitness videos to be played, the step of obtaining the fitness video to be played and controlling the at least two first video output devices to play the fitness video to be played includes: Obtaining the plurality of fitness videos to be played; Each of the at least two first video output devices is controlled to play at least one fitness video to be played among the plurality of fitness videos to be played, and the fitness videos to be played played in each first video output device are different.
19. The method according to claim 17 or 18, characterized in that The multiple fitness videos to be played are posture videos of fitness coaches captured from different angles.
20. The method according to claim 1, characterized in that The at least two first video acquisition devices are the same as part or all of the at least two first video output devices.
21. An audio and video playback method, characterized in that: Applied to the coaching end, the method includes: detecting a first selection operation of a first fitness mode, where the first fitness mode is used to instruct to perform online fitness teaching to a fitness user; In response to a second selection operation, determining at least two second video acquisition devices and at least two second video output devices, each of the at least two second video acquisition devices being located at a different position, and each of the at least two second video output devices being located at a different position; Controlling the at least two second video acquisition devices to acquire a fitness video of a fitness coach, and sending the fitness video to a user terminal of the fitness user; receiving an action video of the fitness user, wherein the action video includes a posture of the fitness user; The at least two second video output devices are controlled to play the action video of the fitness user, so that the fitness coach can provide the online fitness teaching to the fitness user.
22. The method according to claim 21, characterized in that The posture of the fitness user is a virtual posture of the fitness user.
23. The method according to claim 22, characterized in that The method further comprises: receiving physiological characteristic data of the fitness user, wherein the physiological characteristic data corresponds to a posture of the fitness user; generating target prompt information corresponding to the posture of the fitness user according to the virtual posture and the physiological characteristic data; The target prompt information is sent to the user terminal.
24. The method according to claim 23, characterized in that The step of generating target prompt information corresponding to the posture of the fitness user according to the virtual posture and the physiological characteristic data includes: Acquire a sample data set, wherein the sample data set includes a plurality of sample postures and a sample physiological feature interval corresponding to each of the plurality of sample postures; The target prompt information is generated according to the virtual posture, the physiological characteristic data and the sample data set.
25. The method according to claim 24, characterized in that The step of generating target prompt information corresponding to the posture of the fitness user according to the virtual posture and the physiological characteristic data includes: If the posture of the fitness user is not standard, the target prompt information is generated according to the virtual posture, the physiological characteristic data and the sample data set, and the target prompt information is used to prompt the fitness user that the posture is not standard.
26. The method according to claim 24, characterized in that The step of generating target prompt information corresponding to the posture of the fitness user according to the virtual posture and the physiological characteristic data includes: If the posture of the fitness user is in compliance with the standard, the target prompt information is generated according to the virtual posture, the physiological characteristic data and the sample data set, and the target prompt information is used to prompt the fitness user of the posture standard.
27. The method according to claim 25, characterized in that The virtual posture includes a first virtual posture, and the physiological characteristic data includes a first physiological characteristic value, and the first physiological characteristic value is used to represent a physiological characteristic value of the fitness user in the first virtual posture; The generating the target prompt information according to the virtual posture, the physiological characteristic data and the sample data set includes: Determine, according to the first virtual posture, a target sample posture and a target sample physiological characteristic interval in the sample data set, wherein the target sample posture corresponds to the target sample physiological characteristic interval; If the first physiological characteristic value is greater than the target sample physiological characteristic interval, generating the target prompt information, wherein the target prompt information is used to prompt that the first virtual posture has a safety risk; If the first physiological characteristic value is less than the target sample physiological characteristic interval, the target prompt information is generated, and the target prompt information is used to prompt that the first virtual posture is not standard.
28. The method according to claim 21 or 22, characterized in that The method further comprises: Receiving physiological characteristic data and initial prompt information of the fitness user, wherein the physiological characteristic data corresponds to the posture of the fitness user; Verifying the initial prompt information by using the posture of the fitness user and the physiological characteristic data to obtain a verification result of the initial prompt information; Sending the verification result of the initial prompt information to the user terminal.
29. The method according to claim 28, characterized in that The verification result of sending the initial prompt information to the user terminal includes: If the initial prompt information is verified, a verification pass message is sent to the user terminal; If the initial prompt information verification fails, the initial prompt information is adjusted according to the posture of the fitness user and the physiological characteristic data to obtain posture target prompt information corresponding to the fitness user; and the target prompt information is sent to the user terminal.
30. The method according to claim 21, characterized in that The coach terminal includes a first media transmission module, and the first media transmission module is used for the coach terminal to establish a communication connection with the at least two second video acquisition devices and the at least two second video output devices. The method also includes: Acquire the fitness video of the fitness coach captured by the at least two second video capturing devices through the first media transmission module; The action video of the fitness user is transmitted to the at least two second video output devices through the first media transmission module.
31. The method according to claim 23, characterized in that The coach terminal includes a second media transmission module, and the second media transmission module is used for the coach terminal to establish a communication connection with the user terminal. The receiving of the action video of the fitness user includes: Receiving, by the second media transmission module, the action video of the fitness user sent by the user terminal; The receiving of the physiological characteristic data of the fitness user comprises: The physiological characteristic data of the fitness user sent by the user terminal is received through the second media transmission module. The sending the target prompt information to the user terminal includes: The target prompt information is sent to the user terminal through the second media transmission module.
32. The method according to claim 28, characterized in that The coach terminal includes a second media transmission module, and the second media transmission module is used for the coach terminal to establish a communication connection with the user terminal. The receiving of the physiological characteristic data and the initial prompt information of the fitness user includes: Receiving, through the second media transmission module, the physiological characteristic data of the fitness user and the initial prompt information sent by the user terminal; The verification result of sending the initial prompt information to the user terminal includes: The verification result of the initial prompt information is sent to the user terminal through the second media transmission module.
33. The method according to claim 29, characterized in that The coach terminal includes a second media transmission module, and the second media transmission module is used for the coach terminal to establish a communication connection with the user terminal. The sending of the verification pass information to the user terminal includes: Sending verification pass information to the user terminal through the second media transmission module; The sending the target prompt information to the user terminal includes: The target prompt information is sent to the user terminal through the second media transmission module.
34. An audio and video playback device, characterized in that: The device comprises: A first determination module is used to determine at least two first video acquisition devices and at least two first video output devices in response to a selection operation of a fitness user, wherein each of the at least two first video acquisition devices is located at a different position, and each of the at least two first video output devices is located at a different position; A first playing module, used for acquiring a fitness video to be played, and controlling the at least two first video output devices to play the fitness video to be played; A collection module, used for controlling the at least two first video collection devices to collect the action video of the fitness user, wherein the action video includes the posture of the fitness user; The output module is used to control some or all of the at least two first video output devices to output target prompt information corresponding to the posture of the fitness user.
35. An audio and video playback device, characterized in that: The device comprises: A detection module, configured to detect a first selection operation on a first fitness mode, wherein the first fitness mode is used to instruct to perform online fitness teaching to a fitness user; A second determination module is used to determine at least two second video acquisition devices and at least two second video output devices in response to a second selection operation, wherein each of the at least two second video acquisition devices is located at a different position, and each of the at least two second video output devices is located at a different position; A sending module, used for controlling the at least two second video acquisition devices to acquire the fitness video of the fitness coach, and sending the fitness video to the user terminal of the fitness user; A receiving module, configured to receive an action video of the fitness user, wherein the action video includes a posture of the fitness user; The second playing module is used to control the at least two second video output devices to play the action video of the fitness user, so that the fitness coach can provide the online fitness teaching to the fitness user.
36. A terminal device, characterized in that: The terminal device comprises: A memory for storing executable program codes; A processor, configured to call and run the executable program code from the memory, so that the terminal device executes the method according to any one of claims 1 to 20.
37. A terminal device, characterized in that: The terminal device comprises: A memory for storing executable program codes; A processor, configured to call and run the executable program code from the memory so that the terminal device executes the method as claimed in any one of claims 21 to 33.
38. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed, the method according to any one of claims 1 to 20 or 21 to 33 is implemented.