Display devices

Abstract

This application provides a display device including a display and a controller. The controller is configured to: receive volume increase / decrease commands input by a user when simultaneously playing a main video and a secondary video; adjust the volume of the secondary video in response to the volume increase / decrease commands when the focus of the display device is on the volume control of the secondary video; and adjust the volume of the main video in response to the volume increase / decrease commands when the focus is on the volume control of the main video. This application improves the viewing experience of fitness videos.

Description

[0001] This application claims priority to Chinese Patent Application No. 202010851417.4, filed on August 21, 2020, entitled "Display Device and Intelligent Fitness Method", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of display device technology, and more particularly to a display device. Background Technology

[0003] Smart TVs are an important display device in people's homes, allowing them to watch movies, TV shows, cartoons, fitness videos, and other media. With increasing focus on healthy living and a growing abundance of fitness videos, more and more people are choosing to watch fitness videos on their smart TVs while exercising. However, effective fitness training often requires a significant amount of time, and people are easily distracted and fatigued during workouts. Many lose interest after a few sessions and stop exercising, thus failing to achieve their desired results. Therefore, improving people's interest in fitness has become a crucial challenge in popularizing fitness. Summary of the Invention

[0004] To address the aforementioned technical problems, this application provides a display device.

[0005] In a first aspect, this application provides a display device, which includes:

[0006] monitor;

[0007] A controller, connected to the display, is configured to:

[0008] When playing the main video and the secondary video simultaneously, it receives volume increase and decrease commands input by the user.

[0009] When the focus of the display device is on the secondary video volume control, the volume of the secondary video is adjusted in response to the volume increase / decrease command;

[0010] When the focus is on the main video volume control, the volume of the main video is adjusted in response to the volume increase / decrease command.

[0011] Secondly, this application provides a display device, which includes:

[0012] monitor;

[0013] A controller, connected to the display, is configured to:

[0014] When playing the main video and the secondary video simultaneously, it receives volume increase and decrease commands input by the user.

[0015] When the focus of the display device is on the secondary video volume control, in response to the volume increase / decrease command, only the volume of the secondary video is adjusted;

[0016] When the focus is not on the secondary video volume control, in response to the volume increase / decrease command, the system volume of the display device is adjusted to simultaneously adjust the volume of the main video and the secondary video.

[0017] The beneficial effects of the display device provided in this application include:

[0018] This application embodiment allows the main video and secondary video to be played simultaneously, enabling the display device to play other videos on the same screen while playing fitness videos. This enhances the fun of fitness for users. Furthermore, when the main video and secondary video are playing simultaneously, their volumes can be adjusted separately, solving the problem of sound mixing that can easily occur when the main video and secondary video are played at the same time, thus improving the user experience. Attached Figure Description

[0019] To more clearly illustrate the technical solution of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0020] Figure 1 The diagram illustrates an operational scenario between a display device and a control device according to some embodiments;

[0021] Figure 2 The diagram illustrates, by way of example, a hardware configuration block diagram of a display device 200 according to some embodiments;

[0022] Figure 3 The diagram illustrates, by way of example, a hardware configuration block diagram of a control device 100 according to some embodiments;

[0023] Figure 4 The diagram illustrates, by way of example, a software configuration schematic of a display device 200 according to some embodiments;

[0024] Figure 5 The image above exemplarily illustrates a schematic diagram of the homepage of a display device according to some embodiments;

[0025] Figure 6 The image above exemplarily illustrates a schematic diagram of the homepage of a display device according to some embodiments;

[0026] Figure 7The diagram illustrates a training record according to some embodiments;

[0027] Figure 8 The diagram illustrates training suggestions according to some embodiments;

[0028] Figure 9 The diagram above exemplarily illustrates a fitness video details page according to some embodiments;

[0029] Figure 10 The diagram above exemplarily illustrates a fitness video details page according to some embodiments;

[0030] Figure 11 The diagram above exemplarily illustrates a fitness video details page according to some embodiments;

[0031] Figure 12a The diagram above exemplarily illustrates a mode selection interface according to some embodiments;

[0032] Figure 12b The diagram above exemplarily illustrates a mode selection interface according to some embodiments;

[0033] Figure 12c The diagram above exemplarily illustrates a mode selection interface according to some embodiments;

[0034] Figure 13 The image above exemplifies a schematic diagram of a playback interface in a normal mode according to some embodiments;

[0035] Figure 14 The diagram illustrates a gesture guidance schematic according to some embodiments;

[0036] Figure 15 The diagram illustrates a gesture guidance schematic according to some embodiments;

[0037] Figure 16 The diagram illustrates a gesture guidance schematic according to some embodiments;

[0038] Figure 17 The diagram illustrates a gesture guidance schematic according to some embodiments;

[0039] Figure 18 The diagram illustrates a gesture guidance schematic according to some embodiments;

[0040] Figure 19 The diagram illustrates a gesture guidance schematic according to some embodiments;

[0041] Figure 20 The diagram illustrates a gesture guidance schematic according to some embodiments;

[0042] Figure 21 The diagram above exemplarily illustrates a playback interface in follow-up mode according to some embodiments;

[0043] Figure 22 The diagram illustrates a follow-up exercise process according to some embodiments;

[0044] Figure 23 The diagram illustrates a follow-up exercise process according to some embodiments;

[0045] Figure 24 The diagram illustrates, exemplarily, a camera being occupied according to some embodiments;

[0046] Figure 25 The diagram illustrates a follow-up guidance scheme according to some embodiments;

[0047] Figure 26 The diagram illustrates a follow-up guidance scheme according to some embodiments;

[0048] Figure 27 The diagram illustrates a follow-up guidance scheme according to some embodiments;

[0049] Figure 28 The diagram above exemplifies a countdown timer for follow-up exercises according to some embodiments;

[0050] Figure 29 The diagram illustrates a follow-up evaluation according to some embodiments;

[0051] Figure 30 The diagram illustrates a follow-up evaluation according to some embodiments;

[0052] Figure 31 The diagram illustrates a follow-up evaluation according to some embodiments;

[0053] Figure 32 The diagram illustrates a follow-up evaluation according to some embodiments;

[0054] Figure 33 The diagram illustrates a follow-up setup according to some embodiments;

[0055] Figure 34 The diagram illustrates gesture guidance according to some embodiments;

[0056] Figure 35 The diagram illustrates gesture guidance according to some embodiments;

[0057] Figure 36 The diagram illustrates gesture guidance according to some embodiments;

[0058] Figure 37 The diagram illustrates gesture guidance according to some embodiments;

[0059] Figure 38 The diagram illustrates a training scoring scheme according to some embodiments;

[0060] Figure 39 The diagram illustrates a follow-up transition according to some embodiments;

[0061] Figure 40 The diagram illustrates a flowchart of a "learn by watching" mode according to some embodiments.

[0062] Figure 41 The image above exemplifies a movie search page according to some embodiments;

[0063] Figure 42 The image above exemplifies a movie search page according to some embodiments;

[0064] Figure 43 The diagram illustrates volume adjustment according to some embodiments;

[0065] Figure 44 The diagram illustrates volume adjustment according to some embodiments;

[0066] Figure 45 The diagram illustrates volume adjustment according to some embodiments;

[0067] Figure 46 The diagram illustrates volume adjustment according to some embodiments;

[0068] Figure 47 The diagram illustrates a setup diagram of a "watch and practice" mode according to some embodiments;

[0069] Figure 48 The diagram illustrates a mode switching scheme according to some embodiments;

[0070] Figure 49 The diagram illustrates an AR scene mode according to some embodiments;

[0071] Figure 50 The diagram illustrates a pause in the "watch and practice" mode according to some embodiments.

[0072] Figure 51 The diagram illustrates a flowchart of an intelligent fitness method according to some embodiments.

[0073] Figure 52 The diagram illustrates an interface of a display device according to some embodiments;

[0074] Figure 53 The diagram illustrates an interface of a display device according to some embodiments;

[0075] Figure 54 The diagram illustrates an interface of a display device according to some embodiments;

[0076] Figure 55 The diagram illustrates an interface of a display device according to some embodiments;

[0077] Figure 56 The diagram illustrates an interactive schematic of volume gain adjustment according to some embodiments;

[0078] Figure 57 The diagram illustrates an interactive schematic of volume gain adjustment according to some embodiments;

[0079] Figure 58 The diagram illustrates a flow chart of a volume control method according to some embodiments;

[0080] Figure 59 The diagram illustrates an interactive schematic of volume gain adjustment according to some embodiments;

[0081] Figure 60 The diagram illustrates a flow chart of a volume control method according to some embodiments;

[0082] Figure 61 The image above exemplifies a timing diagram of a display device simultaneously playing a main video and a secondary video according to some embodiments;

[0083] Figure 62 The diagram illustrates a flowchart of a method for simultaneously playing a main video and a secondary video using a display device according to some embodiments;

[0084] Figure 63 The diagram illustrates a flow chart of a volume control method according to some embodiments;

[0085] Figure 64 The diagram illustrates a flow chart of a volume control method according to some embodiments. Detailed Implementation

[0086] To make the objectives and implementation methods of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the exemplary embodiments described are only some embodiments of this application, and not all embodiments.

[0087] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0088] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0089] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0090] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0091] Figure 1 This is a schematic diagram illustrating a usage scenario of the display device according to an embodiment. For example... Figure 1 As shown, the display device 200 also communicates with the server 400, and the user can operate the display device 200 through the smart device 300 or the control device 100.

[0092] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes at least one of infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via a wired connection. Users can control the display device 200 by inputting user commands through at least one method, such as buttons on the remote control, voice input, or control panel input.

[0093] In some embodiments, the smart device 300 may include any one of a mobile terminal, tablet computer, computer, laptop computer, AR / VR device, etc.

[0094] In some embodiments, a smart device 300 may also be used to control the display device 200. For example, an application running on the smart device may be used to control the display device 200.

[0095] In some embodiments, the smart device 300 and the display device may also be used for data communication.

[0096] In some embodiments, the display device 200 can also be controlled in ways other than the control device 100 and the smart device 300. For example, it can be controlled by directly receiving the user's voice commands through a module configured inside the display device 200 for acquiring voice commands, or it can be controlled by receiving the user's voice commands through a voice control device set outside the display device 200.

[0097] In some embodiments, the display device 200 also communicates with the server 400. The display device 200 may communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactive features to the display device 200. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.

[0098] In some embodiments, software steps executed by one execution entity can be migrated to another execution entity with which it communicates data, as needed. For example, software steps executed by a server can be migrated to a display device with which it communicates data, and vice versa.

[0099] Figure 2 An exemplary block diagram of the configuration of the control device 100 according to an exemplary embodiment is shown. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0100] In some embodiments, the communication interface 130 is used for external communication and includes at least one of a WIFI chip, a Bluetooth module, an NFC module, or an alternative module.

[0101] In some embodiments, the user input / output interface 140 includes at least one of a microphone, touchpad, sensor, button, or alternative module.

[0102] Figure 3 A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is shown.

[0103] In some embodiments, the display device 200 includes at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0104] In some embodiments, the controller includes a central processing unit, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first to an nth interface for input / output.

[0105] In some embodiments, the display 260 includes a display screen component for presenting an image, a driving component for driving image display, a component for receiving image signals output from a controller, and a user control UI interface, etc.

[0106] In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

[0107] In some embodiments, the tuner 210 receives broadcast television signals via wired or wireless reception and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

[0108] In some embodiments, the communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

[0109] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0110] In some embodiments, the external device interface 240 may include, but is not limited to, one or more of the following interfaces: High Definition Multimedia Interface (HDMI), analog or data high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. It may also be a composite input / output interface formed by multiple of the above interfaces.

[0111] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0112] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations via various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the display 260, the controller 250 can perform operations related to the object selected by the user command.

[0113] In some embodiments, the object can be any of the optional objects, such as a hyperlink, an icon, or other operable controls. Operations related to the selected object include: displaying links to hyperlinked pages, documents, images, etc., or performing operations corresponding to the program associated with the icon.

[0114] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM (random access memory), ROM (read-only memory), a first to an nth interface for input / output, a communication bus, etc.

[0115] A CPU (CPU) processor is used to execute operating system and application instructions stored in memory, as well as various interactive instructions received from external input, to execute various applications, data, and content, ultimately for the display and playback of various audio and video content. A CPU processor can include multiple processors, such as a main processor and one or more sub-processors.

[0116] In some embodiments, a graphics processor is used to generate at least one of various graphical objects, such as icons, operation menus, and user-input-based graphics. The graphics processor includes an arithmetic logic unit (ALU) that performs calculations based on various user-input interactive commands and displays various objects according to display attributes; it also includes a renderer that renders the various objects obtained from the ALU, the rendered objects being displayed on a monitor.

[0117] In some embodiments, a video processor is configured to receive an external video signal and perform at least one of the following video processing operations according to a standard encoding and decoding protocol of the input signal: decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc., to obtain a signal that can be directly displayed or played on a display device 200.

[0118] In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, and a display formatting module. The demultiplexing module demultiplexes the input audio and video data streams. The video decoding module processes the demultiplexed video signal, including decoding and scaling. The image compositing module, such as an image synthesizer, overlays and blends a GUI signal generated by a graphics generator based on user input or its own generation with the scaled video image to generate a displayable image signal. The frame rate conversion module converts the input video frame rate. The display formatting module receives the frame rate-converted video output signal and modifies the signal to conform to a display format, such as outputting RGB data signals.

[0119] In some embodiments, an audio processor is configured to receive external audio signals, perform decompression and decoding according to a standard codec protocol of the input signal, and at least one of the following processes: noise reduction, digital-to-analog conversion, and amplification, to obtain a sound signal that can be played in a speaker.

[0120] In some embodiments, the user can input user commands through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input commands through the GUI. Alternatively, the user can input user commands by inputting specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0121] In some embodiments, a "user interface" is the medium through which an application or operating system interacts and exchanges information with a user, enabling the conversion between the internal form of information and a form acceptable to the user. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include at least one of the visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0122] In some embodiments, the user interface 280 is an interface that can be used to receive control input (e.g., physical buttons on the display device body, or others).

[0123] In some embodiments, the display device's system may include a kernel, a command interpreter (shell), a file system, and applications. The kernel, shell, and file system together form the basic operating system structure, allowing users to manage files, run programs, and use the system. Upon power-up, the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, and runs and maintains virtual memory, the scheduler, signals, and inter-process communication (IPC). After the kernel starts, the shell and user applications are loaded. Applications are compiled into machine code after startup, forming a process.

[0124] See Figure 4 In some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the Android runtime and system library layer (referred to as the "System Runtime Layer"), and the kernel layer.

[0125] In some embodiments, at least one application runs in the application layer. These applications may be Windows programs, system settings programs, or clock programs that come with the operating system; they may also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0126] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications in the application layer. Applications can access system resources and obtain system services during execution through the API interface.

[0127] like Figure 4As shown, the application framework layer in this embodiment includes managers, content providers, etc., wherein the managers include at least one of the following modules: ActivityManager, which interacts with all activities running in the system; LocationManager, which provides access to system location services for system services or applications; PackageManager, which retrieves various information related to application packages currently installed on the device; NotificationManager, which controls the display and clearing of notification messages; and WindowManager, which manages icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0128] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling display window changes (e.g., shrinking the display window, shaking the display, distorting the display, etc.).

[0129] In some embodiments, the system runtime library layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system runs the C / C++ libraries contained in the system runtime library layer to implement the functions that the framework layer needs to perform.

[0130] In some embodiments, the kernel layer is a layer between hardware and software. For example... Figure 4 As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.

[0131] In some embodiments, the hardware or software architecture can be based on the description in the above embodiments, and in some embodiments it can be based on other similar hardware or software architectures, as long as the technical solution of this application can be implemented.

[0132] As more and more people pay attention to fitness, many fitness videos have appeared online for users to learn from. Display devices, as playback devices, can play fitness videos, allowing users to exercise at home. However, people may feel tired and find it time-consuming when watching fitness videos and learning, causing many to lose interest after a few workouts and stop exercising, thus failing to achieve the desired fitness results.

[0133] To address the aforementioned issues, this application offers users a variety of fitness modes to choose from, which can enhance users' interest and effectiveness in exercising. Furthermore, it improves the user's fitness experience through volume control.

[0134] In some embodiments, when a user activates the display device, the display device receives the input signal and may first display the homepage. See also Figure 5 The homepage can be divided into a category area and a content area. The category area can contain multiple categories, such as "My," "Channels," "VIP," "Fitness," "Shop," "Games," "Apps," and "Discover." Each category has interactive controls. Below the category area is the content area for the currently selected category. When a category is selected, it is highlighted to indicate to the user that it is the currently selected category. When switching between different categories, the content area can be updated to display the content corresponding to the new category.

[0135] The display process can be as follows: after a column control is selected, the display device retrieves the display content data corresponding to the column from the local machine or server, and then loads the display content data into the display area.

[0136] In some embodiments, when the display device first enters the homepage after startup, the "My" section can be selected by default, that is, the "My" control can be set as the default focus position. Users can select different sections using the directional keys on the remote control, for example, selecting the "Fitness" section control. The default focus position can also be other controls.

[0137] In some embodiments, when the display device returns to the home page from another page, the previously selected item may be selected by default. Alternatively, the control at the default focus position can be selected.

[0138] In some embodiments, when a user selects the "Fitness" category control, the content area can display the interface corresponding to the "Fitness" category control. This page may include personal record item controls and recommended item controls. Both the personal record item controls and recommended item controls are operable controls.

[0139] The personal record item control can be placed on the side of the content area. When a user is logged in, the personal record item control can display the user's comprehensive training data. When the user is not logged in, the personal record item control can display a login control. When the user clicks the login control, the display device can pop up a login page on the current page, allowing the user to enter their account and password to log in. After the user logs in, the display device can exit the login page and change the personal record item control to display the user's comprehensive training data control. The content displayed by the comprehensive training data control can include at least one of the following: user name, user avatar, cumulative energy consumption, cumulative training duration, and cumulative training days. Among them, the user name can be the training data of XXX, the cumulative energy consumption can be an integer in kilocalories, the cumulative training duration can be an integer in minutes, and the cumulative training days can be an integer in days.

[0140] The recommended project control can be a media asset control that displays media assets. There can be multiple recommended projects, and the recommended content can include any combination of items such as "Exclusive Fitness," "Operational Posters," "Aerobics," "Yoga," "Parent-Child Exercises," "Children's Dance," "Square Dance," "Tai Chi," "Spring Weight Loss Challenge," "White-Collar Relaxation Exercises," "Immunity Boosting Plan," "Goddess Training Camp," "Be a Little Fairy," "Beginner Training," "Intermediate Training," "Advanced Training," "Weight Loss Training," "Shaping Training," and "Stretching Training." The "Exclusive Fitness" control can display the user's customized fitness service information. Different background images can be displayed for users who are not logged in, logged in but have not customized a fitness service, or logged in and have customized a fitness service.

[0141] In some embodiments, the homepage may also be other interfaces, see [link to relevant documentation]. Figure 6 The column area and content area can be updated to be different from [the previous ones]. Figure 5 The appearance of the media asset controls in the content area can be distinguished from others. Figure 5 Recommended programs include "fat-burning fitness exercises", "aerobic dance", and "ultra-effective fat loss".

[0142] On the homepage, under the fitness section, when a user clicks the personal records control, the device can redirect the current page to the training records page. See [link / reference]. Figure 7 The training records page displays detailed training data for the user. This detailed training data may include the following:

[0143] 1. Training score:

[0144] The data is calculated and displayed based on daily, weekly, monthly, and total dimensions, and the data format is integer.

[0145] Scoring formula: 40 * (actual practice time / fixed value) + 60 * (average accuracy / 1)

[0146] Fixed values: Daily: 30; Weekly: 150; Monthly: 600; Total: 7200

[0147] In the scoring formula, if 40 * (actual completed practice time / fixed value) > 40, it is calculated as 40.

[0148] 2. Number of training sessions, training duration, and energy expenditure:

[0149] All training data are calculated cumulatively by day, week, month, and total, and the cumulative data is displayed in integer format.

[0150] Data sources include: health-beneficial media assets, proprietary media assets (normal mode, follow-up mode, watch and practice mode), and exclusive fitness (customized plans).

[0151] 3. Longest training session duration, number of consecutive training days per session, and maximum energy expenditure per session:

[0152] All training data are ranked by week, month, and total data, and the top-ranked data is displayed in integer format.

[0153] Data sources include: health-beneficial media assets, proprietary media assets (normal mode, follow-up mode, watch and practice mode), and exclusive fitness (customized plans).

[0154] On the homepage, under the fitness section, clicking the recommended program control will take users to the fitness details page.

[0155] 4. Health advice:

[0156] Health advice can be used as training advice; its details can be found at [link to relevant documentation]. Figure 8 Different content can be displayed depending on whether the user is logged in or not.

[0157] In some embodiments, the training record page may also display a "History" control and a "My Customization" control. When the user clicks the "History" control, the display device can show the user's historical fitness data. When the user clicks the "My Customization" control, the display device can show the user's customized fitness services.

[0158] On the homepage, under the fitness section, when a user clicks the "Recommended Item" control, the device will redirect the current page to the corresponding fitness details page, where the user can view the fitness video for that item. Alternatively, the user can access the fitness video list or the fitness video playback interface.

[0159] See Figure 9, the details page of the fitness video can display the details of the fitness video, and the details can include an introduction, episodes, related recommendations, and operation controls. The introduction can be used to display the relevant information of the fitness video and can also include a video playback window to play the fitness video preview. The episodes and related recommendations can be operation controls, and users can click on different episodes to perform different training. The operation controls other than the episodes and related recommendations can include "Start Training", "Open VIP", "Like", "Favorite", and "Share". The focus can be default set on the "Start Training" control, and different functions can be realized when the user clicks on different operation controls.

[0160] In some embodiments, the fitness details page can also be other interfaces. See Figure 10 , the fitness details page can be updated to be distinguished as Figure 9 appearance.

[0161] In some embodiments, different fitness videos are set with different viewing modes, such as normal mode, follow-along mode, and viewing mode. When the fitness video supports the follow-along mode, the fitness details page can also be Figure 11 the appearance shown. As Figure 11 shown, the "Like" control can display the number of likes for the course. The parameter optimization algorithm logic for the number of course likes is as follows:

[0162] a. The number of users who like, X, X < 10, not shown;

[0163] b. The number of users who like, X, 10 < X, show appearance X.

[0164] Furthermore, when the number of users who like is in different ranges, different control appearances are shown. The control appearance can include at least one of the color of the control, the characters loaded, the shape of the control, etc.

[0165] In some embodiments, when the user clicks on a certain episode or related recommendation or the "Start Training" control, the display device can directly play the fitness video or pop up a mode selection interface. See Figure 12a , the mode selection interface can be set with at least one of the three viewing modes, namely: normal mode, follow-along mode, and viewing mode. Among them, the viewing mode can also be called the watch-and-practice mode. Each viewing mode can be configured with a background picture and set with corresponding prompts to facilitate users to understand the characteristics of different viewing modes. For example, the normal mode can be set with a prompt: "Block the camera to watch the complete teaching video and familiarize yourself with the training actions", the follow-along mode can be set with a prompt: "Turn on the camera to get real-time comparison of actions and make the actions more standard", and the viewing mode can be set with a prompt: "Block the camera to watch the drama and exercise at the same time without compromising the exercise effect" or "Watch the drama and exercise at the same time without compromising the exercise effect". The specific prompt words can be set according to requirements.

[0166] In some embodiments, the mode selection interface is a floating layer set on the details interface, and the transparency of the floating layer can be set as needed.

[0167] In some embodiments, in response to the user's selection of media assets, it is determined whether the media asset is a training media asset. The so-called training media asset is a training media asset in which keyframes with completed skeletal point annotations are present. Action matching and recognition can be performed by comparing the skeletal points in the image captured by the camera with the skeletal points in the keyframes. Several schemes for matching training media assets have been disclosed in the applicant's previous patents, and will not be elaborated here.

[0168] In some embodiments, the display device can determine whether a media asset is a follow-up training asset by the tag of the video resource, or by detecting whether it contains skeletal point data.

[0169] In some embodiments, after determining that the fitness material is a follow-along training material, the displayed mode selection interface includes at least a follow-along training mode control and other mode controls (e.g., at least one of a normal mode control and / or a movie viewing mode control). Figure 12a As shown.

[0170] In some embodiments, after determining that the fitness material is not a follow-along training material, the displayed mode selection interface does not include a follow-along training mode control, but displays at least one of the other mode controls. For example... Figure 12b As shown.

[0171] In some embodiments, a media asset retrieval request is sent to the server based on the media asset control selected by the user. The retrieval request contains the media asset identifier corresponding to the media asset control. The server receives the media asset data of the media asset determined based on the media asset identifier, and the details page / list page is loaded based on the media asset data.

[0172] In some embodiments, the media asset data includes a confirmation label indicating whether the media asset is a follow-up media asset. After the user selects the playback control, the type of the confirmation label is determined. When the confirmation label indicates a different type of media asset, a different mode selection interface is displayed.

[0173] In some embodiments, after receiving a playback selection for a media asset, it is determined whether the media asset is a practice media asset based on the practice identifier parameter of the media asset. The media asset practice parameter can be displayed as shown in the image. Figure 6 Media asset controls shown / such Figure 10 The details page interface is included in the media asset data downloaded from the server, or it can be obtained from the server in real time after receiving the playback selection of the media asset.

[0174] In some embodiments, upon receiving a playback selection for a media asset, the system determines whether the user has permission to play the media asset based on the user's identifier. If not, a permission purchase or permission prompt interface pops up instead of a mode selection interface.

[0175] In some embodiments, upon receiving a playback selection for media assets, the display device generates a media asset playback request based on the media asset ID and account ID, and sends it to the server. The server authenticates the account ID, and if the user has playback permissions, sends the media asset data and a play permission marker to the display device. The display device then displays the mode selection interface based on the received data. If the user corresponding to the account ID does not have playback permissions, no video data is sent to the display device, or only a limited duration of video data is sent, and a play permission marker is sent to the display device. The display device then displays the benefits purchase interface instead of the mode selection interface. After the user completes the purchase of benefits, the benefits purchase interface or its subsequent interfaces are canceled, and the mode selection interface is displayed to the user, avoiding the inconvenience of the user having to return to the list page and re-enter the details page.

[0176] In some embodiments, the pop-up mode selection interface can also be located at the bottom of the current interface, such as... Figure 12c As shown, the mode selection interface also offers four viewing modes: posture correction, large-screen tutorial, binge-watching mode, and AR scene. Among these, posture correction and... Figure 12a Similar to the follow-along mode, both simultaneously play user movements and fitness videos; large-screen tutorials and... Figure 12a Similar to the normal mode, both display fitness videos in full screen; the binge-watching mode is the same as... Figure 12a Similar to the normal mode, both play movie and fitness videos simultaneously; in AR scene mode, the user can be cut out and virtually placed into the fitness scene using a 3D camera set on the display device.

[0177] In some embodiments, a mode is designed so that, after the user selects the corresponding mode control, the television displays an interface containing a workout media playback window and a local video playback window. The workout media playback window and the local video playback window are arranged parallel to each other along the length of the television. The workout media playback window is used to play fitness media, and the local video playback window is used to play images captured by a camera. The workout media playback window and the local video playback window can be located on the same layer.

[0178] In some embodiments, a mode is intended to display an interface on the TV that includes a training media playback window and a video playback window after the user selects the corresponding mode control. The layer where the training media playback window is located is below the layer where the video playback window is located. The video playback window covers part of the area of ​​the training media playback window. The training media playback window is used to play fitness media, and the video playback window is used to play other media besides the fitness media selected by the user.

[0179] In some embodiments, a mode is intended to make the TV display a playback interface containing only a video playback window after the user selects the corresponding mode control. This playback window can be a follow-up exercise media playback window used to play fitness media.

[0180] In some embodiments, after the user selects the normal mode, the display plays the media asset (such as...) in full-screen mode. Figure 13 (As shown).

[0181] In some embodiments, after the user selects the follow-up mode, the display enters the posture recognition interface, which includes a guided action display window and a local video guidance window. The guided action display window shows the recognition actions that the user needs to follow, and the local video guidance window displays local images captured in real time by the camera. After the person in the local image is recognized and performs the recognition action, the video begins to play (e.g., ...). Figure 15 (As shown).

[0182] In some embodiments, the guidance action display window is located above the follow-up media playback window. After the display device recognizes that the user has performed the correct guidance action, it removes the guidance action display window layer and triggers the follow-up media playback window to play the image data corresponding to the follow-up media ID.

[0183] In some embodiments, after the user selects the viewing mode control, they are first taken to a movie / TV search page (the movie / TV search page may be as follows). Figure 41 (As shown). In some embodiments, the movie search interface is overlaid on top of the original interface.

[0184] In some embodiments, when a TV series, related recommendation, or fitness video corresponding to the "Start Training" control is a smart fitness (self-developed AI follow-along) media asset, the mode selection interface can display the above three viewing modes, with the default focus being the follow-along mode; in some embodiments, when a TV series, related recommendation, or fitness video corresponding to the "Start Training" control is a normal fitness media asset, the mode selection interface can only display the normal mode and the movie viewing mode, with the default focus being the normal mode.

[0185] In some embodiments, each viewing mode is an operation control. Normal mode and movie-watching mode are available to logged-in users and anonymous users, while the follow-up mode is available to logged-in users. If a user is not logged in, when the user clicks the follow-up mode control, the display device will pop up a login interface, guiding the user to log in and use the follow-up mode.

[0186] In some embodiments, when a user enters the normal mode, follow-up mode, or any of the watch-and-practice modes for the first time, the display device may display a guide image. After the guide image display ends, the system returns to the following logical parameters:

[0187] 1. After the introduction to normal mode, return to the video playback interface.

[0188] 2. After the introduction to the follow-up mode, return to the follow-up playback interface.

[0189] 3. After the "Watch and Practice" mode introduction, return to the main video selection screen. The main video selection screen can also be a search interface.

[0190] In some embodiments, when a user clicks on a TV series or related recommendation or the "Start Training" control, the display device may also pop up a mode selection interface or directly enter a viewing mode according to the mode default selection logic. The mode default selection logic may be as follows:

[0191] a) When a user takes a course for the first time, a mode selection page is displayed. After the user selects a mode, the corresponding mode function can be used.

[0192] b. For courses that are not first-time users, courses with a follow-up mode will default to follow-up mode; courses without a follow-up mode will default to normal mode.

[0193] c. Abnormal scenario: If the user was in the follow-up mode last time, but the current course is a normal course, then enter the normal mode.

[0194] In some embodiments, when a user clicks the "Normal Mode" control, or enters Normal Mode according to the default mode selection logic, the device displays a fitness video playing in Normal Mode.

[0195] See Figure 13 This is a schematic diagram of a normal mode according to some embodiments. In normal mode, the user can perform the following operations:

[0196] 1. Press the down arrow key to bring up the episode selection area. The default focus is on the current episode in the playlist.

[0197] 2. Press the menu button, and the default focus will be on the current mode of [Mode Switch].

[0198] After the user switches modes, the display device pauses the playback of the current playback interface and loads the display interface corresponding to the switched mode. For example, when switching from normal mode to follow-up mode, the current follow-up playback interface is paused, and the playback information of the follow-up media (including at least one of the media identifier, playback time, etc.) is recorded. The follow-up interface is then started. In the follow-up media playback window, the media data played in normal mode is loaded according to the playback information, and the local image data obtained by the camera is loaded in the local video window.

[0199] In some embodiments, a mode selection interface may not be provided. After the user selects the playback control, the display device directly plays the practice media according to the preset playback method.

[0200] In some embodiments, when a user clicks the "Follow-up Mode" control, or enters Follow-up Mode according to the default mode selection logic, the display device may show a guide image based on the user's first or first few entries into Follow-up Mode. In Follow-up Mode, the guide image may be a gesture operation guide image.

[0201] In some embodiments, see Figure 14 The gesture operation guide includes a gesture recognition guide and guidance prompts. When a user enters the follow-up mode for the first time, the following is displayed: Figure 14 The posture guidance prompts shown will not be displayed if the user is not entering the follow-up mode for the first time. In this gesture recognition guidance image, the focus is on the "I understand" control by default. If the user clicks this control, the display will jump to the next guidance image, such as the human portrait entry guidance image; if the user clicks back, they will return to the previous screen, such as the fitness details page.

[0202] In some embodiments, see Figure 15 In the facial recognition interface, the display device needs to determine the facial object to be detected for motion. For example, when the human body is a single person or multiple people, the device determines the skeletal point data of the facial object that matches the guided motion by following the facial image, and then performs motion detection and recognition in subsequent image frames based on the determined skeletal point data.

[0203] In some embodiments, the facial recognition interface includes at least two windows: one window displays a demonstration image of the guided action, and the other displays real-time facial data acquired by the camera. For example, the left side displays the demonstration image of the action, the right side displays the image captured by the camera, and the middle displays an AR recognition circle.

[0204] In some embodiments, when a user enters the practice mode for the first time, the data for top duration, accuracy, and energy consumption are all empty.

[0205] In some embodiments, a guide position icon is pre-set on the upper layer of the window displaying the local image captured by the camera, so that the user can move their actual position by referring to the relative position of the image in the local image window and the guide position icon.

[0206] In some embodiments, when a user revisits the gesture guidance map during training, rather than entering the training mode for the first time, the top of the facial recognition guidance map may display data such as duration, accuracy, and energy consumption. In some embodiments, during training, the user can access the settings interface via the down arrow key, and then access the gesture guidance map interface from the settings interface. After the display device shows the human image entering the guidance map, the user can perform the corresponding action based on the action demonstration image. In some embodiments, after a certain interval, the display screen will jump to the next guidance map. In some embodiments, the display device may jump to the next guidance map based on the user's action matching the action demonstration image.

[0207] See Figure 16 In some embodiments, the next guide image after the human image enters the guide image is a human image recognition guide image. After entering the human image guide image, the user can perform corresponding actions according to the action demonstration image. The display device displays the image data captured by the device head in the local image display window and determines whether the image data and the actions in the action demonstration image match to determine whether the user has completed the guided action.

[0208] In some embodiments, the display device may perform the following execution logic based on the images captured by the camera:

[0209] In some embodiments, 1. No one is on the screen

[0210] 1. If no one is on the screen for 3 consecutive seconds, the above prompt will be displayed. Voice prompt: Stand on the screen and perform the specified action to start the follow-along exercise.

[0211] 2. The prompt will be given every 3 seconds.

[0212] 2. The camera slowly rotates to the center position, and the aperture moves accordingly to maintain the relative position of the aperture and the local image window.

[0213] In some embodiments, secondly, there is someone on the screen.

[0214] 1. When the camera can rotate, identify the person's position, place the aperture at the person's feet, and slowly roll the camera to ensure the person is in the center of the frame. As the person moves, the aperture and camera move accordingly.

[0215] 2. When the camera cannot be rotated, cameras that do not support rotation do not need to be rotated. Furthermore, the user can be prompted to move to the center of the view.

[0216] In some embodiments, thirdly, someone does not take any action.

[0217] 1. If a person is recognized on the screen and does not perform any action for more than 5 seconds, a voice prompt will appear: "Follow the image to perform the specified action." This will enable follow-along training.

[0218] 2. The prompt will be given every 3 seconds.

[0219] In some embodiments, fourth, state changes

[0220] 1. When the interface changes from empty to occupied, remove the arrow prompt. Refer to "Part Two" for the remaining logic.

[0221] 2. The logic for the transition from a populated to an unpopulated area is similar to "I".

[0222] Furthermore, it also includes: interaction between autofocus and the overall camera settings.

[0223] 1. The camera settings in the fitness app will be stored locally, and the camera will be in the default position the next time you open it.

[0224] 2. When the initial value is empty, the default is the position of the camera on the entire device.

[0225] In some embodiments, if the user clicks "back", they can return to the previous screen, such as the fitness details page.

[0226] In some embodiments, guiding the user to a designated location and prompting the user to perform a designated action can be done in steps or simultaneously. For example, see [link to example]. Figure 17 After a person stands in the designated position, the next guidance image after the facial recognition guidance image can be the action recognition guidance image. Upon entering the action recognition guidance image, the user can perform the corresponding action based on the action demonstration image. In some embodiments, the display device can execute the following logic based on the image captured by the camera:

[0227] 1. When the user performs the action as shown in the illustration, the following will be displayed: Figure 17 Continue for 2 seconds, then begin practicing.

[0228] 2. The animation is abandoned during the demonstration, and progress is paused. Other situations are described below:

[0229] a. Continue performing the designated action; the progress bar will continue to move.

[0230] b. When the user leaves the location circle, the effect changes to the initial entry interface.

[0231] 3. After completing the exercise, the left overlay will be removed, and a countdown will be displayed. The video will then begin loading and start playing after the countdown ends. The prompts on the right-hand camera interface will disappear. A voice prompt will appear: "Ready, training is about to begin."

[0232] See Figure 18 The next guide image after the motion recognition guide image can be the arm-crossing pause guide image. After entering the arm-crossing pause guide image, the user can perform the corresponding action based on the action demonstration image.

[0233] In some embodiments, the display device may perform the following execution logic based on the images captured by the camera:

[0234] 1. The user makes a cross gesture for 1 second to confirm the start / pause of the countdown recognition.

[0235] 2. After 2 seconds, the pause function will be triggered, and the device will enter a paused state.

[0236] 3. If you abandon a move during the performance, the pause progress will be lost. You will have to start over the next time you compete.

[0237] 4. Press the OK button on the remote control to enter pause mode.

[0238] 5. During the training, the position circle changes with the user's movement. If the user leaves the camera display area, the training will pause.

[0239] In some embodiments, see Figure 19 The next guide image after the arm-crossing pause guide image can be the guide image for the paused state. After entering the paused state guide image, the user can perform the corresponding action based on the action demonstration image. In some embodiments, the display device can take the following execution logic based on the image captured by the camera:

[0240] 1. The countdown timer is activated and paused after the user holds the hands-on-hips gesture for 1 second.

[0241] 2. Playback will be triggered after 2 seconds, and the program will switch to playback mode.

[0242] 3. If you give up during the exercise, your training progress will be lost, and you will have to start over the next time you compete.

[0243] 4. Press the OK button on the remote control. The countdown will start on the left (3, 2, 1), and the pop-up notification on the right will disappear. After the countdown ends, playback will resume from where it was last played.

[0244] In some embodiments, after a pause action is detected, the similarity between the action in the video frame of the nearby demonstration action and the standard pause action is obtained. If an image frame similar to the standard pause action exists in the video frame of the nearby demonstration action, the pause training operation is not triggered; otherwise, it is triggered. This is to avoid the situation where the action in the follow-up video frame includes a pause action, leading to accidental pauses during follow-up training.

[0245] In some embodiments, the presence of image frames similar to the standard pause action in video frames of nearby demonstration actions at a given time point can be determined by the matching score in the already performed action comparison. A high matching score means that a similar action exists in the follow-up video, while a low matching score means that a similar action does not exist in the follow-up video.

[0246] See Figure 20 In some embodiments, the next guide image after the paused state guide image may be a guide image with a camera but failed to be accessed. The guide image with a camera but failed to be accessed includes a prompt screen to remind the user to check the camera.

[0247] When a user enters the practice mode for the first time, the display device will show the practice mode interface after the tutorial image finishes playing, allowing the user to begin practicing. See also... Figure 21 The follow-along mode interface can include two playback windows. One window plays fitness videos, such as follow-along lessons, while the other window displays the user's camera feed. Additionally, the display interface can show other information, such as trial rules and training records. As you can see, in follow-along mode, the user's image can be uploaded to the display device using the camera, allowing the user to intuitively judge whether their movements are consistent with the fitness video.

[0248] In some embodiments, the display device may also display prompts on the user's follow-up window based on whether the user's actions and the fitness video are consistent, as determined by the software.

[0249] In some embodiments, when a user enters the follow-up mode for the first time, the display device can display the user interface according to the execution logic shown in Figure 22 after entering the follow-up mode.

[0250] In some embodiments, Figure 22 The execution logic prior to the training process can be simplified to: Figure 23 The process is shown below.

[0251] When the display device follows Figure 22 After the execution logic shown enters the follow-up process, a default loading page can be displayed, or it can be displayed according to... Figure 23 The execution logic shown displays the default loading page.

[0252] In some embodiments, if the camera is being used by another application, the default loading page can be a notification page indicating that the camera is in use, such as... Figure 24 As shown, the default loading page can prompt the user to exit and re-enter.

[0253] In some embodiments, if the camera is not occupied by other applications and is successfully turned on, it can be displayed. Figure 25 The default loading page shown is similar to the facial recognition interface. Figure 25 As shown, the facial recognition interface can be set with prompts such as "Please keep one person standing inside the circle." After displaying the loading page, the display device can perform facial recognition via its camera. If the recognition is successful, the user enters the practice interface. If the user clicks the back button, they return to the source interface, i.e., the previous screen from the loading page. Furthermore, after successful recognition, the display device fixes the camera angle for stable image acquisition of the user.

[0254] In some embodiments, the process of facial recognition performed by the display device is as follows:

[0255] In some embodiments, 1. Detect that there is no one on the current screen.

[0256] 1. If the camera does not support rotation, or if the user is not detected after being rotated to the edge, display the message: Please stand in the center of the screen.

[0257] 2. When the camera supports rotation, the camera slowly rolls to the center position, and the aperture moves accordingly.

[0258] In some embodiments, secondly, detecting a person in the current frame.

[0259] 1. When the camera supports rotation, the aperture falls at the feet of the person in front, and the camera is slowly rotated to ensure the person is centered in the frame. As the person moves, the aperture and camera move accordingly.

[0260] 2. When the camera is at the moving boundary (top, bottom, left, right boundaries), display the prompt: Please stand in the center of the screen.

[0261] In some embodiments, third, from unmanned to manned.

[0262] 1. Cancel the prompt.

[0263] 2. For the remaining logic, refer to "II. Detecting People in the Current Screen".

[0264] In some embodiments, IV. From manned to unmanned – see “I”.

[0265] In some embodiments, five, multiple people are in front of the camera.

[0266] 1. Only recognize 1 person

[0267] In some embodiments, at least two of the multiple people can also be identified.

[0268] In some embodiments, if the camera cannot center the user on the screen, a prompt page may be displayed, such as... Figure 26As shown, the prompt page can display the prompt: "Please stand in the center of the screen." When the user is in the center of the screen, the display device can display the prompt page shown in Figure 27, prompting the user to confirm that they have started practicing.

[0269] In some embodiments, when the user follows Figure 27 After following the instructions shown, see [link / reference]. Figure 28 The display device shows a 3-second countdown to the video, and then begins playing the follow-up video and user image.

[0270] In some embodiments, facial recognition is not required again when a user switches episodes during practice.

[0271] In some embodiments, if the follow-up course has trial rules, these rules can be displayed in the upper right corner of the course. During training, the display device uses a facial recognition algorithm to lock onto and track the user's face, identifying the user in the camera view and following the user's movements. When the user successfully performs an action, feedback can be displayed, such as encouraging words, which can be animated to enhance engagement. See also Figure 29 The encouraging word can be "GOOD".

[0272] In some embodiments, the feedback from the display device to user actions may be generated according to the following feedback rules:

[0273] Priority Feedback illustration Triggering conditions Animation Interactive Feedback 3 Encourage feedback Accuracy rate above 80% for 3 consecutive seconds Two AR encouraging feedback animations will be displayed randomly. 3 Error action feedback Accuracy rate below 60% for 3 consecutive seconds Two AR error feedback animations are displayed randomly. 2 The human body is still Human body not detected within 4 seconds Poke users with both hands 1 The human body is not in the camera's view. The system detected that the person was not within the frame within 4 seconds. The camera showed no person was detected. 0 No camera Camera not detected The camera cannot be detected.

[0274] In some embodiments, the smaller the priority number, the higher the priority.

[0275] Training records can include training time, calories burned, and accuracy. These records can be refreshed based on time, following these refresh rules:

[0276] a. Training time: Displayed in real time based on course schedule;

[0277] b. Accuracy: The accuracy rate is refreshed every second during the effective action time period of the video and the user's follow-up actions.

[0278] c. Calories burned: User action accuracy within 1 second * 1 second / effective posture marking time in video * standard calories. If it cannot be determined, the expected refresh time is 1 second / time.

[0279] In some embodiments, calories burned may be displayed as energy expenditure, which may also be calculated in the following ways:

[0280] Energy consumed = the sum of energy consumed by each action

[0281] Energy consumed per action = Energy of each action * Accuracy of that action.

[0282] The accuracy rate of a certain action = the arithmetic mean of all accuracy rates during that action (including misses).

[0283] The media asset file for the practice video needs to include the energy level for each movement.

[0284] In some embodiments, if the display device does not detect the user within 4 seconds, the triggered animated interface may be as follows: Figure 30 As shown; if the display device detects that the person is not within the frame (i.e., not within the camera's view) within 4 seconds, the triggered animation interface can be as follows. Figure 31 As shown; if the display device cannot detect the camera, the triggered animation interface may be as follows. Figure 32 As shown.

[0285] In some embodiments, such as Figure 33 As shown, the follow-up mode interface includes a camera settings option. This option is an operation control; when selected, it floats and displays the following prompt: "This function re-matches the camera angle with the person being recognized." Pressing the "OK" button allows the user to enter the camera settings interface and configure the camera. After setting the camera, clicking either the "Back" or "Confirm" button returns the device to the facial recognition interface for a second facial recognition attempt. Upon successful recognition, the user returns to the follow-up mode interface. After a countdown, the user can resume follow-up from where they left off. In the camera settings interface, clicking the "Back" button displays a prompt and option control. The prompt may state: "Abandoning settings will prevent you from continuing follow-up and will exit you." The option control may include a cancel control, which is selected by default. If the user clicks the "Back" button again, they will return to the follow-up course details page.

[0286] In some embodiments, during the follow-along mode, users can perform gesture operations on the display device. In some embodiments, the follow-along mode is a smart fitness scenario that is healthy and beneficial, supported by proprietary algorithm-based follow-along courses. In addition to this scenario, gesture operations can also be applied to other scenarios, such as personalized fitness scenarios where users can customize their own plans.

[0287] In some embodiments, gesture operations include volume control, such as... Figure 34 As shown, a user can activate volume control by making a single-handed OK gesture. The display device can show left and right arrows to guide the user in adjusting the volume. Moving the OK gesture to the left decreases the volume, and moving it to the right increases the volume. See also... Figure 35 Users can also achieve global mute control by pointing to the number "1" with one hand.

[0288] In some embodiments, gesture operations include pausing playback, see [link to documentation]. Figure 36 Users can pause the current practice session by holding their hand with all five fingers spread out in front of the screen for 2 seconds. After pausing playback, see [link to relevant instructions]. Figure 37 Users can continue playing the current exercise by making a gesture with all five fingers spread out, facing the screen for 2 seconds.

[0289] In some embodiments, when a user exits after practicing in follow-up mode for more than 2 minutes or completes a follow-up course, the display device may show a retention page.

[0290] In some embodiments, when a user exits or completes a practice session in follow-up mode after practicing for more than 2 minutes, the display device can generate and display, as shown in the image. Figure 38 The training report is shown. Users can choose to practice again, continue to the next training session, or exit the training.

[0291] In some embodiments, when a user transitions between training sessions, such as switching to the next training section, a prompt explaining the movement can be added. See [link to documentation]. Figure 39 The countdown can be 3 seconds, and the countdown displayed in the media asset control remains unchanged during the follow-up practice.

[0292] In some embodiments, when a user clicks the "Watch and Exercise Mode" control, or enters the Watch and Exercise Mode according to the default mode selection logic, the display device plays fitness videos and movies in the Watch and Exercise Mode.

[0293] In some embodiments, the process of a user simultaneously watching videos and fitness videos using the watch-and-workout mode can be found in [reference needed]. Figure 40 , like Figure 40 As shown, after selecting a fitness video, users can choose a fitness mode. Fitness modes include Normal, Follow-along, and Watch / Watch. When a user selects Watch / Watch mode (the mode where you watch and exercise simultaneously), the device can determine if the current fitness video is free. If the fitness video requires a purchase to watch, a VIP purchase page will pop up. After purchasing the course, the user can access the movie / TV search page. If the fitness video is free, the user can directly access the movie / TV search page.

[0294] In some embodiments, after selecting a fitness video, the user selects a viewing mode, i.e., a watch-and-workout mode, and then enters the movie search page.

[0295] In some embodiments, when displaying a movie search page, training media data can be obtained by sending a training media acquisition request. At this time, when the user selects the movie to watch, the training media data can be downloaded, which improves the loading speed of the training media data. After entering the watch-and-train interface, the training media video can be quickly displayed.

[0296] In some embodiments, certain fitness videos that require purchase to watch offer preview clips. On the VIP purchase page of this video, if the user does not choose to purchase, the system receives a return instruction from the user, cancels the display of the purchase interface, and simultaneously displays a video search page. This allows the user to watch the preview clip in the "watch and practice" mode before deciding whether to purchase the course. In some embodiments, the VIP purchase interface is not forcibly displayed before the mode selection interface. When the training media (fitness video) offers preview clips, the user can search for and display video media. After the preview clips of the fitness video end, an upper overlay is drawn, displaying the membership purchase interface for the fitness video. The user can choose to purchase or return to the "watch and practice" interface.

[0297] In some embodiments, when purchasing or returning to the "Watch and Exercise" interface, if the user has chosen to purchase a membership after the preview segment provided by the fitness video ends, the fitness video continues to play in the fitness video window, and the movie / TV show window continues to play the movie / TV show.

[0298] In some embodiments, when purchasing or returning to the "Watch and Exercise" interface, if the user has not purchased a membership after the preview segment provided in the fitness video ends, a prompt overlay continues to be displayed in the fitness video window, while the video continues playing in the movie window. The playback thread of the fitness video can be paused at this time.

[0299] In some embodiments, when purchasing or returning to the "Watch and Exercise" interface, if the user has not purchased a membership after the preview segment provided by the fitness video ends, the fitness video window on the video window is canceled, and the video window continues playing the video. At this time, the playback thread of the fitness video can be cancelled.

[0300] In some embodiments, during the user's viewing process, after the fitness video ends, a purchase prompt interface pops up. This interface may include a purchase option and an exit option / exit prompt. If the user selects the purchase option, they are redirected to the purchase interface, and after the purchase is completed, the fitness video continues playing on the playback interface before the pop-up prompt. If the user performs a back action, they are redirected to the fitness video selection interface. If the user selects a fitness video, the video continues playing on the playback interface before the pop-up prompt. Returning to the channel page or switching to another channel cancels the playback process before the pop-up prompt, indicating the user's intention is to stop following along.

[0301] In some embodiments, if a subsequent video exists in the video list after the fitness video finishes playing, the subsequent video content will continue to play in the fitness video window. If there is no subsequent video or the video list does not exist, the user will be switched to the fitness video selection interface. If the user selects a fitness video, the fitness video will continue to play in the previous playback interface. If the user chooses to return to the channel page or switch to another channel, the process of the previous playback interface can be undone.

[0302] In some embodiments, after the preview in the video window (main window) ends, a purchase interface (such as the one that displays the main window's video content) can be accessed. Figure 55 If the user has purchased the permission, the video will continue playing; otherwise, a notification overlay will be displayed in the main window, or the main window will be closed and the fitness video window (small window) will be displayed in full screen.

[0303] In some embodiments, the monitoring video window can be used as the main window, and the video window can be used as a smaller window.

[0304] In some embodiments, the layer containing the small window is located above the layer containing the main window.

[0305] In some embodiments, the small window may be located at the edge of the display screen.

[0306] In some embodiments, the small window can be located in the upper left corner of the display screen. Since the content on the main window is usually displayed in the upper left corner to show information that is not closely related to the video content, such as annotations or prompts, the small window can be placed in the upper left corner of the display screen to avoid the small window obscuring the effective image information in the main window video.

[0307] In some embodiments, see Figure 41 The movie search page in the "watch and practice" mode can be set up with a search area and a display area. The search area can be set up with a search keyboard and a search QR code. Users can enter the movie they want to watch using the search keyboard, or scan the QR code with their terminal device to search for movies on the terminal device. The terminal device can then display the movie selected by the user on the display device.

[0308] The display area may include a history section and popular searches. In some embodiments, the history section may display videos that the user has watched or searched in the "Watch and Practice" mode; in other embodiments, the history section may also display videos that the user has watched or searched in all modes.

[0309] Popular searches can feature posters of popular movies and TV shows, which can be configured by the display device operator. Users can then select one of the movies to watch. The media assets displayed on the movie / TV search page can be video assets that do not require conversion to third-party applications for playback; media assets or audio assets that require conversion to third-party applications can be filtered out and not displayed.

[0310] In some embodiments, the movie search page may also include prompts; see [link / reference]. Figure 42 The prompt could be: "You can choose a video to watch while exercising."

[0311] In some embodiments, after entering the video search interface, the processor determines whether a fitness video was previously selected. If so, a prompt is displayed in the upper floating layer of the video search interface to remind the user to select a video to watch and exercise simultaneously. If not, no prompt is displayed.

[0312] In some embodiments, the processor can determine whether the "watch and practice" option has been selected by judging whether the loading process of the "watch and practice" interface has been started in the background.

[0313] In some embodiments, after a user selects a viewing mode, the processor can set a status indicator. After displaying the movie search interface, the processor can determine whether to display a prompt message by judging the channel indicator.

[0314] In some embodiments, when a user selects a movie or TV show source on the movie / TV show search page, the display device can display a full-screen viewing page in the main window and add a fitness playback window to the full-screen viewing page to form a picture-in-picture playback mode.

[0315] In some embodiments, the display device can draw a video playback window and a fitness video window on the display interface, and play the corresponding video in the corresponding window according to the mapping of different windows and different bitstreams. For example, the video data corresponding to the selected video media asset ID can be played in the video playback window to generate a full-screen viewing page, and the video data corresponding to the selected fitness media asset ID can be played in the fitness video window to generate a fitness playback screen.

[0316] In some embodiments, video clips are played in a full-screen video playback window, with a fitness video window positioned above the video playback window.

[0317] In some embodiments, see Figure 43 In picture-in-picture mode, the display interface of the display device includes a main window and a small window. In some embodiments, the main window plays the user-selected video in full screen, and the small window plays the user-selected fitness video. The small window is displayed above the main window, for example, the small window may be displayed in the upper left corner of the main window.

[0318] In some embodiments, users can also switch between the main window and the smaller window; for example, switching the fitness video to be displayed in the main window and the movie to be displayed in the smaller window.

[0319] In some embodiments, the user can also adjust the size and position of the small window, for example, see Figure 47 Move the small window to the upper right corner of the main window.

[0320] In some embodiments, users can switch the positions of the fitness video window and the video playback window using preset buttons. For example, the fitness video can be played in a full-screen fitness video window, while the video playback window is located above the fitness video window.

[0321] In some embodiments, when displaying the "watch and practice" interface, such as Figure 53 As shown, if a user's return control command is received, the video player (main window) is controlled to exit the playback of the video, and the playback of the small window is paused and hidden, switching to the video selection interface, as shown. Figure 41 Or 43.

[0322] In some embodiments, when displaying the "watch and practice" interface, such as Figure 54 As shown, if a user's return control command is received, the main window and the small window are closed, and the video selection interface is switched to, as shown. Figure 41 Or 43.

[0323] In some embodiments, in the returned video selection interface, after the user reselects the video corresponding to the video control, the watch-and-practice interface is restarted, so that the main window loads the video corresponding to the video control reselected by the user, while the small window continues to play the previously selected fitness video or replays the previously selected fitness video from the beginning.

[0324] Upon returning to the video selection screen, the system continues to receive the user's return command and switches to the fitness video details screen.

[0325] In some embodiments, upon returning to the video selection interface, if the user's return instruction is received again, the threads corresponding to the main window and the small window also need to be cancelled. In some embodiments, at least one of the two videos may not be a free video, and the user has not purchased that video. If the preview segment of a non-free video finishes playing first, the current screen of the display device can jump to the corresponding purchase page. After the user purchases, the playback can be automatically returned, or the user can manually click to return to the picture-in-picture playback interface to continue playback, or the playback of both videos can be paused, waiting for the user to restart the playback of both videos. After the preview segment of the other video finishes playing, the user can then jump to the corresponding purchase page. The payment logic for the two videos can be consistent with the payment jump on their respective video details pages, such as including multiple purchase methods such as VIP, special zone, single point, and paid. If the preview segments of the two non-free videos finish playing simultaneously, the user can be prioritized to jump to the purchase page of the secondary video.

[0326] In some embodiments, the main video can invoke the history to jump to the start playback logic when it starts playing, and the secondary video starts playing from zero.

[0327] In some embodiments, if the main video / sub-video is a single episode, it will loop after the episode ends; if it is multiple episodes, the next episode will play automatically; if multiple episodes play to the last episode, it will restart from the first episode.

[0328] In some embodiments, the maximum resolution of the main video can be set to 1080P (if not supported, the resolution will be set to the next lower level), and the default resolution of the secondary video is 720P (if not supported, the resolution will be set to the next lower level). This resolution is determined based on the chip capability of the display device, which is that the two video streams cannot exceed 4K@60HZ. If the chip of the display device is upgraded, the resolution of the main video and the secondary video can be selected to a higher level.

[0329] In some embodiments, users can adjust the resolution of the main video, see [link to relevant documentation]. Figure 47 The playback settings options, accessible via the down arrow key, include a resolution option, which allows users to adjust the resolution of the main video. Besides resolution, the playback settings also include playlist options, mode switching options, related recommendations options, and other user-configurable features.

[0330] In some embodiments, during the watch-and-practice mode, the user can switch playback modes. For example, the user can bring up the mode switching interface by clicking the menu button on the remote control, see [link to relevant documentation]. Figure 48 Users can then choose other modes to watch fitness videos; for example, users can select... Figure 49 The AR scene mode shown is for watching fitness videos.

[0331] In some embodiments, users can also fast forward the main video by long-pressing the right directional button and rewind the main video by long-pressing the left directional button.

[0332] In some embodiments, users can perform synchronized operations to pause and start the main video and the secondary video. For example, referring to Figure 50, users can click the OK button to pause both the main video and the secondary video at the same time, and then click the OK button again to start both the main video and the secondary video at the same time.

[0333] As can be seen, the intelligent fitness method provided in this application can provide... Figure 51 The following steps are shown:

[0334] Step S110: In response to receiving a playback signal for a fitness video, control the display to show a mode selection page, which includes a normal mode option, a follow-along mode option, and a watch-and-practice mode option.

[0335] Step S120: In response to receiving the trigger signal of the normal mode option, control the display to play the fitness video in full screen.

[0336] Step S130: In response to receiving the trigger signal of the training mode option, control the display to simultaneously play the fitness video and the image captured by the camera.

[0337] Step S140: In response to receiving the trigger signal of the "Watch and Practice" mode option, control the display to show the movie search page.

[0338] Step S150: In response to receiving the media asset playback signal from the movie search page, control the display to simultaneously play the fitness video and the media asset corresponding to the media asset playback signal.

[0339] Step S160: In response to receiving the trigger signal of the AR scene mode option, control the display to play the image of the user being cut out and virtually placed into the scene.

[0340] In some embodiments, the video played in the main window may be called the main video, and the video played in the small window may be called the secondary video.

[0341] When a user selects a movie or TV show source on the movie / TV show search page, a command is generated to play the main video and the secondary video simultaneously. Upon receiving the command, the display device generates playback requests for the two videos, retrieves the resources for the two videos from the server, loads the playback page to start the picture-in-picture playback mode, and plays the main video and the secondary video.

[0342] In some embodiments, in picture-in-picture mode, users need to watch both the main video and the secondary video simultaneously. To prevent the audio from mixing and causing discomfort to the user, the display device can play the main video and the secondary video at the volume set by the user last time, or at the default gain volume, thereby achieving automatic gain adjustment of the main audio stream and the secondary audio stream. Of course, users can also control the volume of the display device to manually adjust the gain of the main audio stream and the secondary audio stream before mixing.

[0343] In some embodiments, the main video and the secondary video may each have their own advertisements. The two videos can play their advertisements independently without affecting each other. After their own advertisements have finished playing, the corresponding main video or secondary video will be played.

[0344] In some embodiments, the main video and the secondary video may have interstitial advertisements during the media asset playback process. In some embodiments, the playback logic of different playback windows can be executed independently, and the advertisements can be played independently according to the pre-made advertisements or tags.

[0345] In some embodiments, the display device may also automatically adjust the ad volume. For example, the ad durations of the two videos may be inconsistent. The display device can be configured to: if the ad in one video finishes playing before the ad in the other video finishes playing, increase the volume of the video whose ad has finished playing; and after the ad in the other video finishes playing, restore the volume to the default level or the previously set level by the user. In some embodiments, before playing an ad, the main window and the smaller window need to confirm the ad loading / playing status with each other. While one window is loading / playing an ad, the other window does not load / play an ad.

[0346] In some embodiments, when both the main window and the small window contain advertisements that need to be played, one advertisement may be played while the other is not played. This can be replaced by a video loading screen or a pause screen. The rules for choosing one advertisement can be set according to requirements.

[0347] See Figure 56 This is an interactive illustration of volume gain adjustment according to some embodiments. In some embodiments, the advertising requirement may be pre-roll ads, in-roll ads, and end-roll ads.

[0348] When a user clicks on a movie or TV show on the movie / TV search page, the click action is interpreted by the display device as an instruction to play both the main video and the secondary video simultaneously.

[0349] In some embodiments, in response to receiving an instruction to play the main video and the secondary video simultaneously, the display device generates playback requests for the two videos respectively and sends them to the server to obtain the data for the main video and the secondary video.

[0350] In some embodiments, the display device can determine the media asset identifiers of the corresponding main video and secondary video based on the fitness video and movie / TV video previously selected by the user, and then generate a video playback request based on the media asset identifiers. For example, when a movie / TV video is played in the main window and a fitness video is played in the smaller window, the display device can confirm the identifier of the fitness video based on the playback command selected by the user in the fitness video list interface or fitness video details interface. In the movie / TV selection interface, it can determine the movie / TV identifier corresponding to the movie / TV video based on the movie / TV control selected by the user. Since the movie / TV video is played in the main window and the fitness video in the smaller window, a playback request for the main video is generated based on the media asset identifier, and a playback request for the secondary video is generated based on the fitness video identifier, and these requests are sent to the server respectively.

[0351] In some embodiments, the playback request for a secondary video can be generated and sent directly to the server after the user confirms the identification of the fitness video by selecting the playback instruction in the fitness video list interface or the fitness video details interface, without waiting for the generation of the main video playback request. This allows for advance requesting and downloading of fitness video data, enabling fast loading of fitness videos.

[0352] In some embodiments, the instruction to play the main video and the secondary video simultaneously can be one of the instruction to select a video control in viewing mode or the instruction to play a video program.

[0353] In some embodiments, the instruction to play the main video and the secondary video simultaneously may be an operation instruction requesting the simultaneous playback of a movie video and a fitness video.

[0354] In some embodiments, upon receiving an instruction to play both the main video and the secondary video simultaneously, the system checks whether the windows playing these two videos have advertising requirements. If at least one has an advertising requirement, the corresponding advertisement can be called a pre-roll ad. Then, when sending the playback request for the corresponding window, an advertising request is simultaneously sent to the server. At this point, there is a mapping relationship between the advertising request and the video window. For example, if an advertising requirement parameter is set in the parameters of the video control corresponding to the main window or the main video, an advertising request for the corresponding main window is generated. After obtaining the advertising data, the advertisement is played in the main window. The same applies to smaller windows.

[0355] In some embodiments, there is a mapping relationship between video playback requests and playback windows. The display device first sends the playback requests to the server, and the server returns playback parameters for the corresponding playback requests. If there are advertising request parameters in the playback parameters, the processor generates an advertising request for the corresponding window, and plays the advertisement in the window after obtaining the advertising data.

[0356] In some embodiments, when the user pauses the playback of the main video and the secondary video, and then restarts the playback of the main video and the secondary video, an instruction to play the main video and the secondary video can also be generated. In response to receiving the instruction to play the main video and the secondary video simultaneously, the display device checks whether there are advertising demand parameters in the video streams or window settings of the two windows respectively. If there are advertising demand parameters, an advertising request is generated for the corresponding window. After obtaining the advertising data, the advertisement is played in the window. The advertisement corresponding to the advertising demand parameter can be called an in-video advertisement.

[0357] In some embodiments, the display device may also monitor in real time whether there are advertising demand parameters in the video stream of the main video and the secondary video window during the playback of the main video and the secondary video. If there are advertising demand parameters, an advertising request is generated for the corresponding window. After obtaining the advertising data, the advertisement is played in the window. The advertisement corresponding to the advertising demand can be referred to as an in-video advertisement.

[0358] In some embodiments, the display device may also detect whether there are advertising demand parameters in the video stream or window settings of the main video and secondary video windows when the main video and secondary video finish playing. If there are advertising demand parameters, an advertising request is generated for the corresponding window. After obtaining the advertising data, the advertisement is played in the window. The advertisement corresponding to the advertising demand can be called an end-credits advertisement.

[0359] In some embodiments, the media asset information of the main video and the secondary video contains ad tags indicating that an advertisement needs to be inserted. The media asset information may be included in page data sent by the server, where the page data is the data of a page displaying fitness videos or movie clips. The display device can extract the ad tags from the media asset information, determine the presence of an ad requirement in the current video based on these tags, and then generate an ad request. In this case, the ad corresponding to the ad requirement is a pre-roll ad. After generating the ad request, the display device sends the ad request and playback requests for both videos to the server, thereby requesting ad data, the media asset data of the main video, and the media asset data of the secondary video from the server.

[0360] In some embodiments, the media asset data of the main video and the secondary video contains ad tags indicating that an advertisement needs to be inserted. The media asset data includes the video stream of a fitness video or film source downloaded from the server. The display device can extract the ad tags from the media asset data, determine the presence of an advertisement in the current video based on the ad tags, and then generate an ad request. In this case, the advertisement corresponding to the ad request is either an in-video ad or an end-video ad.

[0361] In some embodiments, since the video request carries both a media asset ID and an account ID (or display device ID), after an ad request is triggered, the server can distribute ad data (e.g., ads with the same duration, similar content, similar style, or similar volume) based on the parameters representing the terminal's "watch and practice" activity and the account ID (or display device ID) of the ad request, thereby improving the user experience. The parameters representing the terminal's "watch and practice" activity can be carried in the ad request or generated and stored by the server in a previously established "watch and practice" interface.

[0362] In some embodiments, after receiving an advertising request, the server determines whether there are advertising requests sent by the same account within a preset time period. If there are, it indicates that the user is watching a video in a viewing mode. In this case, similar advertising data is selected as feedback for another advertising request based on previously confirmed advertising data. In some embodiments, if there is no online advertising data, advertising data is determined according to preset advertising rules.

[0363] In some embodiments, the advertising request used to trigger the server to send an advertisement carries an advertising tag and an account ID (or display device ID). After the advertising request is triggered, the server can determine the advertisement for the video playback window based on the parameters representing the terminal's simultaneous viewing and training and the account ID (or display device ID) of the advertising request, and determine the advertisement for the fitness media playback window based on at least one of the following: the advertisement duration and the advertisement volume of the video window. The server then sends the data of the two advertisements to the display device so that the two video windows on the display device can be played.

[0364] In some embodiments, after displaying the picture-in-picture interface, the display device only plays an advertisement triggered by a single window.

[0365] In some embodiments, before playing advertising data in one window, the display checks whether advertising data is being played in another window. If it is, the former does not play the advertising data; otherwise, the former plays the advertising data.

[0366] In some embodiments, the display device only sends the advertising request corresponding to the video playback window, and the fitness video playback window does not send an advertising request to the server after detecting the advertising request.

[0367] In some embodiments, when playing an advertisement originating from only one window, after receiving the advertisement data fed back by the server according to the advertisement request, the display device controls the display to show a floating layer. The floating layer is located above the video playback window and the fitness video playback window. The advertisement is played in the floating layer. After the advertisement finishes playing, the floating layer is removed, and a notification is broadcast so that the video playback window and the fitness video playback window play the corresponding video streams respectively.

[0368] In some embodiments, the ad data is played in the window corresponding to the original ad request, while the ad data is not played in another window.

[0369] In some embodiments, when the display device simultaneously plays advertisements in both the main window and the smaller window, the volume gain of the two advertisements can be adjusted to improve the audiovisual effect of both ads. For example, the volume gain of the smaller window can be adjusted to 50% of the original volume, or the volume gain of the smaller window can be adjusted to 50% of the main window volume. Alternatively, the volume gain of the smaller window can be adjusted to other values, as long as they differ from the volume of the main window, thereby preventing users from confusing the two advertisements. In some embodiments, the display device can detect the playback progress of the two video windows in real time, and stop the playback of the advertisement in the other window when the advertisement in one window finishes playing. This improves the synchronization of the start of playback of the movie and fitness videos in the two windows.

[0370] In some embodiments, if the display device detects an ad playback marker in one window (meaning the ad in that window has not finished playing) and does not detect an ad playback marker in another window (meaning the ad in that window has finished playing), or if that window is not playing an ad but the corresponding fitness video or movie / TV video is playing, the display device automatically lowers the volume of the window playing the ad and raises the volume of the other window. In some embodiments, the ad playback marker may be an ad countdown marker. In some embodiments, after both the main window and the smaller window have finished playing their ads, the display device starts playing the fitness video and the movie / TV video, and adjusts the volume of these two videos accordingly. The movie / TV video plays in the full-screen movie / TV playback window, i.e., the main window, while the fitness video window, i.e., the smaller window, is located above the movie / TV playback window.

[0371] In some embodiments, after the advertisement data has finished playing, the playback window will begin playing the corresponding video content.

[0372] In some embodiments, when the display device plays two video streams, the automatic gain adjustment of the volume of the two video streams may be: playing the main video and the secondary video according to the gain volume set by the user last time, or playing the main video and the secondary video according to the default gain volume setting.

[0373] In some embodiments, the default gain volume of the secondary video is 0, and the gain volume of the primary video is 100, meaning the secondary video plays silently, and the primary video plays at its original volume. In some embodiments, the gain volume of the secondary video can also be set by default to the volume after gain adjustment of the original volume of the secondary video, for example, the gain volume of the secondary video is 50% of the original volume of the secondary video. (Received.)

[0374] While the main video and the secondary video are playing simultaneously, users can also manually adjust the volume of the main video and the secondary video.

[0375] See Figure 57 This is an interactive schematic diagram of volume gain adjustment according to some embodiments. Figure 57 As shown, users can send volume up and down commands to the display device, and the display device responds to the volume up and down commands by adjusting the volume of both the main video and the secondary video.

[0376] In some embodiments, users can input volume increase or decrease commands to the display device by pressing the volume up or volume down buttons on the remote control. Upon receiving the volume increase or decrease command, the display device adjusts the volume of both the main video and the secondary video simultaneously. For example, if the volume increase command corresponds to the volume up button, both the main video and the secondary video volume are increased; or if the volume decrease command corresponds to the volume down button, both the main video and the secondary video volume are decreased, thus adjusting the overall volume.

[0377] In some embodiments, after receiving a volume increase / decrease command, the display device determines the current playback state based on playback parameters. When the playback parameters indicate that the current interface is in a "watch and practice" playback state, the volume of both the main video and the secondary video is adjusted simultaneously. When the playback parameters indicate that the current interface is in a "play only one video stream" playback state, the volume of only that video stream is adjusted. When the playback parameters indicate that the current interface is in a "watch and chat" playback state (i.e., simultaneously including a video call window and a video playback window), the volume of only the video playback window is adjusted.

[0378] In some embodiments, the display device's adjustment of the overall volume can be an adjustment of the power amplifier section or the audio gain section. After receiving the bitstreams from the two windows, the display device parses them into the main video bitstream and main audio bitstream for the corresponding main window (movie / TV program), and the secondary video bitstream and secondary audio bitstream for the corresponding small window (fitness video). Then, the main video bitstream is sent to the main window for display, the secondary video bitstream is sent to the small window for display, and the main and secondary audio bitstreams are mixed and then processed by the display device's processing module for power amplification and sound effects. In the "watch and practice" mode, in response to the user's volume increase / decrease commands, such as... Figure 52 As shown, the volume of the mixed audio stream is adjusted; at the same time, a volume progress bar is set in another floating layer on the display interface to show the volume adjustment.

[0379] In some embodiments, in response to a user's mute command input, such as Figure 53 As shown, the mixed audio stream is no longer output. The user can input a mute command to the display device via the mute button on the remote control.

[0380] like Figure 52 As shown, in some embodiments, in response to the user's input of volume increase / decrease commands, the display device can display a volume bar in real time when adjusting the volume of the main video and the secondary video at the same time. At this time, in response to the user's volume increase / decrease commands, when the volume of both windows is output, the volume of the two videos is decreased or increased at the same time, and the volume change is displayed on the volume bar, so that the user feels that the volume of both windows has been increased or decreased.

[0381] In some embodiments, user commands to mute or adjust the volume can be applied simultaneously to both the main audio stream and the secondary audio stream before mixing.

[0382] In some embodiments, the main audio stream and the secondary audio stream are simultaneously controlled by instructions to mute or adjust the volume, and the mixed audio stream is also controlled by instructions to mute or adjust the volume.

[0383] In some embodiments, if a user needs to adjust the volume of the main video or the secondary video separately, they can input a trigger command for the volume control option to the display device to bring up the main video volume control and the secondary video volume control.

[0384] like Figure 43As shown, in the "watch and practice" playback mode, the user can press a preset button on the remote control (e.g., the down arrow key) to send a command to the display device to retrieve settings options. In response to this command, playback settings options (control list) are retrieved from a floating layer on the window of the display device's interface. These playback settings options include volume control options and may also include resolution options controls. The user can trigger a volume control option by selecting it, generating a trigger command. Based on this trigger command, the display device retrieves the main video volume control for the main window video in the current or newly created floating layer to control the volume of the main audio stream, and the small video volume control for the corresponding small window to control the volume of the secondary audio stream. When the focus moves to another option control (e.g., the resolution control), the display of the main video volume control and the small video volume control is deactivated.

[0385] The system receives user input to move the focus, allowing the focus to be moved to either the main video volume control or the sub-video volume control. When the focus is on the main video volume control, it accepts user input for volume adjustment commands and adjusts the volume of the main audio stream before mixing in response to these commands. When the focus is on the sub-video volume control, it accepts user input for volume adjustment commands and adjusts the volume of the sub-audio stream before mixing in response to these commands. By adjusting the volume of the audio streams before mixing, the system allows for free adjustment of the volume of the main video (movie) and the sub-video (fitness video).

[0386] In some embodiments, both the main video volume control and the small video volume control can be volume bar controls. Users can adjust the volume using the two volume bars that pop up in the volume control options. For example, users can use the up or down arrow key to move the focus to one of the volume bars, and then use the left or right arrow key to adjust the current volume corresponding to the volume bar. The number at the end of the volume bar can represent the current volume.

[0387] In some embodiments, the appearance and position of the volume bar can also be related to... Figure 43 Different, such as Figure 44 and Figure 45 .

[0388] In some embodiments, the main video volume control and the secondary video volume control can be arranged side by side above the volume control option space.

[0389] In some embodiments, the main video volume control and the secondary video volume control can be arranged side by side above the volume control option space.

[0390] In some embodiments, when displaying the main video volume control and the secondary video volume control, the display of the control list can be deselected to avoid excessive obstruction of the playback screen.

[0391] In some embodiments, the main video volume control and / or the secondary video volume control can be set separately in the control list, eliminating the need to select the video volume control for both windows through the volume control options.

[0392] In some embodiments, the display device may cancel or retain the display of the playback settings options after the two volume bars pop up.

[0393] In some embodiments, the display device receives an input volume adjustment command, and in response to the volume adjustment command, determines the current playback state according to the playback parameters. When the playback parameters indicate that the current interface is in a "watch and practice" playback state, both the main video volume adjustment control and the secondary video volume adjustment control are displayed simultaneously. When the playback parameters indicate that the current interface is in a playback state where only one video stream is played, the volume of only that video stream is adjusted. When the playback parameters indicate that the current interface is in a "watch and chat" playback state (i.e., simultaneously including a video call window and a video playback window), the volume of only the video playback window is adjusted.

[0394] In some embodiments, when the playback parameters indicate that the current interface is playing only one video stream, the volume of that video stream is adjusted only by adjusting the power amplifier and sound effects.

[0395] In some embodiments, volume adjustment of the power amplifier and sound effects section refers to volume adjustment of the encoded and decoded audio stream. In some embodiments, separate adjustment refers to volume gain adjustment of each audio stream during the encoding and decoding process.

[0396] In some embodiments, volume adjustment of the power amplifier and sound effects section refers to volume adjustment of the audio stream after mixing. In some embodiments, separate adjustment refers to gain adjustment of each audio stream before mixing.

[0397] In some embodiments, the playback status can also be confirmed in other ways.

[0398] In some embodiments, the audio processing of the display device includes adjusting the audio gain of each channel, mixing the audio channels, and amplifying and processing the mixed audio.

[0399] In some embodiments, when the input volume adjustment command is received and the main video volume adjustment control and the secondary video volume adjustment control are not displayed on the display interface, the volume of the whole device is controlled according to the volume adjustment command, that is, the power amplifier and sound effect gain of the display device are controlled.

[0400] In some embodiments, when receiving an input volume adjustment command, and displaying the main video volume adjustment control and the secondary video volume adjustment control on the display interface, the gain of the main video volume before mixing is controlled according to the position of the focus to control the volume of the main video or the gain of the secondary video volume before mixing to control the volume of the secondary video.

[0401] In some embodiments, when the focus is on the main video volume adjustment control, in response to the volume adjustment command, the gain of the main video volume before mixing is controlled to control the volume of the main video.

[0402] In some embodiments, when the focus is on the secondary video volume adjustment control, in response to the volume adjustment command, the gain of the secondary video volume before mixing is controlled to control the volume of the secondary video. Figure 56 , Figure 57 The diagram shown illustrates the interactive method for adjusting volume gain, demonstrating how the device's volume can be controlled. Figure 58 As shown, it includes steps S101-S104.

[0403] Step S101: In response to receiving an instruction to play the main video and the secondary video simultaneously, play the main video and the secondary video according to the gain volume set by the user last time, or play the main video and the secondary video according to the default gain volume setting.

[0404] Step S102: During the period when the main video and the secondary video are playing simultaneously, in response to receiving a volume increase or decrease command, adjust the volume of the main video and the secondary video simultaneously.

[0405] Step S103: In response to receiving the trigger command of the volume control option, pop up the main video volume control and the small video volume control on the current interface.

[0406] Step S104: In response to receiving a trigger command from the main video volume control, adjust the volume of the main video, or in response to receiving a trigger command from the sub-video volume control, adjust the volume of the sub-video.

[0407] In some embodiments, steps 103 and 102 may not occur simultaneously.

[0408] See Figure 59 This is an interactive schematic diagram of volume gain adjustment according to some embodiments. Figure 59 As shown, users can send volume up or down commands to the display device, and the display device can adjust the volume of only the main video in response to the volume up or down command.

[0409] In some embodiments, adjusting the main video volume can adjust the overall volume of the display device (i.e., the gain of the mixed power amplifier and sound effects).

[0410] In some embodiments, adjusting the main video volume can adjust the main video volume before mixing.

[0411] In some embodiments, a user can generate a volume up or down command by pressing the volume up or volume down buttons on the remote control, which only adjusts the volume of the main video.

[0412] The volume of the secondary video needs to be adjusted by the user by bringing up the volume control options on the display screen or the small screen volume options.

[0413] In some embodiments, the playback settings options that a user can access on a display device by pressing the down arrow key on a remote control may include a small screen volume option to adjust the relative volume of the secondary video. See also Figure 46 Users can trigger the small screen volume option by selecting it, generating a trigger command for the small screen volume option. Based on this trigger command, the display device can display multiple fixed volume options for the user to choose from, such as mute, 50%, 60%, 75%, 90%, and 100%. In some embodiments, the default selected volume for the small screen volume option is 75%. Each fixed volume control is a small video volume control. Users can move the focus to one of the fixed volume controls using the up or down arrow keys, and then select a fixed volume using the left or right arrow keys. Clicking "OK" generates a trigger command for the small video volume control. The display device adjusts the volume of the secondary video according to the trigger command, and a prompt appears after adjustment: "Volume setting successful."

[0414] After the volume setting is successful, the display device will save the set volume locally. The next time you access the device, the secondary video volume will default to the previously set volume. If the previously set volume is invalid, the default volume, such as 75%, will be used.

[0415] In some embodiments, the control controls the relative volume of the time and the initial volume of the secondary video. The operator of the display device can set the default volume of the secondary video, for example, by counting the number of users who selected each volume level. Only users who have used the "watch and practice" function are counted. If a user has set the volume multiple times, it needs to be saved multiple times, but only the last setting is counted. This setting is used to adjust the gain of the secondary audio and video streams before mixing, that is, adjusting the volume of the secondary audio streams before mixing to 0, 50% of the original volume, 60% of the original volume, 75% of the original volume, 90% of the original volume, and 100% of the original volume, respectively. Then, the secondary audio streams with adjusted volumes are mixed with the main audio streams and output.

[0416] In some embodiments, the control adjusts the volume relative to the main video volume. This setting is used to adjust the gain of the sub-audio stream before mixing, i.e., adjusting the volume of the sub-audio stream before mixing to 0, 50%, 60%, 75%, 90%, and 100% of the main audio stream volume respectively, based on the volume of the main audio stream. Then, the sub-audio stream with the adjusted volume is mixed with the main audio stream and output.

[0417] according to Figure 59 The diagram shown illustrates the interactive method for adjusting volume gain, demonstrating how the device's volume can be controlled. Figure 60 As shown, steps S201-S204 are included.

[0418] Step S201: In response to receiving an instruction to play the main video and the secondary video simultaneously, play the main video and the secondary video according to the gain volume set by the user last time, or play the main video and the secondary video according to the default gain volume setting.

[0419] Step S202: During the period when the main video and the secondary video are playing simultaneously, in response to receiving a volume increase or decrease command, adjust the volume of the main video.

[0420] Step S203: In response to receiving the trigger command for the small screen volume option, pop up the small video volume control on the current interface.

[0421] Step S204: In response to receiving the trigger command from the small video volume control, adjust the volume of the secondary video.

[0422] The volume of the sub-video can be adjusted using the methods described above.

[0423] In some embodiments, steps S202 and S203 may not occur simultaneously.

[0424] In some embodiments, an input volume adjustment command is received, and when the small screen volume control is not displayed on the display interface, the volume of the main video is controlled according to the volume adjustment command.

[0425] In some embodiments, an input volume adjustment command is received, and when the small screen volume control is not displayed on the display interface, the gain of the main video volume before mixing is controlled according to the volume adjustment command to control the volume of the main video.

[0426] In some embodiments, when receiving an input volume adjustment command, the volume adjustment command is not responded to when the small screen volume control is displayed on the display interface.

[0427] In some embodiments, when a small screen volume control is displayed on the display interface, an input instruction to select the small screen volume control is received, and the volume gain of the sub-video before mixing is controlled in response to the selected small screen volume control to control the volume of the sub-video.

[0428] In some embodiments, the volume adjustment command may be a volume up control command or a volume down control command.

[0429] In some embodiments, a mute command input by a user to the display device via a mute button on a remote control can mute the display device globally (e.g., ...). Figure 53 (As shown in the scenario), both the main video and the secondary video are muted. After global muting, if the display device receives a notification from the user that the main window volume or the small window volume has been adjusted via the volume bar or controls, the global mute will be canceled.

[0430] To further describe the data processing procedure for simultaneously playing the main video and the secondary video on the display device, Figure 61 A timing diagram illustrating a display device simultaneously playing a main video and a secondary video is shown, as follows: Figure 61 As shown, in some embodiments, the display device includes a controller, a sound output component, and an image output component, wherein the controller includes a codec unit, an audio processing unit, a video processing unit, an overlay unit, and a power amplifier / sound effect processing unit.

[0431] In some embodiments, after selecting a fitness video and a movie / TV video, the user presses the OK button on the remote control to send a fitness video request and a movie / TV video request to the display device. The encoding / decoding unit of the display device can parse the fitness video stream according to the fitness video request and the movie / TV video stream according to the movie / TV video request. The encoding / decoding unit parses the fitness video stream to obtain a fitness video audio stream and a fitness video stream, and parses the movie / TV video stream to obtain a movie / TV video audio stream and a movie / TV video stream. The encoding / decoding unit sends the two audio streams to the audio processing unit and the two video streams to the video processing unit. The audio processing unit sends the two audio streams to the overlay unit, which overlays the two audio streams and sends them to the power amplifier / audio processing unit. The power amplifier / audio processing unit amplifies and / or processes the overlaid audio stream, and then outputs the amplified and / or processed audio stream to the sound output component of the display device. The sound output component can play the amplified and / or processed audio stream. The video processing unit sends two video streams to the image output component. The image output component transmits the video stream of the movie / video to the movie / video window for image playback, and transmits the video stream of the fitness video to the fitness video window for image playback.

[0432] Figure 62A flowchart illustrating a method for simultaneously playing a main video and a secondary video using a display device according to some embodiments is shown, such as... Figure 62 As shown, the method for a display device to simultaneously play a main video and a secondary video may include steps S301-S309.

[0433] Step S301: Receive the user's input of fitness video requests and movie / TV video requests.

[0434] In some embodiments, the controller of the display device can receive user input of fitness video requests and video requests, extract the media asset identifier of the fitness video from the fitness video request, and extract the media asset identifier of the video from the video request.

[0435] Step S302: The main program obtains the fitness video stream corresponding to the fitness video request and the film and television video stream corresponding to the film and television video request based on the fitness video request and the film and television video request.

[0436] In some embodiments, the controller of the display device can obtain the fitness video bitstream from a media asset content platform based on the media asset identifier of the fitness video, and obtain the video bitstream of the film / TV video based on the media asset identifier of the film / TV video. The media asset content platform can be a content platform set up on the server of the display device, or it can be a third-party content platform. The controller can determine the source of the video bitstream based on the media asset identifier.

[0437] Step S303: The fitness video bitstream is parsed by the encoding and decoding unit to generate a fitness video audio stream and a fitness video video stream; the film and television video bitstream is parsed to generate a film and television video audio stream and a film and television video video stream.

[0438] Step S304: The fitness video audio stream and the movie video audio stream are sent to the overlay unit through the audio processing unit.

[0439] In some embodiments, the audio processing unit may not process the two audio streams, the fitness video audio stream and the movie video audio stream, and may directly send these two audio streams to the overlay unit.

[0440] In some embodiments, the audio processing unit may also perform gain processing on at least one audio stream from the fitness video audio stream and the fitness video stream. The judgment conditions and gain methods for gain processing can be found in other embodiments or set according to specific circumstances.

[0441] Step S305: The fitness video audio stream and the film and television video audio stream are superimposed using the superimposed processor.

[0442] Step S306: The superimposed audio stream is amplified and / or processed by the power amplifier / sound effect processing unit.

[0443] In some embodiments, the power amplifier / sound effect processing unit can perform power amplification and / or sound effect processing on the superimposed audio stream according to a preset gain rule. The preset gain rule can be found in other embodiments or set according to specific circumstances. In some embodiments, the gain rule can be adjusted by the user. For example, the user can select different sound effects, and the superimposed unit can perform sound effect processing on the superimposed audio stream according to the sound effects selected by the user.

[0444] Step S307: Play the audio stream of the power amplification and / or sound effect processing through the sound output component.

[0445] Step S308: The fitness video stream and the movie video stream are sent to the image output component through the video processing unit.

[0446] In some embodiments, the video processing unit may transmit a fitness video stream to a fitness video window and a movie / TV video stream to a movie / TV video window.

[0447] Step S309: Play the fitness video stream and the movie video stream through the image output component.

[0448] In some embodiments, the image output component plays the fitness video stream in the fitness video window and plays the video stream in the movie / TV window.

[0449] To further describe the volume control method for display devices Figure 63 A flowchart of a volume control method according to some embodiments is shown, including steps S401-S406.

[0450] Step S401: Receive the user's selection instructions for the main video control and the secondary video control, and determine the main video and the secondary video to be played.

[0451] In some embodiments, the main video control may be Figure 41 The controls corresponding to the shown video clips allow users to select the main video control and determine which video they want the device to play. For example, selecting the control corresponding to "Life of Pi DVD Version" will specify that the main video to be played is "Life of Pi DVD Version." Small video controls can be... Figure 9 The controls shown correspond to the fitness videos. For example, if a user selects a control corresponding to a "burn calories" fitness video, then the user can confirm that the fitness video to be played is "burn calories".

[0452] Step S402: In response to receiving the instruction to play the main video and the secondary video, play the video data of the main video in the main window and play the video data of the secondary video in the small window above the main window, while playing the audio data of the main video and the audio data of the secondary video at a preset volume.

[0453] In some embodiments, a user can first select the secondary video control, then select the primary video control, and then press the confirmation button on the remote control to input a command to the display device to play the primary and secondary videos. Responding to this command, the display device's controller can control the image output component and the audio output component to simultaneously play the primary and secondary videos. This causes the display device to play the video data of the primary video in the main window and the video data of the secondary video in a small window above the main window. Simultaneously, the audio data of both the primary and secondary videos is played at preset volumes, such as 100 for the primary video and 50 for the secondary video. When playing the primary and secondary videos simultaneously, the audio data of the secondary video's audio stream is superimposed on the audio data of the primary video's audio stream before being output to the display device's audio output component.

[0454] Step S403: When the main video and the secondary video are playing simultaneously, receive volume increase / decrease commands input by the user.

[0455] In some embodiments, when the display device is playing the main video and the secondary video simultaneously, if the user needs to adjust the volume, they can input volume increase or decrease commands to the display device.

[0456] In some embodiments, a user can bring up the volume controls on the display device by pressing the volume up or volume down buttons on the remote control of the display device, and input volume up or down commands to the display device by operating the volume controls. The display device can be configured to display two volume controls upon receiving a trigger signal from the volume up or volume down button on the remote control. The volume controls can appear as a volume bar, such as... Figure 45As shown, one volume control is for adjusting the main video volume, and can be set with a movie / video window identifier, displaying "Main Video Volume". The other volume control is for adjusting the secondary video volume, and can be set with a fitness video window identifier, displaying "Secondary Video Volume". The display device's focus can default to one of the volume bars, and the user can switch the focus position by pressing the up or down button on the remote control. The display device can be configured to generate main video volume adjustment parameters when the display device's focus is on the main video volume control, and these main video volume adjustment parameters may include the movie / video window identifier. The display device can also be configured to generate secondary video volume adjustment parameters when the display device's focus is on the secondary video volume control, and these secondary video volume adjustment parameters may include the fitness video window identifier.

[0457] Users can continue to press the volume up or volume down buttons on the remote control to input volume increase or decrease commands to the display device. When the focus of the display device is on the main video volume control, the display device can determine that the volume increase or decrease command is a command to adjust the main video volume based on the existing main video volume adjustment parameters, and thus adjust the main video volume accordingly. When the focus of the display device is on the secondary video volume control, the display device can determine that the volume increase or decrease command is a command to adjust the secondary video volume based on the existing secondary video volume adjustment parameters.

[0458] In some embodiments, Figure 52 When the user presses the volume up or volume down button on the remote control, the display device shows a volume bar, and the focus is on that volume bar. For example... Figure 52 As shown, the volume bar can be a system volume control, which may have a system volume indicator. The display device can be configured to generate system volume adjustment parameters based on the focus being on the volume bar. These parameters may include the system volume indicator, or they may include both main and secondary video volume adjustment parameters, or they may not include either the main or secondary video volume adjustment parameters. When the user continues to press the volume up or down buttons on the remote control, they can input volume up or down commands into the display device. The display device can determine that the volume up or down command is a command to adjust the system volume based on the existing system volume adjustment parameters, and thus adjust the system volume accordingly. Of course, in some embodiments... Figure 52 The volume bar in the video can also be a main video volume control or a secondary video volume control. Correspondingly, when the focus is on the volume bar, the volume up and down commands are commands to adjust the main video volume or the secondary video volume.

[0459] In some embodiments, the user may also bring up the volume control on the display device in other ways and then input volume increase / decrease commands to the display device by operating the volume control. For example, the display device may also be configured to display a list of controls above the main window in response to a user-input down arrow key. See [link to relevant documentation]. Figure 43 , Figure 44 , Figure 46 .

[0460] exist Figure 43 and Figure 44 In the main window, the control list may include a volume control. When the user moves the focus of the display device to the volume control, the display device can be configured to display two volume bars above the main window in response to the trigger command of the volume control. These two volume bars are the main video volume control and the secondary video volume control, respectively. In Figure 43, the main video volume control can display "Movie Video Volume", and the fitness video volume control can display "Fitness Video Volume". Figure 44 In the display, the main video volume control can display "Main Video Volume," and the fitness video volume control can display "Small Video Volume." The display device can be configured to generate main video volume adjustment parameters when the focus of the display device is on the main video volume control. These main video volume adjustment parameters may include a video window identifier. The display device can also be configured to generate secondary video volume adjustment parameters when the focus of the display device is on the secondary video volume control. These secondary video volume adjustment parameters may include a fitness video window identifier.

[0461] Users can use the up and down buttons on the remote control to move the focus to the main video volume control or the secondary video volume control. Then, they can press the volume up or down buttons to input volume control commands to the display device. When the focus is on the main video volume control, the display device can determine that the volume control command is for adjusting the main video volume based on the existing main video volume adjustment parameters, and thus adjust the main video volume accordingly. When the focus is on the secondary video volume control, the display device obtains the secondary video volume adjustment parameters, which may include the fitness video window identifier. Users can continue to press the volume up or down buttons on the remote control to input volume control commands to the display device, which can then determine that the volume control command is for adjusting the secondary video volume based on the existing secondary video volume adjustment parameters.

[0462] exist Figure 46In this system, the user can access a list of controls by pressing the down or up button on the remote control, which may include a small-screen volume control. When the user moves the focus of the display device to a small-screen volume control, the display device can pop up multiple volume controls based on the trigger signal of the small-screen volume control. Each volume control is a secondary video volume control and has a fitness video window identifier. The display device can be configured to generate secondary video volume adjustment parameters when the focus of the display device is on a secondary video volume control. These secondary video volume adjustment parameters may include the fitness video window identifier. Different volume controls can display different volume level indicators, such as "Mute," "50%," "60%," "75%," "90%," and "100%." ​​The user can move the focus of the display device to one of the volume controls and press the confirmation button to trigger that volume control, thus inputting a volume increase or decrease command to the display device. The display device can determine that the volume increase or decrease command is an instruction to adjust the secondary video volume based on the presence of secondary video volume adjustment parameters.

[0463] Step S404: When the focus of the display device is on the secondary video volume control, the volume of the secondary video is adjusted in response to the volume increase / decrease command.

[0464] In some embodiments, when the focus of the display device is on the secondary video volume control, the display device can generate secondary video adjustment parameters. Therefore, the controller of the display device can be configured to: when the focus of the display device is on the secondary video volume control, in response to the volume increase / decrease command, adjust the volume of the secondary video according to the secondary video volume adjustment parameters and the volume increase / decrease command.

[0465] In some embodiments, after receiving a volume up or down command, the display device may detect whether there is a secondary video volume adjustment parameter.

[0466] If a secondary video volume adjustment parameter exists, the audio data of the secondary video's audio stream before superposition is amplified according to the volume increase / decrease instructions. For example, based on the fitness video window identifier in the secondary video volume adjustment parameter, the audio data of the fitness video's audio stream is amplified by the audio processing unit, and the amplified audio data is superimposed with the audio data of the main video's audio stream; the superimposed audio data is adjusted according to preset amplifier and sound effect parameters; and the adjusted audio data is output to the sound output component of the display device.

[0467] In some embodiments, the volume up / down instructions may include a gain coefficient, which may be the volume coefficient of the fitness video audio stream or the volume coefficient of the main video audio stream. The magnitude of the gain coefficient may be determined by the user by adjusting the volume bar corresponding to the secondary video, or by the volume control selected by the user in the pop-up interface of the small screen volume control.

[0468] Step S405: When the focus is on the main video volume control, the volume of the main video is adjusted in response to the volume increase / decrease command.

[0469] In some embodiments, when the focus of the display device is on the main video volume control, the display device can generate main video adjustment parameters. Therefore, the controller of the display device can be configured to adjust the volume of the main video according to the main video volume adjustment parameters and the volume increase / decrease instructions.

[0470] In some embodiments, after receiving a volume up / down command, the display device may detect whether there are main video volume adjustment parameters.

[0471] If a main video volume adjustment parameter exists, the audio data of the main video audio stream before overlay is amplified according to the volume increase / decrease instructions. For example, based on the video window identifier in the main video volume adjustment parameter, the audio processing unit amplifies the audio data of the video audio stream, and then overlays the amplified audio data with the audio data of the secondary video audio stream; the overlaid audio data is adjusted according to preset amplifier and sound effect parameters; and the adjusted audio data is output to the sound output component of the display device.

[0472] In some embodiments, a linked volume control may be displayed between the main video volume control and the secondary video volume control. When the focus is on the linked volume control, it can be considered that the focus is on both the main video volume control and the secondary video volume control at the same time. At this time, the display device can generate secondary video volume adjustment parameters and main video volume adjustment parameters, and adjust the volume of the main video and the volume of the secondary video according to the volume increase and decrease instructions.

[0473] Step S406: When the focus of the display device is on the system volume control, the system volume of the display device is adjusted in response to the volume increase / decrease command.

[0474] In some embodiments, when the focus of the display device is on the system volume control, the display device can generate system volume adjustment parameters. Therefore, after receiving a volume increase / decrease command, the display device can detect whether the system volume adjustment parameters exist. If the volume adjustment parameters exist, in response to the volume increase / decrease command, the volume of the superimposed main video and secondary video can be increased to adjust the system volume.

[0475] In some embodiments, when the focus of the display device is on the system volume control, the display device does not generate main video volume adjustment parameters and secondary video volume adjustment parameters. Therefore, after receiving the volume increase / decrease command, the display device can also detect whether the main video volume adjustment parameters and secondary video volume adjustment parameters exist. If neither the main video volume adjustment parameters nor the secondary video volume adjustment parameters exist, the display device can respond to the volume increase / decrease command by increasing the volume of the main video and secondary video combined to adjust the system volume.

[0476] In some embodiments, when the focus of the display device is on the system volume control, the display device generates main video volume adjustment parameters and secondary video volume adjustment parameters. Therefore, after receiving a volume increase / decrease command, the display device can also detect whether the main video volume adjustment parameters and secondary video volume adjustment parameters exist. If both the main video volume adjustment parameters and secondary video volume adjustment parameters exist, the display device can adjust the volume of the superimposed main video and secondary video in response to the volume increase / decrease command, thereby adjusting the system volume.

[0477] In some embodiments, when adjusting the system volume, the display device can send the audio data of the audio stream of the secondary video and the audio data of the audio stream of the main video to an overlay unit via the volume control unit. The overlay unit overlays the two audio streams, and then adjusts the gain of the audio data according to preset power amplifier and sound effect parameters. The overlay unit then outputs the adjusted audio data to the sound output component of the display device.

[0478] In some embodiments, when the focus of the display device is not on the secondary video volume control or the primary video volume control, if neither the primary video volume adjustment parameter nor the secondary video volume adjustment parameter exists, in response to the volume increase / decrease command, the system volume of the display device may be increased by default, that is, the superimposed audio data may be increased, or only the volume of the primary video may be increased by default.

[0479] In some embodiments, when the focus of the display device is neither on the secondary video volume control nor on the primary video volume control, if neither the primary video volume adjustment parameter nor the secondary video volume adjustment parameter exists, in response to the volume increase / decrease command, the system volume of the display device can be adjusted according to the system volume parameter and the volume increase / decrease command, wherein the system parameter is generated when the focus is neither on the secondary video volume control nor on the primary video volume control.

[0480] Figure 64A flowchart of a volume control method according to some embodiments is shown, including steps S501-S505.

[0481] Step S501: Receive the user's selection instructions for the main video control and the secondary video control, and determine the main video and the secondary video to be played.

[0482] Step S502: In response to receiving an instruction to play the main video and the secondary video simultaneously, play the video data of the main video in the main window and play the video data of the secondary video in the small window above the main window, while playing the audio data of the main video and the audio data of the secondary video at a preset volume.

[0483] Step S503: When playing the main video and the secondary video simultaneously, receive volume increase / decrease commands input by the user.

[0484] Step S504: When there are corresponding superimposed volume adjustment parameters for the main video and the sub-video, in response to the volume increase / decrease command, adjust the volume of the superimposed main video and sub-video according to the corresponding superimposed volume adjustment parameters for the main video and the sub-video.

[0485] In some embodiments, Figure 52 In this scenario, if a user displays a single volume bar on the display device, and then presses the volume up or volume down button on the remote control to input a volume increase or decrease command to the display device, the display device can generate corresponding superimposed volume adjustment parameters for the main video and the secondary video according to preset response rules. These superimposed volume adjustment parameters may include a gain coefficient, the magnitude of which can be determined by the user by adjusting the volume bar.

[0486] In some embodiments, when there are superimposed volume adjustment parameters corresponding to the main video and the sub-video, the audio control unit of the display device's controller can send the audio data of the sub-video's audio stream and the audio data of the main video's audio stream to a superimposed unit. The superimposed unit superimposes the two audio data streams and then sends the superimposed audio data to a power amplifier / sound effect processing unit. The power amplifier / sound effect processing unit adjusts the superimposed audio data according to the power amplifier parameters and sound effect parameters determined by the superimposed volume adjustment parameters, and outputs the adjusted audio data to the sound output component of the display device.

[0487] Step S505: When there is no corresponding superimposed volume adjustment parameter for the main video and the sub-video, in response to the volume increase / decrease command, adjust the volume of the superimposed main video and the sub-video according to the preset superimposed volume adjustment parameter.

[0488] In some embodiments, Figure 52If a user presses the volume up or volume down button on the remote control after a single volume bar pops up on the display device, the display device may not generate corresponding superimposed volume adjustment parameters for the main video and the secondary video, according to preset response rules.

[0489] In some embodiments, when there are no superimposed volume adjustment parameters corresponding to the main video and the secondary video, for example, when the user inputs a volume increase / decrease command as a voice command "increase volume", the volume increase / decrease command does not include superimposed volume adjustment parameters. In this case, the audio control unit of the display device's controller can send the audio data of the secondary video's audio stream and the audio data of the main video's audio stream to the superimposed unit. The superimposed unit superimposes the two audio data streams and then sends the superimposed audio data to the power amplifier / sound effect processing unit. The power amplifier / sound effect processing unit adjusts the superimposed audio data according to the power amplifier parameters and sound effect parameters determined by the preset superimposed volume adjustment parameters, and outputs the adjusted audio data to the sound output component of the display device.

[0490] As can be seen from the above embodiments, this application provides multiple viewing modes for fitness videos, allowing users to experience full-screen viewing, simultaneous training while watching fitness videos, and simultaneous movie watching on display devices, thereby improving the intelligence and fun of fitness. Furthermore, when playing the main and secondary videos simultaneously, the main and secondary videos are played according to the gain volume set by the user last time, or according to the default gain volume setting, solving the problem of sound mixing that easily occurs when the main and secondary videos are played simultaneously, thus improving the user experience.

[0491] Since the above embodiments are all described in conjunction with other methods, and different embodiments have the same parts, the same or similar parts between the various embodiments in this specification can be referred to mutually. They will not be described in detail here.

[0492] It should be noted that in this specification, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a circuit structure, article, or device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a circuit structure, article, or device. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the circuit structure, article, or device that includes the element.

[0493] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the disclosure herein. This application is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the content of the claims.

[0494] The above embodiments of this application do not constitute a limitation on the scope of protection of this application.

Claims

1. A display device, characterized in that, The display device is a television, including: monitor; A controller, connected to the display, is configured to: After the user selects a fitness video, in response to receiving the selection of the watch-and-workout mode option, the movie search page is displayed; In response to the user's selection of a film or television source on the film and television search page, a first interface containing a main video window and a secondary video window is displayed. The film or television video corresponding to the film or television source is played in the main video window, and the fitness video is played in the secondary video window. The main video window is a full-screen window, the layer containing the secondary video window is located above the layer containing the main video window, and the size of the secondary video window is smaller than the size of the main video window. Upon receiving a recall command, and in response to the recall command, displaying a control list in a floating layer on the first interface; wherein, the control list includes at least a volume control option; the recall command indicates that a first preset button of the remote control has been pressed; the control list is located in the playback area of ​​the playback window of the main video; In response to the volume control option gaining focus, a main video volume control and a secondary video volume control are displayed on the playback area of ​​the main video window; and the main video volume control and the secondary video volume control are located in a floating layer on the first interface; When the focus is moved to the main video volume control and a first volume adjustment command is received, the volume of the main audio stream is adjusted according to the main video volume adjustment parameters and the first volume adjustment command; the main video volume adjustment parameters are the main video volume control, and the main audio stream is the audio stream corresponding to the film source. When the focus is moved to the secondary video volume control and a first volume adjustment command is received, the volume of the secondary audio stream is adjusted according to the secondary video volume adjustment parameters and the first volume adjustment command; the secondary video volume adjustment parameters are the adjustment parameters corresponding to the secondary video volume control, and the secondary audio stream is the audio stream corresponding to the fitness video.

2. The display device according to claim 1, characterized in that, After the controller plays the video corresponding to the video source in the main video window and the fitness video in the secondary video window, it is further configured to: The system receives a second volume adjustment command and adjusts the volume of the mixed audio stream according to the second volume adjustment command; wherein, the second volume adjustment command indicates that a second preset button in the remote control is pressed, and the second preset button is different from the first preset button; the mixed audio stream refers to the audio stream obtained by superimposing the main audio stream corresponding to the main video window and the secondary audio stream corresponding to the secondary video window; the second preset button is a volume up button and a volume down button.

3. The display device according to claim 1, characterized in that, The controller, in response to receiving a selection of the "watch and practice" mode option, displays a movie search page and is configured as follows: When a user selects the "watch and practice" mode, the system checks whether the fitness video is a VIP video. After the user selects the fitness video, they then select the playback mode for the fitness video. The playback mode includes the "watch and practice" mode. If the fitness video is a VIP video, a VIP recommendation page will be displayed; the VIP recommendation page is used to recommend that users purchase playback rights for VIP videos; the VIP recommendation page includes purchase prompt controls and exit prompt controls. If a user is detected to have purchased VIP videos based on the purchase prompt control or exited the VIP recommendation page based on the exit prompt control, the movie and TV search page will be displayed.

4. The display device according to claim 3, characterized in that, The controller is also configured to: When the playback time of the fitness video reaches the trial viewing duration, a floating layer is drawn to display the VIP recommendation page; the layer containing the floating layer is located above the main video window and / or the secondary video window; wherein, when the VIP recommendation page is displayed in the floating layer, the main video window is controlled to continue playing the video, and the secondary video window is controlled to pause playing the fitness video; If a user purchases playback rights to the VIP video based on the VIP recommendation page, the fitness video will continue playing in the secondary video window.

5. The display device according to claim 4, characterized in that, The controller is also configured to: When the playback time of the fitness video reaches the trial viewing duration, pause the playback thread of the fitness video to control the secondary video window to pause the playback of the fitness video; If the user does not purchase playback access to the VIP video based on the VIP recommendation page, the playback thread of the fitness video will remain paused. The VIP recommendation page continues to be displayed in the floating layer.

6. The display device according to claim 4, characterized in that, The controller is also configured to: If the user has not purchased playback rights for the VIP video based on the VIP recommendation page, cancel the playback thread of the fitness video so that the secondary video window is canceled in the interface of the display device; And continue playing the video based on the main video window.

7. The display device according to claim 1, characterized in that, After the controller adjusts the volume of the main audio bitstream according to the main audio volume adjustment parameters and the first volume adjustment command, it is further configured to: The secondary audio stream and the main audio stream after volume adjustment are superimposed to obtain the first target audio data; The first target audio data is output to the sound output component of the display device.

8. The display device according to claim 1, characterized in that, After the controller adjusts the volume of the secondary audio bitstream according to the secondary video volume adjustment parameters and the first volume adjustment command, it is further configured to: The main audio stream and the volume-adjusted secondary audio stream are superimposed to obtain the second target audio data; the second target audio data is then output to the sound output component of the display device.

9. The display device according to claim 1, characterized in that, When the controller adjusts the volume of the secondary audio bitstream according to the secondary video volume adjustment parameters and the first volume adjustment command, it is also configured to: Set the initial volume corresponding to the secondary video window to 0.

Images