Display apparatus and content recording method

Abstract

The invention relates to a display device and a content recording method. The display device includes: a decoder configured to decode audio and video data; a storage medium configured to store data; the controller is configured to display at least two pictures in response to a first operation for triggering multi-picture display, and the at least two pictures comprise a playing picture when the first operation is triggered and a recording picture for recording target content; transmitting the audio and video data to a decoder through the first channel, decoding the audio and video data through the decoder, and playing the correspondingly obtained decoding content in the playing picture; and transmitting the target content to a storage medium for storage through the second channel, and displaying corresponding recording prompt information in the recording picture. According to the embodiment of the invention, the original playing picture can be directly displayed through the first operation to be switched into at least two pictures including the recorded picture, and the original playing picture is supported to be continuously played at the same time, so that the operation can be simplified.

Description

Technical Field

[0001] The present application relates to the field of computer application technology, and in particular to a display device and a content recording method. Background Art

[0002] For large-screen devices at home, the demand for parallel content output in multiple application scenarios is becoming increasingly significant. For example, users may need to record the screen while watching a live broadcast. In related technologies, when recording a program, if the user needs to switch back to the live broadcast, they usually need to stop recording or switch the signal source; further, they may need to use the secondary menu to control the TV to enter the recording function. As a result, each recording requires pausing the live broadcast, which is cumbersome and inconvenient. Summary of the Invention

[0003] Based on this, it is necessary to provide a display device and content recording method that simplify operations for users in response to the above technical problems.

[0004] In a first aspect, the present application provides a display device, comprising:

[0005] a display configured to display images and / or a user interface;

[0006] a decoder configured to decode the audio and video data;

[0007] a storage medium configured to store data;

[0008] The controller is configured as:

[0009] In response to a first operation triggering multi-screen display, displaying at least two screens, the at least two screens including a playback screen when the first operation is triggered and a recording screen for recording target content;

[0010] The audio and video data is transmitted to the decoder through the first channel, the audio and video data is decoded by the decoder, and the corresponding decoded content is played on the playback screen;

[0011] Through the second channel, the target content is transferred to the storage medium for storage, and the corresponding recording prompt information is displayed in the recording screen.

[0012] The above technical solution has the following advantages or beneficial effects: since there is no need to use a remote control device to enter a menu option and select to start recording, the first operation can directly switch from the previous playback screen to displaying at least two screens, including the recording screen, while supporting the original playback screen to continue playing and start recording, thereby simplifying operation and improving operational efficiency. In addition, since two channels can be used, one channel is used to transmit audio and video data to the decoder for decoding to support real-time playback of content, and the other channel is used to transmit target content for recording, the two channels do not interfere with each other, thereby effectively achieving real-time content playback and recording processes simultaneously.

[0013] In one embodiment, the target content is audio and video data; the controller executes the transfer of the audio and video data to a storage medium for storage, and is configured to: for the audio played synchronously with the playback screen, when the audio waveform of the audio triggers a first recording condition or the picture content of the playback screen triggers a second recording condition, the audio and video data obtained based on the triggering moment of the triggering recording condition is transferred to the storage medium for storage.

[0014] The above technical solution has the following advantages or beneficial effects: since it can automatically record according to the audio waveform and picture content, it can simplify user operations and improve operating efficiency.

[0015] In one embodiment, the controller is further configured to:

[0016] In response to the second operation of ending the multi-screen display, the target content is stopped from being transferred to the storage medium for storage, and the recording screen is closed; or, the decoding content is stopped from being played, and the playing screen is closed.

[0017] The above technical solution has the following advantages or beneficial effects: when stopping playback or recording, there is no need to enter the menu option through the remote control device to select stop recording or stop playback. Instead, a second operation can be used to directly switch from the previous multi-screen display to a single-screen display, thereby simplifying the operation and improving operating efficiency.

[0018] In one embodiment, the operation type of each of the first operation and the second operation includes voice input or gesture input; wherein, when the operation type of the first operation is gesture input, the first operation is a first gesture that lasts for a first preset time and then turns into a second gesture; when the operation type of the second operation is gesture input, the second operation is a second gesture that lasts for a second preset time and then turns into the first gesture.

[0019] The above technical solution has the following advantages or beneficial effects: Because voice input or gesture input is used, and the gesture input is further a combination of multiple gestures, the display of the previous playback screen can be directly switched to at least two screens, including the recording screen, while simultaneously allowing the original playback screen to continue playing and starting recording, thereby simplifying operation and improving operational efficiency. In addition, the first operation and the second operation can be reverse operations in the gesture sequence, further simplifying operation.

[0020] In one embodiment, the controller is further configured to:

[0021] In response to a recording and playback operation on the recorded content stored in the storage medium, disconnecting the first channel and transmitting the recorded content stored in the storage medium to the decoder through the third channel;

[0022] The recorded content is decoded by a decoder and the corresponding decoded content is played on the recorded screen.

[0023] Specifically, when recording and playback are required, the first channel can be disconnected, and the audio and video data transmitted through the first channel is no longer transmitted to the decoder for decoding, thereby stopping the live content of the previous playback screen; instead, the recorded content stored in the storage medium is transmitted to the decoder through the third channel, and the decoded recorded content is played on the recording screen. The first channel and the third channel are different channels.

[0024] The above technical solution has the following advantages or beneficial effects: since a single decoder and multiple channels can be used to realize live broadcast of content and playback of recorded content, recording can also be performed simultaneously when playing back recorded content, thereby saving resources while meeting actual operational needs.

[0025] In one embodiment, the controller is further configured to:

[0026] In response to the switching operation for the screen size, the respective screen sizes of the playback screen and the recording screen are interchanged.

[0027] The above technical solution has the following advantages or beneficial effects: since the screen sizes of the playback screen and the recording screen can be interchanged, more diverse display requirements can be met.

[0028] In one embodiment, the target content is audio and video data or data from an external signal source.

[0029] The above technical solution has the following advantages or beneficial effects: since the target content can also be data from an external signal source, it can meet a wider range of multi-screen display requirements.

[0030] In a second aspect, the present application further provides a content recording method, which is applied to the display device provided by various possible implementations of the first aspect, and the method includes:

[0031] In response to a first operation triggering multi-screen display, displaying at least two screens, the at least two screens including a playback screen when the first operation is triggered and a recording screen for recording target content;

[0032] The audio and video data is transmitted to the decoder through the first channel, the audio and video data is decoded by the decoder, and the corresponding decoded content is played on the playback screen;

[0033] Through the second channel, the target content is transferred to the storage medium for storage, and the corresponding recording prompt information is displayed in the recording screen.

[0034] The above technical solution has the following advantages or beneficial effects: since there is no need to use a remote control device to enter a menu option and select to start recording, the first operation can directly switch from the previous playback screen to displaying at least two screens, including the recording screen, while supporting the original playback screen to continue playing and start recording, thereby simplifying operation and improving operational efficiency. In addition, since two channels can be used, one channel is used to transmit audio and video data to the decoder for decoding to support real-time playback of content, and the other channel is used to transmit target content for recording, the two channels do not interfere with each other, thereby effectively achieving real-time content playback and recording processes simultaneously.

[0035] In one embodiment, the target content is audio and video data; transferring the audio and video data to a storage medium for storage includes:

[0036] For the audio played synchronously with the playback screen, when the audio waveform of the audio triggers the first recording condition or the picture content of the playback screen triggers the second recording condition, the audio and video data obtained based on the triggering moment of the triggering recording condition will be transmitted to the storage medium for storage.

[0037] The above technical solution has the following advantages or beneficial effects: since it can automatically record according to the audio waveform and picture content, it can simplify user operations and improve operating efficiency.

[0038] In one embodiment, the operation type of each of the first operation and the second operation includes voice input or gesture input; wherein, when the operation type of the first operation is gesture input, the first operation is a first gesture that lasts for a first preset time and then turns into a second gesture; when the operation type of the second operation is gesture input, the second operation is a second gesture that lasts for a second preset time and then turns into the first gesture.

[0039] The above technical solution has the following advantages or beneficial effects: Because voice input or gesture input is used, and the gesture input is further a combination of multiple gestures, the display of the previous playback screen can be directly switched to at least two screens, including the recording screen, while simultaneously allowing the original playback screen to continue playing and starting recording, thereby simplifying operation and improving operational efficiency. In addition, the first operation and the second operation can be reverse operations in the gesture sequence, further simplifying operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following briefly introduces the drawings required for use in the embodiments of the present application or related technical descriptions. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying any creative work.

[0041] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0042] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0043] Figure 3 A schematic diagram of the hardware configuration of a control device provided in some embodiments of the present application;

[0044] Figure 4 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0045] Figure 5 is a flowchart of a content recording method in one embodiment;

[0046] Figure 6 is a schematic diagram of the flow of audio and video data in one embodiment;

[0047] Figure 7 A schematic diagram of hardware implementation of a recording process in one embodiment;

[0048] Figure 8 A schematic diagram of hardware implementation of the recording and playback process in one embodiment;

[0049] Figure 9 A schematic diagram of module division at the software level in one embodiment;

[0050] Figure 10 is an interactive schematic diagram of a content recording method in one embodiment;

[0051] Figure 11FIG. 1 is a structural block diagram of a content recording device in one embodiment. DETAILED DESCRIPTION

[0052] The following embodiments are described in detail, with examples illustrated in the accompanying drawings. When the following description refers to the drawings, identical numbers in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following embodiments are not intended to represent all possible implementations consistent with the present application. They are merely examples of systems and methods consistent with certain aspects of the present application, as detailed in the claims.

[0053] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0054] In the specification and claims of this application and the accompanying drawings, the terms "first," "second," "third," etc. are used to distinguish similar or similar objects or entities, and are not necessarily intended to limit a particular order or sequence, unless otherwise noted. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances.

[0055] The terms "comprise," "include," and "have," and any variations thereof, are intended to cover but not exclude inclusion; for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0056] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functionality associated with that element.

[0057] In the embodiments of the present application, the display device 200 generally refers to a device capable of displaying images and processing data. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0058] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG, a user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0059] The mobile terminal 300 can function as a control device for performing human-computer interaction between a user and the display device 200. The mobile terminal 300 can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, enabling connection and communication via a network communication protocol, enabling one-to-one control operations and data communication. Audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 for synchronized display.

[0060] like Figure 1 As shown in FIG, the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0061] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart TV, Internet Protocol television (IPTV), etc.

[0062] Figure 2 Some embodiments of this application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0063] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0064] In some embodiments, detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 may include a light receiver, such as a sensor for collecting ambient light intensity; or an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or a sound collector, such as a microphone, for receiving external sounds.

[0065] In some embodiments, the display 260 includes a display component for displaying images and a driver component for driving image display. The display 260 is configured to receive image signals output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces.

[0066] In some embodiments, the communication device 220 is a component used to communicate with an external device or server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 depending on the supported communication methods. For example, if the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including WiFi functionality. If the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including Bluetooth functionality.

[0067] The communication device 220 can establish a communication connection between the display device 200 and an external device or server 400 via a wireless or wired connection. A wired connection can connect the display device 200 to an external device via a data cable, an interface, or other components. A wireless connection can connect the display device 200 to an external device via a wireless signal or wireless network. The display device 200 can establish a connection with an external device directly or indirectly through a gateway, router, or connection device.

[0068] In some embodiments, the controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processor, and a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in a memory. The controller 250 controls the overall operation of the display device 200.

[0069] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0070] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0071] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may further be provided with an external audio output terminal, through which the audio output device may be connected to the display device 200 to output the sound of the display device 200.

[0072] In some embodiments, the user input interface 280 may be configured to receive instructions from a user.

[0073] Figure 3 Some embodiments of this application provide Figure 1 The hardware configuration diagram of the control device in the figure. Figure 3 As shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0074] The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200 .

[0075] In some embodiments, the control device 100 may be a smart device. For example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0076] In some embodiments, as Figure 1 As shown, the mobile terminal 300 or other intelligent electronic devices can play a similar function as the control device 100 after installing the application for controlling the display device 200 .

[0077] The controller 110 includes a processor 112, RAM 113, ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components and external and internal data processing functions.

[0078] Under the control of the controller 110, the communication interface 130 communicates control signals and data signals with the display device 200. The communication interface 130 may include at least one of a WiFi chip 131, a Bluetooth module 132, an NFC module 133, or other near field communication modules.

[0079] The user input / output interface 140 includes at least one of a microphone 141 , a touch panel 142 , a sensor 143 , a button 144 and other input interfaces.

[0080] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with the communication interface 130, such as a WiFi, Bluetooth, or NFC module, to encode user input commands via the WiFi protocol, Bluetooth protocol, or NFC protocol and transmit them to the display device 200.

[0081] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0082] The power supply 180 is used to provide operating power support for various components of the control device 100 under the control of the controller.

[0083] To facilitate user interaction, in some embodiments, display device 200 may run an operating system. An operating system is a computer program used to manage and control the hardware and software resources of display device 200. The operating system can provide a user interface (control the display device), allow users to interact with display device 200, and support the running of various application programs.

[0084] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for display devices.

[0085] The operating system can be divided into different modules or layers according to the functions implemented, e.g. Figure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom: the application layer (abbreviated as "application layer"), the application framework layer (abbreviated as "framework layer"), the system library layer and the kernel layer.

[0086] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on these applications. The application layer can host at least one application, which can include built-in window programs, system settings programs, clock programs, and other applications provided by the operating system, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0087] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0088] like Figure 4As shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to the system location service; a package manager for retrieving various information related to the application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0089] In some embodiments, the activity manager is used to manage the lifecycle of each application and common navigation back functions, such as controlling application exit, opening, and back. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling changes in display windows, such as shrinking, shaking, or distorting the display window.

[0090] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0091] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 4 As shown, the kernel layer can be configured with hardware drivers, and the drivers included in the kernel layer can be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0092] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0093] In combination with the above-mentioned principle description, an embodiment of the present application provides a display device, including:

[0094] a display configured to display images and / or a user interface;

[0095] a decoder configured to decode the audio and video data;

[0096] a storage medium configured to store data;

[0097] The controller is configured as:

[0098] In response to a first operation triggering multi-screen display, displaying at least two screens, the at least two screens including a playback screen when the first operation is triggered and a recording screen for recording target content;

[0099] The audio and video data is transmitted to the decoder through the first channel, the audio and video data is decoded by the decoder, and the corresponding decoded content is played on the playback screen;

[0100] Through the second channel, the target content is transferred to the storage medium for storage, and the corresponding recording prompt information is displayed in the recording screen.

[0101] Among them, the operation type of the first operation can be a voice operation or a gesture operation; of course, it can also be a one-button operation through a remote control device, and the embodiment of the present application does not specifically limit this. It is understandable that when the first operation is triggered, the user may be watching a live program, so that the display can only display the playback screen of the live program. After the first operation is triggered, it can be switched from the original single display of the playback screen to displaying at least two screens. One of the screens is the playback screen of the previous live program, and the other screen is the recording screen. The target content to be recorded can be the audio and video data corresponding to the playback screen of the current live program, or the audio and video data corresponding to the playback screen of other live programs, or data from an external signal source, and the embodiment of the present application does not limit this.

[0102] In addition, since the display originally displayed a single playback screen, it now displays at least two screens, and thus the corresponding screen size will also change. Originally, a single playback screen was displayed, and the playback screen could occupy the entire screen. After changing to displaying at least two screens, taking the display of two screens as an example, the two screens can each occupy half of the screen size, or the playback screen can still occupy the entire screen, while the recording screen is located in a certain position on the screen in the form of a window, such as the upper right corner. Of course, the at least two screens mentioned above are not limited to two screens, and three screens can also be displayed, such as two playback screens and one recording screen. In addition to the playback screen and the recording screen, other types of screens can also be displayed, such as the settings screen, and the embodiments of the present application do not specifically limit this.

[0103] The first channel and the second channel may refer to the input channels of the video and audio, and the decoder is responsible for decoding the video and audio. Through the first channel, the audio and video data can be transmitted to the decoder to obtain the decoded content and play it on the playback screen. Through the second channel, the target content that has not yet been decoded can be transferred to the storage medium for storage to record the target content. Among them, the recording prompt information may include the recording progress, the program information currently being recorded, and the interactive elements for controlling the recording and playback, which are not specifically limited in the embodiments of the present application.

[0104] The display device described above does not require a remote control to access a menu option and select to start recording. Instead, a first operation can be used to directly switch from displaying the previous playback screen to displaying at least two screens, including the recording screen, while simultaneously supporting the continued playback of the original playback screen and starting recording. This simplifies operation and improves operational efficiency. In addition, since two channels can be used, one for transmitting audio and video data to a decoder for decoding to support real-time playback of content, and the other for transmitting target content for recording, the two channels do not interfere with each other, thereby effectively achieving real-time playback and recording simultaneously.

[0105] In some embodiments, the target content is audio and video data; the controller executes the process of transferring the audio and video data to a storage medium for storage, and is configured to:

[0106] For the audio played synchronously with the playback screen, when the audio waveform of the audio triggers the first recording condition or the picture content of the playback screen triggers the second recording condition, the audio and video data obtained based on the triggering moment of the triggering recording condition will be transmitted to the storage medium for storage.

[0107] The recording process is triggered by the audio waveform of the audio and the screen content of the playback screen because the audio waveform and screen content may reflect the key points that the user needs to record. For example, for a football game, the user may need to record the playing screen; and for football games, there is usually a commentator, and when a goal is scored, the commentator's commentary pitch will rise. The increase in pitch will be reflected in the audio waveform, so the first recording condition is determined in advance based on the audio waveform of the commentary sound when the goal is scored. Subsequently, it can be determined whether the audio waveform of the audio can represent the commentary sound when the goal is scored, and thus determine whether to record. Similarly, the screen content will also change when a goal is scored. For example, a scene of the audience cheering will be played. Therefore, the second recording condition is determined in advance based on the screen content when the goal is scored. Subsequently, it can be determined whether the screen content is caused by the goal, and thus determine whether to record.

[0108] Among them, the first recording condition can be specifically that the audio waveform matches the preset waveform shape, and the second recording condition can be that the classification result of the screen content is a preset result, such as the goal result. It should be noted that after the recording condition is triggered, recording can be started from the triggering moment, that is, the audio and video data obtained after the triggering moment is recorded. The recording time can be set in advance, such as the user can set the recording time to 5 minutes, 3 minutes or 15 minutes through the menu, or it can automatically stop recording until the user actively stops recording or the program is finished playing. The embodiment of the present application does not specifically limit this.

[0109] In this embodiment, since automatic recording can be performed based on the audio waveform and the image content, user operations can be simplified and operational efficiency can be improved.

[0110] In some embodiments, the controller is further configured to:

[0111] In response to the second operation of ending the multi-screen display, the target content is stopped from being transferred to the storage medium for storage, and the recording screen is closed; or, the decoding content is stopped from being played, and the playing screen is closed.

[0112] The above process mainly converts a single screen to a multi-screen display and simultaneously starts the recording process. In actual implementation, the user can also end the multi-screen display. For example, the user can stop recording, in which case the recording screen can be closed; the user can also stop playback instead of stopping recording, in which case the playback screen can be closed. It is understood that the second operation can be an operation for stopping recording or an operation for stopping playback, and this embodiment of the application does not specifically limit this.

[0113] In this embodiment, when stopping playback or recording, there is no need to enter the menu option through the remote control device and select to stop recording or stop playback. Instead, the previous multi-screen display can be directly switched to a single-screen display through a second operation, thereby simplifying the operation and improving operating efficiency.

[0114] In some embodiments, the operation type of each of the first operation and the second operation includes voice input or gesture input; wherein, when the operation type of the first operation is gesture input, the first operation is a first gesture that lasts for a first preset time and then turns into a second gesture; when the operation type of the second operation is gesture input, the second operation is a second gesture that lasts for a second preset time and then turns into the first gesture.

[0115] In actual implementation, the operation types of the first operation and the second operation can both be voice input, or both can be gesture input, or one can be voice input and the other can be gesture input. This embodiment of the present application does not make specific limitations on this.

[0116] For voice input, speech sensors, such as microphone arrays, collect voice information. After speech acquisition and preprocessing, and voice feature extraction, the feature data is input into the speech recognition engine. The speech recognition engine uses a pre-trained model to analyze and compare the input feature data to determine whether the user's voice input includes a recorded term that has been activated for multi-screen display.

[0117] Specifically, the voice input content corresponding to the first operation may be "record the current program and display the recording playback window", and the voice input content corresponding to the second operation may be "stop the current recording".

[0118] For gesture input, the camera and gesture sensor capture gesture information. After image acquisition and preprocessing, and gesture feature extraction, the feature data is input into the gesture recognition engine. The gesture recognition engine analyzes and compares the input feature data based on a pre-trained model to determine whether the user's gesture is a recorded gesture that has been activated for multi-screen display.

[0119] Specifically, if the operation type of the first operation and the second operation is gesture input, the first operation and the second operation can both be aggregated operations of multiple gestures. Among them, the first operation can be a first gesture that lasts for a first preset time and then changes to a second gesture. The first gesture can be an open gesture with five fingers spread out, and the second gesture can be a closed gesture with a fist. The first preset time can be 3 seconds; thus, the first operation can be specifically the user's five fingers spread out for 3 seconds and then clenching a fist. Conversely, the second operation can be specifically the user's five fingers spread out after clenching a fist for 3 seconds. The first preset time and the second preset time can be the same, such as both 3 seconds, or they can be different. This embodiment of the present application does not specifically limit this.

[0120] In this embodiment, since voice input or gesture input is used, and the gesture input is further a combination of multiple gestures, the display of the previous playback screen can be directly switched to at least two screens, including the recording screen, while simultaneously allowing the original playback screen to continue playing and starting recording, thereby simplifying the operation and improving operational efficiency. In addition, the first operation and the second operation can be reverse operations in the gesture sequence, further simplifying the operation.

[0121] In some embodiments, the controller is further configured to:

[0122] In response to a recording and playback operation on the recorded content stored in the storage medium, disconnecting the first channel and transmitting the recorded content stored in the storage medium to the decoder through the third channel;

[0123] The recorded content is decoded by a decoder and the corresponding decoded content is played on the recorded screen.

[0124] Specifically, when recording and playback are required, the first channel can be disconnected, and the audio and video data transmitted through the first channel is no longer transmitted to the decoder for decoding, thereby stopping the live content of the previous playback screen; instead, the recorded content stored in the storage medium is transmitted to the decoder through the third channel, and the decoded recorded content is played on the recording screen. The first channel and the third channel are different channels.

[0125] In this embodiment, a single decoder and multiple channels can be used to realize live broadcast of content and playback of recorded content. Recording can also be performed simultaneously when playing back recorded content, thereby saving resources while meeting actual operational needs.

[0126] In some embodiments, the controller is further configured to:

[0127] In response to the switching operation for the screen size, the respective screen sizes of the playback screen and the recording screen are interchanged.

[0128] It is understood that of the at least two displayed screens, one can be the primary screen, i.e., the screen with the larger screen size, while the other screen with the smaller screen size can be the secondary screen. For example, the playback screen can be the primary screen, and the recording screen can be the secondary screen. The two can be interchangeable, and their sizes can also be swapped. For example, the playback screen can be switched to the secondary screen, and the recording screen can be switched to the primary screen.

[0129] It should be noted that in the actual process of displaying multiple screens, picture-in-picture, split-screen or floating window display methods can be used, and the embodiments of the present application do not make specific limitations on this.

[0130] In this embodiment, since the screen sizes of the playback screen and the recording screen can be interchanged, more diverse display requirements can be met.

[0131] In some embodiments, the target content is audio and video data or data from an external signal source.

[0132] As mentioned above, the target content can be audio and video data, i.e., live content that can be recorded simultaneously. In actual implementation, the target content can also be data from an external signal source, such as camera data; this allows users to record video chats or surveillance videos while watching a program, although this embodiment of the application does not specifically limit this.

[0133] In this embodiment, since the target content can also be data from an external signal source, a wider range of multi-screen display requirements can be met.

[0134] The above content mainly describes the display device. In an exemplary embodiment, a content recording method is also provided, which is applied to the display device mentioned above. Figure 5 , the method comprising:

[0135] Step 502 : In response to a first operation triggering multi-screen display, at least two screens are displayed, where the at least two screens include a playback screen when the first operation is triggered and a recording screen for recording target content.

[0136] In step 504 , the audio and video data is transmitted to the decoder via the first channel. The decoder decodes the audio and video data and plays the corresponding decoded content on the playback screen.

[0137] Step 506: The target content is transmitted to a storage medium through the second channel for storage, and corresponding recording prompt information is displayed in the recording screen.

[0138] The recording process can be referred to Figure 6 .exist Figure 6In the process, the A / V data of the digital TV program selected by the user, i.e., the audio and video data, is obtained after demodulation by the high-frequency head and demultiplexing module. During normal viewing, the demultiplexed A / V data can be fed into the decoder via the first channel for decoding and broadcast. Furthermore, it can be fed into the hard disk, i.e., the storage medium, via the second channel for time-shifted storage. When the user performs operations such as pause, rewind, or slow play, i.e., recording and playback, the TV can enter a time-shifted state, disconnecting the first channel and allowing the decoder to retrieve the A / V data from the storage medium via the third channel for decoding and output. At this point, the second channel remains operational, allowing recording to continue. It should be noted that if there is more than one decoder, an additional high-frequency head and demultiplexing module can be configured to enable simultaneous viewing of multiple live programs and subsequent recording and playback.

[0139] In addition, the above-mentioned high-frequency head and demultiplexing module can be realized in hardware through the system main control chip. Figure 7 As shown, in Figure 7 In the system, the input TS stream is the incoming transport stream data. The TS stream passes through a multiplexer, which determines which module in the system's main control chip is responsible for processing it. The programmable transmission interface module is a microprocessor integrated into the system's main control chip. Its primary task is to perform TS stream analysis, demodulation, and demultiplexing. It includes on-chip cache and can transfer data to and from external storage using DMA, providing hardware support for hard disk recording and playback.

[0140] The programmable transmission interface module extracts the TS packets corresponding to the programs to be recorded from the TS stream and stores them in an on-chip cache. When the on-chip cache receives a TS packet, the driver notifies the software program, which then copies the TS packet from the on-chip cache to the external storage. When the external storage area, which contains a 64KB buffer allocated for hard drive reads and writes, is full, the data can be written from the external storage area to the hard drive, completing the recording process. Furthermore, thanks to the multi-channel gating capabilities of the multiplexer and the multi-program gating capabilities of the programmable transmission interface module, programs can be played back in real time while being recorded, allowing users to watch other programs while recording.

[0141] The above process is mainly the recording process. The recording and playback process is the same. For details, please refer to Figure 8 .exist Figure 8In the program, the program information of all recorded programs on the hard disk, such as the content, length, bit rate, recording time, etc. of the program, can be listed in the form of a menu through the display device. The user selects the recorded program to be played through the remote control device. After the recorded program is selected, the corresponding TS stream in the hard disk is read and placed in the external storage. The TS stream in the external storage is selected by the multi-channel selector, and the TS stream is demultiplexed and other operations are performed through the programmable transmission interface module. Finally, it is decoded by the decoder to play the recorded content. In addition, it should be noted that in actual implementation, in order to synchronize the audio and video of the playback screen of the main screen and the recording screen as the sub-screen, cross-signal source recording can be supported, such as synchronous recording of HDMI input and built-in streaming media.

[0142] The above-described content recording method simplifies operations and improves efficiency because it eliminates the need to use a remote control device to access menu options and select to start recording. Instead, a first operation directly switches from displaying the previous playback screen to displaying at least two screens, including the recording screen, while simultaneously allowing the original playback screen to continue playing and recording to begin. Furthermore, because two channels are used, one for transmitting audio and video data to a decoder for decoding to support real-time content playback, and the other for transmitting target content for recording, the two channels do not interfere with each other, thereby effectively achieving real-time content playback and recording simultaneously.

[0143] In some embodiments, the target content is audio and video data; transferring the audio and video data to a storage medium for storage includes:

[0144] For the audio played synchronously with the playback screen, when the audio waveform of the audio triggers the first recording condition or the picture content of the playback screen triggers the second recording condition, the audio and video data obtained based on the triggering moment of the triggering recording condition will be transmitted to the storage medium for storage.

[0145] In this embodiment, since automatic recording can be performed based on the audio waveform and the image content, user operations can be simplified and operational efficiency can be improved.

[0146] In some embodiments, the method further comprises:

[0147] In response to the second operation of ending the multi-screen display, the target content is stopped from being transferred to the storage medium for storage, and the recording screen is closed; or, the decoding content is stopped from being played, and the playing screen is closed.

[0148] In this embodiment, when stopping playback or recording, there is no need to enter the menu option through the remote control device and select to stop recording or stop playback. Instead, the previous multi-screen display can be directly switched to a single-screen display through a second operation, thereby simplifying the operation and improving operating efficiency.

[0149] In some embodiments, the operation type of each of the first operation and the second operation includes voice input or gesture input; wherein, when the operation type of the first operation is gesture input, the first operation is a first gesture that lasts for a first preset time and then turns into a second gesture; when the operation type of the second operation is gesture input, the second operation is a second gesture that lasts for a second preset time and then turns into the first gesture.

[0150] When the operation type is voice input or gesture input, the entire application can be divided into the user interaction layer, business logic layer, hardware decoding layer, data processing layer and hardware acceleration layer at the software level. For details, please refer to Figure 9 In addition, the interaction process between the user and the display device can refer to Figure 10 .

[0151] In this embodiment, since voice input or gesture input is used, and the gesture input is further a combination of multiple gestures, the display of the previous playback screen can be directly switched to at least two screens, including the recording screen, while simultaneously allowing the original playback screen to continue playing and starting recording, thereby simplifying the operation and improving operational efficiency. In addition, the first operation and the second operation can be reverse operations in the gesture sequence, further simplifying the operation.

[0152] It should be understood that, although the steps in the flowcharts of the above embodiments are shown in sequence as indicated by the arrows, these steps are not necessarily performed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be performed in other orders. Moreover, at least a portion of the steps in the flowcharts of the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily performed at the same time, but can be performed at different times. The execution order of these steps or stages is not necessarily to be performed in sequence, but can be performed in turn or alternately with other steps or at least a portion of steps or stages in other steps.

[0153] Based on the same inventive concept, embodiments of the present application further provide a content recording device for implementing the aforementioned content. The solution provided by this device is similar to the solution described in the aforementioned method. Therefore, the specific limitations of one or more content recording device embodiments provided below can be found in the above-described limitations of the content recording method and will not be further elaborated here.

[0154] In an exemplary embodiment, Figure 11 As shown, a content recording device is provided, including: a display module 1102, a playback module 1104 and a recording module 1106, wherein:

[0155] The display module 1102 is configured to display at least two images in response to a first operation triggering multi-image display, wherein the at least two images include a playback image when the first operation is triggered and a recording image of the target content;

[0156] The playback module 1104 is configured to transmit the audio and video data to the decoder via the first channel, decode the audio and video data via the decoder, and play the corresponding decoded content on the playback screen;

[0157] The recording module 1106 is configured to transmit the target content to a storage medium for storage via the second channel, and display corresponding recording prompt information in the recording screen.

[0158] In an exemplary embodiment, the target content is audio and video data; the recording module 1106 is used to transmit the audio and video data obtained based on the triggering moment of the triggering recording condition to a storage medium for storage when the audio waveform of the audio triggers a first recording condition or the picture content of the playback screen triggers a second recording condition for the audio played synchronously with the playback screen.

[0159] In an exemplary embodiment, the recording module 1106 is further used to stop transferring the target content to the storage medium for storage and close the recording screen in response to the second operation of ending the multi-screen display; or, stop playing the decoded content and close the playback screen.

[0160] In an exemplary embodiment, the operation type of each of the first operation and the second operation includes voice input or gesture input; wherein, when the operation type of the first operation is gesture input, the first operation is a first gesture that lasts for a first preset time and then turns into a second gesture; when the operation type of the second operation is gesture input, the second operation is a second gesture that lasts for a second preset time and then turns into the first gesture.

[0161] In an exemplary embodiment, the recording module 1106 is further configured to, in response to a recording and playback operation on the recorded content stored in the storage medium, disconnect the first channel and transmit the recorded content stored in the storage medium to the decoder through the third channel; decode the recorded content through the decoder and play the corresponding decoded content in the recording screen.

[0162] In an exemplary embodiment, the display module 1102 is further configured to interchange the screen sizes of the playback screen and the recording screen in response to a switching operation on the screen size.

[0163] In an exemplary embodiment, the target content is audio and video data or data from an external signal source.

[0164] Each module in the aforementioned content recording device may be implemented in whole or in part through software, hardware, or a combination thereof. Each module may be embedded in or independent of a processor within a computer device in the form of hardware, or may be stored in a computer device memory in the form of software, so that the processor can call and execute the corresponding operations of each module.

[0165] In an exemplary embodiment, a computer device is provided, including a memory and a processor. The memory stores a computer program, and the processor implements possible implementations of the above methods when executing the computer program.

[0166] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the possible implementations provided by the above methods are realized.

[0167] In one embodiment, a computer program product is provided, including a computer program, which implements the possible implementations provided by the above methods when executed by a processor.

[0168] Those skilled in the art will understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. In particular, any reference to memory, database, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The databases involved in the various embodiments provided herein may include at least one of a relational database and a non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the various embodiments provided herein may be, but are not limited to, general-purpose processors, central processing units (CPUs), graphics processing units (GPUs), digital signal processors (DSPs), programmable logic devices (PLDs), quantum computing-based data processing logic devices, artificial intelligence (AI) processors, and the like.

[0169] The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0170] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.

Claims

1. A display device, characterized in that: include: a display configured to display images and / or a user interface; a decoder configured to decode the audio and video data; a storage medium configured to store data; The controller is configured as: In response to a first operation triggering multi-screen display, displaying at least two screens, the at least two screens including a playback screen when the first operation is triggered and a recording screen for recording target content; The audio and video data is transmitted to the decoder through the first channel, the audio and video data is decoded by the decoder, and the corresponding decoded content is played on the playback screen; The target content is transmitted to the storage medium through the second channel for storage, and corresponding recording prompt information is displayed in the recording screen.

2. The display device according to claim 1, wherein The target content is the audio and video data; the controller executes the transmission of the audio and video data to the storage medium for storage, and is configured to: For the audio played synchronously with the playback screen, when the audio waveform of the audio triggers the first recording condition or the picture content of the playback screen triggers the second recording condition, the audio and video data obtained based on the triggering moment of the triggering recording condition will be transmitted to the storage medium for storage.

3. The display device according to claim 1, wherein The controller is further configured to: In response to a second operation of ending the multi-screen display, stopping the transmission of the target content to the storage medium for storage, and closing the recording screen; Alternatively, stop playing the decoded content and close the playing screen.

4. The display device according to claim 3, wherein The operation types of the first operation and the second operation each include voice input or gesture input; wherein, when the operation type of the first operation is gesture input, the first operation is a first gesture that lasts for a first preset time and then changes to a second gesture; when the operation type of the second operation is gesture input, the second operation is a second gesture that lasts for a second preset time and then changes to the first gesture.

5. The display device according to claim 1, wherein The controller is further configured to: In response to a recording and playback operation on the recorded content stored in the storage medium, disconnecting the first channel and transmitting the recorded content stored in the storage medium to the decoder through a third channel; The recorded content is decoded by the decoder, and the corresponding decoded content is played in the recorded image.

6. The display device according to claim 1, wherein The controller is further configured to: In response to a switching operation on the screen size, the screen sizes of the playback screen and the recording screen are interchanged.

7. The display device according to claim 1, wherein The target content is the audio and video data or data from an external signal source.

8. A content recording method, characterized in that: Applicable to the display device according to any one of claims 1 to 7; The method comprises: In response to a first operation triggering multi-screen display, displaying at least two screens, the at least two screens including a playback screen when the first operation is triggered and a recording screen for recording target content; The audio and video data is transmitted to the decoder through the first channel, the audio and video data is decoded by the decoder, and the corresponding decoded content is played on the playback screen; The target content is transmitted to the storage medium through the second channel for storage, and corresponding recording prompt information is displayed in the recording screen.

9. The method according to claim 8, characterized in that The target content is the audio and video data; and the transferring the audio and video data to the storage medium for storage includes: For the audio played synchronously with the playback screen, when the audio waveform of the audio triggers the first recording condition or the picture content of the playback screen triggers the second recording condition, the audio and video data obtained based on the triggering moment of the triggering recording condition will be transmitted to the storage medium for storage.

10. The method according to claim 8, characterized in that The method further comprises: In response to the second operation of ending the multi-screen display, the target content is stopped from being transferred to the storage medium for storage, and the recording screen is closed; or, the decoding content is stopped from being played, and the playing screen is closed.

Images