Display device and program content recording method

Abstract

The invention provides a display device and a program content recording method. The method comprises the following steps: controlling an ultrasonic radar device to detect a target in a first area; in response to the fact that the ultrasonic radar device detects that the target number of the first area is reduced, first time when the target number is reduced is determined, and first program information of the currently played program is acquired; recording the first program content of the currently played program at the first time; in response to the fact that the ultrasonic radar device monitors that the number of the targets in the first area is increased, controlling the display to display a first pop-up window on the current display page; and in response to the selected first control, controlling the display to play the program content corresponding to the first control. Thus, the ultrasonic radar device detects the number of the targets and automatically triggers program recording, the convenience of program content recording is improved, and the recorded content is provided in the first pop-up window, so that a user can quickly position the watched program content, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of video recording technology, and in particular to a display device and a program content recording method. Background Art

[0002] Currently, when users watch multimedia resources or live broadcasts on display devices, they need to manually operate the player pause button when they need to leave for something so that they will not miss the program content when they come back to continue watching. Although manual operation can meet the needs of users to not miss the program content, it is very troublesome. In an emergency, users are prone to forget this operation step. When they come back to watch, they often cannot find the time they were watching at that time, so they spend more time and energy to find the clip that was playing when they left, which causes inconvenience to users. Summary of the invention

[0003] The present application provides a display device and a program content recording method, which can automatically record a program when it detects that the number of people in front of the display device has decreased, and record the time and program information in detail, and provide the user with selection in a pop-up window when the user returns, thereby improving the convenience of program content recording and allowing the user to quickly locate the program content to be watched, thereby improving the user experience.

[0004] In a first aspect, an embodiment of the present application provides a display device, including:

[0005] monitor;

[0006] an ultrasonic radar device, coupled to the display, configured to detect a target;

[0007] A controller is coupled to the display and the ultrasonic radar device and is configured to:

[0008] Controlling the ultrasonic radar device to detect a target in a first area; wherein the first area is an area where a target exists in front of the display device;

[0009] In response to the ultrasonic radar device detecting that the number of targets in the first area is reduced, determining a first time when the number of targets is reduced, and acquiring first program information of a currently playing program;

[0010] Record the first program content of the currently playing program at the first time;

[0011] In response to the ultrasonic radar device detecting an increase in the number of targets in the first area, controlling the display to display a first pop-up window on the current display page; wherein the first pop-up window includes a plurality of first controls, and the first control includes a first time and first program information corresponding to the first time;

[0012] In response to selecting the first control, the display is controlled to play the program content corresponding to the first control.

[0013] In the technical solution provided by the present application, the controller can automatically perform corresponding operations, such as pausing or resuming playback, based on the change in the number of targets detected by the ultrasonic radar in the first area. For example, when the number of targets increases, the display device automatically records the program content, and when the number of targets decreases, a first pop-up window is displayed on the display page for the user to select the program content they want to watch back. In this way, the convenience of recording program content can be improved, and users can quickly locate the program content to be watched, thereby improving the user experience.

[0014] In some feasible embodiments, the controller executes, in response to the ultrasonic radar device detecting that the number of targets in the first area is reduced, determining the first time when the number of targets is reduced, and acquiring the first program information of the currently playing program, which is specifically configured as follows:

[0015] When the ultrasonic radar device detects that the number of targets in the first area decreases, recording the first time when the number of targets decreases;

[0016] Get the first transport stream of the currently playing program;

[0017] First program information is determined according to the first transport stream.

[0018] According to the above embodiment, by recording the time when the number of targets decreases when the ultrasonic radar device detects that the number of targets in the first area decreases, and obtaining the first transmission stream of the currently playing program, and then determining the first program information, the time when the user leaves and the currently playing program information can be recorded in time, so that the user can continue watching from where he left when he returns, providing the function of breakpoint resumption, and improving user experience.

[0019] In some feasible embodiments, the controller acquires the first transport stream of the currently playing program and is configured as follows:

[0020] Receiving a first signal of a currently playing program; wherein the first signal is a baseband signal;

[0021] Demodulating the first signal to obtain a second signal, where the second signal is a digital signal;

[0022] A first transport stream is extracted from the second signal.

[0023] According to the above embodiment, by receiving the first signal of the currently playing program, demodulating to obtain the second signal, and extracting the first transmission stream from the second signal, the transmission stream can be effectively extracted from the first signal, thereby improving the efficiency and quality of signal processing and optimizing data transmission.

[0024] In some feasible embodiments, the controller determines the first program information according to the first transport stream, and is specifically configured as follows:

[0025] Parsing a data table of the first transport stream; wherein the data table at least includes a program mapping table, a network information table, a service description table, and an event information table;

[0026] Acquire basic stream data of a program according to a program mapping table, where the basic stream data at least includes video stream data and audio stream data;

[0027] Acquire network information of the first transport stream according to the network information table;

[0028] Acquire service information of the first transport stream according to the service description table;

[0029] Acquire program event information of the first transport stream according to the event information table; the program event information at least includes program start time, program end time, and program name;

[0030] Determine electronic program guide information according to the elementary stream data, network information, service information and program event information; the electronic program guide information at least includes program name, program start time and program content description;

[0031] The electronic program guide information is used as the first program information.

[0032] According to the above embodiment, by parsing the data tables in the TS stream, such as the program mapping table PMT, the network information table NIT, the service description table SDT, and the event information table EIT, and extracting relevant information therefrom to construct the electronic program guide information, the accuracy of the information can be improved, and by periodically parsing the data tables in the first transport stream, the automatic update of the first program information can be achieved, ensuring that the user obtains the latest program information.

[0033] In some feasible embodiments, the controller performs recording of the first program content of the currently playing program at the first time, and is specifically configured as follows:

[0034] Extracting a first audio data stream and a first video data stream from a first transport stream;

[0035] Storing the first audio data stream and the first video data stream in an on-chip cache;

[0036] Copying the first audio data stream and the first video data stream in the on-chip buffer to the external memory;

[0037] When the first audio data stream and the first video data stream meet a preset condition in the external memory, the first audio data stream and the first video data stream are stored in the hard disk.

[0038] According to the above embodiment, the audio data stream and the video data stream are extracted from the first transmission stream, and the data are first stored in the on-chip cache, which can quickly respond to data requests, reduce delays, and improve data processing efficiency. Furthermore, the data is stored in the on-chip cache and then copied to the external memory and hard disk, which can reduce the risk of data loss.

[0039] In some feasible embodiments, the controller executes, in response to selecting the first control, playing the program content corresponding to the first control, and is configured to:

[0040] In response to selecting the first control, determining in the hard disk a second transport stream of program content corresponding to the first control;

[0041] The program content is played according to the second transport stream.

[0042] According to the above embodiment, by responding to the user selecting the first control, determining the second transmission stream of the program content corresponding to the control in the hard disk, and playing the program content according to the second transmission stream, the user's viewing experience can be significantly improved, convenient playback and review functions can be provided, storage management can be optimized, and the interactivity and playback quality of the system can be enhanced.

[0043] In some feasible embodiments, the controller determines in the hard disk the program content corresponding to the first control, and is specifically configured as follows:

[0044] storing the second transport stream in an external memory;

[0045] Demultiplexing the second transport stream to obtain second audio stream data and second video stream data;

[0046] converting the second audio stream data and the second video stream data into packetized elementary stream data, and decoding the packetized elementary stream data;

[0047] The program content is determined based on the decoded audio data and video data.

[0048] According to the above embodiment, by storing the second transport stream in an external memory, demultiplexing it to obtain second audio stream data and second video stream data, then converting these data into packetized basic stream data and decoding them, and finally determining the program content based on the decoded audio data and video data, the computing burden of the controller can be reduced, the data processing efficiency can be improved, the transport stream can be effectively managed and processed, the efficiency and quality of data processing can be improved, and the utilization of storage resources can be optimized.

[0049] In some feasible embodiments, the controller is further configured to:

[0050] In response to the ultrasonic radar device detecting that there is no target in the first area, the currently playing program is paused.

[0051] According to the above embodiment, when it is detected that the number of targets in the first area is 0, the display device stops playing, and when there are targets in the first area, a first pop-up window pops up for the user to select the playback content.

[0052] In a second aspect, an embodiment of the present application provides a program content recording method, including:

[0053] Controlling the ultrasonic radar device to detect a target in a first area; wherein the first area is an area where a target exists in front of the display device;

[0054] In response to the ultrasonic radar device detecting that the number of targets in the first area is reduced, determining a first time when the number of targets is reduced, and acquiring first program information of a currently playing program;

[0055] Record the first program content of the currently playing program at the first time;

[0056] In response to the ultrasonic radar device detecting an increase in the number of targets in the first area, controlling the display to display a first pop-up window on the current display page; wherein the first pop-up window includes a plurality of first controls, and the first control includes a first time and first program information corresponding to the first time;

[0057] In response to selecting the first control, the display is controlled to play the program content corresponding to the first control.

[0058] In some feasible embodiments, in response to the ultrasonic radar device detecting that the number of targets in the first area is reduced, determining a first time when the number of targets is reduced, and acquiring first program information of a currently playing program include:

[0059] When the ultrasonic radar device detects that the number of targets in the first area decreases, recording the first time when the number of targets decreases;

[0060] Get the first transport stream of the currently playing program;

[0061] First program information is determined according to the first transport stream.

[0062] It can be understood that the beneficial effects that can be achieved by the technical solution provided by the second aspect provided above can refer to the beneficial effects in the first aspect and any optional implementation method thereof, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] In order to more clearly illustrate the technical solution of the present application, the drawings required for use in the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0064] Figure 1A schematic diagram of an operation scenario between a display device and a control device provided in an embodiment of the present application;

[0065] Figure 2 A hardware configuration block diagram of a display device provided in an embodiment of the present application;

[0066] Figure 3 A schematic diagram of software configuration of a display device provided in an embodiment of the present application;

[0067] Figure 4 A schematic diagram of a flow chart of a display device ultrasonic radar device detecting the number of targets to record and play a program provided in an embodiment of the present application;

[0068] Figure 5 A schematic diagram of a display device playing program content provided by an embodiment of the present application;

[0069] Figure 6 A schematic diagram of a process for obtaining first program information of a currently playing program at the first time when the target number is reduced, provided in an embodiment of the present application;

[0070] Figure 7 A schematic diagram of a display device recording program content provided in an embodiment of the present application;

[0071] Figure 8 A schematic diagram of displaying a first pop-up window on a display page provided in an embodiment of the present application;

[0072] Fig. 9 A schematic diagram of a display device playing back a program provided in an embodiment of the present application;

[0073] Fig.10 A flowchart for implementing program content recording based on an ultrasonic radar device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0074] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0075] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0076] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0077] The terms "including" and "having" and any variations thereof are intended to cover but not be exclusive, for example, a product or device comprising a series of components is not necessarily limited to all the components explicitly listed, but may include other components not explicitly listed or inherent to these products or devices. The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware and / or software code that is capable of performing the functions associated with the element.

[0078] The display device 200 provided in the embodiment of the present application generally refers to a device with image display and data processing capabilities, and can have various implementation forms, for example, it can be a television, a smart TV, a computer, a laser projection device, a display (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table), a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0079] Figure 1 Schematic diagram of an operation scenario between a display device 200 and a control device 100 provided in an embodiment of the present application. Figure 1 As shown, the user can operate the display device 200 through the terminal device 300 or the control device 100 .

[0080] In some embodiments, the control device 100 is used to receive operation instructions input by the user and convert the operation instructions into control instructions that the display device 200 can recognize and respond to. The control device 100 can be a remote control, a stylus, a handle, etc., wherein the communication between the remote control and the display device 200 includes infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, and the display device 200 is controlled wirelessly or wired. The user can input user instructions through buttons on the remote control, voice input, control panel input, etc. to control the display device 200.

[0081] In some embodiments, a terminal device 300 (such as a mobile terminal, a tablet computer, a computer, a laptop computer, etc.) can also be used as a control device to perform human-computer interaction between a user and the display device 200. The mobile terminal 300 can also be used as a communication device to establish a communication connection with the display device 200 and perform data interaction. The mobile terminal 300 can install the same software application as the display device 200, and then connect and communicate through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

[0082] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application program for controlling the display device 200 .

[0083] In some embodiments, the display device 200 may also be controlled in a manner other than the control device 100 and the terminal device 300, for example, the user's voice command control may be directly received through a module for acquiring voice commands configured inside the display device 200, or the user's voice command control may be received through a voice control device provided outside the display device 200. The display device 200 may also receive user control through touch or gestures.

[0084] In some embodiments, the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactions to the display device 200. The server 400 may be one cluster or multiple clusters, and may include one or more types of servers.

[0085] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.

[0086] Figure 2 Some embodiments of the present application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0087] like Figure 2 As shown, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0088] In some embodiments, the tuner-demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

[0089] In some embodiments, the communication device 220 is a component for communicating with an external device or server according to various communication protocol types. The display device 200 can be provided with a plurality of communication devices 220 according to the different communication modes supported. For example, when the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function. The communication device 220 may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish the sending and receiving of control signals and data signals with the external control device 100 or the server 400 through the communication device 220.

[0090] The communication device 220 can enable the display device 200 to communicate with the external device or server 400 by wireless or wired connection. Among them, the wired connection can connect the display device 200 with the external device through components such as data cables and interfaces. The wireless connection can connect the display device 200 with the external device through wireless signals or wireless networks. The display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0091] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0092] In some embodiments, the external device interface 240 may include, but is not limited to, any one or more of the following interfaces: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by the above multiple interfaces.

[0093] In some embodiments, the controller 250 controls the operation of the display device 200 and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 can perform operations related to the object selected by the user command.

[0094] In some embodiments, the controller 250 includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a random access memory (RAM), a read-only memory (ROM), a first interface to an nth interface for input / output, a communication bus, etc. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0095] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0096] In some embodiments, the user may input a user command in a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.

[0097] In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, and components of a menu control interface and a user control UI interface.

[0098] In some embodiments, the "user interface" is a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The commonly used form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an interface element such as an icon, window, control, etc. displayed on the display screen of an electronic device, where the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, and other visual interface elements.

[0099] In some embodiments, the display 260 may be a liquid crystal display, an OLED display, or a projection display, and may also be a projection device and a projection screen.

[0100] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or may be an external audio output device of the display device 200. In particular, for the external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0101] In some embodiments, the user interface may be used to receive a control signal from the control device 100 (eg, an infrared remote controller, etc.).

[0102] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface. For example, the operating system can directly control the display device to provide a user interface, or provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0103] In some embodiments, the hardware layer also includes a high-frequency head, a demultiplexing module, a hard disk, a decoder, a multiplexer, and a programmable interface module.

[0104] In some embodiments, a high frequency head (HFH) can receive high frequency signals from an antenna, satellite, or cable TV network. It usually includes an amplifier to increase the signal strength to ensure that the signal remains strong enough before being transmitted to the demodulator. The HFH may also have a frequency selection function to select a specific channel or frequency range.

[0105] In some embodiments, the demultiplexing module is used to separate different elementary streams from the transport stream, such as a video stream, an audio stream, a subtitle stream, etc. The different data streams can be distinguished according to the identifiers of the data packets in the transport stream. The demultiplexing module also includes some error detection and correction functions to ensure the integrity and accuracy of the separated data streams.

[0106] In some embodiments, the hard disk can be used to store large amounts of data, including recorded programs, downloaded content, and other user data. A persistent storage solution can be provided so that users can watch recorded programs at any time. The hard disk can also be used to cache real-time received data to improve the system's responsiveness and reliability.

[0107] In some embodiments, the decoder is used to decode the separated elementary stream from a compressed format into a playable format. The decoder can support multiple codec standards to adapt to different video and audio formats. The decoder may also include some image and audio processing functions to improve the playback quality.

[0108] In some embodiments, a multiplexer is used to switch between multiple input signal sources and select one signal as output. It can be a physical switch or an electronically controlled logic selector. The multiplexer enables the system to support multiple input sources and select one of them for processing as needed.

[0109] In some embodiments, the programmable interface module provides an interface with an external device or system, allowing programmable control. It may include a serial interface, a parallel interface, a USB interface, etc., for communicating with other devices. The programmable interface module allows the system to be configured and controlled by software, increasing the flexibility of the system.

[0110] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0111] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 3 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the system library layer and the kernel layer.

[0112] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0113] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access system resources and obtain system services during execution.

[0114] Figure 3 A schematic diagram of the software configuration of the display device 200 provided in an embodiment of the present application.

[0115] like Figure 3 As shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to the application package currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0116] In some embodiments, the activity manager is used to manage the life cycle of each application and the usual navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes, for example, reducing the display window, shaking the display, distorting the display, etc.

[0117] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0118] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 3 As shown, the kernel layer may be configured with hardware drivers, and the drivers included in the kernel layer may be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.) and power driver, etc.

[0119] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0120] Based on the above hardware framework and software framework, in some embodiments, the display device detects the number of targets in a specific area according to the ultrasonic radar device, and records the content of the currently playing program when the number of targets decreases, so that when the number of targets in the specific area increases, a pop-up window is provided for the user to select the corresponding control to continue playing the program.

[0121] Currently, when users watch programs on display devices, if they need to leave for something, they must manually press the pause button of the player so that they can continue watching without missing the program content when they come back. Although manual operation can meet the needs of users to not miss the program content, this operation method increases user operations, and users are likely to forget this operation step, resulting in difficulty in finding the clip that was playing when they left when they come back to continue watching. This situation not only consumes a lot of time and energy of users, but also affects the viewing experience because they miss wonderful moments.

[0122] In view of the above problems, Figure 4This is a flow chart of the ultrasonic radar device of the display device provided in the embodiment of the present application detecting the number of targets to record and play programs. Figure 4 As shown, some embodiments of the present application provide a display device 200, which includes: a display 260, a controller 250, and an ultrasonic radar device. The ultrasonic radar device is coupled to the display and configured to detect a target, and the controller 250 is coupled to the display 260 and the ultrasonic radar device and configured to perform the following program steps:

[0123] S100: Controlling the ultrasonic radar device to detect targets in a first area.

[0124] In some embodiments, the ultrasonic radar device can be set at different positions of the display device to detect the activities of the user in front of the display device. For example, the ultrasonic radar device can be set at the top center of the display device, or can be set at both sides of the display device, or at the bottom of the display device. This application does not limit the setting position of the ultrasonic radar device.

[0125] The ultrasonic radar device can detect targets in the first area by sending ultrasonic pulses. Here, the first area is the area in front of the display device where the target exists, and the target may be the user in front of the display device. The ultrasonic pulse emitted by the ultrasonic radar device will be reflected back when encountering an obstacle (such as a target). Here, the target may be the audience in front of the display device. When the receiver on the ultrasonic radar device receives the reflected ultrasonic pulse, it is determined that there is a target in the first area. Furthermore, the position, speed, direction and other information of the target are determined based on the time difference between the time of emitting the ultrasonic pulse and the time of receiving the ultrasonic pulse. In addition, the ultrasonic radar device can continuously emit and receive ultrasonic pulses to detect changes in the number of targets in the first area in real time.

[0126] In some embodiments, the ultrasonic radar device can distinguish and track multiple different reflection sources in the same scanning cycle based on multi-target resolution technology. When the target data in the first area increases, the number and pattern of ultrasonic pulse light signals received by the ultrasonic radar device will increase accordingly. The ultrasonic radar device can identify the newly added targets through signal processing algorithms, such as multi-target tracking algorithms, thereby determining that the number of targets has increased.

[0127] In some embodiments, the change in the number of targets can be determined by analyzing the change in the total energy of the echo signal. Exemplarily, the ultrasonic radar device can determine the number of targets in the first area based on the echo intensity and density analysis. Specifically, the intensity of the radar echo is related to the scattering cross-section of the target (i.e., the size of the target and the ability of the material to reflect radar waves). If the energy of the echo received by the ultrasonic radar increases significantly in the first area, it means that the number of targets in the first area increases. Correspondingly, if the received echo energy decreases, the number of targets in the first area decreases. In this way, by analyzing the change in the total energy of the echo signal, the change in the number of people can be indirectly inferred.

[0128] In some embodiments, the ultrasonic radar device may analyze the change in the number of targets in the first area according to the time series. For example, when the ultrasonic radar device scans continuously, the change in the number of targets may be analyzed by comparing the scan data at different time points. For example, if the newly appeared echo signal features match the known target reflection features in several consecutive scans, and these signals continue to exist in subsequent scans, it can be determined that the number of targets has increased. Correspondingly, if certain characteristic signals disappear in subsequent scans, it means that the number of targets has decreased.

[0129] In some embodiments, the ultrasonic radar device can also apply advanced signal processing technologies such as synthetic aperture radar, inverse synthetic aperture radar (ISAR), etc., which can provide higher resolution images and more sophisticated target recognition capabilities, helping to more accurately distinguish and count individuals, especially in complex environments.

[0130] That is, the ultrasonic radar device can determine the change in the number of targets in the first area by analyzing the intensity and timing changes of the echo signal and using advanced signal processing algorithms. It is understandable that the ultrasonic radar device can also use other methods to detect the change in the number of targets, and this application does not limit this.

[0131] S200: In response to the ultrasonic radar device detecting that the number of targets in the first area is reduced, determining a first time when the number of targets is reduced, and acquiring first program information of a currently playing program.

[0132] Figure 5 A schematic diagram of a display device playing program content provided in an embodiment of the present application.

[0133] In some embodiments, Figure 5As shown, when watching a program normally, the display device can receive signals from an antenna, satellite or cable TV through its tuner, and convert the received high-frequency signal into a low-frequency signal suitable for further processing. The demodulator can also be used to convert the analog signal of the low-frequency signal into a digital signal, and the demultiplexing module (demux) can be used to separate different data streams (such as video, audio, PSI / SI table, etc.) in the transport stream. At this stage, the demultiplexing module will parse the data table in the first transport stream and extract the selected program video and audio data from the data table. Then the extracted video data and audio data can be sent to the decoder through channel 1 for decoding, and played to the user through the display and audio output devices. The extracted video data and audio data can be sent to the hard disk through channel 3 for storage so that the user can watch it in time shift later.

[0134] When the user performs a time-shift operation such as pause, rewind or slow play, the display device switches to time-shift mode. At this time, channel 1 is cut off, and the extracted video data and audio data cannot be directly sent to the decoder for real-time playback. Channel 2 is enabled, so that the decoder reads the previously stored audio data and video data from the hard disk through channel 2 and decodes and outputs them. In this way, the user can pause, rewind or slow play the content that has been played before. Then, channel 3 continues to work, and the extracted audio and video data can still be written to the hard disk. This ensures that audio and video data can continue to be recorded in the time-shift state.

[0135] In this way, users can watch time-shifted content without affecting normal recording, thus improving the user experience. When the user decides to resume normal playback, the display device can read the latest stored data from the hard disk and seamlessly return to real-time playback.

[0136] In some embodiments, Figure 6 A schematic diagram of a process for obtaining the first program information of the currently playing program at the first time when the target number is reduced provided in an embodiment of the present application. Figure 6 As shown, the controller performs step S200 and may be configured to perform the following steps:

[0137] S201: When the ultrasonic radar device detects that the number of targets in the first area decreases, record the first time when the number of targets decreases.

[0138] Here, when the ultrasonic radar device detects that the number of targets decreases, such as the number of targets changes from 3 to 2, the first time at this time is determined.

[0139] S202: Acquire the first transport stream of the currently playing program.

[0140] In some embodiments, the controller may determine the currently playing program, and use a high-frequency head to receive the first signal of the currently playing program, that is, the baseband signal, where the baseband signal is obtained after the high-frequency signal is processed by the high-frequency head. Afterwards, a demodulator is used to convert the received baseband signal into a second signal, that is, a digital signal. Then, the first transport stream in the baseband signal may be extracted. Here, the high-frequency head may receive a high-frequency signal from an antenna, a satellite, or a cable TV, and convert the high-frequency signal into a baseband signal. The demodulator may convert an analog signal of the baseband signal into a digital signal.

[0141] In view of this, the controller executes acquisition of the first transmission stream of the currently playing program and can be configured as: receiving the first signal of the currently playing program; wherein the first signal is a baseband signal; demodulating the first signal to obtain a second signal, which is a digital signal; and extracting the first transmission stream from the second signal.

[0142] In this way, the first signal of the currently playing program can be received, demodulated to obtain the second signal, and the first transport stream can be extracted from the second signal. In this way, the efficiency and quality of signal processing can be improved and data transmission can be optimized.

[0143] S203: Determine first program information according to the first transport stream.

[0144] In some embodiments, the first program information may be the electronic program guide information of the program. The electronic program guide information may be obtained by parsing the data table in the first transport stream. Exemplarily, the relevant data table may be determined first, and the relevant data table may include a program map table (PMT), which is used in the first transport stream to describe all the elementary streams contained in the program. The network information table (NIT) provides information about the current transmission network, and the service description table (SDT) provides service description information, such as service name, service type, etc. The event information table (EIT) is divided into the current / next event information table (Event Information Table Present / Following, EIT[p / f]) and the program schedule event information table (Event Information Table Schedule, EIT[schedule]). EIT[p / f] includes information about the programs currently being played and to be played next, and EIT[schedule] provides program schedules for a period of time in the future.

[0145] Furthermore, the above data tables can be parsed to obtain corresponding information. Parsing the program mapping table can obtain the basic stream data of the program, which may include video stream data, audio stream data, and subtitle stream data, etc. Parsing the network information table can obtain the network information of the transport stream, which may include basic attributes of the network, such as network ID, transport stream ID, etc. Parsing the service description table can obtain the service information of the first transport stream; the service information may include service name, service type, etc. Parsing the event information table can obtain program event information, such as detailed information of the currently playing service and the service to be played in the future, including program name, start time, end time, etc. Further, the above basic stream data, network information, service information and program event information can be integrated to obtain electronic program guide information.

[0146] In view of this, the controller executing S203 can be configured to: parse the data table of the first transport stream; wherein the data table includes at least a program mapping table, a network information table, a service description table and an event information table; obtain basic stream data of the program according to the program mapping table, the basic stream data includes at least video stream data and audio stream data, etc.; obtain network information of the first transport stream according to the network information table; obtain service information of the first transport stream according to the service description table; obtain program event information of the first transport stream according to the event information table; the program event information includes at least program start time, program end time, and program name; determine the electronic program guide information according to the basic stream data, network information, service information and program event information; the electronic program guide information includes at least program name, program start time, and program content description; use the electronic program guide information as the first program information.

[0147] According to the above embodiment, by parsing the data tables in the TS stream such as the program mapping table PMT, the network information table NIT, the service description table SDT, and the event information table EIT, and extracting relevant information therefrom to construct the electronic program guide information, the accuracy of the information can be improved, and by regularly parsing the data tables in the first transport stream, the automatic update of the first program information can be achieved, ensuring that the user obtains the latest program information.

[0148] S300: Recording the first program content of the currently playing program at the first time.

[0149] Figure 7 A schematic diagram of a display device recording program content provided in an embodiment of the present application.

[0150] In some embodiments, Figure 7As shown, the first transmission stream can enter the programmable transmission interface module via a multiplexer. The programmable transmission interface module is a special microprocessor integrated in the main control chip, which can analyze, descramble and demultiplex the first transmission stream. The programmable transmission interface module includes an on-chip cache, which can exchange data with an external memory. Specifically, the data transmission speed can be accelerated by a direct memory access (DMA) mechanism. Further, the programmable transmission interface module extracts the first audio data stream and the first video data stream in the first transmission stream, and stores the first audio data stream and the first video data stream in the on-chip cache. When the first audio data stream and the first video data stream are received, the first audio data stream and the first video data stream in the on-chip cache are copied to the external memory. When the preset memory (e.g., 64KB) opened for hard disk reading and writing in the external memory is full, the first audio data stream and the first video data stream are written from the external memory to the hard disk, thereby recording the program content.

[0151] Furthermore, since the multiplexer has a multi-channel gating function, the programmable transmission interface unit has a multi-program gating function, and while recording a program, it can also be played back in real time, and it is possible to watch other programs while recording a program.

[0152] In view of this, in some embodiments, the controller executing S300 may be configured to: extract the first audio data stream and the first video data stream in the first transmission stream; store the first audio data stream and the first video data stream in the on-chip cache; copy the first audio data stream and the first video data stream in the on-chip cache to an external memory; when the first audio data stream and the first video data stream meet preset conditions in the external memory, store the first audio data stream and the first video data stream to the hard disk.

[0153] According to the above embodiment, the audio data stream and the video data stream are extracted from the first transmission stream, and the data are first stored in the on-chip cache, which can quickly respond to data requests, reduce delays, and improve data processing efficiency. Furthermore, the data is stored in the on-chip cache and then copied to the external memory and hard disk, which can reduce the risk of data loss.

[0154] S400: In response to the ultrasonic radar device detecting an increase in the number of targets in the first area, controlling the display to display a first pop-up window on the current display page.

[0155] In some embodiments, when the ultrasonic radar device detects an increase in the number of targets in the first area, that is, an increase in the number of viewers in front of the display device, the controller may display a first pop-up window on the current display page of the display, where the first pop-up window includes multiple first controls, and the first control includes a first time and a first program information corresponding to the first time.

[0156] That is to say, when the ultrasonic radar device detects an increase in the number of viewers in front of the display device, a first pop-up window is displayed on the current display page. The first pop-up window includes multiple first controls. Each first control includes a first time, that is, the time when the audience left, and the first program information of the program watched when the audience left.

[0157] Figure 8 A schematic diagram of displaying a first pop-up window on a display page provided in an embodiment of the present application. Figure 8 As shown, in order to ensure the simplicity of the first pop-up window, the number of first controls in the first pop-up window can be set to 3. However, in fact, the number of first controls can be limited according to actual needs, and the embodiment of the present application is only for illustration and does not limit this.

[0158] S500: In response to selecting a first control, controlling the display to play program content corresponding to the first control.

[0159] In some embodiments, the controller executing S500 may be configured to: in response to selecting the first control, determine in the hard disk a second transmission stream of the program content corresponding to the first control; and play the program content according to the second transmission stream.

[0160] Fig. 9 A schematic diagram of a display device playing back a program provided in an embodiment of the present application.

[0161] In some embodiments, Fig. 9 As shown, the user selects the first control in the first pop-up window through the remote control to determine the program to be played. After the program to be played is selected, the controller reads the second transmission stream of the program content corresponding to the first control in the hard disk, copies the second transmission stream in the hardware to the external memory, and passes the second transmission stream through the multi-channel selector, and connects to the programmable transmission interface module, so that the programmable transmission interface module performs demultiplexing and other operations on the second transmission stream. After that, the second transmission stream is demultiplexed to obtain the second audio stream data and the second video stream data, and the second audio stream data and the second video stream data are converted into a packet elementary stream data format, that is, a PES data stream, and the packet elementary stream data is decoded; the program content is determined according to the decoded audio data and video data. In view of this, the controller performs the determination of the program content corresponding to the first control in the hard disk, which can be configured as: storing the second transmission stream to the external memory; demultiplexing the second transmission stream to obtain the second audio stream data and the second video stream data; converting the second audio stream data and the second video stream data into packet elementary stream data, and decoding the packet elementary stream data; determining the program content according to the decoded audio data and video data.

[0162] According to the above embodiment, by storing the second transport stream in an external memory, demultiplexing it to obtain second audio stream data and second video stream data, then converting these data into packetized basic stream data and decoding them, and finally determining the program content based on the decoded audio data and video data, the computing burden of the controller can be reduced, the data processing efficiency can be improved, the transport stream can be effectively managed and processed, the efficiency and quality of data processing can be improved, and the utilization of storage resources can be optimized.

[0163] In some embodiments, the controller may also be configured to pause the currently playing program in response to the ultrasonic radar device detecting that there is no target in the first area. Thus, when the ultrasonic radar device detects that the number of targets in the first area is 0, if the currently playing program is a live program, the recorded content of the live program is played and the playback is paused. If the currently playing program is a on-demand program, the program is directly paused. Thus, when it is detected that the number of targets in the first area is 0, the display device stops playing, and when there is a target in the first area, a first pop-up window pops up for the user to select the content to play.

[0164] To summarize, in a first aspect, an embodiment of the present application provides a display device, comprising: a display; an ultrasonic radar device, coupled to the display and configured to detect targets; a controller, coupled to the display and the ultrasonic radar device, and configured to: control the ultrasonic radar device to detect targets in a first area; wherein the first area is an area where targets exist in front of the display device; in response to the ultrasonic radar device detecting a decrease in the number of targets in the first area, determining a first time when the number of targets decreases, and obtaining first program information of a currently playing program; recording the first program content of the currently playing program at a first time; in response to the ultrasonic radar device detecting an increase in the number of targets in the first area, controlling the display to display a first pop-up window on the currently displayed page; wherein the first pop-up window includes multiple first controls, and the first control includes a first time and first program information corresponding to the first time; in response to selecting the first control, playing the program content corresponding to the first control.

[0165] In this way, the controller can automatically perform corresponding operations based on the change in the number of targets in the first area detected by the ultrasonic radar, such as pausing or resuming playback. For example, when the number of targets increases, the display device automatically records the program content, and when the number of targets decreases, a first pop-up window is displayed on the display page for the user to select the program content they want to watch back. In this way, the convenience of recording program content can be improved, and users can quickly locate the program content they want to watch, thereby improving the user experience.

[0166] Fig.10 The flowchart of realizing program content recording based on the ultrasonic radar device provided in the embodiment of the present application is as follows: Fig.10As shown, the ultrasonic radar device detects targets in the first area. When the ultrasonic radar device detects that the number of targets in the first area decreases, the controller obtains the first time when the number of targets decreases, and controls the high-frequency head to obtain the first signal of the currently playing program. The high-frequency head converts the high-frequency signal of the program into a first signal, and sends the first signal to the demodulator. The demodulator demodulates the first signal into a second signal of a digital signal, and sends the second signal to the demultiplexing module. The demultiplexing module extracts the first transmission stream in the second signal, parses the data table in the first transmission stream, and determines the first program information of the program being played according to the information in the data table. At the same time, the demultiplexing module parses the first transmission stream to obtain the first video data and the first audio data therein. The recording module obtains the first video data, the first audio data and the first program information, and stores the above information in the hard disk of the storage module.

[0167] When the ultrasonic radar device detects that the number of targets in the first area is reduced to 0, the playback module is controlled to pause the currently playing program. If the program is a live program, the live mode needs to be switched to the playback mode and the playback needs to be paused.

[0168] When the ultrasonic radar device detects an increase in the number of targets in the first area, the controller searches for all second transmission streams in the hard disk, and the demultiplexing module parses the data table of the second transmission stream to obtain the corresponding first program information. Further, the demultiplexing module parses the second transmission stream to obtain the second audio data and the second video data. And returns the second audio data, the second video data and the program information to the controller. The controller displays the first control including the first time and the first program information corresponding to the first time on the current display page according to the program information, and when the user selects the first control, the playback module plays the second audio data and the second video data.

[0169] In a second aspect, the present application provides a program content recording method, comprising:

[0170] Controlling the ultrasonic radar device to detect a target in a first area; wherein the first area is an area in front of a display device where the target exists;

[0171] In response to the ultrasonic radar device detecting that the number of targets in the first area decreases, determining a first time when the number of targets decreases, and acquiring first program information of a currently playing program;

[0172] recording a first program content of the currently playing program at the first time;

[0173] In response to the ultrasonic radar device detecting an increase in the number of targets in the first area, controlling the display to display a first pop-up window on the current display page; wherein the first pop-up window includes a plurality of first controls, and the first controls include the first time and the first program information corresponding to the first time;

[0174] In response to selecting the first control, the display is controlled to play program content corresponding to the first control.

[0175] According to the above embodiment, corresponding operations such as pausing or resuming playback can be automatically performed based on the change in the number of targets in the first area detected by the ultrasonic radar. For example, when the number of targets increases, the display device automatically records the program content, and when the number of targets decreases, a first pop-up window is displayed on the display page for the user to select the program content they want to watch back. In this way, the convenience of recording program content can be improved, and the user can quickly locate the program content to be watched, thereby improving the user experience.

[0176] In some embodiments, in response to the ultrasonic radar device detecting a decrease in the number of targets in the first area, determining a first time when the number of targets decreases, and acquiring first program information of a currently playing program, include: when the ultrasonic radar device detects a decrease in the number of targets in the first area, recording the first time when the number of targets decreases; acquiring a first transmission stream of the currently playing program; and determining the first program information based on the first transmission stream.

[0177] According to the above embodiment, by recording the time when the number of targets decreases when the ultrasonic radar device detects that the number of targets in the first area decreases, and obtaining the first transmission stream of the currently playing program, and then determining the first program information, the time when the user leaves and the currently playing program information can be recorded in time, so that the user can continue watching from where he left when he returns, providing the function of breakpoint resumption, and improving user experience.

[0178] Similar parts between the embodiments provided in this application can be referenced to each other. The specific implementation methods provided above are only a few examples under the general concept of this application and do not constitute a limitation on the protection scope of this application. For those skilled in the art, any other implementation methods expanded based on the scheme of this application without creative work belong to the protection scope of this application.

Claims

1. A display device, characterized in that: include: monitor; an ultrasonic radar device, coupled to the display and configured to detect a target; A controller is coupled to the display and the ultrasonic radar device and is configured to: Controlling the ultrasonic radar device to detect a target in a first area; wherein the first area is an area in front of a display device where the target exists; In response to the ultrasonic radar device detecting that the number of targets in the first area decreases, determining a first time when the number of targets decreases, and acquiring first program information of a currently playing program; recording a first program content of the currently playing program at the first time; In response to the ultrasonic radar device detecting an increase in the number of targets in the first area, controlling the display to display a first pop-up window on the current display page; wherein the first pop-up window includes a plurality of first controls, and the first controls include the first time and the first program information corresponding to the first time; In response to selecting the first control, the display is controlled to play program content corresponding to the first control.

2. The display device according to claim 1, characterized in that The controller executes, in response to the ultrasonic radar device detecting that the number of targets in the first area is reduced, determining a first time when the number of targets is reduced, and acquiring first program information of a currently playing program, and is specifically configured as follows: When the ultrasonic radar device detects that the number of targets in the first area decreases, recording the first time when the number of targets decreases; Acquire a first transport stream of the currently playing program; The first program information is determined according to the first transport stream.

3. The display device according to claim 2, characterized in that The controller acquires the first transport stream data of the currently playing program and is configured to: Receiving a first signal of the currently playing program; wherein the first signal is a baseband signal; Demodulating the first signal to obtain a second signal, where the second signal is a digital signal; The first transport stream is extracted from the second signal.

4. The display device according to claim 2, characterized in that The controller determines the first program information according to the first transport stream, and is specifically configured to: Parsing a data table of the first transport stream; wherein the data table at least includes a program mapping table, a network information table, a service description table, and an event information table; Acquire basic stream data of the program according to the program mapping table, wherein the basic stream data at least includes video stream data and audio stream data; Acquire the network information of the first transport stream according to the network information table; Acquire service information of the first transport stream according to the service description table; Acquire program event information of the first transport stream according to the event information table; the program event information at least includes program start time, program end time, and program name; Determine electronic program guide information according to the elementary stream data, the network information, the service information and the program event information; the electronic program guide information at least includes a program name, a program start time and a program content description; The electronic program guide information is used as the first program information.

5. The display device according to claim 2, characterized in that The controller executes recording of the first program content of the currently playing program at the first time, and is specifically configured as follows: Extracting a first audio data stream and a first video data stream from the first transport stream; Storing the first audio data stream and the first video data stream in an on-chip cache; Copying the first audio data stream and the first video data stream in the on-chip buffer to an external memory; When the first audio data stream and the first video data stream meet a preset condition in the external memory, the first audio data stream and the first video data stream are stored in a hard disk.

6. The display device according to claim 5, characterized in that The controller plays the program content corresponding to the first control in response to selecting the first control, and is configured to: In response to selecting the first control, determining in the hard disk a second transport stream of the program content corresponding to the first control; The program content is played according to the second transport stream.

7. The display device according to claim 6, characterized in that The controller determines in the hard disk the program content corresponding to the first control, and is specifically configured as follows: storing the second transport stream in an external memory; Demultiplexing the second transport stream to obtain second audio stream data and second video stream data; Convert the second audio stream data and the second video stream data into packetized elementary stream data, and decode the packetized elementary stream data; The program content is determined based on the decoded audio data and video data.

8. The display device according to claim 1, characterized in that The controller is also configured to: In response to the ultrasonic radar device detecting that there is no target in the first area, pausing the currently playing program.

9. A method for recording program content, characterized in that: include: Controlling the ultrasonic radar device to detect a target in a first area; wherein the first area is an area in front of the display device where the target exists; In response to the ultrasonic radar device detecting that the number of targets in the first area decreases, determining a first time when the number of targets decreases, and acquiring first program information of a currently playing program; recording a first program content of the currently playing program at the first time; In response to the ultrasonic radar device detecting an increase in the number of targets in the first area, controlling the display to display a first pop-up window on the current display page; wherein the first pop-up window includes a plurality of first controls, and the first controls include the first time and the first program information corresponding to the first time; In response to selecting the first control, the display is controlled to play program content corresponding to the first control.

10. The method according to claim 9, characterized in that In response to the ultrasonic radar device detecting that the number of targets in the first area is reduced, determining a first time when the number of targets is reduced, and acquiring first program information of a currently playing program, comprises: When the ultrasonic radar device detects that the number of targets in the first area decreases, recording the first time when the number of targets decreases; Acquire a first transport stream of the currently playing program; The first program information is determined according to the first transport stream.

Images