Display device and display method

Abstract

The application provides a display device and a display method. The display device comprises a first display screen, a second display screen and a controller. In response to an incoming call request, the display device detects a media category displayed in a first user interface. In response to the media category being a video picture, the display device controls the second display screen to display an incoming call reminder picture corresponding to the incoming call request in a second user interface. The incoming call reminder picture comprises an operation control for indicating an operation of answering the incoming call request and an operation control for rejecting the incoming call request. In this way, when the first display screen is playing a video picture, after receiving an incoming call request, an incoming call reminder picture can be displayed on the second display screen, so that the video picture displayed by the first display screen is not blocked, and user experience is improved.

Description

[0001] This application claims priority to Chinese Patent Application No. 2019110673655, filed on November 4, 2019, entitled “Display Device, Display Method and Computing Device”, the entire contents of which are incorporated herein by reference.

[0002] This application is a divisional application of application number 202010327361.2, application date 2020-04-23, and application title "Display device and display method". Technical Field

[0003] This invention relates to intelligent display device technology, and more particularly to a display device and display method. Background Technology

[0004] With the continuous development of television and internet technologies, internet-based smart TVs have emerged. Smart TVs, based on internet technology, possess open operating systems and chips, and have open application platforms, supporting various functions such as audio-visual entertainment and data access, thereby meeting diverse user needs and bringing a brand-new user experience. In terms of user interaction, smart TVs support voice interaction, allowing users to control the TV via voice commands.

[0005] In existing technology, smart TVs include a display screen. All information that a smart TV needs to show to the user is displayed on this screen. For example, when a smart TV is playing a video, if pop-ups or notifications need to be displayed, this information will inevitably obscure the main screen. This will affect the user's normal video viewing experience, resulting in a poor user experience. Summary of the Invention

[0006] This application provides a display device and a display method, the technical solution of which is as follows.

[0007] This application provides a display device, including: a first display screen, a second display screen, and a controller.

[0008] The controller is configured to receive an incoming call request and display an incoming call reminder screen on the second display screen while the first display screen is displaying a video image.

[0009] In some embodiments, after receiving an incoming call request while the first display screen is displaying a video feed, and after displaying an incoming call reminder screen on the second display screen, the controller is further configured to:

[0010] In response to the user's input of a tab for the request to connect the incoming call, the second display screen is controlled to display a chat screen.

[0011] In some embodiments, the controller is further configured to:

[0012] In response to the user's selection of the chat screen, the chat screen is switched from the second display screen to the first display screen.

[0013] In some embodiments, after receiving an incoming call request while the first display screen is displaying a video feed, and after displaying an incoming call reminder screen on the second display screen, the controller is further configured to:

[0014] In response to the user's input of a tab for the request to connect the incoming call, the first display screen is controlled to display a chat screen.

[0015] In some embodiments, the controller is further configured to:

[0016] In response to a user's input indicating a video call in a pop-up window, the video call screen is displayed on the second display screen.

[0017] In some embodiments, the controller is further configured to:

[0018] In response to a user's input of a pop-up video call instruction, the pop-up video call screen is displayed in the target area of ​​the first display screen.

[0019] In some embodiments, the controller includes a first controller and a second controller. The first controller is configured to: receive an incoming call request while the first display screen is displaying a video image, and in response to the incoming call request, send a message to the...

[0020] The second controller sends an incoming call indication; the second controller is configured to receive the incoming call indication and, in response to the incoming call indication, display an incoming call reminder screen on the second display screen.

[0021] In some embodiments, the second controller is configured to:

[0022] The system receives a user's input instruction to answer a video call, and in response to the instruction, sends a video call instruction to the first controller and closes the incoming call notification screen.

[0023] The first controller is configured as follows:

[0024] In response to the video call instruction, the video call screen is displayed on the first display screen.

[0025] In some embodiments, the first controller is configured to:

[0026] The system receives a user-inputted pop-up video call instruction, and in response to the pop-up video call instruction, closes the video call screen and sends the pop-up video call instruction to the second controller.

[0027] The second controller is configured as follows:

[0028] In response to the pop-up video call instruction, the pop-up video call screen is displayed on the second display screen.

[0029] In some embodiments, the first controller is configured to:

[0030] The system receives a user-inputted instruction for a video call in a small window, and in response to the instruction, closes the video call screen and displays the video call screen in a target area of ​​the first display screen.

[0031] In some embodiments, the first controller is configured to:

[0032] The video image is displayed on the first display screen.

[0033] This application also provides a display method, including:

[0034] The controller receives incoming call requests while the video is displayed on the first screen.

[0035] In response to the incoming call request, the controller displays an incoming call reminder screen on the second display screen.

[0036] In some embodiments, the method further includes:

[0037] After displaying the incoming call reminder screen on the second display screen, in response to the user's input to connect the call...

[0038] The incoming call request tab controls how the chat screen appears on the second display.

[0039] In some embodiments, the method further includes:

[0040] In response to the user's selection of the chat screen, the chat screen is switched from the second display screen to the first display screen.

[0041] In some embodiments, the method further includes:

[0042] After the incoming call notification screen is displayed on the second display screen, in response to the user's input of a tab for the request to connect the incoming call, the first display screen is controlled to display a chat screen.

[0043] In some embodiments, the method further includes:

[0044] In response to a user's input indicating a video call in a pop-up window, the video call screen is displayed on the second display screen.

[0045] In some embodiments, the method further includes:

[0046] In response to a user's input of a pop-up video call instruction, the pop-up video call screen is displayed in the target area of ​​the first display screen.

[0047] In some embodiments, the controller includes a first controller and a second controller.

[0048] The controller receives incoming call requests while the first display screen shows a video feed, including:

[0049] The first controller receives the incoming call request while the video is displayed on the first screen.

[0050] In response to the incoming call request, the controller displays an incoming call reminder screen on the second display screen, including:

[0051] In response to the incoming call request, the first controller sends an incoming call indication to the second controller; the second controller receives the incoming call indication and, in response to the incoming call indication, displays an incoming call reminder screen on the second display screen.

[0052] In some embodiments, the method includes:

[0053] The second controller receives a user's input instruction to answer a video call, and in response to the instruction, sends a video call instruction to the first controller and closes the incoming call notification screen.

[0054] The first controller receives the video call instruction and, in response to the video call instruction, displays the video call screen on the first display screen.

[0055] In some embodiments, the method further includes:

[0056] The first controller receives a user-inputted pop-up video call instruction; in response to the pop-up video call instruction, it closes the video call screen and sends a pop-up video call instruction to the second controller, which in turn displays the pop-up video call screen on the second display screen.

[0057] In some embodiments, the method further includes:

[0058] The first controller receives a user-inputted pop-up video call instruction; in response to the pop-up video call instruction, it closes the video call screen and displays the pop-up video call screen in the target area of ​​the first display screen.

[0059] In some embodiments, after closing the video call screen, the method further includes:

[0060] The first controller displays the video feed on the first display screen.

[0061] This application embodiment also provides a computing device, including:

[0062] Memory, used to store program instructions;

[0063] A processor is configured to invoke program instructions stored in the memory and execute the method described in the second aspect above according to the obtained program.

[0064] The display device and display method provided in this application embodiment, when the controller receives an incoming call request while the first display screen is playing a video, displays an incoming call reminder screen on the second display screen, thereby ensuring that the video screen being displayed on the first display screen is not obstructed, greatly improving the user experience. Attached Figure Description

[0065] To more clearly illustrate the technical solutions in this invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0066] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in an exemplary embodiment of the present invention;

[0067] Figure 2 This is a configuration block diagram of the control device 100 provided in an exemplary embodiment of the present invention;

[0068] Figure 3a This is a schematic diagram of the hardware structure of a hardware system in a display device 200 provided in an exemplary embodiment of this application;

[0069] Figure 3b This is a schematic diagram of the hardware structure of a hardware system in another display device 200 provided in an exemplary embodiment of this application;

[0070] Figure 4 This is a schematic diagram illustrating the connection relationship between the power board and the load in the display device 200 provided in an exemplary embodiment of the present invention;

[0071] Figure 5 According to an exemplary embodiment of the present invention Figure 3a , Figure 3b The diagram shows the hardware architecture of display device 200;

[0072] Figure 6 This is a functional configuration diagram of a display device provided in an exemplary embodiment of the present invention;

[0073] Figure 7 This is a configuration block diagram of the software system in the display device 200 provided in an exemplary embodiment of the present invention;

[0074] Figure 8 This is a schematic diagram of the application layer of a display device provided in an exemplary embodiment of the present invention;

[0075] Figure 9 This is a schematic diagram of the user interface in the display device 200 provided in an exemplary embodiment of the present invention;

[0076] Figures 10-12 An exemplary illustration shows a user interface interacting with a user in a display device 200 according to an exemplary embodiment;

[0077] Figures 13-15 An exemplary illustration shows a user interface interacting with a user in a display device 200 according to an exemplary embodiment;

[0078] Figure 16 This is a schematic diagram illustrating the interaction process between the first controller and the second controller.

[0079] Figure 17 An exemplary illustration shows a user interface interacting with a user in a display device 200 according to an exemplary embodiment;

[0080] Figure 18 An exemplary illustration shows a user interface interacting with a user in a display device 200 according to an exemplary embodiment;

[0081] Figure 19 This is a schematic diagram illustrating the interaction process between the first controller and the second controller.

[0082] Figure 20 An exemplary illustration shows a user interface interacting with a user in a display device 200 according to an exemplary embodiment;

[0083] Figure 21 An exemplary illustration shows a user interface interacting with a user in a display device 200 according to an exemplary embodiment;

[0084] Figure 22 This is a flowchart illustrating the display method provided in an embodiment of this application. Detailed Implementation

[0085] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0086] The terms "first," "second," etc., used in the specification, claims, and drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.

[0087] This application mainly targets display devices with a dual-system, dual-display structure, namely, audio-visual synchronization processing of display devices with a first controller (first hardware system), a second controller (second hardware system), a first display screen, and a second display screen. The structure, function, and implementation of the display device with the dual-system hardware structure will be described in detail below.

[0088] To facilitate user operation, display devices typically include various external device interfaces to connect different peripheral devices or cables for corresponding functions. However, if a high-resolution camera is connected to one of these interfaces, and the display device's hardware system lacks a hardware interface for receiving the high-resolution camera's data, then the data received by the camera will not be displayed on the screen.

[0089] Furthermore, due to hardware limitations, traditional display devices only support one hardware decoding resource and typically can only support video decoding at a maximum resolution of 4K. Therefore, when watching online TV while video chatting, in order to avoid reducing the clarity of the online video, hardware decoding resources (usually the GPU in the hardware system) are needed to decode the online video. In this case, the only option is to use the general-purpose processor (such as the CPU) in the hardware system to perform software decoding of the video chat screen.

[0090] Using software decoding to process video chat footage significantly increases the CPU's data processing load. When the CPU's data processing load is too heavy, issues such as screen stuttering or choppy playback may occur. In some embodiments, due to limitations in CPU data processing capabilities, multi-channel video calls are typically not possible when using CPU software decoding to process video chat footage. When a user wants to simultaneously video chat with multiple other users in the same chat scenario, access may be blocked.

[0091] Based on the above considerations, and to overcome the aforementioned shortcomings, this application discloses a dual hardware system architecture to realize multi-channel video chat data (at least one local video channel).

[0092] The concepts involved in this application will first be explained with reference to the accompanying drawings. It should be noted that the following explanation of each concept is only to make the content of this application easier to understand and does not imply any limitation on the scope of protection of this application.

[0093] The term "module" as used in the embodiments of this application can refer to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code capable of performing the functions associated with that element.

[0094] The term "remote control" as used in the embodiments of this application refers to a component of an electronic device (such as the display device disclosed in this application) that can wirelessly control the electronic device over a relatively short distance. This component typically connects to the electronic device using infrared and / or radio frequency (RF) signals and / or Bluetooth, and may also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example, a handheld touch remote control replaces most of the physical built-in hardware in a typical remote control device with a user interface on a touchscreen.

[0095] The term "gesture" as used in the embodiments of this application refers to user behavior in which a user expresses an expected idea, action, purpose, and / or result through a change in hand shape or hand movement.

[0096] The term "hardware system" as used in the embodiments of this application can refer to a physical component with computing, control, storage, input, and output functions, composed of mechanical, optical, electrical, and magnetic devices such as integrated circuits (ICs) and printed circuit boards (PCBs). In the embodiments of this application, the hardware system is also commonly referred to as a motherboard or chip.

[0097] Figure 1 The diagram illustrates an operational scenario between a display device and a control device according to an embodiment. Figure 1 As shown, the user can operate the display device 200 through the control device 100.

[0098] The control device 100 can be a remote control 100A, which can communicate with the display device 200 via infrared, Bluetooth, ZigBee, or other short-range communication methods to control the display device 200 wirelessly or via wired means. Users can input commands through buttons, voice input, and control panel input on the remote control 100A to control the display device 200. For example, users can input corresponding control commands through the volume up / down buttons, channel control buttons, up / down / left / right movement buttons, voice input buttons, menu buttons, and power buttons on the remote control 100A to control the display device 200.

[0099] The control device 100 can also be a smart device, such as a mobile terminal 100B, tablet computer, computer, laptop computer, etc., which can communicate with the display device 200 via a local area network (LAN), wide area network (WAN), wireless local area network (WLAN), or other networks, and control the display device 200 through an application corresponding to the display device 200. For example, the display device 200 can be controlled using an application running on the smart device. This application can provide the user with various controls through an intuitive user interface (UI) on the screen associated with the smart device.

[0100] For example, both the mobile terminal 100B and the display device 200 can install software applications, enabling them to connect and communicate via network communication protocols, thereby achieving one-to-one control operations and data communication. For instance, the mobile terminal 100B and the display device 200 can establish a control command protocol, synchronizing the remote control keyboard to the mobile terminal 100B. By controlling the user interface on the mobile terminal 100B, the display device 200 can be controlled. Alternatively, audio and video content displayed on the mobile terminal 100B can be transmitted to the display device 200 for synchronized display.

[0101] like Figure 1 As shown, the display device 200 can also communicate with the server 300 via various communication methods. In various embodiments of this application, the display device 200 can establish wired or wireless communication connections with the server 300 via a local area network, wireless local area network, or other networks. The server 300 can provide the display device 200 with various content and interactive features.

[0102] For example, display device 200 interacts by sending and receiving information, as well as with an Electronic Program Guide (EPG), receiving software updates, or accessing a remotely stored digital media library. Server 300 can be a group or multiple groups, and can be one or more types of servers. Other network services, such as video-on-demand and advertising services, are provided through server 300.

[0103] The display device 200 includes a first display screen 201 and a second display screen 202, wherein the first display screen 201 and the second display screen 202 are independent of each other, and a dual hardware control system is adopted between the first display screen 201 and the second display screen 202.

[0104] The first display screen 201 and the second display screen 202 can be used to display different screen images. For example, the first display screen 201 can be used to display images of traditional television programs, while the second display screen 202 can be used to display images of notification messages, voice assistants, and other auxiliary information.

[0105] In some embodiments, the content displayed on the first display screen 201 and the content displayed on the second display screen 202 can be independent of each other and do not affect each other. For example, when the first display screen 201 is playing a television program, the second display screen 202 can display information unrelated to the television program, such as time, weather, temperature, and reminder messages.

[0106] In some embodiments, there may be a correlation between the content displayed on the first display screen 201 and the content displayed on the second display screen 202. For example, when the first display screen 201 is playing the main screen of a video chat, the second display screen 202 may display information such as the avatar of the user currently connected to the video chat and the chat duration.

[0107] In some embodiments, some or all of the content displayed on the second display screen 202 can be adjusted to be displayed on the first display screen 201. For example, information such as time, weather, temperature, and reminder messages displayed on the first display screen 201 can be adjusted to be displayed on the first display screen 201, while other information is displayed on the second display screen 202.

[0108] In addition, the first display screen 201 displays both traditional television program footage and interactive multi-party screens simultaneously, without obscuring the traditional television program footage. This application does not limit the display method of the traditional television program footage and the interactive multi-party screens. For example, this application can set the position and size of the traditional television program footage and the interactive multi-party screens according to their priority.

[0109] Taking the example that the traditional TV program screen has a higher priority than the multi-party interactive screen, the area of ​​the traditional TV program screen is larger than the area of ​​the multi-party interactive screen, and the multi-party interactive screen can be located on one side of the traditional TV program screen or it can be floating in one corner of the multi-party interactive screen.

[0110] The display device 200 can be, in one sense, a liquid crystal display (LCD), an OLED (Organic Light Emitting Diode) display, or a projection display device; in another sense, it can be a smart TV or a display system consisting of a monitor and a set-top box. The specific type, size, and resolution of the display device are not limited, but those skilled in the art will understand that the display device 200 can be modified in terms of performance and configuration as needed.

[0111] In addition to providing broadcast television reception functionality, display device 200 may also include smart network television functionality that provides computer support. Examples include IPTV, smart TV, Internet Protocol TV (IPTV), etc. In some embodiments, the display device may not have broadcast television reception functionality.

[0112] like Figure 1 As shown, a camera can be connected to or installed on the display device 200 to display the images captured by the camera on the display interface of this display device or other display devices, thereby enabling interactive chat between users. Specifically, the images captured by the camera can be displayed in full screen, half screen, or any selectable area on the display device.

[0113] In some embodiments, the camera is connected to the rear shell of the display device via a connecting plate and is fixedly installed on the upper center of the rear shell of the display device. As an installable method, it can be fixedly installed at any position on the rear shell of the display device, as long as its image acquisition area is not blocked by the rear shell. For example, the image acquisition area is oriented in the same direction as the display device.

[0114] As another connection method in some embodiments, the camera can be raised and lowered to the rear shell of the display device via a connecting plate or other conceivable connector. The connector is equipped with a lifting motor. When the user wants to use the camera or an application needs to use the camera, it is raised above the display device. When the camera is not needed, it can be embedded back into the rear shell to protect the camera from damage and protect the user's privacy.

[0115] As one embodiment, the camera used in this application can be 16 megapixels to achieve ultra-high-definition display. In practical use, cameras with higher or lower resolutions than 16 megapixels can also be used.

[0116] When a camera is installed on a display device, the content displayed in different application scenarios can be integrated in various ways, thereby achieving functions that traditional display devices cannot achieve.

[0117] For example, a user can watch a video program while simultaneously engaging in a video chat with at least one other user. The video program can serve as a background image, with the video chat window displayed on top of it. This feature can be figuratively described as "watch and chat simultaneously."

[0118] In some embodiments, in a “watch and chat” scenario, at least one video chat can be conducted across devices while watching live or online videos.

[0119] In another example, a user can video chat with at least one other user while learning through an educational app. For instance, a student can remotely interact with a teacher while studying content within an educational application. This feature could be figuratively called "learn while chatting."

[0120] In another example, a user can video chat with other players while playing a card game. For instance, players can remotely interact with each other while participating in a game within the app. This feature could be figuratively called "watch and play."

[0121] In some embodiments, the game scene and video footage are merged, and the portraits in the video footage are cut out and displayed in the game screen to improve the user experience.

[0122] In some embodiments, in motion-sensing games (such as ball games, boxing games, running games, dancing games, etc.), human postures and movements are acquired through cameras, limb detection and tracking, and detection of key points of the human skeleton are performed. These data are then integrated with the animations in the game to realize games in scenarios such as sports and dance.

[0123] In another example, a user can interact with at least one other user via video and voice in a karaoke app. This feature could be figuratively called "sing-while-watching." In some embodiments, multiple users can collaboratively record a song when at least one user enters the app within a chat context.

[0124] In another example, users can open their local camera to capture images and videos; figuratively, this function could be called "looking in a mirror."

[0125] In other examples, more functions may be added or the aforementioned functions may be removed. This application does not specifically limit the functions of the display device.

[0126] Figure 2The diagram illustrates a configuration block diagram of the control device 100 according to an exemplary embodiment. Figure 2 As shown, the control device 100 includes a controller 110, a communicator 130, a user input / output interface 140, a memory 190, and a power supply 180.

[0127] The control device 100 is configured to control the display device 200 and to receive user input commands, converting the commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200. For example, if the user operates the channel up / down keys on the control device 100, the display device 200 will respond with the channel up / down operation.

[0128] In some embodiments, the control device 100 may be a smart device. For example, the control device 100 may be equipped with various applications to control the display device 200 according to user needs.

[0129] In some embodiments, such as Figure 1 As shown, the mobile terminal 100B or other smart electronic devices can perform similar functions to the control device 100 after installing the application on the control display device 200. For example, users can install the application and use the various function keys or virtual buttons on the graphical user interface provided on the mobile terminal 100B or other smart electronic devices to achieve the functions of the physical buttons on the control device 100.

[0130] The controller 110 includes a processor 112, RAM 113 and ROM 114, a communication interface, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the communication and cooperation between internal components and the external and internal data processing functions.

[0131] Under the control of the controller 110, the communicator 130 enables communication of control signals and data signals with the display device 200. For example, it sends received user input signals to the display device 200. The communicator 130 may include at least one of the following communication modules: WIFI module 131, Bluetooth module 132, NFC module 133, etc.

[0132] User input / output interface 140, wherein the input interface includes at least one of the following: microphone 141, touchpad 142, sensor 143, button 144, camera 145, etc. For example, the user can realize the user command input function through voice, touch, gesture, pressing and other actions. The input interface converts the received analog signal into a digital signal, and the digital signal into a corresponding command signal, and sends it to the display device 200.

[0133] The output interface includes an interface for sending received user commands to the display device 200. In some embodiments, this can be an infrared interface or a radio frequency (RF) interface. For example, with an infrared signal interface, the user input command needs to be converted into an infrared control signal according to an infrared control protocol, and then sent to the display device 200 via an infrared transmitting module. Similarly, with an RF signal interface, the user input command needs to be converted into a digital signal, then modulated according to an RF control signal modulation protocol, and finally sent to the display device 200 via an RF transmitting terminal.

[0134] In some embodiments, the control device 100 includes at least one of a communicator 130 and an output interface. The communicator 130 in the control device 100 is configured with modules such as WIFI, Bluetooth, and NFC, which can encode user input commands via WIFI, Bluetooth, or NFC protocols and send them to the display device 200.

[0135] The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller 110. The memory 190 can also store various control signal commands input by the user.

[0136] The power supply 180 provides power to the electrical components of the control device 100 under the control of the controller 110. The power supply 180 can be powered by a battery and related control circuitry.

[0137] In some embodiments, Figure 3a The image below illustrates a schematic diagram of the hardware structure of a hardware system in a display device 200 according to an exemplary embodiment. For ease of explanation, Figure 3a The display device 200 is illustrated using an LCD monitor as an example.

[0138] Figure 3a As shown, the display device 200 may include: a first panel 11, a first backlight assembly 12, a first rear shell 13, a first controller 14, a second controller 15, a first display driving circuit 16, a second panel 21, a second backlight assembly 22, a second rear shell 23, a second display driving circuit 24, and a power supply assembly 30. Additionally, in some embodiments, the display device 200 may further include:

[0139] A base or hanging bracket. For ease of explanation... Figure 3a The display device 200 is illustrated with an example including a base 41, which is used to support the display device 200. It is worth noting that only one type of base design is shown in the figure, and those skilled in the art can design different types of bases according to product requirements.

[0140] The first panel 11 is used to display the image from the first display screen 201 to the user. In some embodiments, the first panel 11 can be a liquid crystal panel. For example, the liquid crystal panel may include, from top to bottom: a horizontal polarizing plate, a color filter, a liquid crystal layer, a thin-film transistor (TFT), a vertical polarizing plate, a light guide plate, and a printed circuit board (PCB). The PCB is provided with driving circuits such as a gate driving circuit and a source driving circuit. The gate driving circuit is connected to the gate of the TFT via a scan line, and the source driving circuit is connected to the drain of the TFT via a data line.

[0141] The first backlight assembly 12 is located below the first panel 11 and typically consists of optical components used to provide sufficient brightness and a uniformly distributed light source so that the first panel 11 can display images normally. The first backlight assembly 12 also includes a first backplate (not shown in the figure).

[0142] The first rear cover 13 is placed on the first panel 11 to jointly conceal the components of the display device 200, such as the first backlight assembly 12, the first controller 14, the second controller 15, the first display driving circuit 16, and the power supply assembly 30, thus achieving an aesthetic effect.

[0143] The first controller 14, the second controller 15, the first display driving circuit 16, and the power supply assembly 30 are disposed on the first back plate, which is typically stamped with raised structures. The first controller 14, the second controller 15, the first display driving circuit 16, and the power supply assembly 30 are fixed to the raised structures by screws or hooks.

[0144] In some embodiments, the first controller 14, the second controller 15, the first display driver circuit 16, and the power supply component 30 can be disposed on the same board or on different boards. For example, the first controller 14 can be disposed on the motherboard, the second controller 15 on the interaction board, the first display driver circuit 16 on the first display driver board, and the power supply component 30 on the power supply board. Alternatively, they can be disposed on different boards in combination or on the same board as the first backlight component 12. The specific configuration can be made according to actual needs, and this application does not limit this.

[0145] For ease of explanation, Figure 3a The first controller 14, the second controller 15, the first display driver circuit 16, and the power supply assembly 30 are all mounted on a single board for illustrative purposes.

[0146] The main function of the first display driving circuit 16 is to perform thousand-level backlight zone control through the backlight driving signals, such as PWM signals and Local dimming signals, transmitted by the first controller 14. This control is based on changes in image content. After establishing a handshake with the first controller 14, it receives the VbyOne display signal sent by the first controller 14 and converts the VbyOne display signal into an LVDS signal to realize the image display of the first display screen 201.

[0147] The second panel 21 is used to display the image from the second display screen 202 to the user. In some embodiments, the second panel 21 may be a liquid crystal panel, and its specific structure can be found in the foregoing description, which will not be repeated here.

[0148] The second backlight assembly 22 is located below the second panel 12 and typically consists of optical components used to provide sufficient brightness and a uniformly distributed light source, enabling the second panel 12 to display images normally. The second backlight assembly 22 also includes a second backplate (not shown in the figure).

[0149] The second rear cover 23 is placed on the second panel 21 to jointly conceal the components of the display device 200, such as the second backlight assembly 22 and the second display driving circuit 24, thus achieving an aesthetic effect.

[0150] The second display driving circuit 24 is disposed on the second back plate, and is typically formed by stamping protrusions on the second back plate. The second display driving circuit 24 is fixed to the protrusions by screws or hooks. The second display driving circuit 24 can be disposed on a separate board, such as the second display driving board, or it can be disposed on the same board as the second backlight assembly 22. The specific arrangement can be determined according to actual needs, and this application does not limit it in this regard. For ease of explanation, Figure 3a The second display driver circuit 24 is set on a separate board for example.

[0151] In some embodiments, Figure 3a The device also includes a keypad, which can be mounted on either the first back panel or the second back panel; this application does not limit the mounting location. The keypad is equipped with multiple keys and key circuits, enabling the first controller 14 or the second controller 15 to receive key signals from the keypad and to send control signals to it.

[0152] In addition, the display device 200 also includes a sound reproduction device (not shown in the figure), such as an audio component, including an I2S interface with a power amplifier (AMP) and a speaker, for sound reproduction. Typically, the audio component can output at least two channels of sound; to achieve a surround sound effect, multiple audio components are needed to output multiple channels of sound, which will not be discussed in detail here.

[0153] It should be noted that the display device 200 can also be an OLED display. Correspondingly, the template included in the display device 200 will be changed accordingly. For example, since OLED displays can achieve self-illumination, a backlight component is not required in an OLED display. Figure 3a The first backlight assembly 12 and the second backlight assembly 22 in the middle are not described in detail here.

[0154] Or, such as Figure 3a The illustration uses a display device with dual displays as an example, while... Figure 3b The diagram illustrates a hardware structure of a hardware system in a display device according to an exemplary embodiment.

[0155] Among them, such as Figure 3b The display device shown includes a single display screen, comprising: a panel 1, a backlight assembly 2, a back cover 3, a controller 4, a power supply assembly 5, and a base 6. The panel 1 displays the image to the user. The backlight assembly 2, located below the panel 1, typically consists of optical components that provide sufficient brightness and a uniformly distributed light source, enabling the panel 1 to display image content correctly. The backlight assembly 2 also includes a back plate, on which the controller 4 and power supply assembly 5 are mounted. Typically, raised structures are stamped onto the back plate, and the controller 4 and power supply assembly 5 are fixed to these raised structures with screws or hooks. The back cover 3 covers the panel 1 to conceal the backlight assembly 2, controller 4, and power supply assembly 5, achieving an aesthetically pleasing appearance. The base 6 supports the display device.

[0156] The controller 4 and power supply component 5 can be mounted on a separate board, or they can be mounted together on a single board, or they can be mounted together on a single board with the backlight component. The specific configuration can be determined according to actual needs, and this application does not impose any limitations on this. For ease of explanation, Figure 3b In the middle, the controller 4 and the power supply component 5 are mounted on a single board.

[0157] In addition, the display device 200 also includes a sound reproduction device (not shown in the figure), such as an audio component, including an I2S interface with a power amplifier (AMP) and a speaker, for sound reproduction. Typically, the audio component can output at least two channels of sound; to achieve a surround sound effect, multiple audio components are needed to output multiple channels of sound, which will not be discussed in detail here.

[0158] It should be noted that the display device 200 can also use an OLED display screen. In this case, the template included in the display device 200 will be changed accordingly, which will not be discussed in detail here.

[0159] Figure 4 A schematic diagram showing the connection relationship between the power board and the load is shown, such as... Figure 4 As shown, the power supply assembly 30 includes an input terminal IN and an output terminal OUT (first output terminal OUT1, second output terminal OUT2, third output terminal OUT3, fourth output terminal OUT4, and fifth output terminal OUT5 are shown in the figure). The input terminal IN is connected to an AC power source (such as mains power), and the output terminal OUT is connected to a load. For example, the first output terminal OUT1 is connected to a sound reproduction device, the second output terminal OUT2 is connected to the first panel 11 / second panel 21, the third output terminal OUT3 is connected to the first backlight assembly 12 / second backlight assembly 22, the fourth output terminal OUT4 is connected to the first controller 14 / second controller 15, and the fifth output terminal OUT5 is connected to the first display driver circuit 16 / second display driver circuit.

[0160] 24 are connected. Among them, the power supply component 30 needs to convert AC mains power into DC power required by the load, and this DC power usually has different specifications, such as 18V for the audio component and 12V / 18V for the first controller 14.

[0161] For ease of description, one hardware system in the dual-hardware system architecture will be referred to as the first hardware system or the first controller, and the other hardware system will be referred to as the second hardware system or the second controller. The first controller includes various processors, various interfaces, and various modules connected to the first controller through various interfaces. The second controller includes various processors, various interfaces, and various modules connected to the second controller through various interfaces.

[0162] The first controller and the second controller can each have a relatively independent operating system installed. The operating systems of the first controller and the second controller can communicate with each other through a communication protocol. For example, the framework layer of the operating system of the first controller and the framework layer of the operating system of the second controller can communicate to transmit commands and data, so that there are two independent but interconnected subsystems in the display device 200.

[0163] The following is combined with Figure 5 The dual hardware system architecture of this application is described in some embodiments. It should be noted that... Figure 5 This is merely an illustrative example of the dual-hardware system architecture of this application and does not imply any limitation on the application. In practical applications, both hardware systems may include more or fewer hardware or interfaces as needed.

[0164] Figure 5 The example shown is based on Figure 3a , Figure 3b The diagram shows the hardware architecture of display device 200. Figure 5 As shown, the hardware system of the display device 200 includes a first controller 210 and a second controller 310, as well as modules connected to the first controller 210 or the second controller 310 through various interfaces.

[0165] In some embodiments, the second controller 310 may be used to receive instructions sent by the first controller 210 and control the second display screen 380 to display the corresponding image.

[0166] Modules connected to the first controller 210 may include a tuner / demodulator 220, a communicator 230, an external device interface 25, a memory 290, a user input interface 260-3, a video processor 260-1, an audio processor 260-2, and a first display screen 280 (i.e., Figure 1 The first controller 210 includes a first display screen 201, an audio output interface 270, and a power supply module 240. In other embodiments, the first controller 210 may also connect to more or fewer modules.

[0167] The tuner / demodulator 220 is used to amplify, mix, and resonate the received broadcast television signals via wired or wireless means, thereby demodulating the audio and video signals carried in the frequency of the television channel selected by the user from multiple wireless or wired broadcast television signals, as well as additional information (such as EPG data signals). Depending on the television signal broadcasting standard, the signal path of the tuner / demodulator 220 can be various, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, or internet broadcasting; and depending on the modulation type, the signal adjustment method can be digital modulation or analog modulation; and depending on the type of received television signal, the tuner / demodulator 220 can demodulate analog signals and / or digital signals.

[0168] The tuner 220 is also configured to respond to the television channel frequency selected by the user and the television signal carried by that frequency, based on user selection and controlled by the first controller 210.

[0169] In some other exemplary embodiments, the tuner 220 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs television audio and video signals after modulation and demodulation, which are then input to the display device 200 via the external device interface 250.

[0170] The communicator 230 is a component used to communicate with external devices or external servers according to various communication protocol types. For example, the communicator 230 may include a WIFI module 231, a Bluetooth communication protocol module 232, a wired Ethernet communication protocol module 233, and other network communication protocol modules or near-field communication protocol modules (not shown in the figure), such as an infrared communication protocol module.

[0171] The display device 200 can establish a connection for control signals and data signals with an external control device or content providing device via a communicator 230. For example, the communicator can receive control signals from the remote controller 100 under the control of the first controller 210.

[0172] External device interface 250 is a component that provides data transmission between the first controller 210 and other external devices. External device interface 250 can be connected to external devices such as set-top boxes, gaming devices, and laptops via wired / wireless means, and can receive data such as video signals (e.g., motion pictures), audio signals (e.g., music), and additional information (e.g., EPG) from external devices.

[0173] The external device interface 250 may include one or more of the following: a High Definition Multimedia Interface (HDMI) terminal (also known as HDMI 251), a Composite Video Blanking Synchronization (CVBS) terminal (also known as AV 252), an analog or digital component terminal (also known as component 253), a Universal Serial Bus (USB) terminal (254), and a Red, Green, and Blue (RGB) terminal (not shown in the figure). This application does not limit the number or type of external device interfaces.

[0174] The first controller 210 controls the operation of the display device 200 and responds to user operations by running various software control programs (such as operating systems and / or various applications) stored in the memory 290.

[0175] like Figure 5 As shown, the first controller 210 includes a read-only memory (RAM) 213, a random access memory (ROM) 214, a graphics processor (GPU) 216, a CPU processor (CPU) 212, a communication interface 218, and a communication bus. The RAM 213, ROM 214, GPU 216, CPU processor 212, and communication interface 218 are connected to each other via the bus.

[0176] ROM 213 is used to store various system startup instructions. For example, when a power-on signal is received, the display device 200 starts up, the CPU processor 212 executes the system startup instructions in the ROM, copies the operating system stored in memory 290 to RAM 214, and then starts running the operating system. After the operating system has started, the CPU processor 212 copies various application programs from memory 290 to RAM 214, and then starts running the various application programs.

[0177] The graphics processor 216 is used to generate various graphical objects, such as icons, operation menus, and graphics displayed based on user input commands. It includes an arithmetic logic unit (ALU) that performs calculations based on various user-input interactive commands and displays various objects according to display attributes. It also includes a renderer that generates various objects based on the ALU results and displays the rendering results on the first display screen 280.

[0178] CPU processor 212 is used to execute operating system and application instructions stored in memory 290, as well as various interactive instructions received from external input, to execute various applications, data, and content, so as to ultimately display and play various audio and video content.

[0179] In some exemplary embodiments, the CPU processor 212 may include multiple processors. These multiple processors may include a main processor and multiple or one sub-processors. The main processor is used to perform some operations of the display device 200 in a pre-power-on mode and / or to display a screen in normal mode. The multiple or one sub-processors are used to perform an operation in a standby mode or other state.

[0180] The communication interface 218 may include a first interface 218-1 to an nth interface 218-n. These interfaces may be network interfaces that are connected to external devices via a network.

[0181] The first controller 210 can control the operations of the display device 200 related to the first display screen 280. For example, in response to receiving a user command to select a UI object to be displayed on the first display screen 280, the first controller 210 can perform operations related to the object selected by the user command.

[0182] The first controller 210 can control the operations of the display device 200 related to the second display screen 380. For example, in response to receiving a user command to select a UI object to be displayed on the second display screen 380, the first controller 210 can perform operations related to the object selected by the user command.

[0183] The object can be any of the optional objects, such as a hyperlink or an icon. Operations related to the selected object include, for example, displaying links to hyperlinked pages, documents, images, etc., or executing operations corresponding to the icon. User commands for selecting UI objects can be input via various input devices connected to the display device 200 (e.g., mouse, keyboard, touchpad, etc.) or voice commands corresponding to spoken commands by the user.

[0184] The memory 290 includes various software modules for driving and controlling the display device 200. These software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules (not shown in the figure).

[0185] The system comprises the following modules: The basic module is a low-level software module used for signal communication between various hardware components in the display device 200 and for sending processing and control signals to higher-level modules. The detection module is a management module used to collect various information from various sensors or user input interfaces, perform analog-to-digital conversion, and analyze and manage the data. The voice recognition module includes a voice parsing module and a voice command database module. The display control module controls the first display screen 280 to display image content and can be used to play multimedia image content and UI interface information. The communication module is used for control and data communication with external devices. The browser module is used to perform data communication with browser servers. The service module provides various services and applications.

[0186] Meanwhile, the memory 290 is also used to store received external data and user data, images of various items in various user interfaces, and visual renderings of the focus object.

[0187] User input interface 260-3 is used to send user input signals to the first controller 210, or to transmit signals output from the first controller 210 to the user. For example, a control device (e.g., a mobile terminal or remote control) can send user input signals such as power switch signals, channel selection signals, and volume adjustment signals to the user input interface, which then forwards them to the first controller 210 via user input interface 260-3; alternatively, the control device can receive output signals such as audio, video, or data output from user input interface 260-3 after processing by the first controller 210, and display the received output signals or output the received output signals as audio or vibration.

[0188] In some embodiments, the user can input user commands through a graphical user interface (GUI) displayed on the first display screen 280, and the user input interface 260-3 receives the user input commands through the graphical user interface (GUI). Alternatively, the user can input user commands by inputting specific sounds or gestures, and the user input interface 260-3 receives the user input commands by recognizing the sounds or gestures through sensors.

[0189] The video processor 260-1 is used to receive video signals and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard encoding and decoding protocol of the input signal, so as to obtain a video signal that can be directly displayed or played on the first display screen 280.

[0190] For example, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, a display formatting module, etc. (not shown in the figure).

[0191] The demultiplexing module is used to demultiplex the input audio and video data streams. For example, if the input is MPEG-2, the demultiplexing module will demultiplex it into video signals and audio signals.

[0192] The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

[0193] Image compositing modules, such as image compositers, are used to overlay and blend GUI signals generated by a graphics generator based on user input or its own data with scaled video images to generate displayable image signals.

[0194] The frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of an input 24Hz, 25Hz, 30Hz, or 60Hz video to 60Hz, 120Hz, or 240Hz. The input frame rate can be related to the source video stream, and the output frame rate can be related to the refresh rate of the display device. The display formatting module is used to change the signal output by the frame rate conversion module to conform to the display format of the display device, such as converting the format of the signal output by the frame rate conversion module to output RGB data signals.

[0195] The first display screen 280 is used to receive image signals input from the video processor 260-1, and to display video content, images, and a menu control interface. The first display screen 280 includes a display component for presenting the image and a driving component for driving the image display. The displayed video content can be video from a broadcast signal received by the tuner / demodulator 220, or video content input from a communicator or external device interface. The first display screen 280 also displays the user interface (UI) generated in the display device 200 and used to control the display device 200.

[0196] Furthermore, depending on the type of the first display screen 280, it may also include a driving component for driving the display. Alternatively, if the first display screen 280 is a projection display screen, it may also include a projection device and a projection screen.

[0197] The audio processor 260-2 is used to receive audio signals, perform decompression and decoding according to the standard encoding and decoding protocol of the input signals, as well as audio data processing such as noise reduction, digital-to-analog conversion and amplification, to obtain an audio signal that can be played in the speaker 272.

[0198] The audio output interface 270 is used to receive audio signals output by the audio processor 260-2 under the control of the first controller 210. The audio output interface may include a speaker 272, or an external audio output terminal 274 for outputting to an external device, such as an external audio terminal or headphone output terminal.

[0199] In some other exemplary embodiments, the video processor 260-1 may include one or more chips. The audio processor 260-2 may also include one or more chips.

[0200] In addition, in some other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips or integrated with the first controller 210 into one or more chips.

[0201] The power supply module 240, under the control of the first controller 210, provides power supply support to the display device 200 from the external power input. The power supply module 240 may include a built-in power supply circuit installed inside the display device 200, or it may be a power supply installed outside the display device 200, such as a power interface that provides an external power supply in the display device 200.

[0202] Similar to the first controller 210, such as Figure 5 As shown, the module connected to the second controller 310 may include a communicator 330, a detector 340, a memory 390, and a second display screen 380 (i.e., Figure 1 The second display screen 202 in the figure. In some embodiments, it may also include a user input interface, a video processor, an audio processor, a display screen, and an audio output interface (not shown in the figure). In some embodiments, there may also be a power supply module (not shown in the figure) that independently powers the second controller 310.

[0203] The communicator 330 is a component used to communicate with external devices or external servers according to various communication protocol types. For example, the communicator 330 may include a WIFI module 331, a Bluetooth communication protocol module 332, a wired Ethernet communication protocol module 333, and other network communication protocol modules or near-field communication protocol modules (not shown in the figure), such as an infrared communication protocol module.

[0204] The communicator 330 and the communicator 230 of the first controller 210 also interact with each other. For example, the WiFi module 231 in the hardware system of the first controller 210 is used to connect to an external network and establish network communication with an external server, etc. The WiFi module 331 in the hardware system of the second controller 310 is used to connect to the WiFi module 231 of the first controller 210, but does not establish a direct connection with an external network, etc. The second controller 310 connects to the external network through the first controller 210. Therefore, for the user, a display device as described in the above embodiment only displays a WiFi account.

[0205] Detector 340 is a component of the second controller 310 used to acquire signals from the external environment or to interact with the external environment. Detector 340 may include a light receiver 342, a sensor for acquiring ambient light intensity, which can adapt to changes in display parameters by acquiring ambient light; it may also include an image acquisition device 341, such as a camera, which can be used to acquire external environmental scenes and to acquire user attributes or user interaction gestures, which can adaptively change display parameters and recognize user gestures to achieve interactive functions with the user.

[0206] External device interface 350 provides components for data transmission between the second controller 310 and the first controller 210 or other external devices. The external device interface can connect to external devices such as set-top boxes, gaming devices, and laptops via wired or wireless connections.

[0207] The video processor 360 is used to process relevant video signals.

[0208] The second controller 310 controls the operation of the display device 200 and responds to user operations by running various software control programs (such as installed third-party applications) stored in the memory 390 and interacting with the first controller 210.

[0209] like Figure 5 As shown, the second controller 310 includes a read-only memory (ROM) 313, a random access memory (RAM) 314, a graphics processor (GPU) 316, a CPU processor (CPU) 312, a communication interface 318, and a communication bus. The ROM 313, RAM 314, GPU 316, CPU processor 312, and communication interface 318 are connected to each other via the bus.

[0210] ROM 313 stores various system startup instructions. CPU processor 312 executes the system startup instructions in ROM, copying the operating system stored in memory 390 to RAM 314 to begin running the operating system. After the operating system has started, CPU processor 312 copies various application programs from memory 390 to RAM 314, and then begins running these applications.

[0211] CPU processor 312 is used to execute operating system and application instructions stored in memory 390, and to communicate, transmit and interact with the first controller 210, such as signals, data and instructions, and to execute various applications, data and content according to various interactive instructions received from external input, so as to ultimately display and play various audio and video content.

[0212] There are multiple communication interfaces 318, which may include first interfaces 318-1 to nth interfaces 318-n. These interfaces may be network interfaces that are connected to external devices via a network, or network interfaces that are connected to the first controller 210 via a network.

[0213] The second controller 310 can control the operations of the display device 200 related to the second display screen 380. For example, in response to receiving a user command to select a UI object to be displayed on the second display screen 380, the second controller 310 can perform operations related to the object selected by the user command.

[0214] The second controller 310 can control the operations of the display device 200 related to the first display screen 280. For example, in response to receiving a user command to select a UI object to be displayed on the first display screen 280, the first controller 210 can perform operations related to the object selected by the user command.

[0215] The graphics processor 316 is used to generate various graphical objects, such as icons, operation menus, and graphics displayed based on user input commands. It includes a calculation unit that receives various interactive commands from the user, performs calculations, and displays various objects according to display attributes. It also includes a renderer that generates various objects based on the calculation unit's results, and displays the rendering results on the second display screen 380.

[0216] Both the graphics processor 316 of the second controller 310 and the graphics processor 216 of the first controller 210 can generate various graphical objects. Specifically, if application 1 is installed on the second controller 310 and application 2 is installed on the first controller 210, when the user is on the interface of application 1 and performs user input commands within application 1, the graphics processor 316 of the second controller 310 generates the graphical objects. When the user is on the interface of application 2 and performs user input commands within application 2, the graphics processor 216 of the first controller 210 generates the graphical objects.

[0217] Figure 6 The diagram illustrates a functional configuration of a display device according to an exemplary embodiment.

[0218] like Figure 6 As shown, the memory 390 of the second controller 310 and the memory 290 of the first controller 210 are used to store the operating system, applications, content, and user data, respectively. Under the control of the second controller 310 and the first controller 210, they execute system operations that drive the first display screen 280 and the second display screen 380, and respond to various user operations. The memory 390 and the memory 290 may include volatile and / or non-volatile memory.

[0219] Specifically, memory 290 is used to store the running program of the first controller 210 in the display device 200, as well as various applications built into the display device 200, various applications downloaded by the user from external devices, various graphical user interfaces related to the applications, various objects related to the graphical user interfaces, user data information, and various internal data supporting the applications. Memory 290 is used to store system software such as the operating system (OS) kernel, middleware, and applications, as well as input video and audio data, and other user data.

[0220] The memory 290 is specifically used to store drivers and related data for the video processor 260-1 and audio processor 260-2, the first display screen 280, the communicator 230, the tuner / demodulator 220, input / output interfaces, etc.

[0221] In some embodiments, memory 290 may store software and / or programs representing an operating system (OS), including, for example, a kernel, middleware, application programming interfaces (APIs), and / or applications. Exemplarily, the kernel may control or manage system resources, or functions implemented by other programs (such as the middleware, APIs, or applications), and the kernel may provide interfaces to allow middleware and APIs, or applications, to access controllers to control or manage system resources.

[0222] For example, memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, a first audio control module 2906, an external command recognition module 2907, a communication control module 2908, an optical receiving module 2909, a power control module 2910, an operating system 2911, and other application programs 2912, a browser module 2913, etc. The first controller 210 executes various functions such as broadcast television signal reception and demodulation, television channel selection control, volume selection control, image control, display control, audio control, external command recognition, communication control, optical signal reception, power control, a software control platform supporting various functions, and a browser function by running various software programs stored in memory 290.

[0223] The memory 390 includes various software modules for driving and controlling the display device 200. These software modules stored in the memory 390 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules (not shown in the figure). Since the memory 390 and memory 290 have similar functions, relevant details can be found in memory 290 and will not be elaborated upon here.

[0224] For example, memory 390 includes an image control module 3904, a second audio control module 3906, an external command recognition module 3907, a communication control module 3908, an optical receiving module 3909, an operating system 3911, and other application programs 3912, a browser module 3913, etc. The first controller 210 executes various functions such as image control, display control, audio control, external command recognition, communication control, optical signal receiving, power control, a software control platform supporting various functions, and a browser function by running various software programs stored in memory 290.

[0225] Differentiatedly, the external command recognition module 2907 of the first controller 210 and the external command recognition module 3907 of the second controller 310 can recognize different commands.

[0226] For example, when an image receiving device such as a camera is connected to the second controller 310, the external command recognition module 3907 of the second controller 310 may include an image recognition module 2907-1. The image recognition module 3907-1 stores an image database. When the camera receives an external image command, it establishes a correspondence with the command in the image database to control the display device. Since the voice receiving device and remote control are connected to the first controller 210, the external command recognition module 2907 of the first controller 210 may include a voice recognition module 2907-2. The voice recognition module 2907-2 stores a voice database. When the voice receiving device receives an external voice command, it establishes a correspondence with the command in the voice database to control the display device. Similarly, the remote control or other control device 100 is connected to the first controller 210, and the button command recognition module 2907-3 interacts with the control device 100.

[0227] Figure 7 The diagram illustrates a configuration block diagram of the software system in the display device 200 according to an exemplary embodiment.

[0228] For the first controller 210, such as Figure 7 As shown, the operating system 2911 includes execution software for handling various basic system services and for implementing hardware-related tasks, and acts as a medium for data processing between applications and hardware components.

[0229] In some embodiments, a portion of the operating system kernel may include a suite of software for managing display device hardware resources and providing services to other programs or software code.

[0230] In other embodiments, a portion of the operating system kernel may include one or more device drivers. A device driver can be a set of software code within the operating system that helps operate or control devices or hardware associated with the display device. The driver may contain code that operates video, audio, and / or other multimedia components. Examples include displays, cameras, Flash, WiFi, and audio drivers.

[0231] The accessibility module 2911-1 is used to modify or access the application to enable accessibility of the application and operability of its displayed content.

[0232] The communication module 2911-2 is used for connecting to other peripherals via relevant communication interfaces and communication networks.

[0233] User interface module 2911-3 provides objects for displaying the user interface, which can be accessed by various applications to enable user operability.

[0234] Control application 2911-4 is used to control process management, including runtime applications, etc.

[0235] The event transmission system 2914 can be implemented within the operating system 2911 or in the application 2912. In some embodiments, it is implemented both within the operating system 2911 and in the application 2912, and is used to listen for various user input events and to implement a set of or more predefined operations based on the identification results of various events or sub-events that represent various events.

[0236] Among them, the event listening module 2914-1 is used to listen for user input interface input events or sub-events.

[0237] The event recognition module 2914-2 is used to input various event definitions into various user input interfaces, identify various events or sub-events, and transmit them to the processor to execute one or more sets of corresponding processing programs.

[0238] Here, an event or sub-event refers to the input detected by one or more sensors in the display device 200, as well as the input from external control devices (such as control device 100). Examples include various voice input sub-events, gesture recognition sub-events, and sub-events of remote control button commands input from the control device. For instance, one or more sub-events in a remote control include various forms, including but not limited to one or a combination of button presses (up / down / left / right), confirmation button, and button press / hold. It also includes operations of non-physical buttons, such as moving, pressing, and releasing.

[0239] The interface layout management module 2913 directly or indirectly receives user input events or sub-events from the event transmission system 2914, and uses them to update the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, as well as the size or position and hierarchy of containers and other execution operations related to the interface layout.

[0240] Since the operating system 3911 of the second controller 310 has similar functions to the operating system 2911 of the first controller 210, the relevant parts can be found in the operating system 2911, and will not be described again here.

[0241] like Figure 8 As shown, the application layer of the display device contains various applications that can be executed on the display device 200.

[0242] The application layer 2912 of the first controller 210 may include, but is not limited to, one or more applications, such as video-on-demand applications, application centers, and game applications. The application layer 3912 of the second controller 310 may include, but is not limited to, one or more applications, such as live TV applications and media center applications. It should be noted that the applications included on the second controller 310 and the first controller 210 are determined based on the operating system and other design considerations, and this application does not require specific limitations or divisions regarding the applications included on the second controller 310 and the first controller 210.

[0243] A live TV application can provide live television from various signal sources. For example, a live TV application can provide television signals from cable television, terrestrial broadcasting, satellite services, or other types of live TV services. Furthermore, the live TV application can display the video of the live TV signal on a display device 200.

[0244] Video-on-demand (VOD) applications can provide video from various storage sources. Unlike live TV applications, VOD provides video display from certain storage sources. For example, VOD can come from cloud storage servers or from local hard drive storage containing pre-stored video programs.

[0245] Media Center applications are applications that provide playback of various multimedia content. For example, Media Center provides services that allow users to access various images or audios, unlike live TV or video-on-demand.

[0246] The application center provides a storage space for various applications. An application can be a game, an application, or other applications related to a computer system or other device but capable of running on a display device. The application center obtains these applications from various sources, stores them in local storage, and then makes them available for execution on the display device 200.

[0247] Since the second controller 310 and the first controller 210 may each have an independent operating system installed, the display device 200 contains two independent but interconnected subsystems. For example, both the second controller 310 and the first controller 210 can independently install Android and various apps, and can perform certain functions, enabling the second controller 310 and the first controller 210 to work together to achieve a certain function.

[0248] Figure 9 The diagram illustrates a user interface in a display device 200 according to an exemplary embodiment. Figure 9 As shown, the user interface includes a first view display area 2011 and a second view display area 2021. The functions of the first view display area 2011 and the second view display area 2021 are basically the same; only the first view display area 2011 will be described in detail below. For example, the first view display area 2011 includes a layout of one or more different items. Furthermore, the user interface also includes a selector that indicates the selected item; the position of the selector can be moved by user input to change the selected item.

[0249] In some embodiments, the first view display area 2011 is a scalable view display. "Scalable" can mean that the size or proportion of the first view display area 2011 on the screen is scalable, or that the size or proportion of the items in the view display 201 on the screen is scalable.

[0250] "Item" refers to a visual object displayed in the view display area of ​​the user interface in the display device 200 to represent corresponding content, such as icons, thumbnails, video clips, etc. For example, an item can represent image content or video clips from movies or TV series, audio content from music, applications, or other user access history information.

[0251] In addition, the item can represent the interface or set of interfaces connecting the display device 200 to external devices, or it can represent the name of the external device connected to the display device. For example: signal source input interface set, or High Definition Multimedia Interface (HDMI), USB interface, PC terminal interface, etc.

[0252] It should be noted that the view display area can present video chat project content or application layer project content (such as web videos, Video on Demand (VOD) displays, application screens, etc.).

[0253] The "selector" is used to indicate that any item has been selected, such as a cursor or a focused object. The selection information input is located based on the position of the icon or menu touched by the user on the display device 200. The selection of a control item can be selected by moving the focused object displayed on the display device 200; one or more items can be selected or controlled.

[0254] A focus object refers to an object that moves between items based on user input. For example, the focus object's position is indicated by drawing thick lines along the edges of the items. In other embodiments, the focus form is not limited to the example; it can be a tangible or intangible form recognizable to the user, such as a cursor, a 3D deformation of an item, or an identifier such as changing the border lines, size, color, transparency, outline, and / or font of the focused item's text or image.

[0255] The event transmission system 2914 can listen to user input of each predefined event or sub-event and directly or indirectly provide the control of the identified event or sub-event to the interface layout management module 2913.

[0256] The interface layout management module 2913 is used to monitor the state of the user interface (including the position and / or size, change process, etc. of view partitions, items, focus or cursor objects, etc.), and, based on the event or sub-event, can modify the size, position, hierarchy, and other layout of the view display area, and / or adjust or modify the size and / or position, quantity, type, content, and other layout of various items in the view display area. In some embodiments, modifying and adjusting the layout includes displaying or not displaying each view partition or the content of items in the view partition on the screen.

[0257] A user input interface is used to send user input signals to the controller, or to transmit signals output from the controller to the user. For example, a control device (such as a mobile terminal or remote control) can send user input signals, such as power switch signals, channel selection signals, and volume adjustment signals, to the user input interface, which then forwards them to the controller; or, the control device can receive output signals, such as audio, video, or data, from the user input interface after processing by the controller, and display the received output signals or output the received output signals as audio or vibration.

[0258] In some embodiments, a user can input a user command through a user interface displayed on the display device 200, and the user input interface receives the user input command through the user interface. Alternatively, a user can input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.

[0259] A "user interface" is the medium through which an application or operating system interacts and exchanges information with the user. It converts information from its internal form to a form that the user can accept. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0260] Figures 10-12 An exemplary diagram illustrates how a user interface interacts with a user in a display device 200 according to an exemplary embodiment.

[0261] like Figures 10 to 11 As shown, the first display screen (specifically, the first view display area 2011) displays a video image, which can be image content from a movie or TV series, video clips, or video footage from an application. Simultaneously, the controller receives an incoming call request and, in response, displays an incoming call notification screen on the second display screen (specifically, the second view display area 2021). This incoming call notification screen includes a tab for indicating whether to answer the call request and a tab for rejecting the call request.

[0262] After the controller displays the incoming call reminder screen on the second display screen, it can execute either of the following two optional methods.

[0263] In the first alternative approach, the controller responds to a user's input of a tab indicating an incoming call request and displays a chat window on the first display screen. Furthermore, the controller may also respond to a user's instruction to initiate a video call in a pop-up window and display the video call in a pop-up window on a second display screen, or in a target area of ​​the first display screen.

[0264] The tab for user-inputted call connection requests can also be referred to as the indicator for user-inputted call connection requests.

[0265] In the second alternative method, the controller responds to the user's input of a tab indicating a call request and controls the second display screen to show the chat screen. Furthermore, the controller can also respond to the user's selection of the chat screen and control the switch of the chat screen from the second display screen to the first display screen.

[0266] In both of the above methods, "answering a call request" can refer to answering a video call, and "chat screen" can refer to a video call screen.

[0267] It is worth noting that in the embodiments of this application, the number of controllers can be one or more. When there is one controller, the single controller receives the incoming call request while the video image is displayed on the first display screen and displays the incoming call reminder image on the second display screen. When there are multiple controllers, the display of the incoming call reminder image on the second display screen is completed through collaborative interaction between the controllers while the video image is displayed on the first display screen. In one embodiment, the controller may include a first controller and a second controller. The first controller is used to receive the incoming call request while the video image is displayed on the first display screen and send an incoming call indication to the second controller. The second controller is used to receive the incoming call indication and display the incoming call reminder image on the second display screen. The following embodiments of this application are all described using the example of a controller including a first controller and a second controller, but this should not be construed as a limitation of this application.

[0268] Reference Figure 10 If the incoming call is a video call, game invitation, or other video-based call, the incoming call notification screen displayed by the second controller in the second view display area 2021 may include items such as the caller's portrait, name, call prompt, answer video button, answer voice only button, and hang up button. At the same time, the second controller will focus on the answer video button.

[0269] Reference Figure 11 If the incoming call is a voice call, the call notification screen displayed in the second view display area 2021 by the second controller may include the caller's portrait, name, call message, answer voice button, and hang-up button. Simultaneously, the second controller will focus on the answer voice button. The user can move the focus object using the left and right arrow keys on the remote control to select the button and press the OK button to confirm.

[0270] Taking the first optional method mentioned above as an example, if the focused object is positioned on... Figure 10 When the user presses the OK button to answer a video call, in one embodiment, the first and second displays can show... Figure 13 or Figure 14 The image shown. Among them, Figure 13 This is a diagram illustrating a video call involving six parties. Figure 14This is a diagram illustrating a video call involving two parties. Figure 13 or Figure 14 In the shown screen, users can press the floating window button to switch the view to... Figure 17 The screen shown can be switched to the desired layout by pressing the switch layout button. Figure 18 The image shown. Alternatively, the first and second displays can show... Figure 17 or Figure 18 As shown in the image, users can press a specific menu button, such as the OK button, to switch to the desired menu. Figure 13 or Figure 14 The image shown.

[0271] If the focus object is positioned at Figure 10 On the "Only Answer Voice" button, the first and second displays can show... Figure 15 The image shown. (As shown) Figure 15 As shown, the first display screen can continue to display the video feed; in some embodiments, video playback can be paused at this time. The second display screen can display portraits of the participants in the voice call, excluding the current user. It should be understood that the current user mentioned in this application embodiment refers to the user corresponding to the display device. Simultaneously, the second display screen displays a black screen at the position corresponding to the current user, with a "video not started" indicator superimposed on the black screen.

[0272] If the focus object is positioned at Figure 11 If the answer button is pressed, a voice icon can be displayed on the second screen to indicate that a voice call is currently in progress.

[0273] If the focus object is positioned at Figure 10 or Figure 11 When the user presses the OK button while the hang-up button is pressed, the first and second displays can then show... Figure 12 The image shown. Figure 12 The displayed screen shows the screen after no incoming call request has been received, or after a voice or video call has ended. For example... Figure 12 As shown, the first display screen can continue playing the video, while the second display screen can display information such as the voice assistant, weather, date, and time.

[0274] As mentioned above, Figure 13 and Figure 14 The following is a diagram illustrating a video call.

[0275] like Figure 13As shown, the first view display area 2011 displays the video call screen, which shows the video of each of the six participants in the video call. Each participant's video occupies a portion of the first view display area 2011. The lower left corner of each participant's video area displays the participant's name, and the lower right corner indicates whether the participant is in a mute or unmute state.

[0276] For example, user A's video is displayed in the upper left corner of the first view display area. In user A's corresponding area, user A's image fills the entire area, while user A's name is overlaid in the lower left corner of the area above the image, and a "user A is currently muted" indicator is overlaid in the lower right corner. Simultaneously, above each participant's video, user-interactive items and the video call duration are displayed in a semi-transparent manner. These items may include a floating window button, a layout switching button, an invite new participant button, a hang-up button, a video off button, a microphone off button, and a screen sharing button. Different call types may display different items. The focus object can be positioned on one of the items.

[0277] Meanwhile, the incoming call notification screen is no longer displayed on the second display screen. Specifically, the second display screen can be in a backlight-off state, or it can display information such as weather and time. The interface examples after the user presses the floating window button, the layout switch button, and the invite new participant button will be described in the following embodiments. After the user presses the hang-up button, the interface displays the above... Figure 12 The screen shown is as follows. After the user presses the video off button, the corresponding video becomes black and is no longer displayed. After the user presses the microphone off button, a mute icon appears in the area where the user's video is located.

[0278] For example, the user is Figure 13 In the example, when user A presses the microphone mute button, the indicator in the lower corner of user A's area will display a mute icon.

[0279] like Figure 14 As shown, the first view display area 2011 displays the video call screen, showing the videos of the two participants in the video call, with each participant's video occupying half of the first view display area 2011. Simultaneously, above the videos of the two participants, user-interactive items are displayed in a semi-transparent manner. These items may include a floating window button, a beauty filter button, an invite friend button, a hang-up button, a video off button, a microphone off button, and a layout switching button, etc. The focus object can be positioned on one of the items, for example, on the floating window button.

[0280] Specifically, the second display screen can be in a backlight-off state, or it can display information such as weather and time. The interface examples after the user presses the floating window button, the layout switch button, the invite friend button, and the beauty filter button will be described in the following embodiments. After the user presses the hang-up button, the interface displays the above... Figure 12 The screen shown is as follows. After the user presses the video off button, the user's corresponding video goes black and is no longer displayed. After the user presses the microphone off button, a mute icon appears in the area where the user's video is located. For example, the user is... Figure 13 In the example, when user A presses the microphone mute button, the indicator in the lower corner of user A's area will display a mute icon.

[0281] Figure 16 A schematic diagram illustrating the interaction process between the first controller and the second controller, as shown below. Figure 16 As shown, the interaction process between the first controller and the second controller includes:

[0282] S1601, The first controller displays the video image on the first display screen.

[0283] In some embodiments, the video footage may be images from movies or TV series, video clips, or video footage from applications.

[0284] If the video footage also has corresponding audio content, the first controller will simultaneously play the audio information corresponding to the video footage.

[0285] S1602, The first controller receives the incoming call request.

[0286] In some embodiments, the incoming call request may be a video call request, a voice call request, a game invitation, etc.

[0287] S1603, The first controller sends an incoming call indication to the second controller.

[0288] If the first controller determines that a video image is currently being displayed on the first screen, it can send an incoming call indication to the second controller via serial port transmission. This indication can include the type of call and the caller's information, which the second controller uses to select the item to display. Alternatively, the indication can include both the call type and caller information, as well as the item to be displayed on the second screen; the second controller then directly displays the item based on the indication.

[0289] Incoming calls can include video calls, voice calls, game invitations, etc.

[0290] The caller's information may include their image, name, etc.

[0291] Correspondingly, the second controller receives the aforementioned incoming call instruction.

[0292] S1604, the second controller displays the incoming call reminder screen on the second display screen.

[0293] The second controller displays the incoming call notification screen in the second view display area of ​​the second display screen. The incoming call notification screen includes the caller's portrait, name, call message, video call answer button, voice call only button, and hang up button. If the incoming call is a video call, game invitation, or other video-based call, the second controller can focus on the video call answer button; if the incoming call is a voice call, the second controller can focus on the voice call only button.

[0294] After the second controller displays the incoming call reminder screen on the second display screen, the user can use the left and right arrow keys on the remote control to move the focus object to select the button and press the OK button to confirm. Alternatively, the user can directly press the OK button to confirm.

[0295] S1605, The second controller receives the user's instruction to answer a video call.

[0296] S1606, The second controller sends a video call instruction to the first controller.

[0297] After the user presses the OK button, the second controller identifies the user's instruction based on the currently focused item. If the focused item is the hang-up button, the second controller confirms receipt of the hang-up instruction and sends it to the first controller. Upon receiving the hang-up instruction, the first controller instructs the second controller to close the incoming call notification screen and does not execute the following steps. If the focused item is the answer-only voice button, the second controller confirms receipt of the answer-voice call instruction and sends a voice call instruction to the first controller. Upon receiving the voice call instruction, the first controller performs voice call control, such as playing the caller's voice, receiving the receiver's voice and sending it to the caller's device, etc. Simultaneously, the first controller can instruct the second controller to close the incoming call notification screen and display the item currently in a voice call on the second display screen. Furthermore, the following steps are not executed.

[0298] If the focus object is positioned on the video call button, the second controller confirms that it has received the instruction to answer a video call and sends a video call instruction to the first controller.

[0299] Accordingly, the first controller receives the video call instruction and performs the following steps.

[0300] S1607, The first controller displays the video call screen on the first display screen.

[0301] In some embodiments, the video call screen may include the videos of the video call participants, as well as items for user interaction. These user-interactive items may be displayed on top of the videos of the video call participants.

[0302] In some embodiments, the first controller can determine the video display position of each participant based on the number of participants in the video call. For example, assuming the video call is a two-way video call, the video of the caller and the receiver each occupy half of the screen of the first display. As another example, assuming the video call is a six-way video call, each participant in the call occupies one-sixth of the first display.

[0303] In some embodiments, the first controller displays user-operable items above the video feeds of the participants in the video call. These items may include a floating window button, a layout switching button, an invite new participant button, a hang-up button, a video off button, a microphone off button, and a screen sharing button. Different call types may display different items. The focus object may be positioned on one of the items, such as the floating window button. The user can move the focus object using the left and right arrow keys on the remote control to select other items and confirm using the OK button on the remote control.

[0304] S1608, the second controller turns off the incoming call reminder screen.

[0305] It is worth noting that the second controller can execute this step after performing step S1306. The execution order of this step and S1607 is not important.

[0306] After the second controller turns off the incoming call reminder screen, it can display information such as time, weather, temperature, and reminder messages on the second display screen. Alternatively, the second controller can turn off the backlight of the second display screen.

[0307] In the above embodiments, when the first display screen is playing video and the first controller receives an incoming call request, it displays an incoming call reminder screen on the second display screen, thereby ensuring that the video screen being displayed on the first display screen is not obstructed and greatly improving the user experience. When the user selects to answer the video call, the video call screen is displayed on the first display screen so that the user can view the video from all parties involved in the video call.

[0308] In some embodiments, the information transmission between the first controller and the second controller in the above-described interaction process can be transmitted via a serial port.

[0309] In some embodiments, after the first controller displays the video call screen on the first display screen, the user can choose to initiate a small-window video call. Based on the user's selection, the first controller displays the video call screen in a small window while simultaneously continuing to play the previous call footage, thus achieving a simultaneous viewing and chatting effect and greatly enhancing the user experience. Specifically, the user can press... Figure 13 or Figure 14 The floating window button in the middle, or, the user can press Figure 13 or Figure 14 The layout can be switched using a pop-up video call button.

[0310] Figure 17 An exemplary illustration shows a schematic diagram of user interface interaction with a user in a display device 200 according to an exemplary embodiment. For example... Figure 17 As shown, in response to a user-inputted video call instruction in a small window, the video call screen in the first view display area 2011 is closed, and the video screen before the video call continues to be displayed. This small window video call instruction is input by the user pressing the aforementioned floating small window button. Simultaneously, the small window video call screen, containing the videos of each participating party, is displayed in the second view display area 2021.

[0311] In some embodiments, the lower left corner of each participant's video area displays the participant's name, and the lower right corner indicates whether the participant is muted or not. In some embodiments, a line of prompt text (not shown in the figure) can be overlaid on each participant's video in the second view display area 2021, such as "Press the menu key to switch windows," so that the user can return based on the prompt text. Figure 13 or Figure 14 The screen shown is shown.

[0312] In some embodiments, after the videos of each video participant are displayed in the second view display area 2021, the user can press a specific button on the remote control (e.g., the back button), and the display device will return to the previous state. Figure 13 or Figure 14 The screen shown is shown below. Alternatively, a "Back" button can be displayed in the second view area. The user can select this button using the remote control and confirm to return to the previous screen. Figure 13 or Figure 14 The screen shown is shown.

[0313] Figure 18 An exemplary illustration shows a schematic diagram of user interface interaction between a display device 200 and a user according to an exemplary embodiment, such as... Figure 18As shown, in response to a user-inputted pop-up video call instruction, the video call screen in the first view display area 2011 is closed, and the video screen before the video call continues to be displayed. This pop-up video call instruction is input by the user pressing the aforementioned layout switch button. Simultaneously, a pop-up video call screen is displayed below the first view display area 2011, near the lower edge of the first display screen, showing the videos of each participant. In some embodiments, the lower left corner of each participant's video area displays their name, and the lower right corner indicates whether the participant is muted or not.

[0314] In some embodiments, after displaying the videos of each video participant in the upper right corner of the first view display area 2011, the user can press a specific button on the remote control (e.g., the back button), and the display device will then return to the previous state. Figure 13 or Figure 14 The display screen shown is shown below. Alternatively, a return button can be displayed below the first view display area 2011, near the lower edge of the first display screen. The user can select this button using the remote control and confirm to return to the previous screen. Figure 13 or Figure 14 The screen shown is shown.

[0315] Figure 19 A schematic diagram illustrating the interaction process between the first controller and the second controller, as shown below. Figure 19 As shown, after the video call screen is displayed on the first display screen, the user can choose to display the video call screen in a small window. The first controller can then instruct the second controller to display the small window video call screen on the second display screen. The interaction process between the first and second controllers includes:

[0316] S1901, The first controller receives the user's input of a small window video call instruction.

[0317] Users can select the floating window button displayed on the first screen and confirm, at which point the first controller will receive the video call instruction.

[0318] S1902, The first controller sends a small window video call instruction to the second controller.

[0319] The pop-up video call indicator is used to instruct the second controller to display the pop-up video call screen on the second display. For example, the first controller may include the number of participants in the video call, the names of each party, etc., in the indicator.

[0320] Correspondingly, the second controller receives a video call instruction via a small window.

[0321] S1903, The first controller closes the video call screen and displays the video screen that was displayed before the video call.

[0322] S1904, the second controller displays the video call screen in a small window on the second display screen.

[0323] After receiving the video call instruction in the small window, the second controller displays the video and name of each participant in multiple areas on the second display screen, based on the number and names of the participants.

[0324] The execution order of the above steps S1903 and S1904 is not important.

[0325] In some embodiments, after the second controller displays the video call window on the second display screen, the user can press a specific button on the remote control (e.g., the back button), or select the back button in the video call window using the remote control and confirm. Based on the user's operation, the first controller receives the user's back instruction. In response to the back instruction, the first controller sends a command to the second controller to close the video call window. In response to the command, the second controller closes the video call window. At the same time, the first controller re-displays the video call window on the first display screen.

[0326] In some embodiments, the information transmission between the first controller and the second controller in the above-described interaction process can be transmitted via a serial port.

[0327] Corresponding to the above Figure 18 In another embodiment of the interactive interface shown, after the first controller receives the user's input instruction for a small-window video call, it closes the video call screen and displays the small-window video call screen in the target area of ​​the first display screen.

[0328] The first controller can determine the size of the target area based on the number of participants in the video call, and display the video call screen in a small window on the target area.

[0329] In some embodiments, after the second controller displays the small window video call screen in the target area of ​​the first display screen, the user can press a specific button (e.g., the back button) in the remote control, or select the back button in the small window video call screen through the remote control and confirm. Based on the user's operation, the first controller receives the user's return instruction. In response to the return instruction, the first controller closes the small window video call screen, and at the same time, the first controller re-displays the aforementioned video call screen on the first display screen.

[0330] Figure 20 An exemplary illustration shows a schematic diagram of user interface interaction with a user in a display device 200 according to an exemplary embodiment. For example... Figure 20As shown, in response to a user-inputted invitation instruction, the first view display area 2011 displays a list of friends available for invitation above the displayed video call screen. This invitation instruction is input by the user pressing the "Invite New Participant" or "Invite Friends" button mentioned above.

[0331] In some embodiments, the friend list may be displayed above the first view display area 2011, near the upper edge of the first display screen. This friend list may display the portrait and name of each friend. When a user selects a friend's portrait or name and presses the OK button, that friend joins the video call, and the friend's video is added to the first view display area.

[0332] Figure 21 An exemplary illustration shows a schematic diagram of user interface interaction with a user in a display device 200 according to an exemplary embodiment. For example... Figure 21 As shown, in response to a user's input of a beauty filter instruction, the first view display area 2011 displays beauty filter options above the displayed video call screen. The beauty filter options may include backgrounds, stickers, and filters. Under the background option, the user can select any of a variety of backgrounds. Under the sticker option, the user can select any of a variety of stickers. Under the filter option, the user can select any filter method. Under the beauty option, the user can select any beauty method. In some embodiments, the beauty filter options may be displayed below the first view display area 2011 near the lower edge of the first display screen; in this case, other buttons originally displayed at that location are temporarily hidden.

[0333] The above description uses the first optional method as an example to illustrate the interaction process and interface display process between the first and second controllers. For the second optional method, corresponding processing and display processes can be used. For example, after receiving a user's instruction to answer a video call, the second controller displays the video call screen on the second display screen using the same method as the first controller in the first optional method. After the user presses the confirmation button, the first controller displays the video call screen on the first display screen. The specific execution process will not be elaborated here.

[0334] Figure 22 This is a flowchart illustrating the display method provided in an embodiment of this application. The execution of this method is primarily driven by the aforementioned controller. Figure 22 As shown, it includes:

[0335] S2201, Receive incoming call requests while the video screen is displayed on the first display screen.

[0336] S2202. In response to the above-mentioned incoming call request, an incoming call reminder screen is displayed on the second display screen.

[0337] The specific execution process of the above steps can be found in the aforementioned embodiments, and will not be repeated here.

[0338] In this embodiment, when the controller receives an incoming call request while the first display screen is playing a video, it displays an incoming call reminder screen on the second display screen, thereby ensuring that the video screen being displayed on the first display screen is not obstructed and greatly improving the user experience.

[0339] In some embodiments, the controller includes a first controller and a second controller.

[0340] The controller receives incoming call requests while the first display screen shows a video feed, including:

[0341] The first controller receives the incoming call request while the video is displayed on the first screen.

[0342] In response to the incoming call request, the controller displays an incoming call reminder screen on the second display screen, including:

[0343] In response to the incoming call request, the first controller sends an incoming call indication to the second controller;

[0344] The second controller receives the incoming call indication and, in response to the incoming call indication, displays an incoming call reminder screen on the second display screen.

[0345] In some embodiments, the above method further includes:

[0346] After the incoming call notification screen is displayed on the second display screen, in response to the user's input of a tab for the request to connect the incoming call, the second display screen is controlled to display a chat screen.

[0347] In some embodiments, the above method further includes:

[0348] In response to the user's selection of the chat screen, the chat screen is switched from the second display screen to the first display screen.

[0349] In some embodiments, the above method further includes:

[0350] The second controller receives a user's instruction to answer a video call, and in response to the instruction, sends a video call instruction to the first controller and closes the incoming call notification screen.

[0351] The first controller receives a video call instruction sent by the second controller and, in response to the video call instruction, displays the video call screen on the first display screen.

[0352] In some embodiments, the above method further includes:

[0353] The first controller receives a user-inputted pop-up video call instruction, closes the video call screen in response to the instruction, and sends a pop-up video call instruction to the second controller. The second controller, in response to the pop-up video call instruction, displays the pop-up video call screen on the second display screen.

[0354] In some embodiments, the above method further includes:

[0355] The first controller receives a user-input instruction for a small-window video call, and in response to the instruction, closes the video call screen and displays the small-window video call screen in the target area of ​​the first display screen.

[0356] In some embodiments, after closing the video call screen, the method further includes:

[0357] The first controller displays the video feed on the first display screen.

[0358] In some embodiments, this application also provides a storage medium storing instructions that, when run on a computer, cause the computer to perform the methods described in the above method embodiments.

[0359] In some embodiments, this application also provides a chip for executing instructions, the chip being used to execute the methods described in the above method embodiments.

[0360] This application also provides a program product, which includes a computer program stored in a storage medium. At least one processor can read the computer program from the storage medium, and when the at least one processor executes the computer program, it can implement the method described in the above method embodiments.

[0361] In the embodiments of this application, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship; in formulas, the character " / " indicates that the preceding and following related objects are in a "division" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.

[0362] It is understood that the various numerical designations used in the embodiments of this application are merely for the convenience of description and are not intended to limit the scope of the embodiments of this application.

[0363] It is understood that, in the embodiments of the present invention, the order of the above-mentioned process numbers does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0364] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A display device, characterized by comprising: The application comprises: a first display screen configured to display a first user interface; a second display screen configured to display a second user interface; the second display screen is physically independent of the first display screen; a controller configured to: in response to an incoming call request, detect a media category displayed in the first user interface; in response to the media category being a video picture, control the second display screen to display an incoming call reminder picture corresponding to the incoming call request in the second user interface, the incoming call reminder picture comprising an operation control for indicating to answer the incoming call request and an operation control for rejecting the incoming call request; in response to an event of the user inputting to answer the incoming call request, close the incoming call reminder picture; control the first display screen to pause playing media data in the first user interface, and control the first display screen to display a chat picture of an incoming call participant in the first user interface, the chat picture displaying a chat duration and operation controls for user operation in a semi-transparent manner.

2. The display device of claim 1, wherein, The controller is further configured to: in response to a user inputting a small-window video call instruction, control the first display screen to continue displaying the media data in the first user interface; control the second display screen to display a small-window video call picture in the second user interface, the small-window video call picture comprising a video picture of a video participant.

3. The display device of claim 1, wherein, The controller is further configured to: in response to a user inputting a small-window video call instruction, control the first display screen to close the chat picture in the first user interface; control the first display screen to display a small-window video call picture in a target area in the first user interface.

4. The display device of claim 1, wherein, The controller is further configured to: in response to a user switching request for the chat picture, control the first display screen to close the chat picture in the first user interface, and control the first display screen to play media data in the first user interface; control the second display screen to display a chat picture of an incoming call participant in the second user interface.

5. The display device of claim 1, wherein, The controller is further configured to: obtain an incoming call category in the incoming call request, the incoming call category comprising at least a video category and a voice category; if the incoming call category is the video category, control the second display screen to display a first control comprising answering a video in the second user interface, and set a focus on the first control; if the incoming call category is the voice category, control the second display screen to display a second control comprising answering a voice in the second user interface, and set a focus on the second control.

6. The display device of claim 1, wherein, The controller is further configured to: in response to an event of the user inputting to answer the incoming call request, close the incoming call reminder picture; control the second display screen to display a chat picture of an incoming call participant in the second user interface.

7. The display device of claim 6, wherein, The controller is further configured to: in response to a user switching request for the chat picture, control the first display screen to pause playing media data in the first user interface; The second display screen is controlled to close the chat picture, and the first display screen is controlled to display a chat picture of a calling participant in the first user interface.

8. The display device of claim 1, wherein, The controller is further configured to: In response to an event of a user inputting a rejection of the incoming call request, or in response to an event of an end of a call corresponding to the incoming call request, the first display screen is controlled to continue displaying the first user interface, and the second display screen is controlled to display preset information or to be set to a backlit state.

9. A display method characterized by comprising: The display method is applied to a display device, the display device comprising a first display screen, a second display screen, and a controller, the second display screen being independent of the first display screen in physical space; the display method comprising: In response to an incoming call request, a media category displayed in a first user interface is detected; In response to the media category being a video picture, a second display screen is controlled to display an incoming call reminder picture corresponding to the incoming call request in a second user interface, the incoming call reminder picture comprising an operation control for indicating acceptance of the incoming call request and an operation control for rejecting the incoming call request; In response to an event of a user inputting acceptance of the incoming call request, the incoming call reminder picture is closed; The first display screen is controlled to pause playing of media data in the first user interface, and the first display screen is controlled to display a chat picture of a calling participant in the first user interface, the chat picture displaying a chat duration and an operation control for user operation in a semi-transparent manner.

10. A display device, characterized by The display device comprises a first display screen, a second display screen, a first controller, and a second controller, wherein: The first display screen is configured to display a first user interface; The second display screen is configured to display a second user interface; the second display screen being independent of the first display screen in physical space; The first controller is configured to: In response to an incoming call request, a media category displayed in the first user interface is detected; In response to the media category being a video picture, an incoming call indication corresponding to the incoming call request is sent to the second controller, so that the second controller controls the second display screen to display an incoming call reminder picture in the second user interface after receiving the incoming call indication; the incoming call reminder picture comprising an operation control for indicating acceptance of the incoming call request and an operation control for rejecting the incoming call request; In response to an event of a user inputting acceptance of the incoming call request, the incoming call reminder picture is closed; The first display screen is controlled to pause playing of media data in the first user interface, and the first display screen is controlled to display a chat picture of a calling participant in the first user interface, the chat picture displaying a chat duration and an operation control for user operation in a semi-transparent manner. The second controller is configured to: Receive the incoming call indication sent by the first controller, and control the second display screen to display an incoming call reminder picture in the second user interface after receiving the incoming call indication.

11. The display device of claim 10, wherein, The second controller is further configured to: Analyze the incoming call reminder picture, the incoming call reminder picture comprising an incoming call category, the incoming call category at least comprising a video category and a voice category; if the incoming call category is the video category, controlling the second display screen to display a first control for answering the video call in the second user interface, and positioning focus on the first control; if the incoming call category is the voice category, controlling the second display screen to display a second control for answering the voice call in the second user interface, and positioning focus on the second control.

12. The display device of claim 10, wherein, The second controller is further configured to: receive a user inputted indication for answering the video call; in response to the indication for answering the video call, send a video call indication to the first controller, and close the incoming call reminder picture.

13. The display device of claim 12, wherein, The first controller is further configured to: in response to the video call indication, control the first display screen to pause playing the media data in the first user interface, and control the first display screen to display a video call picture in the first user interface, the video call picture displaying a chat duration in a semi-transparent manner and operation controls for user operation.

14. The display device of claim 13, wherein, The second controller is further configured to: identify a user indication through the operation controls, the operation controls including at least a hang-up control and a voice call answering control; in response to a user inputted operation on the hang-up control, send a hang-up indication corresponding to the hang-up control to the first controller, so that the first controller controls the second controller to close the incoming call reminder picture after receiving the hang-up indication; in response to a user inputted operation on the voice call answering control, send a voice call answering indication corresponding to the voice call answering control to the first controller, so that the first controller plays the incoming voice call after receiving the voice call answering indication, and controls the second display to display a voice call picture in the second user interface of the second display screen.

15. The display device of claim 13, wherein, The first controller is further configured to: receive a user inputted small window video call instruction; in response to the small window video call instruction, control the first display screen to close the video call picture in the first user interface, and send a small window video call instruction to the second controller, so that the second controller displays a small window video call picture in the second display screen after receiving the small window video call instruction.

16. A display method characterized by comprising: A display method applied to a display device, the display device including a first display screen, a second display screen, a first controller and a second controller, the second display screen being independent of the first display screen in physical space; the display method comprising: in response to an incoming call request, detecting a media category displayed in a first user interface; in response to the media category being a video picture, sending an incoming call indication corresponding to the incoming call request to the second controller, so that the second controller controls the second display screen to display an incoming call reminder picture in a second user interface after receiving the incoming call indication; the incoming call reminder picture including an operation control for answering the incoming call request and an operation control for rejecting the incoming call request; in response to a user inputted event for answering the incoming call request, closing the incoming call reminder picture; in response to a user inputted event for answering the incoming call request, closing the incoming call reminder picture; controlling the first display screen to pause playing of the media data in the first user interface, and controlling the first display screen to display a chat picture of a calling party in the first user interface, the chat picture displaying a chat duration and an operation control in a semi-transparent manner for user operation; a second controller configured to: receive the incoming call indication sent by the first controller, and control the second display screen to display a call reminder picture in the second user interface after receiving the incoming call indication.

Images