Dual-screen display method and display device
By employing a dual-screen display method in the display device, using the first display to play media assets and the second display to play promotional information, the problem of low media asset playback efficiency is solved, and promotional information can be effectively pushed without affecting media asset playback, thus improving the user experience.
Patent Information
- Application Number
- CN202010404387.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-05-13
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2040-05-13
AI Technical Summary
Inserting promotional information while media assets are playing on display devices results in low playback efficiency, long user wait times, negatively impacts user experience, and may lead to user churn.
A dual-screen display method is adopted, with the first display playing media assets and the second display playing promotional information. The controller sends requests to obtain and display promotional information during the media asset playback process, so as to achieve parallel playback of promotional information and media assets.
It improves the playback efficiency of media assets, avoids user waiting, enhances user experience, and ensures that promotional information can be effectively pushed without affecting the normal playback of media assets.
Smart Images

Figure CN113672182B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of display technology, and in particular to a dual-screen display method and a display device. Background Art
[0002] In the process of playing media through a display device, in order to promote user consumption, promotional information related to the content of the media may be inserted so as to push products corresponding to the promotional information to users. In the process of playing the promotional information on the display device, the media will be stopped, and it is necessary to wait for the promotional information to be finished before continuing to play the media. The user needs to wait for a long time before continuing to watch, which not only affects the user experience and reduces the playback efficiency of the media, but may also lead to user loss. Summary of the invention
[0003] The present application provides a dual-screen display method and a display device, which can solve the problem of low playback efficiency of related media resources. The technical solution is as follows:
[0004] In one aspect, a display device is provided, the display device comprising:
[0005] A first display and a second display, wherein the first display and the second display are configured to display different user interfaces, and any of the user interfaces further includes a selector, and the selector is used to move the position of the selector in any of the user interfaces in response to a user input so as to select a control in any of the user interfaces;
[0006] a controller in communication with the first display and the second display, respectively, the controller being configured to perform presentation of any one of the user interfaces;
[0007] The controller is also configured to:
[0008] Controlling the first display to play media resources;
[0009] During the playing of the media asset, in response to the current playing state of the media asset satisfying a promotion information push condition, sending a first request to a server, the first request being used to request to obtain promotion information associated with the media asset;
[0010] receiving promotion information sent by the server based on the first request;
[0011] The second display is controlled to play the promotion information.
[0012] In another aspect, a dual-screen display method is provided, the method comprising:
[0013] Playing the media asset on the first display;
[0014] During the playing of the media asset, in response to the current playing state of the media asset satisfying a promotion information push condition, sending a first request to a server, the first request being used to request to obtain promotion information associated with the media asset;
[0015] receiving promotion information sent by the server based on the first request;
[0016] The promotion information is played on the second display.
[0017] On the other hand, a computer-readable storage medium is provided, wherein a computer program is stored in the storage medium, and when the computer program is executed by a processor, the steps of the dual-screen display method described above are implemented.
[0018] On the other hand, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute the steps of the dual-screen display method described above.
[0019] The technical solution provided by this application can at least bring the following beneficial effects:
[0020] The display device includes a first display and a second display. Media assets can be played on the first display. During the process of playing the media assets, if the display device determines that the current playback status of the media assets meets the promotion information push conditions, it means that the promotion information can be pushed, and then a first request can be sent to the server. The server receives the promotion information associated with the media assets obtained based on the first request, and then plays the promotion information on the second display. In this way, when it is necessary to push promotion information, the promotion information can be played on the second display, so that the first display will not be occupied. The first display can still play the media assets normally without waiting for the promotion information to be played before continuing to play the media assets. The playback efficiency of the media assets is improved, and the user does not need to wait, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0022] Figure 1 is a schematic diagram showing an operation scenario between a display device and a control apparatus according to an exemplary embodiment;
[0023] Figure 2 is a configuration block diagram of a control device according to an exemplary embodiment;
[0024] Figure 3 is a schematic diagram of a hardware structure of a hardware system in a display device according to an exemplary embodiment;
[0025] Figure 4 is a schematic diagram showing a connection relationship between a power board and a load according to an exemplary embodiment;
[0026] Figure 5 is a hardware architecture block diagram of a display device according to an exemplary embodiment;
[0027] Figure 6 is a functional configuration diagram of a display device according to an exemplary embodiment;
[0028] Figure 7 is a configuration block diagram of a software system in a display device according to an exemplary embodiment;
[0029] Figure 8 is a structural diagram of an application layer of a display device according to an exemplary embodiment;
[0030] Fig. 9 is a schematic diagram of a user interface in a display device according to an exemplary embodiment;
[0031] Fig.10 is a flow chart of a dual-frequency display method according to an exemplary embodiment;
[0032] Fig.11 is a flow chart of a dual-frequency display method according to another exemplary embodiment;
[0033] Fig.12 is a schematic diagram of a first interface according to an exemplary embodiment;
[0034] Fig.13 is a schematic diagram of a second interface according to an exemplary embodiment;
[0035] Fig.14 The figure is a schematic diagram showing a method of playing media resources and promotion information according to an exemplary embodiment. DETAILED DESCRIPTION
[0036] In order to make the purpose, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, not all of the embodiments.
[0037] Based on the exemplary embodiments shown in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application. In addition, although the disclosure in this application is introduced according to one or several exemplary examples, it should be understood that each aspect of these disclosures can also constitute a complete technical solution separately.
[0038] It should be understood that the terms "first", "second", "third", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, for example, they can be implemented according to an order other than those given in the diagrams or descriptions of the embodiments of this application.
[0039] In addition, the terms "include" and "have" and any variations thereof are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to those components expressly listed but may include other components not expressly listed or inherent to such products or devices.
[0040] The term "module" as used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.
[0041] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0042] First, the concepts involved in this application are described in conjunction with the accompanying drawings. It should be noted that the following description of each concept is only to make the content of this application easier to understand and does not limit the scope of protection of this application.
[0043] The term "module" used in the embodiments of the present application may refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or a combination of hardware and / or software code that can perform the functions associated with the element.
[0044] The term "remote control" used in the embodiments of the present application refers to a component of an electronic device (such as the display device disclosed in the present application), which can usually wirelessly control the electronic device within a short distance. The component can generally use infrared and / or radio frequency (RF) signals and / or Bluetooth to connect to the electronic device, and can also include functional modules such as WiFi, wireless USB, Bluetooth, motion sensors, etc. For example: a handheld touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.
[0045] The term "gesture" used in the embodiments of the present application refers to a user's behavior of expressing an intended idea, action, purpose, or result through a change in hand shape or hand movement.
[0046] The term "hardware system" used in the embodiments of the present application may refer to a physical component with computing, control, storage, input and output functions, which is composed of mechanical, optical, electrical and magnetic devices such as integrated circuits (ICs) and printed circuit boards (PCBs). In the embodiments of the present application, the hardware system is also usually referred to as a motherboard or a chip.
[0047] Figure 1 FIG. 2 is a schematic diagram showing an operation scenario between a display device and a control device according to an embodiment. Figure 1 As shown, a user can operate the display device 200 through the control apparatus 100 .
[0048] The control device 100 may be a remote controller 100A, which may communicate with the display device 200 via infrared protocol communication, Bluetooth protocol communication, ZigBee protocol communication or other short-range communication methods, and is used to control the display device 200 wirelessly or in other wired ways. The user may input user commands through buttons on the remote controller 100A, voice input, control panel input, etc. to control the display device 200. For example, the user may input corresponding control commands through the volume plus and minus keys, channel control keys, up / down / left / right movement keys, voice input keys, menu keys, power on / off keys, etc. on the remote controller 100A to realize the function of controlling the display device 200.
[0049] The control device 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a laptop computer, etc., which can communicate with the display device 200 through a local area network (LAN), a wide area network (WAN), a wireless local area network (WLAN) or other networks, and control the display device 200 through an application corresponding to the display device 200. For example, the display device 200 is controlled using an application running on the smart device. The application can provide the user with various controls through an intuitive user interface (UI) on a screen associated with the smart device.
[0050] For example, both the mobile terminal 100B and the display device 200 can be installed with software applications, so that the connection and communication between the two can be achieved through the network communication protocol, thereby achieving the purpose of one-to-one control operation and data communication. For example, the mobile terminal 100B can establish a control command protocol with the display device 200, synchronize the remote control keyboard to the mobile terminal 100B, and realize the function of controlling the display device 200 by controlling the user interface on the mobile terminal 100B; the audio and video content displayed on the mobile terminal 100B can also be transmitted to the display device 200 to realize the synchronous display function.
[0051] like Figure 1 As shown, the display device 200 can also communicate data with the server 300 through various communication methods. In various embodiments of the present application, the display device 200 can be allowed to communicate with the server 300 through a local area network, a wireless local area network or other networks by wired communication or wireless communication. The server 300 can provide various content and interactions to the display device 200.
[0052] For example, the display device 200 receives software program updates or accesses a remotely stored digital media library by sending and receiving information and interacting with an electronic program guide (EPG). The server 300 can be a group or multiple groups, and can be one or more types of servers. Other network service content such as video on demand and advertising services are provided through the server 300.
[0053] The display device 200 includes a first display 201 and a second display 202 , wherein the first display 201 and the second display 202 are independent of each other, and a dual hardware control system is used between the first display 201 and the second display 202 .
[0054] The first display 201 and the second display 202 can be used to display different display images. For example, the first display 201 can be used to display images of traditional TV programs, and the second display 202 can be used to display images of auxiliary information such as notification messages and voice assistants.
[0055] Optionally, the content displayed on the first display 201 and the content displayed on the second display 202 can be independent of each other and do not affect each other. For example, when the first display 201 plays a TV program, the second display 202 can display information such as time, weather, temperature, reminder messages, etc. that are not related to the TV program.
[0056] Optionally, there may be an association relationship between the content displayed on the first display 201 and the content displayed on the second display 202. For example, when the first display 201 plays the main screen of the video chat, the second display 202 may display the avatar of the user currently accessing the video chat, the chat duration, and other information.
[0057] Optionally, part or all of the content displayed on the second display 202 can be adjusted to display on the first display 201. For example, the time, weather, temperature, reminder message and other information displayed on the first display 201 can be adjusted to display on the first display 201, and the second display 202 can be used to display other information.
[0058] In addition, the first display 201 displays the multi-party interaction screen while displaying the traditional TV program screen, and the multi-party interaction screen does not block the traditional TV program screen. Among them, the present application does not limit the display method of the traditional TV program screen and the multi-party interaction screen. For example, the present application can set the position and size of the traditional TV program screen and the multi-party interaction screen according to the priority of the traditional TV program screen and the multi-party interaction screen.
[0059] Taking the example that the priority of the traditional TV program screen is higher than the priority of the multi-party interaction screen, the area of the traditional TV program screen is larger than the area of the multi-party interaction screen, and the multi-party interaction screen can be located on one side of the traditional TV program screen, or it can be suspended in a corner of the multi-party interaction screen.
[0060] The display device 200 can be, on the one hand, a liquid crystal display, an OLED (Organic Light Emitting Diode) display, or a projection display device; on the other hand, the display device can be a display system composed of a smart TV or a display and a set-top box. The specific display device type, size, and resolution are not limited. It is understood by those skilled in the art that the display device 200 can make some changes in performance and configuration as needed.
[0061] In addition to providing the broadcast receiving television function, the display device 200 may also provide an intelligent network television function that provides computer support functions. Examples include network television, smart television, Internet Protocol television (IPTV), etc. In some embodiments, the display device may not have the broadcast receiving television function.
[0062] like Figure 1 As shown, a camera may be connected or provided on the display device 200 to present the image captured by the camera on the display interface of the display device or other display devices to realize interactive chat between users. Specifically, the image captured by the camera may be displayed in full screen, half screen, or any optional area on the display device.
[0063] As an optional connection method, the camera is connected to the back shell of the display device through a connecting plate and is fixedly installed in the upper middle part of the back shell of the display device. As an installable method, it can be fixedly installed at any position of the back shell of the display device, as long as its image acquisition area is not blocked by the back shell. For example, the image acquisition area has the same display orientation as the display device.
[0064] As another optional connection method, the camera can be raised and lowered to the back shell of the display device through a connecting plate or other conceivable connector. A lifting motor is installed on the connector. When the user wants to use the camera or an application wants to use the camera, the camera is raised above the display device. When the camera is not needed, it can be embedded behind the back shell to protect the camera from damage and protect the user's privacy.
[0065] As an embodiment, the camera used in the present application may be 16 million pixels to achieve ultra-high-definition display. In actual use, a camera with higher or lower pixels than 16 million pixels may also be used.
[0066] When a camera is installed on a display device, the content displayed by the display device in different application scenarios can be integrated in a variety of different ways, thereby achieving functions that traditional display devices cannot achieve.
[0067] For example, a user can have a video chat with at least one other user while watching a video program. The video program can be presented as a background image, and the video chat window is displayed on the background image. This function can be called "watch and chat" figuratively.
[0068] Optionally, in a "watch and chat" scenario, while watching a live video or an online video, at least one video chat can be conducted across terminals.
[0069] In another example, a user can have a video chat with at least one other user while learning in an educational application. For example, a student can interact with a teacher remotely while learning the content in an educational application. This function can be vividly called "learning and chatting".
[0070] In another example, a user can have a video chat with other players while playing a card game. For example, when a player enters a game application to participate in a game, he or she can interact with other players remotely. This function can be called "watch and play".
[0071] Optionally, the game scene is integrated with the video screen, and the portrait in the video screen is cut out and displayed in the game screen to enhance the user experience.
[0072] Optionally, in somatosensory games (such as ball, boxing, running, dancing, etc.), the camera can be used to obtain human posture and movement, limb detection and tracking, and detection of key points of the human skeleton, which are then integrated with the animation in the game to realize games such as sports, dance and other scenes.
[0073] In another example, a user can interact with at least one other user through video and voice in a karaoke application. This function can be called "watch and sing". Optionally, when at least one user enters the application in a chat scene, multiple users can complete the recording of a song together.
[0074] In another example, users can open the camera locally to obtain pictures and videos. Figuratively, this function can be called "looking in the mirror."
[0075] In other examples, more functions may be added or the above functions may be reduced. This application does not specifically limit the functions of the display device.
[0076] Figure 2 FIG. 2 exemplarily shows a block diagram of a configuration of a control device 100 according to an exemplary embodiment. Figure 2 As shown, the control device 100 includes a controller 110 , a communicator 130 , a user input / output interface 140 , a memory 190 , and a power supply 180 .
[0077] The control device 100 is configured to control the display device 200, receive the user's input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive medium between the user and the display device 200. For example, the user operates the channel increase and decrease keys on the control device 100, and the display device 200 responds to the channel increase and decrease operations.
[0078] In some embodiments, the control device 100 may be a smart device, for example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.
[0079] In some embodiments, Figure 1 As shown, the mobile terminal 100B or other smart electronic device can play a similar function to the control device 100 after installing the application for controlling the display device 200. For example, the user can install the application to realize the functions of the physical buttons of the control device 100 through various function keys or virtual buttons of the graphical user interface provided on the mobile terminal 100B or other smart electronic device.
[0080] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between the internal components and the external and internal data processing functions.
[0081] Under the control of the controller 110, the communicator 130 realizes the communication of control signals and data signals with the display device 200. For example, the received user input signal is sent to the display device 200. The communicator 130 may include at least one of the communication modules such as the WIFI module 131, the Bluetooth module 132, and the NFC module 133.
[0082] The user input / output interface 140 includes at least one of a microphone 141, a touch panel 142, a sensor 143, a button 144, a camera 145, and the like. For example, the user can input user commands through voice, touch, gesture, pressing, and the like. The input interface converts the received analog signal into a digital signal, and the digital signal into a corresponding command signal, and sends the result to the display device 200.
[0083] The output interface includes an interface for sending received user commands to the display device 200. In some embodiments, it can be an infrared interface or a radio frequency interface. For example, in the case of an infrared signal interface, the user input command needs to be converted into an infrared control signal according to an infrared control protocol, and then sent to the display device 200 via an infrared sending module. For another example, in the case of a radio frequency signal interface, the user input command needs to be converted into a digital signal, and then modulated according to a radio frequency control signal modulation protocol, and then sent to the display device 200 by a radio frequency sending terminal.
[0084] In some embodiments, the control device 100 includes at least one of a communicator 130 and an output interface. The control device 100 is configured with a communicator 130, such as a WIFI, Bluetooth, NFC or other module, which can encode the user input command through the WIFI protocol, Bluetooth protocol, or NFC protocol and send it to the display device 200.
[0085] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller 110. The memory 190 can store various control signal instructions input by the user.
[0086] The power supply 180 is used to provide operating power support for various electrical components of the control device 100 under the control of the controller 110. The power supply 180 can be powered by a battery and related control circuits.
[0087] Figure 3 FIG. 2 is a schematic diagram showing a hardware structure of a hardware system in a display device 200 according to an exemplary embodiment. For ease of explanation, Figure 3 The display device 200 is illustrated by taking a liquid crystal display screen as an example.
[0088] Figure 3 As shown, the display device 200 includes: a first panel 11, a first backlight assembly 21, a main board 31, an interactive board 32, a first display driver board 33, a second panel 12, a second backlight assembly 22, a second display driver board 34, a power board 4, a first rear shell 51, a second rear shell 52 and a base 6.
[0089] Among them, the first panel 11 is used to present the screen of the first display 201 to the user. The first backlight assembly 21 is located below the first panel 11, and is usually some optical components, which are used to supply sufficient brightness and uniformly distributed light sources so that the first panel 11 can display images normally. The first backlight assembly 21 also includes a first backplane (not shown in the figure). The mainboard 31, the interactive board 32, the first display driver board 33 and the power board 4 are arranged on the first backplane, and some convex structures are usually stamped on the first backplane. The mainboard 31, the interactive board 32, the first display driver board 33 and the power board 4 are fixed on the convex bulge by screws or hooks. The mainboard 31, the interactive board 32, the first display driver board 3 and the power board 4 can be arranged on one board, or they can be arranged on different boards respectively. The first rear shell 51 is covered on the first panel 11 to hide the components of the display device 200 such as the first backlight assembly 21, the mainboard 31, the interactive board 32, the first display driver board 33 and the power board 4, so as to achieve a beautiful effect.
[0090] Among them, the main functions of the first display driver board 33 are: through the PWM signal and Lcaldimming signal transmitted by the N chip on the mainboard 31, to perform thousand-level backlight partition control, this part of the control is changed according to the image content, and after establishing a handshake with the N chip on the mainboard 31, to receive the VbyOne display signal sent by the N chip on the mainboard 31, and convert the VbyOne display signal into an LVDS signal to realize the image display of the first display 201. The base 6 is used to support the display device 200. It is worth noting that only one form of base design is shown in the figure, and those skilled in the art can design different forms of bases according to product requirements.
[0091] Among them, the second panel 12 is used to present the screen of the second display 202 to the user. The second backlight assembly 22 is located below the second panel 12, which is usually some optical components, used to supply sufficient brightness and evenly distributed light sources so that the second panel 12 can display images normally. The second backlight assembly 22 also includes a second back plate (not shown in the figure). The second display driver board 34 is arranged on the second back plate, and some convex structures are usually stamped on the second back plate. The second display driver board 34 is fixed to the convex bulge by screws or hooks. The second display driver board 34 can be arranged on one board, or it can be arranged on different boards respectively. The second rear shell 52 is covered on the second panel 12 to hide the components of the display device 200 such as the second backlight assembly 22, the adapter driver board, the second TCON board and the key board 35, so as to achieve an aesthetic effect.
[0092] Optionally, Figure 3 The key panel 35 is also included, and the key panel 35 can be arranged on the first back panel or on the second back panel, which is not limited in the present application.
[0093] In addition, the display device 200 also includes a sound reproduction device (not shown in the figure), such as an audio component, such as an I2S interface including a power amplifier (AMP) and a speaker (Speaker), for achieving sound reproduction. Usually, the audio component can achieve at least two-channel sound output; when the panoramic surround effect is to be achieved, multiple audio components need to be set to output multiple channels of sound, which will not be described in detail here.
[0094] It should be noted that the display device 200 may also use an OLED display screen, so that the template included in the display device 200 changes accordingly, which will not be explained in detail here.
[0095] Figure 4 The schematic diagram of the connection relationship between the power board and the load is shown in FIG. Figure 4As shown, the power board 4 includes an input terminal IN and an output terminal OUT (a first output terminal OUT1, a second output terminal OUT2, a third output terminal OUT3, a fourth output terminal OUT4 and a fifth output terminal OUT5 are shown in the figure), wherein the input terminal IN is connected to the mains, and the output terminal OUT is connected to the load, for example, the first output terminal OUT1 is connected to a light-emitting element (such as a light bar or a self-luminous device, etc.), the second output terminal OUT2 is connected to an audio component, the third output terminal OUT3 is connected to a main board 31, the fourth output terminal OUT4 is connected to a first display driver board 33, and the fifth output terminal OUT5 is connected to a first backlight component 21. The power board 4 needs to convert the AC mains into the DC power required by the load, and the DC power usually has different specifications, for example, the audio component needs 18V, the panel needs 12V / 18V, etc.
[0096] For ease of description, one hardware system in the dual hardware system architecture is referred to as the first hardware system or A system, A chip, and the other hardware system is referred to as the second hardware system or N system, N chip. The A chip includes the A chip controller and various modules connected to the A chip controller through various interfaces, and the N chip includes the N chip controller and various modules connected to the N chip controller through various interfaces. A relatively independent operating system can be installed in each of the A chip and the N chip, and the operating system of the A chip and the operating system of the N chip can communicate with each other through a communication protocol. For example: the framework layer of the operating system of the A chip and the framework layer of the operating system of the N chip can communicate to transmit commands and data, so that there are two independent but interrelated subsystems in the display device 200.
[0097] Combine the following Figure 5 The dual hardware system architecture of this application is further explained. Figure 5 This is merely an exemplary description of the dual hardware system architecture of the present application and does not limit the present application. In practical applications, both hardware systems may include more or less hardware or interfaces as required.
[0098] Figure 5 The example shows that according to Figure 3 The hardware architecture block diagram of the display device 200 is shown in FIG. Figure 5 As shown, the hardware system of the display device 200 includes an A chip and an N chip, as well as modules connected to the A chip or the N chip through various interfaces.
[0099] Among them, chip A can be set in Figure 3 Optionally, chip A mainly implements online video playback and the operation of third-party applications installed by users, similar to an OTT box, and also has a built-in camera. Figure 3 Optionally, N chip: mainly realizes traditional TV functions (such as external set-top box, etc.), displays A chip screen and is responsible for network sharing to A chip, and remote control button transparent transmission to A chip (to achieve the function that remote control can control A chip).
[0100] The N chip may include a tuner 220, a communicator 230, an external device interface 250, a first controller 210, a memory 290, a user input interface 260-3, a video processor 260-1, an audio processor 260-2, a first display 280 (i.e. Figure 2 The first display 201 in the embodiment of the present invention), the audio output interface 270, and the power supply module 240. In other embodiments, the N chip may also include more or fewer modules.
[0101] The tuner-demodulator 220 is used to perform modulation and demodulation processing such as amplification, mixing and resonance on the broadcast television signals received by wired or wireless means, so as to demodulate the audio and video signals carried in the frequency of the TV channel selected by the user, as well as additional information (such as EPG data signal) from multiple wireless or wired broadcast television signals. Depending on the broadcast format of the television signal, the signal path of the tuner-demodulator 220 can be in many ways, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting; and according to different modulation types, the signal adjustment method can be digital modulation or analog modulation; and according to different types of received television signals, the tuner-demodulator 220 can demodulate analog signals and / or digital signals.
[0102] The tuner-demodulator 220 is further configured to respond to the TV channel frequency selected by the user and the TV signal carried by the frequency according to the user's selection and under the control of the first controller 210 .
[0103] In some other exemplary embodiments, the tuner 220 may also be in an external device, such as an external set-top box, etc. In this way, the set-top box outputs the television audio and video signals after modulation and demodulation, and inputs them into the display device 200 through the external device interface 250 .
[0104] The communicator 230 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communicator 230 may include a WIFI module 231, a Bluetooth communication protocol module 232, a wired Ethernet communication protocol module 233, and other network communication protocol modules or near field communication protocol modules such as an infrared communication protocol module (not shown in the figure).
[0105] The display device 200 may establish a connection for control signals and data signals with an external control device or a content providing device through the communicator 230. For example, the communicator may receive a control signal of the remote controller 100 according to the control of the first controller 210.
[0106] The external device interface 250 is a component that provides data transmission between the first controller 210 of the N chip and the A chip and other external devices. The external device interface 250 can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired / wireless manner, and can receive data such as video signals (such as moving images), audio signals (such as music), additional information (such as EPG), etc. from the external devices.
[0107] The external device interface 250 may include: a high-definition multimedia interface (HDMI) terminal also referred to as HDMI 251, a composite video blanking synchronization (CVBS) terminal also referred to as AV 252, an analog or digital component terminal also referred to as component 253, a universal serial bus (USB) terminal 254, a red, green, and blue (RGB) terminal (not shown in the figure), etc. Any one or more of the above. The present application does not limit the number and type of external device interfaces.
[0108] The first controller 210 controls the operation of the display device 200 and responds to user operations by running various software control programs (such as an operating system and / or various application programs) stored in the memory 290 .
[0109] like Figure 5 As shown, the first controller 210 includes a read-only memory ROM 213, a random access memory RAM 214, a graphics processor 216, a CPU processor 212, a communication interface 218, and a communication bus. Among them, the ROM 213 and the RAM 214 and the graphics processor 216, the CPU processor 212, and the communication interface 218 are connected through the bus.
[0110] ROM 213 is used to store various system startup instructions. For example, when a power-on signal is received, the display device 200 starts to power on, and the CPU processor 212 runs the system startup instructions in the ROM, and copies the operating system stored in the memory 290 to the RAM 214 to start running the startup operating system. After the operating system is started, the CPU processor 212 copies various application programs in the memory 290 to the RAM 214, and then starts running the startup various application programs.
[0111] The graphics processor 216 is used to generate various graphic objects, such as icons, operation menus, and user input command display graphics. It includes an operator, which performs operations by receiving various interactive instructions input by the user and displays various objects according to display attributes. It also includes a renderer, which generates various objects based on the operator, and displays the rendered results on the first display 280.
[0112] The CPU processor 212 is used to execute the operating system and application instructions stored in the memory 290, and execute various applications, data and content according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents.
[0113] In some exemplary embodiments, the CPU processor 212 may include multiple processors. The multiple processors may include a main processor and multiple or one sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power-on mode and / or the operation of displaying a picture in the normal mode. The multiple or one sub-processors are used to perform an operation in the standby mode and the like.
[0114] The communication interface 218 may include a first interface 218-1 to an nth interface 218-n, which may be a network interface connected to an external device via a network.
[0115] The first controller 210 may control operations of the display device 200 related to the first display screen 280. For example, in response to receiving a user command for selecting a UI object to be displayed on the first display 280, the first controller 210 may perform operations related to the object selected by the user command.
[0116] The first controller 210 may control operations of the display device 200 related to the second display screen 380. For example, in response to receiving a user command for selecting a UI object to be displayed on the second display 380, the first controller 210 may perform operations related to the object selected by the user command.
[0117] The object may be any one of the selectable objects, such as a hyperlink or an icon. Operations related to the selected object may include, for example, displaying a page, document, image, etc. connected to the hyperlink, or executing a program corresponding to the icon. User commands for selecting UI objects may be commands inputted through various input devices (e.g., a mouse, keyboard, touchpad, etc.) connected to the display device 200 or voice commands corresponding to voices spoken by the user.
[0118] The memory 290 includes various software modules for driving and controlling the display device 200. For example, the various software modules stored in the memory 290 include basic modules, detection modules, communication modules, display control modules, browser modules, and various service modules (not shown in the figure).
[0119] Among them, the basic module is a bottom-level software module used for signal communication between various hardware in the display device 200 and sending processing and control signals to the upper-level modules. The detection module is a management module used to collect various information from various sensors or user input interfaces, and perform digital-to-analog conversion and analysis and management. The speech recognition module includes a speech analysis module and a speech command database module. The display control module is a module used to control the first display 280 to display image content, and can be used to play multimedia image content and UI interface information. The communication module is a module used for control and data communication with external devices. The browser module is a module used to perform data communication between browsing servers. The service module is a module used to provide various services and various applications.
[0120] At the same time, the memory 290 is also used to store received external data and user data, images of various items in various user interfaces, and visual effect images of focus objects, etc.
[0121] The user input interface 260-3 is used to send the user's input signal to the first controller 210, or transmit the signal output from the first controller 210 to the user. Exemplarily, the control device (such as a mobile terminal or a remote controller) can send the user's input signal such as a power switch signal, a channel selection signal, a volume adjustment signal, etc. to the user input interface, and then forward it to the first controller 210 by the user input interface 260-3; or, the control device can receive the output signal such as audio, video or data output from the user input interface 260-3 after being processed by the first controller 210, and display the received output signal or output the received output signal in the form of audio or vibration.
[0122] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the first display 280, and the user input interface 260-3 receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface 260-3 receives the user input command by recognizing the sound or gesture through a sensor.
[0123] The video processor 260-1 is used to receive the video signal and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal, and can obtain a video signal that is directly displayed or played on the first display 280.
[0124] For example, the video processor 260 - 1 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, etc. (not shown in the figure).
[0125] The demultiplexing module is used to demultiplex the input audio and video data streams. For example, if MPEG-2 is input, the demultiplexing module demultiplexes the data streams into video signals and audio signals.
[0126] The video decoding module is used to process the demultiplexed video signal, including decoding and scaling processing.
[0127] The image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator according to the user input or itself with the scaled video picture to generate an image signal for display.
[0128] The frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of the input 24Hz, 25Hz, 30Hz, 60Hz video into a frame rate of 60Hz, 120Hz or 240Hz, wherein the input frame rate may be related to the source video stream, and the output frame rate may be related to the refresh rate of the display device. The display formatting module is used to change the signal output by the frame rate conversion module into a signal that conforms to the display format of the display device, such as converting the format of the signal output by the frame rate conversion module to output an RGB data signal.
[0129] The first display 280 is used to receive the image signal input from the video processor 260-1, and display the video content and image as well as the menu control interface. The first display 280 includes a display component for presenting the picture and a driving component for driving the image display. The displayed video content can be the video in the broadcast signal received by the tuner demodulator 220, or the video content input from the communicator or the external device interface. The first display 280 also displays the user control interface UI generated in the display device 200 and used to control the display device 200.
[0130] Furthermore, depending on the type of the first display 280, a driving component for driving the display is also included. Alternatively, if the first display 280 is a projection display, a projection device and a projection screen may also be included.
[0131] The audio processor 260 - 2 is used to receive the audio signal, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion and amplification processing to obtain an audio signal that can be played in the speaker 272 .
[0132] The audio output interface 270 is used to receive the audio signal output by the audio processor 260-2 under the control of the first controller 210. The audio output interface may include a speaker 272, or an external audio output terminal 274 of a generating device that outputs to an external device, such as an external audio terminal or a headphone output terminal.
[0133] In some other exemplary embodiments, the video processor 260-1 may include one or more chips. The audio processor 260-2 may also include one or more chips.
[0134] Furthermore, in some other exemplary embodiments, the video processor 260 - 1 and the audio processor 260 - 2 may be separate chips, or may be integrated into one or more chips together with the first controller 210 .
[0135] The power supply module 240 is used to provide power supply support for the display device 200 with power input from an external power source under the control of the first controller 210. The power supply module 240 may include a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200, such as a power supply interface for providing an external power supply in the display device 200.
[0136] Similar to N chips, such as Figure 5 As shown, chip A may include a second controller 310, a communicator 330, a detector 340, a memory 390, a second display 380 (i.e. Figure 2 In some embodiments, the second display 202 in the A chip may also include a user input interface, a video processor, an audio processor, a display, and an audio output interface (not shown in the figure). In some embodiments, there may also be a power supply module (not shown in the figure) that independently supplies power to the A chip.
[0137] The communicator 330 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communicator 330 may include a WIFI module 331, a Bluetooth communication protocol module 332, a wired Ethernet communication protocol module 333, and other network communication protocol modules or near field communication protocol modules such as an infrared communication protocol module (not shown in the figure).
[0138] The communicator 330 of the A chip and the communicator 230 of the N chip also interact with each other. For example, the WiFi module 231 in the N chip hardware system is used to connect to the external network and generate network communication with external servers, etc. The WiFi module 331 in the A chip hardware system is used to connect to the WiFi module 231 of the N chip, and does not directly connect to the external network, etc. The A chip connects to the external network through the N chip. Therefore, for the user, a display device such as the above embodiment only displays a WiFi account to the outside.
[0139] The detector 340 is a component of the display device A chip used to collect signals from the external environment or interact with the outside. The detector 340 may include a light receiver 342, a sensor for collecting ambient light intensity, which can adapt to changes in display parameters by collecting ambient light; it may also include an image collector 341, such as a camera, which can be used to collect external environmental scenes, as well as to collect user attributes or gestures for interacting with the user, which can adaptively change display parameters, and can also recognize user gestures to achieve the function of interacting with the user.
[0140] The external device interface 350 is a component for data transmission between the second controller 310 and the N chip or other external devices. The external device interface can be connected to external devices such as set-top boxes, game devices, and laptop computers in a wired or wireless manner.
[0141] The video processor 360 is used to process relevant video signals.
[0142] The second controller 310 controls the operation of the display device 200 and responds to user operations by running various software control programs (such as installed third-party applications, etc.) stored in the memory 390 and interacting with the N chip.
[0143] like Figure 5 As shown, the second controller 310 includes a read-only memory ROM 313, a random access memory RAM 314, a graphics processor 316, a CPU processor 312, a communication interface 318, and a communication bus. Among them, the ROM 313 and the RAM 314 and the graphics processor 316, the CPU processor 312, and the communication interface 318 are connected through the bus.
[0144] ROM 313 is used to store various system startup instructions. CPU processor 312 runs the system startup instructions in ROM and copies the operating system stored in memory 390 to RAM 314 to start running the operating system. After the operating system is started, CPU processor 312 copies various application programs in memory 390 to RAM 314, and then starts running various application programs.
[0145] The CPU processor 312 is used to execute the operating system and application instructions stored in the memory 390, and to communicate with the N chip, transmit and interact with signals, data, instructions, etc., and execute various applications, data and content based on various interactive instructions received from the outside, so as to ultimately display and play various audio and video contents.
[0146] There are multiple communication interfaces 318, which may include a first interface 318-1 to an nth interface 318-n. These interfaces may be network interfaces connected to external devices via a network, or may be network interfaces connected to an N chip via a network.
[0147] The second controller 310 may control operations of the display device 200 related to the second display screen 380. For example, in response to receiving a user command for selecting a UI object to be displayed on the second display screen 380, the second controller 310 may perform operations related to the object selected by the user command.
[0148] The second controller 310 may control the operation of the display device 200 related to the first display screen 280. For example, in response to receiving a user command for selecting a UI object to be displayed on the first display screen 280, the first controller 210 may perform an operation related to the object selected by the user command.
[0149] The graphics processor 316 is used to generate various graphic objects, such as icons, operation menus, and user input command display graphics. It includes an operator, which performs operations by receiving various interactive instructions input by the user and displays various objects according to display attributes. It also includes a renderer, which generates various objects based on the operator, and displays the rendered results on the second display 380.
[0150] Both the graphics processor 316 of the A chip and the graphics processor 216 of the N chip can generate various graphic objects. Specifically, if application 1 is installed on the A chip and application 2 is installed on the N chip, when the user is in the interface of application 1 and performs user input commands in application 1, the graphics processor 316 of the A chip generates graphic objects. When the user is in the interface of application 2 and performs user input commands in application 2, the graphics processor 216 of the N chip generates graphic objects.
[0151] Figure 6 Schematic diagram of functional configuration of a display device according to an exemplary embodiment is exemplarily shown in FIG.
[0152] like Figure 6As shown, the memory 390 of the A chip and the memory 290 of the N chip are respectively used to store operating systems, applications, content, user data, etc., and drive the system operation of the first display 280 and the second display 380 and respond to various operations of the user under the control of the second controller 310 of the A chip and the second controller 210 of the N chip. The memory 390 of the A chip and the memory 290 of the N chip may include volatile and / or non-volatile memory.
[0153] For the N chip, the memory 290 is specifically used to store the operating program that drives the first controller 210 in the display device 200, and to store various applications built into the display device 200, various applications downloaded by users from external devices, various graphical user interfaces related to the applications, various objects related to the graphical user interfaces, user data information, and various internal data supporting the applications. The memory 290 is used to store system software such as the operating system (OS) kernel, middleware, and applications, as well as to store input video data and audio data, and other user data.
[0154] The memory 290 is specifically used to store drivers and related data such as the video processor 260-1 and the audio processor 260-2, the first display 280, the communicator 230, the tuner and demodulator 220, and the input / output interface.
[0155] In some embodiments, the memory 290 may store software and / or programs, and the software programs used to represent the operating system (OS) include, for example, a kernel, middleware, an application programming interface (API), and / or an application. Exemplarily, the kernel may control or manage system resources, or functions implemented by other programs (such as the middleware, API, or application), and the kernel may provide an interface to allow the middleware and API, or the application to access the controller to control or manage system resources.
[0156] For example, the memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, a first audio control module 2906, an external command recognition module 2907, a communication control module 2908, an optical receiving module, a power control module 2910, an operating system 2911, and other application programs 2912, a browser module 2913, etc. The first controller 210 executes various functions such as: broadcast television signal reception and demodulation function, television channel selection control function, volume selection control function, image control function, display control function, audio control function, external command recognition function, communication control function, optical signal reception function, power control function, software control platform supporting various functions, and browser function by running various software programs in the memory 290.
[0157] The memory 390 includes various software modules for driving and controlling the display device 200. For example, the various software modules stored in the memory 390 include a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules (not shown in the figure). Since the functions of the memory 390 and the memory 290 are similar, the relevant parts can be referred to the memory 290, and will not be repeated here.
[0158] For example, the memory 390 includes an image control module 3904, a second audio control module 3906, an external command recognition module 3907, a communication control module 3908, a light receiving module 3909, an operating system 3911, and other applications 3912, a browser module 3913, etc. The first controller 210 executes various functions such as image control function, display control function, audio control function, external command recognition function, communication control function, light signal receiving function, power control function, software control platform supporting various functions, and browser function by running various software programs in the memory 290.
[0159] Distinctively, the external instruction recognition module 2907 of the N chip and the external instruction recognition module 3907 of the A chip can recognize different instructions.
[0160] Exemplarily, since the image receiving device such as a camera is connected to the A chip, the external command recognition module 3907 of the A chip may include a graphic recognition module 2907-1, and a graphic database is stored in the graphic recognition module 3907-1. When the camera receives a graphic command from the outside, it corresponds to the command in the graphic database to control the display device. Since the voice receiving device and the remote control are connected to the N chip, the external command recognition module 2907 of the N chip may include a voice recognition module 2907-2, and a voice database is stored in the voice recognition module 2907-2. When the voice receiving device receives a voice command from the outside, it corresponds to the command in the voice database to control the display device. Similarly, the control device 100 such as a remote control is connected to the N chip, and the key command recognition module 2907-3 interacts with the control device 100.
[0161] Figure 7 Schematically shows a configuration block diagram of a software system in a display device 200 according to an exemplary embodiment.
[0162] For N chips, such as Figure 7 As shown in , the operating system 2911, including execution operation software for processing various basic system services and for implementing hardware-related tasks, acts as a medium between application programs and hardware components to complete data processing.
[0163] In some embodiments, part of the operating system kernel may include a series of software to manage display device hardware resources and provide services for other programs or software codes.
[0164] In some other embodiments, a portion of the operating system kernel may include one or more device drivers, which may be a set of software codes in the operating system that help operate or control devices or hardware associated with the display device. The driver may include code to operate video, audio, and / or other multimedia components. Examples include display, camera, Flash, WiFi, and audio drivers.
[0165] Among them, the accessibility module 2911-1 is used to modify or access the application to achieve the accessibility of the application and the operability of its displayed content.
[0166] The communication module 2911 - 2 is used to connect to other peripheral devices via relevant communication interfaces and communication networks.
[0167] The user interface module 2911 - 3 is used to provide objects for displaying the user interface for access by various application programs, thereby achieving user operability.
[0168] Control application 2911-4 is used for control process management, including runtime applications, etc.
[0169] The event transmission system 2914 may be implemented in the operating system 2911 or in the application 2912. In some embodiments, the event transmission system 2914 is implemented in the operating system 2911 and in the application 2912, and is used to monitor various user input events, and implement one or more sets of predefined operation processing procedures according to the recognition results of various events or sub-events in response to various event references.
[0170] The event monitoring module 2914-1 is used to monitor input events or sub-events of the user input interface.
[0171] The event identification module 2914-2 is used to define various types of events inputted by various user input interfaces, identify various events or sub-events, and transmit them to the processor for executing one or more corresponding processing procedures.
[0172] Among them, events or sub-events refer to inputs detected by one or more sensors in the display device 200, as well as inputs from external control devices (such as the control device 100, etc.). For example: various sub-events of voice input, gesture input sub-events of gesture recognition, and sub-events of remote control key command input of the control device, etc. For example, one or more sub-events in the remote control include multiple forms, including but not limited to one or a combination of pressing up / down / left / right / , confirming key, pressing and holding a key, etc. And operations of non-physical keys, such as moving, pressing, releasing, etc.
[0173] The interface layout management module 2913 directly or indirectly receives user input events or sub-events monitored by the event transmission system 2914, and is used to update the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the size or position and hierarchy of the container and other execution operations related to the interface layout.
[0174] Since the functions of the operating system 3911 of the A chip and the operating system 2911 of the N chip are similar, please refer to the operating system 2911 for the relevant details and will not be repeated here.
[0175] like Figure 8 As shown in , the application layer of the display device includes various applications that can be executed on the display device 200.
[0176] The application layer 2912 of the N chip may include but is not limited to one or more applications, such as video on demand applications, application centers, game applications, etc. The application layer 3912 of the A chip may include but is not limited to one or more applications, such as live TV applications, media center applications, etc. It should be noted that what applications are included in the A chip and the N chip is determined according to the operating system and other designs, and this application does not need to make specific limitations and divisions on the applications included in the A chip and the N chip.
[0177] The live TV application can provide live TV through different signal sources. For example, the live TV application can provide a TV signal using input from cable TV, wireless broadcast, satellite service, or other types of live TV services. And, the live TV application can display the video of the live TV signal on the display device 200.
[0178] Video on demand applications can provide videos from different storage sources. Unlike live TV applications, video on demand provides video display from some storage source. For example, video on demand can come from the server side of cloud storage, or from the local hard disk storage containing stored video programs.
[0179] Media center applications can provide various multimedia content playback applications. For example, a media center can be a service that users can access various images or audios through a media center application, which is different from live TV or video on demand.
[0180] The application center can provide and store various applications. The application can be a game, an application, or some other application related to a computer system or other device but can be run on the display device. The application center can obtain these applications from different sources, store them in a local storage, and then run them on the display device 200.
[0181] Since the A chip and the N chip may be installed with independent operating systems respectively, there are two independent but interrelated subsystems in the display device 200. For example, the A chip and the N chip may be independently installed with Android and various APPs, so that each chip can realize certain functions, and the A chip and the N chip can cooperate to realize a certain function.
[0182] Fig. 9 FIG. 2 is a schematic diagram of a user interface in a display device 200 according to an exemplary embodiment. Fig. 9As shown, the user interface includes a first view display area 2011 and a second view display area 2021. The functions of the first view display area 2011 and the second view display area 2021 are basically the same, and only the first view display area 2011 is described in detail below. In the example, the first view display area 2011 includes a layout of one or more different items. And the user interface also includes a selector indicating that an item is selected, and the position of the selector can be moved by user input to change the selection of different items.
[0183] In some embodiments, the first view display area 2011 is a scalable view display. “Scalable” may mean that the size or proportion of the first view display area 2011 on the screen is scalable, or the size or proportion of the items in the view display 201 on the screen is scalable.
[0184] An "item" refers to a visual object such as an icon, thumbnail, video clip, etc. displayed in the view display area of the user interface in the display device 200 to represent the corresponding content. For example, an item can represent the image content or video clip of a movie or TV series, the audio content of music, an application, or other user access history information of the content.
[0185] In addition, the item may represent an interface or interface set display for connecting the display device 200 to an external device, or may represent the name of an external device connected to the display device, etc. For example: a signal source input interface set, or a High Definition Multimedia Interface (HDMI), a USB interface, a PC terminal interface, etc.
[0186] It should be noted that the view display area can present video chat project content, or application layer project content (such as web video, cloud video on demand (Video on Demand, VOD) display, application screen, etc.).
[0187] The "selector" is used to indicate that any item has been selected, such as a cursor or a focus object. The selection information input is positioned according to the icon or menu position touched by the user in the display 200, and the movement of the focus object displayed in the display device 200 can be used to select the control item, and one or more items can be selected or controlled.
[0188] The focus object refers to an object that moves between items according to user input. For example, the focus object position is realized or identified by drawing a thick line on the edge of the item. In other embodiments, the focus form is not limited to the example, and can be a tangible or intangible form that can be recognized by the user, such as a cursor, etc., such as a 3D deformation of the item, or a border line, size, color, transparency, outline, and / or font of the text or image of the focused item.
[0189] The event transmission system 2914 can monitor the user input of each predefined event or sub-event, and provide the control of the identified event or sub-event directly or indirectly to the interface layout management module 2913.
[0190] The interface layout management module 2913 is used to monitor the user interface status (including the position and / or size, change process, etc. of view partitions, items, focus or cursor objects, etc.), and according to the event or sub-event, can modify the size and position, hierarchy, etc. of the view display area, and / or adjust or modify the size and / or position, quantity, type, content, etc. of the layout of various items in the view display area. In some embodiments, modifying and adjusting the layout includes displaying or not displaying each view partition or the content of the items in the view partition on the screen.
[0191] The user input interface is used to send the user's input signal to the controller, or transmit the signal output from the controller to the user. Exemplarily, the control device (such as a mobile terminal or a remote controller) can send the user's input signal such as a power switch signal, a channel selection signal, a volume adjustment signal, etc. to the user input interface, and then the user input interface transfers it to the controller; or the control device can receive the output signal such as audio, video or data output from the user input interface after being processed by the controller, and display the received output signal or output the received output signal in the form of audio or vibration.
[0192] In some embodiments, the user may input a user command in a graphical user interface (GUI) displayed on the display 200, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.
[0193] It should be noted that the above embodiment is only a possible structure of the display device provided in the embodiment of the present application, and does not constitute a limitation on the display device provided in the embodiment of the present application. Fig.10 The display devices of the dual-screen display method shown are all within the scope of the display devices provided in the embodiments of the present application.
[0194] Next, the dual-screen display method provided in the embodiment of the present application is explained in detail.
[0195] Fig.10 is a flowchart of a dual-screen display method according to an exemplary embodiment, which is applied to a display device. Specifically, it can be applied to a controller included in the display device, which can be the above-mentioned Figure 5 The first controller 210 in the embodiment may also be the above Figure 5The second controller 310 in the present application is not specifically limited in this embodiment. The following embodiment is only explained by taking the display device as the execution subject. Please refer to Fig.10 , the method may include the following steps:
[0196] Step 1001: A display device plays media assets on a first display.
[0197] The display device includes a first display and a second display. Exemplarily, the first display is a main display of the display device, and the second display is a sub-display of the display device, wherein the display area of the main display is larger than the display area of the sub-display, and the display device plays media resources through the main display first. When the main display is occupied, the media resources can be played through the sub-display. Exemplarily, Fig. 9 As shown, the first image display area 2011 is the first display, and the second image display area 2021 is the second display.
[0198] In some embodiments, after the user turns on the display device, the display device can display a first interface in the first display, and the first interface includes multiple media asset controls, each of which corresponds to a media asset. If the display device detects a trigger operation on a media asset control among multiple media asset controls, it means that the user has selected the media asset. The display device can obtain the media asset identifier of the media asset, and then send a second request to the server. The second request includes the media asset identifier of the media asset. The second request is used to request the server to feedback the media asset information corresponding to the media asset identifier. After receiving the second request, the server can obtain the media asset information corresponding to the media asset identifier based on the media asset identifier. The media information includes the poster, playback address, etc. of the media asset.
[0199] The media asset identifier may be used to uniquely indicate a media asset. For example, the media asset identifier may be the name of the corresponding media asset.
[0200] As an example, see Fig.11 The display device can send a second request to the server through the first display, and receive the media resource information fed back by the server through the first display.
[0201] For example, see Fig.12 After the user turns on the display device, the display device can display a first interface including multiple media asset controls on the first display. At this time, the second display has no content to be displayed and can display default information. Fig.12 The default information is the clock.
[0202] In some embodiments, the server sends the acquired media asset information to the display device. After receiving the media asset information, the display device can switch from the first interface of the first display to the second interface, and display the poster, introduction, etc. of the media asset on the second interface, and can also display the collection control and the playback control. If the display device receives a playback instruction, the playback instruction is generated by detecting a trigger operation performed by the user on the playback control. After receiving the playback instruction, the display device can send a third media asset request to the server, and the third request includes the playback address. After receiving the third request, the server can obtain the media asset based on the playback address in the third request. The server sends the acquired media asset to the display device. After receiving the media asset, the display device can play the media asset in the first display.
[0203] As an example, see Fig.11 The display device may send a third request to the server through the first display, receive the media resource fed back by the server through the first display, and then play the media resource in the first display.
[0204] For example, see Fig.13 , the display device displays a second interface, which includes a poster, an introduction, a selection control, and a play control of the media asset. At this time, the second display can still display default information.
[0205] In order to promote user consumption, promotional information can be pushed to users during the playback of media assets.
[0206] Furthermore, the server may determine the reference time point in the stored media asset and the promotion information identifier to be pushed. As an example, for any stored media asset, the server may perform image recognition on the video frame of the any media asset, determine the time point in the any media asset at which promotion information needs to be pushed, and determine the promotion information identifier to be pushed based on the image recognition. The server may also store the media asset, the reference time point determined in the media asset, and the promotion information identifier in correspondence, and one reference time point corresponds to one promotion information identifier.
[0207] Furthermore, the server may set a reference mark at a reference time point, and store the media asset, the reference mark set in the media asset, and the promotion information identifier in correspondence with each other, and one reference mark corresponds to one promotion information identifier.
[0208] In this case, after receiving the third request, the server can obtain the media asset and the reference time point and promotion information identifier stored corresponding to the media asset based on the playback address in the third request, or can obtain the media asset and the reference mark and promotion information identifier stored corresponding to the media asset based on the playback address in the third request.
[0209] For example, see Fig.11 The display device may receive the media resource fed back by the server, the reference time point and the promotion information identifier stored corresponding to the media resource through the first display, and then play the media resource on the first display. Alternatively, the display device may receive the media resource fed back by the server, the reference mark and the promotion information identifier stored corresponding to the media resource, and then play the media resource on the first display.
[0210] Step 1002: During the process of playing the media asset, in response to the current playing state of the media asset satisfying the promotion information push condition, a first request is sent to the server, where the first request is used to request to obtain the promotion information associated with the media asset.
[0211] The promotion information may be an advertisement, and may include a product link, a poster, etc.
[0212] Among them, the current playback status of the media asset meets the promotion information push conditions, indicating that the promotion information can be pushed to the user at present.
[0213] That is, if during the process of playing the media asset, it is determined that the current playing status of the media asset meets the promotion information push condition, it means that the promotion information can be pushed, and a first request can be sent to the server so that the server can feedback the promotion information associated with the media asset.
[0214] In some embodiments, see Fig.11 During the playback of the media asset, if the first display determines that the current playback status of the media asset meets the promotion information push condition, the first display may send a promotion information acquisition instruction to the second display. After receiving the promotion information acquisition instruction, the second display may send a first request to the server, the first request being used to request the acquisition of promotion information associated with the media asset.
[0215] in, Fig.11 The first display and the second display both include chips with information processing functions.
[0216] In implementation, during the process of playing the media asset, in response to the current playing state of the media asset satisfying the promotion information push condition, sending the first request to the server includes the following three implementation methods:
[0217] The first implementation method: in the process of playing the media asset, in response to detecting the reference mark, determining that the current playing state of the media asset meets the promotion information push condition, the reference mark is used to indicate that the promotion information is pushed at the time point marked by the reference mark, and the reference mark is marked by the server based on the media asset. Obtain the promotion information identifier corresponding to the reference mark, and send a first request to the server, the first request including the promotion information identifier.
[0218] The promotion information identifier may be used to indicate a promotion information. For example, the promotion information identifier may be the name and brand of the product corresponding to the promotion information.
[0219] That is to say, during the process of the display device playing media resources through the first display, if a reference mark is detected, it means that promotional information can be pushed, that is, it is considered that the current playback status of the media resources meets the promotional information push conditions, and then the promotional information identifier corresponding to the reference mark can be obtained, and a first request for obtaining the promotional information is sent to the server, and the first request includes the promotional information identifier.
[0220] As an example, in this implementation, when the display device obtains the media asset, it also obtains the reference mark and promotion information identifier stored corresponding to the media asset, and there is a one-to-one correspondence between the reference mark and the promotion information identifier. In the process of playing the media asset, the display device can monitor the playback of the media asset in real time. If it is detected that the video frame played at a certain moment corresponds to a reference mark, it means that there is promotion information that needs to be pushed here, and it can be determined that the current playback status of the media asset meets the promotion information push conditions. Then, based on the correspondence between the reference mark and the promotion information identifier, the promotion information identifier corresponding to the reference mark is determined, and then a first request for obtaining the promotion information is sent to the server. The first request carries the determined promotion information identifier so that the server can obtain the promotion information based on the promotion information identifier.
[0221] The second implementation method: during the process of playing the media asset, the playing progress of the media asset is detected. In response to the playing progress of the media asset being at a reference time point, it is determined that the current playing state of the media asset meets the promotion information push condition, where the reference time point is the time point at which the promotion information is pushed during the playing of the media asset. The promotion information identifier corresponding to the reference time point is obtained. A first request is sent to the server, where the first request includes the promotion information identifier.
[0222] That is, during the process of the display device playing the media asset through the first display, the display device can detect the playing progress of the media asset in real time. If it is determined based on the playing progress of the media asset that the media asset is played to the reference time point, it means that the media asset has been played to the time point where the promotion information needs to be pushed, that is, it is considered that the current playing state of the media asset meets the promotion information push condition. Then, the promotion information identifier corresponding to the reference time point can be obtained, and a first request for obtaining the promotion information can be sent to the server, and the first request includes the promotion information identifier.
[0223] As an example, in this implementation, when the display device obtains the media asset, it also obtains the reference time point and promotion information identifier stored corresponding to the media asset, and there is a one-to-one correspondence between the reference time point and the promotion information identifier. In the process of playing the media asset, the display device can detect the playback progress of the media asset in real time. If it is detected that the playback progress of the media asset is at the reference time point, that is, the media asset is played to the time point where the promotion information needs to be pushed, it can be considered that the current playback status of the media asset meets the promotion information push conditions. Then, based on the correspondence between the reference time point and the promotion information identifier, the promotion information identifier corresponding to the reference time point is determined, and then a first request for obtaining the promotion information is sent to the server. The first request carries the determined promotion information identifier so that the server can obtain the promotion information based on the promotion information identifier.
[0224] A third implementation method: during the playback of the media asset, in response to a screenshot operation, determining that the current playback state of the media asset meets the promotion information push condition. Obtaining the captured reference image, the reference image includes an image of a product corresponding to the promotion information. Sending a first request to the server, the first request includes the reference image.
[0225] That is, when the display device plays the media asset through the first display, if a screenshot operation is detected, it means that the user may want to learn about a certain product, and the promotional information corresponding to the product can be pushed to the user, that is, it can be considered that the current playback status of the media asset meets the promotional information push condition. Then, the reference image captured by the screenshot operation can be obtained, and a first request including the reference image can be sent to the server. Since the reference image includes the image of the product corresponding to the promotional information, the server can obtain the promotional information based on the reference image.
[0226] In this implementation, the server does not mark the reference time point, which may be because the promotional information is pushed too frequently and the server wants to reduce the push of promotional information. However, the user is interested in the product, so the user can control the display device through a control device or gesture to perform a screenshot operation. If the display device detects a screenshot operation, it means that the user may want to learn about the product. Therefore, it can be considered that the current playback status of the media asset meets the promotional information push conditions. Then the captured reference image can be obtained, and a first request can be sent to the server. Since the reference image includes an image of the product that the user wants to know, the reference image can be included in the first request so that the server can obtain promotional information based on the reference image.
[0227] Step 1003: Receive promotion information sent by the server based on the first request.
[0228] In implementation, the server may obtain the promotion information based on the first request, and then send the obtained promotion information to the display device, and the display device may receive the promotion information sent by the server.
[0229] For example, see Fig.11 After receiving the first request, the server can feedback the promotion information to the second display based on the first request.
[0230] In implementation, the server may store multiple promotion information and multiple sets of corresponding relationships, each set of corresponding relationships being a corresponding relationship between each promotion information and a corresponding promotion information identifier. In other words, the server may store multiple promotion information, and each promotion information is stored correspondingly to a corresponding promotion information identifier.
[0231] As an example, if the first request includes a promotion information identifier, the server can directly determine the promotion information corresponding to the promotion information identifier from multiple groups of correspondences stored in the server based on the promotion information identifier, and obtain the promotion information. Alternatively, the promotion information stored corresponding to the promotion information identifier can be directly determined as the promotion information to be obtained, and the promotion information can be obtained.
[0232] As another example, if the first request includes a reference image, the server can perform image recognition on the reference image, determine the name and brand of the product in the reference image, determine the name and brand of the product as the promotional information identifier, and then obtain the promotional information based on the promotional information identifier through the method of the previous example.
[0233] Step 1004: The display device plays the promotion information on the second display.
[0234] In implementation, see Fig.11 After the second display receives the promotion information sent by the server, the promotion information can be played on the second display.
[0235] For example, see Fig.14 , media resources are played in the first display, and promotional information is played in the second display.
[0236] It should be noted that, while the promotion information is being played on the second display, the first display is still playing the media assets. That is, the playing of the promotion information and the playing of the media assets do not affect each other, so that the promotion information can be pushed to the user without affecting the user's viewing of the media assets, thereby improving the user's experience.
[0237] Furthermore, if the user is interested in the promotional information played on the second display and wants to learn more about or purchase the product promoted by the promotional information, since the area of the first display is larger than that of the second display, the promotional information can be played on the first display for easy operation.
[0238] In an implementation, in response to detecting a switch play instruction, the media asset is played in the second display, and the promotional information is played in the first display.
[0239] As an example, the switching playback instruction may be generated based on a detected switching operation, which may be performed by a user through a control device.
[0240] That is, if a switch play instruction is detected, it means that the promotion information needs to be played on a display with a larger area, that is, the promotion information can be played on the first display and the media assets can be played on the second display.
[0241] In a possible implementation, in response to a purchase operation of a product corresponding to the promotion information, if the current playback state of the media asset meets the promotion information push condition, the next promotion information associated with the media asset is obtained, and the first display is controlled to play the next promotion information in the reference area.
[0242] The reference area is any one of the top, bottom, left or right areas of the first display, and usually occupies a very small part of the first display.
[0243] That is, in this implementation, if the next promotional information needs to be pushed during the purchase operation in the first display, the next promotional information associated with the media asset can be obtained and then played in the reference area of the first display.
[0244] As an example, the controller may control the first display to play the next promotion information in the reference area.
[0245] In this way, in the process of purchasing the product corresponding to the promotional information, it will not affect the push of the next promotional information, and a better push effect can be achieved.
[0246] It should be noted that the process of obtaining the next promotional information associated with the media asset when the current playback status of the media asset meets the promotional information push conditions is the same as the process of obtaining the promotional information when the current playback status of the media asset meets the promotional information push conditions in the above embodiment. For details, please refer to the relevant description of the above embodiment, which will not be repeated in this embodiment.
[0247] In another possible implementation, in response to a purchase operation of a product corresponding to the promotional information, if the current playback state of the media asset meets the promotional information push condition, the next promotional information associated with the media asset is obtained. In response to ending the purchase operation and the playback of the media asset is not finished, the playback of the promotional information is stopped in the first display, and the playback of the media asset is stopped in the second display. The media asset is played in the first display, and the next promotional information is played in the second display.
[0248] That is, in this implementation, if the next promotional information needs to be pushed during the purchase operation in the first display, the next promotional information associated with the media asset can be obtained, but the next promotional information is not played at this time, but the next promotional information is stored first. When the purchase is completed and the media asset is not finished playing, the switch play instruction can be executed to stop playing the promotional information in the first display and stop playing the media asset in the second display, and then the content played on the first display and the second display are exchanged, that is, the media asset continues to be played in the first display, and the next promotional information is played in the second display.
[0249] As an example, the controller may control the first display to stop playing the promotion information and continue playing the media asset, and control the second display to stop playing the media asset and play the next promotion information.
[0250] In this way, when the user is purchasing the product corresponding to the promotion information, the next promotion information will not be played temporarily, which will not have any impact on the purchase operation and can improve the user experience. Playing the next promotion information after the purchase is completed can give the user a better experience of browsing the next promotion information.
[0251] In another possible implementation, in response to a purchase operation of a product corresponding to the promotion information, the second display is controlled to stop playing the media asset. In response to the end of the purchase operation and the media asset is not finished playing, the promotion information is stopped in the first display and the media asset is played in the first display.
[0252] That is to say, in this implementation, during the process of executing the purchase operation in the first display, the playing of the media can be stopped in the first display. After the purchase is completed and the playing of the media has not ended, the content played by the first display and the second display are swapped, that is, the playing of the promotional information in the first display is stopped, and the playing of the media continues in the first display.
[0253] Furthermore, the media resource may be stopped from being played in the second display, and the promotion information or the default information may be played in the first display.
[0254] As an example, the controller may control the first display to stop playing the promotion information and continue playing the media assets, and control the second display to stop playing the media assets and continue playing the promotion information or the default information.
[0255] In this way, pausing the media while the user is purchasing a product will not only allow the user to enjoy a better shopping experience, but will also not affect the user's viewing of the media and will not cause the user to miss the next promotional information, thus giving the user a better user experience.
[0256] Furthermore, the playing progress of the media asset is detected. In response to determining that the playing of the media asset is finished based on the playing progress of the media asset, the promotion information is stopped from being played on the second display.
[0257] As an example, during the media playback process, the playback progress of the media can also be detected. If the playback progress of the media is at the end time point, it can be determined that the media has been played to the end, that is, the media playback is considered to be finished, and then the controller can be used to control the second display to stop playing the promotional information.
[0258] In an embodiment of the present application, the display device includes a first display and a second display, and media assets can be played on the first display. During the process of playing the media assets, if the display device determines that the current playback status of the media assets meets the promotion information push conditions, it means that the promotion information can be pushed, and then a first request can be sent to the server. The server receives the promotion information associated with the media assets obtained based on the first request, and then plays the promotion information on the second display. In this way, when it is necessary to push promotion information, the promotion information can be played on the second display, so that the first display will not be occupied, and the first display can still play the media assets normally without waiting for the promotion information to be played before continuing to play the media assets, thereby improving the playback efficiency of the media assets and eliminating the need for users to wait, thereby improving the user experience.
[0259] It should be noted that: when the display device provided in the above embodiment performs dual-screen display, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the display device provided in the above embodiment and the dual-screen display method embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.
[0260] In some embodiments, a computer-readable storage medium is further provided, in which a computer program is stored, and when the computer program is executed by a processor, the steps of the dual-screen display method in the above embodiment are implemented. For example, the computer-readable storage medium may be a ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
[0261] It is worth noting that the computer-readable storage medium mentioned in the present application may be a non-volatile storage medium, in other words, a non-transitory storage medium.
[0262] It should be understood that all or part of the steps to implement the above embodiments can be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The computer instructions can be stored in the above-mentioned computer readable storage medium.
[0263] That is, in some embodiments, a computer program product including instructions is also provided, which, when executed on a computer, enables the computer to execute the steps of the dual-screen display method described above.
[0264] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A display device, It is characterized in that The display device comprises: A first display and a second display, wherein the first display and the second display are independent of each other, a dual hardware control system is used between the first display and the second display, the first display and the second display are configured to display different user interfaces, and any user interface further includes a selector, and the selector is used to move the position of the selector in any user interface in response to a user input so as to select a control in any user interface; a controller in communication with the first display and the second display, respectively, the controller being configured to perform presentation of any one of the user interfaces; The controller is further configured to: control the first display to play the media asset; in the process of playing the media asset, in response to the current playing state of the media asset satisfying the promotion information push condition, send a first request to the server, the first request being used to request to obtain the promotion information associated with the media asset, the promotion information including a product link and / or a poster; receive the promotion information sent by the server based on the first request; control the second display to play the promotion information; in response to detecting a switch play instruction, the switch play instruction being generated based on the detected switch operation, control the second display to play the media asset, and control the first display to play the promotion information, the area of the first display being larger than the area of the second display; The controller is further configured to: in response to a purchase operation of a product corresponding to the promotion information, if the current playback state of the media asset meets the promotion information push condition, obtain the next promotion information associated with the media asset; and control the first display to play the next promotion information in the reference area; Alternatively, in response to a purchase operation of the product corresponding to the promotion information, the second display is controlled to stop playing the media asset; in response to the end of the purchase operation and the media asset has not been played, the first display is controlled to stop playing the promotion information and the first display is controlled to play the media asset; Alternatively, in response to a purchase operation for a product corresponding to the promotional information, if the current playback status of the media asset meets the promotional information push conditions, obtain the next promotional information associated with the media asset; in response to ending the purchase operation and the media asset has not finished playing, control the first display to stop playing the promotional information, and control the second display to stop playing the media asset; control the first display to play the media asset, and control the second display to play the next promotional information.
2. The display device according to claim 1, It is characterized in that The controller, in the process of playing the media asset, in response to the current playing state of the media asset satisfying the promotion information push condition, sends a first request to the server, specifically for: During the playing of the media asset, in response to detecting a reference mark, determining that the current playing state of the media asset meets a promotion information push condition, the reference mark being used to indicate that the promotion information is pushed at a time point identified by the reference mark, and the reference mark being calibrated by the server based on the media asset; Obtaining a promotion information identifier corresponding to the reference mark; The first request is sent to the server, where the first request includes the promotion information identifier.
3. The display device according to claim 1, It is characterized in that The controller, in the process of playing the media asset, in response to the current playing state of the media asset satisfying the promotion information push condition, sends a first request to the server, specifically for: During the process of playing the media asset, detecting the playing progress of the media asset; In response to the playback progress of the media asset being at a reference time point, determining that the current playback state of the media asset meets a promotion information push condition, the reference time point being a time point at which the promotion information is pushed during the playback of the media asset; Obtaining a promotion information identifier corresponding to the reference time point; The first request is sent to the server, where the first request includes the promotion information identifier.
4. The display device according to claim 1, It is characterized in that The controller, in the process of playing the media asset, in response to the current playing state of the media asset satisfying the promotion information push condition, sends a first request to the server, specifically for: During the playing of the media asset, in response to a screenshot operation, determining that a current playing state of the media asset meets a promotion information push condition; Acquire the captured reference image, wherein the reference image includes an image of the product corresponding to the promotion information; The first request is sent to the server, wherein the first request includes the reference image.
5. The display device according to claim 1, It is characterized in that The controller is also configured to: Detecting the playback progress of the media asset; In response to determining that the playing of the media asset is finished based on the playing progress of the media asset, controlling the second display to stop playing the promotion information.
6. A dual-screen display method, It is characterized in that Applied to a display device, the display device includes a first display and a second display, the first display and the second display are independent of each other, a dual hardware control system is used between the first display and the second display, and the first display and the second display are configured to display different user interfaces; the method includes: Play the media asset in the first display; in the process of playing the media asset, in response to the current playing state of the media asset satisfying the promotion information push condition, send a first request to the server, the first request is used to request to obtain the promotion information associated with the media asset, the promotion information includes a product link and / or a poster; receive the promotion information sent by the server based on the first request; play the promotion information in the second display; in response to detecting a switch play instruction, the switch play instruction is generated based on the detected switch operation, control the second display to play the media asset, and control the first display to play the promotion information, the area of the first display is larger than the area of the second display; In response to a purchase operation of a product corresponding to the promotion information, if the current playback state of the media asset meets the promotion information push condition, obtaining the next promotion information associated with the media asset; and controlling the first display to play the next promotion information in a reference area; Alternatively, in response to a purchase operation of the product corresponding to the promotion information, the second display is controlled to stop playing the media asset; in response to the end of the purchase operation and the media asset has not been played, the first display is controlled to stop playing the promotion information and the first display is controlled to play the media asset; Alternatively, in response to a purchase operation for a product corresponding to the promotional information, if the current playback status of the media asset meets the promotional information push conditions, obtain the next promotional information associated with the media asset; in response to ending the purchase operation and the media asset has not finished playing, control the first display to stop playing the promotional information, and control the second display to stop playing the media asset; control the first display to play the media asset, and control the second display to play the next promotional information.
