A display device and a method for displaying a list of signal sources
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-14
- Publication Date
- 2026-08-14
AI Technical Summary
[0005]本申请提供了一种显示设备及信号源列表更新方法,以解决在调整信号源时,只对osd层截图无法得到媒资数据的界面图像的问题
[0016] As can be seen from the above technical solution, this application provides a display device and a method for displaying a signal source list. When the display device receives an operation instruction to adjust the signal source, it first obtains the adjustment type included in the operation instruction, which includes exiting the signal source, switching the signal source, and starting the signal source list. Then, according to the adjustment type, it calls a capture strategy to take a screenshot of the media asset data played by the current signal source. After completing the screenshot, the signal source list is updated, and the signal source is adjusted according to the operation instruction. During the process of adjusting the signal source, the display device centrally processes the task of adjusting the signal source, improving the processing efficiency of the controller. During the screenshot process, the media asset data image of the video layer is captured according to the capture strategy, solving the problem of not being able to accurately obtain a screenshot of the signal source interface when adjusting the signal source.
Smart Images

Figure CN116233526B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of display device technology, and in particular to a display device and a method for displaying a list of signal sources. Background Technology
[0002] When using smart devices similar to televisions, users can quickly and intuitively select the media data they want to play by viewing a list of recently used signal sources. This list can also be set on a display device to facilitate user selection of desired media data. The list on the display device includes the signal source used to play the media data, along with the source's name, icon, and screenshot.
[0003] The name and icon of the signal source are usually system defaults, so identifying which media data the signal source is playing mainly relies on screenshots of the signal source's interface. Screenshots are taken during the playback of media data using the signal source, capturing an image of the media data as the signal source's interface. Users select the signal source by observing these screenshots. Because the media data transmitted by the signal source may change, screenshots of the interface of the media data being played by the signal source are typically taken when adjusting the signal source to show the latest playback content.
[0004] Similar to mobile phones, mobile devices display media data through an OSD layer. However, the OSD layer has a low resolution, and on display devices with higher requirements for media data playback, a video layer is needed. When playing media data via Vidoeo, the OSD layer is set to transparent. However, when capturing the interface image, the OSD layer is screenshotted, resulting in a solid color image, which does not accurately capture the media data itself. Summary of the Invention
[0005] This application provides a method for updating the list of display devices and signal sources to solve the problem that when adjusting the signal source, it is impossible to obtain the interface image of media asset data by only taking a screenshot of the OSD layer.
[0006] On one hand, this application provides a display device, including a display and a controller. The controller is configured to:
[0007] In response to an operation command for adjusting a signal source, the adjustment type included in the operation command is obtained, the adjustment type including exiting the signal source, switching the signal source, and starting the signal source list;
[0008] Based on the adjustment type, invoke the interception strategy corresponding to the adjustment type;
[0009] The aforementioned capture strategy is used to capture the interface image of the signal source when the signal source is adjusted, so as to update the signal source list; the interface image includes the name and icon of the signal source;
[0010] Load the interface image to update the signal source list, and adjust the display status of the interface image of the signal source according to the operation instruction.
[0011] On the other hand, this application also provides a method for displaying a list of signal sources, including:
[0012] In response to an operation command for adjusting a signal source, the adjustment type included in the operation command is obtained, the adjustment type including exiting the signal source, switching the signal source, and starting the signal source list;
[0013] Based on the adjustment type, invoke the interception strategy corresponding to the adjustment type;
[0014] The aforementioned capture strategy is used to capture the interface image of the signal source when the signal source is adjusted, so as to update the signal source list; the interface image includes the name and icon of the signal source;
[0015] Load the interface image to update the signal source list, and adjust the display status of the interface image of the signal source according to the operation instruction.
[0016] As can be seen from the above technical solution, this application provides a display device and a method for displaying a signal source list. When the display device receives an operation instruction to adjust the signal source, it first obtains the adjustment type included in the operation instruction, which includes exiting the signal source, switching the signal source, and starting the signal source list. Then, according to the adjustment type, it calls a capture strategy to take a screenshot of the media asset data played by the current signal source. After completing the screenshot, the signal source list is updated, and the signal source is adjusted according to the operation instruction. During the process of adjusting the signal source, the display device centrally processes the task of adjusting the signal source, improving the processing efficiency of the controller. During the screenshot process, the media asset data image of the video layer is captured according to the capture strategy, solving the problem of not being able to accurately obtain a screenshot of the signal source interface when adjusting the signal source. Attached Figure Description
[0017] To more clearly illustrate the technical solution of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0018] Figure 1 This is a schematic diagram illustrating the operation scenario of the display device and control apparatus provided in the embodiments of this application;
[0019] Figure 2 This is a schematic diagram of the hardware architecture of a display device provided in an embodiment of this application;
[0020] Figure 3A schematic diagram illustrating the hierarchy of data played by the display device in the embodiments of this application;
[0021] Figure 4 A schematic diagram of the interactive structure for updating the signal source list of a display device provided in an embodiment of this application;
[0022] Figure 5 A flowchart illustrating the steps for updating the signal source list of a display device according to an embodiment of this application;
[0023] Figure 6 A schematic diagram illustrating the logical interaction when a display device exits a signal source, provided in an embodiment of this application.
[0024] Figure 7 A schematic diagram illustrating the logical interaction when a display device switches signal sources, provided in an embodiment of this application.
[0025] Figure 8 A schematic diagram illustrating the logical interaction of a display device activating a signal source list when playing media data, as provided in an embodiment of this application.
[0026] Figure 9 A flowchart illustrating the steps for determining the signal source type in a display device according to an embodiment of this application;
[0027] Figure 10 This application provides a flowchart for a display device to determine whether a signal source exists in the signal source list.
[0028] Figure 11 This is a schematic diagram of a display device provided in an embodiment of this application displaying an interface image according to resolution. Detailed Implementation
[0029] To make the objectives and implementation methods of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the exemplary embodiments described are only some embodiments of this application, and not all embodiments.
[0030] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.
[0031] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.
[0032] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.
[0033] The display device provided in this application can have various implementation forms, such as a television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc.
[0034] Figure 1 This is a schematic diagram illustrating the operational scenario between the display device and the control unit according to the embodiment. Figure 1 As shown, the user can operate the display device 200 through the control device 300 or the control unit 100.
[0035] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device 200 includes infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via wired means. Users can control the display device 200 by inputting user commands through buttons on the remote control, voice input, control panel input, etc.
[0036] In some embodiments, a control device 300 (such as a mobile phone, tablet computer, computer, laptop computer, etc.) may also be used to control the display device 200. For example, an application running on the control device 300 may be used to control the display device 200.
[0037] In some embodiments, the display device 200 may receive instructions not by using the control device 300 or control unit 100 described above, but by receiving user control through touch or gestures.
[0038] In some embodiments, the display device 200 can also be controlled in ways other than the control device 100 and the control device 300. For example, it can be controlled by directly receiving the user's voice commands through a module configured inside the display device 200 for acquiring voice commands, or it can be controlled by receiving the user's voice commands through a voice control device set outside the display device 200.
[0039] In some embodiments, the display device 200 also communicates with the server 400. The display device 200 may communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactive features to the display device 200. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.
[0040] like Figure 2 As shown, the display device 200 may include at least one of the following: a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.
[0041] In some embodiments, controller 250 may include a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first to an nth interface for input / output.
[0042] The display 260 may include the following components: a display screen component for displaying images; a driving component for driving image display; a component for receiving image signals output from the controller 250 and displaying video content, image content, and a menu control interface, as well as a user control UI interface, etc.
[0043] The display 260 can be an LCD display, an OLED display, or a projection display, and can also be a projection device and a projection screen.
[0044] The communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of the following: a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.
[0045] The user interface can be used to receive control signals from the control device 100 (such as an infrared remote control).
[0046] Detector 230 is used to collect signals from the external environment or to interact with the external environment. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.
[0047] The external device interface 240 may include, but is not limited to, one or more of the following: High Definition Multimedia Interface (HDMI), analog or high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. It may also be a composite input / output interface formed by multiple interfaces mentioned above.
[0048] The tuner / demodulator 210 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals. In some embodiments, the controller 250 and the tuner / demodulator 210 may be located in different separate devices, that is, the tuner / demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
[0049] The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the monitor 260, the controller 250 can execute operations related to the object selected by the user command.
[0050] In some embodiments, the controller 250 includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM (random access memory), ROM (read-only memory), a first to an nth interface for input / output, a communication bus, etc.
[0051] like Figure 3 As shown, during operation, the display device 200 can establish a connection with the signal source to acquire and play media data transmitted by the signal source. When playing media data, the display device 200 can play the media data through the OSD layer. However, the OSD layer has a lower resolution and is more suitable for rendering the UI interface, displaying playback controls, system settings menus, and other content to the user. Therefore, a video layer is added to the software architecture of the display device 200 for playing media data. The video layer has better playback effects, providing a better viewing experience for the user. When using the video layer to play media data, the OSD layer can be set to transparent.
[0052] Each time the display device 200 is activated, the user can access the signal source list to select the media data they wish to play. The signal source list includes the names and icons of multiple connected or connectable signal sources, as well as screenshots showing the media file types transmitted by the signal sources. Users can select which signal source to connect to based on the screenshots and then play the content they want to watch. To ensure more accurate display of the media data played by the signal source each time the user selects a source, a screenshot of the playback interface of the adjusted signal source is captured each time the signal source is changed (e.g., exiting or switching sources). This ensures that when the user accesses the signal source list, they can see the content of the media data previously transmitted by the signal source, facilitating user selection.
[0053] However, since the software architecture of the display device 200 includes both an OSD layer and a video layer, it is highly likely that the image captured is from the OSD layer. Since the OSD layer image is set to transparent, the captured image appears as a solid color and cannot represent the content of the media data transmitted by the signal source. This prevents users from selecting the desired signal source based on the screenshot of the signal source interface. Furthermore, applications in the display device 200 frequently adjust the signal source during operation. Each application needs to call the multimedia interface to take a screenshot when adjusting the signal source, resulting in an excessive number of signals used to call the multimedia interface and chaotic processing logic.
[0054] like Figure 4 and Figure 5 As shown, this application provides a display device 200 that centralizes the logic for adjusting the signal source and taking screenshots of the playback interface of the signal source into a transition module, thus optimizing the process of signal source adjustment and screenshotting. The display device 200 includes a display 260 and a controller 250. When executing the operation command to adjust the signal source, the controller 250 is configured to:
[0055] S100: In response to an operation command for adjusting the signal source, obtain the adjustment type contained in the operation command;
[0056] The adjustment types include exiting the signal source, switching the signal source, and starting the signal source list. Exiting the signal source refers to switching the display device 200 from playing media data transmitted by the current signal source to the display device 200's home screen, or turning off the display device 200. In this case, a screenshot of the current signal source playback screen needs to be taken before the display device 200 switches to the home screen or turns off.
[0057] Switching signal sources refers to switching from the current signal source used to transmit media data to another signal source. In this case, it's also necessary to take a screenshot of the current signal source's playback screen. When the user accesses the signal source list, they can see which signal sources have been recently connected and what content has been viewed. This helps users filter content of interest and reduces unnecessary operations. This adjustment method is commonly used when users directly input the target signal source via remote control buttons or voice commands to switch signal sources.
[0058] "Activating the signal source list" refers to the process where, during media data playback, the user wants to change the signal source and thus activates the signal source list to select a new source. The signal source list includes both connected and disconnected signal sources. Switching signal sources in this way also requires taking a screenshot of the current signal source's playback screen. Therefore, when activating the signal source list, the controller 250 controls the transition module to take a screenshot of the current screen and update the signal source list.
[0059] In some embodiments, users can input operation commands via voice, remote control, touchpad, or other means. The controller 250 responds to the operation command by parsing its content. For example, while watching a video, a user might input the command "Switch to TV5" via voice. The controller then parses the voice input and determines that the adjustment type of this operation command is switching signal sources.
[0060] S200: Invoke the interception strategy corresponding to the adjustment type according to the adjustment type;
[0061] The signal source switching in the adjustment type can include switching between signal sources or switching between a signal source and an application. Because different adjustment types differ in their execution logic and generated prompts during signal source adjustment and screenshotting, different capture strategies are required to correspond to each adjustment type. A capture strategy can be a series of execution functions or an executable file packaged from a series of execution functions. The content of the capture strategy can include the timing and method of capturing the image from the signal source when the controller 250 executes actions according to the operation instructions, as well as the content executed after capturing the image.
[0062] For example, when a user inputs an operation command to exit the signal source, the controller 250 will invoke the corresponding capture strategy based on the adjustment type "exit signal source". The capture strategy includes the following execution logic of the controller 250 when the operation command "exit signal source" is obtained: first capture the image, then generate information for returning to the homepage, and then launch the homepage.
[0063] S300: Use the aforementioned capture strategy to capture the interface image of the signal source when the signal source is adjusted, so as to update the signal source list;
[0064] The interface image includes the name and icon of the signal source. In some embodiments, due to limited display space in the signal source list, the signal source icon and name are superimposed on the interface image. The signal source icon and name typically use system default content, but in practical applications, some editable settings can be made to facilitate user selection of signal sources.
[0065] After the controller 250 invokes the interception strategy according to the adjustment type, it can continue to run according to the execution logic in the interception strategy, and capture images of the media data played by the display device 200 as the interface image of the signal source. The captured interface image can be used to update the signal source list, and can also add options to the signal source list if the current signal source is not in the list. The signal source list can be configured with multiple levels, such as signal sources connected within a few hours, signal sources connected within a few days, and signal sources that the user may select. Updated signal sources can be displayed in the signal source list according to the actual situation. The number of times a signal source is connected can also be counted and displayed in the signal source list for the user to select.
[0066] S400: Load the interface image to update the signal source list, and adjust the interface image display status of the signal source according to the operation instruction.
[0067] After the controller 250 calls the transition module to take a screenshot of the currently playing content, it will continue to update the signal source list based on the screenshotted interface image. Adjusting the interface image display state of the signal source refers to switching the display device 200 from the state of playing media data transmitted by the current signal source to the running state included in the operation command.
[0068] The execution order of updating the signal source list and adjusting the interface image display status of the signal source according to the operation command is not specified here. However, the execution order of capturing the signal source image must be ensured before adjusting the interface image display status of the signal source, so that the controller 250 can capture the playback screen of the signal source in the video layer before the signal source is adjusted, thereby realizing the update of the signal source list.
[0069] Following the above embodiment of user input voice command "switch to TV5", after the controller 250 captures the playback image of the current signal source, it switches the content played by the display device 200 from the previous signal source to the signal source corresponding to TV5, and replaces the played media data with the content of TV5.
[0070] like Figure 6 As shown, in some embodiments, when a user inputs a command to "exit the signal source," the controller is configured to:
[0071] In response to the operation command to exit the signal source, the multimedia interface is invoked to capture the interface image of the signal source and generate a first prompt message;
[0072] The system controls the display to show the first prompt message and controls the display to show a home page interface, which includes media playback controls and a system settings menu.
[0073] When the controller 250 receives an operation command to exit the signal source, it will call the transition module to execute the actions of exiting the signal source and capturing the media data images played by the signal source. The transition module only refers to a type of module used to perform actions. Its specific form is not unique. It can be used to centrally process signal source adjustment and call the multimedia interface to capture images. Its detailed structure is not the focus of this application and will not be described here.
[0074] After receiving control commands from the controller 250, the transition module calls the multimedia interface to capture the interface image of the signal source that is about to exit. The transition module is equivalent to a logic control unit under the controller 250, so it usually does not have the function of performing specific actions such as taking screenshots or adding subtitles on media data. However, the transition module can call the multimedia interface connected to it to call the multimedia interface and module with screenshot function to process the media data.
[0075] After the multimedia interface captures the interface image of the current signal source, it sends a first prompt message to the transition module. This first prompt message indicates that the screenshot was successful and provides the transition module with the file path of the interface image for retrieval. The first prompt message may also include a similar message displayed on the monitor 260 to remind the user that they are about to exit the current signal source. The first prompt message can be directly received and processed by the transition module, or it can be received and parsed by the controller 250. After parsing the first prompt message, the controller 250 controls the monitor 260 to display the text message "About to exit the current signal source," or it can play a voice prompt "About to exit the current signal source" through a connected audio device to indicate that the operation was successful to the user.
[0076] After the controller 250 controls the display 260 to send a message to the user indicating that the operation was successful, it can control the display device 200 to exit the current signal source and return to the home page of the display device 200, so that the user can select other playback spaces or set system parameters to meet their viewing needs.
[0077] like Figure 7 As shown, in some embodiments, the user selects "Channel 5" via a remote control. When the controller 250 receives a command input by the user via the remote control, it is configured to:
[0078] In response to an operation command to switch signal sources, information parameters of the target signal source are obtained, including the name of the target signal source;
[0079] The target signal source is located based on its name, and a connection is established with the target signal source.
[0080] The information parameters of the signal source include the name of the target signal source, and may also include parameters such as the address and interface used to connect to the target signal source. Based on these information parameters, the target signal source can be located and a connection established. Because the operation command for switching signal sources requires switching from the current signal source to the target signal source, the controller 250 needs to obtain relevant information about the target signal source in order to establish a connection with it; therefore, it needs to obtain the target signal source's information parameters.
[0081] For example, when a user presses the button corresponding to channel 5 using a remote control, the controller 250 has a corresponding key value. The controller 250 can find the information parameters of the target signal source corresponding to channel 5 based on the key value, and establish a connection with the target signal source based on the information parameters.
[0082] During signal source switching, to ensure a better user experience when the user re-accesses the display device 200 and selects content from the signal source list, the controller 250 also captures an image of the media data currently being played by the signal source as the interface image. This image is displayed in the signal source list along with the signal source's icon and name. Therefore, the controller is also configured to:
[0083] Before establishing a connection with the target signal source, the multimedia interface is invoked to capture the interface image of the signal source and generate a second prompt message;
[0084] Control the display to show the second prompt message.
[0085] The second prompt message is of the same type as the first prompt message, but the specific content is different. When the controller 250 receives an operation command to switch the signal source, it calls the transition module to perform the action of switching the signal source and capturing the image. The transition module calls the multimedia interface to capture the media data data screen played by the current signal source. After the multimedia interface completes the screen capture action, it generates the second prompt message.
[0086] The second prompt message may include text or voice information indicating that the signal source is about to be switched, and may also include the file path of the interface image for the transition module to access. The second prompt message can also be received by the controller 250 or the transition module. Upon receiving the second prompt message, the controller 250 will control the display 260 to show the characters "Signal source about to be switched," or will play the voice prompt message "Signal source about to be switched" through a speaker or other audio playback device, so that the user can understand the progress of the input command.
[0087] Upon receiving the second prompt, the controller 250 will adjust the signal source according to the content of the operation instruction. For example, in this embodiment, if the signal source corresponding to the button input by the user via the remote control is the signal source corresponding to TV5, the controller 250 will control the display device 200 to switch from the current signal source to the TV5 signal source.
[0088] During the signal source switching process, the controller 250 needs to ensure that a screenshot of the video layer is completed before switching to the signal source corresponding to TV5, and will verify the screenshot result. If the screenshot fails, the action of capturing the interface image of the current signal source can be repeated to ensure that the interface image of the current signal source can be captured, thereby updating the signal source information in the signal source list. Furthermore, the above embodiment is not only applicable to switching between signal sources, but also to switching between signal sources and applications, as the execution logic is similar and will not be elaborated further here.
[0089] like Figure 8 As shown, in some embodiments, the display device 200 is playing media data, and the user activates the signal source list via a remote control. At this time, the controller is configured as follows:
[0090] In response to the operation command to start the signal source list, the multimedia interface is invoked to capture the interface image of the signal source used to transmit the media data, and a third prompt message is generated;
[0091] Control the third prompt message displayed on the screen;
[0092] The interface image of the signal source is loaded into the signal source list, and the display is controlled to show the signal source list.
[0093] During the playback of media data on display device 200, users can control the display 260 to show the signal source list via remote control buttons, touchpad, voice control, or other methods. The signal source list is displayed during media data playback, allowing users to see both the currently playing media content and select other sources of interest to watch new media content. When the signal source list is open, special display methods, such as flashing or highlighting, can be used for signal sources that are currently transmitting and playing media data to indicate to the user which signal source is currently playing the media data.
[0094] However, when the signal source list is open, it can detect the user's intention to switch signal sources. Therefore, it is also necessary to capture the media asset data currently being played by the signal source and update the signal source list in a timely manner. When the signal source list is activated, it may obstruct the currently playing content, preventing the user from seeing changes in the media asset data played by the signal source in real time. Therefore, before activating the signal source list, the controller 250 needs to capture the media asset data currently being played by the video layer.
[0095] The controller 250 captures the media asset data image transmitted by the current video layer signal source by calling the transition module. After receiving the control command from the controller 250, the transition module calls the multimedia interface to capture the media asset data image transmitted by the current video layer signal source and generates a third prompt message.
[0096] The third prompt message is of the same type as the first and second prompt messages, but its content is different. The controller 250 or the transition module can receive the third prompt message. When the transition module receives the third prompt message, it can report the third prompt message to the controller 250, or it can execute subsequent actions to start the signal source list based on the third prompt message. When the controller 250 receives the third prompt message, it will send a control command to the transition module based on the parsed content to control the display 260 to update and display the signal source list.
[0097] The third prompt message includes the file path of the captured interface image. In some embodiments, the transition module can locate the interface image based on the file path and load it into the signal source list to update the signal sources in the list. In other embodiments, the controller 250 controls the transition module to locate the interface image based on the file path and update the signal source list.
[0098] like Figure 9As shown, when a user launches the signal source list, the display device 200 may be in a boot-up advertisement state. At this time, the signal source for the boot-up advertisement is the built-in signal source of the display device 200. The built-in signal source is used to play advertisements and is updated periodically. Since users rarely choose to jump to the advertisement interface during the selection process, it is necessary to determine the type of the current signal source when capturing the currently playing media data. Therefore, before executing the call to the multimedia interface to capture the interface image of the signal source used to transmit the media data, the controller 250 is also configured as follows:
[0099] Obtain the playback parameters of the signal source used to transmit the media asset data;
[0100] Based on the playback parameters, determine the signal source type of the signal source;
[0101] If the signal source is a physical signal source, then capture the interface image of the physical signal source.
[0102] The playback parameters of the signal source can be used to parse information such as the type and origin of the signal source, including the URL and interface of the signal source. The controller can determine the type of signal source by obtaining these playback parameters. The signal sources of the display device 200 include external signal sources and built-in signal sources. As described above, built-in signal sources are typically used to play advertising content pre-stored in the built-in signal source by suppliers and sponsors, and this advertising content is updated periodically. Users will see the advertising content when they launch the display device 200 or some applications.
[0103] External signal sources refer to signal sources connected via wireless or wired connections, used to play media data that the user wants to watch. These signal sources are also called physical signal sources. Therefore, when the signal source list is launched, if the content being played is an advertisement stored in the built-in signal source, there is no need to capture the advertisement's image and display it in the signal source list. Only if the signal source of the currently playing content is a physical signal source will an image of the currently playing content be captured as the signal source's interface image.
[0104] In some embodiments, the user turns on the display device 200 and controls the start of the signal source list via a remote control. At this time, the display device 200 is playing a "Juju" startup advertisement. When the user starts the signal source list, the controller 250 first obtains the signal source interface of the "Juju" startup advertisement by calling the transition module, determines that "Juju" comes from the built-in signal source of the display device 200, and then does not perform the operation of capturing the "Juju" playback screen, but directly starts the signal source list.
[0105] In other embodiments, the user activates the display device 200 and controls the signal source list via remote control. At this time, the display device 200 is playing footage from "TV5". The controller 250 first obtains the signal source interface of "TV5" by calling the transition module. If the controller determines that the signal source connected to the signal source interface is a physical signal source, it immediately calls the multimedia interface to capture the playback screen of "TV5" as the interface image of the corresponding signal source. After confirming successful capture of the interface image, the controller 250 then controls the display 260 to display the signal source list.
[0106] By identifying the signal source type, the control logic of the transition module and controller 250 can be optimized. This reduces unnecessary screenshots of boot-up ads, saves storage space, and reduces execution steps, effectively improving the execution efficiency of controller 250 and the transition module. It also prevents the signal source list from becoming cluttered, thus enhancing the user experience.
[0107] In the above embodiment, after receiving the control command from the controller 250 and capturing the media data image played by the current signal source by calling the multimedia interface, the transition module also needs to save the captured interface image for the transition module or the controller 250 to call. Therefore, when the controller executes the call to the multimedia interface to capture the interface image, it is configured as follows:
[0108] The filename of the interface image is generated by concatenating the images. The filename is used to cache the interface image in the cache space, and the filename includes the file path.
[0109] The interface image is loaded into the signal source list.
[0110] The cache space can include several storage units, which means it can store and process multiple interface images simultaneously. Users need to generate multiple interface images while using the display device 200. Storing these multiple images in the display device 200's memory space can cause memory congestion over time, thus affecting the display device 200's performance. Furthermore, during retrieval, only one image can be retrieved sequentially at a time, impacting processing efficiency. By capturing the interface images and storing them in the cache space, multiple interface images can be processed simultaneously, improving processing efficiency and saving memory space.
[0111] The filename of an interface image can contain multiple pieces of information, such as the image name, format, and storage path. Therefore, by concatenating the image name, format, and storage path, the interface image can be cached in the cache space. The transition module can also retrieve the interface image from the cache space based on its file path and load it into the signal source list, corresponding to the signal source and promptly displaying the type of media data being played by that signal source.
[0112] When the controller 250 loads the interface image into the signal source list, it also needs to determine whether the signal source list contains relevant information for the current signal source. Some signal sources are not currently loaded into the signal source list; therefore, when updating signal source information based on the interface image, it is necessary to add the signal source name, icon, and interface image to the signal source list to update the list. Thus, as... Figure 10 As shown, when the controller loads the interface image into the signal source list, it is configured as follows:
[0113] Based on the name of the signal source corresponding to the interface image, the signal source is searched in the signal source list;
[0114] If the signal source is found, the interface image corresponding to the signal source is updated according to the file path of the interface image;
[0115] If the signal source is not found, the signal source and its corresponding interface image are loaded into the signal source list.
[0116] During the playback of media data, the display device 200 may have a signal source list that includes information such as the name, icon, and interface image of the current signal source, or it may not have loaded such information yet. For a signal source list that has already loaded the current signal source, when capturing a new interface image, the interface image can be updated based on the display path of the current signal source in the signal source list and the file path of the new interface image.
[0117] For signal source lists that do not have the current signal source loaded, a new display path needs to be created in the signal source list, and the system's default signal source icon and name need to be obtained to ensure that the captured interface image has the corresponding signal source in the signal source list, thereby ensuring that the content of the current signal source can display the content that the user has been prompted to watch when the user starts the signal source list.
[0118] Checking whether the current signal source exists in the signal source list helps reduce redundant signal source options. Displaying multiple options for the same signal source in the list can mislead users, making it difficult for them to determine the latest media asset playback type. Therefore, for signal sources already loaded in the list, it's only necessary to update the list based on the path to the interface image (i.e., the display path and the file path of the interface image) to ensure that the same signal source option does not appear repeatedly in the list.
[0119] like Figure 11As shown, when a user operates the signal source list, the display device 200 will display or activate the signal source according to the user's operation. To minimize obstruction of the media data currently being played on the display device 200, the signal source list is designed to be relatively small. However, to clearly display the content of the interface image, when the user selects a signal source, the controller 250 will control the monitor 260 to display the interface image on the full screen. Therefore, the resolution of the signal source interface image differs somewhat from the resolution at the time of capture, and the interface image needs to be displayed after adjusting its resolution. At this time, the controller is configured as follows:
[0120] In response to an operation event that selects a candidate signal source from the list of signal sources, the resolution of the interface image of the candidate signal source and the resolution of the display are obtained;
[0121] The scaling factor used to display the interface image is calculated based on the resolution of the interface image of the candidate signal source and the resolution of the display.
[0122] Control the display to show the interface image according to the specified ratio.
[0123] The resolution of the interface image in the signal source list will differ from that during cropping. To avoid obscuring the content displayed on the screen, the signal source list itself is designed to be relatively small and is usually located on the side or top / bottom edge of the screen. When providing users with choices, to enrich the options, the signal source list usually displays a large number of signal source options. Therefore, the interface image size of the signal sources is further compressed, which may result in users not being able to clearly see the content of the interface image, hindering their selection.
[0124] The operation event of selecting a candidate signal source from the signal source list can refer to the user selecting to start a candidate signal source. It can also refer to the user controlling the touchpad or remote control to hover the pointer or cursor over a candidate signal source, so that the corresponding interface image of the signal source can be displayed on the screen of the display device 200, helping the user understand the type of media data played by the signal source.
[0125] The method of selecting a signal source can be pre-configured in the controller 250 according to the corresponding strategy. For example, double-clicking a signal source in the signal source list activates the signal source; or the user uses the voice command "Start TV5" to activate the signal source corresponding to "TV5". The interface image displayed for the signal source differs somewhat from the signal source activation method, so the two operation methods must be distinguished when setting the strategy. For example, the user can hover the pointer or cursor over the signal source icon in the signal source list. If the controller 250 detects that the pointer has been hovering over a candidate signal source for more than a preset time, it determines that the user wants to know the content of the media data played by this candidate signal source, and the controller 250 controls the display device to display the interface image.
[0126] When display device 200 displays the interface image of the selected signal source on its entire screen, it needs to change the resolution of the interface image for display. For example, the resolution of display device 200 can be 1366×768, 1920×1080, etc., while the resolution of the interface images in the signal source list will differ from the resolution of display device 200 due to display size limitations. To display the interface image more clearly on the screen of display device 200, controller 250 can obtain the resolution of the interface image and the resolution of display device 200 to calculate the scaling ratio of the interface image.
[0127] After successfully capturing the interface image, the controller 250 can reduce the size of the interface image and display it in the signal source list according to the scaling ratio. Similarly, when the user wants to clearly view the media playback type of the signal source on the screen of the display device 200, the interface image corresponding to the signal source in the signal source list can be enlarged and displayed on the screen of the display device 200.
[0128] Based on the above-described display device 200, some embodiments of this application also provide a method for displaying a list of signal sources, including:
[0129] In response to an operation command for adjusting a signal source, the adjustment type included in the operation command is obtained, the adjustment type including exiting the signal source, switching the signal source, and starting the signal source list;
[0130] According to the adjustment type, the interception strategy corresponding to the adjustment type is invoked. The interception strategy is used to capture the interface image of the signal source when the signal source is adjusted in order to update the signal source list interface.
[0131] The signal source list interface is updated according to the interface image, and the signal source is adjusted according to the operation instructions.
[0132] As can be seen from the above embodiments, this application provides a display device and a method for displaying a signal source list. When the display device receives an operation instruction to adjust the signal source, it first obtains the adjustment type included in the operation instruction, which includes exiting the signal source, switching the signal source, and starting the signal source list. Then, according to the adjustment type, it calls a capture strategy to take a screenshot of the media asset data played by the current signal source. After completing the screenshot, the signal source list is updated, and the signal source is adjusted according to the operation instruction. During the process of adjusting the signal source, the display device centralizes the processing of the signal source adjustment task, improving the processing efficiency of the controller. During the screenshot process, the media asset data image of the video layer is captured according to the capture strategy, solving the problem that the signal source interface screenshot cannot be accurately obtained when adjusting the signal source.
[0133] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product, which can be stored in a computer-readable storage medium.
[0134] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
[0135] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the foregoing exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be made based on the foregoing teachings. The selection and description of the above embodiments are for the purpose of better explaining the contents of this disclosure, thereby enabling those skilled in the art to better utilize the described embodiments.
Claims
1. A display device, characterized in that, include: monitor; The controller is configured as follows: In response to an operation command for adjusting a signal source, the adjustment type included in the operation command is obtained, the adjustment type including exiting the signal source, switching the signal source, and starting the signal source list; According to the adjustment type, a target interception strategy corresponding to the adjustment type is called from multiple preset interception strategies. The interception strategy includes the timing and method of intercepting the image played by the signal source, as well as the content executed after the image is intercepted. Specifically, if the adjustment type is to start the signal source list, the display is in the state of playing media data, and the signal source transmitting the media data is a physical signal source, then the control transition module calls the multimedia interface to execute the interception strategy; if the adjustment type is to start the signal source list, the display is in the state of playing media data, and the signal source transmitting the media data is a built-in signal source, then the interception strategy is not executed. The target capture strategy is used to capture the interface image of the signal source at the video layer when the signal source is adjusted, and the image is spliced to generate the file name of the interface image. The file name is used to cache the interface image to the cache space, and the file name includes the file path. Based on the name of the signal source corresponding to the interface image, the signal source is searched in the signal source list; If the signal source is found, the interface image corresponding to the signal source is updated according to the file path of the interface image; If the signal source is not found, the signal source and its corresponding interface image are loaded into the signal source list; the interface image includes the name and icon of the signal source. The interface image display state of the signal source is adjusted according to the operation command, so as to change from the state of playing the media data transmitted by the signal source to the running state corresponding to the operation command; In response to an operation event that selects a candidate signal source from the list of signal sources, the resolution of the interface image of the candidate signal source and the resolution of the display are obtained; The scaling factor used to display the interface image is calculated based on the resolution of the interface image of the candidate signal source and the resolution of the display. Control the display to show the interface image according to the specified ratio.
2. The display device according to claim 1, characterized in that, When the operation instruction contains an adjustment type of exit signal source, the controller is configured to: In response to the operation command to exit the signal source, the multimedia interface is invoked to capture the interface image of the signal source and generate a first prompt message; The system controls the display to show the first prompt message and controls the display to show a home page interface, which includes media playback controls and a system settings menu.
3. The display device according to claim 1, characterized in that, When the operation instruction includes an adjustment type of switching signal sources, the controller is configured to: In response to an operation command to switch signal sources, information parameters of the target signal source are obtained, including the name of the target signal source; The target signal source is located based on its name, and a connection is established with the target signal source.
4. The display device according to claim 3, characterized in that, When the operation instruction includes an adjustment type of switching signal sources, the controller is further configured to: Before establishing a connection with the target signal source, the multimedia interface is invoked to capture the interface image of the signal source and generate a second prompt message; Control the display to show the second prompt message.
5. The display device according to claim 1, characterized in that, When the operation instruction includes an adjustment type of "start signal source list" and the display is in the state of playing media data, the controller is configured to: In response to the operation command to start the signal source list, the multimedia interface is invoked to capture the interface image of the signal source used to transmit the media data, and a third prompt message is generated; Control the display to show the third prompt message; The interface image of the signal source is loaded into the signal source list, and the display is controlled to show the signal source list.
6. The display device according to claim 5, characterized in that, Before the controller executes the call to the multimedia interface to capture the interface image of the signal source used to transmit the media asset data, it is also configured to: Obtain the playback parameters of the signal source used to transmit the media asset data; Based on the playback parameters, determine the signal source type of the signal source; If the signal source is a physical signal source, then capture the interface image of the physical signal source.
7. A method for displaying a list of signal sources, characterized in that, include: In response to an operation command for adjusting a signal source, the adjustment type included in the operation command is obtained, the adjustment type including exiting the signal source, switching the signal source, and starting the signal source list; According to the adjustment type, a target interception strategy corresponding to the adjustment type is called from multiple preset interception strategies. The target interception strategy is used to intercept the interface image of the signal source in the video layer when the signal source is adjusted, and to splice the interface image to generate a file name. The file name is used to cache the interface image in the cache space, and the file name includes the file path. Based on the name of the signal source corresponding to the interface image, the signal source is searched in the signal source list; If the signal source is found, the interface image corresponding to the signal source is updated according to the file path of the interface image; If the signal source is not found, the signal source and its corresponding interface image are loaded into the signal source list. The interception strategy includes the timing and method of intercepting the image played by the signal source, as well as the content executed after the image is intercepted. Specifically, if the adjustment type is to start the signal source list, the display is in the state of playing media data, and the signal source transmitting the media data is a physical signal source, the control transition module calls the multimedia interface to execute the interception strategy. If the adjustment type is to start the signal source list, the display is in the state of playing media data, and the signal source transmitting the media data is a built-in signal source, the interception strategy is not executed. The signal source is adjusted according to the operation command to change from the state of playing media data transmitted by the signal source to the running state corresponding to the operation command; In response to an operation event that selects a candidate signal source from the list of signal sources, the resolution of the interface image of the candidate signal source and the resolution of the display are obtained; The scaling factor used to display the interface image is calculated based on the resolution of the interface image of the candidate signal source and the resolution of the display. Control the display to show the interface image according to the specified ratio.
Citation Information
Patent Citations
Display equipment and signal source interface display method
CN113766164A
Display device and image recognition method
CN114390329A