A screen projection control method and a display device

Abstract

This application discloses a screen casting control method and a display device. The method obtains a list of screen casting capabilities corresponding to currently supported applications on the display device. In response to a received screen casting request from the screen casting device, it determines the screen casting requirement corresponding to the request. If the screen casting requirement specifies a target application, the received screen casting content is played through the target application. If the screen casting requirement does not specify a target application, based on the type of screen casting protocol in the requirement, the preferred application in the sublist of screen casting capabilities corresponding to the type of screen casting protocol is determined, and the screen casting content is played through the preferred application. The display device can respond to screen casting requests promptly and provide flexible screen casting services to users in various screen casting scenarios, meeting users' screen casting needs and improving the user's screen casting experience.

Description

Technical Field

[0001] This application relates to the field of display technology, and in particular to a screen projection control method and display device. Background Technology

[0002] In work or life scenarios, users can use screen mirroring technology to display videos playing on small screen devices (such as mobile phones, tablets, etc.) on large screen display devices (such as TVs, projectors, etc.). With the development of screen mirroring technology and the convenience it brings to users, more and more users are watching videos by screen mirroring.

[0003] Taking casting a video from a mobile phone to a TV as an example, after the TV receives the casting request from the mobile phone, it displays the video through an application on the TV that can be used for casting. However, there are many applications on the TV that can be used for casting, and they cannot respond to casting requests in a timely manner, which affects the user experience. Summary of the Invention

[0004] This application provides a screen casting control method and a display device, which can be used to solve the technical problem that screen casting applications on a television cannot respond to screen casting requests in a timely manner.

[0005] In a first aspect, some embodiments of this application provide a display device, including a display and a controller, the controller and the display being communicatively connected, and the controller being configured to:

[0006] Get the list of screen casting capabilities for applications currently supported by the display device. The screen casting capability list includes one or more sub-lists of screen casting capabilities, which are divided according to a preset screen casting protocol.

[0007] In response to a screen mirroring request received from a screen mirroring device, determine the screen mirroring requirement corresponding to the screen mirroring request;

[0008] If the target application is specified in the screen mirroring request, the received screen mirroring content will be played through the target application;

[0009] If the target application is not specified in the screen casting request, the preferred application in the screen casting capability sublist corresponding to the screen casting protocol type is determined based on the screen casting protocol type, and the screen casting content is played through the preferred application.

[0010] Secondly, some embodiments of this application provide a screen projection control method, including the following steps:

[0011] Get the list of screen casting capabilities for the applications currently supported by the display device. The screen casting capability list includes one or more sub-lists of screen casting capabilities, which are determined according to the screen casting protocol.

[0012] In response to a screen mirroring request received from a screen mirroring device, determine the screen mirroring requirement corresponding to the screen mirroring request;

[0013] If the target application is specified in the screen mirroring request, the received screen mirroring content will be played through the target application;

[0014] If the target application is not specified in the screen casting request, the preferred application in the screen casting capability sublist corresponding to the screen casting protocol type is determined based on the screen casting protocol type, and the screen casting content is played through the preferred application.

[0015] Some embodiments of this application provide a screen casting control method and a display device, which can obtain a list of screen casting capabilities corresponding to applications currently supported for screen casting in the display device; in response to a received screen casting request sent by the screen casting device, the screen casting requirement corresponding to the screen casting request can be determined; if the target application is specified in the screen casting requirement, the received screen casting content is played through the target application; if the target application is not specified in the screen casting requirement, the preferred application in the sublist of screen casting capabilities corresponding to the screen casting protocol type can be determined based on the screen casting protocol type in the screen casting requirement, and the screen casting content is played through the preferred application; it can respond to screen casting requests in a timely manner and provide flexible screen casting services for users in multiple screen casting scenarios, meet users' screen casting needs, and improve users' screen casting experience. Attached Figure Description

[0016] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 This application illustrates operational scenarios between a display device and a control device according to some embodiments;

[0018] Figure 2 A hardware configuration block diagram of a control device 100 according to some embodiments of this application is shown;

[0019] Figure 3 A hardware configuration block diagram of a display device 200 according to some embodiments of this application is shown;

[0020] Figure 4 The present application illustrates a software configuration diagram in a display device according to some embodiments;

[0021] Figure 5 A timing diagram illustrating screen projection control in a display device according to some embodiments of this application is shown;

[0022] Figure 6AThis application illustrates a scenario diagram between a projection device and a display device in some embodiments;

[0023] Figure 6B The following are schematic diagrams illustrating scenarios of display devices in some embodiments of this application;

[0024] Figure 7 This document illustrates a timing diagram of determining the preferred application in the screen mirroring capability sublist in some embodiments of this application.

[0025] Figure 8 A timing diagram of screen projection control in a display device is shown in some embodiments of this application;

[0026] Figure 9 A timing diagram of screen projection control in a display device is shown in some embodiments of this application;

[0027] Figure 10 A timing diagram illustrating the determination of the screen casting capability list in some embodiments of this application is shown;

[0028] Figure 11 A timing diagram of a screen projection control method according to some embodiments of this application is shown. Detailed Implementation

[0029] To make the objectives, technical solutions, and advantages of the exemplary embodiments of this application clearer, the technical solutions in the exemplary embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described exemplary embodiments are only some embodiments of this application, and not all embodiments.

[0030] Based on the exemplary embodiments shown in this application, all other embodiments obtained by those skilled in the art without inventive effort are within the scope of protection of this application. Furthermore, although the disclosures in this application are presented by way of one or more exemplary examples, it should be understood that each aspect of these disclosures can independently constitute a complete technical solution.

[0031] It should be understood that the terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate, for example, to allow implementation in orders other than those given in the embodiments illustrated or described in this application.

[0032] Furthermore, the terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclusively include, for example, a product or device that includes a series of components is not necessarily limited to those that are explicitly listed, but may include other components that are not explicitly listed or that are inherent to such product or device.

[0033] The display device provided in this application can have various implementation forms, such as mobile phones, tablet computers, televisions, smart TVs, projection devices, monitors, electronic bulletin boards, electronic tables, etc. Figure 1 and Figure 2 This is one specific embodiment of the display device of this application.

[0034] Figure 1 This is a schematic diagram illustrating the operational scenario between the display device and the control unit according to the embodiment. Figure 1 As shown, the user can operate the display device 200 through the smart device 300 or the control device 100.

[0035] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via wired means. Users can control the display device 200 by inputting user commands through buttons on the remote control, voice input, control panel input, etc.

[0036] In some embodiments, a smart device 300 (such as a mobile terminal, tablet computer, computer, laptop computer, etc.) may also be used to control the display device 200. For example, an application running on the smart device 300 may be used to control the display device 200.

[0037] In some embodiments, the display device may receive instructions not through the aforementioned smart devices or control devices, but through touch or gestures.

[0038] In some embodiments, the display device 200 can also be controlled in ways other than the control device 100 and the smart device 300. For example, it can be controlled by directly receiving the user's voice commands through a module configured inside the display device 200 for acquiring voice commands, or it can be controlled by receiving the user's voice commands through a voice control device set outside the display device 200.

[0039] In some embodiments, the smart device 300 can also function as a screen projection device, controlling the display device 200 to play videos, pictures, etc. selected by the user on the screen projection device.

[0040] In some embodiments, the display device 200 also communicates with the server 400. The display device 200 may communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactive features to the display device 200. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.

[0041] Figure 2 An exemplary block diagram of the configuration of the control device 100 according to an exemplary embodiment is shown. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0042] like Figure 3 The display device 200 includes at least one of the following: a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0043] In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first interface to an nth interface for input / output.

[0044] The display 260 includes a display screen assembly for presenting images, a driving assembly for driving image display, a component for receiving image signals from the controller output, and a user control UI interface for displaying video content, image content, menu control interface, and user control UI interface.

[0045] The display 260 can be an LCD display, an OLED display, or a projection display, and can also be a projection device and a projection screen.

[0046] The communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of the following: a WIFI module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

[0047] The user interface can be used to receive control signals from the control device 100 (such as an infrared remote control).

[0048] Detector 230 is used to collect signals from the external environment or to interact with the external environment. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0049] The external device interface 240 may include, but is not limited to, one or more of the following: High Definition Multimedia Interface (HDMI), analog or high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. It may also be a composite input / output interface formed by multiple interfaces mentioned above.

[0050] The tuner / demodulator 210 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals.

[0051] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0052] The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the monitor 260, the controller 250 can execute operations related to the object selected by the user command.

[0053] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM (random access memory), ROM (read-only memory), a first to an nth interface for input / output, a communication bus, etc.

[0054] Users can input commands through a graphical user interface (GUI) displayed on the monitor 260, and the user input interface receives the user input commands through the GUI. Alternatively, users can input commands by entering specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0055] A "user interface" is the medium through which an application or operating system interacts and exchanges information with the user. It converts information from its internal form to a form that the user can accept. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0056] like Figure 4 In some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the Android runtime and system library layer (referred to as the "System Runtime Layer"), and the kernel layer.

[0057] In some embodiments, at least one application runs in the application layer. These applications may be Windows programs, system settings programs, or clock programs that come with the operating system; they may also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0058] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0059] like Figure 4As shown, the application framework layer in this embodiment includes managers, content providers, etc., wherein the managers include at least one of the following modules: ActivityManager, which interacts with all activities running in the system; LocationManager, which provides access to system location services for system services or applications; PackageManager, which retrieves various information related to application packages currently installed on the device; NotificationManager, which controls the display and clearing of notification messages; and WindowManager, which manages user interface elements including icons, windows, toolbars, wallpapers, and desktop widgets.

[0060] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling display window changes (e.g., shrinking the display window, shaking the display, distorting the display, etc.).

[0061] In some embodiments, the system runtime library layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system runs the C / C++ libraries contained in the system runtime library layer to implement the functions that the framework layer needs to perform.

[0062] In some embodiments, the kernel layer is a layer between hardware and software. For example... Figure 4 As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.

[0063] Desktop applications are applications that support screen mirroring on display devices. They are applications that are compatible with the display device hardware and can also be called system applications, launcher applications, etc. For example, the Juhaokan application in Hisense TV is a desktop application of Hisense TV.

[0064] A desktop application is an application that remains running while the display device is powered on; that is, the desktop application remains running whether it is in the foreground or background.

[0065] The display device also includes third-party applications that support screen casting (hereinafter referred to as third-party applications, such as iQiyi, LeBo, etc.). These third-party applications only maintain their running state after being started by user control or other request control.

[0066] In other words, compared to third-party applications, desktop applications are resident in memory and do not need to be launched while the display device is in use.

[0067] After a user selects content (video, image, etc.) to cast via a casting device, the display device receives the casting request and displays the content through an application available for casting on the display device. Since there are many applications available for casting on a display device, the application that the display device will use to play the content is not fixed, which affects the user experience in the casting scenario.

[0068] To enhance the user experience in screen mirroring scenarios, some embodiments of this application provide a screen mirroring control method and a display device. This method can obtain a list of screen mirroring capabilities corresponding to currently supported applications on the display device. In response to a received screen mirroring request from the screen mirroring device, it can determine the screen mirroring requirement corresponding to the request. If the screen mirroring requirement specifies a target application, the received screen mirroring content is played through the target application. If the screen mirroring requirement does not specify a target application, based on the type of screen mirroring protocol in the requirement, the preferred application in the sublist of screen mirroring capabilities corresponding to the type of screen mirroring protocol can be determined, and the screen mirroring content is played through the preferred application. This method can respond to screen mirroring requests promptly and provide flexible screen mirroring services to users in various scenarios, meeting their screen mirroring needs and improving their screen mirroring experience.

[0069] Figure 5 This application illustrates a timing diagram of screen projection control in a display device according to some embodiments. The display device 200 includes a display 260 and a controller 250, which are communicatively connected. Figure 5 As shown, the controller is configured to perform the following steps:

[0070] S310. Obtain the list of screen casting capabilities for applications currently supported by the display device.

[0071] The screen casting capability list includes one or more sub-lists of screen casting capabilities, which are divided according to preset screen casting protocols.

[0072] The default screen casting protocol can include DLNA (Digital Living Network Alliance), Miracast, and AirPlay. It should be understood that the default screen casting protocol is not limited to the above-mentioned protocols and may also include other wireless screen casting protocols.

[0073] It should be understood that the preset screen mirroring protocol may include all screen mirroring protocols supported by the screen mirroring application on the display device, or it may include some screen mirroring protocols supported by the screen mirroring application on the display device.

[0074] In some embodiments, if the preset casting protocols include DLNA, Miracast, and AirPlay, the casting capability list includes three sub-lists of casting capabilities. The first sub-list corresponds to casting applications that support the DLNA protocol, the second sub-list corresponds to casting applications that support the Miracast protocol, and the third sub-list corresponds to casting applications that support the AirPlay protocol.

[0075] In some embodiments, the preset screen mirroring protocol may include a wireless screen mirroring protocol, and the preset screen mirroring protocol may also include a wireless screen mirroring protocol and a wired screen mirroring protocol.

[0076] It's important to understand that screen mirroring applications (including desktop applications and third-party applications) may support one or more screen mirroring protocols.

[0077] For example, when the display device is powered on, the currently available applications that support screen mirroring include a desktop application, third-party application A, third-party application B, third-party application D, third-party application H, and third-party application J. The preset screen mirroring protocols include a first screen mirroring protocol, a second screen mirroring protocol, a third screen mirroring protocol, and a fourth screen mirroring protocol. Among them, the desktop application supports the first, third, and fourth screen mirroring protocols; third-party application A supports the first and third screen mirroring protocols; third-party application B supports the second and fourth screen mirroring protocols; third-party application D supports the first and third screen mirroring protocols; third-party application H supports the first and second screen mirroring protocols; and third-party application J supports the second screen mirroring protocol.

[0078] When the display device is turned on, the applications that support screen casting on the current display device will register for the screen casting monitoring service. During the registration process, based on the screen casting protocol supported by the application, the application will be added to the screen casting capability sublist corresponding to the screen casting protocol.

[0079] In some embodiments, different screen mirroring protocols correspond to different registered addresses, meaning that different screen mirroring protocols correspond to different sublists of screen mirroring capabilities.

[0080] In some embodiments, the display device can assign ports to each preset screen mirroring protocol, and applications that support screen mirroring can bind to the ports when the display device is powered on. For example, the port number of the DLNA protocol is 1900. Applications that support the DLNA protocol will register a screen mirroring listening service under port number 1900 and determine the sublist of screen mirroring capabilities corresponding to port number 1900.

[0081] It should be understood that if there are multiple preset screen casting protocols, the number of corresponding screen casting capability sublists may be less than or equal to the number of preset screen casting protocols.

[0082] In some embodiments, when the display device is turned on, if there is no application that supports a certain preset casting protocol among the applications that support casting, the number of the corresponding casting capability sublists is less than the number of preset casting protocols that exist.

[0083] For the example above, based on the preset casting protocols that include the first casting protocol, the second casting protocol, the third casting protocol, and the fourth casting protocol, the determined casting capability list includes four sub-lists: the first casting capability sub-list, the second casting capability sub-list, the third casting capability sub-list, and the fourth casting capability sub-list. The contents of each casting capability sub-list are shown in Table 1 below:

[0084] Table 1. List of Screen Casting Capabilities

[0085] Screen mirroring capability sublist content First screen mirroring capability sublist Desktop application, third-party application A, third-party application H, third-party application D Second screen mirroring capability sublist Third-party application B, third-party application H, third-party application J Third screen mirroring capability sublist Desktop application, third-party application D, third-party application A Fourth screen mirroring capability sublist Desktop applications, third-party applications B

[0086] In some embodiments, the screen casting capability sublist is stored in a preset data structure. Different preset data structures correspond to different content order in the screen casting capability sublist and different ways of storing or retrieving content data.

[0087] For example, if the preset data result is a stack, after each application registers, the information of each application is stored in the order of registration using a stack, forming a sublist of screen casting capabilities.

[0088] In some embodiments, if the screen casting capability sublist includes desktop applications, the desktop applications are set as the first selected applications in the screen casting capability sublist during the process of determining the screen casting capability sublist. If a stack is used to select screen casting capability sublists containing desktop applications, the desktop applications will be kept at the top of the stack for easy selection from the sublist.

[0089] The stack-based processing logic is simple. During the registration process of each application (non-desktop application) for the screen mirroring listening service, it can first determine whether the application at the top of the stack is a desktop application. If the application at the top of the stack is a desktop application, pop the desktop application from the stack, push the application that is being registered onto the stack, and then push the desktop application onto the stack again, ensuring that the desktop application is always at the top of the stack.

[0090] In some embodiments, if the screen casting capability sublist includes a desktop application, but the first position determined according to the preset data structure is a third-party application, the desktop application can be adjusted to the first position. That is, if the screen casting capability sublist includes a desktop application, it is guaranteed that the desktop application can be found first from the first position, so that the desktop application can respond faster as the application to start casting.

[0091] In some embodiments, regardless of whether a desktop application exists in the screen casting capability sublist, the screen casting capability sublist is stored according to a preset data structure.

[0092] like Figure 5 As shown, it also includes: S320, responding to the received screen mirroring request sent by the screen mirroring device, determining the screen mirroring requirement corresponding to the screen mirroring request.

[0093] When using a screen mirroring device, if a user needs screen mirroring service, they can select the screen mirroring control corresponding to the content to be mirrored on the screen mirroring device and send the screen mirroring request triggered by the screen mirroring control to the corresponding display device.

[0094] Figure 6A This application illustrates a scenario diagram between a projection device and a display device in some embodiments, such as... Figure 6A As shown, the user triggers a casting request by using the casting control on the content display page of the motor casting device, and then sends the casting request to the display device.

[0095] For example, if the screen mirroring request corresponds to the DLNA protocol, the screen mirroring device and the display device need to be on the same local area network to achieve the above. Figure 6A The scenario shown illustrates information interaction.

[0096] The screen casting request carries a screen casting requirement, which may include the target application to be played or the screen casting protocol.

[0097] In some embodiments, the screen casting requirement may also include the screen casting content, or the playback address corresponding to the screen casting content, etc.

[0098] In some embodiments, the screen-casting device sends the screen-casting content to the display device only after the display device responds to the screen-casting request. The screen-casting content can also be the corresponding playback address.

[0099] like Figure 5 As shown, it also includes: S330, if the target application is specified in the screen casting request, the received screen casting content is played through the target application.

[0100] It should be understood that if the target application is specified in the screen casting request, the target application is an application that exists on the display device and supports screen casting.

[0101] The target application can be a desktop application or a third-party application.

[0102] The application that provides playback of screen-cast content for users is the target application specified in the screen-casting request, which improves the user experience.

[0103] S340. If the target application for playback is not specified in the screen casting request, the preferred application in the screen casting capability sublist corresponding to the screen casting protocol type is determined based on the screen casting protocol type in the screen casting request, and the screen casting content is played through the preferred application.

[0104] It should be understood that the preferred application in the screen casting capability sublist is the first application selected from the screen casting capability sublist by a preset selection rule.

[0105] Among them, for the sublist of screen casting capabilities that includes desktop applications, the desktop application can be set as the preferred application. This makes it easier to select the desktop application from the sublist of screen casting capabilities according to preset selection rules, thereby improving the ability to play screen casting content through the desktop application and ensuring that screen casting content is played using the desktop application first.

[0106] It should be understood that desktop applications are applications that remain running while the display device is powered on. Desktop applications are resident in memory. In contrast, third-party applications need to be started by user control or other requests to maintain their running state.

[0107] In other words, if the preferred application in the sublist of casting capabilities corresponding to the casting protocol is a third-party application, the third-party application needs to be launched first, and then the casting content needs to be played through the third-party application.

[0108] The above process ensures that the screen-cast content is played primarily using the desktop application. Since the desktop application is always resident on the display device, playing screen-cast content through the application does not require launching the desktop application. In other words, prioritizing the desktop application results in faster playback speed and improves the user experience.

[0109] In some embodiments, the applications in the screen casting capability sublist are not stored according to a preset data structure, or in other words, the applications in the screen casting capability sublist are not sorted. After determining the screen casting capability sublist, the corresponding application is selected as the preferred application from the sublist. This application does not limit the method for determining the preferred application. Figure 7 This application illustrates a timing diagram showing the determination of the preferred application in the sublist of screen mirroring capabilities in some embodiments, such as... Figure 7 As shown, in step 340, based on the type of screen casting protocol in the screen casting requirement, the preferred application in the sublist of screen casting capabilities corresponding to the type of screen casting protocol is determined, specifically including the following steps:

[0110] S411. If a desktop application exists in the sublist of screen casting capabilities corresponding to the type of screen casting protocol, the desktop application is determined as the preferred application.

[0111] The sublist of screen casting capabilities is divided by preset screen casting protocols. The corresponding sublist of screen casting capabilities can be determined based on the screen casting protocol in the screen casting requirements.

[0112] Desktop applications are applications that are paired with display devices and that support screen mirroring on the display device. In other words, desktop applications are applications that are present in the display device itself. For example, the Juhaokan application in Hisense TV is a desktop application of Hisense TV.

[0113] For each screen casting protocol type, the corresponding sublist of screen casting capabilities may or may not include desktop applications.

[0114] If a desktop application exists in the corresponding screen mirroring capability sublist, select the desktop application as the preferred application.

[0115] S412. If there is no desktop application in the sublist of casting capabilities corresponding to the type of casting protocol, determine the third-party application in the sublist of casting capabilities that meets the preset first selection rule as the preferred application.

[0116] The preset first selection rule can be a random rule, a rule determined based on user habits, or a rule determined based on the order of registration.

[0117] The chosen preferred application can be any application, the application the user uses most often, or the application that was last registered when the device was turned on.

[0118] Figure 6B The following are schematic diagrams illustrating scenarios of display devices in some embodiments of this application, such as... Figure 6B As shown, the display device plays the projected content through the selected preferred application.

[0119] It should be understood that regardless of whether the applications are sorted during the determination process of the screen casting capability sublist, or whether the applications are not sorted during the determination process, if a desktop application exists in the screen casting capability sublist, the desktop application will be the preferred application.

[0120] If the screen mirroring capability sublist is stored using a preset data structure, Figure 8This application shows timing diagrams of screen projection control in a display device in some other embodiments, such as... Figure 8 As shown, in step 340, based on the type of screen casting protocol in the screen casting requirement, the preferred application in the sublist of screen casting capabilities corresponding to the type of screen casting protocol is determined, specifically including the following steps:

[0121] S421. Based on the type of screen casting protocol in the screen casting requirement, determine the sub-list of screen casting capabilities corresponding to the type of screen casting protocol.

[0122] The sublist of screen casting capabilities is divided by preset screen casting protocols. The corresponding sublist of screen casting capabilities can be determined based on the screen casting protocol in the screen casting requirements.

[0123] S422. Based on the preset second selection rule corresponding to the preset data structure of the screen casting capability sublist, determine the preferred application. The preferred application includes desktop applications or third-party applications.

[0124] The preset second selection rule can be the same as the preset first selection rule, or it can be a different rule.

[0125] For different preset data structures, the corresponding preset second selection rule may be different. For example, for the screen projection capability sublist of a stack data structure, the preset second selection rule is the data at the top of the stack, and for the screen projection capability sublist of a linked list data structure, the preset second selection rule is the data pointed to by the pointer.

[0126] Figure 9 This application shows timing diagrams of screen projection control in a display device in some other embodiments, such as... Figure 9 As shown, before obtaining the list of screen casting capabilities for applications currently supported by the display device, the controller is also configured to perform the following steps:

[0127] S301. In response to the startup of the display device, applications that support screen casting register for screen casting monitoring services.

[0128] When the display device is turned on, the applications on the display device that support screen casting will register for the screen casting monitoring service. The applications that support screen casting include system applications and various third-party applications.

[0129] In some embodiments, the controller includes a screen mirroring management module, which manages the registration of screen mirroring capabilities for each application and the scheduling of screen mirroring content.

[0130] When the display device is turned on, the screen casting capabilities of the currently installed applications on the display device are collected. In some embodiments, if the applications supporting screen casting change during the use of the display device, the screen casting capability list is updated based on the change, including application updates or application uninstallation.

[0131] The scheduling of screen-cast content refers to the system scheduling performed after the display device is screen-cast, determining whether the current screen-cast content will be played through the target application, desktop application, or third-party application.

[0132] S302. Based on the registration of screen mirroring monitoring services for each application, determine the list of screen mirroring capabilities.

[0133] Figure 10 This document illustrates a timing diagram of determining the screen mirroring capability list in some embodiments of this application, such as... Figure 10 As shown, the controller is configured to perform the following steps:

[0134] S3021. Obtain the initial port corresponding to the preset screen mirroring protocol.

[0135] The initial port is assigned by the display device to each preset screen mirroring protocol, so that applications that support screen mirroring can bind to the initial port when the display device boots up and register a screen mirroring listening service under that initial port.

[0136] For example, the initial port of the DLNA protocol is 1900. Applications that support the DLNA protocol will register a screen mirroring listening service under this port number 1900. Under the initial port 1900, the corresponding IPv4 is 239.255.255.250:1900, and the IPv6 is [FF0X::C]:1900.

[0137] S3022. Based on the screen mirroring protocol corresponding to the application, select the target port from the initial ports.

[0138] For each application installed on the display device, the corresponding target port can be selected from the initial ports according to the screen mirroring protocol of each application during the registration process.

[0139] For example, the preset screen mirroring protocols (including the first screen mirroring protocol, the second screen mirroring protocol, and the third screen mirroring protocol) correspond to the initial ports including the first port, the second port, and the third port. If the desktop application supports the first screen mirroring protocol and the third screen mirroring protocol, and the third-party application X supports the second screen mirroring protocol and the third-party application Y supports the first screen mirroring protocol and the second screen mirroring protocol, then the target ports corresponding to the desktop application are the first port and the third port, the target port corresponding to the third-party application X is the second port, and the target ports corresponding to the third-party application Y are the first port and the second port.

[0140] S3023. Based on the registered screen mirroring monitoring service and preset data structure of the application corresponding to the target port, determine the sub-list of screen mirroring capabilities.

[0141] In some embodiments, the screen casting capability sublist is stored using a preset data structure. Different preset data structures correspond to different content orders in the screen casting capability sublists, and the methods of storing or retrieving content data differ. It should be noted that the preset data structures used in the process of determining each screen casting capability sublist can be the same or different.

[0142] For example, if the preset data result is a stack, after each application registers, the information of each application is stored in the order of registration using a stack, forming a sublist of screen casting capabilities.

[0143] In some embodiments, if the screen casting capability sublist includes a desktop application, but the first position determined according to a preset data structure is a third-party application, the desktop application can be moved to the first position. That is, if the screen casting capability sublist includes a desktop application, during the process of determining the screen casting capability sublist, the desktop application is set as the first selected application in the sublist. If a stack is used to represent the screen casting capability sublist, and a desktop application exists, the desktop application will always be stored at the top of the stack, making it convenient to select the desktop application from that sublist.

[0144] S3024. Determine the screen casting capability list based on each sublist of screen casting capabilities.

[0145] Some embodiments of this application provide a screen casting control method and a display device, which can obtain a list of screen casting capabilities corresponding to currently supported applications in the display device; in response to a received screen casting request sent by the screen casting device, the screen casting requirement corresponding to the screen casting request can be determined; if the target application is specified in the screen casting requirement, the received screen casting content is played through the target application; if the target application is not specified in the screen casting requirement, the preferred application in the sublist of screen casting capabilities corresponding to the screen casting protocol type can be determined based on the screen casting protocol type in the screen casting requirement, and then the screen casting content is played through the preferred application; it can respond to screen casting requests in a timely manner and provide flexible screen casting services for users in various screen casting scenarios, meet users' screen casting needs, and improve users' screen casting experience.

[0146] To achieve screen mirroring, a screen mirroring device is required to send the screen mirroring and a display device to receive the screen mirroring. Typically, the video playing on a small screen screen mirroring device (such as a mobile phone or tablet) is displayed on a large screen display device (such as a TV or projector) using screen mirroring technology.

[0147] In response to the user's screen mirroring selection, the screen mirroring device checks if there are any display devices on its local area network that support the screen mirroring protocol supported by the application. If there are display devices that support the screen mirroring protocol, the screen mirroring device pushes a list of display devices that can be mirrored for the user to choose from.

[0148] The local area network where the projection device and the display device exist can be built through a single Wi-Fi signal transmission module or through multiple Wi-Fi signal transmission modules.

[0149] In some embodiments, there may be only one display device in the local area network that can be cast to the screen, and the casting operation can be performed directly by sending a casting request, reducing the process of selecting a casting device.

[0150] Figure 11 The diagram illustrates the timing of a screen mirroring control method according to some embodiments of this application. The method is applied between a display device and a screen mirroring device, and the display device includes a screen mirroring management module, a desktop application, a third-party application, and a target application.

[0151] It should be noted that the screen mirroring management module can be included in the controller or it can exist independently.

[0152] The screen mirroring device responds to the screen mirroring request clicked by the user by searching for a list of display devices that support screen mirroring within the local area network where the screen mirroring device is located.

[0153] The screen mirroring device responds to the target display device determined by the user from the list of display devices that support screen mirroring by sending a screen mirroring request to the target display device.

[0154] The target display device remains powered on. When the target display device is powered on, each application registers a screen mirroring monitoring service through the screen mirroring management module. Based on the screen mirroring monitoring service registered by each application, a screen mirroring capability list is determined. The screen mirroring management module collects the screen mirroring capabilities of the applications currently installed on the display device. The screen mirroring capabilities are represented by a screen mirroring capability list, which includes one or more sub-lists of screen mirroring capabilities. The sub-lists of screen mirroring capabilities are divided according to preset screen mirroring protocols. The preset screen mirroring protocols may include all screen mirroring protocols supported by the applications supported by the display device, or may include some screen mirroring protocols supported by the applications supported by the display device.

[0155] Each sublist of screen mirroring capabilities stores the applications in a stack. For screen mirroring protocols supported by desktop applications, the desktop application is placed at the top of the stack in the corresponding sublist of screen mirroring capabilities. For screen mirroring protocols not supported by desktop applications, the sublists of screen mirroring capabilities are recorded in the order in which the applications were registered.

[0156] If any of the applications that support screen mirroring change during the use of the display device, the screen mirroring capability list will be updated accordingly. These changes include application updates and application uninstallation.

[0157] The target display device determines the corresponding projection requirements based on the projection request received from the projection device.

[0158] If the target application is specified in the screen mirroring request, the received screen mirroring content will be played through the target application.

[0159] If the target application is not specified in the casting request and the casting capability sublist corresponding to the casting protocol in the casting request includes desktop applications, the received casting content will be played through the desktop application.

[0160] It should be understood that if the target application for playback is not specified in the screen casting request and the screen casting capability sublist corresponding to the screen casting protocol in the screen casting request includes a desktop application, and the desktop application can be located in the first position of the screen casting capability sublist, it is convenient to play the received screen casting content through the desktop application.

[0161] If the target application is not specified in the casting request and the casting capability sublist corresponding to the casting protocol in the casting request does not include desktop applications, the received casting content will be played through a third-party application.

[0162] It should be understood that if the target application for playback is not specified in the screen casting request and the screen casting capability sublist corresponding to the screen casting protocol in the screen casting request does not include desktop applications, the first position in the screen casting capability sublist can be a third-party application, which makes it convenient to play the received screen casting content through the third-party application.

[0163] Some embodiments of this application provide a screen casting control method and a display device, which can obtain a list of screen casting capabilities corresponding to currently supported applications in the display device; in response to a received screen casting request sent by the screen casting device, the screen casting requirement corresponding to the screen casting request can be determined; if the target application is specified in the screen casting requirement, the received screen casting content is played through the target application; if the target application is not specified in the screen casting requirement, the preferred application in the sublist of screen casting capabilities corresponding to the screen casting protocol type can be determined based on the screen casting protocol type in the screen casting requirement, and then the screen casting content is played through the preferred application; it can respond to screen casting requests in a timely manner and provide flexible screen casting services for users in various screen casting scenarios, meet users' screen casting needs, and improve users' screen casting experience.

[0164] The display device can intervene in the application playing the projected content, prioritizing the use of desktop applications to play the projected content, and can quickly respond to the start of the projected content, thus improving the start-up speed of the projected content.

[0165] For various screen projection needs, the embodiments of this application can be compatible with multiple forms. For a specified target application, the video can be played through that target application. For a non-specified target application, the desktop application is used first, so that the display device can be compatible with multiple screen projection forms corresponding to multiple playback scenarios.

[0166] Through the above process, when the user specifies a target application, the content will be played through that target application. When no target application is specified, the desktop application will be used to play the screen-cast content first. Since the desktop application is always resident on the display device, playing the screen-cast content through the application does not require launching the desktop application. In other words, when the desktop application is used first, the playback speed is faster, which improves the user experience.

[0167] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0168] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A display device, characterized by comprising: include: monitor; The controller, which is communicatively connected to the display, is configured to: Obtain a list of screen casting capabilities corresponding to applications currently supported for screen casting in the display device. The list of screen casting capabilities includes one or more sub-lists of screen casting capabilities, which are divided according to a preset screen casting protocol. In response to a screen mirroring request received from a screen mirroring device, determine the screen mirroring requirement corresponding to the screen mirroring request; If the target application is specified in the screen casting request, the received screen casting content will be played through the target application; If the target application is not specified in the screen casting request, the preferred application in the screen casting capability sublist corresponding to the screen casting protocol type is determined based on the screen casting protocol type in the screen casting request, and the screen casting content is played through the preferred application.

2. The display device of claim 1, wherein, The controller is configured to determine the preferred application in the sublist of screen casting capabilities corresponding to the type of screen casting protocol, and to do so as follows: If a desktop application exists in the sublist of screen casting capabilities corresponding to the type of screen casting protocol, the desktop application is determined to be the preferred application. If there is no desktop application in the sublist of screen casting capabilities corresponding to the type of screen casting protocol, the third-party application that meets the preset first selection rule in the sublist of screen casting capabilities is determined as the preferred application; The desktop application is an application program that is compatible with the display device.

3. The display device of claim 1, wherein, If the screen casting capability sublist is stored in a preset data structure, and the controller is configured to determine the preferred application in the screen casting capability sublist corresponding to the screen casting protocol type based on the screen casting protocol type in the screen casting requirement, the controller is configured to: Based on the type of screen casting protocol in the screen casting requirement, determine the screen casting capability sublist corresponding to the type of screen casting protocol; Based on the preset second selection rule corresponding to the preset data structure of the screen casting capability sublist, the preferred application is determined, and the preferred application includes desktop applications or third-party applications.

4. The display device of claim 1, wherein, The sublist of screen casting capabilities is stored using a preset data structure. Before obtaining the list of screen casting capabilities corresponding to the applications currently supporting screen casting on the display device, the controller is further configured as follows: In response to the startup of the display device, applications in the display device that support screen mirroring register for a screen mirroring monitoring service; Based on the application, a screen mirroring monitoring service is registered to determine the list of screen mirroring capabilities.

5. The display device of claim 4, wherein The controller is configured to: register a screen mirroring monitoring service based on the application, determine the screen mirroring capability list, and configure the controller as follows: Obtain the initial port corresponding to the preset screen projection protocol; Based on the screen mirroring protocol corresponding to the application, the target port is selected from the initial port; Based on the registered screen mirroring monitoring service of the application corresponding to the target port and the preset data structure, the screen mirroring capability sublist is determined; The screen casting capability list is determined based on each of the aforementioned sub-lists of screen casting capabilities.

6. The display device of claim 5, wherein, If the screen mirroring capability sublist includes desktop applications, the controller is further configured to: If the first position in the screen mirroring capability sublist, determined according to the preset data structure, is a third-party application, the desktop application will be moved to the first position.

7. The display device of claim 1, wherein, The controller is also configured to: If any of the applications supporting screen casting change during the use of the display device, the screen casting capability list will be updated based on the change. The change includes application updates or application uninstallation.

8. A screen projection control method, characterized by, include: Obtain a list of screen casting capabilities corresponding to applications currently supported for screen casting on the display device. The list of screen casting capabilities includes one or more sub-lists of screen casting capabilities, which are determined according to the screen casting protocol. In response to a screen mirroring request received from a screen mirroring device, determine the screen mirroring requirement corresponding to the screen mirroring request; If the target application is specified in the screen casting request, the received screen casting content will be played through the target application; If the target application is not specified in the screen casting request, the preferred application in the screen casting capability sublist corresponding to the screen casting protocol type is determined based on the screen casting protocol type in the screen casting request, and the screen casting content is played through the preferred application.

9. The screen projection control method of claim 8, wherein, If the screen mirroring capability sublist is stored in a preset data structure, determining the preferred application in the screen mirroring capability sublist corresponding to the screen mirroring protocol type in the screen mirroring requirement includes: Based on the type of screen casting protocol in the screen casting requirement, determine the screen casting capability sublist corresponding to the type of screen casting protocol; Based on the preset second selection rule corresponding to the preset data structure of the screen casting capability sublist, the preferred application is determined, and the preferred application includes desktop applications or third-party applications.

10. The screen projection control method of claim 8, wherein, The screen mirroring capability sublist is stored using a preset data structure. If the screen mirroring capability sublist includes desktop applications, the process of determining the screen mirroring capability sublist includes: If the first position in the screen mirroring capability sublist, determined according to the preset data structure, is a third-party application, the desktop application will be moved to the first position.

Images