A screen projection control method and terminal device, and display device

Abstract

The application discloses a screen projection control method and terminal equipment and display equipment. In response to a screen projection operation of a user, a first display screen displays an application list in a target display equipment. The application list includes screen projection application programs in the target display equipment. The target display equipment is a screen projection display equipment in the same local area network as the terminal equipment. In response to a second selection request of the user in the application list, a target application program is determined from the application list. Screen projection data corresponding to a screen projection request is sent to the target application program of the target display equipment. The terminal equipment displays screen projection information including information of the target application program. The application list displays all selectable application programs for the user, provides the user with the right to select, and improves user experience.

Description

Technical Field

[0001] This application relates to the field of display technology, and in particular to a screen projection control method, terminal device, and display device. Background Technology

[0002] Screen mirroring refers to the process by which a user projects a video playing on a small-screen terminal device (such as a mobile phone or tablet) onto a large-screen display device (such as a TV or projector), where the video is then displayed by a screen mirroring application. With the development of screen mirroring technology, the scenarios for screen mirroring are becoming increasingly widespread, and the number of screen mirroring applications on display devices is also increasing.

[0003] Taking casting a video played on a mobile phone to a TV as an example, when a user casts their favorite video from their mobile phone to the TV for viewing, the TV selects one of its castable applications (such as LeBao, iQiyi, and other video applications) and uses the selected application to play the video based on the received casting information.

[0004] However, after a video is cast from a terminal device to a display device, the user cannot know which application the display device is using to play the video, resulting in poor screen casting options and a reduced user experience. Summary of the Invention

[0005] This application provides a screen casting control method, a terminal device, and a display device, which can be used to solve the technical problem that, during the process of casting video from the terminal device to the display device, the user cannot know which application the display device is using to play the video, resulting in poor screen casting selectivity for the user.

[0006] This application provides a method for recording status display and a display device, which can improve the user experience of operating the display device.

[0007] In a first aspect, some embodiments of this application provide a terminal device, including a first display screen and a first controller, wherein the first controller is communicatively connected to the first display screen, and the first controller is configured to:

[0008] In response to a user's screen mirroring request, the system controls the first display screen to show a list of devices corresponding to the screen mirroring request. The list of devices includes screen mirroring devices that are on the same local area network as the terminal device.

[0009] In response to the user's first selection request in the device list, the target display device is determined from the device list, and a list of applications in the target display device is displayed, which includes screen-castable applications in the target display device;

[0010] In response to the user's second selection request in the application list, the target application is determined from the application list, and the screen casting data corresponding to the screen casting request is sent to the target application on the target display device;

[0011] The first display screen shows the casting information, which includes information about the target application.

[0012] Secondly, some embodiments of this application provide a display device, including a second display screen and a second controller, wherein the second controller is communicatively connected to the second display screen, and the second controller is configured to:

[0013] In response to the startup of the display device, the screen-casting application is activated to register the screen-casting monitoring service;

[0014] Based on the applications registered with the screen mirroring monitoring service, determine the list of applications that can be mirrored.

[0015] In response to receiving a screen mirroring request from a terminal device, the device information and a list of available screen mirroring applications will be sent to the terminal device.

[0016] In response to receiving screen mirroring data from the terminal device and information from the target application, the target application is triggered to play the playback data corresponding to the screen mirroring data.

[0017] Some embodiments of this application provide a screen casting control method, a terminal device, and a display device. In response to a user's screen casting operation, a first display screen is controlled to display a list of applications in a target display device. The application list includes screen casting applications in the target display device, which is a screen casting display device located on the same local area network as the terminal device. In response to a second selection request from the user in the application list, a target application is determined from the application list, and screen casting data corresponding to the screen casting request is sent to the target application on the target display device. Screen casting information including information about the target application is displayed on the terminal device. The application list displays all selectable applications to the user, providing the user with the right to choose and improving the user experience. Attached Figure Description

[0018] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 This application illustrates operational scenarios between a display device and a control device according to some embodiments;

[0020] Figure 2A hardware configuration block diagram of a display device according to some embodiments of this application is shown;

[0021] Figure 3 This application shows a hardware configuration block diagram of a terminal device according to some embodiments;

[0022] Figure 4 The present application illustrates a software configuration diagram in a display device according to some embodiments;

[0023] Figure 5 A schematic diagram illustrating communication between a terminal device and a display device according to some embodiments of this application is shown;

[0024] Figure 6 A schematic diagram illustrating communication between a terminal device and a display device according to some embodiments of this application is shown;

[0025] Figure 7 A timing diagram illustrating a screen projection control method between a terminal device and a display device according to some embodiments of this application is shown.

[0026] Figure 8 A timing diagram illustrating another embodiment of the screen projection control method between a terminal device and a display device according to this application is shown.

[0027] Figure 9 A schematic diagram showing a device list displayed in a terminal device according to some embodiments of this application is illustrated;

[0028] Figure 10 A schematic diagram showing an application list displayed in a terminal device according to some embodiments of this application is illustrated;

[0029] Figure 11 A schematic diagram showing an application list displayed in a terminal device according to some embodiments of this application is illustrated;

[0030] Figure 12 This application shows schematic diagrams illustrating the display of screen projection information in terminal devices according to some embodiments;

[0031] Figure 13 A timing diagram illustrating another embodiment of the screen projection control method between a terminal device and a display device according to this application is shown.

[0032] Figure 14 The illustration shows a schematic diagram of data played in a display device according to some embodiments of this application. Detailed Implementation

[0033] To make the objectives, technical solutions, and advantages of the exemplary embodiments of this application clearer, the technical solutions in the exemplary embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described exemplary embodiments are only some embodiments of this application, and not all embodiments.

[0034] Based on the exemplary embodiments shown in this application, all other embodiments obtained by those skilled in the art without inventive effort are within the scope of protection of this application. Furthermore, although the disclosures in this application are presented by way of one or more exemplary examples, it should be understood that each aspect of these disclosures can independently constitute a complete technical solution.

[0035] It should be understood that the terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate, for example, to allow implementation in orders other than those given in the embodiments illustrated or described in this application.

[0036] Furthermore, the terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclusively include, for example, a product or device that includes a series of components is not necessarily limited to those that are explicitly listed, but may include other components that are not explicitly listed or that are inherent to such product or device.

[0037] The display device provided in this application can have various implementation forms, such as a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc. Figure 1 This is one specific embodiment of the display device of this application.

[0038] Figure 1 This is a schematic diagram illustrating the operational scenario between the display device and the control unit according to the embodiment. Figure 1 As shown, the user can operate the display device 200 through the smart device 500 or the control device 100.

[0039] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via wired means. Users can input user commands through buttons on the remote control, voice input, control panel input, etc., to control the display device 200. The control device 100 can receive user input commands and convert them into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0040] In some embodiments, a smart device 500 (such as a terminal device, tablet computer, computer, laptop computer, etc.) may also be used to control the display device 200. For example, an application running on the smart device may be used to control the display device 200.

[0041] In some embodiments, the smart device 500 can also be a terminal device for screen projection. The terminal device can have various implementation forms, such as a mobile phone, smartphone, tablet computer, etc. It can project the video screen played by the application on the small-screen terminal device to the large-screen display device 200 and control the display device 200 to play the video, pictures, etc. selected by the user on the terminal device.

[0042] In some embodiments, the terminal device and the display device need to be on the same local area network, which can enable the video, pictures, etc. played on the terminal device to be played or displayed on the display device by screen mirroring.

[0043] In some embodiments, the display device 200 also communicates with the server 400. The display device 200 may communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactive features to the display device 200. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.

[0044] Figure 2 Hardware configuration block diagrams of display devices according to some embodiments of this application are shown, such as... Figure 2 As shown, the display device 200 includes at least one of the following: a tuner 210, a communicator 220, a detector 230, an external device interface 240, a second controller 250, a second display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0045] In some embodiments, the second controller 250 includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first to an nth interface for input / output.

[0046] The second display 260 includes a display screen assembly for presenting images, a driving assembly for driving image display, a component for receiving image signals output from the second controller 250, and a user control UI interface for displaying video content, image content, menu control interface, and user control UI interface.

[0047] The second display 260 may be a liquid crystal display, an OLED display, or a projection display, and may also be a projection device and a projection screen.

[0048] The communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of the following: a WIFI module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

[0049] The user interface can be used to receive control signals from the control device 100 (such as an infrared remote control).

[0050] Detector 230 is used to collect signals from the external environment or to interact with the external environment. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0051] The external device interface 240 may include, but is not limited to, one or more of the following: High Definition Multimedia Interface (HDMI), analog or high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. It may also be a composite input / output interface formed by multiple interfaces mentioned above.

[0052] The tuner / demodulator 210 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals.

[0053] In some embodiments, the second controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the second controller 250 is located, such as an external set-top box.

[0054] The second controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The second controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the second display 260, the second controller 250 can execute operations related to the object selected by the user command.

[0055] In some embodiments, the second controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM (Random Access Memory), ROM (Read-Only Memory), a first to an nth interface for input / output, a communication bus, etc.

[0056] Users can input commands through a graphical user interface (GUI) displayed on the second display 260, and the user input interface receives the user input commands through the GUI. Alternatively, users can input commands by entering specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0057] A "user interface" is the medium through which an application or operating system interacts and exchanges information with the user. It converts information from its internal form to a form that the user can accept. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0058] Figure 3 The present application shows hardware configuration block diagrams of terminal devices according to some embodiments. It should be understood that... Figure 3 The terminal device 300 shown is merely an example; the terminal device 300 may have more than... Figure 3 The diagram shows more or fewer components, or different component configurations. Figure 3 The various components shown can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.

[0059] like Figure 3 As shown, the terminal device 300 includes components such as a radio frequency (RF) circuit 310, a memory 320, a first display 330, a camera 340, a sensor 350, an audio circuit 360, a wireless Fidelity (Wi-Fi) circuit 370, a first controller 380, a Bluetooth circuit 381, and a power supply 390.

[0060] The RF circuit 310 can be used to receive and transmit signals during information transmission or calls. It can receive downlink data from the base station and hand it over to the first controller 380 for processing; it can also send uplink data to the base station.

[0061] The memory 320 can be used to store software programs and data. The first controller 380 executes various functions of the terminal device 300 and performs data processing by running the software programs or data stored in the memory 320. The memory 320 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. The memory 320 stores an operating system that enables the terminal device 300 to run. In this application, the memory 320 may store the operating system and various application programs, and may also store code that executes the methods described in the embodiments of this application.

[0062] The first display 330 can be disposed on one or more sides of the terminal device 300. The first display 330 can be used to receive input digital or character information and generate signal inputs related to user settings and function control of the terminal device 300. Specifically, it is used to collect touch operations of the user on or near it, such as clicking a button, dragging a scroll box, etc.

[0063] The first display 330 can also be used to display information input by the user or information provided to the user, as well as various menus of the terminal device 300, forming a graphical user interface (GUI). Specifically, the first display 330 can be used to display the various graphical user interfaces described in this application.

[0064] The first display 330 can also display applications and corresponding operation steps.

[0065] The terminal device 300 may also include at least one sensor 350, such as an accelerometer 351, a proximity sensor 352, a fingerprint sensor 353, and a temperature sensor 354. The terminal device 300 may also be equipped with other sensors such as a gyroscope, barometer, hygrometer, thermometer, infrared sensor, light sensor, and motion sensor.

[0066] Wi-Fi is a short-range wireless transmission technology. Terminal device 300 can be connected to a local area network (LAN) through Wi-Fi circuit 370, enabling users to access and communicate with the external network, or communicate with other devices within the LAN.

[0067] The first controller 380 is the control center of the terminal device 300. It connects various parts of the terminal through various interfaces and lines. By running or executing software programs stored in the memory 320 and calling data stored in the memory 320, it performs various functions of the terminal device 300 and processes data.

[0068] In some embodiments, the first controller 380 may include one or more processing units; the first controller 380 may also integrate an application processor and a baseband processor, wherein the application processor mainly processes the operating system, user interface and applications, and the baseband processor mainly processes wireless communication.

[0069] Camera 340 can be used to capture still images or videos. Bluetooth circuitry 381 is used to interact with other Bluetooth devices that have Bluetooth circuitry via the Bluetooth protocol. Power supply 390 (such as a battery) is used to power the various components. Audio circuitry 360, speaker 361, and microphone 362 provide an audio interface between the user and terminal device 300, wherein microphone 362 can capture the user's voice.

[0070] like Figure 4 In some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the Android runtime and system library layer (referred to as the "System Runtime Layer"), and the kernel layer.

[0071] In some embodiments, at least one application runs in the application layer. These applications may be Windows programs, system settings programs, or clock programs that come with the operating system; they may also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0072] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0073] Screen mirroring, also known as screen sharing, refers to the process of using certain technologies to push the screen, audio, video, and other resources displayed on a terminal device to a display device in real time for playback, or to push the address of the audio, video, and other resources played on a terminal device to a display device for playback, so that users can watch the corresponding screen and listen to the corresponding audio and video on the display device.

[0074] Currently, screen casting has a wide range of applications. For example, users can cast their favorite TV programs to a TV using an app on their phone. There are many apps available for screen casting on TVs, and each app can play the TV program after receiving the casting information from the phone. The TV can choose any app to play the TV program, but the user doesn't know which app on the TV is casting the TV program from their phone. The screen casting process does not provide users with the right to choose the app to receive the casting information, resulting in a poor user experience.

[0075] In some examples, screen mirroring can be achieved through an application currently being used on the display device. For instance, if application A is playing a video program on a TV, the user can cast their favorite TV program to the TV using application a on their mobile phone. The TV can then directly play the TV program through application A. It should be understood that application A and application a are applications released by the same software developer, with application A installed on the display device and application a installed on the terminal device. However, in this case, the user is still not given the right to choose which application to receive the screen mirroring information.

[0076] To provide users with the right to choose, embodiments of this application provide a screen casting control method, a terminal device, and a display device. In response to a user's screen casting request, the terminal device can control its first display to show a list of devices corresponding to the screen casting request. This list includes screen casting display devices within the same local area network as the terminal device. In response to a user's first selection request from the device list, a target display device can be determined from the list, and a list of applications on the target display device is displayed. This list includes screen casting applications on the target display device. In response to a user's second selection request from the application list, a target application can be determined from the application list, and screen casting data corresponding to the screen casting request is sent to the target application on the target display device. Screen casting information including target application information is displayed on the terminal device. In response to its startup, the display device invokes a screen casting application to register a screen casting monitoring service. Based on the applications registered with the screen casting monitoring service, a list of screen casting applications is determined. In response to receiving a screen casting request from the terminal device, the display device's information and the list of screen casting applications are sent to the terminal device. In response to receiving screen casting data from the terminal device and target application information, the target application is triggered to play playback data corresponding to the screen casting data. By providing a list of selectable applications on the display device, the system presents all available applications to the user, giving them the right to choose and improving the user experience.

[0077] Figure 5 The diagram illustrates a communication between a terminal device and a display device according to some embodiments of this application. The terminal device 300 includes a first display 330 and a first controller 380, which are communicatively connected. The display device 200 includes a second display 260 and a second controller 250, which are communicatively connected. The terminal device 300 and the display device 200 are connected wirelessly to the same wireless transmission point, meaning that the terminal device 300 and the display device 200 are within the same local area network.

[0078] It should be understood that, Figure 5 The display device is powered on and running a desktop application. This desktop application is an application that is compatible with the display device hardware; it can also be called a system application, launcher application, etc. Furthermore, this desktop application supports screen casting. For example, the Juhaokan application in Hisense TVs is a desktop application for Hisense TVs. In this application, "screen casting-enabled application" refers to an application that supports screen casting.

[0079] Figure 6The diagram illustrates another embodiment of communication between a terminal device and a display device according to some embodiments of this application. The terminal device 300 includes a first display 330 and a first controller 380, which are communicatively connected. The display device 200 includes a second display 260 and a second controller 250, which are communicatively connected. The terminal device 300 and the display device 200 are connected to the same wireless transmission point via wireless communication, meaning that the terminal device 300 and the display device 200 are in the same local area network.

[0080] It should be understood that, Figure 6 The display device is turned on and running a third-party application. The third-party application is an application that supports screen mirroring, such as video-on-demand applications like LeBao or iQiyi.

[0081] It should also be understood that in some embodiments, the display device is powered on but not running any applications, and the display device may have a desktop application that supports screen casting. Furthermore, the display device may also have a third-party application that supports screen casting.

[0082] With all the above display devices powered on, the screen projection control method between the terminal device and the display device proposed in some embodiments of this application will be described in detail with reference to the accompanying drawings.

[0083] Figure 7 This application illustrates a timing diagram of a screen projection control method between a terminal device and a display device according to some embodiments, such as... Figure 7 As shown, the first controller in the terminal device is configured to perform the following steps:

[0084] S410, in response to the user's screen mirroring operation, controls the first display screen to display the application list in the target display device.

[0085] The application list includes screen-castable applications on the target display device.

[0086] Furthermore, the target display device is a screen-projectionable display device that is on the same local area network as the terminal device. The target display device can be a screen-projectionable display device selected from multiple screen-projectionable display devices, or it can be the only screen-projectionable display device on the same local area network.

[0087] Figure 8 This illustration shows a timing diagram of a screen casting control method between a terminal device and a display device according to some embodiments of this application. If there are multiple screen casting devices within the same local area network as the terminal device, and the screen casting operation includes a screen casting request operation and a first selection request operation, such as... Figure 8As shown, in step 410, in response to the user's screen mirroring operation, the first display screen is controlled to display the application list of the target display device, and the first controller in the terminal device is configured to perform the following steps:

[0088] S411. In response to the user's screen mirroring request, control the first display screen to display the list of devices corresponding to the screen mirroring request.

[0089] The device list includes screen-projectionable display devices that are on the same local area network as the terminal device.

[0090] It should be understood that the device list includes multiple screen-castable display devices. The device list may include all screen-castable display devices that are on the same local area network as the terminal device, or some screen-castable display devices.

[0091] In some embodiments, if the device list includes a portion of screen-castable display devices, these screen-castable display devices can be determined according to preset screen-casting device habits. For example, screen-castable display devices can be determined by preset screen-casting device habits such as the number of times screen-casting data has been received in the previous few times or a large number of times screen-casting data has been received.

[0092] In response to the screen mirroring request, the application or other application currently playing multimedia resources (such as videos or pictures) on the terminal device can collect information on various screen mirroring display devices in the local area network where the terminal device is located, and determine a list of screen mirroring display devices in the local area network based on this information. The list of devices is then displayed on the first display to provide the user with the option to receive the screen mirroring.

[0093] In this application, the screen-casting display device is a display device that supports receiving screen projections. As screen projection application scenarios expand, there may be multiple display devices capable of receiving screen projections within the local area network where the terminal device is located.

[0094] For example, if the terminal device is a mobile phone, and the user uses an application on the mobile phone to watch a TV series at home, the screen-castable display devices in the local area network of the home environment include the first TV in the living room, the second TV in the living room, the first TV in the bedroom, and the second TV in the bedroom. When the user wants to watch the TV series on the first TV in the bedroom by screen casting, the user can make a screen casting request by touching or clicking the screen casting control on the interface displayed in the application on the mobile phone, or by using voice control to make a screen casting request in the application on the mobile phone.

[0095] In response to the screen mirroring request, the first display screen is controlled to show the list of devices corresponding to the screen mirroring request. In the example above, Figure 9 The diagram illustrates a list of devices displayed in a terminal device according to some embodiments of this application, such as... Figure 9As shown, the equipment list includes the first TV in the bedroom, the first TV in the living room, the second TV in the living room, and the second TV in the bedroom.

[0096] It should be understood that, Figure 9 An example of displaying a device list is provided. The device list can also be displayed on a separate page on the first display. That is, in response to the user's screen casting request, the first display screen is controlled to jump to the device selection page, and the device list corresponding to the screen casting request is displayed on the device selection page.

[0097] It should be understood that the device list can also include a living room primary TV, a living room secondary TV, a bedroom primary TV, and a bedroom secondary TV. The order in which the device list includes all screen-castable display devices can be based on the distance between each screen-castable display device and the terminal device, or on the length of time it takes for the signal of each screen-castable display device to be detected, etc.

[0098] In some embodiments, if there is only one display device in the local area network where the terminal device is located that can be used to receive screen projection, i.e., the target display device, or if there is only one screen projection-capable display device determined according to preset screen projection device habits, for example, the target display device can be determined by preset screen projection device habits such as the last screen projection receiving display device or the display device that received the most screen projection data. In response to the user's screen projection operation, controlling the first display screen to display the application list in the target display device includes:

[0099] In response to a user's screen casting request, the system can control the first display screen to show the application list of the target display device corresponding to the screen casting request. In this case, the user's operation of selecting the screen casting display device is omitted, reducing the operation for the user during the screen casting process, speeding up the user's selection process, and improving the user's screen casting experience.

[0100] S412. In response to the user's first selection request operation in the device list, determine the target display device from the device list and display the application list in the target display device.

[0101] The application list includes screen-castable applications on the target display device.

[0102] It should be understood that when a terminal device obtains each screen-castable display device, it will also obtain a list of screen-castable applications on that display device. This list of screen-castable applications includes at least one screen-castable application on the display device. For example, the list of screen-castable applications includes all screen-castable applications on the display device.

[0103] For the target display device, the list of applications can be determined based on the list of castable applications provided by the target display device.

[0104] For example, if the target display device is the first TV in the bedroom, the list of castable applications for the first TV in the bedroom includes application X, application Y, and application Z. By analyzing each application in the list of castable applications, the corresponding application list can be determined, allowing the user to select the application from the target display device for casting based on their own preferences.

[0105] In the example above, Figure 10 This application shows a schematic diagram illustrating an application list displayed in a terminal device according to some embodiments, such as... Figure 10 As shown, the application list includes application X, application Y, and application Z.

[0106] It should be understood that, Figure 10 This is just one example of displaying an application list. The application list can also be displayed on a separate page on the first display. That is, in response to the user's first selection request in the device list, the first display is controlled to jump from the device selection page to the application selection page, where the application list is displayed.

[0107] In some embodiments, the application list may also be displayed as a drop-down list of the device list. This application embodiment does not limit the display pages of the device list and the application list.

[0108] In some embodiments, the terminal device may also sort the applications in the list of castable applications based on a preset sorting strategy, and determine the application list through the sorted castable applications.

[0109] The preset sorting strategy can be a sorting strategy that determines the priority of each application in the list of castable applications, a sorting strategy that corresponds to a certain feature, or a sorting strategy that corresponds to a summary of several features.

[0110] It should be understood that preset sorting strategies can be set in various ways based on different application scenarios.

[0111] The specific sorting strategy could be based on whether each application in the list of castable applications is an application for which a membership has been purchased, or whether it corresponds to the application that made the casting request on the terminal device, or whether it conforms to preset user habits.

[0112] Among them, the applications that conform to the preset user habits can be applications that the user often uses, applications that were used in the last screen mirroring, or applications that were used in the last time the display device played multimedia resources.

[0113] In some embodiments, it can be first determined whether the castable applications include high-priority applications, and if the castable applications include high-priority applications, it can be determined that the high-priority applications are located at the first position in the application list.

[0114] Among them, the high-priority application can be the first application, the second application, or the third application; the first application is the application corresponding to the application that issued the screen casting request on the terminal device, the second application is the application for which a membership has been purchased, and the third application is the application that conforms to the preset user habits.

[0115] Figure 11 The diagram illustrates a list of applications displayed in a terminal device according to some embodiments of this application, such as... Figure 11 As shown, the application list includes application Y, application X, and application Z. Application Y is the application for which a membership has been purchased, therefore, application Y is determined to be the first application in the application list.

[0116] In some embodiments, in the application list, in addition to determining that application Y is at the first position in the list, application Y can also be marked with a special identifier.

[0117] In some embodiments, screen-castable applications are divided into corresponding sets. The first set includes a first application corresponding to the application that makes the screen-casting request on the terminal device, the second set includes a second application for which a membership has been purchased, and the third set includes a third application based on preset user habits. The order of screen-castable applications included in each set in the application list is determined according to the priority corresponding to each set.

[0118] In some embodiments, the set of divisions may include other sets besides the three sets mentioned above. For example, the application may have two tags: the application may be an application that corresponds to the application that made the screen mirroring request on the terminal device, and the application may also be an application that has purchased a membership.

[0119] For example, the list of screen-castable applications includes application O, application P, application Q, application R, application S, and application T. Screen-castable applications are divided into corresponding sets, where the first set includes application Q, the second set includes application R and application P, and the third set includes application S. Applications that do not belong to the above three sets may not be divided or may be divided into the fourth set.

[0120] At this point, the corresponding application list is application Q, application R, application P, application S, application O, and application T.

[0121] In some embodiments, in addition to determining that applications from the first set, the second set, and / or the third set are located at the top of the list, applications from each set or a subset of the sets may be marked with special identifiers in the application list.

[0122] In some embodiments, if there are M recommended applications among the screen-castable applications, the recommended applications are set from the first to the Nth position in the application list based on a preset first priority, where N is greater than or equal to M.

[0123] It should be understood that for each recommended application, there may be one or more applications; for example, for a purchased membership, the recommended applications include application R and application P.

[0124] Correspondingly, we determine the situation where the number of recommended applications in the application list may be higher than the number of recommended application categories, that is, the total number of all recommended applications is higher than the total number of recommended application categories.

[0125] The recommended applications include a first application corresponding to the application that issued the screen mirroring request on the terminal device, a second application for which a membership has been purchased, and / or a third application that conforms to preset user habits.

[0126] In some embodiments, the list of castable applications may include a subset of applications.

[0127] For example, the application list may include applications divided into a first set, a second set, and a third set, or it may include recommended applications.

[0128] For example, if there are many screen-castable applications, and the number of screen-castable applications exceeds a preset threshold, this section of applications can be hidden, or a hide control can be used to temporarily hide some applications that do not belong to the collection or are not among the recommended applications. If the user needs the hidden applications, they can click the hide control to display those applications.

[0129] S420, In response to the user's second selection request in the application list, determine the target application from the application list.

[0130] Users can select the applications they want to project onto the target display device from the application list, giving them the right to choose which applications to use.

[0131] If you select an application that corresponds to the application that sent the screen mirroring request on your terminal device, you can quickly mirror your screen through that application. If you select an application for which you have a paid membership, you can enjoy the benefits of membership during screen mirroring, such as ad-free viewing. If you select an application that matches your preset user habits, you can provide a familiar viewing experience during screen mirroring.

[0132] S430: Send the screen casting data corresponding to the screen casting request to the target application on the target display device.

[0133] In this context, screen casting data can be understood as data related to the target application playing screen-cast multimedia resources and images on the target display device. Screen casting data can be the playback address of multimedia resources, screenshot data, etc., depending on the specific screen casting protocol. For different screen casting protocols and different screen casting content, the corresponding screen casting data will differ.

[0134] S440 displays the projection information on the first display screen.

[0135] The screen mirroring information includes information about the target application.

[0136] In some embodiments, the projection information can be displayed in the display area of ​​the original multimedia resources on the terminal device, so that users can clearly understand which application on the target display device is playing the projection.

[0137] For example, when a user holds the terminal device, the plane where the display area is located is parallel to the plane where the user is located, and the projected information can be located in the middle, bottom, top, or lower right position of the display area.

[0138] Figure 12 The following are schematic diagrams illustrating the display of screen projection information in terminal devices according to some embodiments of this application, such as... Figure 12 As shown, a window or area displaying screen casting information is shown in the display area. For example, if the target display device is the bedroom TV and the target application is application Q, the window or area will display: "Screen casting to the bedroom TV, currently playing using application Q".

[0139] In some embodiments, step 440 is performed after receiving the response information from the target display device that triggers the target application to play, and then determining the projection information by receiving the response information from the target display device that triggers the target application to play.

[0140] The response information is the information sent by the target display device to the terminal device after the target application successfully plays the screen projection data.

[0141] This application provides a screen casting control method and a terminal device. In response to a user's screen casting request, the terminal device can control its first display to show a list of devices corresponding to the screen casting request. This list includes screen-castable display devices within the same local area network as the terminal device. In response to a user's first selection request from the device list, a target display device can be determined from the list, and a list of applications on the target display device is displayed. This application list includes screen-castable applications on the target display device. In response to a user's second selection request from the application list, a target application can be determined from the application list, and screen casting data corresponding to the screen casting request is sent to the target application on the target display device. Screen casting information including target application information is displayed on the terminal device. By providing a list of screen-castable applications through the display device, all selectable applications are shown to the user, giving the user the right to choose and improving the user experience.

[0142] Figure 13 This application illustrates a timing diagram of another screen projection control method between a terminal device and a display device according to some embodiments, such as... Figure 13 As shown, the second controller in the display device is configured to perform the following steps:

[0143] S510, in response to the startup of the display device, invokes the screen mirroring application to register the screen mirroring monitoring service.

[0144] When the display device is turned on, the second controller will activate the screen-casting applications on the current display device to register a screen-casting monitoring service.

[0145] In some embodiments, during the registration process, screen casting protocol information can be added to the application's information based on the screen casting protocols supported by each application.

[0146] In some embodiments, the display device can assign ports to each preset screen mirroring protocol. Screen mirroring applications bind to the ports when the display device is powered on. For example, the port number for the DLNA protocol is 1900, and applications that support the DLNA protocol will register a screen mirroring listening service under port number 1900.

[0147] It should be understood that, in one feasible implementation, all screen-castable applications on the display device will register for a screen-casting monitoring service.

[0148] S520: Based on the applications registered with the screen mirroring monitoring service, determine the list of applications that can be mirrored.

[0149] If the application registered with the screen mirroring monitoring service is one of all applications available for screen mirroring on the display device, then the determined list of available screen mirroring applications includes all applications available for screen mirroring on the display device.

[0150] For example, the applications available for screen mirroring in the display device include application Q, application R, application P, application S, application O, and application T, and the determined list of screen mirrorable applications includes application Q, application R, application P, application S, application O, and application T.

[0151] It should be understood that when a screen-casting application registers for the screen-casting monitoring service, the application may be in a non-started state, or it may be started and in the foreground, or it may be started and running in the background; regardless of the state of each screen-casting application, it will appear in the list of screen-casting applications.

[0152] In some embodiments, if the list of screen-castable applications changes during the use of the display device, the list of screen-castable applications will also change. The changes may include the installation of applications not installed on the display device or the uninstallation of applications already installed on the display device.

[0153] In some embodiments, at least one castable application may be tagged based on a preset tagging strategy, and a list of castable applications may be determined based on the tagging of at least one castable application.

[0154] The preset tagging strategy can be to tag purchased applications with a first symbol and applications that conform to preset user habits with a second symbol, so that some applications in the list of castable applications have tagging information, making it easier for the mobile terminal to identify whether the application is a purchased application or an application that conforms to preset user habits.

[0155] Users can initiate a screen mirroring request by operating and controlling the terminal device. After receiving the screen mirroring request, the second controller is further configured to perform the following steps:

[0156] S530: In response to receiving a screen mirroring request from a terminal device, the S530 sends information about the display device and a list of screen mirroring available applications to the terminal device.

[0157] The display device information and the list of castable applications can be sent to the terminal device simultaneously. The display device information and the list of castable applications can be combined in the same message and sent at the same time, or the display device information and the list of castable applications can be set in different messages and sent at the same time.

[0158] In some embodiments, when a screen mirroring request is received from a terminal device, the information of the display device can be sent to the terminal device first, and when the target display device is the current display device, the list of screen mirrorable applications can be sent to the terminal device at the same time.

[0159] In some embodiments, the terminal device sends a multicast to a specified address and port. After receiving the multicast, the display device sends its basic information via unicast. Detailed device information can be obtained based on the device description address within this basic information. The basic information includes ports for various device services (such as IP and UPnP services) and a detailed device description address, through which detailed device information can be obtained.

[0160] The terminal device receives information about the display device and a list of castable applications, and controls the display of the device list corresponding to the casting request. The device list includes castable display devices within the same local area network as the terminal device, and is a list that aggregates information about all castable display devices within the same local area network. In response to the user's first selection request from the device list, the terminal device determines the target display device from the device list and displays a list of applications on the target display device. The application list includes castable applications on the target display device, and the application list is determined based on the list of castable applications. In response to the user's second selection request from the application list, the terminal device determines the target application from the application list and sends the casting data corresponding to the casting request to the target application on the target display device.

[0161] It should be understood that sending the screen casting data corresponding to the screen casting request to the target application on the target display device can be a process of sending the target application's information and the screen casting data corresponding to the screen casting request to the target display device.

[0162] S540: In response to receiving the screen projection data from the terminal device and the information from the target application, the target application is triggered to play the playback data corresponding to the screen projection data.

[0163] Figure 14 The present application illustrates schematic diagrams of data playback in display devices according to some embodiments, such as... Figure 14 The image shows the above-mentioned users' comments. Figure 9 , Figure 11 After the terminal device performs a screen mirroring operation, the display device plays the playback data corresponding to the mirrored data. At this time... Figure 12 The terminal device displays the screen projection information.

[0164] It should be understood that if the display device is the target display device for screen mirroring, in response to receiving a screen mirroring instruction, or in response to receiving screen mirroring data and target application information from the terminal device, the second controller is configured to analyze the screen mirroring data and schedule the corresponding target application, for example, to launch the target application.

[0165] After the target application is launched, it is triggered to play the playback data corresponding to the screen casting data. The screen casting data can be related data for the target application in the target display device to play screen casting multimedia resources, or it can be the playback address of the multimedia resources, or screenshot data, depending on the specific screen casting protocol. For different screen casting protocols and different screen casting content, the corresponding screen casting data will be different.

[0166] While triggering the target application to play the corresponding playback data, a response message is also generated indicating that the target application can play the screen-cast content normally. This response message is then sent to the terminal device so that the terminal device can receive the response message, confirm the screen-cast information, and display it.

[0167] This application provides a screen casting control method, a terminal device, and a display device. In response to a user's screen casting request, the terminal device can control its first display to show a list of devices corresponding to the screen casting request. This list includes screen-castable display devices within the same local area network as the terminal device. In response to a user's first selection request from the device list, a target display device can be determined from the list, and a list of applications on the target display device can be displayed. This list includes screen-castable applications on the target display device. In response to a user's second selection request from the application list, a target application can be determined from the application list, and screen casting data corresponding to the screen casting request is sent to the target application on the target display device. Screen casting information including target application information is displayed on the terminal device. Upon its startup, the display device invokes a screen-castable application to register a screen casting monitoring service. Based on the applications registered with the screen casting monitoring service, a list of screen-castable applications is determined. In response to receiving a screen casting request from the terminal device, the display device's information and the list of screen-castable applications are sent to the terminal device. In response to receiving screen casting data from the terminal device and target application information, the target application is triggered to play playback data corresponding to the screen casting data. By providing a list of selectable applications on the display device, the system presents all available applications to the user, giving them the right to choose and improving the user experience.

[0168] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0169] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A terminal device, characterized in that, include: First display screen; A first controller, which is communicatively connected to the first display screen, is configured to: When using the first application, in response to the user's screen casting operation, a list of screen-castable applications in the target display device is obtained. The screen casting operation is an operation to cast the program of the first application to the display device. The target display device is a screen-castable display device that is in the same local area network as the terminal device. The list of screen-castable applications represents multiple applications in the display device that can play the program. Based on the list of castable applications, the first display screen is controlled to display the application list in the target display device, the application list including castable applications in the target display device; In response to a user’s second selection request in the application list, a target application is determined from the application list, and the screen casting data corresponding to the screen casting request is sent to the target application on the target display device; The first display screen shows projection information, which includes information about the target application.

2. The terminal device according to claim 1, characterized in that, If there are multiple screen-castable display devices on the same local area network as the terminal device, the step of responding to the user's screen-casting operation by obtaining the list of screen-castable applications in the target display device includes: In response to a user's screen mirroring request, the first display screen is controlled to display a list of devices corresponding to the screen mirroring request. The list of devices includes screen mirroring devices that are on the same local area network as the terminal device. In response to a user's first selection request operation in the device list, the target display device is determined from the device list; Get a list of screen-castable applications on the target display device.

3. The terminal device according to claim 1 or 2, characterized in that, The list of applications displayed on the target display device includes: Based on a preset sorting strategy, the screen-castable applications in the target display device are sorted. The list of applications that can be cast to screen is displayed according to the sorted list.

4. The terminal device according to claim 3, characterized in that, The step of sorting the castable applications in the target display device based on a preset sorting strategy includes: Determine whether the castable applications include high-priority applications, wherein the high-priority applications are a first application, a second application, or a third application; wherein the first application is the application corresponding to the application that issued the casting request on the terminal device, the second application is the application for which a membership has been purchased, and the third application is the application that conforms to preset user habits; If the castable applications include high-priority applications, then the high-priority applications are determined to be the first in the application list.

5. The terminal device according to claim 3, characterized in that, The sorting of screen-castable applications in the target display device includes: The screen-castable applications are divided into corresponding sets. The first set includes the first application corresponding to the application that sends the screen-casting request in the terminal device. The second set includes the second application for which a membership has been purchased. The third set includes the third application based on preset user habits. Based on the priority corresponding to each set, the order of the screen-castable applications included in each set in the application list is determined.

6. The terminal device according to claim 1 or 2, characterized in that, Before the projection information is displayed on the first display screen, the first controller is configured to: Upon receiving the response information from the target display device triggering the target application to play, the screen projection information is determined.

7. The terminal device according to claim 1, characterized in that, Before displaying the list of applications in the target display device, the first controller is further configured to: The application list is determined based on the list of screen-castable applications sent by the target display device.

8. A display device, characterized in that, include: Second display screen; A second controller, which is communicatively connected to the second display screen, is configured to: In response to the startup of the display device, the screen-casting application is invoked to register a screen-casting monitoring service; Based on the applications that have registered the screen mirroring monitoring service, a list of applications that can be screen mirrored is determined. In response to receiving a screen mirroring request from a terminal device, the information of the display device and the list of screen mirrorable applications are sent to the terminal device, wherein the screen mirroring request is sent by the terminal device after it has identified the display device as the target display device, and the list of screen mirrorable applications represents multiple applications in the display device that can play programs; In response to receiving the screen casting data and target application information from the terminal device, the target application is triggered to play the playback data corresponding to the screen casting data. The screen casting data and target application information are sent by the terminal device after the user selects the target application from the application list. The application list is displayed on the first display screen of the terminal device according to the list of castable applications.

9. The display device according to claim 8, characterized in that, Based on the applications that have registered with the screen mirroring monitoring service, a list of applications that can be screen mirrored is determined, and the second controller is configured as follows: At least one of the screen-castable applications is marked based on a preset marking strategy; The list of screen-castable applications is determined based on the tagging of at least one of the screen-castable applications.

10. A screen projection control method, characterized in that, Applied to terminal devices, including: When using the first application, in response to the user's screen casting operation, a list of screen-castable applications in the target display device is obtained. The screen casting operation is an operation to cast the program of the first application to the display device. The target display device is a screen-castable display device that is in the same local area network as the terminal device. The list of screen-castable applications represents multiple applications in the display device that can play the program. Based on the list of castable applications, control the display of the application list in the target display device, the application list including castable applications in the target display device; In response to a user’s second selection request in the application list, a target application is determined from the application list, and the screen casting data corresponding to the screen casting request is sent to the target application on the target display device; The screen mirroring information is displayed, including information about the target application.

11. A screen projection control method, characterized in that, Applied to display devices, including: In response to the startup of the display device, the screen-casting application is invoked to register a screen-casting monitoring service; Based on the applications that have registered the screen mirroring monitoring service, a list of applications that can be screen mirrored is determined. In response to receiving a screen mirroring request from a terminal device, the information of the display device and the list of screen mirrorable applications are sent to the terminal device, wherein the screen mirroring request is sent by the terminal device after it has identified the display device as the target display device, and the list of screen mirrorable applications represents multiple applications in the display device that can play programs; In response to receiving the screen casting data and target application information from the terminal device, the target application is triggered to play the playback data corresponding to the screen casting data. The screen casting data and target application information are sent by the terminal device after the user selects the target application from the application list. The application list is displayed on the first display screen of the terminal device according to the list of castable applications.

Images